CN111541854B - Motion vector fitting, frame rate conversion method and device and electronic equipment - Google Patents

Abstract

The present disclosure relates to the technical field of image processing, and in particular, to a motion vector fitting method, a motion vector fitting device, a frame rate conversion method and electronic equipment. The method includes: determining the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection; The fitted motion vector corresponding to the block. The present disclosure can select a suitable target fitting method according to the characteristics of the interpolation block, thereby improving the accuracy of fitting motion vectors and improving the smoothness of video playback.

Description

Motion vector fitting, frame rate conversion method and device, and electronic equipment

technical field

The present disclosure relates to the technical field of image processing, and in particular, to a motion vector fitting method, a motion vector fitting device, a frame rate conversion method, and an electronic device.

Background technique

With the continuous development of the multimedia field, people's requirements for video are getting higher and higher. In order to improve the quality of the video, it is often necessary to perform necessary conversion on the video format. Among them, the frame rate conversion technology is a very important part of the video conversion technology.

The frame rate is the frequency at which bitmap images in frame units appear continuously on the display. The existing frame rate conversion algorithm cannot effectively improve the blurring of moving objects, and there is a problem that the video playback is not smooth enough.

SUMMARY OF THE INVENTION

The purpose of the present disclosure is to provide a motion vector fitting method, a motion vector fitting device, a frame rate conversion method and an electronic device, so as to at least to a certain extent overcome the simplicity and singleness of the motion vector fitting method in the related art, which leads to false The accuracy of the combined motion vector is low, which affects the smoothness of video playback.

Other features and advantages of the present disclosure will become apparent from the following detailed description, or be learned in part by practice of the present disclosure.

According to a first aspect of the present disclosure, there is provided a motion vector fitting method, comprising:

Determine the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection;

According to each quantity, the corresponding target fitting method is determined for fitting, and the fitted motion vector corresponding to each interpolation block is obtained.

According to a second aspect of the present disclosure, there is provided a frame rate conversion method, comprising:

Obtain the fitted motion vector corresponding to each interpolation block in the image to be interpolated; wherein, the fitted motion vector is obtained by the above-mentioned motion vector fitting method;

Motion compensation interpolation is performed on the image to be interpolated using the fitted motion vector.

According to a third aspect of the present disclosure, there is provided a motion vector fitting device, comprising:

A quantity determination module, for determining the quantity of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection;

The vector fitting module is used to determine the corresponding target fitting method for fitting according to each quantity, and obtain the fitting motion vector corresponding to each interpolation block.

According to a fourth aspect of the present disclosure, there is provided a frame rate conversion device, comprising:

a motion fitting module, used to obtain the fitted motion vector corresponding to each interpolation block in the image to be interpolated; wherein, the fitted motion vector is obtained by the above-mentioned motion vector fitting method;

The motion compensation module is used to perform motion compensation interpolation on the image to be interpolated by using the fitted motion vector.

According to a fifth aspect of the present disclosure, there is provided a computer-readable medium on which a computer program is stored, and when the computer program is executed by a processor, implements the above-mentioned motion vector fitting method or frame rate conversion method.

According to a sixth aspect of the present disclosure, an electronic device is provided, characterized in that it includes:

processor; and

The memory is used for storing one or more programs, and when the one or more programs are executed by one or more processors, enables the one or more processors to implement the above-mentioned motion vector fitting method or frame rate conversion method.

In the motion vector fitting method provided by an embodiment of the present disclosure, the number of target projection blocks passing through each interpolation block is determined, the interpolation blocks are classified, and then the fitting is performed according to the target fitting method corresponding to the number , and finally obtain the fitted motion vector corresponding to each interpolation block. By classifying the interpolation blocks according to the characteristics of the interpolation blocks and selecting the corresponding target fitting method, the suitable target fitting method can be selected according to the characteristics of the interpolation blocks, thereby improving the accuracy of the fitted motion vector and improving the smoothness of video playback. Spend.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort. In the attached image:

FIG. 1 schematically shows a flowchart of a motion vector fitting method in an exemplary embodiment of the present disclosure;

2 schematically shows a flowchart of a method for determining the number of target projection blocks passing through each interpolation block on an image to be interpolated in an exemplary embodiment of the present disclosure;

3 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to each interpolation block in an exemplary embodiment of the present disclosure;

FIG. 4 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to an interpolation block by performing fitting by a fitting method based on area and reliability in an exemplary embodiment of the present disclosure;

FIG. 5 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to an interpolation block according to an overlapping area and a reliability in an exemplary embodiment of the present disclosure;

6 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to an interpolation block by performing fitting through a joint fitting method in an exemplary embodiment of the present disclosure;

FIG. 7 schematically illustrates the fitting of the first fitted motion vector and the second fitted motion vector based on the joint fitting rule and preset parameters in an exemplary embodiment of the present disclosure to obtain the fitting motion vector corresponding to the interpolation block. flow chart of the method;

FIG. 8 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to an interpolation block by performing a fitting method based on a spatiotemporal neighborhood in an exemplary embodiment of the present disclosure;

9 schematically shows a flowchart of a method for obtaining a fitted motion vector corresponding to an interpolation block according to a first interpolation block and a second interpolation block in an exemplary embodiment of the present disclosure;

FIG. 10 schematically shows the method of obtaining the fitted motion vector corresponding to the interpolation block according to the fitted motion vector corresponding to the target first interpolation block and the target second interpolation block and the distance from the interpolation block in an exemplary embodiment of the present disclosure. flow chart of the method;

FIG. 11 schematically shows a flowchart of a frame rate conversion method in an exemplary embodiment of the present disclosure;

FIG. 12 schematically shows a schematic diagram of a target projection block passing through an interpolation block in an exemplary embodiment of the present disclosure;

FIG. 13 schematically shows the composition diagram of the motion vector fitting apparatus in the exemplary embodiment of the present disclosure;

FIG. 14 schematically shows a composition diagram of a frame rate conversion apparatus in an exemplary embodiment of the present disclosure;

FIG. 15 schematically shows a schematic structural diagram of a computer system of an electronic device in an exemplary embodiment of the present disclosure.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the figures are functional entities that do not necessarily necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

In the related motion compensation frame insertion algorithm, it is usually necessary to determine the corresponding fitted motion vector for the image to be inserted. For example, the to-be-interpolated image may be divided into blocks to obtain multiple interpolation blocks, and then a corresponding fitting motion vector may be determined for each interpolation block. In the method for determining the relevant fitted motion vector, a manner of determining one motion vector as the fitted motion vector among a plurality of motion vectors passing through the interpolation block is often adopted. However, this simple, single approach often results in lower accuracy of the determined fitted motion vectors, which in turn may result in lower quality video.

In view of the above-mentioned shortcomings and deficiencies of the prior art, this exemplary embodiment provides a motion vector fitting method, which can be applied to terminal devices such as mobile phones, tablet computers, and digital cameras.

Referring to Fig. 1, the above-mentioned motion vector fitting method may include the following steps S110 to S120:

Step S110, determining the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection.

In this exemplary embodiment, motion estimation is used to obtain the motion vector corresponding to the image to be interpolated, and may include motion estimation methods such as bidirectional motion estimation; motion vector projection is used to project the motion vector to the image to be interpolated to generate a projection block corresponding to the motion vector, It can include motion vector projection methods such as distance-based motion vector projection.

In this exemplary embodiment, referring to FIG. 2 , determining the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection may include the following steps S210 to S220:

In step S210, the motion vector corresponding to the image to be interpolated is acquired, and the motion vector is projected to determine the position of the projection block corresponding to the motion vector on the image to be interpolated.

In this exemplary embodiment, the motion vector corresponding to the moving image to be interpolated may include a forward motion vector or a backward motion vector obtained by processing the image to be interpolated by bidirectional motion estimation; in addition, the motion vector corresponding to the image to be interpolated may also include Other motion vectors obtained by processing the image to be interpolated according to other motion estimation methods are not specifically limited in the present disclosure.

In this example implementation, when projecting motion vectors, distance-based motion vector projection may be used, where the distance refers to the distance from the center point of the projection block to the center point of each overlapping interpolation block; in addition, other methods may also be used. Perform motion vector projection, which is not specifically limited in the present disclosure. By projecting the motion vector, the position of the projected block corresponding to the motion vector on the image to be interpolated can be determined.

Step S220: Divide the image to be interpolated into at least one interpolation block according to a preset segmentation rule, and determine the number of target projection blocks passing through each interpolation block according to the positions of the interpolation block and the projection block on the image to be interpolated.

In this example embodiment, the preset division rule may include a preset number of interpolation blocks. At this time, the image to be interpolated may be evenly divided into interpolation blocks of the same shape and size according to the preset number of interpolation blocks. In addition, the preset segmentation rule may further include parameters such as a preset interpolation block size, and further divide the image to be interpolated into at least one interpolation block according to the parameters. It should be noted that, in order to ensure the same processing of each region in the image to be interpolated, the preset segmentation rules include segmentation rules for dividing the image to be interpolated into interpolation blocks with the same shape and size.

In this exemplary embodiment, after the image to be interpolated is divided into at least one interpolation block, the number of target projection blocks passing through each interpolation block may be determined according to the position of the projection block in the image to be interpolated. The target projection block passing through the interpolation block refers to the projection block that overlaps with the interpolation block. For example, the projection blocks shown in FIG. 12 are all target projection blocks passing through the interpolation block.

Step S120, according to each quantity, determine a corresponding target fitting method to perform fitting, and obtain a fitting motion vector corresponding to each interpolation block.

In this exemplary embodiment, after determining the number of target projection blocks passing through each interpolation block, a target fitting method corresponding to the number can be selected for fitting, and then a fitted motion vector corresponding to each interpolation block can be obtained.

For example, referring to FIG. 3 , selecting the corresponding target fitting method for fitting according to each quantity, and obtaining the fitting motion vector corresponding to each interpolation block, may include the following steps S310 to S320:

Step S310, when the number is greater than or equal to a preset threshold, perform fitting by a fitting method based on area and reliability to obtain a fitted motion vector corresponding to the interpolation block; and/or by fitting based on area and reliability The method and the motion vector fitting method based on the spatiotemporal neighborhood are jointly fitted to obtain the fitted motion vector corresponding to the interpolation block.

In this example implementation, the preset threshold can be set differently according to the requirements of different scenarios, taking a positive integer. For example, when the target projection block passing through the interpolation block is more trusted, the preset threshold can be set to a smaller value, and when the adjacent fitted motion vector is more trusted, the preset threshold can be set to a larger value, This disclosure does not make any special limitation on this.

In this example implementation, when the number of target projection blocks passing through the interpolation block is greater than or equal to a preset threshold, the fit of the motion vector corresponding to each target projection block to the interpolation block can be determined by the overlap area and the reliability. The contribution degree of the motion vector, and then determine the fitted motion vector of the interpolation block; or, it is also possible to perform joint fitting by the fitting method based on area and reliability and the motion vector fitting method based on spatiotemporal neighborhood to obtain the interpolation value. The fitted motion vector corresponding to the block. In addition, the number of target projection blocks passing through each interpolation block on the image to be interpolated can be further classified according to any rules, and then the fitting method based on area and reliability can be used for fitting, and the area-based fitting method can be used for fitting. It performs joint fitting with the reliability fitting method and the motion vector fitting method based on the spatiotemporal neighborhood, and obtains the fitted motion vectors corresponding to the interpolation blocks of different classifications respectively.

For example, when the preset threshold value is 1, by setting the classification threshold 2, the interpolation blocks can be divided into two types of interpolation blocks whose number is less than 2 and whose number is greater than or equal to 2, and then the number of interpolation blocks equal to 1 is based on The area and reliability fitting method and the spatiotemporal neighborhood-based motion vector fitting method are jointly fitted to obtain the corresponding fitted motion vector; for the interpolation blocks whose number is greater than or equal to 2, the The fitting method is fitted to obtain the fitted motion vector corresponding to the interpolation block. It should be noted that further classification may be performed according to other classification methods, which is not specifically limited in the present disclosure.

Specifically, as shown in FIG. 4 , the fitting motion vector corresponding to the interpolation block is obtained by performing a fitting method based on area and reliability, which may include the following steps S410 to S430:

Step S410, acquiring target projection blocks corresponding to the interpolation blocks, and acquiring the reliability of the motion vector corresponding to each target projection block.

Wherein, the reliability of the motion vector can be calculated according to at least one of the following parameters or a combination of multiple parameters: the sum of absolute errors (SAD) corresponding to the motion vector, the sum of absolute transformation differences (STAD), the texture gradient, the position penalty, The accuracy of the candidate MV, etc.; the specific calculation method may be summation, weighted average, etc., which is not specially limited in the present disclosure.

In this example implementation, after acquiring the target projection blocks corresponding to the interpolation blocks, the method further includes: screening the target projection blocks according to the preset filtering conditions, and deleting the target projection blocks that do not meet the preset filtering conditions.

In this example implementation, after the target projection blocks corresponding to the interpolation blocks are obtained, the target projection blocks can also be screened according to the preset screening conditions, and the target projection blocks that do not meet the preset screening conditions are deleted, so as to improve the accuracy of fitting . For example, a distance threshold can be set to delete the target projection blocks whose distance between the center point of the target projection block and the center point of the interpolation block is greater than the preset distance; for another example, by determining the repetition rate corresponding to each target projection block, And delete the target projection blocks whose repetition rate is not the previous preset number; in addition, other preset filtering conditions can also be set to filter the target projection blocks, which is not limited in the present disclosure.

Step S420: Calculate the overlapping area of each target projection block and the interpolation block.

In this exemplary embodiment, the target projection block passing through the interpolation block refers to the projection block that overlaps with the interpolation block, so the overlapping area between the target projection block and the interpolation block can be used as a parameter of the target projection block.

Step S430: Fit the motion vector corresponding to the target projection block according to the overlapping area and the reliability to obtain the fitted motion vector corresponding to the interpolation block

In this example implementation, the motion vector corresponding to each target projection block can be fitted according to the reliability of each target projection block and the overlapping area between each target projection block and the interpolation block, and then the fitted motion vector corresponding to the interpolation block is obtained. .

For example, the above-mentioned fitting the motion vector corresponding to the target projection block according to the overlap area and the reliability, to obtain the fitting motion vector corresponding to the interpolation block, as shown in FIG. 5 , may include the following steps S510 to S530:

Step S510: Calculate the product of the motion vector, overlap area and reliability corresponding to each target projection block to obtain a first product, and sum the first products corresponding to all target projection blocks to obtain a first sum of products.

In this example implementation, the first product can be obtained by calculating the product of the corresponding motion vector, overlap area and reliability for each target projection block, and the first product corresponding to all target projection blocks passing through the interpolation block is calculated. Sum the products to get the first sum of products.

Step S520: Calculate the product of the overlap area corresponding to each target projection block and the reliability to obtain a second product, and sum the second products corresponding to all target projection blocks to obtain a second sum of products.

In this example implementation, the product of the corresponding overlapping area and the reliability may be calculated for each target projection block to obtain the second product, and the corresponding second product of all target projection blocks that will pass through the interpolation block Summed to get the second sum of products.

Step S530: Calculate the quotient of the first sum of products and the second sum of products to obtain a fitted motion vector corresponding to the interpolation block.

In this example implementation, the quotient of the first sum of products and the second sum of the scene can be calculated, and the calculated quotient can be determined as the fitting motion vector corresponding to the interpolation block.

Specifically, the above-mentioned method for fitting the motion vector corresponding to the target projection block according to the overlapping area and the reliability degree to obtain the fitting motion vector corresponding to the interpolation block can be expressed as:

为计算得到拟合运动矢量，A为穿过插值块的目标投影块的数量，

为第i个目标投影块与插值块之间的重叠面积，

为第i个目标投影块的可信度，MV_i为第i个目标投影块对应的运动矢量。in,

To calculate the fitted motion vector, A is the number of target projection blocks passing through the interpolation block,

is the overlapping area between the ith target projection block and the interpolation block,

is the reliability of the i-th target projection block, and MV _i is the motion vector corresponding to the i-th target projection block.

In this example implementation, referring to FIG. 6 , the interpolation blocks are jointly fitted by the fitting method based on area and reliability and the motion vector fitting method based on spatio-temporal neighborhoods to obtain the fitting motion corresponding to the interpolation blocks. Vector, which may include the following steps S610 to S630:

Step S610, performing fitting by a fitting method based on area and reliability, to obtain a first preset parameter and a first fitting motion vector corresponding to the interpolation block.

In this example implementation, based on the target projection block that passes through the interpolation block that is greater than or equal to the preset threshold, the target projection block can be calculated by a fitting method based on area and reliability, and the corresponding interpolation block can be obtained. The first fitted motion vector of . At the same time, the first preset parameters in the process of calculating the first fitted motion vector may also be acquired for subsequent joint fitting. For example, the first preset parameter may be the number of target projection blocks, etc., which is not specifically limited in the present disclosure.

Step S620 , perform fitting by using a motion vector fitting method based on a spatiotemporal neighborhood to obtain a second preset parameter and a second fitted motion vector corresponding to the interpolation block.

In this exemplary embodiment, a second fitted motion vector may be obtained by further fitting the fitted motion vector corresponding to the adjacent interpolation block of the interpolation block by a motion vector fitting method based on the spatiotemporal domain. At the same time, the second preset parameters in the process of calculating the second fitted motion vector may also be acquired for subsequent fitting. For example, the second preset parameter may be the number of adjacent interpolation blocks, etc., which is not particularly limited in the present disclosure.

Step S630: Perform joint fitting on the first fitted motion vector and the second fitted motion vector based on the joint fitting rule, the first preset parameter and the second preset parameter, to obtain a fitted motion vector corresponding to the interpolation block.

In this example implementation, since the first fitted motion vector may be obtained by fitting motion vectors corresponding to multiple target projection blocks, the second fitted motion vector may be obtained by fitting motions corresponding to multiple adjacent interpolation blocks The vector is obtained by further fitting, so the first preset parameter may include the number of target projection blocks, and the second preset parameter may include the number of adjacent interpolation blocks in the process of calculating the second fitted motion vector.

In addition, the first preset parameter and the second preset parameter may also be set according to other parameters in the process of calculating the first fitted motion vector and the second fitted motion vector. However, it should be noted that, in general, when the first preset parameter and the second preset parameter are set, the selected parameters may be the process of calculating the first fitted motion vector and the process of calculating the second fitted motion vector. , the parameters corresponding to each other.

In this example embodiment, the joint fitting rule may include any rule for jointly fitting the first fitted motion vector and the second fitted motion vector. For example, the joint fitting rule may include a weighting rule, which may include a first weight and a second weight. At this time, referring to FIG. 7 , based on the first preset parameter and the second preset parameter of the joint fitting rule, joint fitting is performed on the first fitted motion vector and the second fitted motion vector to obtain the corresponding interpolation block. Fitting the motion vector may include the following steps S710 to S730:

Step S710: Calculate the product of the first weight and the number of the target projection blocks to obtain a fourth product.

In this example implementation, since the first fitted motion vector may be obtained by fitting motion vectors corresponding to multiple target projection blocks, the first preset parameter may include the target projection in the process of calculating the first fitted motion vector number of blocks. At this time, the product of the first weight and the number of target projection blocks may be calculated first to obtain the fourth product.

Step S720: Calculate the product of the second weight and the number of adjacent interpolation blocks to obtain a fifth product.

In this example embodiment, since the second fitted motion vector may be obtained by further fitting the fitted motion vectors corresponding to multiple adjacent interpolation blocks, the second preset parameter may include the process of calculating the second fitted motion vector The number of adjacent interpolation blocks in the . At this time, the product of the second weight and the number of adjacent interpolation blocks may be calculated first to obtain the fifth product.

Step S730, taking the fourth product as the weight of the first fitted motion vector and the fifth product as the weight of the second fitted motion vector, calculate the weighted average of the first fitted motion vector and the second fitted motion vector, to obtain The fitted motion vector corresponding to the interpolation block.

In this example implementation, the fourth product may be used as the weight of the first fitted motion vector, and the fifth product may be used as the weight of the second fitted motion vector to calculate the difference between the first fitted motion vector and the second fitted motion vector. The weighted average value is calculated as the fitted motion vector corresponding to the interpolation block.

Specifically, the above-mentioned joint fitting is performed on the first fitted motion vector and the second fitted motion vector based on the joint fitting rule, the first preset parameter and the second preset parameter to obtain the fitting motion vector corresponding to the interpolation block. The method can be expressed as:

MV _n =(B*w ₁ *MV _n1 +C*w ₂ *MV _n2 )/(B*w ₁ +C*w ₂ ) (2)

Among them, MV _n is the fitted motion vector obtained by calculation, B is the first preset parameter, w ₁ is the first weight corresponding to the first fitted motion vector, MV _n1 is the first fitted motion vector, and C is the second preset Assuming parameters, w ₂ is the second weight corresponding to the second fitted motion vector, and MV _n2 is the second fitted motion vector.

It should be noted that, due to the different degrees of confidence in different fitted motion vectors in different scenarios, the user can also set the first weight and the second weight according to the needs of the scenario; in addition, when fitting different interpolation blocks , to set different first weights and second weights, and the present disclosure does not specifically limit the setting method of the weights.

Step S320, when the number is less than the preset threshold, perform fitting by a fitting method based on a spatiotemporal neighborhood to obtain a fitted motion vector corresponding to the interpolation block.

In this example implementation, when the number of target projection blocks passing through the interpolation block is less than a preset threshold, the first interpolation block that is adjacent to the interpolation block and the second interpolation block that is adjacent in time can be fitted to determine the The fitted motion vector for the interpolation block.

Specifically, referring to FIG. 8 , the fitting motion vector corresponding to the interpolation block is obtained by performing fitting based on the fitting method of the spatiotemporal neighborhood, which may include the following steps S810 to S830:

Step S810: Acquire a first interpolation block adjacent to the position of the interpolation block in the image to be interpolated according to a preset spatial threshold.

In this example implementation, the preset spatial threshold may be used to limit the distance from the center point of the interpolation block. That is, among all the interpolation blocks, the interpolation block whose distance between the center point of the interpolation block and the center point of the interpolation block is smaller than the preset spatial threshold is the first interpolation block. For example, when the preset spatial threshold is 10 pixels, when the distance between the center point of the interpolation block and the center point of the interpolation block is less than 10 pixels, the interpolation block is the first interpolation block.

Step S820: Acquire, according to a preset time threshold, a second interpolation block with the same position as the interpolation block in the video image time-adjacent to the image to be interpolated.

In this exemplary embodiment, the preset time threshold may be used to define the time difference between the image to be interpolated and the image to be interpolated. That is, a video image adjacent in time to the image to be interpolated is acquired according to a preset time threshold, and a second interpolation block with the same position as the interpolation block is determined therein. For example, when the preset time threshold is 10, video images that are temporally adjacent to the image to be interpolated within 10 may be acquired, and the interpolation block in the same position as the interpolation block in all video images is determined as the second interpolation block.

Step S830, perform fitting according to the first interpolation block and the second interpolation block, to obtain a fitted motion vector corresponding to the interpolation block.

It should be noted that, after obtaining the first interpolation block and the second interpolation block, corresponding to the screening of the target projection block, the first interpolation block and the second interpolation block can also be screened according to the preset screening conditions, so as to select the The target projection blocks that meet the preset filter conditions are deleted to improve the accuracy of fitting.

In this exemplary embodiment, the fitting motion vector corresponding to the interpolation block may be determined by using the first interpolation block that is adjacent in space and the second interpolation block that is adjacent to time. For example, referring to FIG. 9 , performing fitting according to the first interpolation block and the second interpolation block to obtain a fitted motion vector corresponding to the interpolation block may include the following steps S910 to S920:

Step S910: Obtain the target first interpolation block and the target second interpolation block that already have the fitted motion vector in the first interpolation block and the second interpolation block.

In this example embodiment, the fitting motion vectors corresponding to the first interpolation block and the second interpolation block can be further fitted, so it is necessary to obtain the target of the fitted motion vector in the first interpolation block and the second interpolation block. The first interpolation block and the target second interpolation block.

For example, when the image to be interpolated is processed, the fitted motion vector of each interpolation block can be determined in the order from left to right and from top to bottom. In this case, it is possible to determine whether the first interpolation block already has a fitted motion vector through the position of the first interpolation block and the interpolation block, and obtain the target first interpolation block that already has the fitted motion vector; When processing, it may be processed in time sequence. At this time, it can be determined whether the second interpolation block has a fitted motion vector through the time sequence of the second interpolation block and the interpolation block, and then the target that already has the fitted motion vector can be obtained. The second interpolation block.

Step S920: Fitting is performed according to the fitted motion vectors corresponding to the target first interpolation block and the target second interpolation block and the distances between the interpolation blocks to obtain a fitted motion vector corresponding to the interpolation blocks.

In this example implementation, fitting can be performed according to the fitted motion vectors corresponding to the target first interpolation block and the target second interpolation block and the distance between each target first interpolation block and each target second interpolation block and the interpolation block , to obtain the fitted motion vector corresponding to the interpolation block.

For example, referring to FIG. 10 , fitting is performed according to the fitted motion vectors corresponding to the target first interpolation block and the target second interpolation block and the distance between the interpolation blocks to obtain the fitted motion vector corresponding to the interpolation block, The following steps S1010 to S1050 may be included:

Step S1010, obtaining the spatial distance between the target first interpolation block and the interpolation block, and the temporal distance between the target second interpolation block and the interpolation block.

In this example implementation, since the target first interpolation block with a farther spatial distance and the target second interpolation block with a farther temporal distance have less influence on the interpolation block, the difference between the target first interpolation block and the interpolation block can be obtained respectively. and the temporal distance between the target second interpolation block and the interpolation block.

Step S1020: Normalize the spatial distance and the temporal distance to obtain standard distances corresponding to the target first interpolation block and the target second interpolation block.

In this exemplary embodiment, in order to facilitate the calculation, the spatial distance and the temporal distance need to be normalized to obtain standard distances corresponding to the target first interpolation block and the target second interpolation block. For example, normalization rules can be set separately for spatial distance and temporal distance, and the standard distance to normalize them. For example, a spatial distance of 1 pixel can be determined as a standard distance of 1, and then all target first interpolation blocks can be normalized according to this rule; The standard distance of each video image is defined as 1, and then starting from the image to be interpolated, the standard distance of the Nth forward and Nth backward video images is determined as N.

Step S1030, summing all standard distances to obtain a standard distance sum.

In this exemplary embodiment, after the spatial distance and the temporal distance are normalized, all standard distances after the normalization can be summed. Specifically, the standard distances corresponding to all the target first interpolation blocks and the target second interpolation blocks are all added to obtain the standard distance sum.

Step S1040, for each target first interpolation block and each target second interpolation block, respectively calculate the product of the corresponding fitted motion vector and the standard distance to obtain the third product, and sum all the third products to obtain the third product sum .

In this example implementation, the product of the corresponding fitted motion vector and the standard distance may be calculated for each target first interpolation block and each target second interpolation block to obtain a third product, and all target first interpolation blocks The third product corresponding to the block and the target second interpolation block is summed to obtain the third product sum.

Step S1050: Calculate the quotient of the third product sum and the standard distance sum to obtain a fitted motion vector corresponding to the interpolation block.

In this exemplary embodiment, the quotient of the third sum of products and the sum of standard distances can be calculated, and the calculated quotient can be determined as the fitting motion vector corresponding to the interpolation block.

Specifically, the above-mentioned method for fitting the fitted motion vector corresponding to the target first interpolation block and the target second interpolation block and the distance between the interpolation block and the interpolation block, and obtaining the fitted motion vector corresponding to the interpolation block can be expressed as:

为第i个目标第一插值块或目标第二插值块对应的标准距离，MV_i2为第i个目标第一插值块或目标第二插值块对应的拟合运动矢量。Among them, MV _n2 is the fitted motion vector obtained by calculation, D is the sum of the number of the target first interpolation block and the target second interpolation block corresponding to the interpolation block,

is the standard distance corresponding to the i-th target first interpolation block or target second interpolation block, and MV _i2 is the fitted motion vector corresponding to the i-th target first interpolation block or target second interpolation block.

In addition, this exemplary embodiment also provides a frame rate conversion method. Referring to FIG. 11 , the above frame rate conversion method may include the following steps S1110 to S1120:

Step S1110: Obtain the fitted motion vector corresponding to each interpolation block in the image to be interpolated.

The fitted motion vector is a fitted motion vector corresponding to each interpolation block in the image to be interpolated obtained by the above motion vector fitting method.

Step S1120, performing motion compensation interpolation on the image to be interpolated by using the fitted motion vector.

In this exemplary embodiment, the image to be interpolated can be subjected to motion compensation interpolation on the fitted motion vector obtained by the above method, so as to realize frame rate conversion.

It should be noted that the above-mentioned drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the chronological order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, in multiple modules.

Further, referring to FIG. 13 , the embodiment of this example further provides a motion vector fitting apparatus 1300 , including: a quantity determination module 1310 and a vector fitting module 1320 . in:

The number determination module 1310 may be configured to determine the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection.

The vector fitting module 1320 may be configured to determine a corresponding target fitting method for fitting according to each quantity, and obtain a fitted motion vector corresponding to each interpolation block.

In this example embodiment, the vector fitting module 1320 may be configured to perform fitting by a fitting method based on area and reliability when the quantity is greater than or equal to a preset threshold, to obtain the fitting motion corresponding to the interpolation block vector, and/or perform joint fitting through a fitting method based on area and reliability and a motion vector fitting method based on spatiotemporal neighborhood to obtain a fitted motion vector corresponding to the interpolation block; When the preset threshold is set, a fitting method based on a spatiotemporal neighborhood is performed to obtain a fitted motion vector corresponding to the interpolation block.

In this example embodiment, the vector fitting module 1320 can be used to obtain target projection blocks corresponding to the interpolation blocks, and obtain the reliability of the motion vector corresponding to each target projection block; calculate the overlapping area of each target projection block and the interpolation block ; Fit the motion vector corresponding to the target projection block according to the overlapping area and reliability, and obtain the fitting motion vector corresponding to the interpolation block.

In this example embodiment, the vector fitting module 1320 may be configured to calculate the product of the motion vector, overlap area and reliability corresponding to each target projection block to obtain the first product, and sum the first products corresponding to all target projection blocks , obtain the first sum of products; calculate the product of overlapping area and reliability corresponding to each target projection block to obtain the second product, and sum the second products corresponding to all target projection blocks to obtain the second sum of products; calculate the first The quotient of the sum of products and the second sum of products obtains the fitted motion vector corresponding to the interpolation block.

In this example embodiment, the vector fitting module 1320 may be configured to filter the target projection blocks according to the preset filter conditions, and delete the target projection blocks that do not meet the preset filter conditions.

In this exemplary embodiment, the vector fitting module 1320 may be configured to obtain the first interpolation block adjacent to the position of the interpolation block in the image to be interpolated according to the preset spatial threshold; obtain the temporally adjacent image to be interpolated according to the preset time threshold In the video image, the second interpolation block has the same position as the interpolation block; the fitting is performed according to the first interpolation block and the second interpolation block to obtain a fitted motion vector corresponding to the interpolation block.

In this example embodiment, the vector fitting module 1320 can be used to obtain the target first interpolation block and the target second interpolation block that already have the fitted motion vector in the first interpolation block and the second interpolation block; according to the target first interpolation block The fitted motion vector corresponding to the block and the target second interpolation block and the distance between the block and the interpolation block are fitted to obtain the fitted motion vector corresponding to the interpolation block.

In this example embodiment, the vector fitting module 1320 can be used to obtain the spatial distance between the target first interpolation block and the interpolation block, and the temporal distance between the target second interpolation block and the interpolation block; Perform normalization to obtain the standard distances corresponding to the target first interpolation block and the target second interpolation block; sum all standard distances to obtain the standard distance sum; for each target first interpolation block and each target second interpolation block, Calculate the product of the corresponding fitted motion vector and the standard distance to obtain the third product, and sum all the third products to obtain the third product sum; calculate the quotient of the third product sum and the standard distance sum to obtain the corresponding interpolation block. Fit the motion vector.

In this exemplary embodiment, the vector fitting module 1320 may be configured to perform fitting by using a fitting method based on area and reliability, to obtain the first preset parameter and the first fitting motion vector corresponding to the interpolation block; Perform fitting based on the motion vector fitting method of the spatiotemporal neighborhood to obtain the second preset parameter and the second fitted motion vector corresponding to the interpolation block; based on the joint fitting rule, the first preset parameter and the The second preset parameter performs joint fitting on the first fitted motion vector and the second fitted motion vector to obtain a fitted motion vector corresponding to the interpolation block.

In this example implementation, the vector fitting module 1320 may be configured to calculate the product of the first weight and the number of target projection blocks to obtain the fourth product; calculate the product of the second weight and the number of adjacent interpolation blocks to obtain the fourth product Five products; take the fourth product as the weight of the first fitted motion vector, and the fifth product as the weight of the second fitted motion vector, calculate the weighted average of the first fitted motion vector and the second fitted motion vector, and obtain The fitted motion vector corresponding to the interpolation block.

In this exemplary embodiment, the quantity determination module 1310 can be used to obtain the motion vector corresponding to the image to be interpolated, and to project the motion vector to determine the position of the projection block corresponding to the motion vector on the image to be interpolated; The image to be interpolated is divided into at least one interpolation block, and the number of target projection blocks passing through each interpolation block is determined according to the positions of the interpolation block and the projection block on the image to be interpolated.

In addition, in an exemplary embodiment of the present disclosure, a frame rate conversion apparatus is also provided. Referring to FIG. 14 , the frame rate conversion apparatus 1400 includes a motion fitting module 1410 and a motion compensation module 1420 . in:

The motion fitting module 1410 can be used to obtain the fitted motion vector corresponding to each interpolation block in the image to be interpolated; the fitted motion vector is obtained by the above-mentioned motion vector fitting method.

The motion compensation module 1420 may be used to perform motion compensation interpolation on the image to be interpolated using the fitted motion vector.

The specific details of each module in the above-mentioned motion vector fitting apparatus and frame rate conversion apparatus have been described in detail in the corresponding motion vector fitting method and frame rate conversion method, so they will not be repeated here.

It should be noted that although several modules or units of the apparatus for action performance are mentioned in the above detailed description, this division is not mandatory. Indeed, according to embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided into multiple modules or units to be embodied.

FIG. 15 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present invention.

It should be noted that the computer system 1500 of the electronic device shown in FIG. 15 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 15, a computer system 1500 includes a central processing unit (CPU) 1501, which can be loaded into a random access memory (RAM) 1503 according to a program stored in a read only memory (ROM) 1502 or a program from a storage section 1508 Instead, various appropriate actions and processes are performed. In the RAM 1503, various programs and data necessary for system operation are also stored. The CPU 1501 , the ROM 1502 , and the RAM 1503 are connected to each other through a bus 1504 . An input/output (I/O) interface 1505 is also connected to bus 1504 .

The following components are connected to the I/O interface 1505: an input section 1506 including a keyboard, a mouse, etc.; an output section 1507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1508 including a hard disk, etc. ; and a communication section 1509 including a network interface card such as a LAN card, a modem, and the like. The communication section 1509 performs communication processing via a network such as the Internet. Drivers 1510 are also connected to I/O interface 1505 as needed. A removable medium 1511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 1510 as needed so that a computer program read therefrom is installed into the storage section 1508 as needed.

In particular, the processes described below with reference to the flowcharts may be implemented as computer software programs according to embodiments of the present invention. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication portion 1509, and/or installed from the removable medium 1511. When the computer program is executed by the central processing unit (CPU) 1501, various functions defined in the system of the present application are executed.

It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In the present invention, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented in special purpose hardware-based systems that perform the specified functions or operations, or can be implemented using A combination of dedicated hardware and computer instructions is implemented.

The units involved in the embodiments of the present invention may be implemented in a software manner, or may be implemented in a hardware manner, and the described units may also be provided in a processor. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances.

As another aspect, the present application also provides a computer-readable medium. The computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist alone without being assembled into the electronic device. middle. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by an electronic device, the electronic device enables the electronic device to implement the methods in the following embodiments. For example, the electronic device of , can implement the various steps shown in FIG. 1 to FIG. 11 .

Furthermore, the above-mentioned figures are merely schematic illustrations of the processes included in the methods according to the exemplary embodiments of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the chronological order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, in multiple modules.

Other embodiments of the present disclosure will readily suggest themselves to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. A motion vector fitting method, comprising:

determining the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection;

determining a corresponding target fitting method for fitting according to each quantity to obtain a fitting motion vector corresponding to each interpolation block;

determining a corresponding target fitting method for fitting according to each quantity to obtain a fitting motion vector corresponding to each interpolation block, wherein the fitting motion vector comprises the following steps:

when the number is greater than or equal to a preset threshold value and the number is greater than or equal to a classification threshold value, fitting is carried out through a fitting method based on area and reliability, and a fitting motion vector corresponding to the interpolation block is obtained;

when the number is greater than or equal to the preset threshold and is smaller than the classification threshold, performing combined fitting through the fitting method based on the area and the reliability and the motion vector fitting method based on the space-time neighborhood to obtain a fitting motion vector corresponding to the interpolation block;

and when the number is smaller than the preset threshold value, fitting by the fitting method based on the space-time neighborhood to obtain a fitting motion vector corresponding to the interpolation block.

2. The method of claim 1, wherein the fitting by a fitting method based on area and confidence to obtain a fitted motion vector corresponding to the interpolated block comprises:

acquiring target projection blocks corresponding to the interpolation blocks, and acquiring the credibility of the motion vector corresponding to each target projection block;

calculating the overlapping area of each target projection block and the interpolation block;

and fitting the motion vector corresponding to the target projection block according to the overlapping area and the credibility to obtain a fitted motion vector corresponding to the interpolation block.

3. The method of claim 2, wherein fitting the motion vector corresponding to the target projection block according to the overlap area and the confidence level to obtain a fitted motion vector corresponding to the interpolation block comprises:

calculating products of the motion vector, the overlap area and the credibility corresponding to each target projection block to obtain a first product, and summing the first products corresponding to all the target projection blocks to obtain a first product sum;

calculating products of the overlap area and the credibility corresponding to each target projection block to obtain second products, and summing the second products corresponding to all the target projection blocks to obtain second product sums;

and calculating the quotient of the first product sum and the second product sum to obtain a fitting motion vector corresponding to the interpolation block.

4. The method of claim 2, wherein after obtaining the target projection block corresponding to the interpolation block, the method further comprises:

and screening the target projection blocks according to preset screening conditions, and deleting the target projection blocks which do not meet the preset screening conditions.

5. The method according to claim 1, wherein the fitting by the fitting method based on the spatio-temporal neighborhood to obtain a fitted motion vector corresponding to the interpolation block comprises:

acquiring a first interpolation block adjacent to the interpolation block in the image to be interpolated according to a preset spatial threshold;

acquiring a second interpolation block which is positioned at the same position as the interpolation block in the video image adjacent to the image to be interpolated according to a preset time threshold;

and fitting according to the first interpolation block and the second interpolation block to obtain a fitting motion vector corresponding to the interpolation block.

6. The method according to claim 5, wherein the fitting according to the first interpolation block and the second interpolation block to obtain a fitted motion vector corresponding to the interpolation block comprises:

acquiring a target first interpolation block and a target second interpolation block which already have fitting motion vectors in the first interpolation block and the second interpolation block;

and fitting according to the fitted motion vectors corresponding to the target first interpolation block and the target second interpolation block and the distance between the fitted motion vectors and the interpolation blocks to obtain the fitted motion vectors corresponding to the interpolation blocks.

7. The method of claim 6, wherein the fitting according to the fitted motion vectors corresponding to the target first interpolation block and the target second interpolation block and the distance between the fitted motion vectors and the interpolation blocks to obtain the fitted motion vector corresponding to the interpolation block comprises:

acquiring a spatial distance between the target first interpolation block and the interpolation block and a temporal distance between the target second interpolation block and the interpolation block;

normalizing the space distance and the time distance to obtain a standard distance corresponding to the target first interpolation block and the target second interpolation block;

summing all the standard distances to obtain a standard distance sum;

for each target first interpolation block and each target second interpolation block, respectively calculating products of the corresponding fitting motion vector and the standard distance to obtain third products, and summing all the third products to obtain third products;

and calculating the quotient of the third product sum and the standard distance sum to obtain a fitting motion vector corresponding to the interpolation block.

8. The method according to claim 1, wherein jointly fitting the interpolation block by the area and confidence based fitting method and the spatio-temporal neighborhood based motion vector fitting method to obtain a fitting motion vector corresponding to the interpolation block comprises:

fitting by a fitting method based on area and reliability to obtain a first preset parameter and a first fitting motion vector corresponding to the interpolation block;

fitting by a motion vector fitting method based on a space-time neighborhood to obtain a second preset parameter and a second fitting motion vector corresponding to the interpolation block;

and performing joint fitting on the first fitting motion vector and the second fitting motion vector based on a joint fitting rule, the first preset parameter and the second preset parameter to obtain a fitting motion vector corresponding to the interpolation block.

9. The method of claim 8, wherein the joint fit rule comprises a weighting rule, the weighting rule comprising a first weight and a second weight; the first preset parameter comprises the number of the target projection blocks; the second preset parameter comprises the number of adjacent interpolation blocks;

the jointly fitting the first fitted motion vector and the second fitted motion vector based on the joint fitting rule and the preset parameters to obtain a fitted motion vector corresponding to the interpolation block includes:

calculating the product of the first weight and the number of the target projection blocks to obtain a fourth product;

calculating the product of the second weight and the number of the adjacent interpolation blocks to obtain a fifth product;

and calculating the weighted average value of the first fitting motion vector and the second fitting motion vector by taking the fourth product as the weight of the first fitting motion vector and the fifth product as the weight of the second fitting motion vector to obtain the fitting motion vector corresponding to the interpolation block.

10. The method of claim 1, wherein determining the number of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection comprises:

acquiring a motion vector corresponding to the image to be interpolated, and projecting the motion vector to determine the position of a projection block corresponding to the motion vector on the image to be interpolated;

dividing the image to be interpolated into at least one interpolation block according to a preset segmentation rule, and determining the number of target projection blocks passing through each interpolation block according to the interpolation block and the position of the projection block on the image to be interpolated.

11. A method of frame rate conversion, comprising:

acquiring a fitting motion vector corresponding to each interpolation block in an image to be interpolated; wherein the fitted motion vector is obtained by the motion vector fitting method of any one of claims 1-10;

and carrying out motion compensation interpolation on the image to be interpolated by utilizing the fitted motion vector.

12. A motion vector fitting apparatus, comprising:

the quantity determining module is used for determining the quantity of target projection blocks passing through each interpolation block on the image to be interpolated based on motion estimation and motion vector projection;

the vector fitting module is used for determining a corresponding target fitting method for fitting according to each quantity to obtain a fitting motion vector corresponding to each interpolation block;

determining a corresponding target fitting method for fitting according to each quantity to obtain a fitting motion vector corresponding to each interpolation block, wherein the fitting motion vector comprises the following steps:

when the number is greater than or equal to a preset threshold value and the number is greater than or equal to a classification threshold value, fitting is carried out through a fitting method based on area and reliability, and a fitting motion vector corresponding to the interpolation block is obtained;

when the number is greater than or equal to the preset threshold and is smaller than the classification threshold, performing combined fitting through the fitting method based on the area and the reliability and the motion vector fitting method based on the space-time neighborhood to obtain a fitting motion vector corresponding to the interpolation block;

and when the number is smaller than the preset threshold value, fitting by the fitting method based on the space-time neighborhood to obtain a fitting motion vector corresponding to the interpolation block.

13. An electronic device, comprising:

a processor; and

memory for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the motion vector fitting method of any of claims 1 to 10, or the frame rate conversion method of claim 11.

Images