CN105828106B - A kind of non-integral multiple frame per second method for improving based on motion information - Google Patents
A kind of non-integral multiple frame per second method for improving based on motion information Download PDFInfo
- Publication number
- CN105828106B CN105828106B CN201610235788.3A CN201610235788A CN105828106B CN 105828106 B CN105828106 B CN 105828106B CN 201610235788 A CN201610235788 A CN 201610235788A CN 105828106 B CN105828106 B CN 105828106B
- Authority
- CN
- China
- Prior art keywords
- frame
- interframe
- interleave
- correlation
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000033001 locomotion Effects 0.000 title claims abstract 32
- 238000000034 method Methods 0.000 title claims abstract 14
- 238000001514 detection method Methods 0.000 claims 1
- 229910003460 diamond Inorganic materials 0.000 claims 1
- 239000010432 diamond Substances 0.000 claims 1
- 230000026058 directional locomotion Effects 0.000 claims 1
- 238000009432 framing Methods 0.000 claims 1
- 238000007796 conventional method Methods 0.000 abstract 1
- 230000001737 promoting effect Effects 0.000 abstract 1
- 230000000007 visual effect Effects 0.000 abstract 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Systems (AREA)
Abstract
The present invention provides a kind of non-integral multiple frame per second method for improving based on motion information.Judge whether occurrence scene converts in basic group first with the interframe degree of correlation；Secondly the speed of the accurate judgment object movement of the method combined using interframe movement speed and the interframe degree of correlation, to obtain the position to interleave；The interpolation frame at frame position to be inserted finally is obtained using the method for motion compensation, finally realizes that non-integral multiple frame per second is promoted.The present invention breaches the limitation of integral multiple frame per second promotion, makes full use of the motion information of interframe, and in movement velocity, local interleave so that the video motion after promoting frame per second is more smooth enhances visual effect faster；It is obtained simultaneously using motion compensation to interleave, to reduce motion jitter and blooming.In last analytical proof superiority and feasibility of the method for the present invention compared to conventional method in terms of theoretical, subjective and three objective of the present invention.
Description
Technical field
The present invention relates to a kind of methods using inter motion information convert video signals frame per second, belong to multi-media processing neck
Domain.
Background technique
During multi-media processing, due to network bandwidth, realize encoding and decoding digital signal processor performance and
The factors such as the matching problem in different multimedia product intercommunication, it is often necessary to which frame per second conversion is carried out to video.For example, (1) is believing
Under conditions of road bandwidth is restricted, transmission frame per second (being down to per second 10 or 15 frames) must be reduced in coding side, only transmission one
The video content divided both improved then can recover complete video content by switch technology in frame per second in decoding end
The utilization rate of channel width in turn ensures that video quality can satisfy user's viewing demand；(2) in the intercommunication of different multimedia product
Matching, i.e. conversion between the video format of different frame rates.Movie program source is that film is played with 24 frame rate per second, and electric
It depending on NTSC (National Television Selection) standard is played with the rate of 30 frame per second, the play frame rate of liquid crystal display then needs
Reach 60 frame per second.Therefore in order to play movie program source on television equipment and obtain the visual quality of high quality,
It must carry out converting in the frame per second of program source, i.e., frame per second is promoted.
Studying in frame per second conversion at present more is that two times of frame per second are promoted, i.e., integral multiple frame per second is promoted.This promotion is mostly
Raising video frame rate increases the purpose of video realism and smooth sense to reach raising visual quality.But in practical application
Frame per second conversion need mutual conversion between various video frame per second, be not necessarily two times of promotion, in many cases it is desirable that
Non-integral multiple frame per second is promoted, i.e. (source frame rate is M frame/second to lifting factor k, and frame per second is N seconds/frame after promotion, then lifting factor k
=N/M) it is score.Such as it is needed in decoding end to reduce temporal redundancy to being converted on 15 frames/second video in above-mentioned example
To 24 frames/second (k=8/5)；In order to play film source program in liquid crystal display, need 24 frames/be transformed into 60 frames/second on the second
(k=5/2).Meanwhile all frames can be treated substantially equally in two times of frame per second promotions and time domain distribution is full symmetric, but non-whole
During several times frame per second is promoted, time domain distribution also accordingly becomes complicated.Therefore non-integral multiple frame per second is promoted, faces two problems,
One be interleave position determination, another is then how to obtain the interpolation frame of frame position to be inserted.It is existing non-integral multiple at present
Frame per second method for improving is mostly interleave position to be determined using uniform intervals method, and carry out frame using adjacent two frame at frame position to be inserted
Duplication or linear summation obtain interpolated frame, these methods are easy hardware realization, but are all inevitably present disadvantage: to original
Beginning sequence has carried out time domain translation, and changes the motion profile of object, can cause the motion skip in visual effect.
Summary of the invention
In order to realize the conversion between various video format, the present invention provides a kind of non-integral multiple frame per second promotion sides
Method, breaches the limitation that original two times of frame per second are promoted, and applicability is more extensive.Non-integral multiple frame is realized in order to solve conventional method
Caused motion skip problem in rate conversion, frame per second method for improving of the invention are based on motion information, that is, make full use of interframe
Motion information determines the position to interleave, in the fast local interleave of movement velocity, so that the video motion after promoting frame per second is more
Add smoothness, enhances visual effect；It is obtained simultaneously using motion compensation to interleave, to reduce motion jitter and blooming.
In the present invention, with M frame for a basic group, N-M frame is reconstructed, realizes that video frame rate M frame/second is non-whole to N frame/second
Several times frame per second promotes (N > M, and N/M is score).Judge whether occurrence scene becomes in this basic group first with the interframe degree of correlation
It changes；Secondly the speed of the method judgment object movement combined using interframe movement speed and the interframe degree of correlation, to obtain N-M
A position to interleave；The interpolation frame at frame position to be inserted finally is obtained using the method for motion compensation, to realize non-integer
Frame per second again is promoted.
Technical solution of the invention is as follows:
A kind of non-integral multiple frame per second method for improving based on motion information, it is characterised in that method includes the following steps:
Step 1: original video being handled, is handled as frame；
Step 2: successively asking the degree of correlation in basic group between adjacent two frame, i.e. the interframe degree of correlation, and processing of sorting to it；
Step 3: scene detection in basic group carries out previous frame duplication at scene change and obtains interpolation frame；
Step 4: successively obtain adjacent two frame in basic group correspond to block motion vector between macro block and interframe correspond to macro block it
Between block between the degree of correlation, then the degree of correlation between the block motion vector and block is combined and acquires interframe movement speed, and it is arranged
Sequence processing；
Step 5: being primarily based on the interframe degree of correlation and the accurate judgment object movement speed of interframe movement speed, secondly utilize phase
The accuracy of interframe movement speed required by similarity judgment step 4 between adjacent interframe movement speed is finally moving fast, institute
The interframe for asking speed accuracy high determines the position to interleave；
Step 6: the block motion vector between macro block being corresponded to based on adjacent two frame required in step 4, at frame position to be inserted
Carry out motion compensation interleave；
Step 7: frame will be inserted into and primitive frame synthesizes the video of high frame per second.
Preferably, successively ask the related coefficient absolute value of adjacent two interframe in a basic group as interframe phase in step 2
Guan Du according to sorting from small to large, and retains corresponding frame position, to be used for step 5.
Preferably, in step 3 by size relation between the interframe degree of correlation and given threshold judge in basic group whether
Occurrence scene variation.
Preferably, estimation is carried out using diamond search method in step 4, obtains the motion vector of each macro block, together
Shi Liyong corresponds to the related coefficient absolute value between macro block as its degree of correlation；Then using the method that truncates, it is high macro to remove the degree of correlation
The vector of block averages as interframe movement speed to remaining macro block vector size；Finally from big to small to interframe movement speed
Sequence, and retain corresponding frame position, to be used for step 5.
Preferably, in steps of 5, it in conjunction with the interframe degree of correlation and interframe movement speed after sequence in step 2 and 4, determines
Fireballing place interleave recycles two adjacent interframe movements if interleave number is less than the sum for needing interleave at this time
Similarity between speed, in the interframe interleave that similarity is high and speed is big, to guarantee that interleave position changes in motion profile
At fast position.
Preferably, in step 6, using bi directional motion compensation mode, interleave, reduction are required interior at above-mentioned gained interleave
The cavity of interleave and eclipsing effects.
This method is accurately located interleave position, and improves the quality of interpolation frame, thus in the base of successfully upper conversion frame per second
Enhance visual effect on plinth, reduce motion skip, keeps the video motion after being promoted more coherent.
Detailed description of the invention
Fig. 1 is flow chart of the invention；
Fig. 2 is diamond search template schematic diagram；
Fig. 3 is two-way overlapped block motion compensation schematic diagram；
Fig. 4 is that the non-integral multiple frame per second of conventional method 1 promotes schematic diagram；
Fig. 5 is that the non-integral multiple frame per second of conventional method 2 promotes schematic diagram；
Fig. 6 is frame replication defective schematic diagram；
Fig. 7 is that Akiyo video simulation result PSNR and SSIM compare figure.
Specific embodiment
The invention proposes a kind of non-integral multiple frame per second method for improving based on motion information.It is to original video continuous N frame
One basic group carries out scene detection to interframe adjacent in basic group first, and previous frame duplication carries out interleave at scene changes；In conjunction with
Block motion estimation and the block degree of correlation obtain interframe movement speed using the method for averaging that truncates；Then in conjunction with interframe movement speed and
The interframe degree of correlation determines the position to interleave；Secondly similarity and each frame between two adjacent interframe movement speed are utilized
Between the size of movement velocity determine remaining frame position to be inserted；Frame position to be inserted is finally obtained using overlapping block bi directional motion compensation
The interpolation frame at place, and then achieve the purpose that non-integral multiple frame per second is promoted, while solving the cavity in interpolation frame and overlap problem, and
Interleave is in original movement trajectory to eliminate motion blur and jitter phenomenon, after improving non-integral multiple frame per second promotion
Visual effect.
The overall flow of the method for the invention is specifically called out in Fig. 1, is promoted by frame per second M frame/second to N frame/for the second
(N > M, and N/M is score), specific implementation step is as follows:
(1) video is read in, reading M frame is a basic group, and frame operation is carried out as unit of basic group.
(2) obtain the interframe degree of correlation in basic group: successively seeking interframe related coefficient absolute value | ρt|, as the interframe degree of correlation
γt, and sort from small to large to it, while retaining corresponding frame position, the interframe degree of correlation is as shown in formula 1:
γt=| ρt|
Note: f in formulatAnd ft+1Two frames adjacent in a basic group are respectively represented, E [] and D [] respectively indicate frame pixel value
Mean value and variance.
(3) scene detection: according to the size relation of the interframe degree of correlation and given threshold judge two interframe whether occurrence scene
Transformation.
Wherein, interframe degree of correlation γtValue changes in 0~1 range, γt=0-0.3 indicates adjacent two frames correlation journey
It spends low, that is, has been likely to occur scene change；Degree of correlation γt=0.3-0.9 indicates that adjacent two frames degree of correlation is common, that is, having can
The movement velocity of two interframe of energy is bigger；Degree of correlation γt=0.9-1.0 indicates that adjacent two frames degree of correlation is high, i.e., it is possible that
The movement velocity of two interframe is smaller or without motion.So given threshold T=0.3, works as ftAnd ft+1Two interframe degree of correlation γt≤
Think that scene detection has occurred in two interframe when T, is then here labeled as frame position to be inserted, while replicating by previous frame and obtaining interpolation frame
ft+1/2, as shown in formula 2:
ft+1/2=ft(formula 2)
(4) obtain interframe movement velocity: successively obtain adjacent two frame in basic group correspond to block motion vector between macro block and
Interframe corresponds to the block degree of correlation between macro block, and the two combines and acquires interframe movement speed, and processing of sorting to it, specifically include with
Under several steps:
A. to adjacent two frames ftAnd ft+1Carry out estimation, using Block- matching search in the preferable diamond search method of performance
(DS).The search pattern of diamond search was both less big or less small, and big diamond shape (such as attached drawing 2 (a)) step-size in search is big, can be used for thick
Positioning, for being accurately positioned if small diamond shape (such as attached drawing 2 (b)), obtains more so that search process be made not fall into local optimum
Add accurate match point.DS block matching algorithm obtains adjacent two interframe and corresponds to block motion vector between macro block.
B. to adjacent two frames ftAnd ft+1It carries out identical macro block in step a to divide, and calculates the phase between corresponding macro block
To absolute coefficient, as the degree of correlation between block, calculation formula and meaning are identical as the interframe degree of correlation.
C. the degree of correlation between the block motion vector and block between the corresponding macro block of combination, removes the degree of correlation greater than 0.9 using a tail method is pinched
Macro block motion vector, average to remaining piece of vector size, as adjacent two frames ftAnd ft+1Between movement velocity vt,
T=1,2 ..., M-1.
D. M frame in basic group is repeated in and carries out above-mentioned three step, finally obtain M-1 interframe movement speed, it is then right
It retains the position of corresponding frame according to sorting from large to small.
(5) determine all positions to interleave: the accuracy in order to improve frame position to be inserted, two steps realize interleave position
It determines.Combine the interframe degree of correlation and interframe movement speed after sequence first, choose the fast interframe degree of correlation simultaneously of interframe speed compared with
Two small interframe are interleave position；Then judging whether interleave number has reached at this time requires N-M a, direct if reaching requirement
In next step, otherwise continue to choose interleave position: calculating the similarity S between two adjacent interframe movement speed, it is such as public
Shown in formula 3.In similarity Si,i+1Biggish two interframe movement speed vi,vi+1It is middle to choose two frames corresponding to biggish speed
Between carry out interleave, until interleave position number reaches requirement.
(6) motion compensation interleave: interleave is carried out to the frame position to be inserted that above-mentioned steps obtain, for effective solution block
With estimation bring blocking artifact and empty problem, using two times of frame per second promoted in common overlapping block bi directional motion compensation into
Row interleave, as shown in Fig. 3, wherein what solid line represented is the original matching of N × N, and B representative is current block, and N1-N8 representative is worked as
Preceding piece of surrounding block；Dashed boxes are that up and down respectively, w width of left and right four direction extension is formed centered on nine blocks above
(N+2w) × (N+2w) extension blocks.
The relationship of frame per second N according to former frame per second M and after being promoted, can interleave in two kinds of situation, it is specific as follows:
When a.M < N < 2*M, such as M=15, N=24, i.e., 15 frames/second video was promoted to 24 frames/second, needs to look at this time
To 9 interleave positions.It is successively found according to above-mentioned steps, then with interleave method insertion common in two times of promotions at interleave position
One frame.
B.2*M < N when, 24 frames/second video is promoted to 60 frames/second, needs to be inserted at this time by such as M=24, N=60
36 frames.In this case, 12 a interleave positions (N-2*M) still are found according to above-mentioned steps, is then inserted what is searched out
At frame position with three times promoted in commonly use interleave method and be inserted into two interpolation frames, and between other adjacent frames with two times promoted in commonly use
Interleave method is inserted into an interpolation frame.
Illustrate that the present invention is non-whole relative to tradition in terms of theory analysis, subjective analysis and objective analysis three below
The superiority and feasibility of several times frame per second method for improving.
It is mentioned firstly, analyzing the present invention in terms of the generation two of interleave position and interpolation frame relative to the non-integral multiple frame per second of tradition
The superiority and necessity of lifting method.In the present invention, it is related to two kinds of conventional methods 1 and 2, concrete operations are as follows:
1) conventional method 1: determining interleave position according to the weight parameter α of frame each in basic group, using in frame duplication acquisition
Interleave.This method is that the weight parameter of the configuration of each frame is identical, as shown in formula (4):
Specific implementation: if successively executing following processing to each of M input video frame present frame, this is current
Weight α >=1 of frame then carries out frame to the present frame and replicates interleave, and weight parameter subtracts 1, and remainder is added to next frame
Weight parameter on；Conversely, when the weight α < 1 of the present frame, then export the present frame as output video frame, and will
The weight parameter of the present frame is added in the weight parameter of next frame；So, N number of output video is exported within the unit time
Frame.
Citing: 24 frames/30 frames of second -/second, i.e. 4-5, every 4 frame are a base group, at this timeInterleave schematic diagram such as Fig. 4
It is shown.
2) conventional method 2: interleave position is determined according to the weight parameter α of frame each in basic group, using to adjacent two main feed line
Property summation obtain interpolation frame.This method is that each frame adaptive distributes weight parameter, as shown in formula (5):
K=N/M；
Citing: 24 frames/30 frames of second -/second, i.e. 4-5, N=5, M=4, every 4 frame are a base group, at this time k=5/4；Time domain
Profile parameter={ 0,1/5,2/5,3/5,0,1/5,2/5 ... }, interleave schematic diagram are as shown in Figure 5.
Theory analysis:
The comparative analysis of the method for the present invention and above two conventional method: either selection interleave position still generates interpolation
Frame, conventional method all do not account for the motion information of moving object, from attached drawing 6 we it is also seen that if input picture frame
Be repeated twice, so each interleave when image real motion position all by mistake expression.Either method 1 or side
Method 2, interpolated frame obtained all change the real trace of object of which movement, so we can be appreciated that irregularly after frame per second promotion
The even dynamic dynamic movement stopped, that is, our motion jitters for often saying.And the method applied in the present invention takes full advantage of fortune
Dynamic information chooses interleave position and obtains interpolation frame using motion compensation, to ensure that interpolation frame in original movement trajectory, has
Motion jitter and motion skip phenomenon after effect conventional method frame per second being avoided to be promoted.
Subjective analysis:
Test video: source video is avi format.Wherein, color video (resolution ratio 384*288, former 24 frame of frame per second/
Second), news video (resolution ratio 352*288, former 15 frames of frame per second/second), foreman video (resolution ratio 352*288, former frame per second 25
Frame/second), vtext video (resolution ratio 1920*1080, former 30 frames of frame per second/second).
Experiment content: it is non-to the progress of above-mentioned four kinds of different frame rates videos that the method for the present invention and two kinds of conventional methods are respectively adopted
Integral multiple frame per second is promoted.Color video: 24 frames/second is promoted to 30 frames/second；News video: 15 frames/second is promoted to 25 frames/second；
Foreman video: 25 frames/second is promoted to 30 frames/second；Vtext video: 30 frames/second is promoted to 48 frames/second.Then it is broadcast same
It puts and plays video on device, appraiser scores.
Video quality assessment personnel: 15 have certain image procossing Knowledge Base but to video sequence quality evaluation without
The university research of solution is raw.
Subjective evaluation method: using most classic appraisal procedure, compare marking to the video obtained under three kinds of methods,
Rank of giving a mark is 1-5 point, wherein 1 point to represent the video worst, 5 points represent that the video is best, and scoring can be decimal.It is directed to simultaneously
The particularity of the method for the present invention and conventional method, between video pictures clarity and video sequence move two angles of continuity be
Judgment criteria is given a mark respectively, the subjective scoring for obtaining and obtaining video under distinct methods of then respectively averaging.
The final subjective scoring of different video is as shown in table 1, it can be seen that the method tool of the invention in movement continuity
There is certain superiority, but due to having blocking artifact sometimes using block-based motion compensation interleave, it is clear so as to cause picture
Degree is not so good as conventional method once in a while.Therefore it is the quality for improving the promoted video of the method for the present invention, can improves and be transported based on block as far as possible
The accuracy of dynamic compensation frame per second method for improving.
Table 1
Objective analysis:
Using there is appraisal procedure PSNR and the SSIM value of reference frame to compare, therefore construction first is promoted to score times frame per second
Source video sequence, the random frame losing of 120 frames progress obtains 96 before testing Akiyo sequence (original 30 frames of frame per second/second) to standard yuv video
Frame (composition frame per second is 24 frames/second source video sequence)；Then as source video sequence, with the method for the present invention and conventional method
1 and 2 carry out non-integral multiple frame per second promotion (24 frames/30 frames of second -/second) respectively, 120 frames after obtaining 5/4 times of frame per second promotion；
PSNR, SSIM value finally are based on original 120 frame to 120 video frames that distinct methods obtain and carry out objective comparative analysis: such as
Attached drawing 7 (a) and (b) are shown, non-integral multiple frame per second promotion are being carried out using the described method of the present invention, compared to conventional method
PSNR value and SSIM value increase, to sufficiently prove feasibility and superiority of the invention.
Claims (6)
1. a kind of non-integral multiple frame per second method for improving based on motion information, it is characterised in that method includes the following steps:
Step 1: original video being handled, is handled as frame；
Step 2: with M frame for a basic group, the degree of correlation in basic group between adjacent two frame, i.e. the interframe degree of correlation are successively asked, and
It sorts to it processing；
Step 3: scene detection in basic group carries out previous frame duplication at scene change and obtains interpolation frame；
Step 4: successively obtaining that adjacent two frame corresponds to block motion vector between macro block in basic group and interframe corresponds between macro block
Then the degree of correlation between the block motion vector and block is combined and acquires interframe movement speed, the interframe movement by the degree of correlation between block
Speed refers to the speed between adjacent two frame, and processing of sorting to it；
Step 5: the interframe degree of correlation and the accurate judgment object movement speed of interframe movement speed are primarily based on, secondly using adjacent
The accuracy of interframe movement speed required by similarity judgment step 4 between interframe movement speed is finally moving fast, required speed
Spend the determining position to interleave of the high interframe of accuracy；
Step 6: the block motion vector between macro block being corresponded to based on adjacent two frame required in step 4, is carried out at frame position to be inserted
Motion compensation interleave；
Step 7: frame will be inserted into and primitive frame synthesizes the video of high frame per second.
2. the non-integral multiple frame per second method for improving based on motion information as described in claim 1, it is characterised in that: in step 2
In successively ask the related coefficient absolute value of adjacent two interframe in a basic group as the interframe degree of correlation, according to sorting from small to large,
And retain corresponding frame position, to be used for step 5.
3. the non-integral multiple frame per second method for improving based on motion information as described in claim 1, it is characterised in that: in step 3
In by size relation between the interframe degree of correlation and given threshold judge in basic group whether occurrence scene variation.
4. the non-integral multiple frame per second method for improving based on motion information as described in claim 1, it is characterised in that: in step 4
It is middle that estimation is carried out using diamond search method, the motion vector of each macro block is obtained, while utilizing the correlation between corresponding macro block
Absolute coefficient is as its degree of correlation；Then using the method that truncates, remove the vector of the high macro block of the degree of correlation, to remaining macro block vector
Size is averaged as interframe movement speed；Finally interframe movement speed is sorted from large to small, and retains corresponding framing bit
It sets, to be used for step 5.
5. the non-integral multiple frame per second method for improving based on motion information as described in claim 1, it is characterised in that: in step 5
In, in conjunction with the interframe degree of correlation and interframe movement speed after sequence in step 2 and 4, fireballing local interleave is determined, if at this time
Interleave number is less than the sum for needing interleave, then the similarity between two adjacent interframe movement speed is recycled, similar
The interframe interleave that degree is high and speed is big, to guarantee that interleave position changes in motion profile at fast position.
6. the non-integral multiple frame per second method for improving based on motion information as described in claim 1, it is characterised in that: in step 6
In, using bi directional motion compensation mode at above-mentioned frame position to be inserted interleave, reduce cavity and the eclipsing effects of required interpolation frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610235788.3A CN105828106B (en) | 2016-04-15 | 2016-04-15 | A kind of non-integral multiple frame per second method for improving based on motion information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610235788.3A CN105828106B (en) | 2016-04-15 | 2016-04-15 | A kind of non-integral multiple frame per second method for improving based on motion information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105828106A CN105828106A (en) | 2016-08-03 |
| CN105828106B true CN105828106B (en) | 2019-01-04 |
Family
ID=56526937
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610235788.3A Expired - Fee Related CN105828106B (en) | 2016-04-15 | 2016-04-15 | A kind of non-integral multiple frame per second method for improving based on motion information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105828106B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108200446B (en) * | 2018-01-12 | 2021-04-30 | 北京蜜枝科技有限公司 | On-line multimedia interaction system and method of virtual image |
| CN110149555B (en) * | 2018-08-14 | 2022-07-22 | 腾讯科技（深圳）有限公司 | Video processing method and video receiving device |
| CN110198412B (en) * | 2019-05-31 | 2020-09-18 | 维沃移动通信有限公司 | Video recording method and electronic equipment |
| US11303847B2 (en) * | 2019-07-17 | 2022-04-12 | Home Box Office, Inc. | Video frame pulldown based on frame analysis |
| CN112584232A (en) * | 2019-09-30 | 2021-03-30 | 北京金山云网络技术有限公司 | Video frame insertion method and device and server |
| CN112584196A (en) * | 2019-09-30 | 2021-03-30 | 北京金山云网络技术有限公司 | Video frame insertion method and device and server |
| CN111083417B (en) * | 2019-12-10 | 2021-10-19 | Oppo广东移动通信有限公司 | Image processing method and related products |
| CN111263193B (en) * | 2020-01-21 | 2022-06-17 | 北京世纪好未来教育科技有限公司 | Video frame up-down sampling method and device, and video live broadcasting method and system |
| CN111641829B (en) * | 2020-05-16 | 2022-07-22 | Oppo广东移动通信有限公司 | Video processing method, device and system, storage medium and electronic equipment |
| CN111885336B (en) * | 2020-06-19 | 2022-03-29 | 成都东方盛行电子有限责任公司 | Non-frame-coding rate conversion method under frame mode |
| CN112788337A (en) * | 2020-12-28 | 2021-05-11 | 深圳创维－Rgb电子有限公司 | Video automatic motion compensation method, device, equipment and storage medium |
| CN114613306A (en) * | 2022-03-14 | 2022-06-10 | 维沃移动通信有限公司 | Display control chip, display panel and related equipment, method and device |
| CN114938461B (en) * | 2022-04-01 | 2024-11-01 | 网宿科技股份有限公司 | Video processing method, device, equipment and readable storage medium |
| CN116033183B (en) * | 2022-12-21 | 2024-11-22 | 上海哔哩哔哩科技有限公司 | Video frame insertion method and device |
| CN116366886B (en) * | 2023-02-27 | 2024-03-19 | 泰德网聚(北京)科技股份有限公司 | Video quick editing system based on smoothing processing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102523439A (en) * | 2011-12-07 | 2012-06-27 | 天津天地伟业物联网技术有限公司 | Video frame rate improving system and frame rate improving method |
| CN102665061A (en) * | 2012-04-27 | 2012-09-12 | 中山大学 | Motion vector processing-based frame rate up-conversion method and device |
| EP2701386A1 (en) * | 2012-08-21 | 2014-02-26 | MediaTek, Inc | Video processing apparatus and method |
| CN105100807A (en) * | 2015-08-28 | 2015-11-25 | 山东大学 | A frame rate improvement method based on motion vector post-processing |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008160591A (en) * | 2006-12-25 | 2008-07-10 | Hitachi Ltd | Television receiver and frame rate conversion method thereof |
-
2016
- 2016-04-15 CN CN201610235788.3A patent/CN105828106B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102523439A (en) * | 2011-12-07 | 2012-06-27 | 天津天地伟业物联网技术有限公司 | Video frame rate improving system and frame rate improving method |
| CN102665061A (en) * | 2012-04-27 | 2012-09-12 | 中山大学 | Motion vector processing-based frame rate up-conversion method and device |
| EP2701386A1 (en) * | 2012-08-21 | 2014-02-26 | MediaTek, Inc | Video processing apparatus and method |
| CN105100807A (en) * | 2015-08-28 | 2015-11-25 | 山东大学 | A frame rate improvement method based on motion vector post-processing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105828106A (en) | 2016-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105828106B (en) | A kind of non-integral multiple frame per second method for improving based on motion information | |
| CN101946514B (en) | Estimation of true motion vectors using an adaptive search range | |
| US7190405B2 (en) | Method and apparatus of adaptive de-interlacing of dynamic image | |
| TW480885B (en) | Fast motion-compensated video frame interpolator | |
| US9148622B2 (en) | Halo reduction in frame-rate-conversion using hybrid bi-directional motion vectors for occlusion/disocclusion detection | |
| KR100530223B1 (en) | Frame interpolation method and apparatus at frame rate conversion | |
| KR102226563B1 (en) | Content adaptive telecine and interlace reverser | |
| US8018998B2 (en) | Low complexity motion compensated frame interpolation method | |
| US8749703B2 (en) | Method and system for selecting interpolation as a means of trading off judder against interpolation artifacts | |
| US20180007375A1 (en) | Image encoding and decoding methods and devices thereof | |
| CN101222604A (en) | Method for calculating motion estimation value and estimating motion vector of image | |
| US6317460B1 (en) | Motion vector generation by temporal interpolation | |
| CN103051857B (en) | Motion compensation-based 1/4 pixel precision video image deinterlacing method | |
| JP4083266B2 (en) | Motion vector generation method and apparatus | |
| JPH11187406A (en) | Encoding method of binary form signal | |
| KR20050080862A (en) | Method for interpolating frame with motion compensation by overlapped block motion estimation and frame-rate converter using thereof | |
| CN104065975A (en) | Frame Rate Boosting Method Based on Adaptive Motion Estimation | |
| CN100588253C (en) | Motion Vector Field Refinement Method for Tracking Fast Moving Small Objects | |
| CN101483790B (en) | Movie mode video signal detection method | |
| JP2001506101A (en) | System and method for contour-based movement estimation | |
| US8837595B2 (en) | Motion estimation method | |
| CN108282653B (en) | Motion compensation de-interlacing method and system based on motion estimation of bipolar field | |
| CN104506869B (en) | Method for estimating based on Block- matching video sequence under different resolution | |
| CN101483713A (en) | Deinterleaving method based on moving target | |
| Chan et al. | Adaptive partial distortion search for block motion estimation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190104 Termination date: 20190415 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |