JPH1188845A - Moving image scan converter - Google Patents

Abstract

(57) [Summary] [PROBLEMS] An apparatus for scan-converting encoded moving image data of 24 frames per second into moving image data of a progressive scanning method of 60 frames per second, and synthesizing frames without requiring a complicated circuit. A moving image scan conversion device capable of generating a moving image in which the motion of the image is smooth by inserting the moving image. SOLUTION: The encoded moving image data of 24 frames per second is decoded, and the moving image data of (A) obtained by the decoding means is converted to 60% per second by a 2-3 pull-down method.
Field-interlaced scanning moving image data (B) is scanned and converted, and the two fields b1 and b2 adjacent to the time series of the generated data (B) are combined, and the progressive scanning moving image of 60 frames per second is used. The frame data e1 of the data (E) is generated and scan-converted.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image scan conversion apparatus for performing scan conversion of 24 frames of moving image data per second into progressive moving image data of 60 frames per second.

[0002]

2. Description of the Related Art In recent years, in the case of transmitting or recording or reproducing moving image data, the data format of an interlaced video signal of 60 fields per second or a progressive video signal of 60 frames per second has been widely adopted. Moving image data compression such as MPEG is widely performed to reduce the data amount. When a movie film is used as a moving image material, the movie is converted from a movie film source of 24 frames per second to a video signal of an interlaced system of 60 fields per second by a 2-3 pull-down method using a telecine device. May be input to a compression / compression device. The 2-3 pull-down method used in the scan conversion is a method of repeating the operation of reading the first frame of two consecutive frames of a film source as two fields of a video signal and reading the next frame as three fields. As will be described later, two of the data read out as three fields are the same data. Therefore, the same field is duplicated in the scan-converted interlaced video signal of 60 fields per second. Will be.

Therefore, some moving picture coding / compressing apparatuses for coding a video signal as an input signal perform processing for removing the same duplicated field data in order to increase the compression efficiency. That is, by removing overlapping fields from an interlaced video signal of 60 fields per second, scan conversion into moving image data of 24 frames per second is performed and encoded, thereby improving the compression efficiency as a whole. In the case of encoding using this method, when reproducing as a video signal, moving image data of 24 frames per second obtained by decoding a coded moving image of 24 frames per second by a moving image decoding device,
Scan conversion was performed by a moving image scan converter to obtain a video signal of 60 fields per second. It is considered that high-quality moving images can be viewed by displaying the data converted to the progressive scanning method in this manner. Therefore, there has been proposed a moving image scan conversion apparatus that decodes encoded moving image data at 24 frames per second and obtains a progressive scan conversion video signal by scan conversion. (For example, JP-A-6-178274) Hereinafter, an example of the above-described conventional moving image scan conversion device will be described with reference to the drawings.

FIG. 10 shows a moving image scan conversion apparatus which performs scan conversion by a conventional scan conversion method. In FIG. 10, reference numeral 101 denotes an encoded image data input unit for inputting encoded moving image data of 24 frames per second. A decoding unit 102 decodes the encoded moving image data input by the encoded image data input unit 101. 103
Reference numeral denotes a frame memory as a buffer for temporarily storing moving image data obtained by the decoding unit 102. A scan conversion unit 104 reads out the moving image data written in the frame memory 103 while controlling the timing and performs scan conversion. A display unit 105 reads the moving image data generated by the scan conversion unit 104 and displays it as a moving image. Encoded image data input means 101
The display means 105 is controlled by the system controller 106.

[0005] The scan conversion realized by the moving image scan conversion apparatus configured as described above is executed as shown in FIG.
First, FIG. 11A shows moving image data of 24 frames per second obtained by decoding by the decoding means 102. Here, a1 and a2 in the figure are frames of the moving image data (A) at 24 frames per second. Each frame of the moving image data (A) 24 frames per second written in the frame memory 103 is shown in FIG.
The data is decomposed into odd fields and even fields as shown in FIG. That is, the frame a1 is decomposed, and the odd-numbered field is read out as the field b1 and the even-numbered field is read out as two fields including the field b2. The next frame a2 is also decomposed, and the odd field is read out as fields b3 and b5, and the even field is read out as three fields consisting of field b4. Therefore field b
3 and the field b5 are exactly the same. In the next frame decomposition, the reading of the odd and even fields a1 and a3 and a2 and a4 is reversed in order to adjust the arrangement of the odd and even fields of the interlaced field.

The above-described scan conversion method is called a 2-3 pull-down method, and converts 24 frames per second moving image data (A) to 60 fields per second interlaced moving image data (B) as shown in FIG. Things. The 2-3 pull-down method is generally and widely used as a scan conversion method.

Next, scan conversion is performed from the converted interlaced moving image data at 60 fields per second to progressive moving image data at 60 frames per second. In FIG. 11, (B) shows interlaced moving image data of 60 fields per second, and (C) shows progressive moving image data of 60 frames per second, which is scan-converted.

As shown in FIGS. 11B and 11C, one frame is formed by combining the odd field b1 and the even field b2 out of the fields constituting the interlaced moving image data (B) of 60 fields per second. Then, frames c1 and c2 of the interlaced moving image data (C) at 60 fields per second are generated. As shown in the figure, the odd-numbered field b3 and the even-numbered field b4 and the odd-numbered field b5 and the even-numbered field b4 of the fields constituting the interlaced moving image data (B) of 60 fields per second form the respective frames as shown in FIG. Frames c3 and c of interlaced moving image data (C)
4. Generate c5. In this case, the frames c1 and c2 are exactly the same, and the frames c3, c4,
c5 is exactly the same. As a result, 60
The progressive video data (C) of the frame is 2 per second.
The same image generated from each frame of the four-frame moving image data (A) is alternately repeated every two frames and every three frames.

In the above case, the frame data of the moving image of 24 frames per second written in the frame memory is decomposed into an odd field and an even field and read out.
A process of once performing scan conversion to interlaced moving image data at 60 fields per second and then converting the data into progressive moving image data at 60 frames per second is performed. There is also a method of directly performing scan conversion to data.

FIG. 12A shows moving image data of 24 frames per second. Here, a1 and a2 are 2 per second.
This is a frame of 4-frame moving image data (A). Each frame of the moving image data (A) of 24 frames per second written in the frame memory 103 is read out one frame at a time at a period of 60 frames per second, and scan-converted into progressive moving image data of 60 frames per second. That is, the frame a1 in (A) is read out as frames d1 and d2 at a cycle of 60 frames per second. Therefore, d1 and d2 are exactly the same. Next, the frame a2 in (A) is read out as frames d3, d4, d5 at a cycle of 60 frames per second. By repeating the above operation, scan conversion is performed into progressive moving image data of 60 frames per second. As a result, the progressive image data (D) at 60 frames per second is composed of two and three frames each of the same image generated from each frame of the moving image data (A) at 24 frames per second as in (C) of FIG. It will be repeated alternately.

In addition to the above-described method of repeating a frame, a motion correction method has been proposed as a scan conversion method that detects a motion vector and synthesizes and inserts a frame according to a time difference. This is a method of detecting a motion vector of a moving image and inserting an image at a correct position according to a time difference without performing frame repetition simply as in the above-described 2-3 pull-down method at the time of scan conversion.

FIG. 13 shows a comparison between the motion compensation method and the 2-3 pull-down method.
Moving image data of a frame, (D) moving image data subjected to scan conversion by the 2-3 pull-down method, and (D ′) moving image data subjected to scan conversion by the motion correction method. The frame D′ 1 of (D ′) is a frame predicted and generated from the motion vector detected from the moving image data of (A). Compared with the 2-3 pull-down scheme (D), the motion compensation scheme (D ') generates and inserts an image corresponding to the time difference like the frame D'1, so that the motion of the moving picture becomes more natural. .

[0013]

However, the scan conversion by the 2-3 pull-down method as described above results in a process of simply inserting a frame while repeating the duplication of the frame alternately between two and three frames. . As a result, each frame of the input moving image data of 24 frames per second should have been reproduced at the same time interval of 1/24 second, whereas 6 frames per second generated by scan conversion was used.
For 0-frame moving image data, the same image is 2/60
It is reproduced at different intervals of seconds and 3/60 seconds, and it is inevitable that an unnatural motion occurs as a moving image.

In the scan conversion of the motion compensation method as described above, a frame predicted based on a motion vector is synthesized, so that a smooth moving image can be obtained. There is a problem that a high-performance and complicated circuit is required for the correction calculation processing.

The present invention has been made in view of the above problems, and provides a moving image scan conversion apparatus that generates a moving image that realizes a smooth movement by synthesizing and inserting frames without requiring a high-performance and complicated circuit. The purpose is to do.

[0016]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, a moving image scan conversion apparatus according to the present invention converts moving image data of 24 frames per second into an interlaced moving image of 60 fields per second by a 2-3 pull-down method. First scan conversion means for performing scan conversion on data, and generating frame data by combining each field data generated by the first scan conversion means and field data which is time-series adjacent to each field data. In this case, there is provided a second scan conversion means for performing a scan conversion to the moving image data of the progressive scanning method of 60 frames per second.

With such a configuration, of the interlaced field data of 60 fields per second generated by the 2-3 pull-down scheme, the field data adjacent in time series are combined to generate and insert the progressive video frame data. This makes it possible to provide a device in which the smoothness of motion of a moving image is improved without requiring a complicated circuit for motion compensation.

Next, in order to solve the above-mentioned problem, a moving image scan conversion apparatus according to the present invention scan-converts 24 frames per second moving image data into 60 frames per second progressive moving image data by a 2-3 pull-down method. And generating new frame data by synthesizing each frame data generated by the first scan conversion means and frame data adjacent to each frame data in time series. A second scan conversion means for performing a scan conversion to progressive scan type moving image data of 60 frames per second.

With such a configuration, of the progressive frame data of 60 frames per second generated by the 2-3 pull-down system, a pixel of each coordinate of frame data adjacent in time series is combined to newly form a progressive moving image frame. Data can be generated, and an apparatus in which the smoothness of motion of a moving image is improved without requiring a complicated circuit for motion compensation can be provided.

Next, in order to solve the above-mentioned problems, a moving image scan conversion apparatus according to the present invention scans 24 frames of moving image data per second into interlaced moving image data of 60 fields per second by a 2-3 pull-down method. First scan conversion means for performing conversion, and field data generated by decomposing one frame data into two field data among the field data generated by the first scan conversion means. To generate the same frame data for two frames and decompose one frame data into three field data. For the field data generated, the first and second field data of the three fields are combined. To generate the same frame data for two frames, Field data is provided with second scan conversion means for generating one frame data in combination with the first field data of two field data decomposed from the next frame adjacent in time series. I do.

With this configuration, it is possible to generate a composite frame of the third field data of the field data decomposed into three fields and the field data of the next frame adjacent in time series, and It is possible to provide a device in which the smoothness of the motion of the moving image is improved without requiring the complicated circuit.

Next, in order to solve the above-mentioned problems, the moving image scan conversion apparatus according to the present invention scan-converts 24 frames of moving image data per second into progressive moving image data of 60 frames per second by a 2-3 pull-down method. And the frame data obtained by converting one frame data of the 24 frames per second moving image data into two frame data by the first scanning conversion means are directly converted into two frame data, and the 24 frame moving image per second is obtained. As for the frame data obtained by converting one frame data of the image data into three frame data, the first and second frame data are directly used as two frame data, and the third frame data is stored in a time series adjacent to the next frame data. Two frames of data decomposed from 24 frames of moving image data per second Characterized by comprising a second scanning conversion means for generating one-frame data in combination with Chino first frame data.

With such a configuration, it is possible to generate a composite frame of the third frame data of the frame data decomposed into three frames and the frame data of the next frame adjacent in time series. It is possible to provide a device in which the smoothness of the motion of the moving image is improved without requiring the complicated circuit.

Further, in the moving image scan conversion apparatus according to the present invention, when the moving image scan conversion is stopped, the first scan conversion means obtains the last image obtained at the time of stop by the first scan conversion means when generating frame data of the stop display screen. It is preferable to generate the frame data of the stop display screen by combining the field data of the second and the last field data.

With this configuration, when field data after the stop cannot be obtained by the stop processing,
By performing processing to generate frame data at the time of stop from synthesis of field data obtained immediately before stop,
A stop display image can be obtained.

Further, the moving picture scan conversion apparatus according to the present invention further comprises inter-frame correlation detecting means for detecting a correlation between frames adjacent to each other in a time series of moving picture data of 24 frames per second. The conversion unit converts the first scan data generated by decomposing the first frame data and the second frame data in which the correlation between frames detected by the inter-frame correlation detection unit is smaller than a predetermined value. For field data by means,
The first frame data and the second frame data are not combined with each other without performing field data synthesis, and the frame data is generated only by the fields decomposed from the first frame data. It is preferable to generate frame data only by fields decomposed from data.

With this configuration, when a scene of a video is changed, a composite image that extends over uncorrelated frames is not generated, and a moving image is not degraded.

Further, the moving picture scan conversion apparatus according to the present invention comprises decoding means for decoding the coded moving picture data of 24 frames per second, and the decoded moving picture of 24 frames per second decoded by the decoding means. Preferably, image data is input to the first scan conversion means.

With this configuration, the input data is transmitted at a rate of 24
Even in the case of encoded moving image data of a frame, it can be used as input data, and decoding and scan conversion can be performed by the moving image scan conversion device.

[0030]

Embodiment

Embodiment 1 Hereinafter, a moving image scan conversion device according to Embodiment 1 of the present invention will be described with reference to the drawings. The first embodiment employs a 2-3 pull-down scheme and a rate of 60 per second.
After conversion into interlaced moving image data of a field, a composite frame image is generated between fields adjacent in time series, and progressive moving image data of 60 frames per second is obtained. The input is coded moving image data of 24 frames per second, and a decoding unit is provided at the input stage.

FIG. 1 is a schematic diagram of a moving image scan conversion apparatus according to the first embodiment. In FIG. 1, reference numeral 1 denotes coded image data input means for inputting coded moving image data of 24 frames per second. A decoding unit 2 decodes the encoded moving image data input by the encoded image data input unit 1. Reference numeral 3 denotes a frame memory as a buffer for temporarily storing moving image data obtained by the decoding means 2. Reference numeral 4 denotes a scan conversion unit that reads out moving image data written in the frame memory 3 while controlling the timing and performs scan conversion. A display unit 5 reads the moving image data generated by the scan conversion unit 4 and displays it as a moving image. Encoded video data input means 1
The display means 5 is controlled by the system controller 106.

The scan conversion processing of the moving image scan conversion apparatus configured as described above will be described with reference to FIG. First, FIG. 2A shows moving image data of 24 frames per second obtained by decoding by the decoding means 2. Here, in the drawing, a1 and a2 are frames of the moving image data (A) of 24 frames per second. Each frame of (A) written into the frame memory 3 is decomposed into an odd field and an even field as shown in FIG.
That is, in the frame a1, the odd field is read as the field b1 and the even field is read as the field b2. In the next frame a2, the odd field is read as three fields b3 and b5, and the even field is read as three fields b4. Therefore, the field b3 and the field b5 are exactly the same. Further, in the next frame a3, the odd field is read out in the field b7, and the even field is read out in the field b6. In the next frame a4, the odd field is read as the field b9, and the even field is read as the three fields b8 and b10. Here, in order to adjust the odd-even arrangement of the fields of the interlaced image in (B), a
Reading of odd and even fields of 1 and a3 and a2 and a4 is reversed.

Scan conversion is performed from 24 frames per second moving image data (A) to 60 fields per second interlaced moving image data (B) by the 2-3 pull down method described above. Here, from the interlaced moving image data (B) of 60 fields per second generated as shown in FIG.
Scan conversion is performed into moving image data (C) of progressive scanning of the frame. That is, the frame e1 is generated by combining the odd field b1 and the even field b2 of the interlaced moving image data (B) of 60 fields per second decomposed from the frame a1 of the moving image data (A) of 24 frames per second. Here, the frame e1 is a frame in the progressive moving image data (C) of 60 frames per second. Next, the even field b2 of the frame a1 in (A) and the odd field b3 of the frame a2 are combined to generate the frame e2 in (C). as a result,
The generated frame e2 in (C) can be said to be a frame synthesized from the frames a1 and a2 in (A). Next, a frame e3 in (C) is generated by combining the odd field b3 and the even field b4 decomposed from the frame a2 in (A). Next, a frame e4 in (C) is generated by combining the even field b4 and the odd field b5 decomposed from the frame a2 in (A). At this time, the frames e3 and e4 are exactly the same image. Then (A)
The odd field b5 of the frame a2 and the even field b6 of the frame a3 are combined to generate the frame e5 in (C). As a result, the generated frame e5 in (C) can be said to be a frame synthesized from the frames a2 and a3 in (A).

The above processing is repeated to generate progressive scanning moving image data (C) of 60 frames per second.
The frames composing the generated moving image data (C) include the same frame as the input moving image data (A) of 24 frames per second, and two frames adjacent to each other in the time series of (A).
Frames synthesized from frames are also inserted.

In the conventional scan conversion system using only the 2-3 pull-down system, the same image is repeated for 2/60 seconds, 6
Reproduction is performed at intervals of 3/0 second, and the change in motion of the moving image is not smooth, and it is inevitable that the motion becomes unnatural. On the other hand, in the scan conversion method of the moving image scan conversion device according to the present invention, two adjacent frames in a time series are inserted between frames in the input 24 frames of moving image data. The change in the motion of the moving image is smoothed, and the naturalness of the motion is improved as compared with the scan conversion method of the 2-3 pull-down method.

FIG. 3 is an example of a diagram of a process of writing and reading data to and from the frame memory 3 of the moving picture scan converter. In the case of this example, the frame memory 3 is configured to have a memory bank for two frames, and M1 and M
2 is divided into memory areas for one frame. In the memory areas M1 and M2, data can be written and read for each field. In FIG. 3, for convenience of explanation,
The data write / read area for one field is divided into M11, M12, M22 and M23.

Here, after the writing of the field data into the memories M1 and M2 is completed, the written field data can be read, and the data of the two fields of the odd field and the even field can be read at a speed of 1/60 second. It can be read. In FIG. 3, data of the even field 10 is written to the memory area M22, and then data of the odd field 11 is written to the memory area M11. These written field data are read out at the following timings 13 and 14, and one frame data is generated by combining them. The generated frame data is frame data constituting progressive moving image data of 60 frames per second. Next, the data of the even-numbered field 12 is written into the memory area M12 and read at the timing of 16. At this time, the data of the odd field 11 which has been written is also read out at the same time at the timing of 15, and is combined to generate one frame of data. Next, the data of the odd field 11 and the data of the even field 12 which have already been written are read out at timings 17 and 18, and one frame of data is generated by combining them. The generated frame data is a frame constituting progressive moving image data of 60 frames per second.

As a result of controlling the writing and reading of the field data to and from the frame memory 3, the progressive moving image data of 60 frames per second shown in FIG. 2 is generated.

As described above, according to the first embodiment, scan conversion from moving image data of 24 frames per second to progressive moving image data of 60 frames per second can be realized.
In this scan conversion, by generating a frame synthesized from frames adjacent in time series, a simple configuration that does not require a motion compensation circuit is used to simply convert a frame of input moving image data by a 2-3 pull-down method. It is possible to obtain a moving image with a smoother motion than the method of inserting only a copy.

(Embodiment 2) Next, the operation of the scan conversion means of the moving image scan conversion apparatus according to Embodiment 2 of the present invention will be described with reference to FIG. In the second embodiment, after converting into progressive moving image data of 60 frames per second by the 2-3 pull-down method, a synthesized frame image is generated between frames adjacent in time series to obtain moving image data with smooth motion. is there.

First, FIG. 4A shows moving image data of 24 frames per second obtained by decoding by the decoding means 2. Here, in the drawing, a1 and a2 are frames of the moving image data (A) of 24 frames per second. Each frame of the moving image data (A) of 24 frames per second written in the frame memory 3 is read out by one frame at a period of 60 frames per second and scan-converted into progressive scanning moving image data of 60 frames per second. That is, the frame a1 in (A) is read out as frames d1 and d2 at a cycle of 60 frames per second. Therefore, d1 and d2 are exactly the same.
Next, the frame a2 in (A) is read out as frames d3, d4, d5 at a cycle of 60 frames per second. Also, d6 is one of two frames read out from the frame a3 of (A) at a period of 60 frames per second.

According to the above 2-3 pull-down method, scan conversion is performed from 24 frames per second moving image data (A) to 60 frames per second progressive scanning moving image data (D).

Here, 6 per second generated as shown in FIG.
Moving image data of progressive scan of 0 frame (D)
Is further converted into progressive scan moving image data (F) at 60 frames per second by the following processing. Here, the moving image data (F) represents each pixel value of the frame by 2 of (D).
The average value of pixels at each coordinate of the frame is progressive moving image data of 60 frames per second.
First, frames d1 and d2 of progressive scan moving image data (D) of 60 frames per second which are the same data as frame a1 of moving image data (A) of 24 frames per second.
To generate a frame f1 of the moving image data (F). Since frames a1, d1, and d2 are the same frame data, f
1 is also the same. Next, a frame d2 in (D) that is the same as the frame a1 in (A), and a frame a in (A)
The average value of the pixels at each coordinate of the frame d3 in (D), which is the same as that in 2, is used to generate the frame f2 in (F). As a result, the generated frame f2 of (F) can be said to be a frame synthesized from the frames a1 and a2 in (A). Next, the average value of the pixels at the respective coordinates of the frame d3 in (D) that is the same as the frame a2 in (A) and the frame d4 in (D) that is the same as the frame a2 in (A) is calculated, and (F) Is generated. Next, a frame d4 in (D) that is the same as the frame a2 in (A),
(D) frame d which is the same as (a) frame a2
5, the average value of the pixels at each coordinate is taken, and the frame f of FIG.
4 is generated. Here, frames a2, d3, d4, d5
Are the same frame data, so the frames f3 and f4 are also the same. Next, it is the same as the frame a2 in (A) (D)
The average value of the pixel at each coordinate of the frame d5 of (D) and the frame d6 of (D) that is the same as the frame a3 of (A) is calculated,
The frame f5 of (F) is generated. As a result, it can be said that the generated frame f5 of (F) is a frame synthesized from the frames a2 and a3 of (A).

While repeating the same processing as above, 6
0-frame progressive scanning moving image data (F) is generated. The frames constituting the generated moving image data (F) include the same frame as the input moving image data (A) of 24 frames per second, and are synthesized from two frames adjacent in the time series of (A). Frame is also inserted. As a result, the progressive moving image data of 60 frames per second generated by the scan conversion method of the moving image scan conversion apparatus according to the second embodiment is 60 frames per second generated by the scan conversion method of the moving image scan conversion apparatus of the first embodiment. It becomes the same as the progressive video data of the frame. Therefore, as described in the first embodiment, the time-series adjacent two frames between the input frames of the moving image data of 24 frames per second are input.
The frame of the composite image of the frame is inserted, and the change in the motion of the moving image is smoothed.
The movement becomes more natural as compared with the scan conversion method of the three pull-down method. In the second embodiment, the composite image between the two frames uses the pixel average value of each coordinate of the two frames for each pixel as its pixel value. It may be used for deriving a pixel value. As described above, compared with the first embodiment,
The method of combining frames can be flexibly selected.

(Embodiment 3) Next, the operation of the scan conversion means of the moving image scan conversion apparatus according to Embodiment 3 of the present invention will be described with reference to FIG.
This will be described with reference to FIG. In the third embodiment, first, a composite frame image is generated between time-series adjacent fields after converting into interlaced moving image data of 60 fields per second by a 2-3 pull-down method.
The combination of the fields to be combined is different from that of.

First, FIG. 5A shows moving image data of 24 frames per second obtained by decoding by the decoding means 2. Here, a1 and a2 in the figure are frame data of the moving image data (A) at 24 frames per second. Each frame of the moving image data (A) at 24 frames per second is decomposed into an odd field and an even field as shown in FIG. That is, the frame a1 is decomposed, and the odd field is read as a field b1 and the even field is read as a total of two fields b2. The next frame a2 is also decomposed, and the odd fields are read as fields b3 and b5, and the even fields are read as a total of three fields b4. Therefore, the field b3 and the field b5 are exactly the same. Further, in the next frame a3, the odd field is read out in the field b7, and the even field is read out in the field b6. In the next frame a4, the odd field is the field b9, and the even field is the fields b8 and b10.
Are read out for three fields. Here, in order to adjust the arrangement of the odd and even fields of the field of the interlaced image in (B), the reading of the odd and even fields of a1 and a3 and of a2 and a4 is reversed. Scan conversion is performed from 24 frames per second moving image data (A) to 60 fields per second interlaced moving image data (B) by the above 2-3 pull-down method.

Further, the converted interlaced moving image data (B) at 60 fields per second is scan-converted into progressive moving image data (G) at 60 frames per second. In FIG. 5, (B) is interlaced moving image data of 60 fields per second, and (G) is progressive moving image data of 60 frames per second which is scan-converted. That is,
Odd field b1 and even field b of interlaced moving image data (B) of 60 fields per second decomposed from frame a1 of moving image data of 24 frames per second (A)
2 to generate a frame g1. Here, the frame g1 is a frame of the progressive moving image data (G) of 60 frames per second. Next, the frame a of (A)
By combining the even field b1 of 1 and the odd field b2 of the frame a2, a frame g2 of (G) is generated. As a result, the generated frame g2 of (G) can be said to be a frame synthesized from the frames a1 and a2 of (A). Next, a frame is generated by combining the odd field b3 and the even field b4 decomposed from the frame a2 in (A), and the frames g3 and g4 in (G).
And At this time, the frame g3 and the frame g4 are exactly the same frame. Next, the odd field b5 of the frame a2 and the even field 60 of the frame a3 in FIG.
To generate the frame g5 of (G). As a result, the generated frame g5 is a frame synthesized from the frames a2 and a3.

By repeating the same processing as above, scan conversion is performed to progressive scan moving image data (G) of 60 frames per second. The frames constituting the scan-converted moving image data (G) include the same frame as the input 24 frames of moving image data (A), and are synthesized from two frames adjacent in time series in (A). Frame is also inserted.

As described above, in the method of the third embodiment as well, one frame of a composite image with the next frame is inserted after two frames of the same frame continue, and the same frame continues for two frames again. The change in the motion of the moving image is smoothed, and the motion of the image becomes more natural as compared with the scan conversion method of the 2-3 pull-down method.

(Embodiment 4) The operation of the scan conversion means of the moving image scan conversion apparatus according to Embodiment 4 of the present invention will be described with reference to FIG. In the fourth embodiment, after converting into progressive moving image data of 60 frames per second by the 2-3 pull-down method, a composite frame image is generated only between some of the frames, and the motion of the moving image is smoothed. To improve the quality.

First, FIG. 6A shows moving image data of 24 frames per second obtained by decoding by the decoding means 2. Here, in the drawing, a1 and a2 are frames of the moving image data (A) of 24 frames per second. Each frame of the moving image data (A) of 24 frames per second written in the frame memory 3 is read out by one frame at a period of 60 frames per second, and scan-converted into progressive moving image data of 60 frames per second. That is, the frame a1 of FIG.
The frames are read as frames d1 and d2 at a cycle of 0 frame. Therefore, d1 and d2 are exactly the same. Next, the frame a2 in (A) is read out as frames d3, d4, d5 at a cycle of 60 frames per second. Also, d6 is one of two frames read out from the frame a3 of (A) at a period of 60 frames per second. Scan conversion is performed from the moving image data (A) at 24 frames per second to the moving image data (D) of progressive scanning at 60 frames per second by the above 2-3 pull-down method.

Here, 6 per second generated as shown in FIG.
Moving image data of progressive scan of 0 frame (D)
Is further converted into progressive scanning moving image data (H) at 60 frames per second. First, the two frames d1 and d2 of (D) are respectively stored in the frame memory 3 by (H)
As frames h1 and h2. (H) is 6 per second
This is progressive scanning moving image data of 0 frame.
Next, the two frames d3 and d4 of (D) are read from the frame memory 3 as the frames h3 and h4 of (H), respectively. Next, the average value of the pixels at each coordinate from the frames d5 and d6 in (D) is set as the pixel value at that coordinate (H).
Is generated. Here, the frame d in (D)
5 and the frame a2 of (A) are the same data, and (D)
Since the frame d6 of (A) has the same data as the frame a3 of (A), as a result, the generated frame h5 of (H)
Can be said to be a frame synthesized from the frames a2 and a3 of (A).

By repeating the above processing, progressive scanning moving image data (H) of 60 frames per second is generated. The frames constituting the generated moving image data (H) include the input moving image data (A) of 24 frames per second.
And a frame synthesized from two adjacent frames in the time series (A) is also inserted. As a result, the progressive scanning moving image data of 60 frames per second generated by the scan conversion in the fourth embodiment becomes the same as the progressive scanning moving image data of 60 frames per second generated in the third embodiment. Therefore, as in the third embodiment, after the same frame continues for two frames, one frame of the composite image with the next frame is inserted between them, and then the next frame continues for two frames. As described above, the change in the motion of the moving image is smoothed, and the motion of the moving image becomes more natural as compared with the scan conversion method of the 2-3 pull-down method.

(Embodiment 5) The operation of the moving image scan conversion apparatus according to Embodiment 5 of the present invention will be described with reference to FIG. The fifth embodiment provides a moving image scan conversion apparatus capable of obtaining an image at the time of a stop even during a temporary stop during the decoding / reproducing process.

Here, the scan conversion method itself of the fifth embodiment is the same as that of the first embodiment, and the moving image data of 24 frames per second is converted into the moving image data of the interlaced scanning of 60 fields per second by the 2-3 pull-down method. Scan conversion is performed, and two fields adjacent to each other in the time series of the decomposed fields are combined into one frame, and converted into progressive scan moving image data at 60 frames per second for reproduction and display. Thus, the scan conversion is performed at 60
Each frame data constituting the moving image data of the progressive scanning of the frame is generated from two fields adjacent in time series which constitute the moving image data of the interlaced scanning of 60 fields per second.

At a certain point in time, when an event of a pause of decoding / reproduction is input to the moving image scanning conversion apparatus, and the pause processing of decoding / reproduction is performed, the following processing is performed. Assume that the frame to be temporarily stopped is frame a4 of the moving image data (A) of 24 frames per second as shown in FIG.
The stop image data of the progressive scan moving image data (E) of frame 0 is frame e10 '. Frame a
Reference numeral 4 denotes a last frame obtained by reproducing the frames constituting the moving image data of 24 frames per second. In the last frame a4, the odd field is decomposed into b9, and the even field is decomposed into two fields b8 and b10. Here, the fields b8 and b10 are exactly the same data. The frame e9 is generated by combining the even field b10 and the odd field b9, and the last frame e1
For 0 ', the last frame a4 of the input moving image data
The frame e10 'is generated from the even field b10 and the odd field b9 decomposed from the above.

As a result, even when the next one field adjacent in time series cannot be obtained due to the temporary stop of the decoding / reproducing process of the moving picture scan converter, the previous one field b9 from the input moving picture data is obtained. Is one of the fields, it is possible to generate the last frame e10 'from two fields in combination with the field b10.

As described above, during decoding and reproduction, by generating a frame synthesized from frames adjacent in time series during decoding and reproduction, a simple structure that does not require a motion correction circuit and smooth motion can be obtained. You can get moving images,
When a stop event occurs, a stop image can be obtained.

(Embodiment 6) Next, the operation of the moving picture scan conversion apparatus according to Embodiment 6 of the present invention will be described with reference to FIGS. In the sixth embodiment, scan conversion is performed by determining whether to generate and insert a combined frame with the next frame or not to generate a combined frame according to the correlation between two adjacent scan conversion source frames. .

FIG. 8 is a schematic diagram of a moving image scan conversion device. In FIG. 8, reference numeral 19 denotes coded image data input means for inputting coded moving image data of 24 frames per second. 20 is a decoding means, which is an encoded image data input means 1
9 to decode the input coded video data.
Reference numeral 21 denotes a frame memory as a buffer for temporarily storing moving image data obtained by the decoding unit 20. Reference numeral 22 denotes a scan conversion unit that reads out moving image data written in the frame memory 21 while controlling the timing and performs scan conversion. A display unit 23 reads the moving image data generated by the scan conversion unit 22 and displays the data as a moving image. The inter-frame correlation detecting means 25 detects and determines the magnitude of the correlation between two frames written in the frame memory 21. The scan converter 22 is controlled by the result of the magnitude of the correlation detected by the inter-frame correlation detector 25. The encoded moving image data input means 19 to the display means 23 and the inter-frame correlation detection means 25 are controlled by the system controller 24.

The operation of the moving picture scan conversion apparatus configured as described above will be described with reference to FIG. Here, in FIG. 9, (A) is 24 frames of moving image data per second, (B) is interlaced moving image data of 60 fields per second,
(E) is moving image data of progressive scanning at 60 frames per second. Here, the frames a3 'and a in FIG.
4 ′ has a low correlation due to a scene change or the like.

First, an image of one frame of the moving image data (A) of 24 frames per second is decomposed into an odd field and an even field by scan conversion into interlaced scanning moving image data (B) at 60 fields per second. . For example, in frame a3 ', the odd field is field b.
At 7 ', the even field is decomposed into two fields b6'. Next, 1
In a process of generating a frame and generating moving image data (E) of progressive scanning at 60 frames per second, a frame e6 'is generated from the odd field b6' and the even field b7 '.

In generating the next frame (E), the magnitude of the correlation between the frames is checked by the inter-frame correlation detecting means 25, and based on the result, the synthesized frame with the next frame is generated in generating the frame. Is generated and inserted, or a synthetic frame is not generated.
For example, in the generation of the (E) frame e7 ', the inter-frame correlation detection means 25 detects that the correlation between the frames a3' and a4 'in the frame memory 21 is low.
The frame e7 'is composed of two fields obtained by decomposing the frame a3', that is, an odd field b7 'and an even field b.
6 ', and a combined frame with the next frame a4' is not generated.

As described above, by the decoding / reproducing process using the inter-frame correlation, the frames are not synthesized by the two frames having the low correlation, and the generated frame when not synthesized is generated from one frame of the input moving image data. So that the natural movement of the image is not impaired.

[0065]

According to the moving image scan conversion apparatus of the present invention, after converting 24 frames per second moving image data to 60 fields of interlaced scanning moving image data per second, two fields adjacent in time series are combined. By generating one frame corresponding to the time difference, a frame image to be inserted can be synthesized without requiring a complicated circuit for motion compensation, and a moving image with smooth motion can be generated.

After converting the moving image data of 24 frames per second into interlaced moving image data of 60 fields per second, the pixel value of the frame data corresponding to the time difference is calculated from the corresponding pixel value between two frames adjacent in time series. By calculating and inserting the moving image, a moving image having a smooth motion can be generated without requiring a complicated circuit for motion correction.

When it is not possible to obtain the field data after the stop by the stop processing, the stop display image is generated by performing the processing of generating the frame data at the stop from the synthesis of the field data obtained immediately before the stop. Obtainable.

Further, by performing decoding / reproducing processing in accordance with the correlation between frames adjacent in time series, it is possible to avoid frame synthesis between frames having a low correlation due to a scene change or the like.

[Brief description of the drawings]

FIG. 1 is a schematic diagram of a moving image scan conversion device according to a first embodiment of the present invention;

FIG. 2 is an explanatory diagram of a scan conversion operation of the moving image scan conversion device according to the first embodiment of the present invention;

FIG. 3 is a diagram of a writing / reading process with respect to a frame memory of the moving image scan conversion device according to the first embodiment of the present invention;

FIG. 4 is an explanatory diagram of scan conversion operation of the moving image scan conversion device according to the second embodiment of the present invention;

FIG. 5 is an explanatory diagram of scan conversion operation of the moving image scan conversion device according to the third embodiment of the present invention.

FIG. 6 is an explanatory diagram of the scan conversion operation of the moving image scan conversion device according to the fourth embodiment of the present invention.

FIG. 7 is an explanatory diagram of scan conversion operation of the moving image scan conversion device according to the fifth embodiment of the present invention.

FIG. 8 is a schematic diagram of a moving image scan conversion device according to a sixth embodiment of the present invention.

FIG. 9 is an explanatory diagram of scan conversion operation of the moving image scan conversion device according to the sixth embodiment of the present invention.

FIG. 10 is a schematic diagram of a conventional moving image scan conversion device.

FIG. 11 is an explanatory diagram of scan conversion operation of a conventional moving image scan conversion device.

FIG. 12 is an explanatory diagram of an operation of scan conversion of a conventional moving image scan conversion device.

FIG. 13 is a comparison between scan conversion of the conventional motion compensation method and scan conversion of the 2-3 pull-down method.

[Explanation of symbols]

 Reference Signs List 1,19 Encoded image data input means 2,20 Decoding means 3,21 Frame memory 4,22 Scan conversion means 5,23 Display means 6,24 System controller 25 Inter-frame correlation detection means

Claims (7)

[Claims] 1. A moving image scan conversion apparatus for converting 24 frames per second of moving image data into 60 frames per second of a progressive scanning type moving image data, wherein 24 frames per second of moving image data is converted by a 2-3 pull-down method. First scan conversion means for performing scan conversion to interlaced moving image data of 60 fields per second, each field data generated by the first scan conversion means, and a field adjacent to each field data in time series A moving image scan conversion apparatus, comprising: a second scan conversion unit that performs scan conversion to progressive scan moving image data of 60 frames per second by generating frame data in combination with data. 2. A moving image scan conversion apparatus for converting 24 frames per second moving image data into 60 frames per second progressive scanning moving image data, wherein 24 frames per second moving image data is converted by a 2-3 pull-down method. First scan conversion means for performing scan conversion to progressive video data of 60 frames per second, frame data generated by the first scan conversion means, and frame data time-series adjacent to the frame data; And a second scan conversion means for performing scan conversion to progressive scan type moving image data of 60 frames per second by generating new frame data by combining the two. 3. A moving image scan conversion apparatus for converting 24 frames per second of moving image data into 60 frames per second of a progressive scanning type moving image data, wherein 24 frames per second of moving image data is converted by a 2-3 pull-down method. First scan conversion means for performing scan conversion to interlaced moving image data of 60 fields per second; and 1 of the field data generated by the first scan conversion means.
The field data generated by decomposing the frame data into two field data was generated by combining the two field data to generate the same frame data for two frames, and decomposing one frame data into three field data. For field data, the first and second field data of the three fields are combined to generate the same frame data for two frames, and the third field data is generated from the next frame adjacent in time series. A moving image scan conversion device, comprising: a second scan conversion unit that generates one frame data by combining the first field data of the two decomposed field data. 4. A moving image scan conversion device for converting 24 frames per second moving image data into 60 frames per second progressive scanning moving image data, wherein 24 frames per second moving image data is converted by a 2-3 pull-down method. First scan conversion means for performing scan conversion to progressive video data at 60 frames per second, and frames obtained by converting one frame data of 24 frames of video data per second into two frame data in the first scan conversion means The data is used as it is as two frame data.
The first frame data obtained by converting one frame data of the four frame moving image data into three frame data is the first frame data.
The second and third frame data are two frame data as they are, and the third frame data is the first of the two frame data decomposed from the next 24 frames of moving image data adjacent to each other in time series. A moving image scan conversion device, comprising: a second scan conversion means for generating one frame data in combination with the second frame data. 5. When the moving image scan conversion is stopped, in generating frame data of a stop display screen, the last field data and the second to last field obtained at the time of stop by the first scan conversion means. 4. The moving image scan conversion device according to claim 1, wherein frame data of a stop display screen is generated by combining the data with the data. 6. An inter-frame correlation detecting unit for detecting a correlation between frames adjacent to each other in a time series of moving image data of 24 frames per second, wherein the second scan conversion unit includes the inter-frame correlation detecting unit. For the field data by the first scan conversion means generated by decomposing the first frame data and the second frame data in which the correlation between the frames detected by the means is smaller than a predetermined value, respectively. The second frame data is generated only by fields decomposed from the first frame data without performing field data synthesis of a combination across the first frame data and the second frame data. 4. The method according to claim 1, wherein frame data is generated only by fields decomposed from the data. Moving image scan conversion device. 7. Decoding means for decoding coded moving image data of 24 frames per second, wherein said first scanning conversion means converts the decoded moving image data of 24 frames per second decoded by said decoding means. The moving image scan conversion device according to any one of claims 1 to 6, wherein the input is input to the moving image scan conversion device.