JP3193117B2 - Moving image processing method and apparatus therefor - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image processing method and apparatus, and more particularly, to a moving image processing method capable of efficient moving image data transfer without data access contention and highly reliable moving image data, and the same. It concerns the device.

[0002]

2. Description of the Related Art In a conventional moving image processing apparatus, various storing methods have been adopted for storing moving image data as shown in the following several examples. That is, (1) a method of storing only moving image data without additional information of the moving image data (for example, information such as a scene change);
(2) a method of adding and storing moving image management information (for example, information such as resolution of a moving image and the total number of frames) at the beginning or end of moving image data; and (3) moving image management information as a separate file. A method of storing the moving image data on the same storage medium (for example, a hard disk or the like); (4) a method of storing each frame of image data individually as one file when the moving image data is not compressed; ) IS
O, a working group of MPEG (Moving Picture coding Experts Grou
In accordance with the video coding scheme for stored media, which is being standardized in p), the basic algorithm is motion compensation + DCT (discrete cosine transform), and Huffman coding is performed using variable-length coding to perform image compression. For example, there is a method of storing data having different frame lengths.

[0003]

However, in the above-mentioned conventional example, when there is no additional information of the moving image data, only the moving image data can be simply reproduced (fast forward, reverse reproduction, etc.). Further, when management information of moving image management information (for example, resolution information of a moving image, the total number of frames, and the like) is stored in the same storage medium (for example, a hard disk or the like) as moving image data, for example, a certain moving image If another moving image data is displayed during the display of the image data, or if processing such as reading only the moving image management information is performed, access competition for the same storage medium occurs, and the display speed of the moving image being displayed is reduced. There is a disadvantage that it cannot be maintained at 30 frames / sec. Further, when the user manages the moving image data and the management information as separate files on the same medium, the moving image data and the management information cannot be associated with each other, or the moving image data and / or the uncorrelated moving image data and / or the management information have no correspondence. Since the problem of erasing the management information by mistake may occur, the problem also develops that the consistency of the management information with other moving image data is lost.

[0004] Furthermore, when moving image data is compressed according to a compression method which is being studied by the International Standards Committee such as MPEG, if there is no moving image management information, an arbitrary frame in the middle of a moving image cannot be transmitted. For image reproduction and the like, there is no access method other than searching for a corresponding frame by a seek operation from the beginning of moving image data. However, this method has a disadvantage that it takes time to access the corresponding frame.

[0005] Furthermore, since the moving image processing apparatus has a huge amount of data to be processed as compared with a processing apparatus that handles still image data, the moving image processing apparatus is provided with a large-capacity hard disk for storing the image data. It is required to have a high-speed disk interface to display data at a rate of about 30 frames / second. Further, when the data input / output speed of the hard disk is insufficient, it is necessary to provide an image memory for temporary storage or to provide a semiconductor disk in the data input / output unit.

However, in the above conventional example, the input / output data speed of the disk interface of a large-capacity hard disk is generally low, and the image data reading speed of about 30 frames / second cannot be maintained. For this reason, it is necessary to perform processing such as reducing the image size or compressing the moving image to greatly reduce the number of data bits. As a result, there is a problem that high-quality moving image reproduction cannot be performed. Was. Further, when a large-capacity disk having a high-speed interface is provided, the cost becomes extremely high. On the contrary, if the disk capacity is limited to a small value, a long moving image or a high-quality moving image cannot be stored.

Further, in order to satisfy high-speed reading,
If the apparatus is configured to temporarily store moving image data in an image memory or employ a semiconductor memory, the capacity of the moving image data storage is limited by the capacity of the image memory or the semiconductor disk. In addition, these devices are expensive, leaving a cost problem.

Further, in order to store a huge amount of original data of a plurality of kinds of moving images at the same time, a removable type O
Although it is possible to cope while changing the recording medium using an MD or the like, the data input / output speed of the disk interface and the access time to the recording medium are slow, which is also satisfactory from the viewpoint of reproducing high-quality moving images. It is not going.

The present invention has been made in view of the above conventional example, and has as its object to provide a moving image processing method and apparatus capable of efficiently accessing moving image data.

[0010]

In order to achieve the above object, a moving picture processing apparatus according to the present invention has the following arrangement.
That is, a moving image processing apparatus that expands compressed moving image data and displays the expanded moving image data on a display unit, wherein the first storage unit stores the compressed moving image data and the first storage unit stores the compressed moving image data. Second storage means for reading and storing the compressed moving image data, and expansion means for reading the compressed moving image data stored in the second storage means and expanding the compressed moving image data in accordance with the display speed of the moving image And transfer means for transferring moving image data output from the decompression means to the display means, wherein the second storage means has at least a first storage part and a second storage part, 1st and 2nd memory | storage part "
To read the compressed moving image data from the second storage unit to the decompression unit and read the compressed moving image data from the first storage unit to the second storage unit. A moving image processing device characterized in that transfer is performed in parallel.

In order to achieve the above object, a moving image processing apparatus according to the present invention has the following arrangement. That is, a moving image processing apparatus that expands compressed moving image data and displays the expanded moving image data on a display unit, wherein the first storage unit stores the compressed moving image data and the first storage unit stores the compressed moving image data. A second storage unit that reads and stores the compressed moving image data; a decompression unit that reads and decompresses the compressed moving image data stored in the second storage unit; A transfer unit that transfers moving image data to the display unit, and reads out the compressed moving image data from the first storage unit to execute image processing;
Alternatively, image processing means for newly generating image data without depending on the compressed moving image data, and a first data bus for transferring the image data generated by the image processing means to the display means And a second data bus for transferring the compressed moving image data from the first storage means to the decompression means via the second storage means. In order to achieve the above object, a moving image processing method of the present invention includes the following steps. That is, a moving image processing method for decompressing compressed moving image data and displaying the expanded moving image data on a display means, wherein the compressed moving image data is read out from a first storage means storing the compressed moving image data and read out. (2) a storing step of storing the compressed moving image data stored in the second storing means, a decompressing step of reading out the compressed moving image data stored in the second storing means, and expanding the expanded moving image data by the expanding means; A transfer step of transferring the compressed moving image data to the display means, and executing the image processing by reading out the compressed moving image data from the first storage means, or adding a new image independently of the compressed moving image data An image processing step of generating data, and a transfer step of transferring the image data generated by the image processing step to the display means via a first data bus;
Transferring the compressed moving image data from the first storage means to the decompression means via the second storage means via a second data bus. In order to achieve the above object, a moving image processing method of the present invention includes the following steps. That is, a moving image processing method for decompressing moving image data that has been compression-encoded by adaptively using intra-encoding and inter-encoding and displaying the data on a display unit, and instructing a reproduction mode of the moving image. A search step of searching for management information of the moving image data stored in a first storage medium according to the reproduction mode; and a first storage medium based on the management information searched for in the search step. Has a reading step of reading moving image data stored in an independently accessible second storage medium, and a supplying step of expanding the moving image data read in the reading step and supplying the data to the display means. The management information includes at least information for identifying a location on the second storage medium where the intra-coded moving image data is stored. Moving image processing method. In order to achieve the above object, a moving image processing apparatus according to the present invention has the following configuration. In other words, there is provided a moving image processing apparatus for decompressing moving image data which has been compression-encoded by adaptively using intra-coding and inter-coding and displaying the decompressed moving image data on a display means. A storage medium, a second storage medium for storing management information corresponding to the moving image data, and a supply unit for expanding the moving image data and supplying it to the display unit; The storage media are mutually independent media and can be accessed independently of each other, and the management information identifies a location on the first storage medium where at least intra-coded video data is stored. A moving image processing apparatus characterized by including information for performing video processing.

[0012]

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

Here, five embodiments will be described. [Explanation of Common Moving Picture Compression Method (FIGS. 1 and 2)] In all the embodiments described below, "DCT + moving" which is being standardized by MPEG of the International Standards Committee (ISO) as a moving picture compression method. Media (DSM) using "compensation"
A moving image coding method is used (hereinafter referred to as an MPEG method). In the MPEG system, the resolution of a target moving image is 352 (horizontal) × 240 (vertical) × 3 in the case of NTSC.
At 0 frames / sec, the encoded data rate is 900 Kbp
s to 1.15 Mbps.

FIG. 1 is a diagram showing an outline of a moving picture coding procedure according to the MPEG system. FIG. 2 is a diagram showing an outline of the prediction between image data frames. The MPEG system is
As shown in FIG. 1, based on motion-compensated inter-frame prediction coding (1001 in FIG. 1) and DCT (1002 in FIG. 1), subsequent quantization (1003 in FIG. 1) and allocation of Huffman codes (FIG. 1, 1004), which is called a variable-length coding system.

The inter-frame predictive coding 1 shown in FIG.
001 is forward inter-frame predictive coding (shown as Predicted #n (n = 3, 6) in FIG. 2) and forward-backward bidirectional inter-frame predictive coding (FIG. 2, there are two types: Interpolated #n (indicated as n = 1, 2, 4, 5, N). Further, intra-frame predictive encoding is performed for image compression in an image frame (in FIG. 2, it is indicated as Intra #n (n = 0, N-1)). The intra-frame predictive encoding is performed at regular intervals to improve the image quality. In this embodiment, N = 15.

Hereinafter, a frame on which intra-frame predictive coding is performed is referred to as an intra frame, a frame on which forward inter-frame predictive coding is performed is a predictive frame, and a frame on which forward and backward bi-directional predictive coding is performed. It is called an interpolated frame. [First Embodiment (FIGS. 3 and 4)] FIG. 3 is a block diagram showing the configuration of a moving image processing apparatus according to a first embodiment of the present invention. In FIG. 3, reference numeral 100 denotes a common system bus for connecting the components of the device to each other; 101, a VFM unit including a video frame memory for storing a display image, a D / A converter for generating an input signal to a display device, and the like; 102, a display unit; 103, an image memory unit for storing processed image data; 104, a CPU for controlling and managing the entire apparatus
A moving image storage unit 105 for storing moving image data;
Reference numeral 12 denotes a moving image decompressor for decompressing a moving image compressed by the MPEG method described later, 5 denotes a keyboard (KB) for instructing operation, and 6 denotes a mouse.

The CPU 104 comprises a CPU 1, a ROM 2 for storing a control program, a RAM 3 used as a work area, and a system disk 4 used for backup of the control program and the like. Further, the moving image storage unit 105 includes a rewritable removable OMD (magneto-optical disk) 111 for storing a large amount of original moving image data, a disk controller 109 for controlling the removable OMD 111, a hard disk 110 capable of high-speed access and high-speed data transfer, It comprises a disk controller 108 for controlling the hard disk 110, a local bus 107 in the moving image storage unit 105, and a bus controller 106 for connecting the local bus 107 and the common system bus 100.

In this embodiment, the resolution of a high-definition moving image such as HDTV is 1920 pixels (horizontal) × 1035 lines (vertical) × 30 frames / sec. Further, the disk controller 109 is provided with a data transfer capability of 2.4 Mbytes / sec according to the SCSI standard.
Consider a data transfer capacity of 10 Mbytes / sec of the IPI standard. HDTV and NTS compressed by MPEG
Comparing the amount of image data per second of the C method, HD
TV image data is about 24 times larger. If the compression ratio is the same even if this image data is subjected to the image compression of the MPEG system, the encoded data also becomes 24 times, and the encoded data maintains the normal time resolution (30 frames / second) of the moving image. Directly with the SCSI standard disk controller 109
It is impossible to read from the OMD in which the moving image data is stored through the OMD.

In this embodiment, taking the above conditions into consideration, the OM
Once from D, the moving image data is transferred to the high-speed disk,
High-speed reading and reproduction of moving image data is performed by treating the high-speed disk as one buffer or cache.

Hereinafter, the moving image reading / reproducing processing executed by the moving image processing apparatus having the above configuration will be described with reference to the flowchart shown in FIG. Here, high-definition moving image data of the HDTV standard is stored in the OMD 111,
The user operates the OMD 11 with the keyboard 5 or the mouse 6.
It is assumed that reading of the moving image in 1 is designated.

First, in step S10, the CPU 1
Issues a command to read the moving image data to the disk controller 109 through the bus controller 106 and instructs the disk controller 108 to write the moving image data read from the OMD 111 via the local bus 107 to the high-speed hard disk 110. I do. Further, it instructs the bus controller 106 to break the logical connection between the local bus 107 and the system bus 100.

In step S15, the bus controller 106 monitors the reading of moving image data by the disk controller 109 and the writing of moving image data by the disk controller 108 until the end of these input / output processes. By issuing an interrupt signal to the CPU,
Notify PU1. The CPU 1 can perform another processing until receiving the input / output processing end notification. For example, the above-described moving image data input / output is performed on the local bus 10.
7, there is no load on the common system bus 100, and the CPU 1 can perform processing on the image memory unit 103 and the VFM unit 101 through the common system bus 100.

When the transfer of the moving image data from the disk 111 to the disk 110 is completed, in step S25, the CPU 1 instructs the disk controller 108 to read the moving image data from the high-speed hard disk 110 through the bus controller 106.
The bus controller 106 is logically connected to the local bus 107, and the moving image data read from the disk 110 is transmitted through the system bus 100 to the decompressor 1.
12 to be written. Further, it instructs the decompressor 112 to decompress the moving image data and write the decompressed moving image data to the address on the VFM corresponding to the position on the display designated by the user.

In step S30, in response to the command in step S25, the compressed moving image is read from the high-speed disk 110 and decompressed by the decompressor 112.
By outputting the moving image expanded to 01, the moving image is displayed on the display 102.

In step S35, the next instruction is waited for.
Here, if the user instructs the end of the process, the process ends. On the other hand, if the user indicates another moving image display, the process proceeds to step S40, where the completion of the output of the moving image data from the disk 110 is completed, and the input processing of the new moving image data is started from the OMD 111. .

In step S40, it is checked whether or not the OMD 111 has moving image data designated by the user. Here, if there is no corresponding image, the process returns to step S35 and waits for a user instruction. On the other hand, if there is a corresponding image, the process proceeds to step S45, and the input data amount is calculated. Subsequently, the process proceeds to step S50, and checks whether or not there is a free area in the high-speed disk 110. If there is a free area, the process returns to step S10, and the moving image data is started from the OMD 111 to the disk 110. On the other hand, if the disk 110 is full, the process proceeds to step S55. In step S55, the least frequently used image data is searched for and deleted from the moving image data stored in the disk 110.
In step S60, the empty area after erasure is checked to determine whether the empty area is sufficient for inputting new moving image data. If it is determined that there is enough free space,
The process returns to step S10 to start moving image input; otherwise, the process proceeds to step S65. In step S65, it is determined whether or not there is erasable data in the moving image data stored on the disk 110. Here, if it is determined that there is no erasable data, it is determined that image input is impossible, and the process returns to step S35 to wait for the next instruction from the user. On the other hand, if there is erasable data, the process returns to step S55 to continue erasing the image.

Therefore, according to this embodiment, the high-speed disk 1
By using 10 as a cache memory for moving image data, frequently used moving image data can be displayed at high speed without retransfer from the disk 111. Further, the high-speed disk can be used as a work area of the image memory unit 103 when performing moving image processing. [Second Embodiment (FIG. 5)] In the case of the first embodiment, since there is only one data path between the local bus 107 and the disk controller 108, during reading of moving image data from the high-speed disk 110, Data cannot be transferred from the OMD 111 to the high-speed disk 110. Based on this, in this embodiment, the data path between the local bus 107 and the disk controller 108, the data path between the disk controller 108 and the bus controller 106, and the configuration of the disk controller 108 and the bus controller 106 A moving image processing apparatus which enables simultaneous input and output will be described. In the present embodiment, since the configuration other than the moving image storage unit 105 is the same as that of the first embodiment, the device components of the common parts are referred to by the same device reference numbers, and description thereof is omitted.

FIG. 5 is a block diagram showing the configuration of the moving image storage unit 105 of this embodiment. In FIG. 5, the high-speed disk controller 208 includes an output-only directory 301 and an input-only directory 300 for the high-speed disk 110 that operates independently. The bus controller 206 also includes an input-only directory 305 and an output-only directory 306 for the system bus 100, each of which operates independently. In the high-speed disk controller 208, the input-only directory 300 is stored in the local bus 1 through the data path 303.
07, the output-only directory 301 is connected to the output-only directory 306 of the bus controller 206 via the data path 302. The input-only directory 305 of the bus controller 206 is connected to the local bus 107 via the data path 304.

When moving image data is transferred from the low-speed OMD 111 to the high-speed disk 110, the moving image data read from the disk controller 109 is transferred to the input-only directory 300 via the local bus 107 and the data path 303. To be written to the disk 110. When reading moving image data from the disk 110, the data is sent to the system bus 100 via the output-only directory 301 of the high-speed disk controller 208 and directly via the output-only directory 306 of the bus controller 206.

Therefore, according to this embodiment, while a certain moving image is displayed on the display (moving image data is being output from the disk 110), another moving image is transferred from the low-speed disk OMD 111 to the high-speed disk 110. , And the throughput of the entire apparatus can be improved. Further, the image memory 10 for moving image processing is used.
The disk 110 can also be used as the third work area. In that case, moving image data can be written to the disk 110 via the input-only directory 305 and the data paths 304 and 303 of the bus controller 206. [Third Embodiment (FIGS. 6 and 7)] In the second embodiment, a moving image process capable of simultaneously inputting and outputting moving image data by changing the configuration of a bus controller, a high-speed disk controller, and a data path connected thereto. Although the apparatus has been described, in the present embodiment, in addition to the configuration of the second embodiment, a moving image processing apparatus equipped with a plurality of high-speed disks so as to support large-capacity moving image data storage and simultaneous input / output will be described. I do. In the present embodiment, the configuration other than the high-speed disk of the moving image storage unit 105 and the data path related thereto is the same as that of the second embodiment. Is omitted.

In the first embodiment, the high-speed disk 110
Since the input and output to and from the high-speed disk 110 are processed in parallel at the same time,
A reading speed of 0 frames / second cannot be maintained, and a higher-speed device is required. In the present embodiment, a device to which two high-speed disks are connected is provided based on the above. FIG. 6 is a block diagram illustrating a configuration of the moving image storage unit 105 according to the present embodiment. In FIG. 7, the high-speed disk controller 208 can control the two high-speed disks 401 and 402 simultaneously and selectively. That is, each of the output-only directory 301 and the input-only directory 300 of the high-speed disk controller 208 has a data path on both the high-speed disks 401 and 402, and can perform a cross call. For example, when the user specifies a moving image (moving image “A”) to be displayed, the moving image data output destination from the OMD 111 is selected and output to one of the high-speed disks 401 and 402.

Hereinafter, the output destination of the moving image "A" is
Description will be made assuming that 01 has been selected.

At this time, the CPU 1 creates a moving image file management table as shown in FIG. In the moving image file management table of FIG.
The first field 51 includes the OMD 111 specified by the user.
Video file name stored in the second field 5
2 is the selected high-speed disk device number (in the present embodiment, “0” is allocated to the disk 401 and “1” is allocated to the disk 402), and the third field 53 is a temporary file that the CPU 1 automatically creates for the high-speed disk. In the fourth field 54, the first frame number in the moving image read from the OMD 111 is stored. For example, in the first row of the table of FIG. 7, for the above-mentioned moving image "A", the moving image file name "A", the high-speed disk number "0", the temporary file name "temp-A", and the frame number " A value of "0" is set. In the next row of the table in FIG. 7, for example, various values are set assuming that the user has selected the moving image “B”.

Next, while the moving image "B" or "A" is being displayed on the display device, the moving image of the moving image "C" is
Consider a case where the user wants to display an input from 111.

According to the management table shown in FIG. 7, since the disk of the high-speed disk number "1" is used for reading to display the moving image "B", the moving image "C" is displayed.
Output the high-speed disk number "0" to CPU1
Assigns information about the moving image “C” to the management table.

Here, the moving picture "C" data is stored in the OMD 11
During the input from step 1, the user selects the moving image “B” and the moving image “A”.
Is switched and displayed, it is necessary to access the disk of the high-speed disk number "0" for reading the moving image "A", and if it is left as it is, access competition to the disk of the high-speed disk number "0" occurs. .
Therefore, the CPU 1 sets the data input to the disk of the high-speed disk number “0” of the moving image “C” in a frame that does not need to consider the continuity of the moving image data (for example, at a fixed period in the MPEG compression method). Switch to the disk with the high-speed disk number “1” in the appearing intra frame.

This intra frame is performed every certain period (N) in order to improve the image quality at the time of moving image compression. If N = 15, this intra frame appears every 15 frames. If a moving image is reproduced and displayed at 30 frames / second, if N = 15, an intra frame appears every 0.5 seconds. Therefore, the CPU 1
The output destination disk of the moving image “C” is switched so that the field frame number is a multiple of 15. As described above, by switching the high-speed disk for each intra-frame of moving image data, a group of data is stored on one disk, and control is simplified from the viewpoint of moving image compression / decompression.

Therefore, according to this embodiment, by dynamically switching the input / output of a plurality of high-speed disks, it becomes possible to smoothly transfer moving image data even in the case of data input / output competition.

In this embodiment, the high-speed disk is dynamically switched. However, there are various other methods such as a method using a double buffer. In this embodiment, the description has been made with two high-speed disks.
It is also possible to use more than one high-speed disk.

Furthermore, the resolution of a moving image that can be processed is HD
It is needless to say that the present invention is not limited to a TV and includes a moving image of another resolution. Further, the medium for storing moving images and the high-speed disk interface are not limited to the OMD (SCSI interface) and the IPI (intelligent peripheral interface) used in the above-described embodiment. [Fourth Embodiment (FIGS. 8 to 11)] FIG. 8 is a block diagram showing a configuration of a moving image processing apparatus according to a fourth embodiment. Note that, also in this embodiment, the configuration other than the moving image storage unit 105 is the same as that of the first embodiment.

In FIG. 8, 123 and 124 are disk controllers for controlling the disks 122 and 125, respectively. The disk 122 stores management information such as additional information corresponding to each of various types of moving image data, and the disk 125 stores moving image data. Further, an instruction to switch a moving image reproduction speed or the like is issued from the keyboard (KB) 5 or the mouse 6.

FIG. 9 is a block diagram showing the structure of the decompressor 112 for decompressing encoded data compressed and encoded according to the MPEG system. In FIG. 9, input data is an image frame including a compressed encoded signal. First, when an intra frame is input, the switch 4
01 is at the position a, and the image data of the intra frame is expanded via the variable length decoding circuit 40, the inverse quantization circuit 41, and the inverse DCT circuit 42 without any interaction with the preceding and succeeding image frames. Output 404 is output to VFM section 101.

Next, when a predicted frame or an interpolated frame is input, the switch 401 switches to the position b and adds the difference image and the predicted image sent by the adder 44 to the VFM unit 101 from the output 404. Output to Here, in the case of the predicted frame, the decompressed image is branched from the output 404, fed back to the frame memory 403, and stored. Further, this image is input to the motion compensation forward prediction circuit 43 to generate a prediction image. At this time, the position of the switch 402 is c. Further, at this time, the image originally stored in the frame memory 403 is transferred to the frame memory 405.

In the case of expanding the interpolation frame, the switch 402 is switched to the position c, d, or e in accordance with the prediction direction (forward / backward / both forward and backward) of the frame, and the motion compensated forward prediction is performed. Circuit 4
3 or motion compensation forward / backward bidirectional prediction circuit 44
Alternatively, a predicted image is generated from the motion compensation backward prediction circuit 45.

Next, additional information, management information, and a moving image file management method for moving image data will be described. FIG. 10 is a diagram showing the relationship between a moving image data file and its management information file. In FIG. 10, a moving image data disk 125 stores moving image data 55 encoded by the MPEG method. The encoded data includes an intra frame 551 generated at a constant period (in this embodiment, N = 15, that is, every 15 frames).
553 exist every 15 frames.

On the other hand, the moving image data management disk 122 stores management information 50 corresponding to the moving image data. As shown in FIG. 10, the management information 50 includes a file name field 5 of the moving image data file.
1, a device number field 52 in which this data is stored, and offset fields 501 to 503 in the data file indicating the beginning of the intra frame are stored. This offset field exists corresponding to the total number of intra frames in the moving image data. For example, FIG.
At 0, offset fields 501-503 correspond to intra frames 551-553, respectively.
The value stored in the offset field is information for directly accessing an intermediate frame, such as the number of bits from the head of the data file of the corresponding intra frame.

Here, the CPU 1 automatically creates and assigns the file name of the moving image data disk 125 to change the moving image file name specified by the user to the file name of the management information 50 of the moving image data management disk 122. By doing so, these two files are managed. That is,
Even if the storage media for storing the data are separate, the CPU 1 manages the moving image data integrally with the management information and the additional information, and logically treats it as one file. Therefore, the user always sees the logical file (moving image data and its management information and additional information integrated) with the moving image file name specified by the user.

Further, the number of bits from the beginning of the intra frame can be easily extracted as additional information at the time of moving image encoding by a moving image encoder (not shown).

Next, moving image data reproducing processing executed by the moving image processing apparatus having the above configuration will be described with reference to FIG.
This will be described with reference to the flowchart shown in FIG. In the present embodiment, as described with reference to FIG. 10, it is assumed that moving image data is stored as a single file in a continuous area of the disk 122.

First, in step S110, when image reproduction is instructed from the keyboard (KB) 5 or the mouse 6, the process proceeds to step S120, and the processing mode is either the normal reproduction mode or the fast forward reproduction mode. Find out what. If the mode is the normal playback mode, the process proceeds to step S130. If the mode is the fast-forward playback mode, the process proceeds to step S160.

In step S130, it is checked whether the normal reproduction is forward reproduction or reverse reproduction. Here, if it is the forward reproduction, the process proceeds to step S132, and if it is the reverse reproduction, the process proceeds to step S142. In step S132, the address of the first frame of the image data stored in the disk 125 is set. In step S134, the image data frame at the set address is read, and in step S136, the image data is transferred to the decompressor 112. In step S138, the address of the next frame is set, and in step S140
If it is determined in step S that the reproduction is to be continued, the process proceeds to step S
Returning to 134, the reproduction is continued sequentially. Step S
If it is determined in 140 that the reproduction has stopped, the processing is terminated.

By the way, in the case of reverse reproduction, the processing is performed in step S1.
At 42, the address of the last frame of the image data stored in the disk 125 is set. In step S144, the image data frame at the set address is read, and in step S146, the image data is transferred to the decompressor 112. In step S148, the address of the immediately preceding frame is set, and in step S150
If it is determined in step S that the reproduction is to be continued, the process proceeds to step S
Returning to step 144, the reverse reproduction is continued. Step S1
If it is determined in step 50 that the reproduction is to be stopped, the process ends.

On the other hand, if it is determined in step S120 that fast-forward playback is to be performed, first, in step S160, it is determined whether fast-forward playback is forward playback or reverse playback. Here, if the reproduction is the sequential reproduction, the process proceeds to step S162
If so, the process proceeds to step S170.
In step S162, offset information of an intra frame is read from the image management information stored in the disk 122. In step S164, the image data of the intra-frame at the address corresponding to the read intra-frame offset information is read from the disk 125, and the image data is transferred to the decompressor 112 in step S166. Next, if it is determined in step S168 that reproduction is to be continued, the process returns to step S162, reads offset information of the next intra frame, and
Hereinafter, the fast forward reproduction is sequentially continued. If it is determined in step S168 that reproduction has stopped, the process ends. In the case of the present embodiment, since N = 15, there is an intra-frame for every 15 frames of image data, and the image data is read while skipping the moving image data file for every 15 frames, so that fast forward reproduction is executed at 15 times speed. Will be.

By the way, in the case of the reverse reproduction, the processing proceeds to step S7.
At 0, the offset information of the last intra frame is read from the image management information stored in the disk 122. In step S172, the image data of the intra-frame at the address corresponding to the read intra-frame offset information is read from the disk 125. In step S174, the image data is read from the decompressor 11
Transfer to 2. Next, if it is determined in step S176 that reproduction is to be continued, the process returns to step S170.
The offset information of the immediately preceding intra frame is read, and then fast forward and reverse reproduction is continued. Step S1
If it is determined in step 68 that the reverse reproduction is to be stopped, the process ends.

Therefore, according to the present embodiment, at the time of fast-forward playback (reverse playback), the reading of the moving image data and the reading of the moving image management information are performed independently through different disks and different disk controllers. Since access conflicts are resolved, moving image data can be efficiently reproduced. In addition, since the moving image data and the moving image management information can be handled as one logical file from the viewpoint of the user, the consistency between the moving image data and the moving image management information is always maintained, and one of the information is erroneously deleted. Such situations can be avoided. In addition, a high-speed, large-capacity disk is used for storing moving image data, and a medium-low-speed, medium to small-capacity disk is used for storing additional management information. An optimal and inexpensive system can be configured by selectively employing the matched device.

In this embodiment, the moving image data is described as being stored in one file.
One moving image data may be stored and managed in a plurality of files or a plurality of disks.

Also, the moving image data management information is stored on a different disk from the moving image data, and is always read from the disk.
It may be loaded in the work area of M3 and managed on the memory. Further, by storing management information (for example, scene change timing information) other than that described in the present embodiment, the moving image data is managed, and only the image frames in which the scene change has occurred are displayed. Is also conceivable. Furthermore, in the case of fast forward playback, for example,
If not only the intra frame is stored in the offset field but also the offset value of the predicted frame between the intra frames is stored as the management information, fast forward reproduction (reverse reproduction) focusing on the predicted frame becomes possible.
If the predicted frame appears every three frames as shown in FIG. 2, this means that triple-speed fast-forward playback (reverse playback) becomes possible. [Fifth Embodiment (FIG. 12)] FIG. 12 is a block diagram showing a configuration of a moving image processing apparatus according to a fifth embodiment of the present invention.
Also in this embodiment, the same device components as those described in the first embodiment are referred to by the same reference numerals, and description thereof will be omitted. The main difference between the apparatus of the present embodiment and the apparatus described in the first embodiment is that the disk controller 108 for connecting and controlling the hard disk 110 and the removable OMD
Disk controller 109 for connecting and controlling 111
Is directly connected to the decompressor 11.
2 is connected.

[0059] In FIG. 12, 130 video data buffer, 131 compander for compressing and decompression of moving picture data, 132 and 133 D / A converter, 134 controls the display screen of the display unit 1 0 2 Window controller.

In the device having the above configuration, the CPU 1
After the supplied D / A converter to the VFM 101 via a common system bus 100 of the display data generated in 04, but is displayed on the display unit 1 0 2, moving images stored in the hard disk 110 and a removable OMD111 After the data is expanded by the expander 112 via the local bus 107, the data is displayed on the display unit 102 .

The common system bus 100 and the local bus 107 are connected by a bus controller 106, a buffer 130, and a compander 131. By using this data path, the CPU 1 reads the moving image data stored in the removable OMD 111 and buffers the moving image data in the buffer 130, and compresses the read moving image data in accordance with the data transmission capacity of the common system bus 100. Image memory 103 while decompressing by
And further image processing can be performed. The moving image data processed in this manner can be stored in the removable OMD 111 via the buffer 130 and the bus controller 106 while being compressed by the compander 131 following the reverse of the above-described data read path.

Therefore, according to this embodiment, the CPU 104
Since in becomes independent of the supply path to the display portion 102 of the supply path and the moving image data to the display unit 1 0 2 of the generated image data, bus contention by two data is eliminated. Therefore, very high moving picture data transmission rate is displayed on the display unit 1 0 2 without being affected by the transmission of other data. Further, the moving image data stored in the removable OMD 111 is transferred to the CPU unit 10.
In step 4, image processing is performed, and the data can be displayed.

With such a configuration, the data transmission capability of the local bus 107 takes into account only the data transmission speed of moving image data, while the data transmission capability of the common system bus 100 is generated by the CPU unit 104. It is only necessary to take the display data into consideration, and as a result, the common system bus 10 of the device described in the first embodiment is used.
Thus, a system can be configured using two data buses (common system bus 100 and local bus 107) having a lower capacity than the data transmission capacity of 0.

In the above-mentioned five embodiments, the moving image compression coding method according to the MPEG system is used. However, the present invention is not limited to this, and moving image compression may be performed by another method. Needless to say.

The present invention may be applied to a system including a plurality of devices, may be applied to an apparatus including a single device, or may be achieved by supplying a program to the system or the device. Needless to say, the present invention can be applied to such cases.

[0066]

As described above, according to the present invention, there is an effect that moving image data can be efficiently accessed.

[Brief description of the drawings]

FIG. 1 is a diagram showing an outline of a moving picture coding procedure.

FIG. 2 is a diagram showing a configuration of moving image encoded data.

FIG. 3 is a block diagram showing a configuration of a moving image processing device according to the first embodiment of the present invention.

FIG. 4 is a flowchart of a moving image data reading process.

FIG. 5 is a block diagram showing a configuration of a moving image storage according to a second embodiment.

FIG. 6 is a block diagram showing a configuration of a moving image storage according to a third embodiment.

FIG. 7 shows an example of a moving image file management table according to the third embodiment.

FIG. 8 is a block diagram showing a configuration of a moving image processing device according to a fourth embodiment of the present invention.

FIG. 9 is a block diagram illustrating a configuration of a moving image decompressor.

FIG. 10 is a diagram showing a relationship between a moving image data file and its management information file.

FIG. 11 is a flowchart illustrating moving image data reproduction processing.

FIG. 12 is a block diagram showing a configuration of a moving image processing device according to a fifth embodiment of the present invention.

[Explanation of symbols]

 5 Keyboard 101 VFM unit 102 Display 103 Image memory unit 104 CPU unit 106 Bus controller 108 Disk controller 110 Hard disk 111 OMD (magneto-optical disk)

Claims (14)

(57) [Claims] 1. A moving image processing apparatus for expanding compressed moving image data and displaying the expanded moving image data on a display means, wherein: a first storage means for storing the compressed moving image data; Second storage means for reading and storing the stored compressed moving image data; and reading out the compressed moving image data stored in the second storage means and expanding the moving image data in accordance with the display speed of the moving image. Decompressing means, and transfer means for transferring moving image data output from the decompressing means to the display means, wherein the second storage means has at least a first storage part and a second storage part. Reading the compressed moving image data from the second storage unit to the decompression unit by dynamically switching the first and second storage units, and reading the compressed moving image data from the first storage unit to the second storage unit. The compressed moving image data A moving image processing apparatus which performs reading and transferring of data in parallel. 2. A moving image processing apparatus for decompressing moving image data and displaying the expanded moving image data on a display means, wherein the first storage means stores the compressed moving image data; A second storage unit that reads and stores the stored compressed moving image data; a decompression unit that reads and decompresses the compressed moving image data stored in the second storage unit; A transfer unit that transfers the output moving image data to the display unit; and reads out the compressed moving image data from the first storage unit and performs image processing. Image processing means for newly generating image data without dependence, a first data bus for transferring the image data generated by the image processing means to the display means, and the compressed moving image Moving image processing apparatus characterized by having a second data bus to be transferred to the expansion means through said second memory means from said first storage means over data. 3. The decompressor for decompressing the read compressed moving image data or compressing the newly generated image data for storage in the first storage means. 3. The moving picture processing apparatus according to claim 2, further comprising: means for storing moving picture data decompressed by the decompression and compression means. 4. The first storage means has a first storage medium and a first input / output control means for controlling input / output of moving image data, and the second input / output control means comprises a second storage medium. And second input / output control means for controlling input / output of moving image data. The first storage medium can store a larger amount of image data than the second storage medium, and can store more image data than the second storage medium. 3. The moving image processing apparatus according to claim 2, wherein the moving image processing apparatus has a low data input / output speed. 5. The moving image processing apparatus according to claim 4, wherein the first storage medium is a removable magneto-optical disk. 6. The moving image processing device according to claim 4, wherein the second storage medium is a hard disk. 7. After reading out the compressed moving image data for a predetermined time from the first storage means and outputting it to the second storage means, the compressed moving image data for the predetermined time is stored in the second storage means. 3. The moving image processing apparatus according to claim 2, further comprising control means for controlling transfer from the storage means to the decompression means. 8. A moving image processing method for expanding compressed moving image data and displaying the expanded moving image data on a display means, wherein the compressed moving image data is stored in a first storage means in which the compressed moving image data is stored. A storing step of reading and storing the compressed moving image data stored in the second storage means, an expanding step of reading out the compressed moving image data stored in the second storing means and expanding the expanded moving image data, and a moving image expanded by the expanding step A transfer step of transferring data to the display unit, and executing the image processing by reading the compressed moving image data from the first storage unit, or without depending on the compressed moving image data. An image processing step of newly generating image data; a transfer step of transferring the image data generated by the image processing step to the display means via a first data bus; Transferring the compressed video data from the first storage means to the decompression means via the second storage means via a second data bus. 9. A moving image processing method for decompressing moving image data that has been compression-encoded by adaptively using intra-coding and inter-coding and displaying the decompressed moving image data on a display means, comprising: An instructing step of instructing; a retrieval step of retrieving management information of the moving image data stored in a first storage medium according to the reproduction mode; and a first step of retrieving the first information based on the management information retrieved in the retrieval step. A reading step of reading moving image data stored in a second storage medium that can be accessed independently of a storage medium; and a supplying step of expanding the moving image data read in the reading step and supplying the data to the display means. The management information includes at least information for identifying a location on the second storage medium where the intra-coded moving image data is stored. Moving image processing method comprising. 10. A moving picture processing apparatus for decompressing moving picture data which has been compression-encoded by adaptively using intra-coding and inter-coding and displaying the decompressed moving picture data on a display means, wherein the moving picture data is stored. A first storage medium that stores management information corresponding to the moving image data; and a supply unit that expands the moving image data and supplies the data to the display unit. And the second storage medium are mutually independent media and can be accessed independently of each other. The management information is stored on the first storage medium in which at least intra-coded moving image data is stored. A moving image processing device including information for identifying a place. 11. The compressed moving image data stored in the first storage medium and the management information stored in the second storage medium are logically regarded as one moving image file. The moving image processing device according to claim 10, wherein 12. The moving image processing apparatus according to claim 10, wherein the first storage medium has a larger capacity and a higher access speed than the second storage medium. 13. An instructing unit for instructing reproduction of the compressed moving image data, a searching unit for searching the second storage medium in accordance with an instruction from the instructing unit, and reading out the management information, 11. The moving image processing apparatus according to claim 10, further comprising: reading means for accessing the first storage medium and reading the compressed moving image data. 14. The management information stores at least a file name for logically combining the compression-encoded moving image data and the management information, and the compression-encoded moving image data. 14. Device information for identifying the first storage medium that is present.
3. The moving image processing device according to claim 1.