JPH09163304A - Method and device for encoding and authoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an encoding method and device suitable for application to the authoring system of digital video or audio data, etc., and to provide the authoring system by performing random access with one reproduction unit on a format or a receding medium as a reference. SOLUTION: A tape 1 is reproduced by a digital VTR 2. A disk 6, in which data are written while designating each program search point with a time code, belonging to the tape 1 is set to a program search point reading part 7 and read. The information of time code for the program search point corresponding to the tape 1 is sent to a cut discrimination circuit 9. Besides, the time code is previously recorded in the tape 1 to be reproduced, these time code data from the digital VTR 2 are respectively supplied to the cut discrimination circuit 9 and an image type control part 5, and prescribed signal processing is performed by following circuit groups.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a coding method and a coding method suitable for being applied to an authoring system for data such as digital video and audio for producing media such as digital video disks. The device,
And the authoring system.

[0002]

2. Description of the Related Art Random access of a disc player is a random access in the true sense and a CD-DA (Con) which is more commonly applied.
Access has been made in units known as "tracks", which have been familiar since "pactDisk-Digital Audio", or in units known as "chapters" in laser discs. In a CD, a track usually corresponds to one piece of music, and a "chapter" in a laser disk corresponds to each scene. Also, the latest VIDEO CD (video / CD)
Then, by further developing the concept of a track, the entire stream is divided into playback unit parts called PLAY ITEM (play item), and described in a list called PLAY LIST (play list).
PLAYBACK CONTROL that plays back in the order of ITEM (in a different order from the recording order on the disc)
There is also a new random access mechanism called L.

For example, access by a truck is generally realized by the following mechanism. 1. At the time of encoding (sometimes called authoring or mastering), the start point of each track is specified by a time code. The track number is
For example, suppose that the number increases from the first. 2. When encoding, remember where the video or audio data corresponding to the time code specified by a certain track number was recorded on the disc by the absolute address method used in the disc format. . {In the case of a CD, the absolute time code is DVD (Digital Video Di
In the case of sk), the use of sector addresses is planned. } 3. When information of pairs of track numbers and their disc addresses is created for all track start points, the information is used as TOC (Table Of Contents) in the vicinity of the physically first accessed location on the disc (usually, on the disc). Innermost circumference). 4. The player can read this TOC and store it in memory, etc., when the user specifies a certain track.
Since the absolute address on the disc is immediately found, the pickup can be directly advanced to that address and the first data of the track to be played can be read.

A DVD player will inherit these functions and will be equipped with a random access function by a track (or chapter) number and a random access function by a PLAYBACK CONTROL. The subject in the following description is the random access function for the points thus identified. Further, for simplification of description, these functions will be referred to as “cueing function” and a specific location on the randomly accessed disk will be referred to as “cueing point”.

Random access is a GOP (Group
MPEG2 (Mo) restricted by Of Picture
Ving Picture Engineering
When playing back a disc or the like on which a video signal of Group-2) is recorded, even if random access is performed and the recorded stream is played from the middle of the stream, normal video can be played back from an arbitrary picture, unlike the signal. It can't start. Due to the nature of MPEG image compression, it is always necessary to read an intra picture (I picture) called a reference picture first.

On the other hand, it has been found that it is efficient to configure one GOP with 12 to 15 pictures (frames) in ordinary MPEG2 encoding. Therefore, if the encoding is performed only by the rule of 1 GOP = 12 to 15 pictures, the point at which the above-described cue at the time of reproduction can be obtained can be obtained only every 12 to 15 pictures. However, it is obvious that a candidate point for cueing, such as a break in a scene of a video or a movie work, does not appear every 12 to 15 sheets, and obviously appears at an arbitrary place.

[0007] If the cue point is to be determined most easily, there is a method of selecting the nearest GOP break as the cue point, rather than selecting a meaningful break in the work. (Current VIDEO CDs and the like use this method.) However, if the complexity of compression encoding is acceptable, GOPs that are usually composed of every 12 to 15 pictures are used.
It is possible to break the above rule, for example, near the cue point and bring the cue point to the GOP break.

However, the problem is not solved by this alone. There is no guarantee that the reproduction will start from the picture intended by the work after random access, only by making the cue point a GOP break. That is GOP
The cause is the arrangement of the pictures in.

The above will be described in detail with reference to FIG. FIG. 8 shows a state of a general MPEG image sequence. In FIG. 8, the middle of a continuous long image is cut out and shown, and what kind of image the original image is compression-encoded and arranged in what order is representative. A typical example is used and represented. The original image is shown in FIG.
8C shows the encoder output, FIG. 8C shows the decoder input, and FIG. 8D shows the reproduced image.

[GOP is not completely independent] FIG.
In the legend of I, an I picture is an image that can be played back independently, and a P picture is an image that uses prediction from an I or P picture that is ahead (past) of it. , B picture is an image that uses both prediction from an I or P picture in front (past) and prediction from an I or P picture in back (future) of itself. The numbers “xx” attached to I, B, and P represent the order of screens in the original image, and the small numbers represent the past and the large numbers represent the future. Also, solid line arrows indicate the relationship of which image is predicted from which image.

The original image 1 input to the encoder
As shown in FIG. 8A, “... BBPBBIBB
PBBBPBBIB ... "In that order, compression encoding is performed in sequence. Prediction from the front or the rear is shown by a solid arrow, for example, the forward prediction from the I2 picture is 3 of the B3 picture, the B4 picture and the P5 picture.
It is used for images, and at the same time, backward prediction from P5 picture is also used for B3 picture and B4 picture.

Image data compressed and encoded is shown in FIG.
As shown in the encoder output shown in B, the images are rearranged for convenience during decoding. For example, the I2 picture on the original picture is placed at the position shown in FIG. 8B, but the B3 picture and the B4 picture are respectively placed at the positions behind the P5 picture after being shifted backward. By doing so, as shown in the decoder input of FIG. 8C, the I2 picture and the P5 picture necessary for reproducing the B3 picture and the B4 picture can be decoded first. In the encoder output shown in FIG. 8B, the part from the I picture to the front of the next I picture is called GOP.

What should be noted here is the reproduction of the B0 picture and the B1 picture shown in the reproduced image of FIG. 8D. From the perspective of GOP, this B
The 0 and B1 pictures are included in the same GOP N as the I2, but for the reproduction thereof, as shown by the solid arrow in FIG. 8C, prediction from the P1 picture included in the immediately preceding GOP is performed. This is a necessary point. This is why the GOP is not completely independent.

Furthermore, an important point is that, when viewed in the order of the original images, the first image in a normal GOP is the B0 picture.

[Problems in Cue Playback] Next, GO
The problem that occurs because P is not completely independent will be described with reference to FIG. FIG. 9 is an explanatory diagram showing a situation of a problem when the head of a certain GOP N is set as a cue point. The decoder input is shown in FIG. 9A, and the reproduced image is shown in FIG. 9B. Now, it is assumed that there is a sequence of GOPs that are continuously compression-encoded and are input to the decoder. Now, it is assumed that the reproducing device performs a cueing operation for such a GOP sequence. At this time, the cue point where the pickup of the player is located is the I2 picture, which is the head when seen from the decoder input of GOPN.

At this time, in order to reproduce the B0 picture and the B1 picture, not only backward prediction from the I2 picture but also forward prediction from the P1 picture is required, but the data before the cue point is read. Since this is not the case, the prediction from the P1 picture indicated by the broken arrow in FIG. 9A cannot be used. In other words, there is no problem when playing back continuously one after another, but when a certain position is cued, "prediction from the last P picture of the previous GOP" cannot be used. Therefore, as a result, in the reproduced image shown in FIG. 9B, the first few numbers in GOP N (in this case, there are two B0 and B1).
The B picture cannot be reproduced, and the reproduction startable point is from the I2 picture.

Originally, at the time of encoding, GOP N
Since the first picture of B is the B0 picture, in this example, even if the pickup can be carried to the specified GOP data, the cue point will eventually shift two frames behind.

[0018]

As described above,
There are some problems in cue playback. The following can be considered as a solution to this problem.

[Solution 1 that seems correct] * The cue point is offset from the beginning of the GOP. For example, the picture to be cued as the beginning of the track may be shifted from the beginning of the GOP N instead of the beginning, and the I picture may be designated as the cuing point so that it coincides with the reproduction startable point. It seems that there is no, but that does not solve the following problem.

1. The problem is that it is not uniquely decided how much it should be shifted from the beginning of the GOP. According to the rules of MPEG2, the number of B pictures (I pictures or the interval between I and P pictures, MP
If the EG term is used, there is no restriction on the number of M). The number of B pictures can be arbitrarily selected from the viewpoint of image quality and coding efficiency. Therefore, it cannot be said that it is impossible to encode how much the cue point should be shifted from the beginning of the GOP. Originally, I wanted to specify the cue point at a specific position on the work, so I tried to shift the GOP breaks, but if I try to encode and actually build the GOP, the cue point can not be found. So to speak, they fall into a "chicken and egg" relationship.

2. Problem that cue point cannot be confirmed with time code Furthermore, there is a problem with time code. In MPEG2,
It is not possible to have a time code for each picture.
As an option, a GOP header can be placed at the beginning of the GOP, and a time code can be added to this GOP header. "Strike" is to record time code data on a recording medium corresponding to a GOP head. Even in the expected DVD format, although the shape is different, it is still possible to enter the time code for each GOP. In this case, what should the time code value be? In the case of normal, sequential reproduction, if the value of the time code is uniquely determined irrespective of the GOP structure (which picture is used and how many pictures are used),
Considering quite naturally, it should be the time code corresponding to the picture to be reproduced and displayed first among the pictures included in the GOP. In the example of FIG. 9, if the data sequence is sequentially reproduced from the beginning, the B0 picture is GO.
Since the image to be reproduced first among P N, the time code to be attached to GOP N is B
It becomes a value of time "t = 0" of 0 picture. When that happens,
When the cueable point is the intra picture I2 that is not the head in the display order in GOP N, the corresponding time code has a value of “t = 2”, but the value itself is GOP N. The accompanying data no longer exists in the data stream. Originally, it is the cue point specified by the time code (in this example, “t = 2” of the I2 picture), but if the time code does not finally exist in the stream as data, the cue point is set. It will be difficult to confirm from the data itself whether or not was encoded correctly. Furthermore, the cueing point is represented by a pair of a time code and a recording address on the disc on which the cueing point is recorded, and is registered in the TOC, which is also searched from the conventional "cue point retrieval system". Even if the information located at the address of the data on the side is read out, the time code accompanying it cannot be directly confirmed, which is a problem. In addition, the fact that the position where the frame of a fixed value is always advanced from the time code attached to the GOP is set as the cue point results in problem 1.

Here, the problems described above will be summarized. In the special case of fixing the value of "M" to 3, for example, the method of setting the cue point of a track or the like to the first intra picture existing in the GOP (TOC
The problem of may be practical (computed by having a "deviation"), but in general, the value of "M" is arbitrary, so even if the cue point is specified at the time of encoding, it is actually This means that it is difficult to uniquely determine the image to be cued.

[Solution 2 that seems to be correct at first glance] * Method of applying CLOSED GOP FIG. 10 shows “CLOSED GOP” in MPEG2.
It is explanatory drawing which shows the concept of "(closed GOP)."
10A shows an original image, FIG. 10B shows an encoder output, FIG. 10C shows a decoder input, and FIG. 10D shows a reproduced image.

The CLOSED GOP does not use "prediction from the last I and P pictures of the previous GOP" when encoding some B pictures at the beginning of the GOP. Code so that prediction is performed only from the I picture immediately following in the screen order (Only B
by ackward Prediction)
The idea is to ensure the independence of the OP. Looking at the encoder output in FIG. 10B, such GOP N is CL
It is called OSED GOP. Now, as shown in FIG. 10C, if the cue point of the player is the CLOSED GOP, the decoder input does not require the forward prediction from the previous GOP originally shown by the dashed arrow in the figure. , I in the reproduced image shown in FIG.
Some B pictures immediately after the two pictures (in this example, B0 and B1 shown in FIG. 10D) can theoretically be reproduced using only backward prediction from the I2 picture. .

At first glance, this is a good answer,
Not a complete solution. In MPEG2,
It is said that the CLOSED GOP can be played back from the B0 picture at the beginning when viewed in the display order at the time of playback, but it is not said that it must be played back.

In the case of the example shown in FIG. 10, the normal reproducing device must first read the I2 picture and decode it immediately after the cue. Then, this I2 picture becomes a reference, and the next decoding becomes possible. At this time, the following is a problem.

Wait for the decoding of the B0 picture without displaying the decoded I2 picture immediately, and then execute this GO.
Whether the first picture (B0 picture) is displayed in the display order in P, or the I2 picture is displayed immediately and the temporally previous B1 picture is skipped and continued to the next B3 picture. Is entirely optional. (In fact, at the playback start point of the cue point, it seems that there are many playback machines that play the I picture first because the decode buffer is empty. The reason is that the control is simple. The playback image cannot be displayed for at least the time for decoding some B pictures, so that it seems that the access speed does not seem to be slow.

Therefore, even if the cue point of a track or the like is set as a CLOSED GOP at the time of encoding, at the time of reproduction,
The pictures are not always reproduced from the first picture in the display order in the GOP. However, such a reproducing method does not violate the rules defined by MPEG.

Under such circumstances, at present, there is no encoding method for surely specifying the cue point, and which picture is to be used for cue reproduction is freely performed by each reproducing apparatus.

The present invention has been made in consideration of such a point, and by making it possible to uniquely determine the display image at the cue point, an encoding method that enables stable reading during reproduction, and The apparatus and the authoring system are proposed.

[0031]

One of the main inventions is, from a continuous video signal, coding information of only a video signal to be coded, a video signal to be coded and before the video signal or A coding method for generating a group consisting of coding information of a difference from a subsequent video signal or a combination of coding information of a difference between a video signal to be coded and video signals before and after the video signal, which is continuous. When a video signal to be encoded is encoded, when a reproduction unit in the format of the video signal or a division unit of the reproduction unit on the recording medium is included in the group, the video signal corresponding to the division unit Is encoded using only the video signal, and the video signal is set to the head of the group.

According to the above invention, when access is made on the basis of one reproduction unit on the format or on the recording medium, the information of the head portion is reproduced at high speed and correctly.

[0033]

Embodiments of the present invention will be described below in detail with reference to the drawings.

[Outline of Present Embodiment] For example, as in a DVD,
In a medium in which digital video and audio data and the like are recorded on a disc-shaped recording medium such as a phase change type optical disc, a magneto-optical disc, and a read-only optical disc, C
Cue by track jump as done in D, or PLAYBACK of VIDEO CD
Similar to the CONTROL (PBC) function, there is a random access function for starting playback from a specific location designated by the user. In this embodiment, for example, M recorded on a DVD
When performing compression encoding of a PEG2 video signal for a player having a function of starting playback from a specific location represented by a track jump or a PLAYBACK CONTROL (to be referred to as a cue playback). 1. Track (or PLAYBACK CONTR
At the beginning point such as a break of PLAY ITEM which is one playback unit of OL, GOP (GROUPF OF P)
Insert the break of ICTURE). 2. Also, the "sequence with a cut" is applied to a GOP corresponding to a cue point such as a break of a track (or a PLAY ITEM which is one playback unit of PLAYBACK CONTROL), and forward or backward prediction is performed in pictures before and after that point. Code that does not require. This ensures that the cue point image is always an intra picture, so that the cue point picture is always uniquely determined no matter what the playback device interprets. It is possible to provide a cue playback.

Here, what can be a "break" is a unit between units in a logical format, that is, a boundary between logical sectors, logical tracks, logical blocks, etc., and a boundary between physical sectors. The boundary between the logical units is a boundary between the units intended by the creator, such as a track on a CD or a chapter on a video disc. Further, as the boundary of the physical unit, there is a boundary between access units of the optical pickup, which is the structure of the recording medium itself, such as a physical sector on an optical disk.

That is, in this embodiment, the "sequence with a cut" is applied, and in any reproducing apparatus,
Encoding is performed so that the display image of the cue point can be uniquely determined, so that a stable cue function is guaranteed. Hereinafter, this embodiment will be described in detail.

First, the compression encoding method which is the basis of this embodiment will be described with reference to FIG. 1A shows the normal sequence, FIG. 1B shows the cut sequence, FIG. 1C shows the encoder output, and FIG.
Shows the decoder input and FIG. 1E shows the reproduced image.

As shown in FIG. 1A, in a normal sequence, for example, a P1 picture is followed by a B0 picture, a B1 picture, and an I2 picture. However, in this embodiment, a special sequence is used separately. In the special sequence, as shown in FIG. 1B, the P1 picture is followed by the I0 picture, and from there, the B1 picture and the B2 picture are continued in the same manner as in the normal sequence. In this embodiment, such a sequence will be referred to as a “cut sequence” or a “cutted sequence”.

As described above, normally, the sequence of "... BBPBBIBBP ..." As shown in FIG. 1A is "... BBPIBBPBB" in the sequence with cuts as shown in FIG. 1B. .., and the B picture appears to be missing at the cut indicated by the solid arrow in FIG. 1B. By placing this cut, as is clear from FIG. 1B,
No prediction originally existed between GOP N-1 and GOP N before and after the cut, and thus GOP N-1 and GO
Each P N is completely independent.

* The cue point is a sequence with a cut Now, let us consider a case where the beginning of a GOP formed by a sequence with a cut is a cue point such as the beginning of a track. Looking at the decoder input shown in FIG. 1D, the beginning of a GOP with a cut is the I0 picture (G
Since the image to be displayed first in the OP is an intra picture), both are the first image when viewed in decoding order or in the order of the reproduced image shown in FIG. 1E. That is clear.

This is one of the points in this embodiment. If you want to specify a specific location as the cue point during playback, such as with the track or PLAYBACK CONTROL function, 1. The GOP delimiter is determined so that the image corresponding to the cue point becomes the head of the GOP in the display order. 2. Moreover, the GOP is composed of a sequence with a cut. In the image data compressed and encoded according to this rule, when the reproduction is to be started from the cue point indicated by the solid arrow in FIG. 1D, there is a relation of “image to be decoded first = image to be displayed first”. Therefore, whatever the playback device is, the playback from the I0 picture is inevitable. Therefore, the cue point can be uniquely determined. Furthermore, since the time code attached to the image of the cue point can be applied as it is as the time code attached to the GOP, it suffices to look at the time code after encoding to determine whether the cue point was located at the correct position. Therefore, the determination can be easily performed.

That is, the cueing point is represented by a pair of a time code and a recording address on the disc on which the cueing point is recorded, and it is registered in the TOC. By reading the information located at the address of the data on the searched side, the time code that accompanies it can be directly confirmed.

[Outline of Configuration and Operation] FIG. 2 shows a configuration example of an authoring system as an embodiment. First, a master tape (video tape cassette used as a master) 1 to be compression-encoded is reproduced by a digital VTR 2. A flexible tape that is attached to the master tape 1 where each cue point is written with the data specified by the time code.
The disc 6 is set in the cue point reading unit 7.
The read cue point information can be further finely adjusted, added or deleted by the cue point correction device 8 for the time code value of the cue point. The information on the time code of the cue point for the master tape 1 determined by the above means is sent to the cut determination circuit 9. Further, a time code is recorded in advance on the master tape 1 reproduced by the digital VTR 2, and the time code data from the digital VTR 2 is supplied to the cut determination circuit 9 and the image type control unit 5, respectively.

Here, as shown in FIG. 3A, EDL data EDLd (Edit List) consisting of cut number data and time code data corresponding to the cut number data is recorded on the flexible disk 6. Has been done.

The cut determination circuit 9 compares the input time code information of the cue point with the time code data from the VTR 2 to determine what compression sequence (I
It is determined whether or not a combination of pictures, P pictures, and B pictures should be combined, and the correspondence between each frame number data of the input time code and the sequence of the picture is prepared. For example, in the sequence near the point where there is no cue point, the normal "... BBPBBIBBP ...
. ”, And in the vicinity of the cue point, the sequence in which the picture types are encoded is determined in advance, such as“ a sequence with a cut ”, that is,“ ... BBPIBBPBB ... ”.

When the reproduction of the master tape 1 is started,
The cut determination circuit 9 indicates which picture type should be used to compress the image corresponding to the time code while associating the input time code data with the sequence obtained in advance. It is sent to the image type control unit 5 as data. on the other hand,
The video signal reproduced by the digital VTR 2 is sent to the image delay device 3. The delay amount is set by the operation unit 4, and the same information is supplied to the image type control unit 5 (the delay amount will be described later). The delayed video signal is
It is supplied to the image type control unit 5.

The image type control unit 5 calculates the two-dimensional image information of the image generated according to each picture type and the time code delayed corresponding to the processing time thereof by the DCT.
(Discrete Design Transform)
m) Send to 14. The DCT 10 converts image information from two-dimensional pixels into frequency component information, and outputs image frequency component information divided into each band. Further, the image type control unit 5 also outputs time code data delayed corresponding to the processing delay time in order to store what amount of information the image had at what time. The time code data is supplied to the quantizer 11. The output of the quantizer 11 is inversely converted into two-dimensional pixel information including a quantization error through the inverse quantizer 12 and the inverse DCT 13 and fed back to the image type controller 5. Accordingly, the image type control unit 5 can perform a process of generating a differential signal for B or P pictures, that is, a so-called prediction process. The image type control unit 5 also performs motion prediction and compensation, but the feedback information including the quantization error is important information for adapting these processes.

In the quantizer 11, the frequency band information of the image is quantized at a temporary quantization level such that each band is equally quantized without performing weighting or the like. The quantized bits are output together with the time code data delayed by the time required for the quantization. As a result, a change in the amount of image information with time can be obtained. Hereinafter, the data indicating the change in the image information amount for each time will be referred to as "difficulty data".

Now, the quantization level control circuit 15 is supplied with the differential data by, for example, manual input, and is provided with information indicating the time change of the image information amount. The quantization level control circuit 15 determines what kind of weighting control is necessary from the input time code data and the information indicating the time change of the image information amount,
The quantization level weighting control signal is supplied to the quantizer 11. Normally, the quantization level correction device 16 does not work when there is no particular problem with the image quality.

The quantizer 11 quantizes each band according to the above-mentioned quantization level weighting control signal to reduce the amount of information. The quantized bits are supplied to the entropy encoder 17 together with the time code data delayed by the time required for the quantization. The entropy encoder 17 further performs entropy encoding, which is a reversible compression technique, in order to compress the bit amount. Then, the fixed length bit string up to the preceding stage is converted into a variable length bit string. From the entropy encoder 17, the final image code converted into the variable length code and the time information indicating the time when the image should be displayed are supplied to the output rate determining device 18.

The output rate determining device 18 determines the PES (Packetized Elem) based on the time information.
header information such as input stream code or PACK, and the input image code is packetized, and this is supplied to the stream output device 19 as the final code output. On the other hand, on the other hand, the output rate determination device 18
When starting the encoding, from the encoder control unit 23,
Normal encoding instructions are given. The output rate determining device 18 stores the above-mentioned image code and time information, which is the information that is the source of the final code output, in order to enable the editing for improving the image quality later, in the storage device 22.
At the same time, it is saved together with the marking information which is usually the result of encoding.

The final code output is also sent to the monitor decoder 21. The operator can monitor the image quality with this monitor. If there is a problem with the image quality, it is necessary to record time information indicating the time at which the image corresponding to that portion should be displayed in the quantization level correction device 16. At the time when the normal encoding has been completed, which “cut” corresponds to a location having a problem in image quality is stored in the time information recorded in the quantization level correction device 16 and the cut determination circuit 9. It can be easily obtained from the relationship between the time code data and the cut.

Here, the "cut" corresponding to the part in which the image quality is a problem is reproduced again from the encoder control section 23, and the quantization level correction device 16 weights the quantization level while monitoring the monitor decoder 21. Adjust to obtain a quantization level that does not affect image quality. The obtained quantization level weighting control value must be given to the quantization level control circuit 15 together with the time code data corresponding to the “cut”. Of course, when there are a plurality of portions having a problem in image quality, the above processing needs to be repeated.

In the quantizing level control circuit 15, the total amount of generated bits is originally known from the differential data. Therefore, it is possible to recognize a new total generated bit amount as a result of the quantization level being corrected by the quantization level correction device 16. If the total amount of generated bits exceeds the total capacity of the media that is predetermined, then, on the contrary, specify a "cut" that does not pose a problem even if the amount of bits is reduced. Then, while reproducing that portion as described above, the quantization level is adjusted by the quantization level correction device 16 so that the amount of information is suppressed.

In this way, when the quantization level of a necessary portion is readjusted, the encoder control section 23 sequentially reproduces the digital VTR 2 so that only the target "cut" is encoded. Encoding proceeds in the same way as normal encoding. At this time, the encoder control unit 23 gives the designation of re-encoding to the output rate determining device 18 and the storage device 22, respectively, in order to indicate that the result of encoding is due to re-encoding. As a result, the image code and the time information having the improved image quality are recorded in the storage device 22 together with the re-encoding marking information.

When all the re-encoding is completed, the storage device 22 records all the image codes and the time information which are normal or re-encoded. The output rate determination device 18 sequentially packetizes the program from the beginning based on the image code and the time information, and supplies the packet to the stream output device 19 as the final code output. The stream output device 19 outputs the final code output via the output terminal 20.

Next, the encoding sequence determined by the authoring system will be described with reference to FIG.

In MPEG, the number of pictures in a GOP is called N, and the cycle of I or P pictures (the number of pictures from I picture to the next P picture) is called M. In MPEG, there are no restrictions on N and M, but here, for the sake of explanation, the normal sequence is N = 9 and M = 3. In FIG. 4, an I picture surrounded by a square indicates that it is the head of a sequence with a cut, and an I picture surrounded by a circle indicates the head of another general GOP. It should be noted that FIG. 4 merely shows the order of the picture encoding sequences in the original image (in the figure, the subscripts of I, B, and P represent the “numbered” picture on the original image). ), Not the order of pictures at the encoder output with the concept of GOP. In the encoder output, as already described, the order of B pictures is exchanged, and when viewed in GOP units, the I picture is the first.

When N = 9, there are nine types of cut sequences, depending on the position of the cut, from cut sequence 0 to cut sequence 8 as shown in FIGS. But in any case,
At the beginning of the sequence with cuts (indicated by squares)
It is a great feature that the picture type immediately before the I picture is always a P picture.

[Regarding each sequence (the wavy line in FIG. 4 will be described later)] In the cut sequence 0, as shown in FIG. 4B, the position of the I picture is shifted by "2" from the normal sequence by "0". No. picture becomes an I picture. However, since the immediately preceding picture is a P picture, GOP starts from the I0 picture, and N = 10 up to P9 for the sake of sequence. The normal sequence then follows. In the cut sequence 1, as shown in FIG. 4C, the position of the I picture is shifted by one before the normal sequence, and the “first” picture becomes the I picture, and the immediately preceding “0” picture is displayed. The picture is usually a B picture, but is a P picture. GOP starts from I1 picture, and is N up to P10 for the sake of sequence.
= 10. The normal sequence then follows. Note that the immediately preceding GOP includes up to P0 picture, so N = 10 only for that.

In the cut sequence 2, as shown in FIG. 4D, the position of the I picture is the same as that of the normal sequence, and the picture of "No. 2" is the I picture, but the immediately preceding "0" and "1". The two pictures of “No.” are usually B pictures, but both of them are P pictures. GOP
Starts from the I2 picture, and due to the sequence, P11
Up to N = 10. The normal sequence then follows. Note that the immediately preceding GOP includes up to P0 and P1 pictures, so N = 11 only for that. In the cut sequence 3, as shown in FIG. 4E, the position of the I picture is shifted backward by one compared to the normal sequence, and the position is “3”.
Is the I picture. However, the normal sequence is extended up to the "2nd" picture. GOP
Starts from the I3 picture, and due to the sequence, P12
Up to N = 10. The normal sequence then follows. The last GOP includes up to B0, B1, and P2 pictures, so N = 12 only for that.

In the cut sequence 4, as shown in FIG. 4F, the position of the I picture is shifted two positions behind the normal sequence, and the "4" picture is taken as the I picture. However, the normal sequence is extended up to the "No. 2" picture, and the "No. 3" immediately before the I4 picture is
Is a P picture. GOP starts from I4 picture and N = 1 up to P13 due to the sequence.
It becomes 0. The normal sequence then follows. The immediately preceding GOP includes up to B0, B1, P2, and P3 pictures, so N = 13 only for that. In the cut sequence 5, as shown in FIG. 4G, the position of the I picture is shifted from the normal sequence by three to the rear, and the position is “No. 5”.
Is the I picture. However, the normal sequence is extended up to the "2nd" picture, and I
Of the two pictures immediately before the 5 pictures, "3" is the B picture,
The “fourth” picture is a P picture. GOP is I
Starting from 5 pictures, N = 10 up to P14 due to the sequence. The normal sequence then follows.
The last GOP is B0, B1, P2, B3, P4.
Since it includes up to a picture, N = 13 only for that.

As shown in FIG. 4H, the cut sequence 6 is set as a different rule because the length of the immediately preceding GOP becomes too long when the position of the I picture is moved backward as before, so that the cut sequence 6 is made shorter. A normal sequence is placed, and then a sequence with a cut is placed again. The normal sequence starting from the B0 picture is discontinued at N = 6 up to the P5 picture, and the subsequent "6th" picture is the I picture of the sequence with the cut. GOP starts from I6 picture, and N = 10 up to P15 due to the sequence. The normal sequence then follows. The cut sequence 7 is, as shown in FIG.
Similar to the cut sequence 6, if the position of the I picture is simply moved backward, the length of the immediately preceding GOP becomes too long. Therefore, another rule is set, a short normal sequence is placed, and then a cut is made again. Sequence is placed. A normal sequence starting from the B0 picture is continued up to the P5 picture, and then the P picture is continued in "6th", where the GOP is discontinued at N = 7. Immediately after that, the “7th” picture is taken as the I picture of the sequence with the cut. GOP starts from I7 picture, and due to the sequence, up to P16, N = 10
Becomes The normal sequence then follows.

As shown in FIG. 4J, the cut sequence 8 is different from the cut sequence 7 in that if the position of the I picture is simply moved backward, the length of the immediately preceding GOP becomes too long. A short normal sequence is placed, and then a sequence with a cut is placed again. The normal sequence starting from the B0 picture is continued up to the P5 picture, and the subsequent "6" is the B picture, and the "7" is followed by the P picture.
Here, the GOP is terminated when N = 8. Immediately after that, "8
No. ”picture is the I picture of the sequence with cuts. The GOP starts from the I8 picture, and N = 10 up to P17 due to the sequence. The normal sequence then follows.

The above-described normal sequence data Sd and the sequence data Sd of a total of 10 patterns of cut sequences 0 to 8 are stored in the internal ROM 9a of the cut determination circuit 9 shown in FIG. Then, the cut determination circuit 9 transfers the normal sequence data Sd from the internal ROM 9a to the internal RA at the start of processing.
The GOP next to the one currently being processed after being loaded into M9b
It is determined whether or not there is a cue point in the constituent image of.

Then, the cut determination circuit 9 sends the next GOP
When it is determined that there is no cue point, the normal sequence data Sd is loaded from the internal ROM 9a to the internal RAM 9b, and the sequence data Sd is used as the sequence list data SLd in the next GOP process. Then, when the cut determination circuit 9 determines that there is a cue point in the next GOP, the cut determination circuit 9 detects the number of the cue point that is counted from the last constituent image of the GOP being processed. , If the value is “1”, then the data of the above sequence 0,
If it is the "2" th sheet, the data of sequence 1 above is ...
If it is the 9th sheet, the data of the sequence 8 is stored in the internal ROM 9
The sequence data Sd is read from a, loaded into the internal RAM 9b as sequence list data SLd, and used in the next GOP process.

FIG. 3B shows the sequence list data SL.
An example of d is shown. As shown in FIG. 3B, in the sequence list data SLd, time code data and picture type data are registered for each number as an address. The sequence data Sd corresponds to the picture type data in the sequence list data SLd. Since the smallest value of the time code data is the frame, it goes without saying that the time code data can be continuously obtained by simply incrementing the digit of this frame.

That is, the cut determination circuit 9 generates time code data for 2 GOPs, for example, and generates 2 GOPs.
Minute time code data, sequence list data S
Register with Ld. Then, first, the normal sequence data Sd is read from the internal ROM 9a, and the sequence list data SL is associated with the time code data.
Register in d. After that, the cut determination circuit 9
It is detected whether or not time code data having the same value as the time code data at the cue point registered in the EDL data EDLd is included in the time code data corresponding to the next GOP. When it is not included, the cut determination circuit 9 registers the normal sequence data Sd read from the internal ROM 9a in association with the time code data corresponding to the next GOP. If it is included, the cut determination circuit 9 counts the number of images from the last image of the GOP being processed to the image of the cue point of the next GOP on the sequence list data SLd, and according to the value. hand,
As described above, the data of sequences 0 to 8 is selected, and the selected sequence data Sd is stored in the internal ROM 9a.
Is loaded into the internal RAM 9b from, and the load data is used in the process for the GOP. Here, “using load data” means that the cut determination circuit 9
Means to instruct the image type control unit 5 to process the image from the digital VTR 2 with the picture type indicated by the picture type data registered in the sequence list data SLd for the time code data of the image. To do.

Here, FIG. 2 will be described again. In the cut determination circuit 9, based on the information input to the cue point reading unit 7 and the information additionally changed by the cue point correction device 8, which time code frame is the cue point, that is, where the cut is made. It is known whether to put. Therefore, it is possible to easily determine which of the above-mentioned cut sequences should be selected in the vicinity of the cut.

The cut determination circuit 9 is used by the image type control unit 5
On the other hand, in a normal non-cut portion, the encode sequence instruction data is simply repeatedly given in the order of the normal sequence, and in the vicinity of the cut, the matching pattern data of any of the cut sequences 0 to 8 is given. .

Now, the delay amount of the image delay device 3 will be described. Unless otherwise specified, the image type control unit 5 always puts two B pictures in succession if an I or P picture is instructed, and always puts an I or P picture in the next if two B pictures continue. It is assumed that the encoding is performed only by the rule (that is, the period M of the I or P picture is 3). However, if a sequence is designated in advance, it will be encoded as it is.

That is, when it is desired to perform encoding other than this basic normal sequence, it is sufficient to know in advance that it is different from the normal one. Therefore, the image type control unit 5 causes the time code data with no delay. And requires encoding instruction data. Now, regarding the required delay amount, let us return to FIG. 4 and pay attention to the "wavy line" portion. This wavy line is a simple rule of the normal sequence, that is, "when an I or P picture is instructed, two B pictures are continued, and when two B pictures are continued, an I or P picture is always placed next". It shows the part where the rule is not applied.

As is clear from FIG. 4, the effect of placing this cut is that the period M of the I or P picture is M.
When the value is 3, it can be seen that the number of frames is 3 at the maximum. Therefore, it is understood that the setting value of the delay amount for the image delay device 3 should be 3 frames. The set delay amount information is also input to the image type control unit 5 at the same time. Therefore, as a result, the image type control unit 5 uses the delayed video signal with the known delay amount, the time code data without delay, and the encode sequence instruction data in a sequence different from the normal sequence (case where M = 3 is not satisfied). When it is necessary to encode, it becomes possible to know from which frame the special encoding should be performed in the previous frame.

[Description of Main Operations in Authoring System Shown in FIG. 2] Next, main operations in the authoring system shown in FIG. 2 will be described with reference to FIGS. 5 to 7.

In step S1, the cue point reading unit 7 shown in FIG. 2 reads the EDL data EDLd recorded on the flexible disk 6. The EDL data EDLd read by the cue point reading unit 7 is supplied to the cut determination circuit 9, and the RAM of the cut determination circuit 9 is supplied.
Is held. In step S2, the cut determination circuit 9 shown in FIG.
The time code data registered for the first cut number data is read from Ld, and the sequence list data SLd for the subsequent N frames is generated. For example, the time code data for 2 GOPs is generated to generate the internal RA.
The normal sequence data Sd, that is, the picture type data is read from the internal ROM 9a while being held in the M9b, and the picture type data is stored in the internal RAM 9b.
It is registered in correspondence with the time code data for the first GOP held in. The registration of the picture type data with respect to the time code data registered in the sequence list data SLd for the next GOP is performed after processing the last image of the first GOP, and then, as described above, It is performed after selecting the sequence data Sd according to the presence or absence.

In step S3, the cut determination circuit 9 shown in FIG. 2 starts encoding. In step S4,
The cut determination circuit 9 shown in FIG. 2 reads the time code data from the digital VTR 2. In step S5, the cut determination circuit 9 shown in FIG. 2 compares the value of the read time code data with the value of the time code data registered in the sequence list data SLd held in the internal RAM 9b. In step S6, the cut determination circuit 9 shown in FIG. 2 determines whether or not the value of the read time code data is equal to the value of the time code data corresponding to the end of the current GOP, and "YES".
If so, the process proceeds to step S7, and if "NO", the process proceeds to step S9.

In step S7, the cut judgment circuit 9 shown in FIG. 2 reads the last time code data and picture type data of the GOP being processed from the sequence list data SLd held in the internal RAM 9b,
This is supplied to the image type control unit 5 shown in FIG. 2 as encoding sequence instruction data. The image type control unit 5 uses the time code data supplied as the encoding sequence instruction data and the picture type data to generate the video signal of the frame at the temporal position indicated by the time code data having the same value as the time code data, in the picture. Encode with the picture type indicated by the type data. In step S8, the cut determination circuit 9 shown in FIG. 2 sequentially increments the value of the read time code data up to, for example, 9 frames, and
It is detected whether or not each value matches the value of the time code data registered in the EDL held in the internal RAM 9b. At this time, when the cut determination circuit 9 detects a match, it outputs data indicating that the next GOP includes a cue point and data indicating which frame from the read time code matches. If they do not match, data indicating that fact is stored in the internal RAM 9b. In step S9, the cut determination circuit 9 shown in FIG. 2 reads the current time code data and picture type data from the sequence list data SLd held in the internal RAM 9b, and these data are encoded sequence instruction data. Is supplied to the image type control unit 5 shown in FIG. Here "current time code data"
Is time code data of the current image to be processed on the sequence list data SLd.

In step S10, the cut determination circuit 9 shown in FIG. 2 determines whether or not the encoding is completed, and "Y
If "ES", the process ends, and if "NO", step S1.
Move to 1. Here, the determination as to whether or not the encoding is completed is made based on whether or not all the time code data of the cue point registered in the EDL has been processed. In step S11, the cut determination circuit 9 shown in FIG. 2 determines based on the data held in the internal RAM 9b, that is, the data indicating that the next GOP includes a cue point, or the data indicating that they do not match. , Next GOP
Is determined to include the cue point. If “YES”, the process proceeds to step S12, and if “NO”, the process proceeds to step S13.

In step S12, the cut determination circuit 9 shown in FIG. 2 executes the next GO stored in the internal RAM 9b.
Frame number data up to the cue point included in P, that is,
From the read time code, the data indicating how many frames match each other is used to detect which number from the current time is the cue point. In step S13, the cut determination circuit 9 shown in FIG. 2 uses the internal ROM for the next GOP.
Normal sequence data Sd is read from 9a, and the sequence data Sd is registered in the sequence list data SLd of the internal RAM 9b.

In step S15, the cut determination circuit 9
Is "1", and if "YES", the process proceeds to step S16, the sequence data Sd of the cut sequence 0 stored in the internal ROM 9a is selected, and the process proceeds to step S17. Then, the sequence data Sd of the cut sequence 0 is read, the data is loaded into the internal RAM 9b, and the process proceeds to step S4 again. In step S18, the cut determination circuit 9
It is determined whether or not it is the "2" th sheet, and if "YES", the process proceeds to step S19, the sequence data Sd of the cut sequence 1 stored in the internal ROM 9a is selected, and the process proceeds to step S17. , The sequence data Sd of the cut sequence 1 is read out,
It is loaded into the internal RAM 9b, and the process proceeds to step S4 again.

In step S20, the cut determination circuit 9
Is "3" th sheet, and if "YES", the process shifts to step S21, the sequence data Sd of the cut sequence 2 stored in the internal ROM 9a is selected, and the process shifts to step S17. Then, the sequence data Sd of the cut sequence 2 is read, the data is loaded into the internal RAM 9b, and the process proceeds to step S4 again. In step S22, the cut determination circuit 9
If it is "YES", the process proceeds to step S23, selects the sequence data Sd of the cut sequence 3 stored in the internal ROM 9a, and proceeds to step S17. , The sequence data Sd of the cut sequence 3 is read out,
It is loaded into the internal RAM 9b, and the process proceeds to step S4 again.

In step S24, the cut determination circuit 9
Is the "5" th sheet, and if "YES", the process shifts to step S25 to select the sequence data Sd of the cut sequence 4 stored in the internal ROM 9a, and shifts to step S17. Then, the sequence data Sd of the cut sequence 4 is read, the data is loaded into the internal RAM 9b, and the process proceeds to step S4 again. In step S26, the cut determination circuit 9
If it is "YES", the process proceeds to step S27, selects the sequence data Sd of the cut sequence 5 stored in the internal ROM 9a, and proceeds to step S17. , The sequence data Sd of the cut sequence 5 is read out,
It is loaded into the internal RAM 9b, and the process proceeds to step S4 again.

In step S28, the cut determination circuit 9
Is "7" th sheet, and if "YES", the process proceeds to step S29, the sequence data Sd of the cut sequence 6 stored in the internal ROM 9a is selected, and the process proceeds to step S17. Then, the sequence data Sd of the cut sequence 6 is read, the data is loaded into the internal RAM 9b, and the process proceeds to step S4 again. In step S30, the cut determination circuit 9
If it is "YES", the process proceeds to step S31, the sequence data Sd of the cut sequence 7 stored in the internal ROM 9a is selected, and the process proceeds to step S17. , The sequence data Sd of the cut sequence 7 is read and the data is
It is loaded into the internal RAM 9b, and the process proceeds to step S4 again. In step S32, the cut determination circuit 9 determines "9".
Whether or not it is the first sheet, and if "YES", step S3
3, the sequence data Sd of the cut sequence 8 stored in the internal ROM 9a is selected, the process proceeds to step S17, the sequence data Sd of the cut sequence 7 is read, and the data is stored in the internal RA.
It is loaded in M9b, and the process proceeds to step S4 again.

[Effects Derived from Modifications and Embodiments] This system can be applied to all those recording MPEG video (or video compression similar thereto). (All future MPEG video recording / playback devices, whether MMCD or SD, are irrelevant to the recording medium.) A specific cue point in a pre-specified time code frame (which is It does not matter whether it is specified as a cue point for the reason), and due to the nature of the arrangement of the encoded image data, it can be reliably and uniquely accessed and reproduced as a cue point. The fact that it can be uniquely determined means that even if the cue point is recorded as a pair of the time code of the image and the absolute address on the recorded medium, like the TOC on the CD, the information on the TOC is actually It is guaranteed that there will be no inconsistency with the image to be reproduced at the beginning. Therefore, not only in the access by the traditional track mechanism, but also in the complicated random access mechanism such as PLAYBACK CONTROL, the cue point is treated as a pair of the time code of the image and the absolute address on the recorded medium. The same applies under the rules. In the future, it can be applied to the case where it is necessary to cue interactively such as a video for a game. Further, FIG. 2 shows a so-called two-pass or more system in which N times of encoding is performed until optimum encoding can be performed, but a so-called one-pass system is also the same. For a 1-pass system,
Quantization level control circuit 15 and quantization level correction device 1
6, the output rate determination device 18, the storage device 22, and the monitor decoder 21 are unnecessary. This is because the quantization level is fixed in the case of a one-pass system. The output of the entropy encoder 17 is the stream output device 1
9 is input.

[0085]

According to the present invention described above, random access can be performed with reference to one reproduction unit on the above format or on the recording medium, that is, the cue point can be uniquely determined and stable. There is an effect that it is possible to guarantee the provision of the specified cue function.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of compression encoding used for describing an embodiment. FIG. 1A is an explanatory diagram showing a normal sequence. FIG. 1B is an explanatory diagram showing a cut sequence. FIG. 1C is an explanatory diagram showing an encoder output. FIG. 1D is an explanatory diagram showing a decoder input. FIG. 1E is an explanatory diagram showing a reproduced image.

FIG. 2 is a configuration diagram of an authoring system showing an embodiment.

FIG. 3 is an explanatory diagram showing an example of the edit list data and sequence list data shown in FIG. FIG. 3A is an explanatory diagram showing an example of edit list data. FIG. 3B is an explanatory diagram showing an example of sequence list data.

FIG. 4 is an explanatory diagram showing an example of a cut sequence. FIG. 4A is an explanatory diagram showing an example of a normal sequence. FIG. 4B is an explanatory diagram showing an example of a cut sequence 0. FIG. 4C is an explanatory diagram showing an example of a cut sequence 1. FIG. 4D is an explanatory diagram showing an example of a cut sequence 2. FIG. 4E is an explanatory diagram showing an example of a cut sequence 3. FIG. 4F is an explanatory diagram showing an example of a cut sequence 4. FIG. 4G is an explanatory diagram showing an example of the cut sequence 5. FIG. 4H is an explanatory diagram showing an example of a cut sequence 6. FIG. 4I is an explanatory diagram showing an example of a cut sequence 7. FIG. 4J is an explanatory diagram showing an example of a cut sequence 8.

5 is a flowchart for explaining main operations of the authoring system shown in FIG.

FIG. 6 is a flowchart for explaining main operations of the authoring system shown in FIG.

FIG. 7 is a flowchart for explaining main operations of the authoring system shown in FIG.

FIG. 8 is an explanatory diagram for explaining that GOPs used in the description of the conventional technique are not completely independent.

FIG. 9 is an explanatory diagram for explaining a problem in the cueing reproduction, which is used in the description of the conventional technique.

FIG. 10 is an explanatory diagram for explaining a method of applying CLOSED GOP.

[Explanation of symbols]

 1 master tape (video tape cassette) 2 digital VTR 3 image delay device 4 operation unit 5 image type control unit 6 flexible disk 7 cue point reading unit 8 cue point correction device 9 cut judgment circuit 9a ROM Sd sequence data 9b RAM EDLd EDL data SLd sequence list data 10 DCT 11 quantizer 12 inverse quantizer 13 inverse DCT 15 quantization level control circuit 16 quantization level correction device 17 entropy encoder 18 output rate determination device 19 stream output device 20 Output terminal 21 Monitor decoder 22 Storage device 23 Encoder control unit

Claims (13)

[Claims] 1. Coding information of only a video signal to be coded from a continuous video signal, coding information of a difference between a video signal to be coded and a video signal before or after the video signal, or a code. A coding method for generating a group consisting of a combination of coding information of a difference between a video signal to be encoded and video signals before and after the video signal, wherein the video signal is used when encoding a continuous video signal. When a division unit of one reproduction unit on the format of, or a division unit of one reproduction unit on the recording medium is included in the group, a video signal corresponding to the division unit is
A coding method in which the video signal is coded using only the video signal and the video signal is set to the head of the group. 2. The division part of the video signal is a random accessible cue point when the encoded video signal is recorded on the recording medium.
Coding method as described. 3. The encoded video signal is the delimiter by comparing the time information of the video signal corresponding to the delimiter with the time information of the continuous video signal. The encoding method according to claim 1, which is detected. 4. Encoding information of a first picture type from a continuous video signal or only a video signal to be encoded,
Second picture type encoding information of a difference between a video signal to be encoded and a video signal before or after the video signal,
Alternatively, it is a coding method for generating a group consisting of a combination of coding information of a third picture type, which is a difference between a video signal to be coded and video signals before and after the video signal, the time code data of a cue point. Based on the time code data registered in the cue point list data consisting of
A sequence list generation step of generating sequence list data consisting of continuous time code data and picture type data indicating the type of coding information corresponding to the time code data; and by inputting by referring to the sequence list. The picture instruction data corresponding to the value of the time code data of the video signal to be reproduced, and an encoding instruction step for instructing to encode the input video signal so that the picture type indicated by the picture type data is obtained; The detection step of detecting whether or not the cue point registered in the point list is included in the next group, and the cue point registered in the cue point list in the detection step is When it is not detected that it is included in the group of The content is updated so that at least the picture type of the first video signal in the next group is the content indicating that the picture type is the second or third picture type, and in the detecting step, the cue point list is displayed. When it is detected that the cueing point registered in is included in the next group, the beginning of the next group is set to the cueing point, and the content of the sequence list is at least in the next group. And a sequence list updating step of updating the picture type of the first video signal so that the picture type is the first picture type. 5. A video signal of a first picture type which is coded without using prediction, and second and third picture types which are coded using forward prediction or backward prediction or bidirectional prediction. Is a coding method for generating a group of video signals of, and obtains continuous time code data from the time code data registered in the cue point list data composed of the time code data of the cue points, and Of the picture type data indicating the picture type of
The picture type indicated by the picture type data specified for the head of the group is the second or third picture type.
A step of generating sequence list data for at least two groups by designating picture types for the continuous time code data on the basis of the contents of the first sequence data as the picture type (S).
T1), a step (ST2) of reading the time code data added to the video signal from the signal source, and referring to the sequence list data, corresponding to the value of the time code data of the input video signal. The step (ST3) of instructing to encode the input video signal so as to obtain the picture type data and obtain the picture type indicated by the picture type data, and the cue point registered in the cue point list are Step of detecting whether or not it is included in the next group (ST
4) and in the step (ST4), when it is not detected that the cue points registered in the cue point list are included in the next group, the contents of the sequence list are changed to the first group. It is updated with the sequence data, and when it is detected that the cue point registered in the cue point list is included in the next group in the step (ST4), it is a processing target at the present time. A step of detecting the number of video signals from the video signal to the cue point, selecting the sequence data of the next group from the position ahead by the detected number, and updating the contents of the sequence list by the sequence data. An encoding method including (ST5). 6. A delay means for delaying a video signal from a signal source, and time code data obtained on the basis of time code data of cue points registered in cue point list data in which cue points are registered. And a picture of the video signal corresponding to the undelayed time code data from the signal source, based on the picture type data indicating the picture type corresponding to the prediction direction corresponding to the video signal indicated by the time code data. A type of determination is made, and based on the determination result, a determination unit that outputs instruction data and a prediction process for the video signal supplied from the delay unit so that the picture type indicated by the instruction data from the determination unit is obtained. An encoding device comprising: a prediction processing unit that performs the above; and an encoding unit that performs an encoding process on the output from the prediction processing unit. 7. The determination means includes a storage means in which the sequence data is stored, and the sequence data includes a group in which a picture type of a head video signal of a group of a plurality of video signals is a front or rear group. The reference sequence data, which is a picture type obtained by prediction using the video signal of, and the picture type of the first video signal in the group of a plurality of video signals are the picture types for which prediction processing is not performed, and The head position of the group consists of N kinds of sequence data, which are shifted one by one from the reference position, and the judging means refers to the cue point list data, If the value of the time code data in the previous group and the value of the time code data at the cue point match, the 7. The sequence data in which the number of video signals from the position to the cue point is detected and the same number of video signals as the number of the video signals causes the start position of the group to deviate from the reference position is selected. Encoding device. 8. A delay means for delaying a video signal from a signal source, and time code data obtained on the basis of time code data of cue points registered in cue point list data in which cue points are registered. And a picture of the video signal corresponding to the undelayed time code data from the signal source, based on the picture type data indicating the picture type corresponding to the prediction direction corresponding to the video signal indicated by the time code data. A type of determination is made, and based on the determination result, a determination unit that outputs instruction data and a prediction process for the video signal supplied from the delay unit so that the picture type indicated by the instruction data from the determination unit is obtained. A prediction processing means for performing the coding processing, a coding means for coding the output from the prediction processing means, and an output from the coding means. Authoring system comprising a holding device, the information held in the holding device, and an output device that converts the data string corresponding to the recording format of the recording medium carrying. 9. The encoding means uses a continuous video signal, or a first picture type of only a video signal to be encoded, and a difference between a video signal to be encoded and a video signal before or after the video signal. Of the second picture type or information of a third picture type which is the difference between the video signal to be encoded and the video signals before and after the video signal, and the delay amount in the delay means is the first or the first 9. The authoring system according to claim 8, wherein the cycle is equal to or longer than the cycle in which two picture types appear. 10. The determination means includes a storage means in which the sequence data is stored, and the sequence data includes a group in which a picture type of a head video signal of a group including a plurality of video signals is a front or rear group. The reference sequence data, which is a picture type obtained by prediction using the video signal of, and the picture type of the first video signal in the group of a plurality of video signals are the picture types for which prediction processing is not performed, and The head position of the group consists of N kinds of sequence data, which are shifted one by one from the reference position, and the judging means refers to the cue point list data, If the value of the time code data in the previous group matches the value of the time code data of the cue point, the The sequence data in which the number of video signals from that position to the cue point is detected and the number of video signals is the same as the number of the video signals, and the start position of the group is deviated from the reference position is selected. The authoring system described. 11. A delay means for delaying a video signal from a signal source, and time code data obtained on the basis of time code data of cue points registered in cue point list data in which cue points are registered. And a picture of the video signal corresponding to the undelayed time code data from the signal source, based on the picture type data indicating the picture type corresponding to the prediction direction corresponding to the video signal indicated by the time code data. A type of determination is made, and based on the determination result, a determination unit that outputs instruction data and a prediction process for the video signal supplied from the delay unit so that the picture type indicated by the instruction data from the determination unit is obtained. A prediction processing unit for performing a coding process on the output from the prediction processing unit; Authoring system having an output device for the force, and outputs the converted to the corresponding data stream to the recording format of the recording medium. 12. The determination means includes a storage means in which the sequence data is stored, and the sequence data includes a group in which a picture type of a head video signal of a group of a plurality of video signals is a front or rear group. The reference sequence data, which is a picture type obtained by prediction using the video signal of, and the picture type of the first video signal in the group of a plurality of video signals are the picture types for which prediction processing is not performed, and The head position of the group consists of N kinds of sequence data, which are shifted one by one from the reference position, and the judging means refers to the cue point list data, If the value of the time code data in the previous group matches the value of the time code data of the cue point, the 12. The number of video signals from the position to be the cue point is detected, and the sequence data in which the head position of the group is deviated from the reference position by the same number as the number of the video signals is selected. The authoring system described. 13. The encoding means comprises, from a continuous video signal, a first picture type of only a video signal to be encoded, a difference between a video signal to be encoded and a video signal before or after the video signal. Of the second picture type or information of a third picture type which is the difference between the video signal to be encoded and the video signals before and after the video signal, and the delay amount in the delay means is the first or the first 12. The authoring system according to claim 11, wherein the picture type of 2 is longer than the appearance cycle.