JPH11168702A - Video signal processing device with display position control capability for multiple images - Google Patents

Abstract

(57) [Summary] To arbitrarily change one or both of display positions of a display image based on sub-picture data and a display image based on closed caption data. A main microprocessor determines whether a display position of a display image based on closed caption data and a display position of a display image based on sub-picture data overlap.
The determination is made by the zero overlap detection unit. If they overlap, the control data for display timing in the sub-picture decoder 500 is corrected. Thus, the display position of the closed caption data and the display image of the sub-video data are prevented from overlapping each other.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention solves the problem that the display positions of a plurality of subtitles overlap when video is displayed using a video signal source in which a plurality of subtitles of a movie are prepared, for example. The present invention relates to a video signal processing device having a display position control function for a plurality of videos.

[0002]

2. Description of the Related Art In recent years, so-called digital video disks have been developed in which sub-video data such as main video, audio, and subtitles are digitally compressed and recorded on an optical disk. The signals recorded on the digital video disc are packetized from a main video, a plurality of types of audio (for example, different languages), and a plurality of types of sub-video data (for example, different languages) (SP data). Has been recorded.

[0003]

However, closed caption (CC) data that is integrated with the main video data and packetized as subtitle data different from the above-mentioned sub-video exists.

[0004]

As described above, CC data exists. Therefore, when a digital video signal including this CC data is recorded on a digital video disc and a sub-video signal is also recorded, it is possible that both signals are reproduced. However, conventionally, no consideration is given to the display location of each signal, and therefore, when both signals are reproduced and displayed, the signals may overlap and disturb the image.

Accordingly, the present invention provides a video signal processing apparatus having a display position control function which can arbitrarily change one or both of a display position of a display image based on sub-picture data and a display image based on closed caption data. The purpose is to provide.

[0006]

In order to achieve the above object, the present invention provides a first video display means for displaying a first video on a main video, and a first video display means for displaying a first video on the main video. 2
Means for displaying a second image and a display position of the first and / or second image with respect to the main image are detected, and the display position is shifted between the first and second images. Means for controlling the display timing of the first and / or second image display means so as to have a relationship.

[0007]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows an embodiment of the present invention. 1
Reference numeral 00 denotes an optical disk on which data is recorded based on a DVD format as described later. The optical disk 100 is driven to rotate by a disk drive unit 200, and the recorded data is read by an optical pickup of the disk drive unit 200. The disk drive unit 200 is also provided with a focus control unit and a tracking control unit for the optical pickup.

The data read by the disk drive unit 200 is taken into the data processor unit 300 and subjected to demodulation processing, error correction processing, and the like. The data processor 300 distributes the data stream. That is, the data processor unit 300 sends the main video data to the video decoder unit 400, sends the sub video data of the stream specified by the user selection to the sub video decoder unit 500, and outputs the audio data of the stream specified by the user. To the audio decoder section 600
Send to

In the video decoder section 400, for example, MP
The video data is decoded by the EG 2, and the decoded data is converted into a digital-to-analog (D / A) conversion and data reproducing unit 7.
Supply to 00. The sub-picture decoder section 500 decodes the run-length compressed data, and supplies the decoded sub-picture data to the D / A conversion and data reproduction section 700. The audio decoder unit 600 is, for example, a PCM
The audio data, Dolby AC3 audio data, or MPEG audio data is decoded, and the decoded audio data is supplied to the D / A conversion and data reproduction unit 700.

The main video signal and the sub video signal output from the D / A conversion and data reproduction unit 700 are supplied to a monitor unit, and the audio signal is supplied to a speaker.

When the main video signal is decoded and closed caption data (line 21 data) exists in the user data area as described later, this data is multiplexed on a line of the main video signal on a predetermined standard. It is sent to the digital-to-analog converter. As a result, a television receiver including a closed caption decoder can reproduce closed caption data.

Reference numeral 800 denotes a main microprocessor section, which functions as an interface between the operation input section 900 operated by the user and the apparatus and also functions as a system control section for controlling the entire apparatus.

Here, the features of this apparatus will be described.

When the main video data decoded by the video decoder 400 includes CC (closed caption) data, the control data is sent to the main microprocessor 800. The main microprocessor section 800 detects at least a display start point and a display period from the control data.

In the sub-picture decoder section 500,
A display area and a display period in the sub-picture data unit are detected. Therefore, the display control data indicating the display area and the display period is stored in the main microprocessor section 800.
Sent to

The main microprocessor section 800 detects whether the display area and the display period of the CC data overlap with the display area and the display period of the sub-picture. When the two overlap, for example, the sub-picture decoder unit 50 moves so that the display position of the sub-picture moves.
For 0, display destination coordinate data is given.

Thus, overlapping display of characters by closed caption and characters by sub-picture data is prevented. To obtain such overlap prohibition, the overlap display inhibit switch 901 of the operation input unit 900 is turned on. Also, the sub-picture display position moving switch 902 is turned on.

FIG. 2 shows an example of a flowchart of a control unit for realizing prevention of overlapping display of characters by closed caption and characters by sub-picture data. First, the mode is set to a mode in which the overlapping display is inhibited by turning on the overlapping display inhibition switch in FIG.
1). When prohibiting the superimposed display, first, the microprocessor section 800 captures the data of the closed caption in the user area of the MPEG data from the data of the video decoder section 400 (step A2). The display information of the sub-picture is fetched from the sub-picture display area and the display period detector (step A3)
The microprocessor section 800 checks whether the display area and the display period of the closed caption data do not overlap with the display area and the display period of the sub-picture (step A4).

If the display periods overlap (step A5), it is checked whether the display areas overlap (step A6).

If both the display period and the display area overlap, it is determined whether the display position of the closed caption data is above or below the center line of the screen (step A7). Horizontal captions in closed captions (English, French, etc.)
Therefore, it is often possible to avoid overlapping by moving up and down.

When the display position of the closed caption data is below the center line of the screen, the display area of the sub-picture is shifted upward from the display position of the closed caption data (see step A8 and FIG. 3A). Conversely, if the display position of the closed caption data is above the center line of the screen, the display area of the sub-picture is shifted downward from the display position of the closed caption data (see step A9 and FIG. 3B).

Next, the display area of the sub-picture is set to the moved position (step A10), and when the movement is completed, the display of the closed caption data and the sub-picture data is executed (A11).

FIG. 3A shows that the display area and the display period of the closed caption data overlap with the display area and the display period of the sub-picture, and the display position of the closed caption data is below the center line of the screen. This is an example in which the display area of the sub-picture is shifted upward from the display position of the closed caption data.

That is, the display start Y coordinate y2 of the closed caption data and the Y coordinate y of the end point of the sub-picture display area
The coordinates of y1 are moved (the sub-picture display is moved upward in the closed caption display screen) so that 1 + ys-1 satisfies the condition of y2> y1 + ys-1.

FIG. 3B shows that the display area and the display period of the closed caption data overlap with the display area and the display period of the sub-picture, and the display position of the closed caption data is above the center line of the screen. In this example, the display area of the sub-picture is shifted downward from the display position of the closed caption data.

That is, the starting point Y coordinate y of the sub-picture display area
1 is moved so that the condition of y1> y2 (Y coordinate of the last line of the closed caption display) +1 is satisfied (the display of the sub-picture data is moved downward in the screen of the closed caption display).

FIG. 4 shows another embodiment of the present invention.

The same parts as those in the embodiment of FIG. 1 are denoted by the same reference numerals. The embodiment of FIG. 4 is different from that of FIG. 1 in that a closed caption decoder 1001 is provided between an output section of a video decoder section 400 and a D / A conversion and data reproduction processing section 700. It is.
A closed caption display position movement switch unit 1002 is connected to the closed caption decoder 1001.

Further, the operation input section 900 is provided with a movement target setting switch section 905, which can select whether to move the display position of the closed caption data or the display value of the sub-picture data. . When the display position of the sub-picture data is moved, the same operation as in the above embodiment can be obtained.

FIGS. 5 and 6 show flowcharts for explaining the operation of the above embodiment. FIG.
The same parts as those in the flowchart shown in FIG. In the case of this embodiment, in the step A6 of judging that the display areas overlap, if the display areas overlap, whether the display position of the closed caption data is moved and the display position of the sub-picture data is fixed (This determination is based on the movement setting switch 9
05 may be determined).

When the display position of the closed caption data is to be moved, the route is from step A7 to A11 in the same manner as described with reference to FIG. If the display position of the sub-picture data is to be moved, the process proceeds to step B3, where it is determined whether or not the display position of the sub-picture data is below the center line of the screen (step B3). The display area of the data is shifted above the display area of the sub-picture data (B4, B6, B7). Conversely, when the display position of the sub-picture data is above the center line of the screen, the display of the closed caption data is performed. A process of shifting the area below the display area of the sub-picture data is performed (B5, B6,
B7).

In the above-described embodiment, it is checked whether or not the display area of the closed caption data and the display area of the sub-picture data overlap at the time of reproducing the optical disk.
If they overlap, one of the display positions is shifted.

However, when the closed camption data and the sub-picture data are recorded on the optical disc, the overlap of the display areas can be determined in advance. You may do it.

Hereinafter, an apparatus for correcting the display area of the closed caption data at the time of encoding and its operation,
An apparatus for correcting a display area of sub-picture data at the time of encoding and its operation will be described.

FIG. 7 shows an example of an encoder for correcting the display position of the closed caption data and recording the corrected position on the disk.

That is, the encoder includes the encoder section 20
00 and a main microprocessor unit 3000 are used. An audio signal and / or a video signal from the audio / video input unit 2001 are input to the analog / digital conversion unit 2003 of the encoder unit 2000. The analog-to-digital converter 2003 receives a television signal from the television tuner 2002. When the television signal includes closed caption information, this information is input to the closed caption display position moving unit 3001, the closed caption display start point, and the display period detecting unit 3002 of the main macro processor 3000.

From the analog-to-digital converter 2003,
A video signal to be encoded and an audio signal to be encoded are derived and input to the video encoding unit 2004 and the audio encoding unit 2005, respectively. The encoded video signal and audio signal are input to the formatter unit 2007. The sub-picture data such as subtitles is further input to the formatter unit 2007 from the sub-picture encoding unit 2006.

The formatter unit 2007 uses the buffer memory unit 2008 to arrange video signals, audio signals, and sub-picture data into a predetermined format. The data formatted in a predetermined format is transmitted to the optical disk drive unit 320 through the data processor 3200.
1 is supplied. Thereby, for example, it is recorded on an optical disk.

The main microprocessor 3000 monitors the parameters from the sub-picture setting and parameter input unit 3100, and detects the display area and display period of the sub-picture data by the display area and display period detecting unit 3003 of the sub-picture data. be able to. The output of the sub-picture setting and parameter input unit 3100 is input to the sub-picture encoding unit 2006 of the encoder unit 2000. The sub-picture data and parameters (control information for displaying the sub-picture)
It can be input from the sub-picture setting and parameter input unit 3100 by a user operation.

Sub-picture display area and display period detecting section 300
3 and the detection output of the closed caption display start point and the display period detection unit 3002 are the overlap detection unit 3
004. The output of the overlap display inhibition switch 3101 is supplied to the overlap detection unit 3004.
The overlapping display inhibition switch 3101 is set to, for example, ON when inhibiting overlapping display. Overlap detector 3004
Provides the closed caption display position moving unit 3001 with coordinate data for moving the display position of the closed caption data. Then, the data that determines the display position of the closed caption data is corrected and input to the video encoding unit 2004. Closed caption data output from the closed caption display position moving unit 3001 is also input to the video encoding unit 2004. Video encoding unit 200
In step 4, mixing for recording data in the user area of the MPEG video stream is performed.

FIG. 8 shows a flowchart in which the display position of the above closed caption data can be corrected in advance at the time of encoding.

In FIG. 8, after parameters necessary for encoding are set (step C1), it is determined whether or not the overlap display inhibition switch is turned on (step C2). And if it is on, detection of the display position and display period of the closed caption data is performed (step C3),
Next, the display position and the display period of the sub-video data are detected (step C4). Next, the process proceeds to a process of determining whether or not the closed caption display and the sub-video display overlap (step C5). If the display periods overlap, it is determined whether the display areas overlap (steps C6 and C7), and then it is determined whether the display position of the sub-picture data is below the center line of the screen. (C8).

If the display position of the sub-picture data is below the center line of the screen, conversion processing is performed to shift the display position of the closed caption data upward in the display position of the sub-picture (step C9). If the data display position is above the center line of the screen, conversion processing is performed to shift the display position of the closed caption data downward in the display position of the sub-picture (step C10), and encoding processing is performed (step C11).

In the above embodiment, the processing for shifting the display position of the closed caption data is performed. However, the processing for shifting the display position of the sub-picture data may be performed.

FIG. 9 shows still another embodiment of the present invention. The same parts as those in the above embodiment are denoted by the same reference numerals. Therefore, only the differences from the above embodiment will be described.

In this embodiment, the data for determining the display position of the closed caption data is not corrected. Accordingly, the closed caption data from the television tuner unit 2002 is supplied to the closed caption display start point and display period detecting unit 3002 and is also supplied to the video encoding unit 2004.
Further, the output of the sub-picture setting and parameter input unit 3100 is input to the sub-picture encoding unit 2006 via the sub-picture display area moving unit 3005. When detecting that the period and the area of the closed caption display and the sub-picture display coincide with each other, the overlay detection unit 3004 sends control data to the sub-picture display area moving unit 3005 to correct the data for determining the display position of the sub-picture data. Perform

FIG. 10 is a flow chart for explaining the operation of the above-mentioned device. After the parameters necessary for encoding are set (step D1), it is determined whether or not the overlap display inhibition switch is turned on (step D2). If it is off, the continuation of the encoding process is executed. For example, the display position and the display period of the closed caption data are detected (step D).
3) Next, the display position and the display period of the sub-picture data are detected (step D4). Next, the process proceeds to a process of determining whether the closed caption display and the sub-video display do not overlap (step D5). If the display periods overlap, it is determined whether the display areas overlap (steps D6 and D7), and then it is determined whether the display position of the closed caption data is below the center line of the screen. (D8).

If the display position of the closed caption data is below the center line of the screen, a conversion process is performed to shift the display position of the sub-picture data upward in the display position of the closed caption data (step D9). If the display position of the caption data is above the center line of the screen, a conversion process is performed to shift the display position of the sub-picture data downward in the display position of the sub-picture (step D1).
0), an encoding process is performed (step D11).

Next, the closed caption system will be described.

FIG. 11 shows the blanking period of the line 21 in the field 1 of the standard NTSC video signal.

The composite data signal included in the active portion of the line 21 is a sine waveform clock run-in (7 burst cycles), a start bit, and 16-bit data. The 16-bit data is composed of two 8-bit alphanumeric characters formed according to US ASCII code with odd parity, and the clock rate is 0.50.
It is equivalent to 32 fH at 35 MHz. The clock burst and the data are filtered so that the peak becomes 50 IRE and the response becomes 2T. The least significant bit (b1 bit) of data is transferred first, and the most significant bit (b8 bit) is transferred last.

In normal caption data, the caption mode (POPON, PAINTON, ROLLLU) is used.
P), a code representing the TEXT mode, a preamble-address representing the address of the display position and the character color, etc.
Following the ss-Code, a data code representing a character follows. In addition to this, control codes such as display memory deletion, non-display memory deletion, flip memory code, and control codes such as cursor movement, backspace, flash on, line feed, and deletion between line end, which control start and end, are required. Has been inserted.

FIG. 12 shows the basic configuration of the closed caption code decoder. Input unit 11 to C
CC code data is input to the C code decoder 12 and decoded. The decoded data is written to one of the memories 13 and 14. One of the data in the memories 13 and 14 is stored in the selector 15.
And is displayed on the display.

In the PAINTON mode, the decoder writes data to a memory (display memory) to be read (for example, data is written to the memory 13 and read from the memory 13). In order to operate in this manner, the decoded data is immediately displayed.

In the POPON mode, data is written to a memory (non-display memory) that has not been read (for example, data is written to the memory 13 and data is read from the memory 14). ).
The read / write memory is switched and controlled by the flip memory code, and the contents of the data written so far are displayed at once (in this example, the contents of the memory 13). Will be done.

The display is on an opaque black background color.
The characters are white, green, blue, cyan, red, yellow, and magenta.

In the POPON mode, "line feed", "backspace", and "delete until end of line" do not affect the position of the cursor. In PAINTON mode, "line feed"
Does not affect the cursor position (these codes are ignored).

FIG. 13 shows the setting of the display area.
The display area has a font size of 16 pixels * 26 lines per character, and 15 lines (Row 1 to Row 15) * 32 lines (0 to 31 column) in units of this.
m). At the same time, up to four lines that are not necessarily adjacent can be displayed. The outer frame indicates the area of the effective screen of the display, which is 480 lines vertically and 71 lines horizontally.
9 pixels.

FIG. 14A shows an example of transmission of a control signal of closed caption data. Each control signal is composed of a pair of one byte, and is always transmitted to line 21 of the first field, and is transmitted twice to receive the signal correctly. FIG. 14B shows a display example when a control signal as shown in FIG. 14A is transmitted. In this example, line 14 contains AB
This shows an example in which FGHIJK is displayed on the 15th line of the CDE.

FIG. 14A is briefly described as follows.

An instruction to load caption data is executed by "14 20" and "14 20". Next, an instruction to switch the memories 13 and 14 is executed by “142F” and “142F”. Next, it is determined by "14 52" and "14 52" that the display start position is 14 rows and 4 columns. The next data 41, 42, 43, 44 and 45 correspond to the characters ABCDE. The next 00 means that the control data comes next, and the next “14 72” and “14 72” means that the display start position is 15 rows and 4 columns. Subsequently, the data 46, 47, 48, 49, 4A, 4
B corresponds to the character FGHIJK.

As control codes in the closed caption system, there are three different types of control codes for specifying the format, position, attribute, and character display.

The preamble address code (Prea
mble address code), Mid-Row code, Miscellaneou
s (various) control code.

FIG. 15 shows a preamble address code,
FIG. 16 shows Mid-Row codes, and FIG. 17 shows Miscellaneous (various) control codes. FIG.
8 and FIG. 19 show typical character codes.

In the closed caption system, information on the closed caption display start position can be recognized from the above preamble address code. Therefore, when the CC display position is shifted as in the present invention, the calculation is performed as follows. For example, if the display start line is the thirteenth line and the display last line is the fifteenth line, the display start Y coordinate = the Y coordinate above the CC display area + (display line−
1) * Number of lines per character y = 45 + (13−
1) * 26 = 357 lines.

Display end Y coordinate = Y coordinate above CC display area + display line * the number of lines per character minus one;
45 + 15 * 26-1 = 434 lines.

Although the closed caption system is standardized in such a manner as to be multiplexed with a television signal as described above, when it is recorded on an optical disk, it is standardized so as to adopt the following recording method. I have. That is, MPEG
According to the standard, a user data area is secured in the GOP layer, so that it is standardized so that line 21 data is described here. The following arrangements have been made.

The line 21 data has a frame rate of 2
9.97 Hz ISO 13818-2 or ISO 11
17-2 is described only in the bit stream. Line 21 data cannot be recorded in the video gap. The field 1 data of line 21 is combined with the top field defined in ISO 13818-2,
Combined with Field 1 of the / 60 TV system. Field 2 data of line 21 is ISO1381
It is combined with the bottom field defined in 8-2 and combined with the field 2 of the NTSC (525 / 60TV) system. There cannot be two or more line 21 data user data in the GOP layer.

In the case of recording in the user data area, FIG.
Continue with the syntax as shown in 0. Further, when the two bytes following the user start code in the user data of the GOP layer are 4343h, the user data is only the line 21 data and must follow the syntax shown in FIG. When line 21 data is recorded, all GOPs in the same video title set are line 2
Must have one data area.

FIG. 20 shows a file described in the user data area.
The format is shown. In the figure, user data star
t The code is defined as a value 000001B2h. line
twenty one For indicator, the data that follows is user data
Is a fixed value indicating that top field flag of gop is
The top display field of the first picture in the GOP is
"1b" for bottom field
In this case, "0b" is described. number of displayed fiel
d gop indicates the number of display fields in the GOP, followed by
It is the same as the number of line 21 data recorded repeatedly.
You.

Marker bits is a fixed value. line21 swi
When tch is "1b", it indicates that the following line 21 data is valid and conforms to the EIA-608 standard. "0
b "indicates that the following line 21 data is invalid. The line 21 includes either field 1 data or field 2 data.

Line21  data () is the format shown in FIG.
Specified in the mat. line21 data1 has an odd MSB
Several parity bits, 7 bits of which are EIA-608
Represents the data of character 1 defined by. line21  da
ta2 is an odd parity bit whose MSB is 7 bits.
Is character 2 data specified by EIA-608
Represents

Next, sub-picture data whose display position is controlled to move will be described.

Since this sub-picture data is defined in the DVD standard, the outline of the DVD system will be described first.

The optical disk is a double-sided laminated disk having a storage capacity of about 5 Gbytes on one side, for example, and has a large number of recording tracks between a lead-in area on the inner circumference side of the disk and a lead-out area on the outer circumference side of the disk. Are located. Each track is composed of a large number of logical sectors, and various information (appropriately compressed digital data) is stored in each sector.

FIG. 22 shows the volume space of the optical disk.

As shown in FIG. 22, the volume space includes a volume and file configuration zone, a DVD video zone,
Consists of other zones. The UDF bridge configuration is described in the volume and file configuration zone, and the data of the UDF bridge configuration can be read even by a computer of a predetermined standard. The DVD video zone has a video manager (VMG) and a video title set (VTS). The video manager (VMG) and the video title set (VTS) are each composed of a plurality of files. The video manager (VMG) is information for controlling a video title set (VTS).

FIG. 23 shows a video manager (VM
G) and the structure of a video title set (VTS).

The video manager (VMG) includes a video manager information (VMGI) as control data for controlling a video title set and the like, and a video object set (VMGM) as data for menu display. VOBS). Video Manager Information for Backup (V
MGI).

The video title set (VTS) includes a video title set information (VTSI) as control data and a video object set (VTSM) as data for menu display. VOBS)
And a video object set (VTSTT) for a title of a video title set, which is a video object set for displaying video. VOBS). It also has a video title set information (VTSI) for backup.

Further, a video object set for displaying images (VTSTT) VOBS) is composed of a plurality of cells. Each cell (Cel)
1) is assigned a cell ID number.

FIG. 24 hierarchically shows the relationship between the video object set (VOBS) and the cell (Cell) and the contents of the cell (Cell). DVD
When the playback processing is performed, video breaks (scene changes, angle changes, story changes, etc.) and special playback are performed in units of cells (Cells) or video object units (VOBs) that are lower layers.
U).

Video Object Set (VOBS)
First, one or more video objects (VO
B IDN1 to VOB IDNi).
In addition, one video object has one or more cells (C IDN1 to C IDNj). Further, one cell is composed of one or a plurality of video object units (VOBU). One video object unit (VOBU) is composed of one navigation pack (NV
PCK), one or more audio packs (A
PCK), one or more video packs (V PC
K) One or more sub-picture packs (SP
PCK).

Navigation Pack (NV) PCK)
Is mainly used as control data for controlling the reproduction of data in the video object unit to which it belongs and control data for performing a data search of the video object unit.

The video pack (V PCK) is main video information and is compressed according to a standard such as MPEG. Sub picture pack (SP PCK) is sub-picture information having auxiliary contents for the main video. For example, movie subtitles, scenarios, etc., using run-length compression technology. Audio Pack (A PCK)
Is audio information.

FIG. 25 shows a video object (VO
The relationship between B) and the cell is extracted and shown. FIG.
The example shown in (A) is a block arrangement in which one title (for example, a movie scene) is continuous, and cells in the block are continuously reproduced. In contrast, FIG.
FIG. 5B shows an example of cell arrangement when a multi-scene is recorded. That is, a standard is defined for DVDs that allow simultaneous recording of events that can be recorded at different angles. For example, in the case of a baseball movie, an image of the entire stadium shot from behind the backnet and an image of the referee's face zoomed in are acquired at the same time, each image is divided into multiple units, and these are interleaved. And record it on the track. The example of FIG. 25B shows an example in which two scenes are divided into units, and each unit is interleaved. If such a disc plays,
Either one of the units is separately acquired and reproduced. Which scene is to be selected is determined by the operation of the user, or when a priority is given and there is no user selection, the one with the higher priority is reproduced.

FIG. 26 shows a program chain (PG
C) shows an example in which the reproduction order of the above cells (Cells) is controlled.

As a program chain (PGC),
Various program chains (PGC # 1, PG # 1) are set so that the reproduction order of the data cells can be variously set.
C # 2, PGC # 3...) Are prepared. Therefore, the order of cell reproduction is set by selecting a program chain.

An example is shown in which programs # 1 to #n described as program chain information (PGCI) are executed. The illustrated program has contents for sequentially designating cells after #s in the video object set (VOBS).

FIG. 27 shows a video title set (VT
S) shows a video title set information (VTSI). Video title set program chain information table (VTS) in video title set information (VTSI) PGCIT) is described. Therefore, when a video object set (VOBS) in one video title set (VTS) is played,
This video title set program chain information table (VTS A program chain selected by the user from a plurality of program chains presented in (PGCIT) is used.

In the VTSI, the following data is described in addition to the above.

VTSI MAT: a management table of video title set information, which describes what information exists in the video title set, and describes a start address and an end address of each information.

VTS PTT SRPT: Video title set Part of title search pointer table, in which title entry points and the like are described.

VTSM PGCI UT: Video title set menu program chain Information unit table, which is a chain for reproducing a video title set menu described in various languages. Therefore, it is possible to confirm from the menu what kind of video title set is described, and what kind of style of playback order is described.

VTS TMAPT: Video title set time map table, in which information on the recording position of the VOBU managed in the program chain is described.

VTSM C ADT: video title set menu cell This is an address table in which the start and end addresses of the cells constituting the video title set menu are described.

VTSM VOBU ADMAP: Video title set menu Video object unit address map, in which the start address of the video object unit for menu is described VTS C ADT: video title set cell address table in which the start and end addresses of the cells constituting the video title set body are described.

VTS VOBU ADMAP: Video title set video object unit address map, in which the start address of the video object unit of the title body is described.

In the reproducing apparatus, when a program chain is selected, the reproduction order of the cells is set by the program chain. For playback, the NV included in the video object unit is used. PCK is referenced. NV The PCK has information for controlling display contents and display timing, and information for data search. Therefore, this NV V based on the information in the PCK table The PCK is taken out and decoded.
Also, other packs are taken out and decoded,
In that case, A of the language specified by the user
PCK, SP The removal of the PCK is performed.

FIG. 28 shows a configuration example of one pack and a packet.

One pack is composed of a pack header and a packet. A pack start code, a system clock reference (SCR), and the like are described in the pack header. The pack start code is a code indicating the start of a pack, and includes a system clock reference (S
CR) is information indicating the location time in the reproduction elapsed time for the entire apparatus. The length of one pack is 2048 bytes, and is defined and recorded as one logical block on the optical disk.

One packet is composed of a packet header and video data, audio data, sub-picture data, or navigation data. The packet header of the packet may be provided with stuffing. Padding may be provided in the data portion of the packet.

FIG. 29 shows that the NV The PCK is extracted and shown.

NV The PCK basically includes a presentation control information (PCI) packet for controlling playback and data search information (DS) existing in the same video object.
I) Have a packet. Each packet is described with a packet header and a sub-stream ID, followed by data. A stream ID is described in each packet header, and NV It indicates PCK, and the substream ID identifies PCI and DSI. In each packet header, a packet start code, a stream ID, and a packet length are described, followed by each data.

The PCI packet is navigation data for changing display contents in synchronization with the reproduction of video data in the video object unit (VOBU) to which the packet belongs.

[0107] The PCI packet includes PC which is general information.
I General Information (PCI GI),
Non-seamless angle information (NSML
ANGLI) and highlight information (HL)
I) and recording information that is recorded information
(RECI) is described.

FIG. 30 shows reproduction control general information (PCI G
I) is shown.

PCI The GI has a general description of this PCI.
It is information and the following information is described. This na
Logical block number that is the address of the navigation pack
Bar (NV PCK LBN), managed by this PCI
Indicates the attributes of the video object unit (VOBU)
Video object unit category (VOBUC
AT), a video object unit managed by this PCI.
Shows user's operation prohibition information during the knit display period
User operation control (VOBU UO
P CTL), opening the display of video object units
Indicates the start time (VOBU S PTM), Video Object
Indicates the end time of the display of the project unit (VOBU E
PTM). VOBU S Specified by PTM
The first video to be played is an I-picture in the MPEG standard.
It is. Furthermore, the video object unit
Video object unit that indicates the display time of the last video
Knit sequence end presentation tie
(VOBU SE E PTM) or the first video in a cell
Cell error indicating the relative display elapsed time from the video frame
Push Time (C ElTM) and the like are also described.

The NSM described in the PCI
L ANGLI indicates the address of the destination (destination) at the time of an angle change. That is, the video object also has images captured from different angles. Then, when the user specifies to display an image at an angle different from the currently displayed angle, the address of the VOBU to be shifted to the next reproduction is described.

The HLI is information for designating a specific area in the screen in a rectangular shape and changing the luminance of this area, the color of the sub-picture displayed here, and the like. This information includes the Highlights General Information (H
L GI), a button color information table (BTN) for allowing the user to make a button selection for color selection. COLIT) and a button information table (BTNIT) for select buttons
Is described.

RECI is video, audio, and sub-picture information recorded in the video object unit, and describes what data is to be decoded. For example, there are a country code, a copyright holder code, a recording date, and the like.

A DSI packet is navigation data for executing a search for a video object unit.

The DSI packet contains DS which is general information.
I General Information (DSI GI)
And seamless playback information (S
ML PBI), seamless angle information
(SML AGLI), video object unit
Information (VOBU) SRI), synchronization information
Information (SYNCI).

As shown in FIG. The GI describes the following information.

NV Indicates the PCK decoding start reference time
NV which is the system clock reference PCK
SCR, NV Indicates the PCK logical address (NV P
CK LBN), this NV Video object to which PCK belongs
Indicates the end address of the project unit (VOBU E
A) is described. Furthermore, decode first
Of the first reference picture (I-picture) for
Address (VOBU 1STREF EA) First deco
A second reference picture (I or P picture)
Char) end address (VOBU) 2NDREF E
A) Third reference picture to decode first
(I or P picture) end address (VOBU
3RDREF EA) is described. Furthermore,
ID number (VOBU) of the VOB to which this DSI belongs VO
B IDN) and the ID number of the cell to which this DSI belongs
(VOBU C IDN), the first video frame in the cell
Cell Elaps Time, which indicates the relative elapsed time from the
(C ELTM) is also described.

As shown in FIG. The following information is described in the PBI.

The VOBU to which this DSI belongs is
Unit (ILVU) or video
Pre-unit (PRE) that serves as a reference
U) video object unit seam indicating if
Less category (VOBU SML CAT), Inter
Indicates the end address of the moved unit (ILVU E
A), specify the start address of the next interleaved unit
Show (ILVU SA), the next interleaved unit
(ILVU) SZ), Video object
(VOB) indicates the video display start time (VOB).
OB V S PTM), Video Object (VOB)
Indicates the video display end time in the (VOB) V E
PTM), audio in video object (VOB)
Indicates the video stop time (VOB A STP PT
M), audio in video objects (VOB)
Indicates the gap length (VOB A GAP LEN) etc.
is there.

As shown in FIG. 33, seamless angle information (SML AGLI) describes the following information.

The address and size (SML) of the next interleaving unit to be shifted at each angle
AGL Cn DSTA) (n = 1 to 9). This information is referenced when the angle changes.

As shown in FIG. 34, VOBU search information (VOBU The following information is described as (SRI).

This information describes the start address of the VOBU (0.5 × n) seconds before and after the start time of the current video object unit (VOBU). That is, the start addresses of VOBUs from +1 to +20, +60, +120 and +240 as forward addresses (FWDINn) and the flag indicating that a video pack exists in the unit are described as forward addresses (FWDINn) based on the VOBU including the DSI. Have been.
The start address is described by the number of logical sectors relative to the first logical sector of the VOBU. By using this information, the VOBU to be reproduced can be freely selected.

As shown in FIG. 35, synchronization information (SYNC)
Describes the addresses of sub-pictures and audio data to be reproduced in synchronization with the reproduction start time of the VOBU video data including the DSI. Address is NV containing DSI The start position of the target pack is indicated by the number of logical sectors relative to the PCK.
When there are a plurality of audio streams (up to eight), the synchronization information is described by the number. When there are a plurality of sub-pictures (up to 32), synchronization information is described by the number of sub-pictures.

The above description has been made for video, audio, NV
This is an explanation of the pack structure of data, sub-pictures, and the like.

Here, each aggregate of each pack will be described.

FIG. 36 shows the relationship between a video object unit (VOBU) and video packs in this unit. Video data in a VOBU is composed of one or more GOPs. The encoded video data conforms to, for example, ISO / IEC13818-2. A VOBU GOP is composed of an I picture, a P picture, and a B picture, and a series of data is divided into a video pack.

FIG. 37 shows the relationship between audio streams and audio packs. Audio streams include linear PCM, Dolby AC-3, MP
There is data such as EG.

FIG. 38 shows an example of the logical structure of a pack of encoded (run-length compressed) sub-pictures.

As shown in the upper part of FIG. 38, one pack (SP) of sub-pictures (sub-pictures) included in video data
PCK) is composed of, for example, 2048 bytes (2 kB). One pack of a sub-picture includes a packet header and sub-picture data after a head pack header. The pack header contains a reference time (SCR; System Clock) through reproduction of the entire file.
Reference) information, which has a predetermined relationship with the time of the system timer, and has an SCR of the same time information.
Each sub-picture packet to which is added is collected and transferred to the decoder.

[0130] The first sub-picture packet includes, after the packet header, sub-picture data that has been run-length compressed together with a sub-picture unit header (SPUH). Similarly, the second sub-picture packet includes run-length compressed sub-picture data after the packet header.

A sub-picture data unit 310 is obtained by collecting such a plurality of sub-picture data for one unit (one unit) of run-length compression. The sub-picture data unit 310 is provided with a sub-picture unit header 311. After the sub-picture unit header 311, pixel data 312 obtained by performing run-length compression of video data of one unit (for example, data of one horizontal line of a two-dimensional display screen) and display control sequence information of each sub-picture pack are included. A table 313 is included.

That is, the sub-picture data unit 31
0 is a sub-picture unit header (SPUH) 3 in which various parameters for displaying a sub-picture are recorded.
11, display data (compressed pixel data; PXD) 312 composed of run-length codes, and a display control sequence table (DCSQT) 313.

FIG. 39 shows an example of a part of the contents of the sub-picture unit header 311 in the run-length compressed data 310 for one unit shown in FIG.

The sub picture unit header (SPU
H) 311 includes the size (S) of the sub-picture unit.
PU SZ; 2 bytes) and sub-picture data packet
Start recording of display control sequence table 313 in unit
Address (SP DCSQT SA; 2 bytes)
Have been.

More specifically, as shown in FIG. 39, parameters having the following contents are recorded in the sub-picture unit header (SPUH) 311.

(1) Size of this sub-picture unit (SPU (2) recording start position information of the display control sequence table 33 in the packet (display control sequence table start address SP of the sub-picture) DCSQT SA).

The display area on the display screen can be recognized by referring to the information of the display range described in the display control sequence table. If the information is intentionally rewritten, the display area can be corrected.

FIG. 40 shows the data structure of the sub-picture unit again.

[0139] A sub-picture unit is composed of a plurality of sub-picture packets. That is, one pack of the sub-picture information included in the video data is composed of, for example, 2048 bytes (2 kB), and one pack of the sub-picture information includes, after the first pack header,
It contains one or more sub-picture packets. The pack header is provided with time (SCR; System Clock Reference) information serving as a reference throughout reproduction of the entire file, and a packet in the sub-picture pack to which the SCR of the same time information is added is a sub-picture decoder. To be forwarded to

In the packet header of the above-mentioned packet,
The time at which the playback system should start controlling the display of the sub-picture data unit is recorded as a presentation time stamp (PTS). However, as shown in FIG. 41, this PTS is recorded only in the header of the first sub-picture data packet in each sub-picture data unit (Y, W). In the PTS, in a plurality of sub-picture data units reproduced with reference to a predetermined reproduction time SCR, values along the reproduction order are described for each sub-picture data unit.

Therefore, the display time can be recognized by referring to the PTS by the system controller. Conversely, if this PTS is rewritten, the display time can be shifted.

FIG. 42 shows a serial arrangement state (n, n + 1) of sub-picture units composed of one or more sub-picture packets, and a presentation time stamp (PTS) described in a packet header of one of the units (n + 1). ) And the progress of the display control of the unit (n + 1) corresponding to this (PTS). That is, the relationship between the processing time of the PTS, the display clear period of the sub-picture unit (n), and the display start time of the sub-picture unit (n + 1) to be displayed from now on is shown.

As shown in FIG. 43, the sub-picture unit header (SPUH) 311 contains the size of the sub-picture unit (2-byte SPUH). SZ) and the recording start address (2-byte SP) of the display control sequence table 33 in the packet. DCSQT SA) are recorded.

SPU The SZ describes the size of one unit by the number of bytes, and the maximum size is 53248 bytes. SP DCSQT SA is a display control sequence table (SP) based on the relative number of bytes from the first byte of the unit. DCSQT) is described.

As shown in FIG. 44, a display control sequence
Table (SP DCSQT) 313 includes one or more
Sub-picture display sequence (SP DCSQ0, S
P DCSQ1, ... SP DCSQn) are described in the order of execution.
Have been. Display control sequence table (SP DCS
QT) 313 is during the valid period of the sub-picture unit
To start / stop the display of sub-pictures and change the attributes
Display sequence information to be displayed.

FIG. 45 shows the sub-picture display control sequence (SP DCSQ). This SP The following contents are described as parameters of DCSQ.

The sub picture display control start time (SP) indicating the time when the execution of the video data display control is started
DCSQ STM; Sub-Picture Display Control S
equence Start Time) and the next sub-picture display control sequence (SP Address (SP) representing the destination of description of DCSQ NXT DCSQ SA; Addres of Next
SP DCSQ) and a sub-picture data display control command (SP DCCMD; Sub-Picture Display Control
Command) (SP DCCMD1, SP DCCMD2
, SP DCCMD3,...) Are recorded.

Here, the presentation time stamp PTS in the packet header is defined by a relative time from a reference time (SCR: System Clock Reference) throughout reproduction of the entire file, such as a reproduction start time at the beginning of the file. ing. As described above, the SCR is described in the pack header provided before the packet header.

Further, the sub-picture display control time (SP) which sets the display control sequence execution start time is set. D
CSQ (STM) is defined by a relative time (relative PTM) from the PTS described in the packet header.

Therefore, (SP DCSQ STM)
And the count value of the sub-timer are compared. If the count value of the sub-timer is greater than the display control sequence time, the display state of the output data decoded by the decoding means is controlled according to the sequence control data.

In practice, (SP DCSQ With respect to a video frame displayed first after the execution start time described as (STM) is described, control for display is started for a sub-picture represented in the video frame. Display control sequence time (SP
DCSQ "0000h" is described in STM). The value of the execution start time is equal to or longer than the PTS described in the sub-picture packet header, and is 0 or a positive integer. Based on the display control start time, one (SP) When the command in the DCSQ is executed, the next designated (SP DCS
The execution process is started when the command in Q) reaches the display control start time. For example, it is possible to perform control such that the colors of the displayed subtitles are sequentially changed.

SP NXT DCSQ SA is indicated by a relative number of bytes from the first sub-picture unit,
Next SP It shows the DCSQ address. Next SP
If there is no DCSQ, this SP DCSQ
Is the relative number of bytes from the first byte of the relevant sub-picture unit, and the first SP The start address of DCSQ is described. SP DCCMDn describes one or more display control sequences.

FIG. 46 shows a display control command (SP) for performing display control. DCCMD).

Display control command (SP DCCMD) includes an instruction (FSTA) for setting a compulsory display start timing of pixel data. DSP), an instruction to set the display start timing of the pixel data (STA) DSP),
Command to set the display end timing of pixel data (S
TP DSP), instruction to set color code of pixel data (SET COLOR), an instruction to set the contrast between the pixel data and the main image (SET CONT
R), an instruction to set a display area for pixel data (SE)
T DAREA), an instruction to set the display start address of the pixel data (SET DSPXA), an instruction (C) for setting a change control of color and contrast of pixel data
HG COLCON), a command to end the display control (C
MD END). The respective codes and extension fields are as follows as shown in the figure.

That is, a forced display start timing command (FSTA) The code of the DSP is 00h and the extension field is 0 bytes. When this instruction is described, the forced display of the sub-picture unit having this code is executed regardless of the display state of the sub-picture.

Display start timing command (STA) DS
The code of P) is 01h, and the extension field is 0 bytes. This command is a display start command for the sub-picture unit. This command is ignored when the display of the sub-picture is turned off.

Display stop timing command (STP DS
The code of P) is 02h, and the extension field is 0 bytes. This command is a sub-picture unit display stop command. The sub-picture can be redisplayed by the previous display start command.

A color code setting instruction (SET COLO
The code of R) is 03h, and the extension field is 2 bytes. This command is a command for determining the color of each pixel of the pixel data, and is described in the extension field by a pallet code. The second pallet code for each pixel
Each palette code is described for an enhancement pixel (4 bits), a first enhancement pixel (4 bits), a pattern pixel (4 bits), and a background pixel (4 bits).

Here, this instruction (SET COLOR)
Is not present in the sub-picture unit,
The last used one before that is maintained and this instruction is used. This instruction is specified at the beginning of each line.

A contrast setting command (SET CONT
The code of R) is 04h, and the extension field is 2 bytes. This command is a command for setting a mixing ratio between the pixel data and the main image, and is described in the extension field by contrast designation data. The contrast designation data of the pixel includes a second emphasized pixel (4 bits), a first emphasized pixel (4 bits), a pattern pixel (4 bits),
Since there is a background pixel (4 bits), contrast designation data k for each pixel is described.

The contrast of the main image is (16-k) / 1
6, the contrast of the sub-picture is k / 16. 16 is a gradation. The value may be "0", in which case the sub-picture does not appear on the screen even though it exists. If the value is not “0”, k is treated as (value + 1).

Here, this instruction (SET CONTR)
Is not present in the sub-picture unit,
The last used one before that is maintained and this instruction is used. This instruction is specified at the beginning of each line.

Display area setting command (SET DARE
The code of A) is 05h, and the extension field is 6 bytes. This command is a command for setting a display area of square pixel data on the screen. In this instruction:
The start position (10 bits) and end position (10 bits) of the X-axis coordinates on the screen, and the start position (10 bits) and end position (10 bits) of the Y-axis coordinates are described. The remaining bits of the six bytes are reserved. The value at the start position of the X-axis coordinate is subtracted from the value at the end position of the X-axis coordinate, and +1
Should be the same as the number of display pixels on one line. The origin of the Y-axis coordinate is line number 0. The origin of the X-axis coordinate is also 0. On the screen, it corresponds to the upper left corner. The Y-axis coordinate value is 2 to 479 (525 lines / 60 Hz
TV) or 2-574 (625 lines / 50H
z in the case of TV), whereby a sub-picture line is specified, and the X-axis coordinate value describes a value of 0 to 719, thereby specifying a pixel number.

Here, this instruction (SET DAREA)
Is not present in the sub-picture unit,
The last sub-picture unit sent earlier is kept as it is.

Display start address setting instruction (SET DS
PXA) is 06h, and the extension field is 4 bytes. This command is a command indicating the first address of the image data to be displayed. The first addresses of the odd field (16 bits) and the even field (16 bits) are described by the relative number of bytes from the head of the sub-picture unit. The first of the position indicated by this address
Pixel data indicates a run-length compression code including the first pixel at the left end of the line.

Here, this instruction (SET DSPXA)
Is not present in the sub-picture unit,
The state of the last sub-picture unit sent earlier is kept as it is.

Color and contrast change control command (C
HG The code of (COLCON) is 07h, and the extension field is (pixel control data size + 2 bytes).

(CMD The code of END) is FFh, and the extension byte is 0 byte.

FIG. 47 shows the above (CHG COLCO
N) pixel control data (P
XCD (Pixel Control Data).

This PXCD is data for controlling the color and contrast of the pixel displayed as a sub-picture during the display period. The instruction described in the PXCD is a sub picture display control start time (SP DCSQ
It is performed for each video frame from the first video frame after the STM is described, and is performed until the next new PXCD is set. The old PXCD is canceled when the new PXCD is updated.

The line control information (LN) shown in FIG. CT
LI (Line Control Information) designates a line on which sub picture change control is performed. A plurality of lines on which the same conversion control is performed can be designated. The pixel control information (PX CTLI; Pixcel Control I
nformation) describes the designated position on the line where the change control is performed. One or more pixel control information (PX CT
LI) can designate a plurality of positions on a line where conversion control is performed.

As the end code of the pixel control data (PXCD), (0FFFFFFFh) is LN It is described in CTLI. P such that only this end code exists
When XCD arrives, (CHG COLON) means the end of the instruction itself.

Referring to FIG. 48, each of the above instructions will be further described.

LN The CTLI is composed of 4 bytes. The line number (10 bits) at which the change of the sub-picture starts, the number of changes (4 bits), and the end line number (1)
0 bit). The change start line number is the line number at which the change of the pixel control content starts, and is described by the line number of the sub-picture. The end line number is a line number at which the control state based on the pixel control content is stopped, and is also described by the line number of the sub-picture. The number of changes is
This is the number of change positions, and the pixel control information (PX
CTLI) number. The line numbers at this time are naturally 2 to 479 (when the television system is 525 lines / 60 Hz) or 2 to 574 (when the television system is 625 lines / 50 Hz).

Next, one pixel control information (PX CTL
I) is composed of 6 bytes and describes a change start pixel number (10 bits) and control information for changing the color and contrast of each pixel following the pixel.

The palette codes for the pixels are for the second emphasized pixel (4 bits), for the first emphasized pixel (4 bits),
For pattern pixels (4 bits), for background pixels (4 bits)
Each pallet code is described. Also, the contrast designation data for the second emphasized pixel (4 bits), the first emphasized pixel (4 bits), the pattern pixel (4 bits), and the background pixel (4 bits) are described as the contrast designation data for the pixel. Have been.

The above change start pixel numbers are described by the pixel numbers in the display order. When this is zero, SET CO
LOR and SET CONTR is ignored. A color pallet code is described as the color control information, and the contrast designation data is described as the contrast control information as described above.

When no change is requested in each of the above control information, the same code as the initial value is described.
The initial value is a color code and contrast control data specified from the beginning to be used for the sub-picture unit.

Next, an example of a sub-picture compression method will be described.

FIG. 49 shows run-length compression rules 1 to 6 when pixel data (run-length data) of a sub-picture is created. According to this rule, the data length (variable length) of one unit of the unit is determined. Then, encoding (run-length compression) and decoding (run-length decompression) are performed with the determined data length.

FIG. 49 shows a run-length compression rule 1 used in the encoding method according to the embodiment when the preceding sub-picture pixel data (run-length data) 312 is composed of 2-bit pixel data. ~ 6
It is to explain.

According to rule 1 shown in the first column of FIG. 49, when one to three identical pixels continue, one unit of encoded (run-length compressed) data is constituted by 4-bit data. In this case, the first two bits represent the number of continuous pixels, and the following two bits represent pixel data (such as pixel color information).

For example, the first compressed data unit CU01 of the video data PXD before compression shown in the upper part of FIG.
Are two 2-bit pixel data d0, d1 = (000
0) b (b is binary). In this example, the same 2-bit pixel data (00)
b is continuous (continuous).

In this case, as shown in the lower part of FIG. 50, d0, d1 = (1000) b obtained by connecting the 2-bit display (10) b of the continuation number "2" and the content (00) b of the pixel data.
Is the data unit CU01 * of the compressed video data PXD.
Becomes

In other words, according to rule 1, data unit C
(0000) b of U01 is (1) of data unit CU01 *.
000) b. In this example, no substantial bit length compression is obtained, but for example, the same pixel (00)
If b is three consecutive CU01 = (000000) b, CU01 * = (1100) b after compression, and 2
A bit compression effect is obtained.

According to rule 2 shown in the second column of FIG. 49, when 4 to 15 identical pixels continue, one unit of encoded data is constituted by 8-bit data. In this case, the first two bits are represented by an encoding header indicating that it is based on rule 2, the subsequent four bits represent the number of continuous pixels, and the subsequent two bits represent pixel data.

For example, the second compressed data unit CU02 of the video data PXD before compression shown in the upper part of FIG.
Are five 2-bit pixel data d2, d3, d4, d
5, d6 = (0101010101) b.
In this example, the same 2-bit pixel data (01) b is 5
It is continuous (continuous).

In this case, as shown in the lower part of FIG. 50, the encoded header (00) b, the 4-bit display (0101) b of the continuation number "5", and the content (01) b of the pixel data are connected. d2 to d6 = (00010101) b are the data units CU02 * of the compressed video data PXD.

In other words, according to rule 2, the data unit C
(0101010101) b of U02 (10-bit length)
Is (00010101) b (8) of the data unit CU02 *.
(Bit length). In this example, the effective bit length compression amount is only 2 bits from 10 bits to 8 bits. However, when the number of continuations is, for example, 15 (a 30-bit length in which 15 01s of CU02 are continuous), this is 8 bits. It becomes compressed data (CU02 * = 00111101),
A 22-bit compression effect is obtained for the bits. That is, the bit compression effect based on Rule 2 is greater than that of Rule 1. However, rule 1 is also required to support run-length compression of a fine image with high resolution.

According to rule 3 shown in the third column of FIG. 49, when 16 to 63 identical pixels continue, one unit of encoded data is constituted by 12-bit data. In this case, the first 4 bits represent an encoded header indicating that the rule is based on rule 3,
The next 6 bits indicate the number of continuous pixels, and the subsequent 2 bits indicate pixel data.

For example, the third compressed data unit CU03 of the video data PXD before compression shown in the upper part of FIG.
Are 16 2-bit pixel data d7 to d22 = (10
1010... 1010) b. In this example, 16 pieces of the same 2-bit pixel data (10) b are continuous (continuous).

In this case, as shown in the lower part of FIG. 50, the encoded header (0000) b, the 6-bit display (010000) b of the continuation number “16”, and the content of the pixel data (10)
b and d7 to d22 = (0000000100001)
0) b is the data unit CU of the compressed video data PXD
03 *.

In other words, according to rule 3, data unit C
(101010... 1010) b (32-bit length) of U03 is (000000001000) of the data unit CU03 *.
010) b (12-bit length). In this example, the substantial bit length compression amount is 20 bits from 32 bits to 12 bits, but the continuation number is, for example, 63 (CU0
In the case of 63 consecutive 10s of 3 and a length of 126 bits, this is 12-bit compressed data (CU03 * = 00).
0011111110), and a compression effect of 114 bits can be obtained for 126 bits. That is, the bit compression effect based on Rule 3 is greater than that of Rule 2.

According to the present invention, it is possible to arbitrarily control the sub-picture and the picture based on the closed caption data so as not to overlap. This control is also possible in a disk reproducing device, and in a disk recording device, it is also possible to set a relationship shifted in advance before recording on a disk.

In the disc reproducing apparatus, attention was paid to the relationship between the sub-picture recorded on the disc and the display image of the closed caption data. But not limited to this,
It is also possible to use a form in which a sub-picture reproduced from a disk is used and closed caption data is inputted from an external tuner.

In the above description, it has been described that the video processing means is built in the playback apparatus in advance, but the video processing means has flexibility based on software recorded on a recording medium. It may be constructed later in the signal processing device.

That is, the following files may be provided on a disk serving as a recording medium and installed in the apparatus.

A first video processing file for processing the first video information for displaying the first video on the main video on the screen, and a second video for displaying the second video on the main video. A second image processing file for processing the second image information, and a display position of the first and second images on the screen using control data included in the first and second image information Is detected, and the display positions are changed between the first and second positions.
Is a control file that controls the display timing of at least one of the images so that the images have a shifted relationship.

Further, when installing in a device in which the first and second video processing means are provided in advance, only the control file may be installed. Naturally, in this case, a recording medium on which the control file is recorded is distributed.

The above file is a basic concept, and various modified embodiments are possible as follows.

[0201] As a file for controlling the display timing of the at least one image, the first and second images are controlled so that the display area is shifted on the screen.
Alternatively, control is performed so that the display times of the first and second images are shifted on the screen. Alternatively, when the second image of the first and second images is a fixed display value and the first image is shifted, the fixed display position of the second image is lower than the horizontal center line of the screen. If the first
Is shifted toward the top of the screen, and if the fixed display position of the second image is above the horizontal center line of the screen, the first image is shifted toward the bottom of the screen. Further, the shift amount may be interlocked with external input means for externally adjusting the shift amount.

As for the first and second images, the first image is a sub-image reproduced from a video disc, and the second image is
Is a video based on closed caption data, the first video processing file is a sub-video decoder for decoding the sub-video, and the file for controlling the display timing is the video processed by the sub-video decoder. The shifted relationship is obtained by correcting the display timing information of the first video.

[0203] Alternatively, the first video is a sub video reproduced from a video disc, the second video is a video based on closed caption data, and the first video processing file decodes the sub video. Then, the second video processing file extracts data from a decoder for decoding the main video signal and generates the closed caption data.

[0204] The second video processing file may function as a closed caption decoder for receiving and decoding the closed caption data extracted from the decoder for decoding the main video signal.

Further, the control of the display timing may be set so as to include a selection function for determining which of the first and second images is to be displayed. The display timing control signals of the first video and / or the second video are adjusted by the control file.

The above file is installed in the decoder, but may be installed in the encoder.

A first video processing file for encoding first video information for superimposing a first video on a main video on a screen and a second video are superimposed on the main video and displayed. A second video processing file for encoding the second video information, and control data included in the first and second video information on the screen by using the control data included in the first and second video information. A control file for detecting a display position and correcting at least the display timing control information of one of the images so that the display position is displaced between the first and second images.

The data for obtaining the first video is sub-picture data to be recorded on a video disc, and the data for obtaining the second video is closed caption data to be recorded on the video disc.

[0209] The control file for modifying the display timing control information modifies the display control data accompanying the sub-picture data. Alternatively, the display control data accompanying the closed caption data is corrected.

[0210]

As described above, according to the present invention,
One or both of the display positions of the display image based on the sub-picture data and the display image based on the closed caption data can be arbitrarily changed.

[Brief description of the drawings]

FIG. 1 is a diagram showing an embodiment of the present invention.

FIG. 2 is a flowchart shown to explain the operation of the apparatus of FIG. 1;

FIG. 3 is a view showing an example of a display screen shown for explaining the operation of the apparatus shown in FIG. 1;

FIG. 4 is a diagram showing another embodiment of the present invention.

FIG. 5 is a flowchart illustrating the operation of the apparatus of FIG. 4;

FIG. 6 is a view showing a continuation of the flowchart in FIG. 5;

FIG. 7 is a diagram showing still another embodiment of the present invention.

FIG. 8 is a flowchart for explaining the operation of the apparatus of FIG. 7;

FIG. 9 is a diagram showing still another embodiment of the present invention.

FIG. 10 is a flowchart illustrating the operation of the apparatus of FIG. 9;

FIG. 11 is a diagram showing a transmission format of closed caption data.

FIG. 12 is a diagram showing a decoder for closed caption data.

FIG. 13 is an explanatory diagram showing a display screen area of closed caption data.

FIG. 14 is a diagram showing a transmission data example of closed caption data and a display example thereof.

FIG. 15 is a diagram showing an example of a preamble address code of a closed caption system.

FIG. 16 is a closed caption type MID-RO.
The figure which shows a W code.

FIG. 17 is a diagram showing a control code of a closed caption system.

FIG. 18 is a diagram showing a closed caption type character code.

FIG. 19 is a diagram showing a character code of a closed caption method.

FIG. 20: Line 21 on a digital video disc
FIG. 4 is an explanatory diagram of a data recording format.

FIG. 21 is an explanatory diagram of a recording format of line 21 data on the digital video disk.

FIG. 22 is an explanatory diagram of a volume space which is a logical format recorded on an optical disc.

FIG. 23 is an explanatory diagram showing the structure of a video manager (VMG) and a video title set (VTS) in the volume space.

FIG. 24 is the video object set (VOBS)
Between a cell and a cell, and furthermore, a cell
FIG.

FIG. 25 is an explanatory diagram showing the relationship between video objects and cells.

FIG. 26 is an explanatory diagram showing an example in which the reproduction order of cells is controlled by a program chain (PGC).

FIG. 27 is an explanatory diagram of a video title set information (VTSI) in a video title set (VTS).

FIG. 28 is a diagram showing a configuration example of one pack and a packet.

FIG. 29: Navigation pack (NV FIG.

FIG. 30 is an explanatory diagram of general information of picture control information (PCI).

FIG. 31 is an explanatory diagram of general information of data search information (DCI).

FIG. 32 is an explanatory diagram of seamless reproduction information.

FIG. 33 is an explanatory diagram of seamless angle information.

FIG. 34 is an explanatory diagram of address information showing the data search information in more detail;

FIG. 35 is an explanatory diagram of synchronization information.

FIG. 36 is an explanatory diagram of a video object unit.

FIG. 37 is an explanatory diagram of an audio stream.

FIG. 38 is an explanatory diagram of a sub-picture unit.

FIG. 39 is an explanatory diagram of a sub-picture unit.

FIG. 40 is an explanatory view of the same sub-picture unit.

FIG. 41 is an explanatory diagram showing a continuous configuration of sub-picture units.

FIG. 42 is an explanatory diagram showing display timing of a sub-picture unit.

FIG. 43 is an explanatory diagram showing a header configuration of a sub-picture unit.

FIG. 44 is an explanatory diagram of a sub-picture display control sequence table.

FIG. 45 is an explanatory diagram of a sub-picture display control sequence table.

FIG. 46 is an explanatory diagram of a sub-picture display control command.

FIG. 47 is an explanatory view of a sub-picture display control command.

FIG. 48 is an explanatory diagram of the contents of a sub-picture display control command.

FIG. 49 is an explanatory diagram of a run-length compression rule.

FIG. 50 is an explanatory diagram showing an example of run-length compressed data.

[Explanation of symbols]

100: optical disk, 200: disk drive section, 3
00: data processor section, 400: video decoder section, 500: sub-picture decoder section, 600: audio decoder section, 700: D / A conversion and data reproduction section, 80
0: Main microprocessor, 900: Operation input unit,
1001 Closed caption decoder.

Continuing from the front page (72) Inventor Shinichi Kikuchi 3-3-9, Shimbashi, Minato-ku, Tokyo Inside Toshiba AV EE Co., Ltd.

Claims (17)

[Claims] 1. A first video processing means for processing first video information for displaying a first video on a main video on a screen, and displaying a second video on the main video. Second video processing means for processing the second video information in order to perform the processing, and control data included in the first and second video information on the screen of the first and second video. Means for detecting a display position and controlling a display timing of at least one of the first and second images so that the display position has a shifted relationship between the first and second images. Video signal processing device with display position control function. 2. The apparatus according to claim 1, wherein the means for controlling the display timing of the at least one image is means for controlling the display area of the first and second images to be shifted on the screen. 2. The video signal processing device with a display position control function for a plurality of videos according to 1. 3. The means for controlling the display timing of the at least one image is a means for controlling the display time of the first and second images to be shifted on the screen. 2. The video signal processing device with a display position control function for a plurality of videos according to 1. 4. A means for controlling the display timing of the at least one image, wherein the second image of the first and second images has a fixed display value and the second image is shifted when the first image is shifted. If the fixed display position of the image is below the horizontal center line of the screen, the first image is shifted toward the top of the screen,
2. The plural images according to claim 1, wherein when the fixed display position of the second image is above a horizontal center line of the screen, the first image is shifted in a downward direction of the screen. Video signal processing device with video display position control function. 5. The display position of a plurality of images according to claim 1, wherein the means for controlling the display timing of the at least one image further comprises an external input means for adjusting the shift amount from outside. Video signal processing device with control function. 6. The first image is a sub-image reproduced from a video disk, the second image is an image based on closed caption data, and the first image processing means decodes the sub-image. The sub-video decoder according to claim 1, wherein the means for controlling the display timing obtains the shifted relationship by correcting display timing information of the first video processed by the sub-video decoder. 2. The video signal processing device with a display position control function for a plurality of videos according to 1. 7. The first image is a sub-image reproduced from a video disc, the second image is an image based on closed caption data, and the first image processing means decodes the sub-image. 2. The plurality of second video processing units according to claim 1, wherein the second video processing unit extracts data from a decoder that decodes the main video signal to generate the closed caption data. 3. Video signal processing device with video display position control function. 8. The first video is a sub video reproduced from a video disc, the second video is a video based on closed caption data, and the first video processing means decodes the sub video. The second video processing means is a closed caption decoder that receives and decodes the closed caption data extracted from a decoder that decodes the main video signal. Video signal processing device with display position control function for multiple images. 9. The plurality of display timing control means according to claim 8, wherein said display timing control means includes a selection means for determining which of said first and second images is to be displayed. Video signal processing device with video display position control function. 10. The first image and / or the second image may be obtained by adjusting display timing control signals handled by the first image processing unit and the second image processing unit, respectively. The video signal processing device with a display position control function according to claim 9. 11. A first video processing means for encoding first video information for superimposing and displaying a first video on a main video on a screen, and superimposing a second video on the main video. Second video processing means for encoding the second video information for display, and the screen of the first and second video using control data included in the first and second video information Means for detecting the upper display position and correcting the display timing control information of at least one of the first and second images so that the display position is displaced between the first and second images. A video signal processing device with a display position control function for a plurality of videos. 12. The data for obtaining the first video is sub-video data to be recorded on a video disk, and the data for obtaining the second video is closed caption data to be recorded on the video disk. The video signal processing device with a display position control function for a plurality of videos according to claim 11. 13. The video signal processing with a display position control function for a plurality of videos according to claim 12, wherein the means for modifying the display timing control information modifies display control data accompanying the sub-video data. apparatus. 14. The apparatus according to claim 1, wherein the means for modifying the display timing control information modifies display control data accompanying the closed caption data.
2. A video signal processing device with a display position control function for a plurality of videos according to 2. 15. A first video processing means for processing sub video information to display a sub video as a first video on a main video on a screen, and wherein the main video is a second video. Second video processing means for superimposing character information as a coded composite signal during blanking of field 1 and line 21 of the standard NTSC video signal to display the closed caption in a superimposed manner; Using the control data included in the information, the display positions of the first and second images on the screen are detected, and the display positions are shifted between the first and second images. A video processing device with a display position control function for a plurality of videos, comprising: means for controlling display timing of at least one of the videos. 16. A sub-picture display area detecting unit for detecting a display area coordinate of a sub-picture as a first picture, and detecting a display position (the number of lines and the number of columns) of closed caption data as a second picture. A closed caption data display position detection unit, a display coordinate conversion unit that converts the detection information of the closed caption data display position detection unit into display area coordinate data, and a sub-picture display area detection unit and the display coordinate conversion unit. A display area overlap detection unit that notifies that the display of the sub-picture and the closed caption are overlapped based on the obtained information, and a display area coordinate of the sub-picture is moved based on a detection output of the display area overlap detection unit. A video signal processing apparatus with a display position control function for a plurality of videos, comprising: 17. A sub-picture display area detecting section for detecting a display area coordinate of a sub-picture as a first picture, and detecting a display position (the number of lines and the number of columns) of closed caption data as a second picture. A closed caption data display position detection unit, a display coordinate conversion unit that converts the detection information of the closed caption data display position detection unit into display area coordinate data, and a sub-picture display area detection unit and the display coordinate conversion unit. Based on the received information, a display area overlap detection unit that notifies that the display of the sub-picture and the closed caption are overlapped, and the display position information of the closed caption is changed based on the detection output of the display area overlap detection unit. A closed caption display position moving unit for receiving and decoding the closed caption data. Multiple image display position control function video signal processing apparatus characterized by comprising a chromatography Zudo caption decoder.