JP2001238172A - Image structure editing device, structure element reconfiguration device and computer readable recording medium with program for executing computer recorded thereon as each means of those device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an image stream so as to grasp its structure at a glance by using the structure information defining the hierarchical structure of the image stream and also to reedit the structure of the structuralized image stream with an intuitive and easy-to-understand operation. SOLUTION: This device includes a structure editing picture 401 which displays the hierarchical structure of an image stream and the range of packages and segments in accordance with the structure information defining the hierarchical structure of the image stream and also can select displayed packages and segments, a segment range editing screen 402 which displays the segment range selected on the picture 401 in a reduced image of a pair of start and end frames, a representative frame editing screen 403 which displays a frame representing the segments and a representative range editing screen 404 which displays the range of the frame representing the selected segment out of the frame range to which the segment belongs as a representative range.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video structure editing apparatus for structuring a video stream composed of a video including video or audio to create structural information, editing the structural information, and a structural element re-editing apparatus. The present invention relates to a computer-readable recording medium on which a program for executing a computer is recorded as a component device and each means of the device, and more particularly, to a video structure for editing a video stream structure itself and describing contents in a structural element. The present invention relates to an editing apparatus, a structuring element reconstructing apparatus capable of selecting a structuring element from one or a plurality of video streams and performing a logically combinable reconstruction, and a recording medium. These techniques for editing the video structure, describing the contents, and reconstructing the structural elements are applied to technical fields such as video management, browsing of video search results, and digest creation.

[0002]

2. Description of the Related Art In recent years, even in a video stream including only video or a video stream including video and audio, structure information is created by structuring the video stream, and video management, editing, and utilization are performed using the structure information. Various methods have been developed for this.

As an example of structuring a video stream, for example, a range of an arbitrary frame in the video stream is defined as a segment, and the same range as the range defined by one segment is defined by a set of a plurality of other segments. A method of creating a hierarchical structure of a video stream by defining a set of a plurality of segments as a package when it can be expressed has been proposed.

As a display example of a video in a conventional video editing apparatus, a method of arranging video clips in chronological order and displaying the video by an image icon is often used. Such a video editing apparatus displays the video itself. There is no apparatus for editing a video stream using a structural element of a structured video stream or for reconstructing the structure itself.

In other words, in video editing software or a non-linear video editor, in the process of arranging and superimposing and editing each video clip, if the scale is the finest, continuous frames may be displayed in a line. However, this is merely intended to overlap each video material, and no easy-to-use support tool for structuring a video stream or reediting the structure of the structured video stream has been provided.

[0006]

Therefore, the present applicant has
A range of an arbitrary frame in a video stream is defined as a segment, and a set of a plurality of segments is defined as a package when the same range defined by one segment can be represented by a set of other segments. Accordingly, a video structure editing apparatus that edits the structure of a video stream using structure information that defines the hierarchical structure of the video stream is proposed.

In addition, the segmented state and length (range of frames) of the segments of the structured video stream are displayed in a visually comprehensible manner, and the structural elements such as segments and packages constituting the structure information of the video stream are displayed. We propose a video structure editing device that can be easily created.

[0008] Conventionally, for the structural elements of a plurality of structured video streams, browsing of search results, creation of digests, etc., are collectively reproduced from a certain viewpoint in a continuous manner, or stored in a file. Or to create a new video stream, but since such work and processing is not a video editing process but a cross-sectional collection (or search) of video stream structural elements, It cannot be realized by a conventional video editing device.

SUMMARY OF THE INVENTION The present invention has been made in view of the above, and provides a display so that the structure of a video stream can be grasped at a glance using structure information defining a hierarchical structure of the video stream. It is an object of the present invention to provide a video structure editing device capable of reediting the structure of a structured video stream by an easy operation.

Further, the present invention has been made in view of the above, and selects a structural element from one or a plurality of video streams, logically edits the selected structural element, and
It is an object of the present invention to provide a structural element reconstructing device capable of reconstructing as one video stream.

[0011]

In order to achieve the above object, a video structure editing apparatus according to claim 1 defines an arbitrary frame range in a video stream as a segment, and defines the range as one segment. In the case where the same range can be represented by a set of other segments, the set of the plurality of segments is defined as a package, and the structure information defining the hierarchical structure of the video stream is used for the video. What is claimed is: 1. A video structure editing apparatus for editing a structure of a stream, comprising: displaying a hierarchical structure of the video stream, a range of packages and segments based on the structure information, and selecting the displayed packages and segments. Display means, and a range of segments selected by the structure display means are displayed as a pair of start frames. And a segment range display means for displaying a reduced image of the end frame, a representative frame display means for displaying a representative frame representative of the segment selected by the structure configuration display means, and a selection by the structure configuration display means. Representative range display means for displaying a range of frames representing the segment from a frame range belonging to the segment as a representative range.

According to a second aspect of the present invention, in the video structure editing apparatus according to the first aspect, the structure configuration display unit, the segment range display unit, the representative frame display unit, and the representative range display unit include: Each is configured as an edit screen on which information can be displayed and a command can be input, and is displayed as one window screen in which the edit screens are combined for each individual video stream.

According to a third aspect of the present invention, in the video structure editing apparatus according to the second aspect, each of the editing screens of the window screen includes a displayed segment, package, representative frame, or representative range. Is selected, the display state of the selected segment, package, representative frame, or representative range is changed and displayed, and one or more segments or packages are selected and editing operations such as moving and deleting are performed. , And displays the result.

According to a fourth aspect of the present invention, in the video structure editing apparatus according to the third aspect, the editing operation includes dividing the selected segment, changing the range of the selected segment, and selecting the selected segment. This includes changing the hierarchy in the hierarchical structure of the segments and merging a plurality of selected segments to generate one new segment.

According to a fifth aspect of the present invention, in the video structure editing apparatus according to any one of the first to third aspects, when a package is selected by the structure configuration display means, the segment is displayed. Range display means for displaying the reduced image in association with all segments included in the selected package, and the representative frame display means,
The representative frame is displayed in association with all segments included in the selected package, and the representative range display means displays the representative range in association with all segments included in the selected package. is there.

According to a sixth aspect of the present invention, in the video structure editing apparatus according to any one of the second to fifth aspects, the segment range display means, the representative frame display means, and the representative range display means are provided. Can be specified to be displayed or hidden in the window screen, and when at least one of these editing screens is specified to be hidden, the specified editing screen is displayed on the window screen. And the edit screen corresponding to the structure configuration display means is expanded by the area of the hidden edit screen, and another edit screen is moved to fill the hidden edit screen area. Is what you do.

According to a seventh aspect of the present invention, in the video structure editing apparatus according to any one of the second to sixth aspects, the segment range display means, the representative frame display means, and the representative range display means are provided. Can be removed from the window screen and displayed as another window screen.

The video structure editing device according to claim 8 is the video structure editing device according to any one of claims 1 to 7, wherein the structure configuration display means is arranged to start or end a range of the segment. In the part, a reduced image of the start frame or end frame of the corresponding segment is displayed in a scaled manner in accordance with the vertical display size for displaying the range of the segment, or the horizontal display size of the range of the corresponding segment is displayed. In this case, the image is scaled according to the display.

According to a ninth aspect of the present invention, in the video structure editing apparatus according to the eighth aspect, the structure configuration display means includes a variable magnification when displaying the reduced image in a variable size. Is smaller than the preset ratio, the reduced image is omitted.

According to a tenth aspect of the present invention, in the video structure editing apparatus according to the eighth or ninth aspect, the structure configuration display means may designate display and non-display of the reduced image. What is possible.

According to an eleventh aspect of the present invention, there is provided the video structure editing apparatus according to any one of the first to tenth aspects, wherein the structure configuration display means is configured to display a representative frame corresponding to each segment. The position information indicating the position is displayed at a corresponding position in the range of the segment, and when the displayed position information is selected, the display state of the selected position information is changed, and the representative frame display unit includes the structural configuration. A predetermined number of representative frames of the segments displayed on the display means are arranged in a line and displayed, and when the total number of the segments is equal to or more than a predetermined number, a scroll bar is displayed to change a range of the representative frames to be displayed. When an arbitrary representative frame is selected from the displayed representative frames, the display state of the selected representative frame is changed, and The position information of the configuration display means and the representative frame of the representative frame display means are linked with the corresponding position information and the display state of the representative frame, and when one is selected, the display state of the other is also changed. .

According to a twelfth aspect of the present invention, there is provided the video structure editing apparatus according to any one of the first to tenth aspects, wherein the structure configuration display means includes a position of a representative range belonging to each segment. Is displayed at a corresponding position of the range of the segment, and when the displayed range information is selected, the display state of the selected range information is changed, and the representative range display means sets the representative range as a pair. When the total number of the pair of reduced images is equal to or more than a predetermined number, the range of the pair of reduced images to be displayed by displaying a scroll bar can be changed. When an arbitrary pair of reduced images is selected from the displayed pair of reduced images, the display state of the selected pair of reduced images is changed. A pair of reduced images of broadcast and representative frame display means is a display state links corresponding range information and the pair of the reduced image, in which if one is selected also the other display state is changed.

According to a thirteenth aspect of the present invention, there is provided the video structure editing apparatus according to any one of the first to twelfth aspects, wherein the structure configuration display means includes a position of a representative range belonging to each segment. Is displayed as a rectangle or oblong at the corresponding position in the range of the segment,
If the display of a plurality of range information overlaps, the display is shifted by the display of the rectangle or the ellipse below the display of the rectangle or the ellipse of the immediately preceding range information.

According to a fourteenth aspect of the present invention, there is provided the video structure editing apparatus according to any one of the first to thirteenth aspects, further comprising an attribute for selecting an attribute of the representative frame or the representative range. When the attribute is selected by the attribute selection means, the representative frame display means or the representative range display means displays only a representative frame or a representative range having the selected attribute.

According to a fifteenth aspect of the present invention, in the video structure editing apparatus according to any one of the first to fourteenth aspects, the structure configuration display means designates reproduction of a selected segment. A playback designation unit, a segment video playback unit that plays back a frame in a range defined by the segment specified by the playback designation unit, and playback and stop of a segment being played back by the segment video playback unit.
Video playback operation means for performing operations such as rewind, fast forward, pause, and skip to a designated frame.

According to a sixteenth aspect of the present invention, in the video structure editing apparatus according to any one of the first to fifteenth aspects, a desired frame is reproduced by the segment video reproducing means. A continuous frame display unit for displaying a predetermined number of continuous frames including the specified frame in a line, and displaying the continuous frame displayed by the continuous frame display unit. When an arbitrary frame is dragged and dropped from the frames, the corresponding frame is generated and displayed as a representative frame of the segment being reproduced by the segment video reproducing means.

[0027] According to a seventeenth aspect of the present invention, in the video structure editing apparatus according to the sixteenth aspect, the representative range display means selects one of the continuous frames displayed by the continuous frame display means. When two frames are selected, dragged and dropped, a new representative range of the selected segment is generated and displayed with the first frame of the two frames as the start frame and the other as the end frame. .

The video structure editing apparatus according to claim 18 is the video structure editing apparatus according to any one of claims 1 to 17, further comprising: the structure configuration display means, the segment range display means, and the representative frame. Enter a description of the contents of the segment, package, representative frame or representative range selected on the display means or representative range display means,
The content description display means is provided for editing and displaying, and the content description display means includes "who (Who), what time (When), where (Where), and what (What) ), Why (Why),
It is possible to input and change 5W1H information corresponding to "How (how)" and free description information as arbitrary information, and by registering the 5W1H information, it is displayed as a candidate from the next time, and from the next time. It is possible to select without inputting.

A video structure editing apparatus according to a nineteenth aspect of the present invention is the video structure editing apparatus according to the eighteenth aspect, wherein the structure configuration display means displays the 5W1H information and the free description information of a segment below a certain package in a table format. And a list display means for displaying and editing the list.

A recording medium according to a twentieth aspect stores a program to be executed by a computer as each unit of the video structure editing apparatus according to any one of the first to nineteenth aspects. As a result, the program can be machine-readable, and the operations of claims 1 to 19 can be realized by a computer.

According to a twelfth aspect of the present invention, there is provided a structuring element reconstructing apparatus for converting one or a plurality of video streams displayed using the video structure editing apparatus according to any one of the first to nineteenth aspects. , A plurality of packages or segments are selected, the display order of the structural elements composed of the selected packages or segments is reconfigured, and a video stream obtained by reproducing the display order is generated as a new video stream. Reconstruction display means for sequentially displaying and editing the structural elements in a rectangle corresponding to the length of the range of the frame of the structural element, and switching and display of measurement units such as the number of frames or time as necessary Scale display means.

The structural element reconstructing apparatus according to claim 22 is the structural element reconstructing apparatus according to claim 21, further comprising: a mouse for selecting and operating the structural element. Operating means, wherein the reconstructed display means arranges the respective structural elements in a row in a horizontal order and displays them in a rectangle, and uses the mouse operating means to newly display one or more of the displayed video streams. When selecting and dragging a desired structural element and dropping it at a desired position, the new structural element is incorporated and rearranged between the structural elements before and after it, and when selecting and deleting any structural element, The structural elements before and after the arbitrary structural element are combined and rearranged.

According to a twelfth aspect of the present invention, in the structuring element reconstructing apparatus according to the twenty-second aspect, the reconstructing display means includes a column of the structuring elements displayed side by side. When dragging any structural element using the mouse operating means and dropping it at a desired position,
It moves the structural element to the specified position and rearranges it.

According to a twenty-fourth aspect of the present invention, there is provided a structural element reconstructing apparatus according to any one of the twenty-first to twenty-third aspects, wherein the reconstructing display means displays each of the structural elements. It is displayed in a unified color for each original video stream to which it belongs, and among the structural elements, packages represent a set of segments and are displayed as shaded rectangles for each package, allowing only operations in package units Is what you do.

According to a twenty-fifth aspect of the present invention, in the structural element reconstructing apparatus according to the twenty-fourth aspect, the reconstructing display means cancels the operation of the package unit to construct a package. A set of segments to be operated can be operated on a segment basis.

According to a twenty-sixth aspect of the present invention, there is provided a structural element reconstructing apparatus according to any one of the twenty-first to twenty-fifth aspects, wherein the reconstructing display means is provided via the mouse operating means. When the mouse pointer is moved to a structural element, detailed information such as the original video stream to which the corresponding structural element belongs and the range of the frame is displayed.

According to a twenty-seventh aspect of the present invention, in the structuring element reconstructing apparatus according to any one of the twenty-first to twenty-sixth aspects, the reconstructing display means and the scale displaying means each include information. Is configured as an editing screen capable of displaying and inputting commands, and is displayed as a single window screen. The size of the editing screen can be freely adjusted by scaling the window screen vertically or horizontally. It can be changed.

According to a twenty-eighth aspect of the present invention, in the structuring element reconstructing apparatus according to any one of the twenty-first to twenty-seventh aspects, the reconstructing display means includes: In the end portion, a reduced image of the start frame or end frame of the corresponding segment is displayed in a scaled manner in accordance with the vertical display size for displaying the range of the segment, or is displayed horizontally in the range of the corresponding segment. It is displayed in a scaled manner according to the size.

According to a twelfth aspect of the present invention, in the structuring element reconstructing apparatus according to the twenty-eighth aspect, the reconstructing display means displays the reduced image at a variable magnification. When the magnification is smaller than a preset ratio, the reduced image is omitted.

According to a thirtieth aspect of the present invention, there is provided a structural element reconstructing apparatus according to any one of the twenty-first to twenty-ninth aspects, wherein the reconstructing display means displays the reconstructed structural element. It can be reproduced as one video stream.

According to a thirty-first aspect of the present invention, in the structural element reconstructing apparatus according to any one of the twenty-first to twenty-third aspects, the reconstructing display means selects a structural element. Thus, the range of the corresponding frame can be reproduced.

According to a thirty-second aspect of the present invention, in the structuring element reconstructing apparatus according to any one of the twenty-first to thirty-first aspects, the reconstructing display means displays the reconstructed structuring element. It can be stored on a recording medium as one video stream.

According to a thirty-third aspect of the present invention, in the structuring element reconstructing apparatus according to the thirty-second aspect, the reconstructing display means records the reconstructed structuring element as one video stream. When saving to media,
It is expressed and stored in a general-purpose language representing a browsing method such as SMIL.

A recording medium according to a thirty-fourth aspect of the present invention is characterized by recording a program to be executed by a computer as each means of the structural element reconstructing device according to any one of the twenty-first to twenty-third aspects. I do. by this,
22. The program can be read by a machine, and
33 can be realized by a computer.

[0045]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of a video structure editing apparatus and a structural element reconstructing apparatus according to the present invention will be described below in detail in the order of Embodiment 1 and Embodiment 2 with reference to the accompanying drawings. I do.

Embodiment 1 First, regarding the video structure editing apparatus according to the first embodiment, [Schematic Configuration of Video Structure Editing Apparatus], [Configuration of Structure Information], [Example of Displaying Structure Information by Structure Display Software], [Specific Functions of Structure Editing Software] Detailed description] will be described in detail with reference to the accompanying drawings.

[Schematic Configuration of Video Structure Editing Apparatus] FIG.
FIG. 1 is a schematic configuration diagram illustrating an example of a video structure editing device 100 according to a first embodiment. The video structure editing apparatus 100 receives the video stream from the storage unit 103 storing the video stream and / or the structure information obtained by structuring the video stream, analyzes the structure of the video stream, and, based on the analysis result, analyzes the video stream. Display screen 1 of stream structure
02 that performs a process of visually displaying the image on the computer 02
It consists of.

Here, a hard disk built in the computer 101 may be used as the storage means 103, but here, a video information library, a floppy disk, a CD, -It is assumed that a recording medium such as a ROM, an MO, and a DVD is used. The storage unit 103 may store either the video stream or the structure information, or may store both the video stream and the structure information.
It is sufficient that the target video stream and the structure information can be read and placed in the computer 101 before the structure editing is performed at 0.

FIG. 2 shows the computer 101 shown in FIG.
FIG. 2 is a block diagram of the configuration. The computer 101 includes a CPU 201 that executes processing based on software described later.
ROM 202 storing a boot program and the like;
RAM 20 used as work area of PU 201
3 and a keyboard 204 for performing various input operations
And a mouse 205 and a display device 206 such as a CRT or a liquid crystal display having the display screen 102 for displaying the process of analyzing the video stream and the structure of the video stream.
And the structure analysis software 207 and the structure edit software 20 for realizing the functions of the video structure edit device according to the first embodiment.
8. a hard disk 210 storing various application programs and data such as structure display software 209;
An interface unit 211 such as various drivers and a network adapter for connecting the storage unit 103 and the computer 101 shown in FIG.
2 at least.

The configuration of the video structure editing apparatus 100 shown in FIGS. 1 and 2 is merely an example, and if the functions of the first embodiment described later can be realized, Any system configuration may be used.
Further, as a basic technique of a structure display method of analyzing a video stream to generate structure information and displaying the structure on a display screen, Japanese Patent Application No. 10-24959 by the present applicant discloses a structure display method.
The technology proposed in No. 8 can be applied. Further, the method of structuring the video stream is not particularly limited, but at least an arbitrary range in the video stream is defined as a segment, and the same range as the range defined by a certain segment is defined by a plurality of other segments. When the set can be represented by a set of segments, a set of a plurality of segments is defined as a package, and by defining the plurality of segments as partial segments of the certain segment, the entire video stream is structured. set to target.

[Structure of Structural Information] Next, an example of the structure of structural information used in the video structure editing apparatus according to the first embodiment will be described with reference to FIG. In the first embodiment, the entrance of the structure of one entire video stream is defined as a root R, and an arbitrary range in the video stream is defined as a segment S as a structural element representing a structure hierarchically below the root R. If the same range as the range defined by a certain segment S can be represented by a set of other segments S, the set of these segments S is defined as a package P.

That is, in the example of the structure shown in FIG. 3, a package P (refer to a symbol A) representing the entire video and one segment S constituting the package P exist in the first hierarchy immediately below the root R. . Also, on the second level,
Package P (see reference symbol B) and six segments S forming the package P, and package P (see reference symbol C) and three segments S forming the package P
And a package P (see reference symbol D) and two segments S constituting the package P. Also, the third
In the hierarchy, a package P (see reference numeral E), three segments S constituting the package P, and a package P
(See symbol F), two segments S that make up the package P, package P (see code G), one segment S that makes up the package P, package P (see code H), and the package P. There are two segments S that make up, a package P (see symbol I), and five segments S that make up the package P. The package P (see reference numeral J) is located on the fourth level.
And two segments S constituting the package P.

In the example of the structure shown in FIG.
Although there are a hierarchy to a fourth hierarchy, the depth of this hierarchy and the number of packages P in each hierarchy are not particularly limited.
It is set as needed. Further, in the first embodiment, when the same range as the range defined by the segment of the higher hierarchy can be expressed by a set of a plurality of lower segments, the plurality of segments are defined as partial segments with respect to the segment of the higher hierarchy. Define.

Next, the criteria for generating the package P will be described with reference to an example. For example, when the video stream having the structure shown in FIG. 3 is a video stream in which a movie is recorded, of the three packages P on the second layer, the first package P (see reference numeral B) is:
The video is divided according to the characteristics of the still image, the second package P (see reference numeral C) is divided according to the characters, and the third package P (see reference numeral D) is divided according to time. is there. In this example, a partial segment (a segment at a level immediately below the parent segment) is generated by dividing a parent segment (a segment at a higher hierarchy), so the range of the partial segment constituting one package is If the ranges of the partial segments are collected without overlapping each other, they become the ranges of the parent segment.

As described above, the structure of the video stream may be extracted or read from the structure information generated in advance, or the video stream may be read and structured directly on the spot to generate the structure information. .

[Display Example of Structure Information by Structure Display Software] FIG. 4 is an explanatory diagram showing a display example of the structure edit screen 401 by the structure display software 209 of the first embodiment. The structure display software 209 corresponds to the structure display unit of the present invention, and displays the hierarchical structure of the video stream based on the structure information as described below. However, here, for simplicity of description, a video stream capable of displaying all structural information in one screen size of the display screen 102 is shown as an example, and further, only a basic function of the structural display software 209 is displayed. An edit screen 401 is shown.

As shown in FIG. 4, the structure edit screen 401 includes a structure display unit 401A that displays structure information 301 in which each package is a node 301a and that represents structure information in a tree-like parent-child relationship, and a range of each package. Package identification display 302a and package identification display 302
In order to display the configuration information 302 including the segment identification display 302b indicating the range of each segment serving as a component of a in accordance with the display line of the corresponding node, and to recognize the range of each segment in association with the numerical scale And a configuration display unit 401B for displaying the scale 303. Reference numeral 304 denotes a row display unit for making it easier to visually recognize the corresponding display rows of the structure display unit 401A and the configuration display unit 401B, and 305 denotes a playback designation unit for designating the playback of the selected segment. Shows a play button icon.

The operation of the above configuration will be described with reference to the display example of the display screen 102 in the first embodiment shown in FIGS. First, when the structure of the video stream as shown in FIG. 3 is displayed on the display screen 102, it becomes as shown in FIG. Here, the structure display unit 401
A: Structure information 301 and configuration display unit 401 displayed on A
The configuration information 302 displayed in B is displayed based on the following rules (conditions). Here, in order to distinguish each node 301a for easy understanding, the symbols A to J shown in FIG. 3 are described in the display of □ (or dotted □) indicating the node. For the same reason, the package identification 302a and the segment identification 302b are
Described as A, SA, etc.

In the rule tree-like parent-child relationship, nodes belonging to the same hierarchy are displayed in the same display row or display column, and are connected by straight lines. This rule can be paraphrased as follows. That is, in the arrangement of the tree-like parent-child relationship in the structure information 301, when an arbitrary package is set as a parent package, the same range as the range of a segment, which is one of the components of the parent package, is assigned to other segments. When a plurality of child packages represented by a set are defined, the plurality of child packages are defined as sibling packages, a plurality of nodes indicating the sibling packages are arranged in a vertical direction, and these nodes are arranged. Is displayed by connecting with a line. Also, in a tree-like parent-child relationship, when an arbitrary package is set as a parent package, the same range as the range of any one of the plurality of segments which are constituent elements of the parent package is set to a set of other plurality of segments. When a plurality of child packages represented by are defined and the ranges of the plurality of child packages do not overlap, a plurality of nodes indicating the plurality of child packages are arranged side by side in a horizontal direction, and These nodes are displayed by connecting them with lines.

Therefore, in FIG. 5, the nodes B, C and D are displayed in the same display column and are connected by a straight line, so that they have the same hierarchy and these nodes B, C and D The package corresponding to is a sibling package. The nodes G, H, and I are displayed on the same display line and are connected by a straight line, and therefore have the same hierarchy. However, the packages corresponding to these nodes G, H, and I are siblings. Not a package.

In the tree-like parent-child relationship, a node of a package representing the entire video stream is defined as a top-level package, and the corresponding node is defined as structure information 301 (structure display unit 4).
01A). Therefore, the node A indicating the package P representing the entire video is arranged at the upper left of the structure information 301.

In a tree-like parent-child relationship, when an arbitrary package is set as a parent package, the same range as the range of a segment, which is one of the components of the parent package, is represented by a set of other plural segments. When a child package is defined, the node indicating the child package is arranged at the lower right of the node indicating the parent package, and these nodes are connected by a broken line and displayed. For example, if node E is a parent package, its child package, node J,
In the display of the structure display section 401A, it is arranged at the lower right of the node E, and is connected to the node E by a broken line.

In a rule tree-like parent-child relationship, if there is a child package having a sibling package as a parent package, the node indicating the child package is arranged at the lower right of the node indicating the corresponding sibling package, and The sibling package located below the sibling package is arranged below the position of the child package arranged at the lower right.

Therefore, in FIG. 5, focusing on the nodes E, F and J, the packages of the nodes E and F are in a sibling package relationship, and the packages of the nodes E and J are Parent package and child package. Therefore, the node J is arranged at the lower right of the node E, and the node F is arranged on the line next to the line where the node J exists.

The rule configuration display unit 401B sets the horizontal direction of the screen as a time-series direction, and the line corresponding to each node specified by the row display unit 304 of the structure display unit 401A corresponds to the range of the corresponding package. A thin band-shaped package identification display 302a is displayed at a corresponding position in the time series with the length. In addition, for each segment constituting the package displayed by the package identification display 302a, a block-shaped segment identification display 302b having a length corresponding to the range of the segment and at a corresponding position in a time series is displayed. .

Therefore, in FIG. 5, for example, the package identification (PA) corresponding to node A is
It is displayed on the same line as the node A and in a thin strip shape showing the entire video stream. The segment identification display (reference code SA) corresponding to the node A is displayed in the same row as the node A and in a block shape having a length corresponding to the range of the segment (here, the entire video stream).

The package identification (PE) corresponding to the node E has the length of the package corresponding to the node E on the same line as the node E, and a thin band at the corresponding position in the time series. Is displayed. In addition, the segment identification display (symbols SE1 to SE3) corresponding to the node E is displayed in the same row as the node E, in the range of each segment, and at a corresponding position in time series in a block shape.

Image structure editing apparatus 100 of the first embodiment
By executing the rules 1 through 3 with the structure display software 209, the logical structure inside the structure information can be visualized and easily grasped, and the ratio of the range of each segment can be intuitively known. , Allowing easy comparison of the structure of multiple packages and segment configurations, and displaying intuitive and quantitative understanding of the range and arrangement of each package or segment in the overall structure information structure Can be.

The structure display software 20 according to the first embodiment
It is apparent that the application of No. 9 makes it easy to reflect and display an editing result such as addition, deletion, or range change of a segment by the structure editing software 208 described later. The structure edited using such a structure display method can be used as information for searching or browsing, and may be stored in the storage unit 103 again for use at a later date.

[Specific description of the function of the structure editing software]
Next, referring to the display screen of FIG.
The function of No. 8 will be described. In the first embodiment, the structure editing software 208 operates in conjunction with the structure display software 209 to play the role of a segment range display unit, a representative frame display unit, a representative range display unit, and an attribute selection unit of the present invention. Things.

Reference numeral 402 denotes a segment range edit screen,
Reference numeral 403 denotes a representative frame editing screen, 404 denotes a representative range editing screen, and 405 denotes an attribute selection screen. As shown in FIG.
It is displayed as one window screen.

On the structure edit screen 401, in addition to the display of the hierarchical structure of the video stream and the range of the package and the segment described above, the start frame (or end) of the corresponding segment is displayed at the beginning (or end) of the range of each segment. Or, the reduced image of the end frame is displayed in a scaled manner in accordance with the vertical display size for displaying the range of the segment as indicated by reference numeral 601 in the figure, or is displayed as indicated by reference numeral 602 in the figure. The image is scaled and displayed according to the horizontal display size of the range.

When the reduced image is displayed at a reduced scale when the reduced image is scaled and displayed, in other words, the reduced image is scaled (reduced). If it is difficult to identify the image when the image is displayed, the display of the reduced image is omitted. Further, on the structure edit screen 401, for example, it is possible to specify display or non-display of the reduced image of the start frame by using an icon or the like (not shown). When the display is selected, the display state of the structure edit screen 401 in FIG. When you select hide, Figure 4
Is displayed on the structure edit screen 401 shown in FIG.

Further, on the structure edit screen 401 shown in FIG.
A state in which two packages (a set of segments) of the package identification display indicated by 603 are selected,
The display state is different from that of the other package identification display 604 (for example, the display color is changed). FIG.
In the structure edit screen 401, since all segments cannot be displayed on one screen, a scroll bar is displayed below the structure edit screen 401 so that scrolling is possible as necessary. FIG. 6 shows an example in which a package is selected, but one or a plurality of segments may be selected. In this case, the display state of the selected segment is changed and displayed.

The segment range edit screen 402 corresponds to the segment range display means of the present invention. As shown in the figure, the range of each segment of the set of segments selected by the package identification display 603 is displayed as a pair of start frame and end frame. Are displayed as the reduced images 605 and 606. The segment range editing screen 402 can be removed from the window screen and displayed as another window screen. As a specific operation, for example, an icon for designating a window of the edit screen is registered in a toolbar or the like in advance, and after specifying the segment range edit screen 402, the corresponding icon is selected to easily realize the operation. can do. Further, by operating a scroll bar displayed on the lower side of the segment range editing screen 402, it is possible to scroll and display a segment range (a pair of reduced images) that cannot be displayed on one screen.

The representative frame edit screen 403 corresponds to the representative frame display means of the present invention, and as shown in the figure, the segment selected on the structure edit screen 401 (here, the two packages selected on the package identification display 603) Representative frame 6 representing all segments belonging to
07 is displayed. Note that a plurality of representative frames 607 can be set for one segment, and all the set representative frames are displayed as the representative frames 607. However, if there is a representative frame 607 that cannot be displayed on one screen, the representative frame editing screen 403
By operating the scroll bar displayed on the lower side, the representative frame 607 can be scrolled and displayed.

The representative range editing screen 404 displays a range of frames representing the selected segment from a range of frames belonging to the segment as a representative range. However, the representative range editing screen 404 in FIG.
This shows a state where the representative range is not displayed. The display state of the representative range is described in a structure edit screen 401 described later.
It will be described in detail in the link relationship with. Representative range edit screen 4
Also in 04, if the display cannot be performed on one screen, a scroll bar is displayed below the representative range editing screen 404, and the representative range can be scrolled and displayed by operating the scroll bar.

The attribute selection screen 405 plays a role of an attribute selecting means for selecting an attribute of a representative frame or a representative range. For example, during the operation of the representative frame editing screen 403, the “Spatial Key:
By operating the "key for designating a place / spatial attribute" and inputting or selecting an attribute related to a place, only the corresponding representative frame is displayed as the representative frame 607 on the representative frame editing screen 403.

When the displayed segment, package, representative frame or representative range is selected, each of the edit screens 401 to 404 is displayed by changing the display state of the selected segment, package, representative frame or representative range. When one or a plurality of segments or packages are further selected and an editing operation such as moving or deleting is performed, the result is reflected and displayed.

The editing operation includes dividing the selected segment, changing the range of the selected segment, changing the hierarchy of the selected segment in the hierarchical structure, and merging a plurality of selected segments into one new segment. Is generated. The specific technique of this editing operation can be easily realized by using a structure display method or the like which has already been filed by the present applicant.

Next, a display example in the case where the structure of two video streams is displayed simultaneously by the video structure editing apparatus 100 of the first embodiment will be described with reference to FIG. The window screens 701 and 702 are displayed as one window screen in which the editing screens (editing screens 401 to 405) are combined for each individual video stream. In this way, video editing of a plurality of video streams can be performed simultaneously. Thus, one window screen is prepared for one video stream, so that it is easy to operate and compare a plurality of video streams. Further, when using the structural element reconstructing apparatus according to the second embodiment described later, the work of reconstructing the structural elements can be facilitated.

Next, with reference to FIG. 8, a description will be given of a process of selecting display / non-display of each edit screen of the segment range edit screen 402, the representative frame edit screen 403, and the representative range edit screen 404. In the first embodiment, display and non-display can be designated for each of the edit screens 402 to 404 in the window screen. More specifically, for example, an icon for designating display / non-display of the edit screen is registered in a toolbar or the like in advance, and a desired edit screen is designated, and then the corresponding icon is selected, thereby easily realizing. be able to.

FIG. 8 shows a state where the segment range editing screen 402 and the representative range editing screen 404 are not displayed from the window screen of FIG. As shown in the drawing, when at least one of the edit screens 402 to 404 is designated as non-display, the designated edit screen (here, edit screen 402, edit screen 402,
404) is hidden in the window screen, the structure editing screen 401 is expanded by the area of the editing screen where it is hidden, and the area of the editing screen where other editing screens (here, the editing screen 403) are hidden. Move to fill.

On the window screen, a total of five types of display (edit screens 401 to 405) are performed, but depending on the purpose of editing the structure of the video stream, there may be necessary edit screens. In addition, various usage methods are conceivable, such as a case in which only a part to be emphasized is displayed with attention, and a case where the display speed of the window is emphasized and only the structure of the video stream is to be viewed. Therefore, five types of display (editing screens 401 to 405) are displayed, and an essential structure editing screen 401 is displayed.
Is always displayed, the display / non-display of the other parts can be selected, and the operability can be improved by instructing the non-display if necessary.

When the segment range editing screen 402 and the representative range editing screen 404 are removed from the window screen of FIG. 6 as separate window screens, the window screen is displayed in the same manner as in FIG.

FIG. 9 shows how the display size of the segment changes and the display of the start frame changes from the display state of the window screen of FIG. 8 due to the horizontal reduction of the structure editing screen 401. As shown, the start frame of the structure edit screen 401 is reduced only in the horizontal direction, or has changed from the display state to the non-display state.

FIG. 10 shows a change when the display of the start frame of the segment on the structure edit screen 401 is not displayed from the display state of the window screen of FIG. Here, with further reference to FIG.
The display state of the position information and the link relationship between the representative range editing screen 404 and the representative frame editing screen 403 will be described. The structure editing screen 401 displays the position information 1001 indicating the position of the representative frame corresponding to each segment at a corresponding position in the range of the segment, and when the displayed position information 1001 is selected, the selected position information 1001 is displayed.
The display state of A is changed to the selected state.

On the other hand, the representative frame editing screen 403 displays a representative number of representative frames 1002 of each segment of the selected package identification display 603 in a line.
The total number of segments is equal to or greater than a predetermined number (in FIG. 10, the predetermined number =
In the case of 9), the display range of the representative frame 1002 for displaying and displaying the scroll bar can be changed.
When an arbitrary representative frame 1002A is selected from the displayed representative frames 1002, the display state of the selected representative frame 1002A is changed to the selected state.

Further, the position information 1001 of the structure edit screen 401 and the representative frame 1002 of the representative frame edit screen 403 correspond to the corresponding position information 1001 respectively.
The display state of the representative frame 1002 is linked, and when one is selected, the display state of the other is also changed. For example, in FIG. 10, when the position information 1001A on the structure editing screen 401 is selected, the display state of the corresponding representative frame 1002A on the representative frame editing screen 403 also changes to the selected state. At this time, the structure edit screen 401
If the representative frame corresponding to the position information selected in the step is not displayed on the representative frame editing screen 403, the representative frame editing screen 403 automatically scrolls the screen so that the corresponding representative frame is displayed. .

Next, the display state of the representative range on the representative range edit screen 404 and the link relationship between the representative range edit screen 404 and the structure edit screen 401 will be described with reference to FIG. As shown, the representative range edit screen 404 includes a package identification display 1 selected on the structure edit screen 401.
From the frame range belonging to 101 (here, one segment), a plurality of frame ranges representing the segment are displayed as a representative range 1103. Note that the representative range editing screen 404 displays all the representative ranges corresponding to all the segments included in the selected package.

Here, as a method of displaying the representative range 1103, as shown in the figure, the representative range is displayed as a reduced image of a pair of start frame and end frame, and when the total number of the pair of reduced images is a predetermined number or more. Displays a scroll bar. By operating the scroll bar, the range of the pair of reduced images can be changed to display a representative range that is not displayed. An arbitrary pair of reduced images 110 out of the displayed pair of reduced images 1103 is displayed.
When 3A is selected, a selected pair of reduced images 1103 is selected.
The display state of A is changed to the selected state.

On the other hand, the structure editing screen 401 displays range information 1102 indicating the position of the representative range belonging to each segment.
When the displayed range information 1102 is selected at the corresponding position in the segment range and the displayed range information 1102 is selected, the selected range information 1 is displayed.
The display state of 102A is changed to the selected state. The range information 1102 indicating the position of the representative range is displayed as a rectangle or an ellipse at the position corresponding to the range of the segment, and when the display of a plurality of range information 1102 overlaps, the range information 1112 is displayed.
As indicated by 02A, the display is shifted below the rectangular or long elliptical display of the immediately preceding range information 1102 by the rectangular or long elliptical display.

Further, the range information 1102 of the structure edit screen 401 and the pair of reduced images 1103 of the representative range edit screen 404 are respectively linked to the corresponding range information and the display state of the pair of reduced images, and one of them is selected. Then, the other display state is also changed. For example, in FIG. 11, when the range information 1102A on the structure editing screen 401 is selected, the display state of the corresponding pair of reduced images (representative ranges) 1103A on the representative range editing screen 404 also changes to the selected state. At this time, if a pair of reduced images (representative ranges) corresponding to the range information selected on the structure editing screen 401 is not displayed on the representative range editing screen 404, the representative range editing screen 404 displays the corresponding pair of reduced images. The screen is automatically scrolled so that an image (representative range) is displayed.

Next, the operation when the segment is reproduced using the reproduction button icon 305 on the structure editing screen 401 will be described. For example, the structure edit screen 4 in FIG.
At 01, a playback segment 306 is selected as a segment to be played back (hereinafter referred to as a playback segment), and playback is designated by a playback button icon 305. First, on the display screen 102 of the display device 206, FIG.
A segment video playback window 1201 and a playback operation window 1202 as shown in (a) and (b) are displayed. The segment video playback window 1201 and the playback operation window 1202 include a structure editing screen 401
The segment selected in the above is used as a playback segment 306 to play back frames within the range defined by the playback segment 306, and corresponds to the segment video playback means of the present invention.

By operating various keys in the playback operation window 1202, the playback of the playback segment 306 is started, the playback speed of the playback segment being played back in the segment video playback window 401 is adjusted, rewinded, fast forwarded, paused, The end of the reproduction and the skip to the designated frame can be performed. In particular, "play / detect"
By pressing the key, the reproduction can be started if the reproduction is paused, and the desired frame can be designated as the target frame from the reproduction segment being reproduced if the reproduction is being performed.

The segment video playback window 12
01 and a playback operation window 1202, when a target frame is designated, the display screen
13, a continuous frame display window 1301 as shown in FIG. 13 is displayed. The continuous frame display window 1301 specifies a frame at a timing when a predetermined key (“play / detect” key) on the reproduction operation window 402 is operated, and specifies the specified frame 130.
A predetermined number of continuous frames centered at 1a are displayed in a line, and correspond to a continuous frame display means of the present invention. FIG. 13 shows an example in which nine continuous frames are displayed in a line as a predetermined number of continuous frames, but this number is not particularly limited, and the number can be appropriately changed by the operator as necessary. And Also,
An identification bar 1301b is displayed above the specified frame 1301a to distinguish it from other frames.

The continuous frame display window 130
Reference numeral 1 denotes a scroll bar for scrolling the displayed continuous frames after displaying a predetermined number of continuous frames centered on the specified frame 1301a in a line.
The scroll bar 130c is provided.
By operating 1c, it is possible to change the frame displayed as a continuous frame within the range of the playback segment (in other words, between the start frame and the end frame of the playback segment).

The continuous frame display window 130
When an arbitrary frame from the continuous frames displayed in step 1 is plotted on the representative frame editing screen 403 displayed in multiple windows on the same display screen by dragging and dropping, the representative frame editing screen 403 is dropped. Frame to segment video playback window 1
At 201, a representative frame representing the reproduction segment 306 being reproduced is generated and displayed.

FIG. 14 shows the reproduction operation window 1 described above.
202 and a continuous frame display window 1301;
The window screen including the structure editing screen 401 and the representative range editing screen 404 shows a state where the window screen is displayed on the display screen 102 in a multi-window manner. On the representative range editing screen 404, when two frames are selected from the continuous frames displayed in the continuous frame display window 1301 and dragged and dropped, the first frame of the two frames is set as a start frame 1401, and A new representative range of the currently selected segment is generated and displayed as one of the end frames 1402.

Next, the content description window 1501 will be described with reference to FIG. Content description window 1
Reference numeral 501 denotes a function for inputting, editing, and displaying a description of the contents of the segment, package, representative frame, or representative range selected on the structure edit screen 401, the segment range edit screen 402, the representative frame edit screen 403, or the representative range edit screen 404. have.

In the content description window 1501, “Who (Who), when (When), where (Where), and what (Wha)
There is provided an area for inputting and changing 5W1H information 1502 corresponding to “t), why (Why) and how (How)” and free description information 1503 as arbitrary information.

By specifying registration using the “Add” button in the figure and registering the 5W1H information 1502, the registered contents are displayed as candidates in the area of the 5W1H information 1502 from the next time. Selection is possible without input.

For example, when a segment is selected on the structure editing screen 401, if the contents of the segment have been stored in advance, the description contents are displayed in a corresponding area of the contents description window 1501. In the case of a new input or a change, an instruction is given by an “Apply” button. When another segment is selected, its description is displayed.

FIG. 16 is an explanatory diagram showing a list display screen 1601 for displaying the description content input using the content description window 1501 in a tabular list. The list display screen 1601 is displayed by performing a predetermined key operation on the structure editing screen 401. For example, on the structure edit screen 401, the 5
When the list display of the W1H information and the free description information is specified in a table format, the list display screen 1601 is displayed.

Note that each item on list display screen 1601 is
The boundary of each item can be freely moved, and when there are many items of the content description, the columns can be enlarged or reduced to make it easier to see necessary items. In addition, an item to be displayed may be selected so that display / non-display can be performed.

In the list of contents description, an edit mode and a read mode are prepared, and work is performed in any selected mode. At this time, the difference in the mode is expressed by the difference in the background color.

If the description does not fit in one column, the color of the frame is changed and displayed, the cursor is placed in that part, and the cursor is moved up and down by a key or a scroll bar is dynamically prepared. By scrolling and displaying,
Make all descriptions visible.

It is necessary to describe a content description having a high added value to a structural element such as a segment while observing the flow of a video stream (content). As in the content description window 1501, a method may be used in which only the information (representative frame, content description, range, etc.) of the target segment is displayed, but this alone is not sufficient to describe the content of the description for the previous segment or the next segment. It is difficult to refer and compare, and it is difficult to write at the same level. When writing sentences, it is easier to work while re-reading from the beginning many times, but the situation will be improved, but the document is described in separate windows for each word or for each clause, and those windows can not be referenced in the same way Given that, it is clear that it is difficult to describe at the same level.

As described above, according to the video structure editing apparatus of the first embodiment, the display is performed so that the structure of the video stream can be grasped at a glance by using the structure information defining the hierarchical structure of the video stream, and the intuition can be obtained. It is possible to provide a video structure editing apparatus capable of re-editing the structure of a structured video stream by a simple and easy-to-understand operation.

A program for implementing each means of the video structure editing apparatus of the first embodiment is recorded on a computer-readable recording medium such as a hard disk, a floppy disk, a CD-ROM, an MO, and a DVD. It is executed by being read from the recording medium. Further, this program can be distributed via the above-described recording medium, or can be distributed via a communication network such as the Internet.

Embodiment 2 In the second embodiment, a plurality of packages or segments are selected from one or a plurality of video streams displayed using the video structure editing apparatus of the first embodiment, and a structural element including the selected packages or segments is displayed. The present invention relates to a structuring element reconstructing apparatus that reconstructs the order and generates a video stream obtained by reproducing in a display order as a new video stream. The hardware configuration of the structural element reconfiguration apparatus according to the second embodiment is the same as that of the first embodiment.
Since this is the same as the video structure editing apparatus described above, only the different parts will be described here.

FIGS. 17 to 19 show a display screen 1701 (window screen) of the structural element reconstructing apparatus according to the second embodiment.
A reconstructed display unit 1702 that sequentially displays and edits rectangles according to the length of the range of the frame of each structural element, and a scale display unit that can switch and display a unit of measurement such as the number of frames or time as needed. Scale display section 1703
And

The reconstruction display section 1702 has a mouse operation means for selecting and operating structural elements such as segments and packages. The mouse operation means can be easily realized by a pointing device such as a general mouse. The reconstruction display unit 1702
As shown in FIG. 17, each structural element (eg, segment 1705, package 1706, package 1707)
Are arranged in a row in the order in which they are joined, are displayed as rectangles, and a new structuring element is selected from one or more video streams displayed by the structuring element reconstructing apparatus of the first embodiment using a mouse operating means. By dragging and dropping, for example, at a desired position 1708, as shown in FIG. 18, a new structural element (segment 1) is inserted between the structural elements before and after that (here, package 1706, package 1707).
801) are incorporated and rearranged.

Also, for example, in the reconfiguration display section 1702 in the state of FIG. 18, when a segment 1801 is selected and designated for deletion, the structural elements before and after the segment 1801 (here, the package 1706, the package 170
7) are combined and rearranged as shown in FIG.

Further, the reconstruction display unit 1702 drags an arbitrary structural element from the row of structural elements displayed side by side using the mouse operating means and drops it at a desired position. Move and reorder structuring elements. For example, in FIG. 17, when the segment 1705 is dragged and dropped at a position after the package 1707, the segment 1705 moves to the last position.

The reconstructed display unit 1702 displays the structural elements in a uniform color for each original video stream to which they belong. Among the structural elements, a package represents a set of segments, is displayed as a shaded rectangle for each package, and allows only an operation on a package basis.
For example, in FIG. 17, a package 1706 and a package 1707 are displayed as shaded rectangles (shaded portions in the figure) in a state where a set of segments belonging to each package can be confirmed.

As described above, a set of segments displayed in a shaded rectangle of a package cannot be directly operated. For example, an operation of a package release button or the like (not shown) is operated to release an operation of each package. As a result, a set of segments constituting the package can be operated on a segment basis. Specifically, FIG.
In FIG. 8, when the package 1707 is released, the shaded rectangular display portion disappears as shown in FIG.
Segments 1901 to 1904, which are a set of segments of the package 1707, can be operated in segment units. FIG. 19 shows a state where the segment 1901 is selected.

Further, as shown in FIG. 17, when the mouse pointer is moved to a desired structural element via the mouse operating means, the reconstructed display unit 1702 displays the original video stream to which the corresponding structural element belongs or the frame. The detailed information 1704 such as the range is displayed.

The reconstruction display section 1702 and scale display section 1703 are each configured as an editing screen on which information can be displayed and commands can be input. Therefore, as described above, by dragging and dropping from another window screen, a structural element can be input or displayed. In addition, since it is displayed as one window screen, the size of the edit screen can be freely changed by scaling the window screen vertically or horizontally, and when displaying in a multi-window, a necessary screen is displayed. The work can be performed efficiently with the size of.

Also in the reconstructed display section 1702, as in the structure edit screen 401 of the first embodiment, a reduced image of the start frame or end frame of the corresponding segment is displayed at the beginning or end of the segment range. The range may be scaled and displayed in accordance with the vertical display size for displaying the range, or may be scaled and displayed in accordance with the horizontal display size of the range of the corresponding segment. Further, when displaying the reduced image at a variable magnification, the reduced image may be omitted if the magnification is smaller than a preset ratio.

The structure edit screen 401 according to the first embodiment
Like the play button icon 305 of FIG.
Embodiment 1 by providing a play button icon on the 702
In the same manner as described above, the structural elements reconstructed by the reconstruction display unit 1702 may be reproduced as one video stream. By selecting a structural element, the range of the corresponding frame may be reproduced.

Further, the structural elements reconstructed by the structural element reconstructing device may be stored as one video stream on a recording medium. At this time, when saving the reconstructed structural element as one video stream on a recording medium, the SMIL
By expressing and storing the information in a general-purpose language representing a browsing method such as the above, it is possible to directly reproduce the reconfiguration information (a set of reconfigured structural elements) with a general-purpose browser.

As described above, the structural element reconstructing apparatus according to the second embodiment selects structural elements from one or a plurality of video streams, logically edits the selected structural elements,
It can be reconstructed as one video stream.

A program for realizing each means of the structural element reconstructing apparatus according to the second embodiment is recorded on a computer-readable recording medium such as a hard disk, a floppy disk, a CD-ROM, an MO, and a DVD. Is executed by being read from the recording medium. Further, this program can be distributed via the above-described recording medium, or can be distributed via a communication network such as the Internet.

[0125]

As described above, the video structure editing apparatus of the present invention (claims 1 to 17) defines a range of an arbitrary frame in a video stream as a segment, and a range defined by one segment. Edit the structure of a video stream using the structure information that defines the hierarchical structure of the video stream by defining the set of multiple segments as a package when the same range can be represented by a set of other segments Video structure editing device, based on the structure information, the hierarchical structure of the video stream,
View package and segment ranges,
Structure configuration display means capable of selecting the displayed package and segment; segment range display means for displaying a range of the segment selected by the structure configuration display means as a reduced image of a pair of start frame and end frame;
Representative frame display means for displaying a representative frame representing the segment selected by the structure display means, and a range of frames representing the segment from a frame range belonging to the segment selected by the structure display means. With the representative range display means to be displayed as, as well as performing display so that the structure of the video stream can be grasped at a glance using the structure information that defines the hierarchical structure of the video stream, with intuitive and easy-to-understand operation,
It is possible to provide a video structure editing device capable of reediting the structure of a structured video stream.

Further, the structure display means, the segment range display means, the representative frame display means and the representative range display means are each configured as an edit screen on which information can be displayed and commands can be inputted, and individual video images can be displayed. Since each editing screen is displayed as one window screen for each stream, the structure editing of a plurality of video streams can be performed simultaneously, and it is easy to operate and compare a plurality of video streams.

When each of the editing screens of the window screen selects a displayed segment, package, representative frame or representative range, the display state of the selected segment, package, representative frame or representative range is changed and displayed. If one or more segments or packages are further selected and editing operations such as moving or deleting are performed, the results are reflected and displayed, so that operability can be improved. In addition, by dividing the selected segment, changing the range of the selected segment, changing the hierarchy of the selected segment in the hierarchical structure, and merging a plurality of selected segments to generate one new segment, Structure editing work can be performed efficiently.

When a package is selected by the structure configuration display means, the segment range display means displays reduced images corresponding to all the segments included in the selected package, and the representative frame display means displays the reduced image. The representative frame is displayed corresponding to all the segments included in the selected package, and the representative range display means displays the representative range corresponding to all the segments included in the selected package. Can be easily grasped, and operability can be improved.

Each of the edit screens corresponding to the segment range display means, the representative frame display means, and the representative range display means can be displayed or not displayed in the window screen. At least one of these edit screens can be designated. When two non-displays are specified, the specified edit screen is hidden in the window screen, the edit screen corresponding to the structure configuration display means is expanded by the area of the hidden edit screen, and other edit screens are displayed. Movement to fill the hidden display area of the edit screen allows you to selectively display or hide necessary or unnecessary parts according to your purpose, further improving operability. Can be planned.

The editing screens corresponding to the segment range display means, the representative frame display means, and the representative range display means can be removed from the window screen and displayed as another window screen. The layout of each of the edit screens can be changed, thereby improving work efficiency and operability.

Further, the structural configuration display means enlarges or reduces the reduced image of the start frame or end frame of the corresponding segment at the beginning or end of the segment range according to the vertical display size for displaying the segment range. In this case, the displayed content is scaled according to the horizontal display size of the range of the corresponding segment, so that the displayed content can always be kept legible.

When displaying the reduced image in a scaled manner, the structure configuration display means omits the reduced image when the scaling ratio is smaller than a preset ratio. Can be kept.

Further, since the structure configuration display means can designate display or non-display of the reduced image, it is possible to select an appropriate display state according to the work content.
In addition, since the amount of the image displayed on the screen can be adjusted, the processing speed can be improved by using the non-display of the reduced image, and when the position of the representative frame or the representative range is to be clarified. In addition, unnecessary reduced images can be eliminated to make viewing easier.

Further, the structure display means displays the position information indicating the position of the representative frame corresponding to each segment at a corresponding position in the range of the segment, and when the displayed position information is selected, the selected structure information is displayed. Change the display state of the position information, the representative frame display means displays a predetermined number of representative frames of the segments displayed on the structural configuration display means in a line, and if the total number of segments is equal to or more than the predetermined number, Displaying the scroll bar and changing the range of the representative frame to be displayed, and selecting an arbitrary representative frame from the displayed representative frames, changing the display state of the selected representative frame, The position information of the structural configuration display means and the representative frame of the representative frame display means indicate the corresponding position information and display form of the representative frame, respectively. Are linked, and when one is selected, the display state of the other is also changed. Therefore, by simply operating one, the corresponding part of the other can be automatically specified, and work efficiency can be improved. Performance can be improved.

Further, the structure display means displays the range information indicating the position of the representative range belonging to each segment at the corresponding position of the segment range, and when the displayed range information is selected, the selected range is displayed. Change the information display state,
The representative range display means displays the representative range as a reduced image of a pair of start frames and an end frame, and displays a scroll bar when the total number of the pair of reduced images is equal to or more than a predetermined number. When the range of the image can be changed and an arbitrary pair of reduced images is selected from the displayed pair of reduced images, the display state of the selected pair of reduced images is changed, and further, the structure configuration display means The range information and the pair of reduced images of the representative frame display means are linked to the corresponding range information and the display state of the pair of reduced images, and when one is selected, the other display state is also changed. By simply operating one of them, the other corresponding portion can be automatically specified, thereby improving work efficiency and improving operability.

Further, the structure display means displays the range information indicating the position of the representative range belonging to each segment as a rectangle or an ellipse at the corresponding position of the segment range, and the display of a plurality of range information overlaps. Is displayed below the rectangular or elliptical display of the previous range information, shifted by the display of the rectangle or elliptical, so that even if there are multiple range information, it is easy to see as much as possible without overlapping. it can.

Further, the image processing apparatus has attribute selecting means for selecting an attribute of the representative frame or the representative range. When the attribute is selected by the attribute selecting means, the representative frame displaying means or the representative range displaying means displays the selected attribute. Since only the representative frame or the representative range is displayed, the display contents can be narrowed down, and work efficiency and operability can be improved.

[0138] Also, the structure configuration display means includes: a reproduction designating means for designating reproduction of the selected segment; a segment video reproducing means for reproducing frames within a range defined by the segment designated by the reproduction designating means; Playing, stopping, rewinding the segment being played by the playback means,
Video playback operation means for performing operations such as fast-forward, pause, and skip to a designated frame, so that segments can be easily played back, and the target portion of video playback is limited by segment selection. , And the position of the target segment with respect to the entire video stream is clarified, so that it is possible to reproduce while grasping the entire structure, which has an effect that it is easier to understand than the reproduction of the entire video.

[0139] Further, when a desired frame is reproduced by the segment video reproducing means, a continuous frame displaying means for designating as a target frame and displaying a predetermined number of continuous frames including the designated frame in a line is provided. The frame display means drags and drops an arbitrary frame from the continuous frames displayed on the continuous frame display means, and generates and displays the corresponding frame as a representative frame of the segment being reproduced by the segment video reproduction means. Therefore, a series of operations is simple, and the work can be performed efficiently.

The representative range display means selects two frames from the continuous frames displayed on the continuous frame display means, and drags and drops the frame to set the first frame of the two frames as the start frame. ,
Since a new representative range of the selected segment is generated and displayed with the other as the end frame, a series of operations is simple, and the work can be performed efficiently.

The video structure editing apparatus according to the present invention is characterized in that the segment, package, representative frame or representative range selected by the structure configuration display means, segment range display means, representative frame display means or representative range display means. Content description display means for inputting, editing, and displaying a description of the content of the subject element. The content description display means displays "Who (W
(ho), when (When), where (Where), what (What), why (Why), how (Ho)
w) "and free description information, which is arbitrary information, can be input and changed.
By registering the W1H information, it is displayed as a candidate from the next time, and can be selected without inputting from the next time, so that the content can be easily described. Also, 5W
The whole description contents can be unified by the 1H information.

Further, the video structure editing apparatus of the present invention (claim 19) provides a 5W1H
Information and free description information are displayed in a list in a table format, and a list display means for editing is provided. This makes it easy to refer to and compare the description contents of the previous and next segments, and always write descriptions at the same level. Can do it.

The recording medium of the present invention (claim 20)
Recorded a program for causing a computer to execute each means described in any one of claims 1 to 19, so that the program can be machine-readable, and the operations of claims 1 to 19 can be realized by a computer. There is an effect that a possible recording medium can be obtained.

According to a twelfth aspect of the present invention, there is provided a structural element reconstructing apparatus for displaying one or a plurality of images displayed by using the video structure editing apparatus according to any one of the first to nineteenth aspects. Structural element for selecting a plurality of packages or segments from the video stream, reconstructing the display order of the structural elements composed of the selected package or segment, and generating a video stream obtained by reproducing in the display order as a new video stream A reconstruction device for displaying and editing the structural elements in a rectangular shape according to the length of the frame range of the structural element in order, and switching a unit of measurement such as the number of frames or time as necessary. And a scale display means that can be displayed, so that a structural element is selected from one or a plurality of video streams, and the selected structural element is logically edited. It can provide structural elements reconstructor which can be reconfigured as a single video stream.

The reconstruction display means has a mouse operation means for selecting and operating the structural elements. The reconstruction display means arranges the respective structural elements in a horizontal line in the order in which the structural elements are connected and displays them in a rectangle. Using the operation means, a new structuring element is selected from one or more displayed video streams, dragged and dropped to a desired position, and the new structuring element is incorporated between the preceding and following structuring elements. If you select and delete an arbitrary structural element, the structural elements before and after the arbitrary structural element are combined and rearranged, so you can edit the structural element with a simple mouse operation. Performance can be improved.

[0146] The reconstruction display means can drag an arbitrary structural element from the row of structural elements displayed side by side using the mouse operating means and drop it at a desired position. Since the elements are moved and rearranged, the structural elements can be edited by a simple mouse operation, and operability can be improved.

The reconstruction display means displays the structural elements in a unified color for each of the original video streams to which the structural elements belong, and the package among the structural elements represents a set of segments and a network for each package. Since it is displayed as a hanging rectangle and only operations in package units are permitted, information on each structural element is visually recognized, and structural element operations are performed in segment units and package units to improve operability. Can be planned.

Further, since the reconfiguration display means can release the operation for each package and operate the set of segments constituting the package for each segment, it is possible to shift from the operation for each package to the operation for each segment when necessary. Thus, work efficiency and operability can be improved.

When the mouse pointer is moved to the structural element via the mouse operating means, the reconstructing display means displays detailed information such as the original video stream to which the corresponding structural element belongs and the frame range. The attribute of the structural element can be clearly recognized, and the operation can be performed accurately.

The reconstruction display means and the scale display means are each configured as an edit screen on which information can be displayed and commands can be input, and are displayed as one window screen. Since the size of the editing screen can be freely changed by scaling in the horizontal direction, the work can be performed efficiently.

The reconstruction display means enlarges or reduces the reduced image of the start frame or end frame of the corresponding segment at the beginning or end of the segment range according to the vertical display size for displaying the segment range. The reduced image is displayed in a scaled manner in accordance with the horizontal display size of the range of the corresponding segment, so that the reduced image can be displayed in an easily viewable manner, and the work can be performed efficiently.

Further, the reconstructed display means omits the reduced image when the reduced image is displayed at a reduced magnification when the magnification is smaller than a preset ratio. Can be kept.

Further, since the reconstructed display means can reproduce the reconstructed structural element as one video stream, it is possible to browse the search results.

Further, the reconstruction display means can reproduce the range of the corresponding frame by selecting the structural element, so that the convenience in reconstructing the structural element can be improved. Also, the contents can be confirmed before saving.

Further, since the reconstructed display means can store the reconstructed structuring element as one video stream on a recording medium, the structuring element reconstructing device reconstructs the structuring element and saves the digest, thereby providing a digest. Creation of images and the like becomes possible. Further, when the reconstructed structural element is stored as a single video stream on a recording medium, it can be directly reproduced by a general-purpose browser by expressing and storing it in a general-purpose language representing a browsing method such as SMIL. Become.

The recording medium of the present invention (claim 34)
Records a program for causing a computer to execute each means described in any one of claims 21 to 33, so that the program can be machine-readable, and the operations of claims 21 to 33 can be realized by a computer. There is an effect that a possible recording medium can be obtained.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram illustrating an example of a video structure editing device according to a first embodiment.

FIG. 2 is a block diagram of the computer shown in FIG. 1;

FIG. 3 illustrates a structure example of structure information used in the video structure editing device according to the first embodiment.

FIG. 4 is an explanatory diagram showing a display example of a structure editing screen by the structure display software according to the first embodiment;

FIG. 5 is an explanatory diagram showing a display example of a structure editing screen by the structure display software according to the first embodiment;

FIG. 6 is an explanatory diagram showing functions of the structure editing software according to the first embodiment;

FIG. 7 is an explanatory diagram showing a display example in a case where the structure of two video streams is displayed simultaneously by the video structure editing device of the first embodiment.

8 is an explanatory diagram showing a state in which a segment range editing screen and a representative range editing screen are not displayed from the window screen of FIG. 6;

FIG. 9 is an explanatory diagram showing a change in a display state of a start frame due to a reduction in a structure editing screen in a horizontal direction.

FIG. 10 is an explanatory diagram showing a display state of position information on a representative range editing screen and a link relationship between the representative range editing screen and the representative frame editing screen.

FIG. 11 is an explanatory diagram showing a display state of a representative range on the representative range edit screen and a link relationship between the representative range edit screen and the structure edit screen.

FIG. 12 is an explanatory diagram showing display screens of a segment video playback window and a playback operation window.

FIG. 13 is an explanatory diagram showing a continuous frame display window.

FIG. 14 is an explanatory diagram showing a state in which a playback operation window, a continuous frame display window, and a window screen including a structure editing screen are displayed in a multi-window on the display screen.

FIG. 15 is an explanatory diagram showing a content description window.

FIG. 16 is an explanatory diagram showing a list display screen that displays description contents input using a content description window in a tabular list.

FIG. 17 is an explanatory diagram showing a display screen (window screen) of the structural element reconfiguration device according to the second embodiment.

FIG. 18 is an explanatory diagram showing a display screen (window screen) of the structural element reconfiguration device according to the second embodiment.

FIG. 19 is an explanatory diagram showing a display screen (window screen) of the structural element reconstructing apparatus according to the second embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 video structure editing apparatus 101 computer 102 display screen 103 storage means 207 structure analysis software 208 structure editing software 209 structure display software

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] February 8, 2001 (2001.2.8)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

[0084] In window screen, although a total of five display (edit screen 401 to 405) is performed, depending on the purpose of performing the structure editing video stream, it need
There are also edit screens. In addition, various usage methods are conceivable, such as a case in which only a part to be emphasized is displayed with attention, and a case where the display speed of the window is emphasized and only the structure of the video stream is to be viewed. Then, out of the five types of display (editing screen 401 to 405), integral structure editing screen 40
1 is always displayed, and the display / non-display of the other portions can be selected, and the operability can be improved by instructing the non-display as necessary.

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0102

[Correction method] Change

[Correction contents]

By specifying the registration using the “Add” button in the figure and registering the 5W1H information 1502 , the registered contents are displayed as candidates in the area of the 5W1H information 1502 from the next time and input from the next time. You can select it without having to do it.

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0105

[Correction method] Change

[Correction contents]

Note that each item on list display screen 1601 is
The boundaries of each item can Rukoto move freely, if the item of content description is large, by scaling the column, can be easier to see the necessary items. Also,
An item to be displayed may be selected so that display / non-display can be performed.

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0117

[Correction method] Change

[Correction contents]

As described above, a set of segments displayed in a shaded rectangle of a package cannot be directly operated. For example, an operation of a package release button or the like (not shown) is operated to release an operation of each package. As a result, a set of segments constituting the package can be operated on a segment basis. Specifically, FIG.
Oite to 8, when the release of the package 1707, as shown in FIG. 1
As shown in FIG. 9, the shaded rectangular display portion is eliminated, and segments 1901 to 1904, which are a set of segments of the package 1707, can be operated in segment units. FIG. 19 shows a state where the segment 1901 is selected.

[Procedure amendment 5]

[Document name to be amended] Statement

[Correction target item name] 0121

[Correction method] Change

[Correction contents]

The structure edit screen 401 according to the first embodiment
Like the play button icon 305 of FIG.
Embodiment 1 by providing a play button icon on the 702
And in a similar manner, it may be reproduced reconstituted structural elements in the reconstruction display unit 1702 as a single video stream.
By selecting a structural element, the range of the corresponding frame may be reproduced.

[Procedure amendment 6]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

Further, the video structure editing apparatus of the present invention (claim 19) provides a 5W1H
Information and free description information are displayed in a list in a table format, and a list display means for editing is provided. This makes it easy to refer to and compare the description contents of the previous and next segments, and always write descriptions at the same level. Can be done.

[Procedure amendment 7]

[Document name to be amended] Statement

[Correction target item name] Figure 3

[Correction method] Change

[Correction contents]

FIG. 3 is an explanatory diagram showing an example of the structure of structure information used in the video structure editing device according to the first embodiment ;

[Procedure amendment 8]

[Document name to be amended] Drawing

[Correction target item name] FIG.

[Correction method] Change

[Correction contents]

FIG.

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04N 5/765 H04N 5/92 H5 / 781 G11B 27/02 A5 / 92 (72) Inventor Takayuki Kunieda Ota, Tokyo No. 1-3-6, Nakamagome-ku, Ricoh Co., Ltd. (72) Inventor Nozomi No. 1-3-6, Nakamagome, Ota-ku, Tokyo F-term in Ricoh Co., Ltd. 5B075 ND12 NS01 PQ46 PQ48 UU35 5C053 FA14 FA23 JA21 KA04 KA08 KA24 KA30 5D077 AA22 BA02 BA03 BA04 BA14 CA02 DC03 HC03 HC17 5D110 AA13 AA27 AA29 BB20 CA04 CA16 CA43 CD15 FA02 FA09

Claims (34)

[Claims] 1. A range of an arbitrary frame in a video stream is defined as a segment, and when the same range defined by one segment can be represented by a set of another plurality of segments, A video structure editing device that edits the structure of the video stream by using a structure information defining a hierarchical structure of the video stream by defining a set as a package, based on the structure information, Structure display means for displaying the hierarchical structure of the package and the range of the package and the segment, and selecting the displayed package and segment; and displaying the range of the segment selected by the structure display means as a pair of start frame and end. Segment range display means for displaying a reduced image of a frame; Representative frame display means for displaying a representative frame representing the segment selected by the composition display means, and a range of frames representing the segment from a frame range belonging to the segment selected by the structure display means. A video structure editing apparatus, comprising: a representative range display means for displaying as; 2. The structure configuration display means, the segment range display means, the representative frame display means, and the representative range display means are each configured as an edit screen on which information can be displayed and a command can be input. The video structure editing device according to claim 1, wherein the video structure editing device is displayed as one window screen in which each editing screen is combined for each video stream. 3. When each of the edit screens of the window screen selects a displayed segment, package, representative frame, or representative range, the display state of the selected segment, package, representative frame, or representative range is changed. 3. The video structure editing apparatus according to claim 2, wherein when a display operation is performed and one or more segments or packages are selected and an editing operation such as moving or deleting is performed, the result is reflected and displayed. apparatus. 4. The editing operation includes dividing a selected segment, changing the range of the selected segment, changing the hierarchy of the selected segment in a hierarchical structure, and merging a plurality of selected segments into a new one. The video structure editing apparatus according to claim 3, further comprising generating a segment. 5. When a package is selected by the structural configuration display means, the segment range display means displays the reduced image in association with all segments included in the selected package, and displays the representative frame. Means are
Displaying the representative frame in association with all the segments included in the selected package, and displaying the representative range in association with all the segments included in the selected package. The video structure editing apparatus according to any one of claims 1 to 3, wherein 6. An edit screen corresponding to the segment range display means, the representative frame display means, and the representative range display means can be specified to be displayed or hidden in the window screen. When at least one non-display is designated, the designated edit screen is hidden in the window screen, and the edit screen corresponding to the structure configuration display means is expanded by an area of the hidden edit screen, The video structure editing apparatus according to any one of claims 2 to 5, wherein another editing screen moves so as to fill the area of the hidden editing screen. 7. The editing screen corresponding to the segment range display means, the representative frame display means, and the representative range display means can be removed from the window screen and displayed as another window screen. An image structure editing apparatus according to claim 2. 8. The structure configuration display unit adjusts a reduced image of a start frame or an end frame of a corresponding segment to a vertical display size for displaying the range of the segment at the beginning or end of the range of the segment. 8. The video structure editing apparatus according to claim 1, wherein the image is displayed by scaling up or down according to a horizontal display size of a range of a corresponding segment. apparatus. 9. The structure configuration display unit according to claim 2, wherein, when displaying the reduced image in a scaled manner, the reduced image is omitted when a scaling ratio is smaller than a preset ratio. 9. The video structure editing device according to 8. 10. The video structure editing apparatus according to claim 8, wherein said structure configuration display means can designate display or non-display of said reduced image. 11. The structure configuration display means displays position information indicating a position of a representative frame corresponding to each segment at a corresponding position in a range of a segment, and when the displayed position information is selected, the selected structure information is selected. The representative frame display means displays the representative frames of the segments displayed on the structural configuration display means in a predetermined number in a row, and the total number of the segments is equal to or greater than a predetermined number. In some cases, the range of the representative frame to be displayed by displaying the scroll bar can be changed, and when an arbitrary representative frame is selected from the displayed representative frames, the display state of the selected representative frame is changed. Further, the position information of the structural configuration display means and the representative frame of the representative frame display means correspond to the corresponding position information and The display state of the frame is linked, a video structure editing apparatus according to any one of claims 1 to 10 where one is characterized in that it is changed when selected also other display state. 12. The structure configuration display means displays range information indicating a position of a representative range belonging to each segment at a corresponding position in the range of the segment, and when the displayed range information is selected, the selected structure information is displayed. Change the display state of the range information, the representative range display means, the representative range is displayed as a reduced image of a pair of start frame and end frame, if the total number of the pair of reduced images is a predetermined number or more, The range of the pair of reduced images to be displayed by displaying the scroll bar can be changed, and when an arbitrary pair of reduced images is selected from the displayed pair of reduced images, the selected pair of reduced images is displayed. Changing the display state, and further displaying the range information of the structural configuration display means and the pair of reduced images of the representative frame display means, respectively, corresponding range information and a pair of reduced images. Status is linked, the video structure editing apparatus according to any one of claims 1 to 10, characterized in that one is changed when selected also other display state. 13. The structure configuration display means displays range information indicating the position of a representative range belonging to each segment as a rectangle or an oblong at a corresponding position in the range of the segment.
13. When the display of a plurality of range information overlaps, the display is shifted by the display of the rectangle or the ellipse below the display of the rectangle or the ellipse of the immediately preceding range information. The video structure editing device according to any one of the above. 14. An image processing apparatus further comprising: an attribute selection unit that selects an attribute of the representative frame or the representative range, wherein the representative frame display unit or the representative range display unit includes:
14. The video structure editing apparatus according to claim 1, wherein when an attribute is selected by said attribute selecting means, only a representative frame or a representative range having the selected attribute is displayed. 15. The structure configuration display means includes: a reproduction designation means for designating reproduction of a selected segment; a segment video reproduction means for reproducing frames in a range defined by the segment designated by the reproduction designation means; Playback, stop, and playback of the segment being played back by the segment video playback means.
15. The video structure editing apparatus according to claim 1, further comprising: video playback operation means for performing operations such as rewinding, fast forwarding, pausing, and skipping to a designated frame. . 16. A continuous frame display means for designating as a target frame when a desired frame is reproduced by the segment video reproducing means and displaying a predetermined number of continuous frames including the specified frame in a line. The representative frame display means, when dragging and dropping an arbitrary frame from the continuous frames displayed by the continuous frame display means, displays the corresponding frame as a representative of the segment being reproduced by the segment video reproduction means. The video structure editing apparatus according to claim 1, wherein the video structure editing apparatus generates and displays the frame as a frame. 17. The representative range display means selects two frames from the continuous frames displayed by the continuous frame display means, drags and drops, and starts the first frame of the two frames. 17. The video structure editing apparatus according to claim 16, wherein a new representative range of the selected segment is generated and displayed as a frame and the other as an end frame. 18. A description of the contents of the segment, package, representative frame, or representative range selected by said structural configuration display means, segment range display means, representative frame display means, or representative range display means,
The content description display means for editing and displaying, as the content of the selected target element, "who (Who), what time (When), where (Where), what (What) ), Why (Wh
y), it is possible to input and change 5W1H information corresponding to “How” and free description information as arbitrary information, and by registering the 5W1H information, it is displayed as a candidate from the next time. 2. The method according to claim 1, wherein the user can select the item without inputting it from the next time.
7. The video structure editing apparatus according to any one of items 7 to 7. 19. The apparatus according to claim 18, wherein said structure configuration display means has a list display means for displaying and editing 5W1H information and free description information of segments under a certain package in a table format. 3. The video structure editing apparatus according to claim 1. 20. A computer-readable recording medium having recorded thereon a program to be executed by a computer as each means of the video structure editing apparatus according to any one of claims 1 to 19. 21. A plurality of packages or segments are selected from one or more video streams displayed by using the video structure editing apparatus according to any one of claims 1 to 19, and the selected packages or segments are selected. A structural element reconstructing apparatus that reconstructs a display order of structural elements including a package or a segment and generates a video stream obtained by reproducing the display order as a new video stream, wherein the structural element is a frame of the structural element. Reconstructed display means for sequentially displaying and editing rectangles according to the length of the range, and scale display means capable of switching and displaying measurement units such as the number of frames or time as necessary. Structural element reconstruction device. 22. The reconstruction display means further includes a mouse operation means for selecting and operating the structural elements, wherein the reconstruction display means arranges the respective structural elements in a horizontal line in the order in which the structural elements are joined and forms a rectangle. When a new structuring element is selected from the displayed one or more video streams using the mouse operation means and dragged and dropped at a desired position, the structuring element is positioned between the preceding and following structuring elements. The method according to claim 11, wherein the new structural element is incorporated and rearranged, and when an arbitrary structural element is selected and deleted, structural elements before and after the arbitrary structural element are combined and rearranged. 22. The structural element reconstruction device according to 21. 23. The reconfiguration display means, when dragging an arbitrary structural element from a row of structural elements displayed in a horizontal line and using the mouse operating means and dropping the structural element at a desired position, displays the specified position. 23. The structural element reconstructing apparatus according to claim 22, wherein the structural elements are moved and rearranged. 24. The reconstruction display means displays the structural elements in a uniform color for each of the original video streams to which the structural elements belong, and a package among the structural elements represents a set of segments and a package. The structural element reconstructing apparatus according to any one of claims 21 to 23, wherein the structural element reconstructing apparatus according to any one of claims 21 to 23, wherein the structural element reconstructing apparatus displays a shaded rectangle every time and permits only an operation in a package unit. 25. The structural element reconstructing apparatus according to claim 24, wherein the reconstructing display unit cancels the operation of the package unit and can operate a set of segments constituting the package in segment units. . 26. The reconstructing and displaying means, when a mouse pointer is set on a structural element via the mouse operating means, an original video stream to which the structural element belongs,
The structural element reconstructing apparatus according to any one of claims 21 to 25, wherein detailed information such as a range of a frame is displayed. 27. The reconfiguration display means and the scale display means are each configured as an edit screen on which information can be displayed and a command can be input, and are displayed as one window screen. 27. The size of the editing screen can be freely changed by enlarging or reducing in the horizontal or horizontal direction.
The structural element reconstruction device according to any one of the above. 28. The reconstructed display means sets a reduced image of a start frame or an end frame of a corresponding segment at a start or end portion of a range of a segment according to a vertical display size for displaying the range of the segment. The structural element reconstruction according to any one of claims 21 to 27, wherein the structural element is displayed in a scaled manner or is scaled in accordance with a horizontal display size of a range of a corresponding segment. apparatus. 29. The reconstructed display means, when scaling the reduced image and displaying the scaled image, omits the reduced image if the scaling ratio is smaller than a preset ratio. 29. The structural element reconstruction device according to claim 28. 30. The structural element reconstructing apparatus according to claim 21, wherein said reconstructing display means is capable of reproducing the reconstructed structural element as one video stream. . 31. The structural element according to claim 21, wherein the reconstruction display means can reproduce a range of a corresponding frame by selecting the structural element. Reconstruction device. 32. The structural element according to claim 21, wherein said reconstructed display means can store the reconstructed structural element as one video stream on a recording medium. Reconstruction device. 33. The reconstructed display means, when storing the reconstructed structural element as one video stream on a recording medium, expresses and stores the reconstructed structural element in a general-purpose language such as SMIL or the like. 33. The structural element reconstructing device according to claim 32, wherein 34. A computer-readable recording medium having recorded thereon a program to be executed by a computer as each means of the structural element reconstructing apparatus according to any one of claims 21 to 33.