JP2004260868A - Moving image editing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving image editing apparatus in which more simplified unitary management is made possible by flexibly relating information accompanied with video. <P>SOLUTION: Various kinds of information accompanied with video can be related for each hierarchy of a hierarchical structure. Besides, an input/display method for the related information accompanied with video is realized by a GUI operation such as preparing icons by various source media of the information accompanied with video and dragging & dropping the icon for each source medium into an M-icon. Further, relating is made possible by using analytic information resulting from applying a video analytic technique to video material as an analytic information icon. Furthermore, the related information is visually and clearly displayed for an operator. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

  The present invention relates to a moving image editing apparatus used at the time of editing moving images such as television broadcast program production and video program production.

  2. Description of the Related Art Conventionally, in television broadcast program production and video program production facilities, the use of computers has been rapidly increasing in functionality. In particular, in recent years, instead of relying on a tape counter for a video editing method using a video tape recorder that repeats fast forward and rewind, material video is stored on a hard disk which is inexpensive and easy to handle and save. Thus, a moving image editing apparatus that performs editing, that is, a so-called nonlinear editing apparatus, has been remarkably advanced.

  FIG. 2 is a block diagram showing an example of the configuration of a conventional moving image editing apparatus. 201 is a scene change point detecting unit, 202 is a magnetic storage device, 203 is a monitor, 204 is a frame buffer, 205 is a main memory, 206 is an input device, 207 is a VTR, 208 is a video interface, and 209 is an image. A compression unit, 210 is an audio interface, 211 is a CPU, 212 is a bus, and 214 is an image reduction unit. Scene change point detecting section 201, magnetic storage device 202, monitor 203, frame buffer 204, main memory 205, input device 206, video interface 207, audio interface 210, image compressing section 209, and The image reduction unit 214 is connected to the CPU 211 via the bus 212, and the VTR 207 is connected to the video interface 208 and the audio interface 210.

  In FIG. 2, a CPU 211 sends and receives signals to and from other connected components via a bus 212, and each of the components is controlled by an access signal from the CPU 211. An instruction to the CPU 211 is given by an operator through an input device 206 such as a mouse or a keyboard. The VTR 207 reproduces a series of moving image information composed of a plurality of scenes, sends a moving image of the reproduced information to a video interface 208, and outputs an audio signal of the reproduced information to an audio interface. Send to 210. The audio interface 210 digitizes the input audio signal and sends it to the magnetic storage device 202. The magnetic storage device 202 stores the sent audio information. The video interface 208 converts the received moving image into a format handled by the moving image editing apparatus, and outputs the scene change point detecting unit 201, the magnetic storage device 202, the main memory 205, and the image compression. Unit 209 sends the image to the image reduction unit 214. The image compression unit 209 compresses and encodes the transmitted moving image and sends the encoded moving image to the magnetic storage device 202. The magnetic storage device 202 stores the sent video information. The scene change point detection unit 201 analyzes the input moving image for each frame, and detects a scene change point from the magnitude of the change in the color distribution between the frames. The image reduction unit 214 creates a reduced moving image, that is, an M-icon, in which each frame is reduced to 80 × 60 pixels from the analysis result of the scene change point detection unit 201. The created M-icon is sent to the magnetic storage device 202 and stored. Also, moving image analysis information (including the frame number of the scene change point) describing the relationship between the M-icon and the detection result of the scene change point detection unit 201 is also stored in the magnetic storage device. It is sent to 202 and stored. The monitor 203 displays the moving image stored in the magnetic storage device 202 based on the analysis information, and provides a GUI (Graphical User Interface) to the operator. The frame buffer 204 stores an image to be displayed on the monitor 203. The main memory 205 stores various control programs of the CPU 211.

  Instead of the magnetic storage device 202, another storage medium, for example, a magneto-optical storage device, or a remote file via a network may be used. Further, the mouse used for the input device 206 may use another pointing device such as a trackball.

  The operator sets a reduced moving image (M-icon) reflecting the scene analysis information obtained by the scene change point detecting unit 201 as an editing operation target, and has a hierarchical structure (tree structure) on the editing screen. By assembling in a shape, editing will proceed.

  FIG. 3 shows an example of the editing screen, which is displayed on the monitor 203. Reference numeral 300 denotes an editing screen, 301 denotes a tree structure display area, 302 denotes an M-icon, 303 denotes an enlarged schematic view of the M-icon, 304 denotes a material area, 305 denotes various function buttons, 307 denotes a plurality of cuts and This is an M-icon indicating that the scene has been edited as a unit. As shown in the tree structure display area 301, editing is performed by assembling the M-icons 302 into a hierarchical structure (tree structure) in the editing screen 300. The upper hierarchy is a representation of the lower hierarchy belonging to it as a single unit, and corresponds to a chapter or section in a story. The highest hierarchy represents the entire story. A material area 304 is an area in which the M-icons 302 created by the image reduction unit 214 are arranged based on the analysis result of the scene change point detection unit 201. The operator selects a material to be edited from the area and selects the tree. A tree structure is constructed in the structure display area 301. Various function buttons 305 are operation buttons for performing various edits on the edit screen 300.

  As described above, in the moving image editing apparatus, the burden on the operator can be reduced. That is, editing can be performed in units of scenes and cuts, so that the story can be easily assembled. In addition, since the input moving image is automatically divided into scenes, the operator does not have to worry about it. Further, since moving images can be stored and managed in a hierarchical structure, it is easy to search for necessary scenes and cuts.

  In the process of moving image production such as television broadcast program production and video program production, that is, in moving image editing, information (hereinafter, referred to as image accompanying information) relating to a video used for production, such as a photographing date, a photographing location, and a photographing intention. Rights-related information such as shooting-related information, portrait rights of cast members in the video, copyright of music, usable range, and expiration date; video-related information such as scripts and subtitles; editing-related information such as editing history and time code; Etc. occur in a wide range and in large quantities. Furthermore, a large amount of information having various degrees of abstraction represented by editing intention is generated. Hereinafter, a method for managing video accompanying information in a conventional nonlinear editing device will be described.

  A specific example (information management / display method) of a method for managing video accompanying information in a conventional nonlinear editing device will be described with reference to FIGS. FIG. 4 and FIG. 5 show, for each video material or still image material, video accompanying information such as material name, material medium type, material medium length, and comments. Reference numeral 401 denotes a display field of an icon for each material type, reference numerals 401-1 and 401-2 denote a material icon, reference numeral 402 denotes a display name of a material name, reference numeral 403 denotes a display field for distinguishing video, audio, and the like, and reference numeral 404 denotes a display of the length of the material. Reference numeral 501 denotes a display field of a representative icon of the material, reference numeral 502 denotes a display field of the title, type, and material length of the material, reference numeral 503 denotes a comment display field when editing the material, and reference numeral 504 denotes a display field of a label of the material.

  In FIG. 4, a material icon 401-1 or 401-2 for indicating the material type is displayed in a material type icon display column 401. For example, a material icon 401-1 indicates that the material is a program, and a material icon 401-2 indicates that the material is a scene. In addition, the material icon includes an icon representing one cut. The material name display column 402 displays the title of the material represented in the left material type icon display column 401 on the left side, and the display column 403 for distinguishing between video and audio, if the material is made of audio, A2 "and" V "or" V1 "if it is made of video. The length of the material is displayed in the material length display column 404 on the right side.

  Also, in FIG. 5, a display column 501 of the representative icon of the material includes a sound material icon 501-1, a still image material icon 501-2, a moving image material icon 501-3 with sound information, and a folder icon 501-4. A moving image material icon 501-5 without audio information is displayed. A title, type, and material length display column 502 of the material displays the title, type, material length, and the like of the material represented in the display column 501 of the representative icon of the material on the left. For example, in the right column of the audio material icon 501-1, "title", "moving image", and "material length" are written, and in the right column of the still image material icon 501-2, "title", "still". "Drawing" and "material length" are described. In the right column of the moving image material icon 501-3 with sound information and the moving image material icon 501-5 without sound information, "title", "moving image", and "material length" are described. In the right column of the folder icon 501-4, "folder name", "folder", and "number of materials in the folder" are described. Further, a display field 503 of the editing state of the material describes an editing state and simple information necessary for editing the material, and a display field 504 of a label of the material describes a label name of the material.

  4 and 5, when information as described above is added, an information field of the information to be added is searched for in the window, and the information field is selected by the input device 206 such as a mouse so that the information can be input. This is realized by inputting characters from the input device 206 such as a keyboard. For example, when it is desired to add a label name of “interview” to the moving image material icon 501-3, first, the information field 505 of the label name of the moving image material icon 501-3 is selected with a mouse to enable input. In this state, when "interview" is input from the keyboard, the character "interview" is displayed on the label name information column 505.

  However, in the method of displaying video accompanying information described with reference to FIGS. 4 and 5, it is difficult to display and manage information having various degrees of abstraction generated during editing of a moving image. Hereinafter, the reason will be described based on a simple specific example of the degree of abstraction of information.

  When producing a program, the operator attempts to create the program by considering the program in a hierarchical structure, such as the transfer of a story in a story or a chapter section. At that time, the operator's head has conceptual information that is a basis for assembling a hierarchical structure. For example, a case in which a documentary program depicting “Four Seasons of the Mountain” is produced will be taken as an example.

FIG. 8 is a diagram depicting conceptual information of a hierarchical structure assembled in the creator's head when a documentary program depicting “Four Seasons of the Mountain” is produced, and is a diagram for explaining the degree of abstraction of video accompanying information. But also. In FIG.
Specific example (1): The program is for introducing the four seasons of the mountains. The procedure of thinking of the operator when producing such a program is listed below.

  As image data on hand, "Image data 801", "Image data 802," where rivers increase in height with the melting water of ice, as icicles melt and drop in the faint sunlight. "Butterbur sprout is sprouting" image data 803, "Animals start moving from hibernation" Image data 804, "birds sing" Image data 805, "Vivid forest "Image data 806 dyed yellowish green", "Image of cicada" image data 807, "Fiery autumn leaves" image data 808, "Image data with one side covered by silver world" Data 809 is already owned.

  The operator first overlooks the image data on hand, plans to introduce the image data 817 of the “Mountain Four Seasons” in order from spring to winter, and plans to introduce the image data of “Spring”. It is assumed that the image data 814 is composed of four parts: image data 814, "summer" image data 814, "autumn" image data 815, and "winter" image data 816. If it is deemed that the video data on hand is insufficient, the acquisition of video data will be considered separately. In addition, I think that the contents of "spring" will be composed of three parts: "thaw", "budding", and "Keiho". And the "melting thaw" was shot in the form of "icicles melting and falling in the pale sunshine". The picture data 801 and "river melted in the faint sunlight." The video was taken with the water flowing up in the water. The river was flowing in the water with the melting water. The video data 802 consisted of the video data. I do. The image data 801 that “the icicles melt and drip in the pale sunlight” and the image data 802 that the “river is flowing with the melting water of the river” are raw image data. It is visual information and is the most specific (low abstraction) information.

  Other "spring" contents include "sprout" and "butterbur sprout sprouting" as image data 803, and "Keiko" as "animals start moving from hibernation" image data. By combining the image data 804 with the "birdsong" image data 805, the image data is composed of the image data 811 of "budding" and the image data 812 of "Keibu". It is assumed that the user wants to edit the video data 813 of "Spring". The image data 810 of the "thaw", the image data 811 of the "budding", and the image data 812 of the "Keibu" are conceptually different from the image data 801 and 802. (A relatively high level of abstraction). In addition, the structure of the video data 814 of "summer", the video data 815 of "autumn", and the video data 816 of "winter" can be considered in the same manner as the video data 813 of "spring". Therefore, although omitted, the image data 805 of "birdsong", "the image data 806 where the forest is dyed vivid yellow-green", and the image data 807 of "semi-ring" are omitted. The image data 808, "fiery autumn leaves", and the image data 809, which is entirely covered with the silver world, are also the most specific information. The "spring" video data 813, the "summer" video data 814, the "autumn" video data 815, and the "winter" video data 816 are the video data. These are more conceptual (higher abstraction) information than the data 810, 811 and 812. Furthermore, the video data 817 of the "seasonal season", which is the entire configuration of the program "seasonal season", is the most abstract information. As a result, this program has editing intention information having four levels of abstraction. Such information is important as clarifying the editing intention and as a search keyword when reusing the video.

  If the user intends to manage the editing intention information in the form of FIG. 4 described above, for example, the situation becomes as shown in FIG. 1201-1 is a video material after editing, that is, a material icon representing the video data 817 of the program "Four Seasons of the Mountain", and 1201-2 is a video data that "the icicles melt in the faint sunlight and the water drops." Reference numeral 1201-3 denotes a material icon representing the video data 802, which indicates that "the river is flowing with increasing water by melting snow." Reference numeral 1202 denotes an information column in which an editing intention of each material icon is entered. Columns for other material icons and their accompanying items are omitted because they are not described. The video data 801 and 802 can be entered in the information column 1202 as respective information. Also, video data 817 can be entered in the information column 1202 as the information. However, information of an intermediate abstraction level such as video data 810 and 813 does not have a corresponding entry column. The same applies to the video data 814 to 816, 811 and 812. If all the video data 817, 813 to 816, and 810 to 812 are written in the row of the material icon 1202-1, a simple parallel notation is obtained, and the information level (abstraction level) is lost. . As described above, in a superficial and uniform method in which information can be displayed and managed only in video material units as shown in FIGS. 4, 5 and 12, it is possible to appropriately cope with information having various degrees of abstraction. I can't do it.

  Specific example (2): There is a program called narration. This is also one of important video accompanying information, and is information closely related to the flow of the video. As described in the specific example (1), the narration A of "in the warm sunshine in spring ..." is given to the image data 801 of "the icicles melt in the pale sunshine". Let us consider a case where a narration B of "butterbur tomatoes ..." is added to the video data 803 "butterfly tomatoes are sprouting". In such a case, the narration A is associated with the image data 801 where the icicles melt in the pale sunlight, and the narration B is the image of the "butterbur sprout". It is necessary that information be associated with each video on a one-to-one basis, such as being associated with data 803. Thus, it can be said that the narration information is the most specific (lower abstract) information that is closely attached to the video. In the information management method as in the specific example (2) described above, the information column of the narration information is provided in FIGS. 4, 5, and 12, and the description thereof is added. Even if the frame number and time of the corresponding video are given, it is obvious that the correspondence is difficult to understand because it is only a sequence of numbers. Also, when there is a narration that spans a plurality of materials, there is no proper means to describe it. For example, even if the description of the narration information such as the narration A and the narration B is added to the display field 503 of the editing state of the material, the narration A and the narration B may be added to any video. I don't know if it works. This applies to the same kind of information such as captions and dialog information.

Specific example (3): When a certain person appears in a certain section of a series of videos produced, relevant information such as a portrait right and a profile related to this person is generated as one of the video accompanying information. I do. Such information is information applied only to a part of the material. However, depending on the length and type of the video, for example, if the video has a large number of characters, the amount of information increases immediately. If this is to be described and managed in such a manner that one information column is provided for one information type as shown in FIGS. 4, 5 and 12, the screen space or the like can be used immediately. It is clear that problems arise.
JP-A-9-200687

  The display column of the video accompanying information described above can describe superficial information such as a material name and its length, but it is difficult to describe it in association with a flow of a video such as script information. Further, it is impossible to describe information applied only to a part of the material, for example, profile information of a person appearing only in a part.

  For example, as in the above specific example (1), the operator usually considers programs in a hierarchical structure and tries to create them. However, the concept that occurs during production thinking as described above is one of important video accompanying information, and four levels of abstraction levels are provided, from information with a high level of abstraction to information with the lowest level of abstraction. Is present in one program. Such information cannot be described or managed by the above-mentioned conventional information management method. Further, as in the above-mentioned specific example (2), the narration information of the narration information is displayed in the conventional display column by the conventional display method. Even if a description is added, it is not known to which video each piece of the narration information corresponds. As described above, it is impossible to clearly describe and manage information generated along the flow of video editing by a conventional method. The same applies to the same type of information such as captions and dialog information.

Further, as in the specific example (3) described above, the conventional display method causes a problem in screen space and the like.
As described above, video accompanying information in a conventional moving image editing apparatus called a so-called non-linear editing apparatus is only a position such as a length of a video material or a comment of an operator. Since only an information management method capable of providing information can be performed, it has not been possible to sufficiently cope with various video accompanying information having different levels of abstraction as described above.

  However, in the process of video production, information about the video, for example, shooting-related information such as shooting date and time, shooting location, and shooting intention, rights-related information such as portrait rights of performers, copyright of music and the like, usable range, expiration date, script, A large amount of video additional information such as subtitles, editing history, editing information such as time code, and the like are generated.

  In editing a tape base conventionally performed by a broadcasting station for such video accompanying information, a video creator collects the information, edits it, broadcasts a memo in the form of a memo paper, a flexible disk, or the like. Was recorded and stored. The video information is stored on a video tape, a hard disk or the like. As described above, since the media to be stored differs depending on the type of information, it is necessary to separately manage the media. As time elapses, the relation (association) with respect to each of these pieces of information becomes ambiguous. It was often dissipated.

  An object of the present invention is to provide a moving image editing apparatus that flexibly associates these pieces of video accompanying information and enables easier unified management.

  According to the present invention, in order to solve the above-described problem, it is possible to manage information according to the degree of abstraction by associating various types of video accompanying information with information having various levels of abstraction for each layer using a tree structure. And Also, by associating the information closely attached to the flow of the image with the tree structure of the M-icon displayed at the time of editing, the corresponding image can be clearly understood, and the narration over a plurality of materials can be performed. Was realized by a method of associating with the upper layer of the tree structure.

The method of associating is realized by a GUI such as a method of preparing icons for various source media of video accompanying information and dragging and dropping the icons on the M-icon.
Furthermore, the analysis information obtained by applying the image analysis technology to the image material is displayed as an analysis information icon associated with the analysis information, thereby enabling flexible association.

Furthermore, a display zone is provided for each M-icon so that the user can visually recognize what information is associated with each M-icon.
As a further method, an information column is provided in which video accompanying information can be input in an arbitrary format, information in the information column is designated for each required group, and information items are assigned to each group. As a result, an editing apparatus having an easy input method and an easy display method has been realized.

  ADVANTAGE OF THE INVENTION According to this invention, fine-grained unified management of video accompanying information is attained, and dissipation of accompanying information does not occur. It also enables fine-grained information management according to the degree of abstraction of information. That is, the method of inputting and displaying the video accompanying information is simplified, and the operation can be performed easily and quickly. Further, it is possible to quickly grasp what additional information is included in the target video material during editing, and it is possible to easily confirm detailed information. Further, since the operating means is realized by a simple interface, the operation can be performed even with a low skill level.

The present invention relates to a method for centrally managing video accompanying information in a moving image editing apparatus.
One embodiment of the present invention will be described with reference to FIGS.
FIG. 11 is a diagram schematically illustrating an operation in which video and audio are edited and stored in the magnetic storage device from the VTR. FIG. 2 is a block diagram showing a configuration of the moving image editing apparatus, which has the same configuration as that described in the related art.

  11 and 2, the operation in which video and audio are edited and stored in the magnetic storage device will be described. First, a video signal is output from a video tape mounted on the VTR 207 in accordance with an instruction from the input device 206, and a moving image in frame units is inspected from the VTR 207 via the video interface 208 and the bus 212 for a scene change. It is supplied to the outlet 201. The scene change point detection unit 201 digitizes the input moving image, analyzes color distribution information between the images, and detects a scene change point. The frame number of the scene change point generated by the scene change point detection unit 201 is stored in the magnetic storage device 202 as moving image analysis information (scene change point information). At the same time, an M-icon is stored in the magnetic storage device 202. The M-icon is a reduced image (for example, 80 pixels × 60 pixels) obtained by reducing the moving image input to the scene change point detecting unit 201 in the image reducing unit 214 in accordance with the size of the GUI environment to be displayed. Pixel), which is an operation target in the editing apparatus. Generally, in order to take out a predetermined frame from an encoded moving image and return it to a video signal and reproduce the image, it is necessary to decode the encoded moving image. Processing time is required. If the reduced image (M-icon) is stored in advance as a high-speed display image as in the above-described embodiment, the processing time can be shortened without requiring the processing time for decoding, and the image can be quickly displayed. You can check the contents.

  At the same time, the moving image is encoded by the image compression unit 209 using the image compression technique and stored in the magnetic storage device 202. This moving image (compressed moving image) is used, for example, when it is desired to view the final editing result in detail. As for audio, an audio output signal of the VTR 207 is digitized via an audio interface 210 and stored in the magnetic storage device 202.

  The operator instructs the reading of the M-icon registered in the magnetic recording device 202 by using an input device 206 such as a mouse or a keyboard. In accordance with this instruction, the CPU 211 reads the scene analysis information of the corresponding moving image from the magnetic storage device 202. Based on the information, only the first frame of each scene is read from the M-icon and displayed on the monitor 203. By operating the displayed M-icon, the moving image editing apparatus of the present invention is operated.

  FIG. 1 is an example of an editing screen using the M-icon described above. The reference numerals in FIG. 1 are the same as those in FIG. 3 described in the prior art, but 306, 306-1, 306-2, and 306-3 denote an information presence display zone, and 311 denotes an M of cut or scene. -Icons, 312 are M-icons for a plurality of cuts and scenes, 313 is an M-icon for the entire story, 321 is an information button, 322 is a character detection instruction button, 331 is a scanner icon, 332 Is a FAX icon, 333 is a TEL icon, and 341 is a portrait right icon.

  In FIG. 3, the operator edits the story by assembling it into a hierarchical structure (tree structure) as shown in a tree structure display window 301 using the M-icon 302. Go. This editing structure using the tree structure has the advantages that the video structure can be easily grasped visually and that the stream can be easily assembled. Bring the best environment. For example, a management method for the three specific examples described in the related art will be described below.

Specific example (1)
When the program described in the related art is created by the live image editing apparatus, the screen is as shown in FIG. FIG. 10 shows another embodiment of the editing screen of the present invention, wherein 1001 to 1005, 1011 to 1013, 1021, 1022, and 1031 are M-icons, and other symbols are the same as those in FIG. The M-icons 1001 to 1005 at the lowermost level represent the video data itself, the M-icon 1001 is the video data 801 of "Icicles in pale sunlight ...", and the M-icon 1002 is " The video data 802 of "In the thaw water ...", the M-icon 1003 is the video data 803 of "Butterbur sprout ...", the M-icon 1004 is the video data 804 of "Animals hibernating ...", M-icon The icon 1005 is video data 805 of "birds singing ...". Similarly, other M-icons (not shown) at the bottom of the tree are other video data. For the lowermost M-icon, the information having the lowest abstraction in the above-described concept, for example, the M-icon 1001, "the icicle has melted in the faint sunlight and the water has dropped" And the M-icon 1002 is associated with the explanation information that "the river is flowing with the height of the snowmelt."

  In the next higher level, the M-icons 1001 and 1002 are combined to form an M-icon 1011. The image data 801 is composed of image data 801 in which the icicles have melted and fallen in the pale sunlight, and image data 802 in which the river is flowing with the melting water in the water. This is one scene, and the M-icon 1011 is associated with the explanation information of “thaw”. Similarly, the M-icon 1012 is associated with the explanation information of “budding”, and the M-icon 1013 is associated with the explanation information of “Keibu”.

  In a further upper layer, M-icons 1021, 1012, and 1013 are combined to form an M-icon 1021. This means that one "spring" scene is formed from three scenes of "thaw", "sprout" and "Keihaku", and this M-icon 1021 describes "spring". Associate information. Similarly, the explanation information of "summer" is associated with the M-icon 1022.

The uppermost M-icon 1031 represents the entire program. This M-icon 1031 is associated with descriptive information of “Four Seasons of the Mountain” and purpose information such as “Introducing Four Seasons of the Mountain”.
Specific example (2)
The narration information described in the description of the prior art is, for example, a narration 811 such as "in the warm sunlight of spring ...", a narration 812 such as "butterbur toga ..." By associating with the M-icon 1003, the video and the narration information can be managed completely one-to-one. In the process of video editing, a tune may be overlaid on a video as BGM later. Such BGM is accompanied by information such as the title, length, performer, and copyright of the music. When associating such information with a video, the BGM is often associated with a plurality of cuts or scenes, so that the BGM is associated with a middle layer to a higher layer. In the example of FIG. 10, for example, when spring-like BGM is superimposed on the entire "spring" scene, the BGM information is associated with the M-icon 1021. Further, more global information such as the broadcast schedule of the edited program is associated with the M-icon 1031 in the uppermost layer representing the entire story. As described above, the information management method according to the present invention by associating information with a tree structure enables fine-grained information management according to the degree of abstraction of information.

  When the above association is performed, for example, it is determined that the script and subtitle character information are associated with the editing related information zone 306-1 of the M-icon 311 representing a cut or scene in a lower hierarchy. The "table" icon and the "character" icon are displayed (not shown in FIG. 1), and the editing related information zone of the M-icon 312 extending over a plurality of cuts and scenes in the middle hierarchy. In 306-2, a "song" icon, a "person" icon, and a "author" icon are displayed (not shown in FIG. 1), which indicate that the song is associated with the title of the BGM, the name of the player, and the copyright. In the editing related information zone 306-3 of the M-icon 313 representing the story at the highest level, a "history" icon indicating that it is associated with the broadcast history is displayed (FIG. 1). Is not shown). It should be noted that video accompanying information relating to the reduced moving image itself, which does not depend on the combination of video data or the editing result, can also be associated in the material area 304.

  In the conventional moving picture editing apparatus, such various kinds of information having different levels of abstraction can only be managed in a uniform manner for each video material. Enables fine-grained information management according to the degree.

  Moving image compilations such as television broadcast programs and video programs include a full version in which all videos are played from the beginning to the end, and a digest version in which only key points are extracted and summarized. It is assumed that a complete version has been edited and created with this editing apparatus. In the lower layer of the created tree structure, it is determined whether or not to use it for the digest version for each cut or scene, and the cut or scene used for the digest version is given information indicating that the digest version can be used. . In addition, switching information between the full version and the digest version is given to the editing-related information zone 306-3 of the M-icon 313 in the uppermost layer with an "all" icon and a "da" icon (FIG. 1). Not shown). In fact, when the user wants to use the digest version, the creator switches instantly to the digest version simply by switching the full version / digest version information given to the top M-icon. In this way, by allowing individual information to be added to the lower layer and its management information to be added to the upper layer, one edited result has various variations and can be used for various broadcasts.

  Next, how an actual editing apparatus takes in various video accompanying information into a computer and associates it with video information, and how to display the associated accompanying information on an operator will be described.

  First, an example of an association method in the editing apparatus will be described. In the tree structure shown in FIG. 1, a description will be given by taking as an example a case in which, for a scene represented by an M-icon 302, image right information, for example, portrait right information relating to a character A in the image exists.

  Examples of media for transmitting portrait right information to an operator include memo sheets, faxes, telephones, and the Internet. If the portrait right information is provided on a memo sheet, there are the following two methods for associating. First, the information button 321 is clicked with the M-icon 302 selected with the mouse. Then, an information window as shown in FIG. 6 for inputting and displaying various information related to the scene is displayed on the monitor 203. In FIG. 6, reference numeral 600 denotes a right-related information window, 601 a check box for instructing display of a portrait right icon, 602 a information display column, 603 a tag button for switching the information window to a window related to another information genre, Reference numeral 604 denotes a check box for instructing highlighting regarding the expiration date, 605 a link button, 606 an OK button for validating the input result, and 607 a cancel button for invalidating the input result. This information window 600 displays a list of information items and their information contents. When inputting the portrait right item, the operator inputs the contents of the memo into the portrait right entry field 602 using the input device 206 such as a keyboard. The method of inputting and displaying the information to be added in an information column prepared in advance for inputting the information is hereinafter referred to as a fixed format method. The examples of FIGS. 4, 5 and 12 described in the prior art are also of this format.

  FIG. 7 is a flow chart of the operation as viewed from the apparatus side. When an interrupt input from the input device 206 (FIG. 2) such as a mouse occurs (step 100), the CPU 211 first checks whether the information button 321 (FIG. 1) is pressed (step 100). 101). As a result of checking, if so, it is checked whether or not the M-icon 302 was selected before the interruption occurred (step 102). As a result of the check, if it is determined that the user has been selected, an information window 600 (FIG. 6) is displayed on the monitor 203 (step 103). Next, the CPU 211 waits for an interrupt from the input device 206 such as a mouse keyboard again (step 104). When an interrupt occurs, the CPU 211 executes each process according to the type of the interrupt (steps 105 to 111 → steps 112 to 119). If there is an input from the board (step 107), the CPU 211 writes the input contents into the main memory 205 (step 113). When the check box 601 is checked by the mouse of the input device 206 (step 108), the CPU 211 reads out and switches the display on / off information of the portrait right icon 341 on the main memory 205 in advance, and switches again the main memory. 205 is written (step 114). When the tag button 603 is pressed with the mouse (step 111), the CPU 211 switches and displays the information genre of the window 600 according to the type of the pressed tag button (step 117).

  If the highlighting instruction check box 604 is checked by the mouse of the input device 206 (step 109), the CPU 211 reads out display on / off information of the portrait right icon 341 on the main memory 205, and if it is turned on. (Step 115), the highlighting on / off information of the portrait right icon 341 on the main memory 205 is read out and switched in advance, and written in the main memory 205 again (step 119). When the link button 605 is pressed by the mouse of the input device 206 (step 110), the CPU 211 checks the presence or absence of the link content, and displays the link content on the monitor 203 (step 116). . When the OK button 606 is pressed by the mouse of the input device 206 (step 105), the CPU 211 reads all information written in the main memory 205 since the information window 600 was opened. The information is re-stored in the main memory 205 as accompanying information of the M-icon 302 (step 112). Then, the window 600 is closed, and the selected state of the M-icon 302 is released to return to the original state (step 118). When the cancel button 607 is pressed (step 106), all the information written in the main memory 205 until the information window 600 is opened is discarded, the window 600 is closed, and the M-icon The selected state of 302 is canceled and returned to the original state (step 118). In this way, individual associations are realized.

  More specifically, with respect to a scene represented by the M-icon 302 in FIG. 1, video accompanying information, for example, regarding the character A in the video, “the video in which the person A appears will be displayed until December 31, 1998. The following describes an example in which portrait right-of-use expiration information “only available” exists. Such information is usually transmitted to the operator in the form of notes. The operator first clicks on the information button 321 with the M-icon 302 selected with the input device 206 such as a mouse. Then, an information window as shown in FIG. 6 described above is displayed on the monitor 203 in order to input and display various information related to the scene. The operator searches the window for an information display column corresponding to the information to be entered. If found, the information display column is made selectable by an input device 206 such as a mouse, and in this state, characters are input by the input device 206 such as a keyboard. The above-mentioned portrait right-of-use expiration date information that "the video in which the person A appears can be used only until December 31, 1998" is an information display column in which the entry column 604 next to the item of the expiration date appropriately corresponds. The operator writes "December 31, 1998" here using the input device 206 such as a keyboard. If the user wants to make the input information valid and hold it on the editing apparatus, he clicks the OK button 606 with the input device 206 such as a mouse.

  Another method of associating the portrait right information with the note paper is to use a scanner. The operator uses a scanner to read data into the computer. Then, the captured image data is displayed as a scanner icon 331 in the material area 304 of FIG. The scanner icon 331 is dragged and dropped on the M-icon 302 with the mouse. The computer applies character recognition technology to the dropped image data, automatically determines that the description is a portrait right description, and fills in the portrait right item. The portrait right information is associated with the M-icon 302 by the above method.

  If the information is received directly on a computer, such as a fax, it is displayed as a FAX icon 332 in the material area, and the portrait right can be dragged and dropped on the M-icon 302 with the mouse. Is filled out in the item.

  Also, when the voice is provided by telephone, the voice is taken into the computer. The captured audio data is displayed in the material area 304 as a TEL icon 333, and the following operation is as described above.

  In FIG. 1, a method of taking in multimedia information by using multimedia icons represented by a scanner icon 331, a facsimile icon 332, and a TEL icon 333 has been described. However, other methods such as Internet communication, Internet, communication equipment, etc. Obviously, the capture by the method can also be realized by the above-described operation or a similar method. In addition, the display location of the multimedia icon may be different from the material area 304, another window may be opened, and one type of icon, for example, a plurality of scanner icons may be provided. If the display cannot be performed on one screen, the screen can be switched by scrolling the screen or changing the page.

  FIG. 9 illustrates a case where the same portrait right information is associated over a plurality of scenes. Reference numerals 701 to 706 denote M-icons each representing one cut or scene, reference numeral 707 denotes an M-icon one level higher than the M-icons 701 to 704, and reference numeral 708 denotes all M-icons 701 to 701 on the screen. 706 is an M-icon. When it is desired to associate a specific M-icon from the M-icons 701 to 706 in FIG. 9, a plurality of M-icons 701 to 706 are selected and the same operation as described above may be performed. If the M-icons to be selected are 701 to 704, the M-icons can be executed by selecting the M-icon 707 at a higher rank, or may be associated with the M-icons still in the material area 304 before editing.

  The above method is a procedure when there is a purpose of associating a specific M-icon, this time with the M-icon 302. Here, there is a more convenient association method in the case where the character A appears in any scene at a glance, or in a large number, so that multiple selection is difficult. Hereinafter, description will be made with reference to FIG. 9 as an example. When the character A appears only in the M-icons 701 and 703 in the video represented by the M-icons 701 to 706, first, the operator sets the M-icon 708 in the uppermost layer representing the entire story. Is selected with the mouse, and the character detection instruction button 322 is pressed with the mouse. The M-icon to be selected is not limited to the uppermost layer, and may be an upper-layer M-icon, for example, (M-icon 707) when the section in which the character A appears is known in advance. Then, a list of videos belonging to the M-icon 708, that is, videos of the M-icons 701 to 706 is displayed at appropriate intervals. The operator finds one screen on which the character A appears from among them, and instructs with the mouse that this is the character A. Then, by pressing the character detection instruction button 322 to start detection, an instruction to start detection is issued. The editing device extracts the feature amount, for example, skin color, hair color, height, body shape, and the like from the character A specified in advance, and extracts the M-icons 701 to 706 based on the extracted feature amounts. , Perform the detection. This detection function is a known technique, and is an application of an image recognition technique as in the above-described scene change point detection. Upon completion of the detection process, an icon that abstracts the obtained detection information, that is, a character detection result icon 709 is created and displayed. When this icon 709 is selected with a mouse and information such as portrait right information is associated using the above-described keyboard input method or drag-and-drop method, M-icons 701 and 703 in which the character A appears The information is automatically distributed to and the association ends at once. Such a function is to detect a standard voice used in a commercial or the like every time, for example, a voice such as a “catch phrase” of a product to be advertised that flows simultaneously with a video in the commercial by a voice recognition technology, and detects the detected sound. For example, the information of the product maker is associated with the application, or a specific sound effect, for example, the sound of a wave is detected by voice recognition technology, and the information on the sea is associated with the detected scene. Enable various associations.

As described above, the video analysis information obtained by the video analysis technology is effectively used to realize more flexible association between the video information and the video accompanying information.
Next, how to display the associated information will be described. In the M-icon 302 associated with the portrait right information by the above method, a small portrait right icon 341 is displayed in the information existence zone 306 provided below the reduced moving image. This indicates that portrait right information is associated with the scene. This makes it clear at a glance what information is added to the scene, and also alerts an editor who intends to use the scene to use it. The icon may be a symbol, an illustration, a picture, or the like, as well as a character. In addition, in a scene to which video use expiration information is added, when the expiration date has already expired or the expiration date is near, the buttons are displayed using distinctive colors or frames. This is very effective for preventing the expired scene from being used by mistake. In this way, by emphasizing such as changing the color, more detailed information can be given to the display. This can be done by changing the size or adding a decorative frame.

  When viewing the information content associated with the scene represented by the M-icon 302 in FIG. 3, the operator clicks the information button 321 with the M-icon 302 selected with the mouse. Then, an information window as shown in FIG. 6 is displayed. The window 600 is a multi-layered window for each genre, such as shooting-related information, right-related information, video additional information, and editing-related information. The display of the portrait right icon 341 can be turned on / off by a check box 601. A link button 605 is displayed next to the information column 602 for information items provided from electronic media such as a fax, a scanner, and the Internet by the above-described association method. When the operator presses the link button 605, image data captured by facsimile or scanner is displayed on the monitor 203. On the display, information such as the fax number of the transmission source is displayed. Further, the voice information obtained by the telephone is also reproduced by depressing the link button 605. As described above, a method for easily calling the multimedia information from the information window is provided.

  Further, the link button 605 is used, for example, when the character profile information is on a home page of the Internet, the home page address is entered in the character profile section of the information window 600. By inputting, it can also be used when linking to the home page.

  When a search is desired to be performed on the associated information group, the search is performed as follows. First, an M-icon located at the top of the search target in the tree structure is selected. As for this, multiple selection is also possible. In this state, when a search button in various function buttons 305 is clicked with a mouse, a window for inputting search conditions is displayed. The search condition includes, for example, a keyword condition such as a name and a date, a feature amount condition extracted by applying the above-described image recognition technology, and a condition such as a brown hair woman. Alternatively, when camera work information or the like has already been associated, search can be performed under conditions such as a zoom-in image. After inputting search conditions, clicking the search button starts the search. The search is completed and the search result is displayed. If found, the corresponding M-icon is highlighted by coloring. If not found, a message to that effect is displayed.

  When a multimedia icon represented by the FAX icon 332 is selected and the search button is clicked, all M-icons associated with the fax information are highlighted and displayed. This is the same for other multimedia icons such as a scanner icon.

The search here corresponds to a call opposite to the call of the multimedia information from the video information by the link button 605 described above, and a bidirectional call method is realized.
Furthermore, even when a video analysis information icon represented by the character icon 709 obtained by applying the video analysis technology described above is selected, all the associated M-icons are similarly highlighted and displayed instantaneously. Search is possible.

  Next, an information input method based on the fixed format method described with reference to FIG. 6 and another information input method (hereinafter, referred to as a free format method) will be described. The types of video accompanying information cover a wide variety of genres. Such information is generally managed by classifying such information into similar groups. However, the method of classifying such information is different for each person who uses the information or for each production site. For example, at a production site, rights-related information is important in business, and you may want to group the rights-related information so that it can be viewed. At another production site, you may want to group together only the necessary expiration information for the required video, because not all rights are needed. In addition, the exact type of information required will vary from person to person and production site. Furthermore, the video accompanying information does not necessarily exist uniformly in all material videos. For example, not all images have a portrait right, and some images do not have portrait right information. In this way, the video accompanying information is, as it were, a small quantity multi-product type information.

  The fixed format method is a method in which information fields are uniformly prepared in advance for all materials. In order to cope with a wide variety of information by this method, it is necessary to provide a large number of information columns. There is no problem as long as the information is added to all the information fields of a large number of genres. However, in most cases, the video accompanying information is small-quantity, multi-product type information, and only a part of the installed information column is used, and the information column is often full of blanks. That is, an extra GUI space must be prepared for information that does not exist. The increase in the GUI space causes a problem that it is difficult for an operator to grasp the existence of information. Furthermore, it is difficult to manage even when there are a plurality of information of the same type.

  This will be described with reference to FIG. In FIG. 5, there are three types of information: "title" represented by the information column 502, "comment" represented by the information column 503, and "label" represented by the information column 504. The column of "title" is a column for entering and displaying the name and type of the material or folder, the material length or the number of materials in the folder, and the like. This kind of information is always present in any material. As can be seen from FIG. 5, for such information, information is entered in the entire column of "Title", and there is no waste on the GUI space. However, when looking at the adjacent “comment” column, the information column of the audio material icon 501-1 and the folder icon 501-4 is blank. The same applies to the "label" column, and these blanks are wasteful on the GUI space.

  In this example, since there are five materials and three types of information, there is not much problem. However, when the number of materials and the types of information increase, waste of GUI space becomes a serious problem. In addition, "comment" information such as "cut a scene crossed by a person 0: 00: 01: 12" is already added to the information column 503 for the moving image material icon 501-5. If you want to add "comment" information, you need to increase the number of lines in the entry field. When the number of lines is increased, blank lines are increased one by one in the columns of "title" and "label", which also wastes the GUI space. The above is a problem on the GUI.

  The following are operational problems. At the site of moving image editing, how is the video material captured, from the shooting information such as the shooting date and time, the material information such as the material name and material length, the right information such as the expiration date and the usable range, and the video material? In many cases, information such as editing instruction information such as how long a video should be edited and finally finished should be provided in the form of a memo. As the introduction of computers at the video editing site has progressed, these memos have been changed from the non-computer form of memos to the form that can be easily transmitted to computers such as text files. It is changing. A description of the information to be added as described above already exists in the form of a text file or the like. For example, the information is taken into an editing device via a flexible disk, the Internet, an intranet, or the like, and distributed to each information type. You may try to add it. At this time, the operation procedure in the fixed format method is to open a text file, find out the corresponding content from the text file, cut out the character string with a mouse or the like, copy it to a memory, and then use the above method. It is necessary to take steps such as making the information column ready for input and pasting there. Further, when the item to which the entered information belongs is moved, it is necessary to re-enter the information in the information field of the change destination and then delete the information of the change source, and thus the operation procedure is complicated.

  Next, operational problems will be described. As described above, a variety of information is provided to a moving image editing site, but sometimes the provided information does not have a suitable information classification in a prepared information classification. In some cases, a plurality of pieces of information are combined and transmitted in the form of one sentence. There may be a case where the user wants to associate the information as it is, or a case where the assignment to each piece of information is supposed to be performed later and is temporarily input. In contrast to the above case, the fixed format method is inconvenient in many cases because it is necessary to always divide and associate the provided information.

  In the above-mentioned case and in the case of information of a small quantity and multi-product type, a method of flexibly inputting and displaying such video accompanying information will be described below. First, regarding the problem of the GUI space, the present invention does not prepare a pair of an information item and an information column in advance as in the conventional method, but uses an arbitrary format such as an itemized list or a written sentence. Information is entered in a general-purpose information field that can be entered, and then a tag button of an information item corresponding to the entered information is pasted. In other words, as many GUI spaces as necessary are allocated where necessary, and no extra GUI space is required for information that does not exist. In addition, since necessary information can be instantaneously displayed by the sort button, the information can be easily confirmed. Further, even when a plurality of pieces of information of the same type exist for the same material, the information item tag button can be pasted to each piece of information a plurality of times, so that an easy and flexible response is possible.

  Next, as an operational problem, when the information to be added is provided in the form of a text file or the like, the information can be directly taken into the moving image editing apparatus by using a capture button described later. Was made possible. Therefore, complicated operation procedures as in the related art are unnecessary. In addition, since the content can be examined after being captured, information can be input or added as if it were a correction of a sentence. Further, the change of the information item of the already added information can be realized by only one action such as dragging and dropping a new information item tag, thereby simplifying the operation.

  For operational problems, a fixed format method is used by using an information field that allows entry of arbitrary formats such as bullet points and sentences, and information item tag buttons prepared in a hierarchical structure. As described above, it is not necessary to input information by subdividing it in advance, and at present, it is possible to add information in a rough state and allocate the information later. Also, preparing information items in a hierarchical structure means that if the information items you want to add are close to nuances but not exactly appropriate, you can use the upper information item tag button By doing so, it was possible to respond flexibly. Further, the hierarchical arrangement of the information item tag buttons has an effect that it is easy to search for a desired tag button.

  Further, the information type can be added only by adding the information item tag button. Also, the hierarchical structure of information item tag buttons can be set. Therefore, it is possible to flexibly respond to the use of the moving image editing site to be used.

  A method for inputting and displaying the video accompanying information in the free format will be described below with reference to specific embodiments. The procedure required to call the information window is the same as in the fixed format system. The called window is as shown in FIGS. 13 to 18, reference numeral 100 denotes an information window, 101 denotes an information item tag button of various video accompanying information, 102 denotes a tag attachment area to which an information item tag is attached, 103 denotes an information field in which an arbitrary format can be input, 104 is a scroll bar for setting the display range of the information column, 105 is a switch button for switching the information item tag to be displayed, 106 is an importance setting button for setting the importance of information, and 107 is information displayed in the information column. Is a sort button for instructing a process for rearranging the text files, 108 is a capture button for instructing to capture the contents of the text file in the information field, 606 is an OK button for validating the input result, and 607 is a cancel button for invalidating the input result. is there.

  In FIG. 13, when the information window 100 is called, the operator first inputs the transmitted information through the input device 206 such as a keyboard. In this example, it is input that "the video in which the person A appears can be used only until December 31, 1998". Then, the result is as shown in FIG. Next, an input device 206 such as a keyboard is used to input a line feed at the beginning and end of the character string used as information in the written character string, and the character string is cut out from the entire sentence. In this example, a line feed is entered at the beginning and end of the character string “December 31, 1998”. Then, the result is as shown in FIG. The method of extracting the character string may be another method such as copy and paste, other than the method of line feed. As can be seen from FIG. 15, above and below the cut-out character string, a cut-out specifying line 111 that clearly indicates that the character string has been cut out is displayed. Next, a corresponding information item tag button is searched for from the tag button group in which the information item tag button 101 is set. The information item tag button group is stored in a hierarchical structure as shown in FIG. The operator switches the information item tag button to be displayed by moving between the layers by clicking the switch button 105 with a mouse. In this example, the "rights information" of the information item tag button 101 in FIG. 15 is selected with the mouse, and in this state, the downward arrow of the switching button 105 is clicked with the mouse. Then, as shown in FIG. 16, the information item tag button 101 is located at a lower level in the hierarchical structure of “right information” in FIG. 19 from “right information”, “photographing information”, “material information”, and “edit information”. "Portrait information" and "copyright information". Further, when "portrait right information" of the information item tag button 112 is selected and the downward arrow portion of the switching button 105 is similarly clicked with a mouse, an information item which is lower in the hierarchical structure of "portrait right information" in FIG. The abbreviation “Xiao / Name” indicating the meaning of “Portrait holder's name” of the tag button 113, the abbreviation “Xiao / expiration date” indicating the meaning of “expiration date”, and the abbreviation “Xiao” indicating the meaning of “usable range” / Usable "is displayed, as shown in FIG.

  The operator drags the information item tag button 113 with the mouse and drops it to a position just to the left of the above-described cut-out character string and in the tag pasting area 102. Then, as shown in FIG. 18, a duplicate information item tag button 114 of the dragged information item tag button 113 is created and arranged on the left side of the desired character string.

  Further, a case where it is desired to associate the character string "Person A" in the character string "Picture A appearing in the first input can be used only until December 31, 1998" as portrait right holder name information This is realized by cutting out the character string in the same manner as described above, and selecting and dragging and dropping the “expiration date” of the information item tag button 113 by the same operation as described above. Although not shown in FIG. 13, the link button 605 (FIG. 6) in the fixed format described above is provided in the tag button area 109, and operates in a hierarchical structure as described above.

  When the number of pieces of information exceeds a certain number and cannot be displayed on one screen, the scroll range 104 can be moved with a mouse to change the display range. Also, when the tag buttons 101, 112 and 113 cannot be displayed at once in the tag button area 109, the display range can be changed by a scroll bar or the like, though not shown. The hierarchical structure shown in FIG. 19 is an example of necessary video accompanying information, and a part necessary for the description is partially omitted.

  When the importance setting button 106 is clicked on with a mouse in a state where an arbitrary information item tag button is selected, the importance of the information can be set. The color, font, outer shape, and the like of the information item tag set as high importance change, so that the operator can recognize at a glance that the information item tag is important.

  The sort button 107 is a button for changing the display order of the already added information. If the user presses the sort button 107 to instruct the above-mentioned sorting by importance, the information is displayed in order from the top to the bottom of the screen according to the importance of each information. If an instruction to display only the right-related information is issued, only the right-related information is found from the added information and displayed. This is an effective means to find important or specific information.

  Further, in the above example, the first character string "A video in which the person A appears can be used only until December 31, 1998" is input from the keyboard. When the operator clicks the capture button 108 with a mouse and instructs the capture of the text file, the operator can display the character string on the information column 103.

  If the user wants to change the information item of the already added information, the user can drag and drop a new information item tag onto the information item tag of the information to be changed. In order to invalidate the already added information item, the information item tag is dragged with a mouse and dropped in an area outside the tag pasting area 102. The attributes and hierarchical structure such as the number of information item tag buttons and item contents can be changed from the moving image editing apparatus according to the production site or person to be used.

  Finally, the associated information is determined as valid, and when the window is to be closed, the OK button 109 is clicked with the mouse. If the user wants to close the window as invalid, the user clicks the cancel button 110 with the mouse.

  In the first stage, we do not want to divide the character string "The video in which person A appears can only be used until December 31, 1998", and want to associate it as one piece of information, or add information roughly for now. For example, if it is desired to add details later, it is possible to regard the entire character string as one cutout and add the information item tag 101, which is an information item tag in the upper layer of the information item tag 113, to it It is.

  Also, an empty tag button which does not belong to any information item is provided as an information item tag button (not shown), and it is difficult to sort information, so it is used when adding information roughly and adding it later finely. I do.

  In this example, at first, all the sentences "The video in which the person A appears can be used only until December 31, 1998" are input. However, if it is known that only the expiration information is used, from the beginning, You may enter only “December 31, 1998”.

  Further, in the above-described embodiment of the free format method, the information character string in the information column 103 is cut out, divided into individual lines, and then the target information item tag button is dragged and assigned in order to assign the genre of video information. Dropped and assigned. However, as another method, a necessary part of the information character string in the information column 103 is selected with a mouse or the like, and the selected character string is dragged and dropped to a target information item tag button to assign and display. It is also possible to do.

The figure which shows an example of the edit screen display of the moving image editing apparatus of this invention. FIG. 2 is a block diagram illustrating a configuration example of a non-linear moving image editing device. The figure which shows an example of the edit screen of the conventional moving image editing apparatus. The figure which shows an example of the conventional information window which inputs and displays various information. The figure which shows the other example of the conventional information window which inputs and displays various information. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. 5 is a flowchart showing an example of a method of associating video accompanying information with video data according to the present invention. The figure explaining the abstraction degree of image | video accompanying information. The figure which shows another example of the edit screen display of the moving image editing apparatus of this invention. The figure which shows another example of the edit screen display of the moving image editing apparatus of this invention. FIG. 4 is a diagram illustrating an operation of storing video information in the present invention. The figure which shows another example of the conventional information window which inputs and displays various information. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. FIG. 4 is a diagram showing an information window for inputting and displaying various information of the present invention. The figure explaining the hierarchical structure of the information tag button of this invention.

Explanation of reference numerals

100: information window, 101, 112, 113: information item tag button, 102: tag pasting area, 103: information column, 104: scroll bar, 105: switch button, 106: importance setting button, 107: software -Button, 108: import button, 109: tag button area, 111: explicit cutout line, 201: scene change point detection unit, 202: magnetic storage device, 203: monitor, 204: frame buffer, 205: main Memory, 206: input device, 207: VTR, 208: video interface, 209: image compression unit, 210: audio interface, 211: CPU, 212: bus, 214: image reduction unit, 300: Edit screen, 301: Tree structure display area, 302: M-icon, 303: Enlarged table of M-icon Schematic diagram, 304: material area, 305: various function buttons, 306, 306-1, 306-2, 306-3: information presence display zone, 311: M-icon of cut scene, 307, 312: M-icons for multiple cut scenes, 313: M-icon for the entire story, 321: information button, 322: character detection instruction button, 331: scanner icon, 332: FAX Icon, 333: TEL icon, 341: Portrait right icon, 401: Display field of icon by material type, 401-1 and 401-2: Material icon, 402: Display field of material name, 403: Video / audio 404: display length of the material, 501: display space of the representative icon of the material, 501-1, 501-2, 501-3, 501-4, 501 5: Material icon, 502: Title and type of material ・ Material length display field, 503: Comment display field when editing material, 504: Display field of material label, 600: Information window, 601: Portrait right check box , 602: information display field, 603: tag button, 604: expiration date check box, 605: link button, 606: OK button, 607: cancel button, 701, 702, 703, 704, 705, 706, 707: M-icon, 801 to 817: video data, 1001 to 1005, 1011 to 1013, 1021, 1022, 1031: M-icon, 1201-1, 1201-2, 1201-3: video material after editing, 120 2: Information column.

Claims (4)

A moving image editing apparatus that displays a reduced moving image on a screen and performs editing while viewing moving image information displayed on the screen,
Means for associating the reduced video with video-associated information associated with the reduced video, displaying an icon indicating the associated video-associated information together with the reduced video, and displaying the associated video-associated information A moving image editing apparatus characterized in that video accompanying information related to the moving image information can be confirmed from the video data. A moving image editing apparatus that displays a reduced moving image on a screen and performs editing while viewing moving image information displayed on the screen,
Means for inputting the reduced video and video accompanying information related to the reduced video, and identification means for identifying the level of abstraction from the input video accompanying information, wherein the abstraction identified by the identification means is provided. A moving picture editing apparatus characterized in that the video accompanying information has a tree structure in the order of degree. A moving image editing apparatus that displays a reduced moving image on a screen and performs editing while viewing moving image information displayed on the screen,
Associating the reduced moving image with video accompanying information related to the reduced moving image, displaying an icon indicating the associated video accompanying information together with the reduced moving image, and calculating the moving image from the associated video accompanying information. A moving image editing method, characterized in that video accompanying information related to information can be confirmed. A moving image editing apparatus that displays a reduced moving image on a screen and performs editing while viewing moving image information displayed on the screen,
The reduced video and video accompanying information related to the reduced video are input, the level of abstraction of the input video accompanying information is identified, and the video accompanying information is arranged in a tree structure in the order of the degree of abstraction. A moving image editing method.