JPH10200855A - IMAGE EDITING METHOD, IMAGE EDITING DEVICE, AND MEDIUM RECORDING PROGRAM FOR CAUSING COMPUTER TO EXECUTE IMAGE EDITING PROCESS - Google Patents

Abstract

(57) [Summary] [Problem] To provide a moving image sound editing method that enables editing of sound accompanying a moving image to be easily performed by operating an icon on an image display surface. SOLUTION: A part of a moving image information to be edited is selected, and a plurality of frame-unit images in the part are arranged in a horizontal direction, and a film image-like image sequence 121, 1 is provided.
22 and at least two horizontal bars 126A and 126B arranged side by side in the image sequence and having a figure width corresponding to the level setting value of the audio information related to the image sequence. Edits audio information in a portion to be edited by a screen display operation on the horizontal bars 126A and 126B.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving picture editing method used for producing a moving picture such as a television broadcast program or a video program, and more particularly to a method for editing audio information accompanying a moving picture.

[0002]

2. Description of the Related Art In recent years, a method of producing a sophisticated television broadcast program or video program by using a computer is rapidly developing. Instead of using a video tape recorder and relying on the tape counter to repeat fast-forward and rewind operations, instead of using video editing techniques, editing is performed using images stored on a hard disk that is inexpensive and easy to handle and save. Recently, a moving picture editing apparatus using the technique of the scheme has been attracting attention.

[0003] By the way, the moving image referred to here is composed of a plurality of frame-unit images arranged independently in time series, and includes image information and audio information which can be displayed as a moving image, or audio information or the like. It is information consisting of two pieces of information.

[0004] By the way, the image editing work is, in any case, mainly the work to be judged based on the feeling of the editor. As an image editing method, a device that performs image editing by using a display for operating a video on an edited video screen, that is, a so-called icon display (hereinafter, referred to as an icon) is used in association with image information.

FIGS. 22 and 23 show a conventional technique of such an image editing apparatus, in which a desired cut (sequence of a plurality of frame unit images) of a time-series video material (moving image) is shown.
Also, an example of a screen display when effect editing of a scene composed of other plural cuts and another desired cut or scene, that is, editing in which the image content is switched while changing the image content is shown. Things.

Here, FIG. 22 is a display example of an editing work screen assisted by a computer, and FIG. 23 is another display example of an editing work screen assisted by a computer. These editing operations use typical image editing software that is commercially available.

The general configuration of the editing device used at this time is a computer-based system, and more specifically, a typical system including a central processing unit, a memory, and various devices operated by an operator. It has a general-purpose computer configuration.

FIG. 24 shows an example of an image editing system (according to the prior art). The image editing system includes a computer 401 to which a monitor 407 having a display screen having a size of, for example, 19 inches is connected.

[0009] The video playback unit (VTR) 402
Any video information (image information) of the NTSC system, the PAL system, or another format system can be reproduced. The video information reproduced from the video reproduction unit 402 is sent to the video capture / frame storage unit 403, where it is converted into digital information and stored.

[0010] The video information thus stored in the video capture / frame storage unit 403 is then passed through a decompressor / compressor 404 to a disk accelerator 405.
Supplied to The decompressor / compressor 404 compresses and decompresses video information, and is currently the fastest JPEG (JPEG).
point Photographic coding
An expansion / compression processor using an Experts Group chip is often used.

Next, the disk accelerator 405 sends the video information sent from the video playback unit 402 to the video capture / frame storage unit 403 and stores the video information to one or more disk storage units 406 or receives it therefrom. It is for doing.

The computer 401 has control signals 408,
The components 409 and 410 control the components of the image editing apparatus, that is, the video capture / frame storage unit 403, the decompressor / compressor 404, and the disk accelerator 405.

The video information stored in the disk storage unit 406 is read from the disk storage unit 406 by control signals 408, 409, and 410 from the computer 401 for editing and other operations to be performed. And disk accelerator 4
05, which can be read by the video capture / frame storage unit 403 via the decompressor / compressor 404.

The device shown in FIG. 24 is different from a conventional sequential file device which basically requires a video tape winding operation in order to access desired video information. ”(Random access). Therefore, as described above, the direct method is used.

FIG. 22 and FIG.
7 is an example of a screen for first and second editing operations displayed on a monitor 407. 22 and 23, 210, 313
A vertical line indicated by is a figure called a current position bar for displaying a reference position at the time of editing work.

Reference numerals 302 and 303 on the screen of FIG. 23 denote timelines for relatively displaying the position and range of the cut or scene to be edited based on the position of the current position bar. A track for displaying a timeline is assigned to each piece of image information to which each cut or scene to be edited belongs, and a corresponding track name is assigned.

Further, reference numeral 203 on the screen of FIG. 22 denotes a timeline for relatively displaying the position and range of the cut or scene after editing, and 304 denotes an image of two timelines 302 and 303. 5 is a timeline showing a range to be combined at the time of combining and editing.

Reference numerals 201 (FIG. 22) and 301 (FIG. 23) denote timeline windows on which the timelines are displayed. The timeline 203,
302 and 303 can be scrolled by screen operation.

Reference numeral 205 denotes a program window. The image is displayed on the basis of the video information read from the disk storage unit 406 in order to confirm the scene of the image of the timeline 203 displayed in the timeline window 201. Is done. Note that a mark-in position and a mark-out position, which are positions for starting and stopping reproduction of image display, are indicated by a mouse (not shown) which is an instruction device to which the computer 401 of FIG. 24 is connected. The buttons are displayed together.

Reference numerals 206 and 306 denote windows called working bin windows or project windows for displaying video information (image information) recorded in the disk storage unit 406 and mainly edited image information. is there.

In order to perform effect editing, a window 305 for displaying a list of various video effect patterns and an effect setting window 312 for setting the type of effect and its effect amount are provided. A video effect panel window 207 having the functions of two windows is provided.

The effect editing is an editing in which special effect processing such as a wipe effect and a dissolve effect is performed on an image. The wipe effect is a process of converting image A to image B, in which the image A is wiped off from the screen in a certain changing pattern, and another image B appears in the area where the image A has been erased instead. It is image processing that comes. What is a dissolve effect?
In the process of converting the image A to the image B, the image processing is such that the image B gradually appears until the brightness of the image A gradually decreases and disappears. The effect editing includes other special effect processing other than the wipe effect and the dissolve effect.

Next, the operation required for effect editing will be described in more detail with reference to FIGS. 22 and 23.

<Case of FIG. 22> First, the working bin
Two of the video materials different for each scene or cut displayed in the window 206 are respectively selected by operating the mouse, and are arranged on the timeline 203 in an order for joining. Next, the bar 210 is further moved to the position where the two video materials are joined by the mouse, whereby effect editing at the moved position is started.

That is, the menu bar 208 for selecting the type of effect displayed on the video effect panel window 207 or the computer 4 as well as the mouse.
A window 20 in which an effect time can be set by inputting a numerical value from a keyboard (not shown) connected to the “01”.
9. Further, by operating a slider capable of setting the amount of other set amounts, for example, the width of the boundary of a vertical wipe for changing a scene from left to right, and the amount of blur, editing is performed according to the user's preference. .

At this time, the state of the edited scene or cut effect is determined by displaying a plurality of edited still images 202 side by side at a predetermined frame interval on the timeline window 201. You can now know. Here, the predetermined number of frame intervals can be variably set, and this setting is
This is performed when a predetermined menu is selected from the menu bar in the program window 205.

<Case of FIG. 23> First, two of the video materials of different scenes or cuts displayed on the project window 306 are respectively selected, and are set as A roll and B roll on the timelines 302 and 303, respectively. Be placed. Here, A roll and B roll are
This is for distinguishing and calling each of the two scene-crossing cuts when they are composed and edited, and the composite editing in this case is also called AB roll editing.

Next, the timeline 303 is moved by the mouse to set the effect time so that the timeline 303 and the timeline 302 have a predetermined overlap width in the horizontal axis (time axis) direction.

When one of the various effect patterns displayed on the video effect pattern display window 305 is selected by the user, an effect setting window 312 is displayed and an effect pattern representing the selected pattern is displayed. A symbol is displayed on the timeline 304 in the range of the overlap.

Therefore, the effect setting window 312
Is operated to change the set amount of the effect, and the user's favorite editing is performed.

At this time, the timeline window 30
Still images before editing are displayed at predetermined frame intervals on the timelines 302 and 303 in 1. The setting of the number of frame intervals is performed by the slider 315.

In general, a moving image is accompanied by a sound. In this case, it is necessary to edit the sound. In this case, the form of sound editing is roughly divided into the following. There are two types.

First, according to the first mode, when a certain scene of the image B is joined to a certain scene of the image A, the sound A is gradually attenuated and the sound B is gradually increased at the joint. Then, this state is overlapped, that is, so-called overlap editing.

This overlap editing is used for the purpose of preventing unnaturalness caused by a sudden change in sound at a joint, enabling smooth scene switching, and the like.

The second mode is an editing for adding new audio to a video separately from the audio accompanying the video, so-called mixing editing. This mixing edit is B
This is used when it is desired to add GM (background music) or the like to a video.

By the way, when editing these, the method that has become mainstream in a conventional broadcast program production site is as follows.
Prepare two VTRs, input these two playback outputs to the mixer, and operate the mixer while listening to the sound being played, and play the attenuation and increase of each sound. It was a method that decided while doing it.

[0037]

The prior art described above does not give sufficient consideration to facilitating the editing work, requires a high level of skill in the editing work, and requires a great deal of labor and time. There was a problem of cost.

That is, as described above, at the time of editing, in the prior art, two VTRs are prepared, these two reproduction outputs are input to the mixer, and the editor listens to the reproduced sound. It is necessary to operate the mixer while deciding the degree of attenuation and the degree of increase of each sound during playback. Therefore, it requires a high level of skill in the work. You have to go back and start over, which requires a lot of effort and time.

In the so-called non-linear editing which has been conventionally used, the editing form by the timeline method is mainly used. In this method, the editing is advanced by inserting each material of video and audio using a mouse operation in a window displayed in a band shape by replacing the time axis direction with the horizontal direction of the display screen.

However, even in this timeline system, both video and audio are only displayed in a band having a length corresponding to the time length, so that the editing points in the overlap editing and the mixing in the mixing editing are mixed. When determining the starting point, there is a problem that it is difficult to work while checking the video.

The present invention provides an editing method and an editing system capable of easily and quickly effect editing and sound editing of an image by operating on a computer graphical user interface screen, and a recording medium storing a program for executing the editing process. I do.

The present invention provides an editing method and an editing system for editing video information material including audio information and moving image information with the aid of a computer.

In the editing method and the editing system according to the present invention, information of the video information material is stored in the storage device, the video information is read from the storage device, and the read video information is displayed on the screen of the display device. In accordance with the user's instruction, the editing position of the video information is displayed on the video information display on the screen, and when the user's instruction is given, the editing position is changed. The editing process specified by the user is performed, and the edited video information is displayed on the screen.

Therefore, the user can perform the editing process while simultaneously checking both the editing material and the editing result on the screen.

According to another embodiment of the present invention, the display of the related audio information is changed in conjunction with the editing of the moving image information.

According to another embodiment of the present invention, a reduced moving image is created by thinning out pixels of moving image information, stored in the storage device, and a moving image of a film image is obtained from the reduced moving image read from the storage device. An image is created and displayed on the screen as editing material.

A still further object of the present invention is to provide a moving picture audio editing method which enables an editing operation of sound accompanying a moving picture to be easily performed by operating an icon on an image display screen.

[0048]

SUMMARY OF THE INVENTION The object of the present invention is to provide a moving picture sound editing method in which moving picture information and sound information included in video information are edited by screen display operation.
A part to be edited in the moving image information is selected, and a plurality of frame-based images in the part are arranged in a predetermined direction of the screen, for example, a film image-like image row arranged in a horizontal direction, and the image row. At least two horizontal bar figures arranged side by side and having a figure width corresponding to the level setting value of the audio information related to the image sequence are displayed, and a portion of the moving image information to be edited is displayed. Of the voice information is performed by a screen display operation on the horizontal bar graphic.

Since the image of the portion of the video information to be edited is displayed as a film image arranged on the left and right on the display screen, it is possible to associate the image information with the audio information by viewing this image display. Here, since the screen display operation of the corresponding portion on the horizontal bar graphic may be performed, the editing of the audio information is facilitated.

[0050]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the illustrated embodiments. FIG. 2 shows an example of a device used for such moving image editing, and this device is constituted by the following parts.

A CPU 501 for processing various controls, a monitor 508 for displaying various kinds of information such as image information of scenes and cuts used for image editing and a hierarchical structure (tree structure) indicating an editing state, and various control programs for the CPU 501 are provided. A memory 502 for storing, a storage device for storing the image information and audio information and information related thereto, for example,
A magnetic recording device 506, a frame buffer memory 507 for storing an image to be displayed on a monitor 508, a scene change check for detecting a scene change point between cuts in an image composed of a plurality of scenes or scenes. Output unit 503, a mouse (or keyboard) 509 as an input device, and a video tape recorder (hereinafter, referred to as a video tape recorder).
(Referred to as a VTR) 505 to generate compressed image data by compressing the image information.
It comprises a compression / decompression unit 511 for reproducing image information equivalent to the image information from the TR 505, a video interface 504 and an audio interface 512 connected to the VTR 505, respectively.

Further, from the image information stored in the magnetic storage device 506, under the control of the CPU 501, a reduced image for high-speed display, in which the information amount is spread to, for example, 1/64 from the original image material, is generated. Stored in device 506.

The CPU 501 and the memory 50
2. The scene change point detection unit 503, the video interface 504, the audio interface 512, the magnetic recording device 506, and the frame buffer 507 are respectively connected to the bus 5
10 so that each unit is controlled by access from the CPU 501.

The scene change point detecting unit 503 analyzes the state of the color distribution of the input moving image for each frame,
A scene change point which is a change point between cuts is detected. The image reducing unit 513 creates a high-speed display moving image by thinning out pixels from the original video material.
The magnetic storage device 506 stores the moving image for high-speed display, and also stores moving image analysis information describing the relationship between the detection result from the detection unit 503 and the moving image for high-speed display.

The monitor 508 displays the moving image for high-speed display stored in the magnetic storage device 506 based on the analysis information, and provides the user with a GUI (graphical user interface), that is, an input device such as a mouse or a keyboard. Editing for realizing an interface in which various data input operations are performed and an output display corresponding to the operations is performed based on selecting a predetermined display area on which an image is displayed using the operations described above. Provide a screen.

The frame buffer 507 includes a monitor 508
An image to be displayed is stored. Main memory 502
Stores various control programs. The mouse or keyboard 509 is used as an instruction input device for various operations.

The video interface 504 is a VTR
(Video tape recorder) The video signal from 505 is input and converted into a moving image format handled by this device.
The image compression / decompression unit 511 data-compresses the original video information and decompresses the compressed information. The audio interface 512 performs conversion processing relating to audio signals so that audio signal data can be exchanged between the VTR 505 and the computer. The CPU 501 controls the above units and manages their operations.

The scene change point detecting section 50
3, magnetic storage device 506, monitor 508, frame buffer 507, main memory 502, mouse or keyboard 509, video interface 512, image compression / decompression unit 511, audio interface 512
Along with the CPU 501, it is connected to the bus 510.
It is controlled by an access signal from the PU 501.

Note that, instead of the magnetic storage device 506, another storage medium, for example, a magneto-optical storage device may be used, or a remote file connected to the bus 510 via a network may be used. .

The CPU 501 includes a scene change point detection unit 50
Based on the scene change point detection information detected in step 3, an image of a scene or cut transition is extracted from the high-speed display moving image, and a representative image of the scene or cut to which the image belongs is shown in FIG. Icon images 1302 to 130 in a tree structure display window 1301 shown in FIG.
4 is displayed on the monitor 508. In addition,
An icon is a small image or figure for screen display operation.

Therefore, the user (editing worker) sets the image shown in FIG. 13 displayed on the screen of the monitor 508 as an editing operation target, and assembles it into a hierarchical structure (tree structure) on the icon editing screen. Continue editing.

In the tree structure shown in FIG. 13, an image at a middle level, for example, an image 1303 is a representation of a plurality of images 1302 at a lower level belonging thereto as one unit. Similarly, the image 1304 at the highest level represents a plurality of images 1303 at the middle level, and corresponds to the entire story.

According to this method, the editing can be performed in units of scenes and cuts, so that the story can be easily assembled, and the scenes or cuts are divided almost automatically into the input moving images. Therefore, the moving image can be stored and managed in a hierarchical structure with little trouble for the user, and there is an advantage that a necessary scene and a cut can be easily searched. In this case, the burden on the user can be reduced.

The editing system according to the embodiment shown in FIG. 2 is a moving image editing apparatus for editing a sound accompanying a moving image, such as an overlap editing and a mixing editing, by easily operating icons on an image display screen. Provide an audio editing method.

In the audio editing according to the embodiment of FIG. 2, the image of the portion of the video information to be edited is displayed as a film image arranged on the left and right on the display screen. By looking at this image display, the correspondence between the image information and the audio information becomes possible. Since the screen display operation of the corresponding portion on the horizontal bar graphic may be performed, the editing of the audio information becomes easy.

Next, the operation of the embodiment of the present invention using the moving picture editing apparatus of FIG. 2 will be described with reference to FIGS. 2 and 3. At this time, in FIG.
7 shows a control process by U501.

First, in response to an instruction from the mouse or keyboard 509 from the operator, a video signal and a video signal are output from the video tape mounted on the VTR 505, and processing for registering the video signal and the audio signal in the magnetic storage device 506 is started. Is done. At this time, 1
Video interface 50 is used for moving images in frame units.
4. It is supplied to the scene change point detection unit 503 via the bus 510 (process 701 in FIG. 3).

The scene change point detection section 503 digitizes the input moving image, analyzes color distribution information between the images, and detects a scene change point (process 702). As a result, the moving image analysis information including the frame number of the scene change point generated by the scene change point detection unit 503 is stored in the magnetic storage device 506 (process 703).

At the same time, the moving image for high-speed display is stored in the magnetic storage device 506 (process 704). This moving image for high-speed display is processed by reducing the same data as the moving image input to the scene change point detection unit 503 in accordance with the size of a GUI (graphical user interface) environment for performing various displays. (Process 705), which is the object of operation in the present editing apparatus.

In general, from among encoded moving images,
To convert any image back to a video signal and play it back,
It is necessary to decode the encoded moving image, and the CPU 5
01 requires a processing time for this decoding. However, in this embodiment, as described above, since the reduced image for high-speed display is stored in advance, the decoding process is not performed, so that the decoding process time is not required, and the entire processing time is reduced. Can be shorter.

Further, scene change point detection processing (processing 70
At the same time as 2) and storing the moving image for high-speed display in the magnetic storage device 506 (process 704), the moving image is
1 by using the image compression technique (processing 70
6) The encoded moving image is stored in the magnetic storage device 506 (process 707). The stored encoded moving image is used when high-speed display performance is not required, for example, when it is desired to view the final editing result in detail.

On the other hand, the audio output signal reproduced by the VTR 505 is also transmitted through the audio interface 512.
It becomes digitized audio information and is stored in the magnetic storage device 50.
6 (processing 708).

Next, the editing operator (operator) instructs reading of the high-speed display moving image registered in the magnetic recording device 506 by using the mouse or the keyboard 509. Accordingly, the CPU 501 reads the scene analysis information of the corresponding moving image from the magnetic storage device 506, and reads only the image of the first frame of each scene from the high-speed display moving image based on the information, as shown in FIG. Thus, the display is performed on the main window 421 of the monitor 508.

At this time, an icon such as a moving image display on the main window is operated in this embodiment. Then, the operator operates this icon on the monitor display screen to display the tree structure display window 4 in FIG.
By assembling in a hierarchical structure (tree structure) shown in FIG. 21, a moving image according to the story is created. Hereinafter, as a specific example, an overlap editing for the tree structure shown in FIG. 4 will be described as an example.

When performing overlap editing of audio between a scene represented by the icon 422 (hereinafter referred to as scene A) and a scene represented by the icon 425 (hereinafter referred to as scene B), first, the editing mode The transition to
This is performed by clicking the icons 422 and 425 with the mouse 509 and then clicking the overlap edit button in the button group 426. As a result, an editing screen 420 is displayed. When this screen is enlarged, the editing screen 420 becomes as shown in FIG.

In FIG. 1, reference numerals 121 and 122 denote moving images belonging to scenes A and B, respectively (hereinafter, images A and B).
This is a reduced moving image sequence in which moving images for high-speed display of respective frames in a predetermined section of a predetermined section (image B) are arranged and displayed in chronological order from left to right in the form of a film image.

Next, reference numerals 123 and 124 denote waveform display portions of sounds corresponding to scenes A and B (hereinafter referred to as sound A and sound B), respectively, which are read from the recording device 506. At this time, the joint of the scene is represented by 125.

The display is reduced by the set number of frames by operating an icon (hereinafter referred to as a setting icon) 128 for setting the interval between adjacent frames of the image displayed in the image row by the operator. The image is displayed. Further, by operating the display position setting icon 127, an arbitrary section can be displayed in the entire image rows 121 and 122.

Next, at the joint 125 and its vicinity, the sound A is attenuated and the sound B is increased.
In order to perform overlap editing that adaptively variably controls the volume, the volume control level (volume control
Level) according to each audio information. CPU5
01 reads out the audio information to be edited for each of the audio A and the audio B from the magnetic storage device 506, and newly adds the audio information attenuated at a predetermined attenuation rate to the edit target portion based on the read audio information. The generated voice information is rewritten from the CPU 501 to the magnetic storage device 506.

In this case, by selecting a range of a portion to be edited of each piece of audio information and setting a predetermined attenuation rate, an operation function for enabling control of the volume is provided by the horizontal bar graphic display section 126. It can be obtained by a display figure. Here, first, the horizontal bar 126A corresponds to the sound A, and the vertical width of each black portion indicates the volume control level set in each predetermined period of the sound A. Next, the horizontal bar 126B corresponds to the sound B, and the upper and lower widths of the black-colored portions represent the volume control levels set for each predetermined period of the sound B.

According to the audio editing of the present invention, it is possible to adjust not only the audio amplitude level but also other audio parameters, for example, one of various sound quality levels and the pitch level in an arbitrarily specified editing section. Can also. For example, white circles 129 to 132 on the bar graphic 126 are icons for specifying such an audio parameter adjustment section, and the inclination of the diagonal part of the bar graphic 126 indicates that the voice parameter changes gradually. . Audio amplitude level,
Button icons 631, 632, and 633 for designating parameters of the sound quality level and the pitch level can be provided in the window of FIG. The operator sets the audio parameters to be edited to the button icons 631, 632, 633.
Click with your mouse to select one of them. When the button icon 634 is designated with a mouse, an echo effect is applied to the sound in the editing section (during fade).

Next, a white circle figure 129 is a setting icon for setting the level attenuation start point of the voice A. White circle figure 130
Is a setting icon for setting the level attenuation end point of the voice A. A white circle 131 is a setting icon for setting a level increase start point of the sound B. And the white circle figure 132 is voice B
Is a setting icon for setting a level increase end point.

Image sequences 121 and 122 of film images
And audio waveform display sections 123 and 124, horizontal bar display section 12
6. The display position setting icon 127 and the display interval setting icon 128 are display-controlled in conjunction with each other, and the operation result is immediately reflected.

Therefore, the operator performs overlap editing by operating the horizontal bars 126A and 126B while watching the image sequences 121 and 122 in the form of film images and the sound waveform.

FIG. 15 shows an edit screen 420 according to another embodiment. In FIG. 15, 121, 122
Arranges a high-speed display moving image of each frame of a predetermined section of a moving image (hereinafter, referred to as an image A or an image B) belonging to a scene A or a scene B in a time-series manner from left to right in the form of a film image. 5 is a reduced moving image sequence displayed on the screen.

Note that the portions indicated by the dotted lines in each of the reduced moving image sequences are not included in the edited image sequence, that is, represent portions of the video which have no influence.

Next, reference numerals 123 and 124 denote waveform display sections of sound corresponding to scenes A and B (hereinafter referred to as sound A and sound B), respectively, which are read from the recording device 506. At this time, the joint of the scene is represented by 125.

In the following, in FIG. 15, the components denoted by the same reference numerals as those in FIG. 1 are the same, and the description will be omitted. Note that 136 and 137 represent an edited image image sequence and an edited audio image (audio waveform) sequence, respectively.

Here, the horizontal bar 126 according to this embodiment is used.
A and 126B will be described with reference to FIG. The operator simply designates and moves the four white circle figures 129 to 132 in the horizontal direction while watching the video, and the voice A attenuation start point position 521, the end point position 522, and the audio B increase start point position 523, the end point position 524, the split amounts 525 and 526, the fade time lengths 527 and 528, the transition time length 529, and various parameters required for editing can be arbitrarily set.

For example, now, the white circle figure 129 is dragged with the mouse to move from the position 521 in FIG.
As shown in the figure, when the sound A is moved to the position 523, the sound A attenuation start time position 521 is delayed by, for example, one frame of the image. Accordingly, the split amount of the voice A 52
5 and the fade time length 527, and the audio transition time length 529 between the audio A and the audio B are also reduced by, for example, one frame, whereby the audio A attenuates more quickly than in FIG. .

Next, assuming that the white circle figure 130 is moved from the position 522 in FIG. 5A to a position 530 as shown in FIG. 5C, the end of the attenuation of the sound A is, for example, one frame. Only, the fade time length of audio A and the audio transition time length between audio A and audio B are, for example, 1
The sound A increases by the number of frames, and the sound A attenuates more slowly than in the case of FIG.

On the other hand, assuming that the white circle graphic 131 is moved from the position 523 in FIG. 5A to the position 521 as shown in FIG.
The frame becomes earlier by one frame, and the split amount and the fade time length of the audio B increase by, for example, one frame. As a result, the audio B gradually increases from an earlier point in time.

Further, assuming that the white circle figure 132 is moved from the position 522 in FIG. 5A to a position 524 as shown in FIG.
The frame becomes earlier, the fade time length of the sound B and the sound transition time length between the sound A and the sound B decrease by, for example, one frame, and the sound B increases more quickly.

Therefore, according to this embodiment, editing can be easily performed so that sound can be heard more smoothly even at a joint between scenes.

In this embodiment, the movement of the four white circle figures 129, 130, 131, and 132 is performed on the screen 4
Image sequence 12 displayed as a film image on 20
1 and 122 are provided by clicking on each image with a mouse. Further, the position of the horizontal bar display section 126 itself can be dragged with a mouse, and the correspondence between video and audio can be shifted.

Next, when the work is completed and the editing result is determined, the OK button 135 is clicked with a mouse to give the editing result. As a result, the edited moving image reflecting the operation result is stored in the magnetic storage device 506, and at the same time, the tree structure information is changed. As a result, the tree structure is displayed on the main window of the moving image editing device. Changes as shown in FIG. At this time, information indicating that the editing has been performed including the audio is displayed on the main window of the moving image editing apparatus as a graphic 1001 in FIG.

If the user wants to confirm the editing state before the editing is determined, the preview button 133 shown in FIG.
Click with your mouse. As a result, FIG.
As shown in FIG. 4, the image of 640 × 480 size compressed and stored by the image compression / expansion unit 511 is configured to be reproduced in the window 430 of the monitor 508, and the editing state can be easily checked. Can be.

Next, in this embodiment, even when it is desired to simultaneously perform special effect processing of images such as wipe and dissolve at the joint of scenes, the editing can be performed by the same method. Hereinafter, the operation of audio editing accompanying the effect editing of video will be described.

At this time, the transition to the editing mode is performed by the same operation as the above-described overlap editing. On the main window shown in FIG.
5 is clicked with the mouse 509, and the special effect processing buttons 42 such as wipe and dissolve in the button group 426 are clicked.
This is done by clicking 8,429. Thus, the edited editing screen 420 is as shown in FIG.

The display screen shown in FIG. 21 is an edit screen when the wipe process is selected by the operator. Here, the image strings 121 and 122 and the waveform display unit 1 for audio A and audio B
23, 124, horizontal bar display section 126, horizontal bar 126A,
126B, the display interval setting icon 128, the display position setting icon 127, and the white circle figures 129 to 132 are as described in FIG.

In FIG. 6, reference numeral 605 denotes an image after editing obtained as a result of performing the wiping process on the image A and the image B as a reduced moving image sequence in the form of a film image. The type of the wipe effect at this time is determined by the selection of the wipe pattern 606 by the operator.

Reference numeral 607 denotes a horizontal bar display unit which indicates the length of the wipe between the image A and the image B.
07A and 607B indicate the lengths of the portions where the images A and B are displayed, respectively. Therefore, the length of the wipe is represented by the portion where these horizontal bars 607A and 607B overlap.

Therefore, the function of determining the degree of attenuation of the sound A and the degree of increase of the sound B in these overlapping portions is realized by the horizontal bar display unit 126. At this time, the white circle graphic 129 gives the attenuation start point of the voice A, and the white circle graphic 130 gives the attenuation end point of the voice A. Similarly, the white circle graphic 131 gives the start point of the increase of the sound B, and the white circle figure 132 gives the end point of the increase of the sound B.

In these displays, the operator operates the display interval setting icon 128 to
An arbitrary range can be selected and displayed. Also,
By operating the display position setting icon 127, an arbitrary section can be selected and displayed. At this time, the cut line of the film image, the audio waveform display, each bar and each icon are interlocked with each other, and the operation result for each bar and each icon is immediately reflected on each other.

Next, the effect editing processing by the horizontal bar display section 126 will be described with reference to FIGS. The operator operates the moving image trains 121 and 122 displayed in the form of a film image shown in FIG.
4 while viewing the horizontal bar display section 607 and the horizontal bar display section 12.
By operating 6, the overlap editing at the time of the special effect processing of the image, such as the wipe and the dissolve, is performed.

First, FIG. 7A shows that the operator
07A and 607B are operated by a mouse, and an image A and an image B are overlapped. The length of this overlapping portion is the length of the wipe. At this time, the horizontal bars 126A and 126B are connected to the horizontal bars 607A and 607B.
7A, the state automatically changes to the state shown in FIG.

Next, assuming that the white circle figure 129 is dragged with the mouse from the state shown in FIG. 7A to the position shown in FIG. 7B, the split amount 715 of the sound A becomes, for example, one frame worth. Occurs and the fade time length 717,
The audio transition time length 719 between the audio A and the audio B may be increased by, for example, one frame, and the attenuation of the audio A may be started earlier than the start of the wipe.

On the other hand, when the white circle graphic point 130 is moved from the state of FIG. 7A to the position of FIG. 8A, the fade time length 717 of the sound A and the sound transition between the sound A and the sound B are changed. For example, the time length 719 can be increased by, for example, one frame, and the effect that the voice A can be heard even after the end of the wipe can be provided.

Also, from the state of FIG.
8B, the split amount 716 of the sound B is generated for, for example, one frame.
The fade time length 708 of the sound B is reduced by, for example, one frame, and the start of the increase of the sound B from the wipe start position is delayed.

Further, when the white circle figure 132 is moved from the state shown in FIG. 7A to the position shown in FIG. 8C, the fade time length 718 of the sound B is reduced by, for example, one frame. Voice B completes the increase as soon as possible. As a result, even in the effect editing of an image, sound can be heard more smoothly. Even at this time, the determination of the editing result and the confirmation by the image reproduction before the determination can be performed in the same manner as the above-described overlap editing at the joint of the scenes.

Next, the audio mixing and editing operation according to this embodiment will be described with reference to FIG.
The following describes a case where BGM (background music) is mixed and edited in a scene represented by the icon 1303 displayed in the tree structure shown in FIG.

First, an operation before shifting to the audio mixing / editing mode will be described. In this case, first, BGM
Is included in the magnetic storage device 506 in advance.
Is required. Then, on this premise, an instruction to read out the audio data onto the editing apparatus is issued by the mouse or the keyboard 509.

Then, the CPU 501 creates an icon 1305 (hereinafter referred to as a voice icon) displayed in the same manner as the moving image icons 1302 to 1304 shown in FIG.

After setting an audio icon 1305 necessary for handling audio data on the editing apparatus, by clicking on the audio icon 1305 with a mouse in the same manner as a moving image icon, audio reproduction and insertion work can be performed. Become so.

Next, a method of shifting to the audio mixing / editing mode will be described. To enter edit mode,
For example, there are two types described below. The first method is to drag the sound icon 1305 with the mouse and
Drop to 303. The second method is the voice icon 13
05 and the icon 1303 are selected, and a predetermined button of the button group 426 is clicked on with a mouse, and the screen display shifts, and the edited screen after the shift is as shown in FIG.

In FIG. 9, reference numeral 931 denotes a reduced moving image sequence in which each frame of a certain section of the moving image belonging to the scene represented by the icon 1303 in FIG. 13 is displayed in the form of a film image as in the case described above. It is. At this time,
The sound belonging to the scene represented by the icon 1303 is
The waveform of the audio to be mixed is displayed on the waveform display section 933, and is displayed on the waveform display section 932.

The horizontal bar 9 displayed on the horizontal bar display section 934
The black vertical width of 34M represents the volume control level of the audio to be mixed for each predetermined period, and the white circle 905 represents the mixing increase completion point.

The display position setting icon 12 here
7, display interval setting icon 128, and OK button 1
The preview button 133 and the preview button 133 have the same functions as those described above, and are linked with the display of the film image and the sound waveform, and the operation results for the bars and icons are immediately reflected on each other.

On the mixing editing screen shown in FIG. 9, first, the operator inputs a moving image sequence 931 displayed as a film image.
By moving the horizontal bar 934M by designating the white circle graphic 935 with the mouse while looking at the mouse, it is possible to set the audio mixing increase completion point.

At this time, as shown in the figure, the mixing sound gradually increases at the start of the mixing so that the sound can be mixed unnaturally, and the mixing sound is not shown at the end of the mixing. It also has a function to gradually attenuate.

In this embodiment, the audio mixing increase completion point can also be given by clicking the moving image sequence 931 displayed as a film image with a mouse. That is, in the state shown in FIG. 10A, if it is desired to set the frame 931F in the image sequence 931 as the starting point of the increase of the audio information mixing, the mouse is clicked on this frame 931F. Then, a horizontal bar 93 indicating the level of the sound to be mixed is displayed.
The figure 935 on the 4M moves to the frame 931F in conjunction with it, as shown in FIG. 10B.

Then, this time, the white circle figure 935 is moved by the mouse to the state shown in FIG.
At 06, the sound will be mixed such that the volume control level will gradually increase.

Although not shown, the end point of the audio mixing can also be designated on the horizontal bar 934M of the audio with the mouse.

When the editing process is completed and the editing result is determined, the OK button 135 in FIG. 9 is clicked with the mouse. The moving image reflecting the result of the above editing process is stored in the magnetic storage device 506, and the tree structure information is changed at the same time. As a result, the display returns to the original main window 1301. The display of the tree structure at this time is shown in FIG.
Here, the information that the audio information 1305 has been mixed and edited is displayed on the main window 1301 as the graphic 1101 as in the case described above.

On the other hand, if it is desired to check the editing state before the editing operation is completed, the preview button 133 is clicked on with a mouse. Is reproduced on the monitor 508, and the editing state can be easily confirmed as in the case described above.

Next, a procedure for performing an editing process using the editing screens shown in FIGS. 1, 6, and 9 under the control of a computer will be described with reference to flowcharts of FIGS. 16 and 17 are flowcharts showing the procedure of the overlap editing shown in FIG. When the overlap editing mode is selected by the operator, the REDRAW_FLAG set in the memory 502 is initialized to “0” in step 140.
In step 141, the window 420 shown in FIG. In step 142, the mouse 50
9 is executed.

At step 143, it is determined whether or not an event for pressing the setting icon 127 has occurred. If the display position setting icon 127 has been pressed, REDRAW_FLAG is set to “1” in step 144. Further, at step 145, the display position designated by the operator is written into the memory 502.

If it is determined in step 143 that no event has occurred, it is determined in step 146 whether or not an event for pressing the display interval setting icon 128 has occurred. If the display position setting icon 128 has been pressed, at step 147 the REDRAW_FLAG
Is set to a "1" value. Further, at step 148, the display interval specified by the operator is written into the memory 502.

If it is determined in step 146 that no event has occurred, in step 149, it is determined whether or not there is an event in which any of the voice parameter icons 631 to 633 is pressed. Parameter icons 631-63
If any one of the three is pressed, at step 150 R
EDRAW_FLAG is set to “1” value. Further, in step 151, the type of the control parameter designated by the operator is written in the memory 502.

If it is determined in step 149 that no event has occurred, it is determined in step 152 whether or not there is an event in which the echo icon 634 is pressed. If the echo icon 634 has been pressed, step 153
To set REDRAW_FLAG to a "1" value. Further, in step 154, information of the echo effect is written in the memory 502.

If it is determined in step 152 that no event has occurred, in step 155, the white circle figure 12
It is determined whether or not there is an event in which 9 is pressed. White circle figure 1
If 29 is pressed, REDRA in step 156
Set W_FLAG to “1” value. Further, in step 157, the fade-out start time of the audio A is written in the memory 502.

If it is determined in step 155 that no event has occurred, then in step 158, the white circle 13
It is determined whether there is an event in which 0 is pressed. White circle figure 1
If 30 is pressed, the REDRA
Set W_FLAG to “1” value. Further, in step 160, the fade-out end time of the voice A is written in the memory 502.

If it is determined in step 158 that no event has occurred, then in step 161 the white circle figure 13
It is determined whether there is an event in which 1 is pressed. White circle figure 1
If 31 has been pressed, the REDRA
Set W_FLAG to “1” value. Further, in step 163, the fade-in start time of audio B is written in the memory 502.

If it is determined in step 161 that no event has occurred, then in step 164, the white circle figure 13
It is determined whether or not there is an event in which 2 is pressed. White circle figure 1
If 32 is pressed, the REDRA
Set W_FLAG to “1” value. Further, in step 166, the fade-in end time of the audio B is written in the memory 502.

If it is determined in step 164 that no event has occurred, in step 167, the image sequence 121
It is determined whether there is an event in which is pressed. Image sequence 121
Is pressed in step 168,
Set FLAG to "1" value. Step 16
In step 9, according to the state of each white circle figure selected in advance,
The fade-in time information and the fade-out time information of the audio A or the audio B are written in the memory 502.

If it is determined in step 167 that no event has occurred, in step 170, the image sequence 122
It is determined whether there is an event in which is pressed. Image sequence 122
Is pressed in step 171.
Set FLAG to "1" value. Step 17
In step 2, according to the state of each white circle figure selected in advance,
The fade-in time information and the fade-out time information of the audio A or the audio B are written in the memory 502.

If it is determined in step 170 that no event has occurred, it is determined in step 173 whether or not there is an event in which the horizontal bar display unit 126 is pressed. If the horizontal bar display unit 126 has been pressed, at step 174 R
EDRAW_FLAG is set to “1” value. In step 175, the value of the correspondence between video and audio is written to the memory 502.

If it is determined in step 173 that no event has occurred, it is determined in step 176 whether or not there is an event for which the preview button 133 is pressed. If the review button 133 is pressed, step 1
At 77, a review window 430 is opened. Further, at step 178, the window 420 is closed.

If it is determined in step 176 that no event has occurred, then in step 179, the OK button 1
It is determined whether or not there is an event in which 35 is pressed. If the 0K button 135 is pressed, an image of the edited result is displayed on the monitor in step 180, and the edited result is stored in the magnetic storage device 506.

If it is determined in step 179 that no event has occurred, or after the processing in step 180 has been performed, in step 181 the CANCEL button 13
It is determined whether or not there is an event that 4 is pressed. CANCE
If the L button 134 has been pressed, the process of step 178 is performed.

When it is determined in step 181 that no event has occurred, or in steps 145, 148, and 15
1, 154, 157, 160, 163, 166, 16
After any one of the processes 9, 9, 172, and 175 is performed, in step 182, the REDRAW_FLA
It is determined whether G is "1". R at step 182
If it is determined that EDRAW_FLAG = "1",
In step 183, a screen corresponding to the edited contents is displayed on the monitor. REDRAW_FLA in step 182
If it is determined that G is not “1”, step 14
Return to 0. If the processing in step 178 has been performed, the overlap editing mode is temporarily ended.

Next, FIGS. 18 and 19 are flowcharts showing the procedure of the wipe editing shown in FIG. When the wipe edit mode is selected by the operator, in step 240, the REDRA set in the memory 502 is set.
W_FLAG is initialized to “0” value. Step 24
In step 1, a window 420 shown in FIG. At step 242, an interrupt input process from the mouse 509 is performed.

At step 243, it is determined whether or not there is an event that the setting icon 127 is pressed. If the display position setting icon 127 has been pressed, the R
EDRAW_FLAG is set to “1” value. Further, at step 245, the display position designated by the operator is written into the memory 502.

If it is determined in step 243 that no event has occurred, it is determined in step 246 whether or not there is an event in which the display interval setting icon 128 is pressed. When the display position setting icon 128 is pressed,
In step 247, REDRAW_FLAG is set to “1”. Further, at step 248, the display interval designated by the operator is written into the memory 502.

If it is determined in step 246 that no event has occurred, then in step 249, the horizontal bar 607
It is determined whether there is an event in which is pressed. Horizontal bar 607
Is pressed in step 250,
Set FLAG to "1" value. Step 25
In step 1, the superimposition amount of the video specified by the operator is written in the memory 502.

If it is determined in step 249 that no event has occurred, in step 252, the white circle figure 12
It is determined whether or not there is an event in which 9 is pressed. White circle figure 1
If 29 is pressed, REDRA in step 253
Set W_FLAG to “1” value. Further, in step 254, the fade-out start time of the audio A is written in the memory 502.

If it is determined in step 252 that no event has occurred, then in step 255,
It is determined whether there is an event in which 0 is pressed. White circle figure 1
If 30 is pressed, REDRA in step 256
Set W_FLAG to “1” value. Further, in step 257, the fade-out end time of the audio A is written in the memory 502.

If it is determined in step 255 that no event has occurred, then in step 258, the white circle figure 13
It is determined whether there is an event in which 1 is pressed. White circle figure 1
If 31 has been pressed, the REDRA
Set W_FLAG to “1” value. Further, in step 260, the fade-in start time of the audio B is written in the memory 502.

If it is determined in step 258 that no event has occurred, then in step 261 the white circle figure 13
It is determined whether or not there is an event in which 2 is pressed. White circle figure 1
If 32 has been pressed, the REDRA
Set W_FLAG to “1” value. Further, at step 263, the fade-in end time of audio B is written to the memory 502.

If it is determined in step 261 that no event has occurred, then in step 264 the image sequence 121
It is determined whether there is an event in which is pressed. Image sequence 121
Is pressed in step 265, REDRAW_
Set FLAG to "1" value. Step 26
In step 6, according to the state of each white circle figure selected in advance,
The fade-in time information or the fade-out time information of the sound A or the sound B is written in the memory 502.

If it is determined in step 264 that no event has occurred, in step 267, the image sequence 122
It is determined whether there is an event in which is pressed. Image sequence 122
Is pressed in step 268,
Set FLAG to "1" value. Step 26
In step 9, according to the state of each white circle figure selected in advance,
The fade-in time information or the fade-out time information of the sound A or the sound B is written in the memory 502.

If it is determined in step 267 that no event has occurred, in step 270, it is determined whether or not there is an event in which the horizontal bar display unit 126 is pressed. If the horizontal bar display unit 126 is pressed, the R
EDRAW_FLAG is set to “1” value. In step 272, the value of the correspondence between video and audio is written to the memory 502.

If it is determined in step 270 that no event has occurred, it is determined in step 273 whether or not there is an event for which the preview button 133 is pressed. If the preview button 133 is pressed, step 2
At 74, a preview window is opened. Step 2
At 75, the window 420 is closed.

If it is determined in step 273 that no event has occurred, then in step 276, the OK button 1
It is determined whether or not there is an event in which 35 is pressed. If the OK button 135 is pressed, an image of the edited result is displayed on a monitor in step 277, and the edited result is stored in the magnetic storage device 506.

If it is determined in step 276 that no event has occurred, or after the process in step 275 has been performed, in step 278, the CANCEL button 134 is pressed.
It is determined whether there is an event in which is pressed. CANCEL
If the button 134 has been pressed, the process of step 275 is performed.

In step 278, when it is determined that no event has occurred, or in steps 245, 248, and 25
1, 254, 257, 260, 263, 266, 269
And 272, after any one of the processes is performed,
At step 279, it is determined whether REDRAW_FLAG is "1". At step 279, REDRAW
If it is determined that _FLAG = “1”, step 2
A screen corresponding to the contents edited at 80 is displayed on the monitor. At step 280, REDRAW_FLAG is "1"
If not, the process returns to step 240.
If the processing in step 275 has been performed, the wipe edit mode is temporarily terminated.

Next, FIGS. 20 and 21 are flowcharts showing the procedure of the mixing edit shown in FIG. When the mixing editing mode is selected by the operator,
At step 340, the R set in the memory 502
EDRAW_FLAG is initialized to “0” value. At step 341, the window 420 shown in FIG.
08 is displayed. At step 342, an interrupt input process from the mouse 509 is performed.

At step 343, it is determined whether or not an event of pressing the setting icon 127 has occurred. If the display position setting icon 127 is pressed, the process proceeds to step 34.
In step 4, REDRAW_FLAG is set to a “1” value.
Further, at step 345, the display position designated by the operator is written into the memory 502.

If it is determined in step 343 that no event has occurred, it is determined in step 346 whether or not an event for pressing the display interval setting icon 128 has occurred. If the display interval setting icon 128 has been pressed, REDRAW_FLAG is set to “1” in step 347.
Set to a value. Further, at step 348, the memory 50
The display interval designated by the operator is written in 2.

If it is determined in step 346 that no event has occurred, in step 349, it is determined whether or not there is an event in which the horizontal bar display section 934 is pressed. If the horizontal bar display section 934 is pressed, at step 350 R
EDRAW_FLAG is set to “1” value. Further, in step 351, the fade-in start point of the mixing voice designated by the operator is written in the memory 502.

If it is determined in step 349 that no event has occurred, it is determined in step 352 whether there is an event in which the image sequence 931 is pressed. If it is determined that no event has occurred, at step 353 the REDR
AW_FLAG is set to “1” value. Further, in step 354, the audio fade-in start time is written in the memory 502.

If it is determined in step 352 that no event has occurred, in step 355, the white circle 93
It is determined whether or not there is an event in which 5 is pressed. White circle figure 9
If 35 is pressed, REDRA in step 356
Set W_FLAG to “1” value. In step 357, the audio fade-in end time is written in the memory 502.

If it is determined in step 355 that no event has occurred, it is determined in step 358 whether or not there is an event in which the preview button 133 is pressed. If the preview button 133 is pressed, step 3
At 59, the preview window 430 is opened. Further, in step 360, the window 420 is closed.

If it is determined in step 358 that no event has occurred, then in step 361, the OK button 1
It is determined whether or not there is an event in which 35 is pressed. If the OK button 135 has been pressed, an image of the edited result is displayed on the monitor in step 362, and the edited result is stored in the magnetic storage device 506.

If it is determined in step 361 that no event has occurred, or after the processing in step 362 has been performed, in step 363, the CANCEL button 13
It is determined whether or not there is an event that 4 is pressed. CANCE
If the L button 134 has been pressed, the process of step 360 is performed.

In step 363, when it is determined that no event has occurred, or in steps 345, 348, and 35
After any one of the processes 1, 354 and 357 is performed, at step 364, the REDRAW_FLAG
Is determined to be "1". At step 364, R
If it is determined that EDRAW_FLAG = "1",
At step 365, a screen corresponding to the edited contents is displayed on the monitor. REDRAW_FLA in step 364
If it is determined that G is not “1”, step 34
Return to 0. If the processing in step 360 has been performed, the mixing edit mode is temporarily ended.

The editing processing program represented by the flowcharts shown in FIGS. 16 to 21 is stored in the memory 502 in a code signal format readable by the CPU 501. The memory 502 may be a semiconductor memory, a CD-ROM, or a recording medium such as a magnetic disk or an optical disk.

The present invention is not limited to the above-described embodiments, and it is obvious that those skilled in the art can make various improvements and modifications based on the above disclosure.

[0169]

According to the present invention, since the relationship between video and audio can be obtained at a glance, it is possible to easily determine, correct and change the editing point of audio while watching the video. Also,
According to the present invention, an image used for editing can be obtained as an intuitive display close to human sensitivity, so that editing of audio does not require any special skill, and editing can be easily performed in this respect as well.

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing an example of an edit screen display according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of a moving image editing apparatus used in an embodiment of the present invention.

FIG. 3 is an explanatory diagram showing an operation of the moving image editing apparatus used in the embodiment of the present invention.

FIG. 4 is a schematic diagram showing an example of an edit screen display according to the embodiment of the present invention.

FIG. 5 is an explanatory diagram of an operation when performing overlapped audio editing in the embodiment of the present invention.

FIG. 6 is a schematic diagram showing another example of the editing screen display according to the embodiment of the present invention.

FIG. 7 is an operation explanatory diagram when performing overlapped audio editing when a special effect such as wipe dissolve is performed in the embodiment of the present invention.

FIG. 8 is an operation explanatory diagram when performing overlapped audio editing when a special effect of video such as wipe / dissolve is performed in the embodiment of the present invention.

FIG. 9 is a schematic diagram showing still another example of the editing screen display according to the embodiment of the present invention.

FIG. 10 is an explanatory diagram of an operation when performing audio mixing editing in the embodiment of the present invention.

FIG. 11 is a schematic diagram of a display screen after performing overlapped audio editing in the embodiment of the present invention.

FIG. 12 is a schematic diagram of a display screen after performing audio mixing editing in the embodiment of the present invention.

FIG. 13 is a schematic diagram of a display screen before an editing display in the embodiment of the present invention.

FIG. 14 is a schematic diagram of a playback display screen for confirming an editing state in the embodiment of the present invention.

FIG. 15 is a schematic diagram showing another example of an edit screen display according to the embodiment of the present invention.

FIG. 16 is a flowchart showing a procedure of overlap editing shown in FIG. 1;

FIG. 17 is a flowchart showing a procedure of overlap editing shown in FIG. 1;

FIG. 18 is a flowchart showing a procedure of wipe editing shown in FIG. 6;

FIG. 19 is a flowchart showing a wipe editing procedure shown in FIG. 6;

FIG. 20 is a flowchart showing a procedure of mixing editing shown in FIG. 9;

FIG. 21 is a flowchart showing a procedure of the mixing editing shown in FIG. 9;

FIG. 22 is an explanatory diagram showing an example of a screen display for effect editing.

FIG. 23 is an explanatory diagram showing another example of a screen display for effect editing.

FIG. 24 is a block diagram showing an example of a moving image editing apparatus according to the related art.

[Explanation of symbols]

 121, 122 Image sequence based on film image 123, 124 Audio signal waveform display unit 125 Joint 126 Horizontal bar display unit 126A, 126B Horizontal bar 421 indicating audio signal level 421 Tree structure display window 501 CPU 502 Main memory 503 Scene change point detection Unit 504 video interface 505 VTR 506 magnetic storage device 507 frame buffer memory 508 monitor 509 mouse (keyboard) 510 bus 511 image compression / expansion unit 512 audio interface 513 image reduction unit

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] November 18, 1997

[Procedure amendment 1]

[Document name to be amended] Drawing

[Correction target item name] Fig. 4

[Correction method] Change

[Correction contents]

FIG. 4

Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 5/781

Claims (7)

[Claims] 1. A video material (image material) editing method for editing audio material corresponding to image information and a video material (image material) composed of the audio information with the assistance of a computer. Storing information of video material (video information) in a storage device, and reading out a plurality of image sequences (image sequences) to be edited from the video information from the storage device;
In order to generate an edited image sequence (image sequence), in the image editing method, the plurality of image sequences (image sequences) are edited. An image sequence (image sequence) related to audio information is displayed on a common time axis, a display figure operated to move a display position in the time axis direction is displayed, and a display position of the display figure is moved. An image editing method, wherein video information relating to the audio information is edited. 2. The image editing method according to claim 1, wherein the edited image sequence (image sequence) and the edited image sequence (image sequence) are simultaneously displayed. . 3. An apparatus for editing a video material (image material), wherein audio material corresponding to the image information and a video material (image material) composed of the audio information are edited with the aid of a computer. A storage device for storing video material information (video information); a unit for reading a plurality of image sequences (image sequences) to be edited from the video information from the storage device; An image editing apparatus having means for editing the plurality of image sequences (image sequences) for generating the image sequence (image sequence) related to the image information and the image sequence (image sequence) related to the audio information. Means on a common time axis, means for displaying a predetermined display graphic, means for moving the predetermined display graphic in a display position in the time axis direction, and a display position of the display graphic. Means for editing video information related to the audio information in response to being moved. 4. The image editing method according to claim 3, further comprising means for simultaneously displaying the edited image sequence (image sequence) and the edited image sequence (image sequence). Image editing device. 5. A video material (image material) editing method in which a video material (image material) composed of audio information corresponding to image information and the audio information is edited with computer assistance, Storing information of video material (video information) in a storage device, and reading out a plurality of image sequences (image sequences) to be edited from the video information from the storage device;
A medium storing program code representing a procedure of an image editing method characterized by editing the plurality of image sequences (image sequences) in order to generate an edited image sequence (image sequences); A program code representing a procedure for displaying an image sequence (image sequence) related to the image information and an image sequence (image sequence) related to the audio information on a common time axis, and a display figure operated to move a display position in the time axis direction. A recording medium for recording a program code representing a procedure for displaying and a program code representing a procedure for editing and editing video information related to the audio information in response to movement of a display position of the display graphic. . 6. A storage device for storing video information including video information and audio information related to the video information in association with a scene of the video information and information on a change point where the scene changes, and a display device. A video and audio editing apparatus comprising: a device for editing information on scene change points and the video information from the storage device; and a device for controlling each of the devices, wherein a volume of the audio information is adjusted when the video information is edited. In a moving image editing method used in a moving image and sound editing apparatus for setting a value of a volume control level according to the above-mentioned sound information in order to perform editing for adaptively variably controlling, a part of the above-mentioned moving image information to be edited And an image sequence in the form of a film image in which a plurality of frame-unit images in that portion are arranged, and the image sequence, which is arranged side by side with the image sequence. And a bar graphic having a graphic width corresponding to the set value of the volume control level of the audio information to be displayed, and the editing of the audio information in the portion of the video information to be edited is performed on the bar graphic. A moving picture sound editing method, which is performed by changing a display position of a setting graphic display displayed on the screen. 7. The setting graphic displayed on the bar graphic according to the invention of claim 6, wherein at least two of a graphic display for setting a change start point and a graphic display for setting a change end point are used. Video and audio editing method.