JPH07114634A - Method and device for editing multimedia scenario program - Google Patents

Abstract

PURPOSE:To save the labor for editing by describing a scenario program in object units and correcting it, and then converting the program into a program matching the command system of a specific multimedia reproducing device. CONSTITUTION:To verify the edited scenario program in object representation, this scenario program is read in object format as it is and previewed. When the program needs to be corrected, the program can be corrected without considering the whole constitution by correcting the program in object units or altering contents objects. The scenario program in object format which is corrected and completed is converted finally into a procedure type program to be reproduced by a specific multimedia reproducing device. Therefore, the multimedia scenario program which can be reused can be edited without depending upon the specific multimedia reproducing device.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for editing a story composed of multimedia information such as moving images, still images, voices, etc. By describing each object in a format that does not depend on the command system of the media playback device and converting the scenario program described in this object unit into a procedural program corresponding to each playback device, BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia scenario program editing method and an apparatus for editing scenario programs for various multimedia playback apparatuses by editing the scenario programs.

[0002]

2. Description of the Related Art A multimedia reproducing apparatus capable of reproducing a plurality of pieces of information such as a moving image, a still image and a sound in one recording medium (for example, a compact disc) and reproducing them has been put into practical use. In this multimedia reproducing apparatus, various kinds of information recorded in the recording medium can be reproduced in a desired order based on a scenario program (automatic reproduction program) edited in advance. And
The scenario program is, for example, a compact disc
If the CD-ROM is recorded in a specific area of a read-only memory (CD-ROM), the CD-ROM can be mounted in a multimedia reproducing device to perform automatic reproduction or the like. In addition, the multimedia playback device here means
Information (material) exchanged between a plurality of devices is MPEG, J
This is a device that can be played back in a state in which multiple types of data formats such as PEG are mixed (multimedia information).

[0003]

However, the command system (command system; language for scenario program description) for performing automatic reproduction is unique to the multimedia reproducing apparatus and edited for a specific reproducing apparatus. The scenario program can be operated only on a specific playback device. Since the conventional scenario program was edited in a procedural program format corresponding to each multimedia reproducing apparatus, it had to be recreated for each multimedia reproducing apparatus. Therefore, when it is desired to reproduce the same scenario program on a plurality of models of reproducing devices, as shown in FIG. 5, the scenario program is edited with a command system (language for scenario program description) corresponding to each model. Then, each scenario program had to be modified while previewing (simulating) to complete the scenario program. As described above, since it is necessary to edit, preview, and modify each model, a large number of man-hours are required.

The present invention has been made to solve the above problems, and provides a method and apparatus for easily editing a scenario program for various multimedia playback devices by editing the scenario program once. The purpose is to provide.

[0005]

As means for achieving the above object, a multimedia scenario program for editing a multimedia scenario program for reproducing information in a plurality of types of data formats including video information and audio information. An editing method for processing a plurality of information consisting of video information compressed by a predetermined method, audio information compressed by a predetermined method, or a combination of video information and audio information and information compressed by a predetermined method Each object is described in an independent object unit, and a scenario program indicating the reproduction order of these information is described in each processing unit in an independent object unit, and each information and the scenario program are modified in each object unit. To convert to a procedural program suitable for each playback device. A method for editing a media scenario program, and a multimedia scenario program editing apparatus for editing a multimedia scenario program for reproducing information of a plurality of types of data formats including video information and audio information, the method being compressed by a predetermined method. Processing unit of a scenario program indicating the compressed video information, the audio information compressed by a predetermined method, or the information compressed by a predetermined method by combining the video information and the audio information, and the reproduction order of these information. Storage means for separately storing each as an independent object unit, and execution means for interpreting and executing the scenario program stored in the storage means,
Program input means for inputting and modifying each of the information and the scenario program on an object basis, and a procedural program for reproducing the information and the scenario program stored on an object basis by a specific reproducing apparatus. It is intended to provide a multimedia scenario program editing device characterized by including a converting means for converting into.

[0006]

[Function] After describing various information and a scenario program in object units and editing the multimedia scenario program, the multimedia scenario program is converted into a procedural program suitable for the command system of a specific multimedia reproducing apparatus. Since the conversion is performed, the scenario programs for various multimedia playback devices can be easily edited by only editing the multimedia scenario program once.

Further, in the multimedia scenario program editing device, since the contents can be confirmed by previewing (simulating) the multimedia scenario program described in object units, the multimedia scenario program is corrected at this stage to complete the multimedia scenario program. By doing so, it is not necessary to make corrections and changes after conversion into a plurality of procedural programs suitable for the command system of each multimedia playback device, and editing labor can be saved.

[0008]

Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is an explanatory diagram of a multimedia scenario program editing method according to claim 1, and FIG. 2 is an explanatory diagram of a structure of a scenario program.

As an example, 5 minutes of moving image data compressed by the internationally standardized encoding system MPEG-1 is used as the material (source) α, and 1 minute of moving image data compressed by MPEG-1 is used as the material β. Consider a case in which still image data compressed by the internationally standardized encoding method JPEG is used as the material γ to edit a scenario program for reproducing these materials α, β, γ in a desired order.

Each material α, β, γ is currently ISO / IEC
MHEG (multimedia
A data structure of the hypermedia coding expert group) system is used, for example, and is defined as a content object. The data (material) used in this multimedia program is expressed in a plurality of types of data formats, unlike an ordinary computer program that has one data format. Therefore, in order to display (reproduce) each content object, it is necessary to recognize and handle the difference in the data format such as the type of material and the compression method. Therefore, as shown in FIG.
A tag called a hook is attached to each content object (Content), and information (encoding standard name, various parameters, etc.) about the encoding method (data format) is described in this tag.

How to actually display (reproduce) each material α, β, γ on an object called a link
Describe how to proceed. This link object contains
Describes the source object (material), target object (target object), trigger condition, and action (motion). The description content of the link object is as shown in FIGS. 6A to 6C, for example. In the same figure (A), “When object A is in the READY state, object B is RU
N state ”, and in FIG.
It indicates that "the object B is set to the RUN state when the time set in the time stone of the object A is reached", and in FIG.
After that, the object B is put in the STOP state. ”

The action object (Action) shown in FIG. 2 describes the action contents actually sent to the target object. A presentable object (Presentable) is an object that includes a content object that has been changed to actually make a presentation. Presentable 1 is in content 1, presentable 2 is in content 2, and presentable 3 is in content 3. Each corresponds.
Then, by using the presentable object in this way, it is possible to give a presentation without changing the content of the content object itself.

For example, considering a scenario program in which the material α is played for 3 minutes, the material β is played for 1 minute, and finally the material γ is played for 30 seconds when the play button is operated. 1, link 2, link 3
The actions 1 to 3 are described as shown in FIG. In the scenario program shown in FIG. 3,
The meaning of what is described as a timestone is a sign that a certain time has come. In this case,
It is defined to mean that 3 minutes have elapsed when the time stone becomes 1, and 1 minute has elapsed when the time stone becomes 2. Furthermore, in FIG. 2, the selection object (Sele
ction Object) describes a display for the operator to select a motion or a reproduction material, and a target object after selection.

In order to verify the scenario program edited by the object representation, the scenario program is read in the object format and previewed. Then, when the correction is necessary, the modification can be performed without considering the entire configuration, such as changing in units of objects or changing the content object. The object-format scenario program, which has been modified and completed, is finally converted into a procedural program to be played back by a specific multimedia playback device. For example, a multimedia playback device is a CD-
In the case of a reproducing device such as a ROM, after recording into a medium such as a CD-ROM, after conversion into a procedural program (for example, source code corresponding to a certain processor) in a format suitable for the model of the multimedia reproducing device. By using the authoring input / output interface, the procedural program and various kinds of information as reproduction materials are recorded at a predetermined position on a medium such as a CD-ROM. In this way, it is possible to edit a procedural program compatible with various multimedia playback devices.

As described above, the multimedia scenario program editing method of the present invention expresses information (materials) and scenario programs as objects, and therefore can be reused without depending on a specific multimedia reproducing apparatus. You can edit various multimedia scenario programs. Also, by incorporating the concept of MHEG, which is currently being standardized, it will be possible in the future to make data compatible with other multimedia authoring systems (multimedia editing devices) at the scenario program level. .

The advantages of handling the scenario program in object units are as follows. The material to be reproduced, the reproduction method, and the relationship between the materials are treated as independent independent masses (objects), and are defined as a content object, an action object, and a link object, respectively. The description language of the object is not particularly limited, but for example, ASN. Which is standardized by ISO (International Organization for Standardization). 1 is used. These objects encapsulate their contents, and can be handled at the same level without depending on a specific playback device. In addition, by encapsulating the content, it is possible to change in units of the material to be reproduced, the method of reproducing the material, and the relationship between the materials, which facilitates editing as compared with the conventional scenario program description method.

For example, when it is desired to change the condition under which a certain material is reproduced, when the conventional scenario program description method is used, the reproduction condition is selected from the scenario programs described depending on the specific reproduction device. The description portion is searched for and changed, and a certain amount of knowledge about the target playback device and the command for controlling the playback device is required. On the other hand, when the method according to the present invention is used, only the relevant link object needs to be changed to another link object or the contents thereof need to be partially modified. It can be carried out.

FIG. 4 is a block diagram of the multimedia scenario program editing apparatus according to the second aspect. This multimedia scenario program editing device 10 is a main control means 11 configured by using a computer system.
And an image display device 12 such as a CRT monitor display
And an electro-acoustic transducer 13 such as a speaker, a keyboard for inputting an object format scenario program of which an example is shown in FIG. 3, or another device that is edited in advance and stored in a recording medium such as a floppy disk. Program input means 14 for reading the created scenario program.

The multimedia scenario program editing apparatus 10 interprets and executes the scenario program stored in the scenario program storage means 15 based on the preview request supplied via the main control means 11. Based on the program conversion request supplied via the execution unit 16 and the main control unit 11, the scenario program is converted into a command system corresponding to the model of the specified multimedia reproducing apparatus (for example, source code corresponding to a specific processor). The scenario program converting means 17 for converting and the above-mentioned various materials α, β,
a material data storage means 18 for storing γ and the like, a temporary storage means 19 for taking out the scenario program converted by the scenario program conversion means 17 from the material data storage means 18, and temporarily storing the material data. A recording medium writing unit 20 for writing the data temporarily stored in the converted data temporary storage unit 19 into a recording medium such as a CD-ROM is provided.

The multimedia scenario program editing device 10 further includes program display control means 21 for displaying the object format and the converted scenario program on the image display device 12 for editing and editing the program, and a compression code. Moving picture decoding means 22 for decoding the converted moving picture data into, for example, an analog video signal.
A still image decoding means 23 for decoding the compressed and encoded still image data into an analog video signal, and an image output selecting means 2 for selecting a signal to be supplied to the image display device 12.
4 and audio decoding means 24 for decoding compression-coded or digitized audio information into analog audio information.

Next, the operation of the multimedia scenario program editing device 10 will be described. When a program edit request is given, the main control means 11 activates the program display control means 21 and controls the image output selection means 24 so that the output of the program display control means 21 is supplied to the image display device 12. Then, an editor program or the like provided in advance in the main control means 11 is activated so that the scenario program can be edited. The main control means 11 stores the edited scenario program in the scenario program storage means 15.

When the editing of the scenario program is completed and a preview request is given, the main control means 11 activates the scenario program interpreting / executing means 16. The scenario program interpreting / executing means 16 has an interpreter function and interprets and executes an object format scenario program stored in the scenario program storing means 15 when reading it. Specifically, the main control means 11 is supplied with information regarding the designation of the material to be reproduced and the encoding format of the material.

For example, when the material α, which is a moving image compressed and encoded by MPEG-1, is designated, the main control means 11
Reads out the material α from the material data storage unit 18, supplies it to the moving image decoding unit 22, and switches the output selection of the image output selecting unit 24 to display the moving image decoded by the moving image decoding unit 22 as an image. It is supplied to the device 12 to display an image.

The reproduction of the audio information is performed by the material data storage means 1
Audio decoding means 25 for reading digital audio information
It is made by supplying to. The analog audio signal decoded by the audio decoding means 25 is amplified by a built-in low frequency amplifier and supplied to the electro-acoustic converter 13 such as a speaker to reproduce the audio.

Decoding means 2 for moving images, still images and voices
2, 23, and 25 are provided with a plurality of types of decoding circuits or decoding programs so as to correspond to a plurality of types of encoding formats, respectively, and are designated by the scenario program interpreting / executing means 16 via the main control means 11. The decoding operation is selected / switched according to the encoding format used.

When it is confirmed that the contents of the image reproduced by the image display device 12 and the contents of the sound reproduced by the speaker 13 are the desired story, and the program conversion request is given, the main control means 11 causes the scenario. The program conversion means 17 is activated. The scenario program converting means 17 is mainly composed of a compile program or the like for converting an object format scenario program into a procedural program for a reproducing device which can be interpreted and executed by a specific multimedia reproducing device, and the compiled program is reproduced. Multiple systems are provided for each type of device.

As a concrete implementation method of the compiled program, a scenario program described in object units is sequentially interpreted for each object and, for example, an object (content object) representing a material to be reproduced.
Or the object (link object) that represents the playback method, and in the former case, the name of the device (device in which the material is recorded) that represents the material for the specific multimedia playback device. In the latter case, it is converted into a reproduction command or the like for a specific multimedia reproduction device.

The scenario program conversion means 17 performs program conversion according to the conversion target model specified by the input from the program input means 14 and the like, and the main control means 11 temporarily stores the converted program as conversion data. Write to means 19.

When an external output request is given, the main control means 1
1 activates the recording medium writing means 20 via the converted data temporary storage means 19. Recording medium writing means 2
0 receives the scenario program according to the specific model temporarily stored in the converted data temporary storage means 19,
This is written in a specific area of the recording medium mounted in the recording medium writing means 20.

Next, the main control means 11 selects from among various material data stored in the material data storage means 18,
Material data required by the scenario program edited this time is read out and sequentially supplied to the recording medium writing device 20 via the converted data temporary storage means 19. The recording medium writing means 20 writes the supplied material data in a predetermined area of the recording medium. As a result, a recording medium in which a scenario program that can be reproduced by a specific multimedia reproducing apparatus and necessary material data are recorded is created. For example, as the recording medium writing unit 20, a CD-
A ROM writer creates a CD-ROM for a particular multimedia player.

Even with the same scenario program, CD-ROs for three models, model A, model B, and model C
If you need to create M, you can edit the common scenario program described in the object format once, and convert the program by specifying the conversion target model.
You can get the scenario program for each model.

[0032]

As described above, in the multimedia scenario program editing method according to claim 1, after the scenario program is described and modified in object units,
Since this is converted into a program adapted to the command system of a particular multimedia reproducing apparatus, the scenario programs for various multimedia reproducing apparatuses can be edited by editing the scenario program once.
At this time, since the correction is performed on an object-by-object basis, it can be performed very easily. Furthermore, since the correction is completed at the time of the first editing, it is individually corrected after conversion for various multimedia playback devices. The effect is that there is no need to do it.

Since the multimedia scenario program editing device according to the second aspect comprises means for interpreting and executing the scenario program expressed in object units,
By executing the scenario program described in object units, the story can be confirmed without using a specific multimedia playback device. Further, since this multimedia scenario program editing device is provided with the scenario program converting means, the scenario program expressed in object units can be converted into a program suitable for the command system of a specific multimedia reproducing device. It is possible to edit scenario programs for various multimedia playback devices by editing the scenario program once.

[Brief description of drawings]

FIG. 1 is an explanatory diagram of a multimedia scenario program editing method according to claim 1.

FIG. 2 is an explanatory diagram of a structure of a scenario program according to the present invention.

FIG. 3 is an explanatory diagram showing a specific example of a scenario program according to the present invention.

FIG. 4 is a block configuration diagram of a multimedia scenario program editing device according to claim 2;

FIG. 5 is an explanatory diagram of a conventional scenario program editing process.

FIG. 6 is an explanatory diagram showing a specific example of a link object according to the present invention.

[Explanation of symbols]

 10 multimedia editing device 11 main control means 15 scenario program storage means 16 scenario program interpretation / execution means 17 scenario program conversion means 20 recording medium writing means

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical display location G11B 27/034 H04N 5/91 8224-5D G11B 27/02 K 7734-5C H04N 5/76 Z

Claims (2)

[Claims] 1. A multimedia scenario program editing method for editing a multimedia scenario program for reproducing information of a plurality of types of data formats including video information and audio information, the video being compressed by a predetermined method. Information or audio information compressed by a predetermined method or video information and audio information are combined to describe a plurality of information consisting of information compressed by a predetermined method in independent object units for each processing unit,
Further, a scenario program indicating the reproduction order of these information is described in object units independent for each processing unit, and after correcting each information and the scenario program in each object unit, a procedural type corresponding to each reproduction apparatus is written. A method for editing a multimedia scenario program, characterized by converting into a program. 2. A multimedia scenario program editing device for editing a multimedia scenario program for reproducing information of a plurality of types of data formats including video information and audio information, the video being compressed by a predetermined method. Information, audio information compressed by a predetermined method, or information compressed by a predetermined method by combining video information and audio information, and a scenario program indicating the reproduction order of these information are independent for each processing unit. Storage unit for separately storing as an object unit, execution unit for interpreting and executing the scenario program stored in the storage unit, and a program for inputting and modifying each of the information and the scenario program in object units Input means, the information stored in object units, and the scenario plan A multimedia scenario program editing device, comprising: a conversion means for converting a program into a procedural program for reproduction by a specific reproduction device.