JP2006333330A - Data processing method, apparatus and program thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To start processing of content data based on the attribute data at a timing earlier than conventional using data in which content data and attribute data indicating the attribute of the content data are mixed. To do.
MXF file data FILE is analyzed (traced) by an MXF analysis unit 31. When picture data is detected, it is added to image file data IFD in a picture memory 24. When the index data INDEX is detected, the attribute management data PMD in the index memory 25 is updated based on the index data INDEX.
[Selection] Figure 5

Description

  The present invention relates to a data processing method, apparatus, and program for processing data in which content data and attribute data indicating attributes of the content data are mixed.

MXF (Material eXchange Format) is one of file exchange formats for video data and audio data.
MXF is composed of a plurality of pack data PACKs, and each pack data PACK includes index data INDEX indicating the attribute of the frame data and one or a plurality of frame data.
Each frame data includes system data, picture data, and sound data.
By the way, in a computer such as a personal computer, MXF file data is downloaded and then reproduced and edited.
In this case, the computer traces the MXF format file data, extracts the picture data, and stores it in the picture file.
The computer analyzes the picture file and generates and manages attribute data such as GOP related data of the picture data.
Thereafter, the computer performs processing such as reproduction and editing based on the picture file and the attribute data.

However, in the system described above, the entire MXF file data downloaded is traced to perform the picture data separation process, and then the separated picture data analysis process must be completed before playback and editing can be started.
Therefore, there is a problem that it takes a long time after the file data is downloaded until playback and editing can be started.

  The present invention has been made in view of the above-described problems of the prior art, and uses the data in which content data and attribute data indicating the attribute of the content data are mixed to process the content data based on the attribute data. It is an object of the present invention to provide a data processing method, an apparatus thereof, and a program that can be started at an earlier timing than conventional.

  In order to solve the above-described problems of the prior art, the data processing method according to the first aspect of the present invention provides the data processing method according to one trace for data in which content data and attribute data indicating the attribute of the content data are mixed. A first step of detecting content data and the attribute data; and a second step of writing the detected content data in a first storage area when the content data is detected during the tracing of the first step. And a third step of writing the detected attribute data in the second storage area when the attribute data is detected in the trace in the first step.

  According to a second aspect of the present invention, there is provided a data processing device, wherein the content data and the attribute data are detected by a single trace for data in which content data and attribute data indicating the attribute of the content data are mixed. Content processing means for writing the content data detected by the detection means to a first storage area, and attribute processing means for writing attribute data detected by the detection means to a second storage area.

  According to a third aspect of the present invention, there is provided a program executed by a computer, wherein the content data and the attribute data are obtained by a single trace for data in which content data and attribute data indicating the attribute of the content data are mixed. A first procedure for detecting the content data, a second procedure for writing the detected content data to a first storage area when the content data is detected during the trace of the first procedure, and the first procedure When the attribute data is detected in the trace, the computer is caused to execute a third procedure for writing the detected attribute data in the second storage area.

  According to the present invention, processing of the content data based on the attribute data is started at an earlier timing than before using data in which content data and attribute data indicating the attribute of the content data are mixed. A data processing method, an apparatus thereof, and a program can be provided.

Hereinafter, embodiments of the present invention will be described.
First, the correspondence between the configuration of the present invention and the configuration of the present embodiment will be described.
The picture data of this embodiment is an example of the content data of the present invention.
Further, the data L of the KLV data and the index data INDEX of the present embodiment are examples of attribute data of the present invention.
Step ST11 shown in FIG. 8 is an example of the first process of the present invention, step ST14 is an example of the second process of the present invention, and steps ST13 and ST16 are an example of the third process of the present invention. .
The MXF analysis unit 31 shown in FIG. 5 is an example of the detection unit of the present invention, the picture configuration unit 32 is an example of the content processing unit of the present invention, and the index configuration unit 33 is an example of the attribute processing unit of the present invention. It is.
A program PRG shown in FIG. 5 is an example of the program of the present invention.

An outline of the computer 4 shown in FIG. 1 will be described.
As shown in FIG. 5, the computer 4 stores the MXF file data FILE downloaded from the FTP server 3 in the input MXF memory 22.
Then, the MXF analysis unit 31 of the processing circuit 23 outputs the data L and V of the KLV data storing the picture data to the picture configuration unit 32 based on the key K of the KLV data constituting the file data FILE, and the index data The data V of the KLV data storing the INDEX is output to the index configuration unit 33.
The picture construction unit 32 adds data V, which is picture data, to the image file data IFD stored in the picture memory 24.
Also, the picture configuration unit 32 updates the attribute management data PMD stored in the index memory 25 based on the data L of the picture data.
Further, the index configuration unit 33 updates the attribute management data PMD based on the data V (index data INDEX) of the KLV data input from the MXF analysis unit 31.
That is, the computer 4 generates (updates) the attribute management data PMD in parallel with the generation of the image file data IFD.

Hereinafter, the communication system 1 will be described in detail with reference to the drawings.
FIG. 1 is an overall configuration diagram of a communication system 1 according to an embodiment of the present invention.
As shown in FIG. 1, the communication system 1 includes, for example, an FTP (File Transfer Protocol) server 3 and a computer 4, which communicate via a network 2.

[MXF file FILE]
First, the MXF file data FILE used in the communication system 1 will be described.
FIG. 2 is a diagram for explaining file data FILE in the MXF format used in the communication system 1 shown in FIG.
MXF is a standard defined in SMPTE-377M published by SMPTE (Society of Motion Picture & Television Engineers).
This standard, studied at the ProMPEG Forum, is a video content format mainly for the purpose of interoperability with business-use devices, and that video data, audio data, and metadata can be combined into a single file. It is characterized by not depending on the codec of data / audio data, and is used for applications such as digital archiving, content distribution, and nonlinear editing.

As shown in FIG. 2, the file data FILE includes header data HEADER, body data BODY, and footer data FOTER.
The header data HEADER includes a header partition pack HPP and metadata META.
The header partition pack HPP shows attribute data for the entire file data FILE.
For example, when the header partition pack HPP indicates Closed partition, the number of frames, which is the number of frame data included in the file data FILE, can be indicated in the metadata META.

The metadata META is an encoding method of frame data (video data and audio data) stored in the body data BODY, keywords related to the contents of the frame data, title, identification data, editing data, creation data, editing data, etc. Indicates the attribute.
In addition, the metadata META includes, for example, a time code related to frame data, data for specifying missing frame data, the number of frames (Duration), and the like.

The body data BODY is composed of a plurality of pack data PACK.
The pack data PACK is classified by the body partition pack BPP.
Each pack data PACK includes index data INDEX and one or a plurality of editing unit data EU as shown in FIG.

The index data INDEX includes GOP (Group Of Pictures) related data of a frame in the editing unit data EU in the pack data PACK immediately before the pack data PACK in which the index data INDEX is stored.
The GOP related data indicates, for example, a frame number, a temporal offset, a key frame offset, and a flag.
The frame number indicates a number assigned to identify a target frame.
As shown in FIG. 3, the temporal offset indicates an offset in the editing unit data EU from the display order to the encoding order.
The key frame offset indicates an offset within the editing unit data EU up to the key frame.
The flag indicates whether the frame data is I Frame (Intra Frame: intra-frame coding) or the type using the correlation with the previous (past) I Frame, P Frame (Predicted Frame: forward predictive coding), before and after ( I / P / B frame information frame such as B Frame (Bi-directional predicted Frame) is a frame compressed using the correlation with I Frame of the past and future). Indicates whether or not

  In the above-described example, the case where the index data INDEX indicates the GOP related data of the frame data of the editing unit data EU in the pack data PACK in which the index data INDEX is stored is illustrated, but the index data INDEX is stored. The GOP related data of the frame data in the pack data PACK may be indicated.

As shown in FIG. 2, each of the editing unit data EU includes video data PIC and audio data SOU for one frame, and system data SYS indicating these attributes.
The system data SYS indicates, for example, the format and type of the video data PIC and the audio data SOU.
The system data SYS is, for example, the MXF_D format (for example, D10 standardized by SMPTE), and the type (for example, IMX50_625, IMX40_625, IMX30_625, IMX50_525, IMX40_525, IMX30_525, etc., standardized by SMPTE). Indicates.
In addition to the above, the system data SYS indicates, for example, an encoding method, a time code, UMID (Unique Material IDentifier) that is identification data of the data MXF_D, and the like.

The video data PIC is video data encoded by MPEG (Moving Picture Experts Group) or the like.
The audio data SOU is audio data encoded by AES (Audio Engineering Society) 3 or the like.
As described above, the file data FILE is stored in a state where the video data PIC and the audio data SOU are interleaved (mixed state).

  The footer data FOTER includes identification data indicating the end of the file data FILE.

For example, the video data PIC, the audio data SOU, and the system data SYS that constitute the editing unit data EU described above are composed of, for example, a single or a plurality of KLV data.
FIG. 4 is a diagram for explaining the KLV data.
As shown in FIG. 4, the KLV data includes a key K, a data length L, and data V.
The key K and the data length L are each fixed-length data, the key K is identification data of the content (type) of the data V, for example, and the data length L indicates the data length of the data V.
Data V indicates a data body.
The KLV data can be KLV data as data (V).
In order to perform analysis processing of KLV data, the fixed-length key K is read to determine the data type, the fixed-length data L is read to determine the length of the data V, and the data V corresponding to the length is read. Read and process.
The entire KLV data can be analyzed by repeating the above three processes in units of K, L, and V in order from the beginning of the file to the end.
Since the MXF file FILE is composed of the above KLV data, the basic analysis process can be performed in the same manner as the above KLV data analysis process.

[FTP server 3]
The FTP server 3 transmits the above-described MXF file data FILE to the computer 4 via the network 2.

[Computer 4]
The computer 4 downloads MXF data from the FTP server 3 and performs reproduction processing and editing processing.
FIG. 5 is a block diagram of the computer 4 shown in FIG.
As shown in FIG. 5, the computer 4 includes, for example, an interface 21, an input MXF memory 22, a processing circuit 23, a picture memory 24, an index memory 25, a display 26, a memory 27, and an operation unit 28.

The interface 21 receives MXF file data FILE from the FTP server 3 shown in FIG.
The input MXF memory 22 stores the MXF file data FILE received by the interface 21.

  For example, the processing circuit 23 executes the program PRG read from the memory 27 to realize the MXF analysis unit 31, the picture configuration unit 32, the index configuration unit 33, and the reproduction / editing unit 34 illustrated in FIG.

The MXF analysis unit 31 traces the MXF file data FILE read from the input MXF memory 22 and performs an analysis process thereof.
Specifically, the MXF analysis unit 31 reads the fixed-length key K of the KLV data constituting the file data FILE to determine the data type, reads the fixed-length data L, and determines the length of the data V. The data is calculated and read as data V for the length, and processed.
Then, when the key K of the read KVL data indicates picture data, the MXF analysis unit 31 outputs the data L of the KLV data and the data V (picture data) to the picture configuration unit 32.
At this time, based on the data L of the KLV data, the MXF analysis unit 31 outputs the subsequent picture data for the data length V to the picture configuration unit 32 as data V.

  Further, when the MXF analysis unit 31 indicates that the key K of the read KLV data is the index data INDEX, the data for the data length L following the data L of the KLV data is used as the data V (index data INDEX). , Output to the index configuration unit 33.

  Further, when the key K of the read KLV data is neither the picture data nor the index data INDEX, the MXF analysis unit 31 determines the key K of the next KLV data of the KLV data based on the data L. To do.

  The MXF analysis unit 31 analyzes the entire file data FILE by repeating the above KLV data processing from the beginning of the file data FILE to the end in order.

The picture configuration unit 32 inputs the data L and V of the picture data from the MXF analysis unit 31.
As shown in FIG. 6, the picture configuration unit 32 accumulates the data length indicated by the data L input from the MXF analysis unit 31 from the first picture data to the previous picture data of the target picture data for each target picture data. The picture offset is calculated and stored in the item associated with the target picture data in the attribute management data PMD shown in FIG.
Further, as shown in FIG. 6, the picture configuration unit 32 sets the data L of each target picture data as the picture size (Picture Size) and is associated with the target picture data in the attribute management data PMD shown in FIG. Stored in the selected item.

  Also, the picture configuration unit 32 adds the data V (picture data) input from the MXF analysis unit 31 to the image file data IFD stored in the picture memory 24 as shown in FIG.

The index construction unit 33 registers the GOP related data indicated by the index data INDEX input from the MXF analysis unit 31 in the attribute management data PMD shown in FIG.
That is, the index configuration unit 33 displays the frame number, temporal offset, key frame offset, and flags indicated by the GOP related data in the attribute management data PMD. Store in the corresponding item.

  The reproduction / editing unit 34 receives an operation signal corresponding to an operation by the user from the operation unit 28, and based on the operation signal and the attribute management data PMD shown in FIG. 6 stored in the index memory 25, the picture memory The reproduction processing (decoding processing) of the image file data IFD stored in 24 is performed, and the image obtained thereby is output to the display 26.

Hereinafter, an operation example of the computer 4 illustrated in FIG. 5 will be described.
FIG. 8 is a flowchart for explaining an operation example (Unwrap) of the computer 4 shown in FIG.
Step ST11:
The MXF analysis unit 31 of the processing circuit 23 reads, for example, the MXF file data FILE shown in FIGS. 2, 6, and 7 from the input MXF memory 22 in units of KLV data.

Step ST12:
When the MXF analysis unit 31 of the processing circuit 23 determines whether the KLV data relates to picture data based on the key K of the KLV data read in step ST11, and determines that the KLV data relates to picture data, It progresses to step ST13, and when that is not right, it progresses to step ST15.

Step ST13:
The MXF analysis unit 31 of the processing circuit 23 outputs the data L of the KLV data read in step ST11 to the picture configuration unit 32.
As shown in FIG. 6, the picture configuration unit 32 accumulates the data length indicated by the data L input from the MXF analysis unit 31 from the first picture data to the previous picture data of the target picture data for each target picture data. The picture offset is calculated and stored in the item associated with the target picture data in the attribute management data PMD shown in FIG.
Further, as shown in FIG. 6, the picture configuration unit 32 sets the data L of each target picture data as the picture size (Picture Size) and is associated with the target picture data in the attribute management data PMD shown in FIG. Stored in the selected item.

Step ST14:
The MXF analysis unit 31 of the processing circuit 23 outputs the data V of the KLV data read in step ST11 to the picture configuration unit 32.
The picture construction unit 32 adds the data V (picture data) input from the MXF analysis unit 31 to the image file data IFD stored in the picture memory 24 as shown in FIG.
Thereafter, the processing circuit 23 proceeds to step ST17.

Step ST15:
When the MXF analysis unit 31 of the processing circuit 23 determines whether the KLV data is related to the index data INDEX based on the key K of the KLV data read in step ST11, and determines that the KLV data is related to the index data INDEX The process proceeds to step ST16, and if not, the process proceeds to step ST17.

Step ST16:
The MXF analysis unit 31 of the processing circuit 23 outputs the data V (index data INDEX) of the KLV data read in step ST11 to the index configuration unit 33.
The index construction unit 33 registers the GOP related data indicated by the index data INDEX input from the MXF analysis unit 31 in the attribute management data PMD shown in FIG.
That is, the index configuration unit 33 displays the frame number, the temporal offset, the key frame offset, and the flags indicated by the GOP related data in the attribute management data PMD. Store in the corresponding item.

Step ST17:
The MXF analysis unit 31 of the processing circuit 23 determines whether or not the analysis of all KLV data constituting the file data FILE is completed, and returns to step ST11 if it is determined that the analysis has not been completed.
The processing circuit 23 completes the processing of step ST17 described above, and then stores the image file stored in the picture memory 24 based on the attribute management data PMD stored in the index memory 25 in accordance with the operation signal from the operation unit 28. Data IFD reproduction processing or editing processing is performed.

As described above, according to the computer 4, as described with reference to FIG. 8, in the process of tracing the MXF file data FILE by the MXF analysis unit 31 in the processing circuit 23, the image file data shown in FIG. The IFD generation process and the attribute management data PMD generation process shown in FIG. 6 are performed in parallel.
That is, the computer 4 does not generate the attribute management data after generating the image file data IFD as in the prior art, but also generates the attribute management data PMD in the process of generating the image file data IFD. Generate.
Therefore, according to the computer 4, the image file data IFD can be stored in the picture memory 24 and the attribute management data PMD can be stored in the index memory 25 when the tracing of the entire file data FILE is completed.
As a result, the computer 4 can generate the image file data IFD and the attribute management data PMD in a shorter time than before, after starting the analysis processing of the file data FILE.

Moreover, according to the computer 4, the processing load of the processing circuit 23 can be reduced by increasing the efficiency of the processing as described above.
Further, according to the computer 4, after the image file data is generated, the analysis process thereof can be made unnecessary.

The present invention is not limited to the embodiment described above.
In the embodiment described above, MXF file data FILE is exemplified as “data in which content data and attribute data indicating the attribute of the content data are mixed” in the present invention, but the present invention is not limited to this. Absent.

FIG. 1 is a configuration diagram of a communication system 1M according to an embodiment of the present invention. FIG. 2 is a diagram for explaining MXF file data transmitted from the FTP server shown in FIG. 1 to the computer. FIG. 3 is a diagram for explaining GOP related data stored in the file data FILE. FIG. 4 is a diagram for explaining the KLV data. FIG. 5 is a block diagram of the computer shown in FIG. FIG. 6 is a diagram for explaining the attribute management data PMD stored in the index memory shown in FIG. FIG. 7 is a diagram for explaining the image file data IFD stored in the picture memory shown in FIG. FIG. 8 is a flowchart for explaining an operation example of the computer shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Communication system, 3 ... FTP server, 4 ... Computer, FILE ... File data of MXF, 21 ... Interface, 22 ... Memory for input MXF, 23 ... Processing circuit, 24 ... Picture memory, 25 ... Index memory, 26 ... Display , 27 ... Memory, 28 ... Operation part, 31 ... MXF analysis part, 32 ... Picture composition part, 33 ... Index composition part, 34 ... Playback / editing part, PMD ... Attribute management data, IFD ... Image file data

Claims (9)

A first step of detecting the content data and the attribute data by a single trace for data in which content data and attribute data indicating the attribute of the content data are mixed;
A second step of writing the detected content data to the first storage area when the content data is detected during the trace of the first step;
A data processing method comprising: a third step of writing the detected attribute data in a second storage area when the attribute data is detected in the trace in the first step. A fourth step of performing a process of reproducing the content data written in the first storage area in the second step based on the attribute data written in the second storage area in the third step The data processing method according to claim 1, further comprising: The content data includes a plurality of pack data,
Each of the pack data includes first attribute data of frame data and one or a plurality of frame data,
The data processing method according to claim 1, wherein the first step detects the first attribute data in the pack data and the content data in the frame data in the pack data. The frame data further includes second attribute data indicating a data length of the content data in the frame data,
The data processing method according to claim 3, wherein the first step further detects the second attribute data. The data processing method according to claim 3, wherein the first attribute data indicates an encoding type when the frame data is encoded image data. The data processing method according to claim 4, wherein the second attribute data indicates a data length of the frame data. Detecting means for detecting the content data and the attribute data by a single trace on data in which content data and attribute data indicating the attribute of the content data are mixed;
Content processing means for writing the content data detected by the detection means to a first storage area;
A data processing apparatus comprising: attribute processing means for writing the attribute data detected by the detection means to a second storage area. 8. The reproduction apparatus according to claim 7, further comprising: a reproducing unit that reproduces the content data written in the first storage area by the content processing unit based on the attribute data written in the second storage area by the attribute processing unit. The data processing apparatus described. A program executed by a computer,
A first procedure for detecting the content data and the attribute data by a single trace for data in which content data and attribute data indicating the attribute of the content data are mixed;
A second procedure for writing the detected content data to the first storage area when the content data is detected during the trace of the first procedure;
When the attribute data is detected during the trace in the first procedure, a program for causing the computer to execute a third procedure for writing the detected attribute data in a second storage area.

Images