KR100837721B1 - Encoding/Decoding Apparatus and Encoding Method of Binding Format for Consuming Personalized Digital Broadcasting Contents - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to an integrated format encoding apparatus for the consumption of personalized digital broadcast content, a decoding apparatus and an encoding method thereof.

2. The technical problem to be solved by the invention

The present invention relates to digital broadcast content (e.g., digital broadcast programs, TVA metadata and additional content) and user data (e.g., user assets, user preferences or user viewing information), and the use rights and time and space for such content. By encoding and storing the configuration information and the synchronization information in a single integrated format, and playing the encoded integrated format according to the synchronization information of each component, it is possible to produce or store different consumption experiences for each user. The present invention aims to provide an integrated format encoding apparatus for consuming personalized digital broadcasting content, a decoding apparatus and an encoding method thereof.

3. Summary of Solution to Invention

According to an aspect of the present invention, there is provided an integrated format encoding apparatus for consuming personalized digital broadcast content, comprising: digital broadcast content acquiring means for acquiring digital broadcast content; User data acquiring means for acquiring user data generated while the user consumes the acquired digital broadcast content; User metadata generating means for generating user metadata using the spatiotemporal configuration information and synchronization information of the obtained user data; And integrated format encoding means for encoding the obtained digital broadcast content, the obtained user data, and the generated user metadata into a unified format for consumption of personalized digital broadcast content.

4. Important uses of the invention

The present invention is used for integrated format encoding / decoding for consumption of personalized digital broadcast content.

Integrated broadcast content, MPEG-4 file format, MPEG-21 file format, MPEG-4 BIFS, user preferences, personal viewing information, TV-Anytime, customized broadcasting, personal data broadcasting, MAF (MPEG Application Format)

Description

Integrated format encoding apparatus for consumption of personalized digital broadcasting content, decoding apparatus and encoding method thereof {Encoding / Decoding Apparatus and Encoding Method of Binding Format for Consuming Personalized Digital Broadcasting Contents}

1 is a block diagram of an embodiment of an integrated format encoding / decoding apparatus for consumption of personalized digital broadcasting content according to the present invention;

2 is a diagram illustrating an embodiment of a profile of a storage format according to a digital broadcasting service environment according to the present invention;

3 is a structural diagram of an embodiment of an integrated broadcast content based on an MPEG-4 file format according to the present invention;

4 is a diagram illustrating an embodiment of a process of rendering integrated broadcast content based on BIFS applied to the present invention;

5 is a structural diagram of an embodiment of an integrated broadcast content based on an MPEG-21 file format according to the present invention;

6 is a flowchart of an embodiment of an integrated format encoding method for consumption of personalized digital broadcast content according to the present invention.

* Explanation of symbols on the main parts of the drawing

110: encoder 111: digital consumption right acquisition unit

112: broadcast program acquisition unit 113: TVA metadata acquisition unit

114: user data acquisition unit 115: additional content acquisition unit

116: user metadata generation unit 117: unified format encoding unit

118: Integrated format editor 10: Integrated format

120: decoder 121: integrated format decoding unit

122: digital consumption right verification unit 123: broadcast program playback unit

124: user metadata interpreter 125: TVA metadata interpreter

126: TVA metadata playback unit 127: Digital item playback unit

The present invention relates to an integrated format encoding apparatus for the consumption of personalized digital broadcasting content, a decoding apparatus and an encoding method thereof, and more particularly, to digital broadcasting content (eg, digital broadcasting program, TVA metadata and additional content). ) And user data (e.g., user assets, user preferences, or user viewing information), usage rights for such content, and configuration and synchronization information in space and time, encoded and stored together in one unified format, An integrated format encoding device for the consumption of personalized digital broadcast content, and a decoding device and encoding thereof, which can produce or store different consumption experiences for each user by reproducing the encoded integrated format according to the synchronization information of each component. It is about a method.

Along with the digitization of broadcasts, there is a demand for a change from conventional broadcasts to user-tailored broadcasts with additional services. In addition, the functions of television terminals such as a personal video recorder and a set-top box are being improved. Such a television terminal is expected to provide a storage function of broadcast content, an input function of user data, and the like. In other words, when a user watches television, user data containing the user's intention (for example, checking an important part, taking a brief note, or recording his / her voice) may be stored on the television terminal. In addition, it is expected that recording information of the user, such as repeatedly playing back a specific portion of broadcast content or stopping viewing, will be provided in the TV terminal.

In conventional analog broadcasting, the user can only select a channel. However, as digitalization of broadcast proceeds, a user can consume broadcast content in various patterns such as consumption of additional content as well as broadcast content or input user data. Information about the additional content and broadcast content may be described through metadata. The most representative example is TV-Anytime (TVA) metadata.

Here, TVA metadata is largely divided into phase 1 and phase 2 according to a broadcasting environment and a function to be provided. Phase 1 is a standard for metadata that enables search, selection, acquisition, and consumption of broadcast content when main broadcast content is transmitted in one direction and metadata for broadcast content is transmitted in both directions. Phase 2 metadata is metadata that enables access and use by describing access information on additional contents through a contents referencing identifier (CRID).

The user then consumes additional content via the CRID of the TVA metadata while watching the broadcast. At this time, the user consumes additional content by downloading and streaming. In addition, as the user watches the broadcast, it is expected that user data such as memo, marking, and voice recording inputted by the user's intention or user's viewing history information is generated. In addition, broadcast contents and additional contents stored in a personal terminal are expected to be consumed by being stored in a storage medium (eg, HD-DVD, DVD, Blu-ray Disc) according to the storage capacity of a limited terminal and the user's taste.

However, TVA metadata alone does not allow access and extraction of additional content or user data stored with broadcast content. Therefore, even after storing broadcast contents in a storage medium, a new storage format is urgently required to provide a user-tailored broadcasting service. In other words, with the digitization of the broadcasting environment, various types of consumption are required for storing, reusing, editing, and sharing the digital broadcasting program after storing it in a storage medium. There is a demand for storing not only broadcast programs but also related contents and metadata when storing them in a storage medium.

Furthermore, there is a demand for producing and preserving different consumption experiences for each individual by storing user data such as content and metadata collected / created or edited by the user and user preference information and viewing information. .

The present invention has been proposed to meet the above requirements, and includes digital broadcast content (eg, digital broadcast programs, TVA metadata, and additional content) and user data (eg, user assets, user preferences, or user viewing information). And the user's right to use such content, time-space configuration information and synchronization information are encoded and stored together in one unified format, and the encoded unified format is reproduced according to the synchronization information of each component. It is an object of the present invention to provide an integrated format encoding apparatus, a decoding apparatus and an encoding method thereof for the consumption of personalized digital broadcast content, which can produce or store different consumption experiences.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. It will also be appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided an integrated format encoding apparatus for consuming personalized digital broadcast content, comprising: digital broadcast content obtaining means for obtaining digital broadcast content; User data acquiring means for acquiring user data generated while the user consumes the acquired digital broadcast content; User metadata generating means for generating user metadata using the spatiotemporal configuration information and synchronization information of the obtained user data; And integrated format encoding means for encoding the obtained digital broadcast content, the obtained user data, and the generated user metadata into a unified format for consumption of personalized digital broadcast content. In addition, the present invention, the digital broadcast content to edit at least one of the digital broadcast content and the user data included in the encoded integrated format at the request of the user to edit the encoded integrated format into a new unified format, And integrated format editing means for controlling the obtaining means and the user metadata generating means.

On the other hand, the present invention, in the integrated format decoding apparatus for consumption of personalized digital broadcast content, decoding the integrated format transmitted from the outside, digital consumption rights, digital broadcast program, TVA metadata, additional content, user data and user Integrated format decoding means for extracting metadata; Digital consumption right verification means for performing an authentication function using digital consumption right upon re-consumption of the integrated form; TVA metadata analyzing means for interpreting TVA metadata delivered from said integrated format decoding means; An analysis result of the TVA metadata analyzing means, the user metadata transmitted from the integrated format decoding means, and reference information about the user data and reference information about additional content through the reference table according to the interpreted result. User metadata analyzing means for extracting; Broadcast program reproducing means for reproducing the extracted digital broadcast program, user data, and additional contents according to space-time information using reference information of each content; And TVA metadata reproducing means for providing an additional information service using additional information on the digital broadcast program described in the transmitted TVA metadata.

On the other hand, the present invention, the integrated format encoding method for the consumption of personalized digital broadcast content, Digital broadcasting content acquisition step of acquiring digital broadcast content; A user data obtaining step of obtaining user data generated while the user consumes the obtained digital broadcasting content; Generating user metadata by using the spatiotemporal configuration information and synchronization information of the obtained user data; And an integrated format encoding step of encoding the obtained digital broadcast content, the obtained user data, and the generated user metadata into a unified format for consumption of personalized digital broadcast content. The present invention also provides an integrated format editing step of editing the encoded integrated format into a new integrated format by updating at least one of digital broadcasting content and user data included in the encoded integrated format according to the user's request. It includes more.

In the present invention, the term digital broadcasting terminal refers to a terminal capable of receiving digital broadcasting. For example, digital broadcasting terminals include terrestrial digital broadcasting terminals, satellite digital broadcasting terminals, cable digital broadcasting terminals, IPTV (Internet Protocol Television) terminals, digital multimedia broadcasting (DMB) terminals, and the like.

In the present invention, the digital broadcast content refers to the content that can be consumed by the digital broadcast terminal. For example, the digital broadcast content includes a digital broadcast program and additional content.

In the present invention, the additional content refers to multimedia resources that can be acquired and consumed through TVA metadata in a digital broadcasting terminal, data broadcasting applications that can be acquired and consumed by data broadcasting, and multimedia that can be searched, acquired and consumed by a user. Collective resources. In addition, the additional content refers to content types provided by the TVA standard and application types provided by data broadcasting middleware such as Advance Common Application Platform (ACAP), Multimedia Home Platform (MHP), and Open Cable Application Platform (OCAP). Include them. For example, additional content includes documents, images, audio, video, text, Java classes, Java applets, web pages, and the like.

In the present invention, the storage medium refers to a medium for storing digital data. For example, storage media include hard disks, memory, external storage, network storage, CDs, DVDs, HD-DVDs, Blu-ray discs, and the like.

In the present invention, the user data refers to personalized information generated by the user's intention. For example, the user data includes content and metadata collected or created / edited by the user, preference information and viewing information of the user.

In the present invention, a digital item may be included in an integrated form and controlled by digital consumption rights, and collectively refer to multimedia resources that a user may individually consume. For example, a digital item includes a digital broadcast program, additional content, and user data.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of an integrated format encoding / decoding apparatus for consumption of personalized digital broadcasting content according to the present invention.

As shown in FIG. 1, an integrated format encoding / decoding apparatus for consumption of personalized digital broadcast content according to the present invention includes an encoder 110 and a decoder 120. Here, the encoder 110 for the consumption of personalized digital broadcast content according to the present invention is a digital consumption rights acquisition unit 111, broadcast program acquisition unit 112, TVA metadata acquisition unit 113, user data acquisition unit 114, an additional content obtaining unit 115, a user metadata generating unit 116, an integrated format encoding unit 117, and an integrated format editing unit 118. In addition, the decoder 120 for the consumption of personalized digital broadcast content according to the present invention includes an integrated format decoding unit 121, digital consumption right verification unit 122, broadcast program playback unit 123, user metadata analysis unit 124, TVA metadata analyzing unit 125, and TVA metadata reproducing unit 126.

Hereinafter, each component of the integrated format encoder 110 for consumption of personalized digital broadcasting content according to the present invention will be described.

The digital consumption right acquiring unit 111 acquires a right to reproduce, store, edit, exchange, and consume digital broadcasting content (hereinafter, referred to as digital consumption right) and delivers it to the integrated format encoding unit 117. do. In this case, when the digital consumption right for the digital broadcasting content is obtained in the digital broadcasting terminal, it is preferable that the digital consumption right obtaining unit 111 obtains the digital consumption right from the service provider. For example, the digital consumption right obtaining unit 111 obtains a digital consumption right for viewing and storing a subscriber-based broadcasting program (satellite DMB or cable broadcasting) from a service provider. The acquired digital consumption right is encoded in the integrated format 10, and the digital consumption right verification unit 122 performs an authentication function using the digital consumption right when the integrated format 10 is re-used in the decoder 120. In addition, when the digital consumption right for the digital broadcast content stored in the storage medium is obtained by the decoder 120, it is preferable that the digital consumption right verification unit 122 to be described later obtains. For example, when a broadcast program and additional content of an over-the-air broadcast are stored in a storage medium and played back in the decoder 120, the digital consumption right verification unit 122 performs both the acquisition and authentication functions of the digital consumption right, thereby saving the storage medium. The digital broadcast content stored in the is consumed.

The broadcast program acquisition unit 112 performs a function of acquiring and storing a digital broadcast program that is broadcast through a digital broadcast channel (for example, terrestrial digital broadcast, satellite digital broadcast, DMB broadcast, or IPTV broadcast). do. The digital broadcast program is delivered to the integrated format encoding unit 117 or the additional content obtaining unit 115. In this case, the digital broadcasting terminal preferably has a function of simultaneously storing the digital broadcasting program and storing the same in a storage medium. In addition, the broadcast service environment in which the digital broadcasting terminal operates may be configured by a general one-way broadcast service environment and an interactive service environment through a communication network such as the Internet network independently or interlocked and fused.

The TVA metadata obtaining unit 113 obtains TVA metadata corresponding to the digital broadcasting program transmitted through the digital broadcasting channel and transmits the TVA metadata to the integrated format encoding unit 117 or the additional content obtaining unit 115. In this case, the acquired TVA metadata may include both Phase 1 and Phase 2 specifications of the TVA. In addition, the TVA metadata may be multiplexed together with the audio and video streams of the broadcast program and transmitted through the same channel, separate independent channels, or a communication network such as the Internet.

The user data acquisition unit 114 is generated by the intention and action of the viewer while the user (viewer of the digital broadcast content) consumes (eg, consumes, reserves, stores, and edits) the digital broadcast content and metadata. The user data is obtained and transferred to the user metadata generator 116 or the integrated format encoder 117. User data generated by viewers' intentions and actions may include user work (eg, user marking, notes, voice recordings, or video capture), user preferences (eg, preferred broadcast channels, programs, program segments). , Genre, or character), and viewing information of the user (eg, consumption history of digital broadcasting content, whether to watch a program by section, or data generated by an application when the application of data broadcasting is consumed). Such user data is directly obtained through an input device (for example, a touch pen, a mouse, a keyboard, a micro phone, a camera, or a biosignal sensor) or a storage medium mounted or connected to a digital broadcasting terminal. In this case, the user's preference and the user's viewing information may be obtained indirectly by an automatic calculation algorithm based on the number of times of using digital broadcasting content and metadata.

The additional content obtaining unit 115 performs additional content from a broadcast channel, a communication network, or a storage medium through a location resolution process provided by the TVA based on the TVA metadata transmitted from the TVA metadata obtaining unit 113. Perform the function of acquiring them. At this time, the additional content includes the kind of content included in the 'ContentType Classification Scheme' defined in the 'TVA Phase 2 Extended Metadata Schemas' standard. The additional content obtaining unit 115 may directly obtain the additional content according to a user's request based on the TVA metadata transmitted from the TVA metadata obtaining unit 113, and may include a recommendation algorithm or automation embedded in the digital broadcasting terminal. It is also possible to indirectly obtain additional content through an algorithm. As an example of the additional content, when the user watches a soccer game program in a digital broadcasting terminal capable of two-way broadcasting service, the additional content obtaining unit 115 may display shot scene video clips of Park Ji-sung or text related to the history of the player Seol Ki-hyun. Additional content, such as information, CF video clips starring Lee Young-pyo, can be obtained from the broadcaster or third party service providers.

In addition, the additional content obtaining unit 115 performs a function of acquiring additional content using link information displayed on the data broadcasting program among the digital broadcasting programs transmitted from the broadcasting program obtaining unit 112. The additional content at this time is defined as content types provided by data broadcasting middleware such as Advance Common Application Platform (ACAP), Multimedia Home Platform (MHP), Open Cable Application Platform (OCA), and the like. The scope of the data broadcasting middleware applied to the present invention is not limited to the above-mentioned example. For example, the additional content obtaining unit 115 may include data broadcasting contents (eg, text, graphics, audio, and video), stock information, traffic information, shopping information, and the like in a quiz program transmitted through a data broadcasting channel. Can be obtained from a broadcaster or a third party service provider.

In addition, the additional content obtaining unit 115 obtains multimedia resources that a TV user searches for and acquires or consumes in a TV terminal through an external channel (Internet channel).

The user metadata generator 116 includes configuration information and synchronization information in space-time between a digital broadcast program, additional content delivered from the additional content acquirer 115, and user data delivered from the user data acquirer 114. Creates user metadata. Here, the configuration information and the synchronization information of the user data are stored in the user metadata according to the format shown in Table 1 below.

Table 1 shows the types of user data, space-time configuration information, and synchronization information. Among the user data acquired by the user data acquisition unit 114, data requiring configuration information and synchronization information may be a graphic, an image, a video clip, an audio clip, or a text. It is divided into five types. An image is a format for a picture or a picture, a video clip is a format for an image, and an audio clip is a format for audio data.

For example, referring to the configuration information according to the type of the user data, when the type of the user data is graphic, the user draws on the screen using a pointing device (for example, a mouse, a keyboard, or a touch pen). Indicates a note. Here, the configuration information includes a class (eg, rectangle, circle, line) and color information (RGB (red, green, blue)) of the memo.

In addition, in the configuration information of the user data shown in [Table 1], the size and location are the size and location information of the user data based on the broadcast program. However, the size and position information of the graphic are represented through a point (left-top coordinates of the left upper end point and right-bottom coordinates of the lower right end point). Filename represents the name of the file referenced by the user data. The message describes the text content entered by the user.

Next, referring to the synchronization information of [Table 1], the synchronization information of the user data has period information. The period information indicates time information at which user data should be reproduced based on the digital broadcast program. It contains information on the start time ("Start") and end time ("End") of user data.

An example of an application service using the above-described user data type, space-time configuration information, and synchronization information is as follows. When the user watches an English education broadcast, using the touch pen of the TV terminal to mark (eg, underline or circle) a new English word, the user data acquisition unit 114 displays the marking in the form of a graphic. Can be obtained as In addition, when a user searches for new idioms and similar words through a web browser, the user data acquisition unit 114 may obtain a search result in the form of text. In addition, the user data acquisition unit 114 may obtain a user's pronunciation of a new word or sentence in the form of an audio clip through a microphone of a broadcasting terminal, which is submitted to a pronunciation correction service provider through a communication network. The received correction may also be obtained in the form of an audio clip. Here, the screen position information of the graphic, text, and audio clip data input by the user becomes the configuration information of the user data. In addition, the time information synchronized with the broadcast program, that is, the time (Start) and the time (End) information input to the input device become synchronization information of the user data.

In addition, the user metadata generator 116 generates a reference table for linking the contents reference identifier (CRID), which is the identification information of the content in TVA metadata, with the location on the file of the actual content to be encoded in the integrated format 10. Insert into user metadata.

Table 2 below shows an example of a reference table. Here, the digital consumption right for the broadcast contents included in the integrated format 10 may be included in the form of a sub-node of the user metadata (sub-element of the xml document) or in the form of a sub-node of TVA metadata.

Table 2 is an example of a reference table to be inserted into user metadata generated by the user metadata generator 116. The reference table describes all the content that can be provided through the TVA metadata.

Each item includes an index as an attribute value, identification information (CRID) of content, and a type of a resource referenced by the CRID. Here, if the type is the content of audio, video, or image, the item is a track number in the storage format as a lower node of each type if the corresponding content is downloaded. (track num) is included. In addition, when the type is video (content that requires a video and audio stream), the item includes track numbers corresponding to the video and audio streams in order. If the content is not downloaded, the item includes a locator, which is a lower node, and the CRID of the corresponding content, which is the value of the "ref" attribute of the locator, is executed by the location analysis engine of the additional content obtaining unit 115. Content can be obtained. In addition, when the type refers to "crid", that is, another CRID, the item includes "toCRID" as a lower node, and the "ref" attribute value indicates the CRID to which it refers.

In addition, the user metadata generator 116 extracts and inserts user preferences into user metadata. The user metadata generator 116 inserts 'Usage History DS' of the TVA metadata into the user metadata to record the user preferences. User action information (ActionTime and ActionType) of the 'Usage History DS' is used to record the user's preferred part, and information on the user's favorite part is used to the preferred segment of the digital broadcasting program. An alarm or referral service is available. The user's preference is determined based on the number of times the digital broadcast program is repeatedly played by the user.

The integrated format encoding unit 117 is each digital consumption rights acquisition unit 111, broadcast program acquisition unit 112, TVA metadata acquisition unit 113, user data 114, additional content acquisition unit 115, Encode the digital consumption right, the digital broadcast program, the TVA metadata, the user data, the additional content, and the user metadata transmitted from the user metadata generator 116 into the unified format 10 and encode the encoded unified format 10. Performs a function of saving to a storage medium. That is, the integrated format encoding unit 117 performs MPEG-4 BIFS (Binary Format for Scenes) encoding using not only TVA metadata but also space-time configuration information and synchronization information of user metadata. Here, BIFS encoding performs a temporal / spatial rendering function when playing broadcast contents included in the integrated format 10.

The integrated format editing unit 118 decodes the integrated format 10 and provides the integrated format 10 to the user, and adds the updated digital broadcasting content or user data to the integrated format to generate a new integrated format according to the user's request. Perform the function of editing. That is, when the user wants to update a supplementary content, user metadata, or TVA metadata in the integrated format 10 stored in the storage medium to create a new integrated format, the integrated format editing unit 118 is encoded. The integrated format 10 is decoded according to an encoding standard and provided to the user, and the TVA metadata obtaining unit 113, the additional content obtaining unit 115, and the updated digital broadcasting content or user data are included in the new integrated format. The user metadata generator 116 is controlled.

Hereinafter, each component of the integrated format decoder 110 for consumption of personalized digital broadcasting content according to the present invention will be described.

The integrated format decoding unit 121 decodes the integrated format 10 to extract digital consumption rights, digital broadcast programs, TVA metadata, additional content, user data, and user metadata. The integrated format decoder 121 transmits the digital broadcast program to the broadcast program player 123, the user metadata to the user metadata analyzer 124, and the TVA metadata to the TVA metadata analyzer 125. do. In addition, the integrated format decoding unit 121 performs a function of enabling access to the contents corresponding to each of the playback units. In this case, the integrated format 10 is obtained from the integrated format encoding unit 117 through a storage medium (for example, a hard disk, a memory, a network storage device, a CD, a DVD, an HD-DVD, a Blu-ray disk, a USB storage device). It is desirable to be moved or shared to the integrated format decoding unit 121.

The digital consumption right verification unit 122 performs a function of authenticating digital consumption rights for digital broadcast contents included in the integrated format 10. In addition, when the digital consumption right verification unit 122 acquires the digital consumption right at the decoder 120, the digital consumption right verification unit 122 acquires and verifies the digital consumption right (eg, playback, reuse, and consumption) of the stored digital broadcasting content from the service provider. It performs the function. In this case, an example of the digital consumption right verification unit 122 is as described above.

The TVA metadata analyzer 125 parses TVA metadata encoded in the integrated format. The TVA metadata analyzing unit 125 transmits the analyzed result to the user metadata analyzing unit 124.

The user metadata analyzer 124 interprets the user metadata transmitted from the integrated format encoder 121 and extracts a reference to the user data and a reference to additional content through the reference table according to the result of the analysis. To the broadcast program playback unit 123.

The broadcast program reproducing unit 123 may convert the digital broadcast program, the user data, and the additional contents delivered from the integrated format decoding unit 121 by using a reference to each content transmitted from the user metadata analyzing unit 124. -4 Plays according to the time and space information included in BIFS. At this time, the reproduction method will be described with reference to FIGS. 3 and 4.

The digital item reproducing unit 127 may digitally reproduce the digital items included in the integrated format 10 so that the user can reproduce or consume the digital items separately from the process of playing the digital broadcast program or the process of playing the TVA metadata. To play an item.

The TVA metadata playback unit 126 performs a function of providing an additional information service using additional information about the digital broadcast program described in the TVA metadata transmitted from the TVA metadata analysis unit 125. In addition, the TVA metadata playback unit 126 performs a function of providing reference information about additional content related to the digital broadcast program. In this case, the additional information service provided through the TVA metadata means a service that provides indexing information of a broadcast program, key frames, video segment information, and description information of the program itself such as synopsis, main character, and keywords of the program. do. In addition, for the contents included in the unified format 10, additional content information in the TVA metadata may be interpreted through the reference table in the unified format 10 described above in [Table 2].

2 is a diagram illustrating an embodiment of a profile of a storage format according to a digital broadcasting service environment according to the present invention.

The profile of the integrated format according to the present invention is divided into a unidirectional broadcast profile (profile I), a bidirectional broadcast profile (profile II), or a user data profile (profile III) according to the applied broadcast service environment. Profile II comprises Profile I and Profile III comprises Profile I or Profile II. The technology required and the content included in the unified format are specific to each profile.

The skills required in the profiles are shown in Table 3 below.

Profile I, for unidirectional broadcasting, provides additional information about the program by TVA Metadata Phase 1 together with the digital broadcast program. Techniques required in Profile I for unidirectional broadcast include TVA Metadata Phase 1, Reference Table, and MPEG-4 File Format. The function of Profile I for unidirectional broadcasting includes additional information (e.g. keyword, synopsis, main character) about the program related to the program, simple additional content (e.g. key frame, preview image), reuse of the broadcast program (e.g. For example, the functions for collectible, moving, and sharing are included.

Next, profile II provides additional content by TVA metadata (Phase 2) together with the digital broadcast program. Profile II features for unidirectional broadcasting include a wider variety of additional content offerings (e.g., related news, additional metadata) through interactive servers, additional content acquisition through user searches, additional content reuse, and data broadcasting. Data broadcasting application acquisition function is included.

In particular, profile III includes profile I or profile II, and includes user data such as data input by the user, user preference information (using Usage History DS), and viewing information.

3 is a structural diagram of an embodiment of an integrated broadcast content based on an MPEG-4 file format applied to the present invention.

As shown in Fig. 3, the file format of the unified format according to the present invention is based on the MPEG-4 file format. Here, the ftyp box 300 represents the file format type of the unified format. The move box 310 includes an initial object descriptor 311, track boxes 312 to 319 for specifying respective metadata, and a meta box 320, and an mdat box. 330 includes respective data related to each track box 312 to 319.

The initial object descriptor 311 performs a function of providing the information of the initial object descriptor in the decoder 120 (or the player) when the user re-views the digital broadcast program stored with the additional content and the user data.

The tracks 312 to 319 perform a reference function of data stored in the mdat box 320. At this time, the track number 312 and the track number 313 are streams for the scene information and contain information about the scene descriptor and the object descriptor, respectively. Track number 314 and track number 315 are assigned to reference TVA metadata and user metadata, respectively. From track No. 315, information about user data or additional contents may be included, and the actual data about the track is stored in the mdat box 330. Here, the tracks other than the tracks 1 and 2 may include digital consumption rights for the contents included in the integrated format in the form of an independent file.

The meta box 319 includes an iloc / iinf box 321 and an XML box 323. The iloc / iinf box 321 includes location information of digital items included in the unified form 10. Here, the location information may include an offset, a length, an item name, or a content type. In addition, the XML box 323 may include digital consumption rights for digital items included in the integrated format 10 in the form of MPEG-21 Digital Item Declaration (DID).

The mdat box 330 includes actual data referenced by each track of the moov box 310. That is, the actual data referred to by track number 312 in the move box 310 is the scene descriptor 331 in the mdat box 330, and the actual data referred to by track number 313. Is the object descriptor 332 in the mdat box 330. In addition, the actual data referred to by track number 316 becomes the video stream 335 of the broadcast program. At this time, each data is stored in the form of a bit stream.

4 is a diagram illustrating an embodiment of a process of rendering integrated broadcast content based on BIFS applied to the present invention.

BIFS includes an object descriptor 313 including information on each object of an object based MPEG-4 file, and a scene descriptor 312 including time and spatial information of the objects. The object descriptor 313 and the scene descriptor 312 are initialized through the initial object descriptor 311, and an image is configured by updating each scene. The BIFS shown in FIG. 4 is used to store the digital broadcast content in one unified format in which additional content and user data are integrated.

The reproduction order of broadcast contents included in the integrated format of FIG. 3 according to the present invention will be described with reference to FIG. 4. The initial object descriptor 311 of the unified format provides basic information (eg, profile of BIFS, screen size, etc.) of rendering for digital broadcast content. In addition, using "ES_Descriptor" in the initial object descriptor 311, it indicates that track number 312 refers to the information of the scene descriptor, and track number 313 refers to the information of the object descriptor. Thereafter, track No. 312 refers to the scene descriptor 331 in the mdat box 330, and the scene descriptor 312 is a space-time configuration information and synchronization information of user data and additional contents based on a broadcast program. Organize the objects accordingly. Each object obtains a corresponding track, that is, corresponding object information, by referring to the object descriptor 332 through track No. 313. By using the obtained object information, the image is finally constructed by referring to the actual data stream in the mdat box 330.

For example, the video stream of the broadcast program allows track 4 315 to render with reference to video stream 323 in mdat box 330. User data consisting of audio clips then causes track 7 318 to render with reference to the audio clip stream 326 in the mdat box 330. In this case, the graphic of the user data type can be rendered with only the configuration information and the synchronization information without the actual data included in the mdat box 330, and thus is represented only by the scene descriptor 321 and the object descriptor 322. This is possible. For contents that are not overlaid on the broadcast program and used separately, the CRID of TVA metadata corresponding to each content is first obtained, and the actual data position is obtained through a reference table inside the user metadata.

5 is a structural diagram of an embodiment of an integrated broadcast content based on the MPEG-21 file format applied to the present invention.

The second embodiment of the file format of the unified format according to the present invention extends using the MPEG-21 file format by defining the unified format of FIG. 3 according to the present invention as a hidden mp4 file. Here, the ftyp box 500 indicates the file format type of the unified format.

The meta box 510 includes an iloc / iinf box 511 and an XML box 512.

The iloc / iinf box 511 includes location information of digital items included in the unified format 10. Such location information may include offset, length, item name, or content type. The digital items may represent the MPEG-4 file 521 of the mdat box 520 or may be represented as digital items inside the MPEG-4 file 521. Herein, the MPEG-4 file 521 follows the integrated format based on the MPEG-4 file format shown in FIG. 3.

The XML box 512 may describe digital consumption rights for digital items included in the integrated format 10 in the form of MPEG-21 Digital Item Declaration (DID).

The mdat box 520 may include at least one MPEG-4 file 521. The MPEG-4 file 521 includes an iloc / iinf box 511 and an XLM in a meta box 510 including respective location information and digital consumption rights. The (xml) box 512 allows individual consumption of digital items by the user.

6 is a flowchart of an embodiment of an integrated format encoding method for consumption of personalized digital broadcast content according to the present invention.

Referring to the case in which the user watches or stores a digital broadcast program (502), the broadcast program acquisition unit 112 acquires a digital broadcast program that the user watches or stores (502). In operation 504, the TVA metadata acquisition unit 113 acquires TVA metadata corresponding to a broadcast program viewed by the user.

Next, a digital consumption right for the digital broadcast content (digital broadcast program) is obtained (508), and a profile of the integrated format is determined (506) according to the type of broadcast service and the presence or absence of user data.

First, profile I can consume information about broadcast content described in TVA metadata (phase 1). When the integrated format encoding unit 117 stores the digital broadcast program in the unified format, the integrated format encoding unit 117 encodes the digital broadcast program and the TV metadata in the unified format (534).

Next, in Profile II, in addition to the service provided by Profile I, TVA metadata (phase 2) may provide additional content through a bidirectional server.

It is checked whether the user downloads new additional content (media resource) while watching the broadcast (510).

As a result of the check 510, if the user wants to download a media resource, the user terminal checks whether the new additional content is consumed in synchronization with time and space information for the broadcast program or separately (512).

As a result of the check 512, if new additional content is consumed in synchronization with a broadcast program, time and space information of the content is stored in the same form as the user data described above in [Table 1] inside the user metadata. (514). Next, the track number value into which the content is to be inserted is updated to the reference table (516). As a result of the check 512, if new additional content is not consumed in synchronization with the broadcast program, the process “516” is performed. And it is performed repeatedly from the "510" process.

If the check result 510 does not download the media resource, the process 526 is performed.

In addition, the application may acquire and consume an application through data broadcasting (530), or include the additional contents that acquire and consume additional content through a user's search (532) to encode the integrated format (534).

Profile III is a profile in which user data is added in Profile I or Profile II. If new user data is input while watching the broadcast (518), the information of the input data is input to the user metadata in the form of [Table 1] (520).

In addition, when the user records a playback such as repeatedly watching or skipping a specific part while playing the program (522), the user preferences and viewing information as described above are stored in the user metadata (524).

If there is no further downloading of additional content or input of user data until the end of the broadcast, the locator value is extracted using the location analysis engine to refer to the location information of all the undownloaded contents (526). The locator, which is the final position information of the content obtained through the position resolution engine, is then updated in the reference table (528).

The broadcast program, TV-Anytime metadata, user metadata, downloaded additional contents, and user data obtained in the above process are encoded in the aforementioned integrated format (534). At this time, the data to be included in each track, and the time and space information of the data are referred to through values described in user metadata.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

The present invention as described above, in the digital broadcast terminal, by storing the digital broadcast content, TVA metadata, the user data, and the temporal and spatial configuration information and synchronization information of the components in a storage medium together, It has the effect of enabling possession / reuse / editing / sharing.

In particular, the present invention enables the storage and space-time synchronized playback of user data, such as content and metadata collected and created or edited by the user, user preference information, and viewing information, thereby providing a different consumption experience for each user. It has the effect of producing and preserving.

For example, the present invention may allow the user to input and store information such as his or her own memo or marking when watching a broadcast content such as an education broadcast or a cooking broadcast, and may repeatedly view the user's favorite part when watching. By generating and storing information about the personal information, there is an effect of generating personalized content. That is, the present invention enables the production and preservation of personal broadcast content such as an English educational broadcast containing personal learning information or a cooking program including my own recipe.

Claims (22)

In the integrated format encoding apparatus for the consumption of personalized digital broadcast content, Digital broadcast content acquiring means for acquiring digital broadcast content; User data acquiring means for acquiring user data generated while the user consumes the acquired digital broadcast content; User metadata generating means for generating user metadata using the spatiotemporal configuration information and synchronization information of the obtained user data; And Integrated format encoding means for encoding the obtained digital broadcast content, the obtained user data and the generated user metadata into a unified format for consumption of personalized digital broadcast content Integrated format encoding device for consumption of personalized digital broadcast content comprising a. The method of claim 1, The digital broadcast content acquiring means and the user metadata to update at least one of digital broadcast content and user data included in the encoded integrated format according to the user's request to edit the encoded integrated format into a new integrated format. Integrated form editing means for controlling the generation means Integrated format encoding device for consumption of personalized digital broadcast content further comprising. The method according to claim 1 or 2, The user metadata generating means, Integrating format for consumption of personalized digital broadcasting content, characterized in that it further comprises in the generated user metadata at least one of a reference table or the preference of the user is mapped to the identification information and location information of the digital broadcasting content Encoding device. The method of claim 3, wherein The user metadata generating means, Personalized digital further comprising time information and spatial information of the downloaded additional content in the generated user metadata when the new additional content downloaded at the user's request is synchronized with the digital broadcasting content. Integrated format encoding device for consumption of broadcast content. The method of claim 4, wherein The integrated format encoding means, Personalized digital broadcasting using MPEG-4 BIFS (Binary Format for Scenes) encoding by using the digital broadcasting content, the user data, and the user metadata by using space-time configuration information and synchronization information of the user data. Integrated format encoding device for consumption of content. The method of claim 5, wherein The integrated format encoding means, Integrating the digital broadcast content, the user data and the user metadata in an integrated format that conforms to the MPEG-21 file format structure including a plurality of MPEG-4 files for the consumption of personalized digital broadcast content Format encoding device. The method of claim 6, The user data, And at least one of a user's work, a user's preference, and a user's viewing information. The method of claim 7, wherein The reference table, And identification information of the additional content related to the digital broadcasting content and location information of the actual additional content inserted in the integrated format are mapped. The method of claim 8, The integrated format, An integrated format encoding device for the consumption of personalized digital broadcast content, comprising digital consumption rights described in MPEG-21 Digital Item Declaration (DID) form in a track box or meta box. The method of claim 9, The user metadata, And the digital consumption right in a lower node of the user metadata. The method of claim 10, Metadata for the digital broadcast content, And the digital consumption right in a lower node of the user metadata. In the integrated format decoding apparatus for the consumption of personalized digital broadcast content, Integrated format decoding means for extracting digital consumption rights, digital broadcast programs, TVA metadata, additional content, user data and user metadata by decoding the integrated format delivered from the outside; Digital consumption right verification means for performing an authentication function using digital consumption right upon re-consumption of the integrated form; TVA metadata analyzing means for interpreting TVA metadata delivered from said integrated format decoding means; An analysis result of the TVA metadata analyzing means, the user metadata transmitted from the integrated format decoding means, and reference information about the user data and reference information about additional content through the reference table according to the interpreted result. User metadata analyzing means for extracting; Broadcast program reproducing means for reproducing the extracted digital broadcast program, user data, and additional contents according to space-time information using reference information of each content; And TVA metadata reproduction means for providing an additional information service using additional information on the digital broadcast program described in the transmitted TVA metadata. Integrated format decoding device for consumption of personalized digital broadcast content comprising a. The method of claim 12, Digital item means for consuming digital broadcast content, TVA metadata, or user data contained in an integrated format in the form of a digital item without being associated with the playback of the integrated format Integrated format decoding device for consumption of personalized digital broadcast content further comprising. The method according to claim 12 or 13, The broadcast program reproduction means, Consumption of personalized digital broadcast content consumption by using MPEG-4 BIFS to reproduce the synchronization required for playback between digital broadcast program, TVA metadata, digital consumption right, user metadata, additional content, and user data. Integrated format decoding device for. The method of claim 14, The user data, Integrated format decoding device for consumption of personalized digital broadcast content, characterized in that it comprises a user asset, user preferences and viewing information of the user. In the integrated format encoding method for the consumption of personalized digital broadcast content, A digital broadcast content acquiring step of acquiring digital broadcast content; A user data obtaining step of obtaining user data generated while the user consumes the obtained digital broadcasting content; Generating user metadata by using the spatiotemporal configuration information and synchronization information of the obtained user data; And An integrated format encoding step of encoding the obtained digital broadcast content, the obtained user data, and the generated user metadata into a unified format for consumption of personalized digital broadcast content. Integrated format encoding method for consumption of personalized digital broadcast content comprising a. The method of claim 16, An integrated format editing step of updating the encoded integrated format into a new integrated format by updating at least one of digital broadcasting content and user data included in the encoded integrated format according to the user's request; Integrated format encoding method for consumption of personalized digital broadcast content further comprising. The method according to claim 16 or 17, The user metadata generation step, Integrating format for consumption of personalized digital broadcasting content, characterized in that it further comprises in the generated user metadata at least one of a reference table or the preference of the user is mapped to the identification information and location information of the digital broadcasting content Encoding Method. The method of claim 18, The user metadata generation step, Personalized digital further comprising time information and spatial information of the downloaded additional content in the generated user metadata when the new additional content downloaded at the user's request is synchronized with the digital broadcasting content. Integrated format encoding method for consumption of broadcast content. The method of claim 19, The integrated format encoding step, Integration of the digital broadcast content, the user data and the user metadata by MPEG-4 BIFS encoding using the configuration information and synchronization information in the space-time of the user data for consumption of personalized digital broadcast content Format encoding method. The method of claim 20, The integrated format encoding step, Integrating the digital broadcast content, the user data and the user metadata in an integrated format that conforms to the MPEG-21 file format structure including a plurality of MPEG-4 files for the consumption of personalized digital broadcast content Format encoding method. The method of claim 21, The user data, And at least one of a user's work, a user's preference, or user's viewing information.

Images