KR102477310B1 - DRM contents parallel packaging device and system comprising it and method for DRM contents parallel packaging - Google Patents

Abstract

The present invention relates to a parallel packaging device for DRM content that can reduce the amount of time and calculation required for DRM packaging regardless of the capacity of video content, a DRM content parallel packaging system including the same, and a method for parallel packaging DRM content,
DRM content parallel packaging apparatus according to an embodiment of the present invention,
A NAL segmentation module for segmenting video content composed of a plurality of NAL units (Network Abstraction Layer Units) into individual NAL units; A NAL selection module for selecting at least one packaging NAL unit to be processed for DRM packaging and at least one or more skip NAL units not to be processed for DRM packaging among the plurality of NAL units divided by the NAL division module; For each of the plurality of packaging NAL units selected by the NAL selection module, decoding using a CABAC decoder, packaging DRM metadata in the QTC data extracted through decoding, and encoding the NAL unit for which DRM metadata packaging has been completed Parallel packaging module; includes.

Description

DRM contents parallel packaging device, DRM contents parallel packaging system including the same, and DRM contents parallel packaging method {DRM contents parallel packaging device and system comprising it and method for DRM contents parallel packaging}

The present invention relates to a device for parallel packaging DRM contents, which can reduce the amount of time required for DRM packaging and the amount of calculation regardless of the capacity of video contents, a parallel packaging system for DRM contents including the same, and a method for parallel packaging DRM contents.

Due to the recent commercialization of 5G technology and the activation and base expansion of one-person media such as YouTube, the demand for digital content distribution and distribution-related platforms is explosively increasing, and related industries are growing rapidly.

However, due to the lack of awareness of digital content copyright, problems caused by indiscriminate illegal copying and unauthorized use of digital content have begun to emerge, and as a result, the importance of digital rights management (DRM) is emerging. .

DRM is a general term for technologies and service management systems and techniques for protecting the copyright of digital contents, and a number of R&D and commercialization services are underway to protect copyright information in various device environments. DRM technology for video content is largely divided into two types, which perform DRM packaging for video and provide safe and efficient DRM services between video content providers and users through complex license technology.

Existing DRM packaging technology is to eradicate illegal copying and unauthorized use of content by inserting the copyright of specific content into the content. Scrambling or symmetric/asymmetric key cryptographic algorithms were mainly used.

The problems caused by this are as follows.

First, it is a problem of DRM packaging execution speed and amount of computation. In the case of symmetric key/asymmetric key cryptographic algorithms, as the length of the secret key increases recently due to the safety of the algorithm, the speed and amount of computation required for encryption or decryption tend to increase exponentially. In the case of realistic content, the capacity increases up to 8 times compared to existing content, so the time required and the amount of calculation increase when a cryptographic algorithm is applied, and as a result, separate software or hardware must be newly developed and built in related fields. The cost required to solve this will increase.

Second, it is a problem of managing various keys required for DRM packaging. When scrambling or symmetric/asymmetric key cryptographic algorithms are used in DRM packaging, a key management policy and system are required to manage them. In particular, in the case of a symmetric key encryption algorithm, since a secret key must exist for each authorized user for a specific content, as the number of content and authorized users increases, the key for this inevitably increases exponentially. Along with additional requirements, a more complex form of key management policy must be introduced, which increases the cost to solve it.

Third, it is a management problem for realistic content metadata. Existing content did not provide interactive interaction service, so only video content existed. However, in the case of realistic content, video content that enhances a sense of presence and immersion using the five senses of a person and metadata that enables interactive interaction exist separately. .

Since the existing DRM packaging techniques cannot manage and package such metadata, it is necessary to develop a new type of DRM content packaging technology to solve this problem.

Korea Patent No. 10-0814064

An object of the present invention is to provide a DRM contents parallel packaging apparatus, a DRM contents parallel packaging system including the same, and a DRM contents parallel packaging method capable of reducing the amount of time required for DRM packaging and the amount of calculation regardless of the capacity of video contents.

DRM content parallel packaging apparatus according to an embodiment of the present invention,

A NAL segmentation module for segmenting video content composed of a plurality of NAL units (Network Abstraction Layer Units) into individual NAL units; A NAL selection module for selecting at least one packaging NAL unit to be processed for DRM packaging and at least one or more skip NAL units not to be processed for DRM packaging among the plurality of NAL units divided by the NAL division module; For each of the plurality of packaging NAL units selected by the NAL selection module, decoding using a CABAC decoder, packaging DRM metadata in the QTC data extracted through decoding, and encoding the NAL unit for which DRM metadata packaging has been completed Parallel packaging module; includes.

In the device for parallel packaging DRM contents according to an embodiment of the present invention, the NAL selection module selects the packaging NAL unit and the skip NAL unit based on randomly generated random number information, wherein the random number information includes the packaging NAL Packaging processing information for unit selection and location information on the packaging NAL unit and skip NAL unit may be included.

In the DRM content parallel packaging apparatus according to an embodiment of the present invention, a NAL alignment module for aligning the packaging NAL unit and the skip NAL unit using location information included in the random number information may be included.

In the DRM content parallel packaging apparatus according to an embodiment of the present invention, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel for each of the selected plurality of packaging NAL units. Each of the DRM packaging modules includes decoding means for decoding using a CABAC decoder; a packaging means for selecting QTC data from data derived as a result of decoding by the decoding means, inserting a bitstream of the selected QTC data and a bitstream of DRM metadata, and performing DRM packaging; And, it may include encoding means for encoding the packaging NAL unit on which the DRM packaging has been performed using a CABAC encoder.

In the apparatus for parallel packaging DRM contents according to an embodiment of the present invention, the packaging unit may include among QTCs present in a Y channel representing luminance among YCbCr channels included in an image frame embodying a video image of the packaging NAL unit. DRM packaging may be performed by performing an insertion operation on at least one bitstream of QTC and a bitstream of DRM metadata.

In addition, the DRM content parallel packaging management server according to an embodiment of the present invention,

a communication unit that performs wired/wireless communication with a user terminal; A NAL segmentation module that divides video content including a plurality of NAL units into individual NAL units, at least one packaging NAL unit to be processed for DRM packaging among the plurality of NAL units divided by the NAL segmentation module, and DRM packaging processing A NAL selection module for selecting at least one skip NAL unit not to be skipped, and a CABAC decoder for each of a plurality of packaging NAL units selected by the NAL selection module, and DRM metadata in the QTC data extracted through decoding A parallel packaging unit including a parallel packaging module for packaging and encoding the NAL unit for which DRM metadata packaging has been completed.

In the DRM content parallel packaging management server according to an embodiment of the present invention, the NAL selection module selects the packaging NAL unit and the skip NAL unit based on randomly generated random number information, and the random number information is It may include packaging processing information for NAL unit selection and location information on the packaging NAL unit and skip NAL unit.

The DRM content parallel packaging management server according to an embodiment of the present invention may include a NAL alignment module for aligning the packaging NAL unit and the skip NAL unit using location information included in the random number information.

In the DRM content parallel packaging management server according to an embodiment of the present invention, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel for each of the selected plurality of packaging NAL units. . Each of the DRM packaging modules includes decoding means for decoding using a CABAC decoder; a packaging means for selecting QTC data from data derived as a result of decoding by the decoding means, inserting a bitstream of the selected QTC data and a bitstream of DRM metadata, and performing DRM packaging; And, it may include encoding means for encoding the packaging NAL unit on which the DRM packaging has been performed using a CABAC encoder.

In the DRM contents parallel packaging management server according to an embodiment of the present invention, the packaging unit includes QTCs present in a Y channel representing luminance among YCbCr channels included in a video frame implementing a video image of the packaging NAL unit. DRM packaging may be performed by performing an insertion operation on at least one bitstream of QTC and a bitstream of DRM metadata.

A parallel packaging method for DRM content according to an embodiment of the present invention is performed by a computing device, wherein the computing device includes: a first step of dividing image content including a plurality of NAL units into individual NAL units; A second step of selecting at least one packaging NAL unit to be processed for DRM packaging and at least one or more skip NAL units not to be processed for DRM packaging among a plurality of divided NAL units; A third step of decoding each of the selected plurality of packaging NAL units using a CABAC decoder; A fourth step of packaging DRM metadata in QTC data among data obtained through the decoding, for each of the plurality of selected packaging NAL units; A fifth step of encoding the NAL unit for which the DRM metadata packaging is completed using a CABAC encoder for each of the plurality of selected packaging NAL units.

In the DRM content parallel packaging method according to an embodiment of the present invention, the second step selects the packaging NAL unit and the skip NAL unit based on randomly generated random number information, and the random number information is It may include packaging processing information for NAL unit selection and location information on the packaging NAL unit and skip NAL unit.

The parallel packaging method for DRM contents according to an embodiment of the present invention may further include aligning the packaging NAL unit and the skip NAL unit using location information included in the random number information.

In the parallel packaging method for DRM contents according to an embodiment of the present invention, in the fourth step, QTC data is selected from data derived in the third step, and a bitstream of the selected QTC data and a bitstream of DRM metadata are selected. DRM packaging can be performed by inserting .

In the parallel packaging method for DRM contents according to an embodiment of the present invention, in the fourth step, the QTCs present in the Y channel representing luminance among the YCbCr channels included in the video frame implementing the video image of the packaging NAL unit. An insertion operation may be performed on at least one bitstream of QTC and a bitstream of DRM metadata.

Other specific details of implementations according to various aspects of the present invention are included in the detailed description below.

According to the DRM contents parallel packaging method and DRM contents parallel packaging system according to an embodiment of the present invention,

Unlike the existing DRM packaging for tangible content, which increased the amount of time and computation in proportion to the volume of the content, DRM packaging is performed in parallel by arranging an appropriate number of DRM packaging modules in parallel to increase the time required and the amount of computation regardless of the volume. The amount of calculation can be made constant.

Accordingly, efficient DRM packaging can be performed for large-capacity high-definition video content and 8K-class realistic content.

1 and 2 are block diagrams illustrating a DRM content parallel packaging system according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a parallel packaging unit of a DRM content parallel packaging management server according to an embodiment of the present invention.
4 is a block diagram for explaining the operation process of the parallel packaging unit of the DRM contents parallel packaging management server according to an embodiment of the present invention.
5 is a block diagram illustrating a parallel packaging module according to an embodiment of the present invention.
6 is a diagram illustrating an HEVC-based realistic content bit stream structure.
7 is a block diagram showing the configuration of a DRM packaging module, which is one component of the parallel packaging module.
8 is a diagram for explaining a DRM packaging process in QTC.
9 is a diagram schematically illustrating a DRM unpackaging process according to an embodiment of the present invention.
10 to 12 are flowcharts illustrating the operation process of the DRM content parallel packaging system according to an embodiment of the present invention.
13 is a flowchart illustrating a method for packaging DRM contents in parallel according to an embodiment of the present invention.
14 is a diagram illustrating a computing device according to an embodiment of the present invention.

Since the present invention can apply various transformations and have various embodiments, specific embodiments will be exemplified and described in detail in the detailed description. However, it should be understood that this is not intended to limit the present invention to specific embodiments, and includes all transformations, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as 'include' or 'having' are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded. Hereinafter, an apparatus for parallel packaging DRM contents according to an embodiment of the present invention, a parallel packaging system for DRM contents including the same, and a method for parallel packaging DRM contents will be described with reference to the drawings.

1 and 2 are block diagrams illustrating a DRM content parallel packaging system according to an embodiment of the present invention.

1 and 2, the DRM content parallel packaging system according to an embodiment of the present invention includes a user terminal 100 and a DRM content parallel packaging management server 200 (hereinafter referred to as a DRM parallel packaging server). include 1 shows a case in which the DRM parallel packaging server 200 stores a plurality of video contents in a DB by itself, and FIG. 2 shows an external content provider (Contents Provider, CP1 to CP3) 200 shows a case of providing video content.

In the present invention, video contents subject to DRM packaging are not particularly limited, but can be more usefully used for large-capacity and high-definition video contents. Preferably, video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-definition video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive interaction content, etc., HEVC (High Efficiency Video Codec)-based 4K 120 FPS (Frame Per Second) level, or 8K It may be 120 FPS level realistic content. Specifically, it may be HEVC (H.264, H.265)-based 8K-class realistic content. Of course, it can be applied to content of various levels, such as 60 to 120 FPS content and 120 to 240 FPS content, as well as 120 FPS content.

The user terminal 100 refers to a terminal capable of transmitting and receiving various data to and from the DRM parallel packaging server 200 via a wired/wireless communication network according to a user's key manipulation, such as a personal computer (PC), a laptop computer, and a personal portable device. It may be any one of a personal digital assistant (PDA) and a mobile communication terminal, etc., and for storing a web browser and program to access the DRM parallel packaging server 200 via a wired/wireless communication network. It refers to a terminal equipped with a memory, a microprocessor for calculating and controlling by executing a program, and the like.

A user may request transmission (download request) of specific video content to the DRM parallel packaging server 200 through the user terminal 100 .

When receiving a transmission request for specific video content from the user terminal 100, the DRM parallel packaging server 200 performs DRM parallel packaging (hereinafter referred to as "DRM packaging") on the corresponding video content and transmits it to the user terminal 100. . Alternatively, the DRM parallel packaging server 200 may DRM package and store a plurality of video contents in advance, and when the DRM parallel packaging server 200 receives a transmission request for specific video contents from the user terminal 100, the DRM packaging server 200 performs DRM packaging in advance. The corresponding video content may be selected from among the video contents and transmitted to the user terminal 100 .

To this end, the DRM parallel packaging server 200 may include a communication unit 210, a parallel packaging unit 220, a storage unit 230, and a control unit (not shown).

The communication unit 210 is a communication means that performs a function of interworking with the user terminal 100 and external content providers CP1 to CP3 via a wired/wireless communication network, and performs a function of transmitting and receiving various data.

The storage unit 230 stores various data and programs necessary for driving the DRM parallel packaging server 200 . Depending on the embodiment, the storage unit 230 may store a plurality of video contents that are not DRM-packaged or a plurality of video contents that have been pre-DRM-packaged. Alternatively, the storage unit 230 may store a plurality of image contents pre-processed by DRM packaging by external content providers CP1 to CP3.

The parallel packaging unit 220 performs DRM parallel packaging processing on video content. The parallel packaging unit 220 divides video content into a plurality of NAL units, selects at least one or more NAL units to be subjected to DRM packaging among the divided plurality of NAL units, and processes the selected NAL units for DRM packaging. The parallel packaging unit 220 processes DRM packaging for corresponding video content in response to a transmission request from the user terminal 100, or DRM packaging a plurality of video contents in advance regardless of the transmission request of the user terminal 100, and stores the corresponding video content. (230).

A controller (not shown) controls overall functions of the DRM parallel packaging server 200 .

3 is a block diagram showing the configuration of the parallel packaging unit 220 of the DRM content parallel packaging management server according to an embodiment of the present invention.

As shown in FIG. 3, the parallel packaging unit 220 includes a NAL division module 221, a NAL selection module 222, a parallel packaging module 223, a packaging skip module 224, a shared memory 225, and a NAL An alignment module 226 may be included. Each of the modules 221 to 226 is a component that performs a predetermined function, and may be implemented as hardware, software, or a combination of hardware and software. For example, the modules 221 to 226 may mean program modules, which may be software components that are executed by a processor to perform predetermined functions.

On the other hand, the above modules 221 to 226 are described as components constituting the parallel packaging unit 220 of the DRM parallel packaging server 200, but the parallel packaging unit 220 of the DRM parallel packaging server 200 It does not function as a , but may be implemented as an independent device. That is, it can be implemented as an independent DRM content parallel packaging device in which the functions of the above modules 221 to 226 are implemented.

NAL unit (Network Abstraction Layer Unit) means a video layer independent of the network. This means that it does not interfere with the video.

6 is a diagram illustrating a bit stream structure of HEVC-based realistic content. 6 shows a bit stream structure of H.264 level video content (hereinafter referred to as H.264), but H.265 level video content may have a similar structure.

H.264 level video content was developed for the purpose of network transmission from the beginning, and is composed of a NAL unit for efficient transmission of video content.

Referring to FIG. 6 , an HEVC-based realistic content bit stream includes a NAL unit and a raw byte sequence payload (RBSP). The RBSP may include a parameter set indicating information such as SPS and PPS, and slice data RBSP corresponding to VCL (Video Coding Layer). VCL represents actual H.264 compressed data, and VCL data is interfaced with the outside through a NAL unit. All data of H.264 is composed of each NAL unit.

The NAL division module 221 divides the video content composed of a plurality of NAL units as described above into individual NAL units.

For example, referring to FIG. 4 , the NAL division module 221 may divide video content into n NAL units.

The NAL selection module 222 selects at least one or more NAL units to be processed for DRM packaging among a plurality of NAL units divided by the NAL division module 221. The NAL selection module 222 selects a NAL unit to be processed for DRM packaging and a NAL unit not to be processed for DRM packaging based on randomly generated random number information (see R in FIG. 4).

The random number information includes packaging processing information. The random number information R means an array composed of two state values (eg, 0 or 1). The first status value (eg, 1) may mean a NAL unit to be processed for DRM packaging (hereinafter, also referred to as a "packaging NAL unit"), and the second status value (eg, 0) is DRM packaging processing. It may mean a NAL unit (hereinafter, also referred to as a “skip NAL unit”) that will not be used. For example, referring to FIG. 4, the first NAL unit (#1), the third NAL unit (#3), the fourth NAL unit (#4), and the ~n-th NAL unit (#n) are packaging NAL units. And, the second NAL unit (#2), the fifth NAL unit (#5) to the n-1th NAL unit (#n-1) are skip NAL units.

Also, the random number information R includes location information together with packaging processing information. The order of the state values arranged in the random number information (R) means the order of arrangement of NAL units matching the corresponding state values. For example, referring to FIG. 4, the first state value 1 in the state value array “10110??” included in the random number information (R) is a first NAL unit along with information indicating that the first NAL unit (#1) is packaged. Contains positional information that (#1) is sorted first. Similarly, the second state value 0 includes information indicating that the second NAL unit #2 is skipped (not packaged) and location information indicating that the second NAL unit #2 is aligned second.

Meanwhile, the ratio (N, 0<N<100) of the state values constituting the random number information R may be adjusted. N may mean a packaging NAL unit generation rate among state values of the entire random number information (R). When N is relatively large, since the ratio of NAL units to be packaged is large, encryption is sufficient to reduce the possibility of unauthorized copying, but packaging processing speed may be slowed down. Conversely, when N is relatively small, since the ratio of NAL units to be packaged is small, the possibility of unauthorized copying may be relatively high due to insufficient encryption, but the packaging processing speed may be increased by that much. The user can adjust the state value ratio N considering the processing speed and duplicability. Of course, N may mean a skip NAL unit generation rate according to settings.

The packaging NAL unit 222a selected by the NAL selection module 222 is transmitted to the parallel packaging module 223, and the selected skip NAL unit 222b is transmitted to the packaging skip module 224.

For example, referring to FIG. 4 , k packaging NAL units 222a are transmitted to the parallel packaging module 223, and (n-k) skip NAL units 222b are transmitted to the packaging skip module 224.

5 is a block diagram illustrating a parallel packaging module 223 according to an embodiment of the present invention. For each of the plurality of packaging NAL units 222a selected by the NAL selection module 222, the parallel packaging module 223 decodes the NAL unit using a CABAC decoder, and DRM metadata in the QTC data extracted through decoding. is packaged, and the NAL unit for which DRM metadata packaging has been completed is encoded.

In the parallel packaging module 223, a plurality of DRM packaging modules 223a to 223k for packaging DRM metadata for each of the packaging NAL units 222a are formed in parallel. The parallel packaging module 223 may be performed by utilizing a predefined CPU-based multi-thread. A thread means a unit of work that is independently processed by the CPU. Normally, the number of cores and the number of threads are the same. can The number of the plurality of DRM packaging modules 223a to 223k may be equal to the number of cores (the number of threads). For example, referring to FIG. 4 , k threads package k packaging NAL units 222a in parallel. Of course, the number of threads and the number of packaging NAL units may not be the same, and a plurality of NAL units may be packaged in one thread. For example, when the number of packaging NAL units is 8 and the number of threads is 4, each thread may package 2 packaging NAL units. (Please check that it is written correctly.)

Each of the DRM packaging modules 223a to 223k packages DRM metadata for each of the selected plurality of packaging NAL units. The DRM packaging modules 223a to 223k will be described later with reference to FIG. 7 .

The packaging skip module 224 may perform a function of collecting the skip NAL unit 222b without performing packaging. Alternatively, a simple alignment process may be performed after collecting the skip NAL units 222b. Since the packaging skip module 224 does not process packaging, the amount of calculation is not large. Accordingly, the packaging skip module 224 may be composed of one thread.

The packaging NAL unit processed by the parallel packaging module 223 and the skip NAL unit processed by the packaging skip module 224 are transferred to the shared memory 225 and temporarily stored.

Meanwhile, DRM packaging performed by each of the DRM packaging modules 223a to 223k for individual NAL units has a time difference. Accordingly, the order of NAL units that have been encoded may be different from the order of NAL units included in original video content. If the NAL units are sorted in the order in which DRM packaging is completed, original video content cannot be implemented. Therefore, a process of sorting NAL units in which DRM packaging has been completed is required.

Accordingly, the NAL sorting module 226 aligns the packaged NAL unit temporarily stored in the shared memory 225 and the skipped NAL unit by using the location information given by the random number information (R) to form one image. Complete the DRM packaging work for the content.

Referring to FIG. 7, the DRM packaging modules 223a to 223k will be described. 7 is a block diagram showing the configuration of DRM packaging modules 223a to 223k, which are one component of the parallel packaging module 223.

As shown in FIG. 7 , each of the DRM packaging modules 223a to 223k may include a decoding unit 2231, a packaging unit 2232, and an encoding unit 2233. Each of the means 2231 to 2233 is a component that performs a predetermined function, and may be implemented as hardware, software, or a combination of hardware and software. For example, the means 2231 to 2233 may mean a program module, which may be software components that are executed by a processor to perform predetermined functions.

The packaging unit 2232 performs DRM packaging using QTC existing in a YCbCr channel, which is one of channels representing video images. More specifically, the packaging unit 2232 performs an XOR operation on at least one QTC among the QTCs present in the Y channel representing luminance among the YCbCr channels and the bitstream of the DRM metadata, and packages them.

That is, the packaging unit 2232 selects a YCbCr channel from among several channels, selects some QTCs in the Y channel representing luminance from among the YCbCr channels, and selects at least one bitstream of the Y-channel QTCs and their corresponding positions. DRM packaging is performed by performing an XOR operation on the DRM metadata bitstream.

The Y channel is information about a basic black and white image, and a Cb channel and a Cr channel are created by referring to the Y channel. At this time, a color image having the same quality as the original or a relatively lower quality compared to the original is generated through lossless or lossy compression according to the generation method. In the present invention, DRM packaging is performed only for the Y channel using the principle of YCbCr. That is, when packaging is performed only for the Y channel, the Cb channel and the Cr channel, which are channels created by referring to this, are automatically packaged. In addition, when DRM packaging is performed on the Cb and Cr channels instead of the Y channel among YCbCr, the amount of packaging operation and the required time increase. In addition, since DRM packaging is a technology that prevents unauthorized users from viewing the video by increasing the distortion of the video, it can be seen that it is excellent that the distortion is increased compared to the original for the result of the packaged video. Accordingly, DRM packaging by the packaging unit 2232 is preferably performed for QTC in Y channel among YCbCr channels.

The encoding unit 2233 encodes the DRM-packaged video frame to generate a DRM-packaged NAL unit. The encoding means 2233 may be a CABAC encoder that performs binary arithmetic encoding that performs encoding adaptively according to surrounding conditions.

8 is a diagram for explaining a DRM packaging process in QTC.

8 illustrates an area selected in a QTC during the DRM packaging process and a process of inserting DRM metadata into the corresponding area. One QTC is divided into four areas according to the signal frequency distribution of the corresponding video. It is marked as LL (Low Low), LH (Low High), HL (High Low) and HH (High High), and MSB (Most Significant Bit: the bit of the largest digit, that is, the leftmost bit of the 4 areas ) DRM packaging is performed by selecting one bit or more bits and performing an XOR operation with the corresponding DRM metadata bitstream. Of course, this XOR operation is not necessarily limited to 1 bit of MSB and 2 or more bits including it. For example, LSB (Least Significant Bit: the bit of the smallest digit, that is, the rightmost bit) may be performed on 1 bit and some bits of larger digits. The DRM packaging process illustrated in FIG. 8 exemplifies a result of performing an XOR operation between 2 bits of MSB in a pixel and 2 bits of a DRM metadata bitstream.

Meanwhile, the DRM unpackaging process reversely performs the DRM packaging process, as shown in FIG. 9 . After performing the CABAC decoding process on packets that have downloaded or streamed video content (for example, HEVC video files) for which DRM packaging has been completed, after selecting the area performed during packaging for the obtained packaged QTC, a legitimate user After obtaining an unpackaged QTC by performing an XOR operation with the DRM metadata bitstream owned by (Legal Subscriber), the data is transmitted and processed through the HEVC decoding process. As a result, real-time unpacking of video data downloaded or streamed by a user is performed, so that the original video can be viewed without delay.

Next, with reference to FIGS. 10 to 12 , an operation process of the DRM content parallel packaging system according to an embodiment of the present invention will be described.

10 to 12 are flowcharts illustrating the operation process of the DRM content parallel packaging system according to an embodiment of the present invention.

10 is a system in which the DRM parallel packaging server 200 provides DMR-packaged video contents in a real-time streaming method when there is a video content transmission request from the user terminal 100 .

First, the user requests transmission of specific video content to the DRM parallel packaging server 200 through the user terminal 100 . (S110) The DRM parallel packaging server 200 requests and receives video content from a corresponding video content provider (CP). (S120, S130) The DRM parallel packaging server 200 performs DMR packaging processing on video content (S140) and transmits it to the user terminal 100 in real time. (S150) In this process, if the DRM parallel packaging server 200 stores video content itself, steps S120 to S130 may be omitted.

11 and 12 show that a plurality of unspecified video contents are DMR packaged and stored in advance before there is a request for transmission of video contents from the user terminal 100, and there is a transmission request through the user terminal 100 in advance. As a system for transmitting DMR-packaged video contents, FIG. 11 is a case where the DRM parallel packaging server 200 processes DMR packaging in advance, and FIG. 12 is a case where a video content provider (CP) processes DMR packaging in advance.

Referring to FIG. 11 , the DRM parallel packaging server 200 requests video content provision from a video content provider (CP) and receives it. (S210, S220) The DRM parallel packaging server 200 processes and stores video content in DMR packaging. (S230) When there is a video content transmission request from the user terminal 100 (S240), the DRM parallel packaging server 200 transmits the corresponding video content to the user terminal 100 when the corresponding video content has been previously DMR packaged. send. (S250) If video content that has not been processed for DMR packaging is requested, the process of FIG. 10 is performed.

Referring to FIG. 12, when video content provision is requested from the DRM parallel packaging server 200 (S310), the video content provider (CP) independently processes the video content for DMR packaging (S320), and the DRM parallel packaging server 200 ) is sent to (S330) When there is a video content transmission request from the user terminal 100 (S340), the DRM parallel packaging server 200 transmits the corresponding video content to the user terminal 100. (S350)

Next, referring to FIG. 13, a parallel packaging method for DRM contents according to an embodiment of the present invention will be described. 13 is a flowchart illustrating a method for packaging DRM contents in parallel according to an embodiment of the present invention.

First, video content to be subjected to a DRM package is received. (S10)

Although the video content is not particularly limited, it can be more usefully used for large-capacity and high-definition video content. Preferably, video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-definition video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive interaction content, etc., HEVC (High Efficiency Video Codec)-based 4K 120 FPS (Frame Per Second) level, or 8K It may be 120 FPS level realistic content. Specifically, it may be HEVC (H.264, H.265)-based 8K-class realistic content. Of course, it can be applied without limitation to content of various levels, such as 120 FPS content, 60 to 120 FPS content, and 120 to 240 FPS content.

Next, the video content is divided into individual NAL units. (S20)

Next, at least one NAL unit (packaging NAL unit) to be processed for DRM packaging is selected from among the plurality of divided NAL units. (S30) At this time, based on the random number information (R), a packaging NAL unit and a NAL unit (skip NAL unit) not to be processed for DRM packaging are selected. The random number information R includes location information along with packaging processing information.

Next, DRM packaging is performed on each of the selected plurality of packaging NAL units. (S40)

Specifically, decoding is performed using a CABAC decoder for each of a plurality of divided packaging NAL units. (S41) When the packaging NAL unit is decoded by the CABAC decoder, five types of data are derived for each video frame. The derived data are QTC, general control data, internal prediction data, filter control data, and motion data.

Next, the DRM meta data is packaged within the QTC data. (S42)

QTC data is selected from data derived as a result of decoding by the CABAC decoder, and DRM packaging is performed by performing an XOR operation on DRM metadata and QTC data for a portion of the QTC data.

In the DRM metadata packaging step (S42), a YCbCr channel is selected from among several channels present in each video frame, some QTCs in the Y channel representing luminance are selected from among the YCbCr channels, and at least one of the Y channel QTCs is selected. DRM packaging is performed by performing an XOR operation on the bitstream and the DRM metadata bitstream at a position corresponding thereto.

Next, the DRM-packaged video frame is encoded with a CABAC encoder to generate a DRM-packaged NAL unit. (S43)

At the same time as DRM packaging is performed on the packaging NAL unit, a frame having the same shape as the previous image frame is created for the skip NAL unit not subjected to DRM packaging, and the frame is skipped.

Next, a plurality of packaging NAL units for which DRM packaging (decoding, packaging, encoding) is completed and a skip NAL unit for which frame skip is completed are temporarily stored. (S50)

Next, a plurality of temporarily stored NAL units are sorted. (S60)

A plurality of packaging NAL units for which DRM packaging is completed and a skip NAL unit for which frame skip is completed are aligned using location information given by the random number information (R).

As described above, according to the DRM content parallel packaging method and DRM content parallel packaging system according to an embodiment of the present invention, when performing DRM packaging for existing immersive content, the required time and amount of computation increased in proportion to the volume of the content. Contrary to this, by arranging an appropriate number of DRM packaging modules in parallel and performing DRM packaging in parallel, the required time and amount of computation can be kept constant regardless of the capacity. Accordingly, efficient DRM packaging can be performed for large-capacity high-definition video content and 8K-class realistic content.

14 is a diagram illustrating a computing device according to an embodiment of the present invention. The computing device TN100 of FIG. 14 may be a device described in this specification (eg, a DRM parallel packaging device, a DRM parallel packaging server, etc.).

In the embodiment of FIG. 14 , the computing device TN100 may include at least one processor TN110, a transceiver TN120, and a memory TN130. In addition, the computing device TN100 may further include a storage device TN140, an input interface device TN150, and an output interface device TN160. Elements included in the computing device TN100 may communicate with each other by being connected by a bus TN170.

The processor TN110 may execute program commands stored in at least one of the memory TN130 and the storage device TN140. The processor TN110 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to embodiments of the present invention are performed. Processor TN110 may be configured to implement procedures, functions, methods, and the like described in relation to embodiments of the present invention. The processor TN110 may control each component of the computing device TN100.

Each of the memory TN130 and the storage device TN140 may store various information related to the operation of the processor TN110. Each of the memory TN130 and the storage device TN140 may include at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory TN130 may include at least one of read only memory (ROM) and random access memory (RAM).

The transmitting/receiving device TN120 may transmit or receive a wired signal or a wireless signal. The transmitting/receiving device TN120 may perform communication by being connected to a network.

Meanwhile, the present invention may be implemented as a computer program. The present invention may be implemented as a computer program stored in a computer-readable recording medium in order to execute the DRM contents parallel packaging method according to the present invention in combination with hardware.

Methods according to embodiments of the present invention may be implemented in the form of programs readable by various computer means and recorded on computer-readable recording media. Here, the recording medium may include program commands, data files, data structures, etc. alone or in combination.

Program instructions recorded on the recording medium may be those specially designed and configured for the present invention, or those known and usable to those skilled in computer software.

For example, recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CDROMs and DVDs, and magneto-optical media such as floptical disks. optical media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of the program command may include a high-level language that can be executed by a computer using an interpreter, as well as a machine language generated by a compiler.

These hardware devices may be configured to act as one or more software modules to perform the operations of the present invention, and vice versa.

Although one embodiment of the present invention has been described above, those skilled in the art can add, change, delete, or add components within the scope not departing from the spirit of the present invention described in the claims. The present invention can be variously modified and changed by the like, and this will also be said to be included within the scope of the present invention.

100: user terminal
200: DRM content parallel packaging management server
210: Ministry of Communication
220: parallel packaging unit
221: NAL division module
222: NAL selection module
223: parallel packaging module
224: packaging skip module
225: shared memory
226: NAL alignment module
CP1 ~ CP3: External Content Provider

Claims (15)

A NAL segmentation module for segmenting video content composed of a plurality of NAL units (Network Abstraction Layer Units) into individual NAL units;
NAL for selecting at least one packaging NAL unit to be processed for DRM packaging and at least one or more skip NAL units not to be processed for DRM packaging based on randomly generated random number information among the plurality of NAL units divided by the NAL segmentation module. optional module;
For each of the plurality of packaging NAL units selected by the NAL selection module, decoding using a CABAC decoder, packaging DRM metadata in the QTC data extracted through decoding, and encoding the NAL unit for which DRM metadata packaging has been completed Parallel packaging module; and,
A NAL alignment module for aligning the packaging NAL unit and the skip NAL unit using location information included in the random number information;
The random number information includes packaging processing information for selecting the packaging NAL unit and location information about the packaging NAL unit and skip NAL unit,
The random number information is an array consisting of a first state value indicating a NAL unit to be processed for DRM packaging and a second state value indicating a NAL unit not to be processed for DRM packaging, and the ratio of the first state value (0<N<100 , N is the packaging NAL unit generation rate) is adjusted in consideration of the packaging processing speed and the possibility of unauthorized copying
DRM content parallel packaging device characterized by.
delete delete The method of claim 1,
In the parallel packaging module, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel for each of the selected plurality of packaging NAL units,
Each of the DRM packaging modules,
decoding means for decoding using a CABAC decoder;
a packaging means for selecting QTC data from data derived as a result of decoding by the decoding means, inserting a bitstream of the selected QTC data and a bitstream of DRM metadata, and performing DRM packaging; and,
Encoding means for encoding the packaging NAL unit on which the DRM packaging is performed using a CABAC encoder
DRM content parallel packaging device comprising a.
The method according to claim 4, wherein the packaging means,
Insertion operation is performed on the bitstream of at least one QTC among the YCbCr channels included in the video frame embodying the video image of the packaging NAL unit and the bitstream of DRM metadata among the QTCs present in the Y channel representing luminance. A parallel packaging device for DRM content that is packaged by DRM.
a communication unit that performs wired/wireless communication with a user terminal;
A NAL segmentation module that divides video content including a plurality of NAL units into individual NAL units, and DRM packaging processing based on randomly generated random number information among the plurality of NAL units divided by the NAL segmentation module. A NAL selection module for selecting at least one packaging NAL unit and at least one skip NAL unit not to be subjected to DRM packaging processing, and decoding and decoding each of the plurality of packaging NAL units selected by the NAL selection module using a CABAC decoder. A parallel packaging module that packages the DRM metadata in the QTC data extracted through and encodes the NAL unit for which the DRM metadata packaging has been completed, and the packaging NAL unit and the skip NAL unit using the location information included in the random number information A parallel packaging unit including a NAL alignment module for aligning;
The random number information includes packaging processing information for selecting the packaging NAL unit and location information about the packaging NAL unit and skip NAL unit,
The random number information is an array consisting of a first state value indicating a NAL unit to be processed for DRM packaging and a second state value indicating a NAL unit not to be processed for DRM packaging, and the ratio of the first state value (0<N<100 , N is the packaging NAL unit generation rate) is adjusted in consideration of the packaging processing speed and the possibility of unauthorized copying
DRM content parallel packaging management server characterized by.
delete delete The method of claim 6,
In the parallel packaging module, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel for each of the selected plurality of packaging NAL units,
Each of the DRM packaging modules,
decoding means for decoding using a CABAC decoder;
a packaging means for selecting QTC data from data derived as a result of decoding by the decoding means, inserting a bitstream of the selected QTC data and a bitstream of DRM metadata, and performing DRM packaging; and,
Encoding means for encoding the packaging NAL unit on which the DRM packaging is performed using a CABAC encoder
A DRM content parallel packaging management server comprising a.
The method according to claim 9, wherein the packaging means,
Insertion operation is performed on the bitstream of at least one QTC among the YCbCr channels included in the video frame embodying the video image of the packaging NAL unit and the bitstream of DRM metadata among the QTCs present in the Y channel representing luminance. A parallel packaging management server for DRM content that is packaged by DRM.
Performed by a computing device, the computing device comprising:
A first step of dividing video content including a plurality of NAL units into individual NAL units;
A second step of selecting at least one packaging NAL unit to be processed for DRM packaging and at least one or more skip NAL units not to be processed for DRM packaging based on randomly generated random number information from among the plurality of divided NAL units;
A third step of decoding each of the selected plurality of packaging NAL units using a CABAC decoder;
A fourth step of packaging DRM metadata in QTC data among data obtained through the decoding, for each of the plurality of selected packaging NAL units;
A fifth step of encoding the NAL unit for which the DRM meta data packaging is completed using a CABAC encoder for each of the plurality of selected packaging NAL units; and,
Aligning the packaging NAL unit and the skip NAL unit using location information included in the random number information;
The random number information includes packaging processing information for selecting the packaging NAL unit and location information about the packaging NAL unit and skip NAL unit,
The random number information is an array consisting of a first state value indicating a NAL unit to be processed for DRM packaging and a second state value indicating a NAL unit not to be processed for DRM packaging, and the ratio of the first state value (0<N<100 , N is the packaging NAL unit generation rate) is adjusted in consideration of the packaging processing speed and the possibility of unauthorized copying
DRM content parallel packaging method characterized by.
delete delete The method according to claim 11, wherein the fourth step,
DRM content parallel packaging method, characterized in that for performing DRM packaging by selecting QTC data from among the data derived in the third step, inserting a bitstream of the selected QTC data and a bitstream of DRM metadata.
The method according to claim 14, wherein the fourth step,
Insertion operation is performed on the bitstream of at least one QTC among the YCbCr channels included in the video frame embodying the video image of the packaging NAL unit and the bitstream of DRM metadata among the QTCs present in the Y channel representing luminance. A parallel packaging method for DRM content that is packaged by DRM.

Images