KR102302755B1 - DRM contents parallel packaging device and system comprising it and method for DRM contents parallel packaging - Google Patents

Abstract

The present invention relates to a DRM content parallel packaging apparatus capable of reducing the required time and computational amount for DRM packaging regardless of the capacity of video content, a DRM content parallel packaging system and a DRM content parallel packaging method including the same,
DRM content parallel packaging device according to an embodiment of the present invention,
a NAL segmentation module for segmenting video content including a plurality of NAL units (Network Abstraction Layer Unit) into individual NAL units; For each of the plurality of NAL units divided by the NAL partitioning module, the NAL unit is decoded using a CABAC decoder, the DRM metadata is packaged in the QTC data extracted through decoding, and the DRM metadata packaging is completed. a parallel packaging module that encodes

Description

DRM contents parallel packaging device, DRM contents parallel packaging system including same, and DRM contents parallel packaging method {DRM contents parallel packaging device and system comprising it and method for DRM contents parallel packaging}

The present invention relates to a DRM content parallel packaging apparatus capable of reducing the required time and computational amount for DRM packaging regardless of the capacity of video content, a DRM content parallel packaging system including the same, and a DRM content parallel packaging method.

Due to the recent commercialization of 5G technology and the activation and expansion of one-person media such as YouTube, the demand for related digital content distribution and distribution platforms is increasing explosively, and related industries are rapidly growing.

However, due to the lack of awareness of digital content copyright, problems caused by indiscriminate illegal copying and unauthorized use of digital content have begun to emerge, and the importance of digital rights management (DRM) is emerging. .

DRM is a generic term for technology and service management systems and techniques for protecting the copyright of digital content, and a number of R&D and commercialization services are being performed to protect copyright information in various device environments. DRM technology for video content is largely divided into two types, which provide a safe and efficient DRM service between video content providers and users through DRM packaging for video and complex licensing technology.

The existing DRM packaging technology inserts the copyright of a specific content into the content to eradicate illegal copying and unauthorized use of the content. Scrambling or symmetric key/asymmetric key encryption algorithms were mainly used.

The problems caused by this are as follows.

First, it is the problem of DRM packaging execution speed and computational amount. In the case of a symmetric key/asymmetric key encryption algorithm, as the length of the secret key increases recently due to the safety of the algorithm, the speed and amount of computation required for encryption or decryption are increasing exponentially. In the case of immersive content, the capacity is increased up to 8 times compared to the existing content, so when the encryption algorithm is applied, the time required and the amount of computation increase. The cost required to solve this will increase.

Second, it is a problem of managing various keys required for DRM packaging. When scrambling or symmetric/asymmetric key encryption algorithms are used in DRM packaging, a key management policy and system are required to manage them. In particular, in the case of a symmetric key encryption algorithm, since a secret key must exist for each authorized user for a specific content, when the number of content and authorized users increases, the corresponding key will inevitably increase exponentially. Since a more complex type of key management policy must be introduced along with additional requirements, the cost to solve it increases.

Third, it is a management problem for immersive content metadata. Existing content did not provide a two-way interaction service, so only video content existed. .

Since it is impossible to manage and package such metadata in the existing DRM packaging technique, it is necessary to develop a new type of DRM content packaging technology to solve this problem.

Korean Patent No. 10-0814064

An object of the present invention is to provide a DRM content parallel packaging apparatus capable of reducing the required time and computational amount for DRM packaging regardless of the capacity of video content, a DRM content parallel packaging system including the same, and a DRM content parallel packaging method.

DRM content parallel packaging device according to an embodiment of the present invention,

a NAL segmentation module for segmenting video content including a plurality of NAL units (Network Abstraction Layer Unit) into individual NAL units; For each of the plurality of NAL units divided by the NAL partitioning module, the NAL unit is decoded using a CABAC decoder, the DRM metadata is packaged in the QTC data extracted through decoding, and the DRM metadata packaging is completed. a parallel packaging module that encodes

In the DRM content parallel packaging apparatus according to an embodiment of the present invention, in the parallel packaging module, for each of the plurality of divided NAL units, a plurality of DRM packaging modules for packaging the DRM metadata may be formed in parallel. have. Each of the DRM packaging modules includes: decoding means for decoding the NAL unit using a CABAC decoder; packaging means for selecting QTC data from among the data derived as a result of decoding by the decoding means and performing DRM packaging by inserting a bitstream of the selected QTC data and a bitstream of DRM metadata; and encoding means for encoding the NAL unit on which the DRM packaging is performed using a CABAC encoder.

In the DRM content parallel packaging apparatus according to an embodiment of the present invention, the packaging means includes at least among QTCs present in a Y channel expressing luminance among YCbCr channels included in a video frame implementing the video image of the NAL unit. Insertion operation may be performed on one or more bitstreams of QTC and bitstreams of DRM metadata.

In the DRM content parallel packaging apparatus according to an embodiment of the present invention, a shared memory for temporarily storing a plurality of NAL units in which DRM packaging is completed; It may further include a NAL sorting module for arranging a plurality of NAL units temporarily stored in the shared memory.

DRM content parallel packaging management server according to an embodiment of the present invention,

a communication unit for performing wired/wireless communication with the user terminal; A NAL division module that divides video content composed of a plurality of NAL units into individual NAL units, and a CABAC decoder for each of the plurality of NAL units divided by the NAL division module to decode the NAL unit and perform decoding and a parallel packaging unit including a parallel packaging module that packages the DRM metadata in the QTC data extracted through it and encodes the NAL unit on which the DRM metadata packaging is completed.

In the DRM content parallel packaging management server according to an embodiment of the present invention, in the parallel packaging module, for each of the divided plurality of NAL units, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel. can Each of the DRM packaging modules includes: decoding means for decoding the NAL unit using a CABAC decoder; packaging means for selecting QTC data from among the data derived as a result of decoding by the decoding means and performing DRM packaging by inserting a bitstream of the selected QTC data and a bitstream of DRM metadata; and encoding means for encoding the NAL unit on which the DRM packaging is performed using a CABAC encoder.

In the DRM content parallel packaging management server according to an embodiment of the present invention, the packaging means includes: among QTCs present in a Y channel expressing luminance among YCbCr channels included in a video frame implementing the video image of the NAL unit. An insertion operation may be performed on at least one bitstream of QTC and a bitstream of DRM metadata.

In the DRM content parallel packaging management server according to an embodiment of the present invention, the parallel packaging unit includes: a shared memory for temporarily storing a plurality of NAL units for which DRM packaging is completed; It may further include a NAL sorting module for arranging a plurality of NAL units temporarily stored in the shared memory.

DRM content parallel packaging method according to an embodiment of the present invention,

It is performed by a computing device, the computing device dividing the image content including a plurality of NAL units into individual NAL units; decoding each of the plurality of divided NAL units using a CABAC decoder; For each of the plurality of divided NAL units, packaging DRM metadata in QTC data among the data obtained through the decoding; and encoding the NAL unit in which the DRM metadata packaging is completed by using a CABAC encoder for each of the plurality of divided NAL units.

In the DRM content parallel packaging method according to an embodiment of the present invention, the packaging of the DRM metadata includes selecting QTC data from among the data derived in the decoding step, and selecting a bitstream of the QTC data and DRM metadata. DRM packaging can be performed by inserting the bitstream of

In the DRM content parallel packaging method according to an embodiment of the present invention, the packaging of the DRM metadata is present in a Y channel expressing luminance among YCbCr channels included in a video frame implementing the video image of the NAL unit. DRM packaging may be performed by performing an insertion operation on the bitstream of at least one QTC and the bitstream of DRM metadata among the QTCs used.

In a DRM content parallel packaging method according to an embodiment of the present invention, the method comprising: temporarily storing a plurality of NAL units in which DRM packaging is completed; It may further include; arranging a plurality of temporarily stored NAL units.

Other details of implementations according to various aspects of the invention are included in the detailed description below.

The disclosed technology may have the following effects. However, this does not mean that a specific embodiment should include all of the following effects or only the following effects, so the scope of the disclosed technology should not be construed as being limited thereby.

According to the DRM content parallel packaging method and DRM content parallel packaging system according to an embodiment of the present invention,

Unlike the existing DRM packaging for immersive content, which requires an increase in time and computation in proportion to the capacity of the content, DRM packaging is performed in parallel by arranging an appropriate number of DRM packaging modules in parallel to reduce the time required and reduce the time required regardless of capacity. The amount of calculation can be made constant.

Therefore, efficient DRM packaging can be performed for large-capacity, high-definition video content and 8K-class immersive content.

1 and 2 are block diagrams illustrating a DRM content parallel packaging system according to an embodiment of the present invention.
3 is a block diagram illustrating a configuration of a parallel packaging unit of a DRM content parallel packaging management server according to an embodiment of the present invention.
4 is a diagram illustrating a structure of an HEVC-based immersive content bit stream.
5 is a block diagram illustrating a configuration of a DRM packaging module, which is a configuration of a parallel packaging module.
6 is a diagram for explaining a DRM packaging process in QTC.
7 is a diagram schematically illustrating a DRM unpackaging process according to an embodiment of the present invention.
8 to 10 are flowcharts illustrating an operation process of a DRM content parallel packaging system according to an embodiment of the present invention.
11 is a flowchart illustrating a DRM content parallel packaging method according to an embodiment of the present invention.
12 is a diagram illustrating a computing device according to an embodiment of the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

The terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present invention, terms such as 'comprising' or 'having' are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof. Hereinafter, a DRM content parallel packaging apparatus, a DRM content parallel packaging system including the same, and a DRM content parallel packaging method according to an embodiment of the present invention will be described with reference to the drawings.

1 and 2 are block diagrams illustrating a DRM content parallel packaging system according to an embodiment of the present invention.

1 and 2, the DRM content parallel packaging system according to an embodiment of the present invention includes a user terminal 100 and a DRM content parallel packaging management server 200 (hereinafter also referred to as a DRM parallel packaging server). include 1 shows a case in which the DRM parallel packaging server 200 has stored a plurality of image contents as a DB on its own, and FIG. 2 is a DRM parallel packaging server separately from an external content provider (Contents Provider, CP1 to CP3). A case in which video content is provided is shown at 200 .

In the present invention, the video content to be subjected to DRM packaging is not particularly limited, but may be more usefully utilized for large-capacity, high-definition video content. Preferably, the video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-definition video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive content, etc., HEVC (High Efficiency Video Codec)-based 4K 120FPS (Frame Per Second) level, or 8K It may be 120 FPS immersive content. Specifically, it may be an 8K-level immersive content based on HEVC (H.264, H.265). Of course, it can be applied to various levels of content, such as 60 to 120 FPS content, 120 to 240 FPS content, as well as 120 FPS content, without limitation.

The user terminal 100 refers to a terminal capable of transmitting and receiving various data to and from the DRM parallel packaging server 200 via a wired/wireless communication network according to a user's key operation, and includes a personal computer (PC), a notebook computer, and a personal portable device. It may be any one of an information terminal (PDA: Personal Digital Assistant) and a mobile communication terminal (Mobile Communication Terminal), and a web browser for accessing the DRM parallel packaging server 200 via a wired/wireless communication network and a program for storing It refers to a terminal equipped with a memory, a microprocessor for operating and controlling the execution of a program.

A user may make a transmission request (download request) for a specific video content to the DRM parallel packaging server 200 through the user terminal 100 .

When the DRM parallel packaging server 200 receives a transmission request for a specific video content from the user terminal 100, the DRM parallel packaging (hereinafter also referred to as “DRM packaging”) on the video content is transmitted to the user terminal 100 . . Alternatively, the DRM parallel packaging server 200 may pre-package and store a plurality of image contents, and when the DRM parallel packaging server 200 receives a transmission request for a specific image content from the user terminal 100, DRM packaging It is possible to select a corresponding image content from among the image content and transmit it to the user terminal 100 .

To this end, the DRM parallel packaging server 200 may include a communication unit 210 , a parallel packaging unit 220 , a storage unit 230 , and a control unit (not shown).

The communication unit 210 is a communication means for performing a function of interworking with the user terminal 100 and external content providers CP1 to CP3 via a wired/wireless communication network, and performs a function of transmitting and receiving various data.

The storage unit 230 stores various data and programs necessary for driving the DRM parallel packaging server 200 . According to an embodiment, the storage unit 230 may store a plurality of image contents that have not been subjected to DRM packaging or a plurality of image contents that have been subjected to DRM packaging in advance. Alternatively, the storage unit 230 may store a plurality of image contents that have been pre-DRM packaged by the external content providers CP1 to CP3.

The parallel packaging unit 220 performs DRM parallel packaging processing on the image content. The parallel packaging unit 220 divides the video content into a plurality of NAL units and performs DRM packaging on each NAL unit. The parallel packaging unit 220 DRM packaging the corresponding image content in response to the transmission request of the user terminal 100 or DRM packaging the plurality of image contents in advance regardless of the transmission request of the user terminal 100 to the storage unit It can be stored in (230).

A control unit (not shown) controls the overall function of the DRM parallel packaging server 200 .

3 is a block diagram illustrating the configuration of the parallel packaging unit 220 of the DRM content parallel packaging management server according to an embodiment of the present invention.

As shown in FIG. 3 , the parallel packaging unit 220 may include a NAL division module 221 , a parallel packaging module 222 , a shared memory 223 , and a NAL alignment module 224 . Each of the modules 221 to 224 is a component that performs a predetermined function, and may be implemented as hardware, software, or a combination of hardware and software. For example, the modules 221 to 224 may mean program modules, which may be software components that are executed by a processor to perform predetermined functions.

On the other hand, although the above modules 221 to 224 are described as components constituting the parallel packaging unit 220 of the DRM parallel packaging server 200, the parallel packaging unit 220 of the DRM parallel packaging server 200 is necessarily described. It may not function as a function, but may be implemented as an independent device. That is, it may be implemented as an independent DRM content parallel packaging device in which the functions of the above modules 221 to 224 are implemented.

The NAL unit (Network Abstraction Layer Unit) means a video layer independent of the network. This means that it does not interfere with the video.

4 is a diagram illustrating a bit stream structure of HEVC-based immersive content. 4 shows a bit stream structure of H.264-level video content (hereinafter, H.264), but H.265-level video content may also have a similar structure.

H.264 video content was developed for the purpose of network transmission from the beginning, and it is configured including a NAL unit for efficient transmission of video content.

Referring to FIG. 4 , an HEVC-based immersive content bit stream includes a NAL unit and a Raw Byte Sequence Payload (RBSP). The RBSP may include a parameter set indicating information such as SPS and PPS and a slice data RBSP corresponding to a video coding layer (VCL). VCL represents actual H.264 compressed data, and VCL data is interfaced with the outside through the NAL unit. All data of H.264 is composed of each NAL unit.

The video content (H.265 or H.264) has a NAL unit structure. The video itself has a bitstream structure, and the bitstream has a continuous NAL structure (NAL header and RBSP). The NAL unit of H.265 has 64 types of NAL units, and the NAL units having actual image information are numbers 0 to 3 (32 types of NAL). This is called VCL, and the remaining NAL units from 32 to 63 are called non-VCL. The non-VCL usually has various parameter information necessary for video decoding, such as video playback, resolution, frames per second, and start and end of video. The present invention parallelizes the DRM packaging process for the NAL units (No. 0 to No. 31) corresponding to the VCL.

The NAL segmentation module 221 divides image content including a plurality of NAL units into individual NAL units using a NAL unit parser.

The parallel packaging module 222 decodes the NAL unit using a CABAC decoder for each of the plurality of NAL units divided by the NAL division module 221, and packages the DRM metadata in the QTC data extracted through decoding, and , encodes the NAL unit for which DRM metadata packaging has been completed.

In the parallel packaging module 222, a plurality of DRM packaging modules 222a to 222n for packaging DRM metadata for each of the divided NAL units are formed in parallel. The parallel packaging module 222 may be performed by utilizing a predefined CPU-based multi-thread. A thread means a unit of work that the CPU independently processes. Usually, the number of cores and the number of threads are the same. can The number of the plurality of DRM packaging modules 222a to 222n may be the same as the number of cores (the number of threads).

Each of the DRM packaging modules (222a to 222n) packages the DRM metadata for each of the plurality of divided NAL units. The DRM packaging modules 222a to 222n will be described later with reference to FIG. 5 .

The shared memory 223 temporarily stores a plurality of NAL units on which DRM packaging (decoding, packaging, and encoding) has been completed, and the NAL sorting module 224 aligns the plurality of NAL units temporarily stored in the shared memory 223 .

All data of H.264 is composed of each NAL unit, and each NAL unit has a unique serial number. The NAL alignment module 224 may align a plurality of NAL units in which DRM packaging is completed by using the unique serial number of the NAL unit.

On the other hand, not all video content including the NAL unit has a unique serial number. In this case, the NAL alignment module 224 cannot perform the alignment. Accordingly, in an embodiment of the present invention, a flag for order identification is inserted in a predetermined area (eg, head area) of the NAL unit.

The flag insertion may be performed at any stage before being stored in the shared memory 223 . For example, this may be performed when the NAL segmentation module 221 divides image content into individual NAL units or when the parallel packaging module 222 performs DRM packaging.

There is a time difference between DRM packaging performed by each DRM packaging module 222a to 222n for an individual NAL unit. Accordingly, the order of the NAL units for which encoding is completed may be different from the order of the NAL units included in the original video content. If the NAL units are arranged in the order in which DRM packaging is completed, the original video content cannot be implemented, so a process of temporarily storing and sorting the NAL units in which DRM packaging is completed is required.

The DRM packaging modules 222a to 222n will be described with reference to FIG. 5 . 5 is a block diagram showing the configuration of the DRM packaging module (222a ~ 222n) as one configuration of the parallel packaging module (222).

As shown in FIG. 5 , each of the DRM packaging modules 222a to 222n may include a decoding means 2221 , a packaging means 2222 , and an encoding means 2223 . Each of the means 2221 to 2223 is a component that performs a predetermined function, and may be implemented as hardware, software, or a combination of hardware and software. For example, the means 2221 to 2223 may mean program modules, which may be software components that are executed by a processor to perform predetermined functions.

The packaging means 2222 performs DRM packaging by using QTC existing in a YCbCr channel, which is one of the channels expressing the video image. More specifically, the packaging means 2222 performs an XOR operation on at least one QTC among QTCs existing in a Y channel expressing luminance among YCbCr channels and a bitstream of DRM metadata for packaging.

That is, the packaging means 2222 selects a YCbCr channel from among several channels, selects some QTCs in a Y channel expressing luminance from among the YCbCr channels, and selects at least one bitstream of the Y channel QTC and a position corresponding thereto. DRM packaging is performed by performing an XOR operation on the DRM metadata bitstream.

The Y channel is information about a basic black-and-white image, and a Cb channel and a Cr channel are generated with reference to the Y channel. At this time, a color image with the same image quality as the original or with a relatively lower quality compared to the original is generated through lossless or lossy compression according to the method of generation. In the present invention, DRM packaging is performed only for the Y channel using this principle of YCbCr. That is, if packaging is performed on only the Y channel, the Cb channel and Cr channel, which are channels generated by referring to this, are automatically packaged. In addition, when DRM packaging is performed on the Cb and Cr channels instead of the Y channel among YCbCr, the amount of packaging operation and the required time are increased. In addition, since DRM packaging is a technology that prevents unauthorized users from viewing the image by increasing the distortion of the image, it can be seen that the increased distortion of the result of the packaged image compared to the original is excellent. Therefore, DRM packaging by the packaging means 2222 is preferably performed for QTC in the Y channel of the YCbCr channel.

The encoding means 2223 encodes the video frame on which the DRM packaging has been performed to generate a DRM packaged NAL unit. The encoding means 2223 may be a CABAC encoder that performs a binary arithmetic encoding method that adaptively performs encoding according to surrounding conditions.

6 is a diagram for explaining a DRM packaging process in QTC.

6 illustrates a process of inserting DRM metadata into a region selected within a QTC and a process of inserting DRM metadata into the region during the DRM packaging process. One QTC is divided into four regions according to the signal frequency distribution of the corresponding image. The four regions are denoted as LL (Low Low), LH (Low High), HL (High Low) and HH (High High), and the MSB (Most Significant Bit) of the four regions: the bit with the largest digit, that is, the leftmost bit ) Select 1 bit or more bits and perform DRM packaging by performing an XOR operation with the corresponding DRM metadata bitstream. Of course, this XOR operation is not necessarily limited to 1 bit MSB and 2 or more bits including the same. For example, the LSB (Least Significant Bit: bit of the smallest digit, that is, the rightmost bit) may be performed for one bit and a part of bits having a larger digit than that. The DRM packaging process illustrated in FIG. 6 exemplifies the result of performing an XOR operation on 2 bits of MSB in the pixel and 2 bits of the DRM metadata bitstream.

On the other hand, the DRM unpackaging process is as shown in FIG. 7 as a reverse of the DRM packaging process. After performing the CABAC decoding process on the downloaded or streaming video content (eg, HEVC video file) for which DRM packaging has been completed, select the area performed during packaging for the obtained packaged QTC, and then a legitimate user After obtaining unpackaged QTC by performing XOR operation with the DRM metadata bitstream owned by (Legal Subscriber), the data is transmitted and processed through the HEVC decoding process. Due to this, the actual user can unpackage the downloaded or streamed image data in real time, so that the original image can be viewed without delay.

Next, an operation process of the DRM content parallel packaging system according to an embodiment of the present invention will be described with reference to FIGS. 8 to 10 .

8 to 10 are flowcharts illustrating an operation process of a DRM content parallel packaging system according to an embodiment of the present invention.

8 is a system in which the DRM parallel packaging server 200 provides DRM-packaged video content in a real-time streaming method when there is a request for video content transmission from the user terminal 100 .

First, the user requests transmission of specific video content to the DRM parallel packaging server 200 through the user terminal 100 . (S110) The DRM parallel packaging server 200 requests and receives the video content from the corresponding video content provider (CP). (S120, S130) The DRM parallel packaging server 200 transmits the video content to the user terminal 100 in real time by DRM packaging processing (S140). (S150) In this process, if the DRM parallel packaging server 200 stores the image content by itself, steps S120 to S130 may be omitted.

9 and 10 show that a plurality of unspecified video contents are DRM-packaged and stored before there is a need for transmission of video contents from the user terminal 100, and then, when there is a transmission request through the user terminal 100, in advance As a system for transmitting DRM-packaged video content, FIG. 9 is a case in which the DRM parallel packaging server 200 performs DRM packaging in advance, and FIG. 10 is a case in which the image content provider (CP) performs DRM packaging in advance.

Referring to FIG. 9 , the DRM parallel packaging server 200 requests and receives the image content from the image content provider (CP). (S210, S220) The DRM parallel packaging server 200 stores the video content by DRM packaging processing. (S230) When there is a request for image content transmission from the user terminal 100 (S240), the DRM parallel packaging server 200 transmits the image content to the user terminal 100 when the corresponding image content has been pre-DRM packaged. send. (S250) If the video content that has not been processed for DRM packaging is requested, the process of FIG. 8 is performed.

Referring to FIG. 10 , when a video content provision request is received from the DRM parallel packaging server 200 ( S310 ), the video content provider CP itself DRM packaging the video content ( S320 ), and the DRM parallel packaging server 200 . ) is sent to (S330) When there is a request for image content transmission from the user terminal 100 (S340), the DRM parallel packaging server 200 transmits the corresponding image content to the user terminal 100. (S350)

Next, a DRM content parallel packaging method according to an embodiment of the present invention will be described with reference to FIG. 11 . 11 is a flowchart illustrating a DRM content parallel packaging method according to an embodiment of the present invention.

First, video content to be DRM package is received. (S10)

The image content is not particularly limited, but may be more usefully used for large-capacity, high-definition image content. Preferably, the video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-definition video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive content, etc., HEVC (High Efficiency Video Codec)-based 4K 120FPS (Frame Per Second) level, or 8K It may be 120 FPS immersive content. Specifically, it may be an 8K-level immersive content based on HEVC (H.264, H.265). Of course, it can be applied to various levels of content, such as 60 to 120 FPS content, 120 to 240 FPS content, as well as 120 FPS content, without limitation.

Next, the video content is divided into individual NAL units. (S20)

Next, for each of the plurality of divided NAL units, DRM packaging is performed. (S30)

Specifically, decoding is performed using a CABAC decoder for each of a plurality of divided NAL units. (S31) If the NAL unit is decoded by the CABAC decoder, five pieces of data are derived for each image frame. The derived data are QTC, general control data, internal prediction data, filter control data, and motion data.

Next, the DRM metadata is packaged within the QTC data. (S32)

QTC data is selected from the data derived as a result of decoding by the CABAC decoder, and DRM-packaged by performing an XOR operation on the DRM metadata and QTC data for a partial region of the QTC data.

The DRM metadata packaging step (S32) selects a YCbCr channel from among several channels present in each image frame, selects some QTCs in a Y channel expressing luminance from among the YCbCr channels, and selects at least one of the Y channel QTCs. DRM packaging is performed by performing XOR operation on the bitstream and the DRM metadata bitstream in the corresponding position.

Next, a DRM-packaged image frame is encoded with a CABAC encoder to generate a DRM-packaged NAL unit. (S33)

Next, a plurality of NAL units on which DRM packaging (decoding, packaging, encoding) has been completed are temporarily stored. (S40)

Next, a plurality of temporarily stored NAL units are arranged. (S50)

A plurality of NAL units for which DRM packaging has been completed are aligned using the unique serial number of the NAL unit. Alternatively, a flag for order identification is inserted in a predetermined area (eg, head area) of the NAL unit, and the NAL units are aligned using the inserted flag. The flag insertion may be performed in any step as long as it is before step S40.

As described above, according to the DRM content parallel packaging method and the DRM content parallel packaging system according to an embodiment of the present invention, the time required and the amount of computation increased in proportion to the capacity of the content when performing DRM packaging for the existing immersive content. Contrary to this, by arranging an appropriate number of DRM packaging modules in parallel to perform DRM packaging in parallel, the time required and the amount of computation can be made constant regardless of the capacity. Therefore, efficient DRM packaging can be performed for large-capacity, high-definition video content and 8K-class immersive content.

12 is a diagram illustrating a computing device according to an embodiment of the present invention. The computing device TN100 of FIG. 12 may be a device described herein (eg, a DRM parallel packaging device, a DRM parallel packaging server, etc.).

In the embodiment of FIG. 12 , the computing device TN100 may include at least one processor TN110 , a transceiver device TN120 , and a memory TN130 . Also, the computing device TN100 may further include a storage device TN140 , an input interface device TN150 , an output interface device TN160 , and the like. Components included in the computing device TN100 may be connected by a bus TN170 to communicate with each other.

The processor TN110 may execute a program command stored in at least one of the memory TN130 and the storage device TN140. The processor TN110 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to an embodiment of the present invention are performed. The processor TN110 may be configured to implement procedures, functions, and methods described in connection with an embodiment of the present invention. The processor TN110 may control each component of the computing device TN100 .

Each of the memory TN130 and the storage device TN140 may store various information related to the operation of the processor TN110 . Each of the memory TN130 and the storage device TN140 may be configured as at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory TN130 may include at least one of a read only memory (ROM) and a random access memory (RAM).

The transceiver TN120 may transmit or receive a wired signal or a wireless signal. The transceiver TN120 may be connected to a network to perform communication.

Meanwhile, the present invention may be implemented as a computer program. The present invention may be implemented as a computer program stored in a computer-readable recording medium in combination with hardware to execute the DRM content parallel packaging method according to the present invention.

The methods according to the embodiment of the present invention may be implemented in the form of a program readable by various computer means and recorded in a computer readable recording medium. Here, the recording medium may include a program command, a data file, a data structure, etc. alone or in combination.

The program instructions recorded on the recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

For example, the recording medium includes magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CDROM and DVD, and magneto-optical media such as floppy disks. optical media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of program instructions may include not only machine language such as generated by a compiler, but also a high-level language that can be executed by a computer using an interpreter or the like.

Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

In the above, although an embodiment of the present invention has been described, those of ordinary skill in the art can add, change, delete or add components within the scope that does not depart from the spirit of the present invention described in the claims. It will be said that various modifications and changes of the present invention can be made by, and this is also included within the scope of the present invention.

100: user terminal
200: DRM content parallel packaging management server
210: communication department
220: parallel packaging unit
221: NAL partition module
222: parallel packaging module
222a ~ 222n : DRM packaging module
2221: decoding means
2222: packaging means
2223: encoding means
223: shared memory
224: NAL alignment module
CP1 ~ CP3 : External Content Provider

Claims (12)

a NAL segmentation module for segmenting video content including a plurality of NAL units (Network Abstraction Layer Unit) into individual NAL units;
For each of the plurality of NAL units divided by the NAL partitioning module, the NAL unit is decoded using a CABAC decoder, the DRM metadata is packaged in the QTC data extracted through decoding, and the DRM metadata packaging is completed. A parallel packaging module that encodes
In the parallel packaging module, for each of the plurality of divided NAL units, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel,
Each of the DRM packaging modules,
decoding means for decoding the NAL unit using a CABAC decoder;
packaging means for selecting QTC data from among the data derived as a result of decoding by the decoding means and performing DRM packaging by inserting at least one bitstream in the selected QTC data and a bitstream of DRM metadata corresponding thereto; and,
Encoding means for encoding the NAL unit on which the DRM packaging has been performed using a CABAC encoder,
The packaging means,
Insertion operation on the bitstream of at least one QTC among the QTCs present in the Y channel representing the luminance among the YCbCr channels included in the video frame implementing the video image of the NAL unit and the bitstream of DRM metadata corresponding thereto DRM content parallel packaging device that performs DRM packaging.
delete delete The method according to claim 1,
a shared memory for temporarily storing a plurality of NAL units in which DRM packaging is completed;
NAL sorting module for sorting a plurality of NAL units temporarily stored in the shared memory
DRM content parallel packaging device further comprising a.
a communication unit for performing wired/wireless communication with the user terminal;
A NAL division module that divides video content composed of a plurality of NAL units into individual NAL units, and a CABAC decoder for each of the plurality of NAL units divided by the NAL division module to decode the NAL unit and perform decoding A parallel packaging unit including a parallel packaging module that packages the DRM metadata in the QTC data extracted through and encodes the NAL unit in which the DRM metadata packaging is completed; includes;
In the parallel packaging module, for each of the plurality of divided NAL units, a plurality of DRM packaging modules for packaging the DRM metadata are formed in parallel,
Each of the DRM packaging modules,
decoding means for decoding the NAL unit using a CABAC decoder;
packaging means for selecting QTC data from among the data derived as a result of decoding by the decoding means and performing DRM packaging by inserting at least one bitstream in the selected QTC data and a bitstream of DRM metadata corresponding thereto; and,
Encoding means for encoding the NAL unit on which the DRM packaging has been performed using a CABAC encoder,
The packaging means,
Insertion operation on the bitstream of at least one QTC among the QTCs present in the Y channel representing the luminance among the YCbCr channels included in the video frame implementing the video image of the NAL unit and the bitstream of DRM metadata corresponding thereto DRM content parallel packaging management server to perform DRM packaging.
delete delete The method according to claim 5, The parallel packaging unit,
a shared memory for temporarily storing a plurality of NAL units in which DRM packaging is completed;
NAL sorting module for sorting a plurality of NAL units temporarily stored in the shared memory
DRM content parallel packaging management server further comprising.
performed by a computing device, the computing device comprising:
dividing video content including a plurality of NAL units into individual NAL units;
decoding each of the plurality of divided NAL units using a CABAC decoder;
For each of the plurality of divided NAL units, packaging DRM metadata in QTC data among the data obtained through the decoding;
For each of the plurality of divided NAL units, encoding the NAL unit in which the DRM metadata packaging is completed using a CABAC encoder,
The step of packaging the DRM metadata includes:
Insertion operation on the bitstream of at least one QTC among the QTCs present in the Y channel representing the luminance among the YCbCr channels included in the video frame implementing the video image of the NAL unit and the bitstream of DRM metadata corresponding thereto A DRM content parallel packaging method that performs DRM packaging.
delete delete 10. The method of claim 9,
Temporarily storing a plurality of NAL units for which DRM packaging is completed;
aligning a plurality of temporarily stored NAL units;
DRM content parallel packaging method further comprising.

Images