JP7245401B2 - DRM content parallel packaging device, DRM content parallel packaging system including the same, and DRM content parallel packaging method - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act 2019 Korea Communication Information Science Society (KICS) Winter Conference Held on January 24, 2019

The present invention provides a DRM contents parallel packaging apparatus, a DRM contents parallel packaging system including the same, and a DRM contents parallel packaging method, capable of reducing the time required for DRM packaging and the amount of calculation regardless of the capacity of video contents. It is about.

In recent years, in addition to the commercialization of 5G technology, with the activation and expansion of personal media such as YouTube, the demand for related digital content distribution and distribution platforms has increased explosively. Herd is growing rapidly.

However, due to a lack of awareness of digital content copyrights, problems of illegal copying and unauthorized use of digital content have begun to emerge, and the importance of digital rights management (DRM) is increasing.

DRM is a general term for technologies and service management systems and techniques for protecting the copyright of digital content. service is being performed. DRM technology for video content can be roughly divided into two: DRM packaging for video and safe and efficient DRM service between video content providers and users through complex licensing technology. offer.

The existing DRM packaging technology inserts the copyright of specific content into the content to eradicate illegal copying and unauthorized use of the content. H.264 (up to 4K60 FPS) content, and scrambling or symmetric/asymmetric key encryption algorithms were mainly used as detailed packaging techniques.

The problems that arise are as follows.

The first is the speed and computational complexity of DRM packaging. In the case of symmetric key/asymmetric key cryptographic algorithms, the speed and amount of computation required for encryption or decryption have increased in recent years as the length of the secret key increases due to the security issues of the algorithms. It tends to increase exponentially. In the case of realistic content, the capacity increases up to 8 times compared to existing content, so the time and amount of calculation required to apply encryption algorithms increase. Or, since hardware must be newly developed and constructed, the cost for solving this will increase.

The second is the management of various keys required for DRM packaging. If scrambling or symmetric/asymmetric key cryptographic algorithms are used in DRM packaging, a key management policy and system is required to manage this. In particular, for symmetric-key cryptographic algorithms, a private key must exist for each authorized user to a particular piece of content, so as content and authorized users grow, the keys for this also grow exponentially. In addition to the need for additional key management systems, a more complicated form of key management policy needs to be introduced, which increases the cost of solving this problem.

The third is a problem related to the management of sensible content metadata. Existing content does not provide a two-way interaction service, so there is only video content. There is separate metadata that allows interactive interaction with video content.

Since existing DRM packaging techniques cannot manage and package such metadata, development of a new type of DRM content packaging technique is required to solve this problem.

The present invention provides a DRM contents parallel packaging apparatus, a DRM contents parallel packaging system including the same, and a DRM contents parallel packaging method, capable of reducing the time required for DRM packaging and the amount of calculation regardless of the capacity of video contents. intended to provide

A DRM content parallel packaging device according to an embodiment of the present invention includes:

A NAL division module that divides a video content configured including a plurality of NAL units (Network Abstraction Layer Units) into individual NAL units; CABAC for each of the plurality of NAL units divided by the NAL division module a parallel packaging module for decoding NAL units using a decoder, packaging DRM metadata in QTC data extracted through decoding, and encoding the NAL units for which DRM metadata packaging has been completed; .

In the DRM content parallel packaging device according to the embodiment of the present invention, the parallel packaging module is configured to form a plurality of DRM packaging packages for packaging the DRM metadata for each of the plurality of divided NAL units. Modules may be formed in parallel. Each of the DRM packaging modules selects QTC data from decoding means for decoding the NAL unit using a CABAC decoder; data derived as a result of decoding by the decoding means, and selects packaging means for performing DRM packaging by inserting the QTC data bitstream and the DRM metadata bitstream; and encoding means for encoding the NAL unit on which the DRM packaging is performed using a CABAC encoder. can include

In the DRM content parallel packaging apparatus according to the embodiment of the present invention, the packaging means converts the Y channel representing luminance among the YCbCr channels included in the video frame that implements the video image of the NAL unit. An insertion operation can be performed on at least one QTC bitstream and a DRM metadata bitstream among existing QTCs.

Shared memory for temporarily storing a plurality of NAL units for which DRM packaging has been completed in an apparatus for parallel packaging of DRM contents according to an embodiment of the present invention; Arranging the plurality of NAL units temporarily stored in the shared memory A NAL alignment module can further be included.

A DRM content parallel packaging management server according to an embodiment of the present invention includes:

A communication unit that performs wired/wireless communication with a user terminal; a NAL division module that divides video content including a plurality of NAL units into individual NAL units; and a plurality of NALs divided by the NAL division module. For each unit, a CABAC decoder is used to decode the NAL unit, package DRM metadata in QTC data extracted through decoding, and encode the NAL unit for which DRM metadata packaging has been completed. a parallel packaging section containing parallel packaging modules;

In the DRM content parallel packaging management server according to the embodiment of the present invention, the parallel packaging module creates a plurality of DRM packages for packaging the DRM metadata for each of the plurality of divided NAL units. Angling modules may be formed in parallel. Each of the DRM packaging modules selects QTC data from decoding means for decoding the NAL unit using a CABAC decoder; data derived as a result of decoding by the decoding means, and selects packaging means for performing DRM packaging by inserting the QTC data bitstream and the DRM metadata bitstream; and encoding means for encoding the NAL unit on which the DRM packaging is performed using a CABAC encoder. can include

In the DRM content parallel packaging management server according to the embodiment of the present invention, the packaging means may include a Y channel representing luminance among YCbCr channels included in a video frame representing the video image of the NAL unit. The insertion operation can be performed on at least one or more QTC bitstreams and DRM metadata bitstreams among the QTCs present in the .

In the DRM content parallel packaging management server according to the embodiment of the present invention, the parallel packaging unit has a shared memory for temporarily storing a plurality of NAL units for which DRM packaging has been completed; It can further include a NAL alignment module that aligns multiple NAL units.

A DRM content parallel packaging method according to an embodiment of the present invention includes:

a step performed by a computing device, wherein the computing device divides a video content composed of a plurality of NAL units into individual NAL units; for each of the divided plurality of NAL units, a CABAC decoder; for each of the plurality of divided NAL units, packaging DRM metadata in QTC data among the data obtained through the decoding; encoding the DRM metadata packaging completed NAL unit using a CABAC encoder for each of the NAL units.

In the DRM content parallel packaging method according to an embodiment of the present invention, the step of packaging the DRM metadata includes selecting QTC data from among the data derived in the decoding step, and DRM packaging can be performed by inserting a bitstream of DRM metadata and a bitstream of DRM metadata.

In the DRM content parallel packaging method according to an embodiment of the present invention, the step of packaging the DRM metadata includes converting luminance among YCbCr channels included in a video frame that implements the video image of the NAL unit. A bitstream of at least one QTC among the QTCs present in the Y channel to be expressed and a bitstream of DRM metadata can be inserted and DRM packaged.

The DRM content parallel packaging method according to an embodiment of the present invention further includes: temporarily storing a plurality of NAL units for which DRM packaging has been completed; and arranging the temporarily stored plurality of NAL units. be able to.

Additional specifics of implementations according to various aspects of the present invention are included in the detailed description below.

According to a DRM content parallel packaging method and a DRM content parallel packaging system according to an embodiment of the present invention,

When performing DRM packaging for existing immersive contents, the time required and the amount of calculation increased in proportion to the volume of the contents. By performing DRM packaging, the required time and amount of computation can be kept constant regardless of the capacity.

Therefore, efficient DRM packaging can be performed for large-capacity high-definition video content and 8K-class realistic content.

FIG. 1 is a block diagram illustrating a DRM content parallel packaging system according to one embodiment of the present invention. FIG. 2 is a block diagram illustrating a DRM content parallel packaging system according to one embodiment of the present invention. FIG. 3 is a block diagram illustrating the configuration of the parallel packaging unit of the DRM content parallel packaging management server according to one embodiment of the present invention. FIG. 4 is a diagram illustrating an HEVC-based immersive content bitstream structure. FIG. 5 is a block diagram illustrating the configuration of a DRM packaging module, which is one configuration of the parallel packaging module. FIG. 6 is a diagram for explaining a DRM packaging process in QTC. FIG. 7 is a schematic diagram of a DRM unpackaging process according to an embodiment of the present invention. FIG. 8 is a flow chart illustrating an operation process of a DRM content parallel packaging system according to an embodiment of the present invention. FIG. 9 is a flow chart illustrating an operation process of a DRM content parallel packaging system according to an embodiment of the present invention. FIG. 10 is a flowchart illustrating the operation process of the DRM content parallel packaging system according to an embodiment of the present invention. FIG. 11 is a flowchart illustrating a DRM content parallel packaging method according to an embodiment of the present invention. FIG. 12 is a diagram illustrating a computing device according to one embodiment of the present invention.

Since the present invention can be subject to various transformations and can have various embodiments, specific embodiments will be illustrated and described in detail in the detailed description. However, this is not intended to limit the invention to any particular embodiment, but should be understood to include any transformations, equivalents or alternatives falling within the spirit and scope of the invention.

The terminology used in the present invention is merely used to describe particular embodiments and is not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "including" or "having" specify the presence of any of the features, numbers, steps, acts, components, parts, or combinations thereof described in the specification. and does not preclude the existence or addition of one or more other features, figures, ​​ steps, operations, components, parts or combinations thereof. Must. Hereinafter, a DRM content parallel packaging device, a DRM content parallel packaging system including the same, and a DRM content parallel packaging method according to embodiments of the present invention will be described with reference to the drawings.

1 and 2 are block diagrams illustrating a DRM content parallel packaging system according to an embodiment of the present invention.

As shown in FIGS. 1 and 2, a DRM content parallel packaging system according to an embodiment of the present invention includes a user terminal (100) and a DRM content parallel packaging management server (200, hereinafter DRM parallel packaging server). Also called.) including. FIG. 1 shows a case where a DRM parallel packaging server 200 voluntarily stores a plurality of video contents in a database, and FIG. ) separately provides video content to the DRM parallel packaging server 200. FIG.

In the present invention, the video content that is the target of DRM packaging is not particularly limited, but it can be more effectively used for large-capacity, high-quality video content. Preferably, the video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-quality video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive interaction content, etc., HEVC (High Efficiency Video Codec)-based 4K120 FPS (Frame Per Second) class , or 8K120 FPS-class realistic content. Specifically, it may be HEVC (H.264, H.265)-based 8K-class realistic content. Of course, it can be applied to various levels of contents such as 60 to 120 FPS level contents, 120 to 240 FPS level contents, etc., as well as 120 FPS level contents.

The user terminal (100) refers to a terminal that can transmit and receive various data to and from the DRM parallel packaging server (200) via a wired/wireless communication network by user's key operation. PC (Personal Computer), notebook computer, personal digital assistant (PDA), mobile communication terminal (Mobile Communication Terminal), etc., via a wired/wireless communication network. It means a terminal equipped with a web browser for connecting to the DRM parallel packaging server 200, a memory for storing programs, a microprocessor for executing, calculating and controlling the programs.

A user can make a transfer request (download request) for specific video content to the DRM parallel packaging server 200 through the user terminal 100 .

When the DRM parallel packaging server 200 receives a transfer request for specific video content from the user terminal 100, the DRM parallel packaging server 200 performs DRM parallel packaging (hereinafter also referred to as 'DRM packaging') on the corresponding video content, Transfer to the user terminal (100). Alternatively, the DRM parallel packaging server 200 can pre-DRM package and store a plurality of video contents, and the DRM parallel packaging server 200 receives specific video contents from the user terminal 100. When a transfer request is received from the user terminal 100, the corresponding video content can be selected from the video content pre-DRM packaged and transferred to the user terminal (100).

To this end, the DRM parallel packaging server 200 may include a communication unit 210, a parallel packaging unit 220, a storage unit 230, and a control unit (not shown).

The communication unit (210) is a communication means that performs a function of interlocking with the user terminal (100) and external content providers (CP1-CP3) via a wired/wireless communication network, and is a function of transmitting and receiving various data. carry out

The storage unit 230 stores various data and programs necessary for driving the DRM parallel packaging server 200. According to an embodiment, the storage unit 230 can store a plurality of video contents that have not been DRM packaged or a plurality of video contents that have been DRM packaged in advance. Alternatively, the storage unit 230 can store a plurality of video contents previously DRM-packaged by external content providers (CP1-CP3).

A parallel packaging unit 220 performs DRM parallel packaging processing on video content. A parallel packaging unit (220) divides the video content into a plurality of NAL units and performs DRM packaging on each NAL unit. The parallel packaging unit 220 performs DRM packaging processing on the corresponding video content according to the transfer request of the user terminal 100, or pre-packages a plurality of video contents regardless of the transfer request of the user terminal 100. The video content can be DRM packaged and stored in the storage unit 230 .

A controller (not shown) controls general functions of the DRM parallel packaging server (200).

FIG. 3 is a block diagram illustrating the configuration of the parallel packaging unit 220 of the DRM content parallel packaging management server according to one embodiment of the present invention.
As illustrated in FIG. 3, the parallel packaging unit (220) includes a NAL segmentation module (221), a parallel packaging module (222), a shared memory (223), and a NAL alignment module (224). can contain. Each of the modules (221-224) may be implemented in hardware, software, or a combination of hardware and software as components that perform predetermined functions. For example, the modules (221-224) may refer to program modules, which may be software components executed by a processor to perform predetermined functions.

On the other hand, the modules (221 to 224) are described as components constituting the parallel packaging unit (220) of the DRM parallel packaging server (200), but they are not necessarily the components of the DRM parallel packaging server (200). Instead of functioning as a parallel packaging unit (220), it may be embodied as an independent device. That is, it may be embodied as an independent DRM content parallel packaging device in which the functions of the modules (221-224) are embodied.

A NAL unit (Network Abstraction Layer Unit) means a video layer independent of a network. This means that even if a

FIG. 4 is a diagram illustrating a bit stream structure of HEVC-based immersive content. FIG. H.264 class video content (hereinafter referred to as H.264) has a bitstream structure. H.265 level video content may also have a similar structure.

H. H.264 class video content was developed for the purpose of network transfer from the beginning, and includes NAL units for efficient transfer of video content.

Referring to FIG. 4, the HEVC-based immersive content bitstream comprises NAL units and RBSP (Raw Byte Sequence Playload). The RBSP may include a parameter set indicating information such as SPS and PPS, and slice data RBSP corresponding to VCL (Video Coding Layer). VCL is the actual H.264. H.264 compressed data, and VCL data is interfaced with the outside through the NAL unit. H. All H.264 data consists of respective NAL units.

Video content (H.265 or H.264) has a NAL unit structure. The video itself has a bitstream structure, and the bitstream has a continuous NAL structure (NAL header and RBSP). H. H.265 NAL units have 64 NAL unit types, and NAL units having actual video information are numbered 0 to 3 (32 types of NALs). This is called VCL, and the remaining 32nd to 63rd NAL units are called non-VCL. Non-VCL usually has various parameter information necessary for video decoding, such as video playback, resolution, number of frames per second, start and end of video. The present invention parallelizes the DRM packaging process for the NAL units (numbered 0 to 31) corresponding to the VCL.

A NAL segmentation module (221) uses a NAL unit parser (Parser) to segment video content including a plurality of NAL units into individual NAL units.

A parallel packaging module (222) decodes each of the plurality of NAL units divided by the NAL division module (221) using a CABAC decoder, and extracts QTC data through decoding. , and encode the NAL unit for which the DRM metadata packaging is completed.

In the parallel packaging module (222), a plurality of DRM packaging modules (222a-222n) for packaging DRM metadata are formed in parallel for each of the plurality of divided NAL units. The parallel packaging module (222) may be performed utilizing pre-defined CPU-based multiple threads (Threads). A thread means a unit of work independently processed by a CPU. Normally, the number of cores and threads is the same. (threads) can be processed simultaneously. The number of DRM packaging modules 222a-222n may be the same as the number of cores (the number of threads).

Each DRM packaging module (222a-222n) packages DRM metadata for each of the plurality of divided NAL units. The DRM packaging modules (222a-222n) are described below with reference to FIG.

A shared memory 223 temporarily stores a plurality of NAL units for which DRM packaging (decoding, packaging, encoding) has been completed, and a NAL alignment module 224 temporarily stores in the shared memory 223. A plurality of NAL units are aligned.

H. All H.264 data consists of respective NAL units, and each NAL unit has a unique sequence number. A NAL alignment module (224) can align multiple NAL units for which DRM packaging has been completed using NAL unit-specific sequence numbers.
On the other hand, not all video content containing NAL units have unique sequence numbers. In this case, the NAL alignment module (224) will not be able to perform the alignment. Therefore, in one embodiment of the present invention, a flag for order identification is inserted in a predetermined area (eg, head area) of the NAL unit.

Flag insertion may be performed at any step before saving to shared memory (223). For example, it may be performed when the NAL splitting module (221) splits the video content into individual NAL units, or when the parallel packaging module (222) performs DRM packaging.

DRM packaging performed by each DRM packaging module (222a-222n) for individual NAL units has a time lag. Therefore, the order of the encoded NAL units may differ from the order of the NAL units included in the original video content. If the NAL units are arranged in the order in which the DRM packaging is completed, the original video content cannot be realized.

The DRM packaging modules (222a-222n) are described with reference to FIG. FIG. 5 is a block diagram illustrating the configuration of a DRM packaging module (222a-222n), which is one configuration of the parallel packaging module (222).

As illustrated in FIG. 5, each DRM packaging module (222a-222n) can include decoding means (2221), packaging means (2222), and encoding means (2223). The means (2221 to 2223) may be embodied in hardware, software, or a combination of hardware and software as components that perform predetermined functions. For example, the means (2221-2223) may mean program modules, which may be software components executed by a processor to perform a predetermined function.

A packaging means 2222 performs DRM packaging using the QTC present in the YCbCr channel, which is one of the channels expressing the video image. More specifically, the packaging means 2222 performs an XOR operation on at least one or more QTCs among the QTCs present in the Y channel representing luminance among the YCbCr channels and the bitstream of the DRM metadata. and packaging.

That is, the packaging means (2222) selects a YCbCr channel from among a plurality of channels, selects some QTCs in the Y channel expressing luminance from among the YCbCr channels, and selects at least one of the QTCs in the Y channel. DRM packaging is performed by performing an XOR operation on one bitstream and the bitstream of the DRM metadata in the corresponding position.

The Y channel is information about basic black-and-white video, and the Cb channel and Cr channel are generated by referring to the Y channel. At this time, a color image having the same image quality as the original or a relatively reduced image quality compared to the original is generated through lossless or lossy compression depending on the method of generation. In the present invention, this principle of YCbCr is used to perform DRM packaging only for the Y channel. That is, if only the Y channel is packaged, the Cb channel and the Cr channel, which are generated by referring to the Y channel, are automatically packaged. In addition, when DRM packaging is performed on Cb and Cr channels, which are not the Y channel, of YCbCr, the amount of computation and the time required for packaging increase. In addition, DRM packaging is a technology that increases video distortion and prevents unauthorized users from viewing the video, so As for the result, it can be said that it is superior in that distortion increases compared to the original. Therefore, the DRM packaging by the packaging means (2222) is preferably performed on the QTC in the Y channel among the YCbCr channels.

An encoding means 2223 encodes the DRM-packaged video frames to generate DRM-packaged NAL units. The encoding means (2223) may be a CABAC encoder that performs a binary arithmetic coding scheme that adaptively performs encoding according to surrounding conditions.

FIG. 6 is a diagram for explaining a DRM packaging process in QTC.

FIG. 6 illustrates a region selected in a QTC and a process of inserting DRM metadata into the corresponding region in the DRM packaging process. divided into four regions by The four areas are denoted as LL (Low Low), LH (Low High), HL (High Low) and HH (High High). bit) is selected and XORed with the corresponding bitstream of DRM metadata to perform DRM packaging. Of course, such an XOR operation is not necessarily limited to two or more bits including the MSB 1 bit. For example, it may be performed for one LSB (Least Significant Bit, i.e., rightmost bit) bit and some of the higher bits. The DRM packaging process illustrated in FIG. 6 illustrates the result of performing an XOR operation on 2 MSB bits in a pixel and 2 bits of a bitstream of DRM metadata.

On the other hand, the DRM unpackaging process reverses the DRM packaging process and is illustrated in FIG. After performing the CABAC decoding process on packets that have been downloaded or streamed from video content (e.g., HEVC video files) for which DRM packaging has been completed, the obtained packaged QTC is packaged. After selecting the region to be processed in the above, the XOR operation is performed with the DRM metadata bitstream owned by the legal subscriber to obtain the unpackaged QTC, and then the data is processed through the HEVC decoding process. be forwarded for processing. Accordingly, it is possible for an actual user to unpackage downloaded or streamed video data in real time and view the original video without delay.

Next, the operation process of the DRM content parallel packaging system according to an embodiment of the present invention will be described with reference to FIGS. 8 to 10. FIG.

8 to 10 are flowcharts illustrating the operation process of the DRM content parallel packaging system according to an embodiment of the present invention.

FIG. 8 is a system in which a DRM parallel packaging server 200 provides DRM-packaged video content in real-time streaming when a user terminal 100 requests transfer of video content.

First, a user requests transfer of specific video content from the DRM parallel packaging server 200 through the user terminal 100 . (S110) The DRM parallel packaging server 200 requests and receives video content from the corresponding video content provider (CP). (S120, S130) The DRM parallel packaging server (200) performs DRM packaging processing (S140) on the video content and transfers it to the user terminal (100) in real time. (S150) In this process, if the DRM parallel packaging server 200 independently stores video content, steps S120-S130 may be omitted.

9 and 10, before receiving a transfer request for video contents from the user terminal 100, a plurality of unspecified video contents are DRM-packaged and stored, and then transferred through the user terminal 100. A system for transferring pre-DRM-packaged video content upon request. This is the case where the provider (CP) performs DRM packaging in advance.

Referring to FIG. 9, the DRM parallel packaging server 200 requests and receives video content from a video content provider (CP). (S210, S220) The DRM parallel packaging server (200) stores the video content after performing DRM packaging. (S230) When there is a transfer request for video content from the user terminal (100) (S240), the DRM parallel packaging server (200) sends the video content to the user if the video content has undergone DRM packaging processing in advance. Transfer to the terminal (100). (S250) If video content that is not DRM packaged is requested, the process of FIG. 8 is performed.

Referring to FIG. 10, when the DRM parallel packaging server 200 requests the provision of video content (S310), the video content provider (CP) voluntarily performs DRM packaging processing of the corresponding video content (S320). ) and transfer to the DRM parallel packaging server (200). (S330) When there is a transfer request for video content from the user terminal (100) (S340), the DRM parallel packaging server (200) transfers the corresponding video content to the user terminal (100). (S350)

Next, a DRM content parallel packaging method according to an embodiment of the present invention will be described with reference to FIG. FIG. 11 is a flowchart illustrating a DRM content parallel packaging method according to an embodiment of the present invention.

First, the video content performing the DRM package is received. (S10)

The video content is not particularly limited, but can be used more effectively for large-capacity, high-definition video content. Preferably, the video content includes a plurality of NAL units (Network Abstraction Layer Units). High-capacity high-quality video content, for example, virtual reality content (VR content), augmented reality content (AR content), interactive interaction content, etc., HEVC (High Efficiency Video Codec)-based 4K120 FPS (Frame Per Second) class , or 8K120 FPS-class realistic content. Specifically, it may be HEVC (H.264, H.265)-based 8K-class realistic content. Of course, it can be applied to various levels of contents such as 60 to 120 FPS level contents, 120 to 240 FPS level contents, etc., as well as 120 FPS level contents.

The video content is then split into individual NAL units. (S20)

Next, DRM packaging is performed for each of the divided NAL units. (S30)
Specifically, each of the divided NAL units is decoded using a CABAC decoder. (S31) When the CABAC decoder decodes the NAL unit, five data are derived for each video frame. The derived data are QTC, general control data, intra-prediction data, filter control data and operational data.

Next, package the DRM metadata within the QTC data. (S32)

QTC data is selected from data derived as a result of decoding by a CABAC decoder, and DRM metadata and QTC data are XORed to some regions in the QTC data to perform DRM packaging.

The DRM metadata packaging step (S32) selects a YCbCr channel from among multiple channels present in each video frame, and selects some QTCs in the Y channel representing luminance from among the YCbCr channels. Then, an XOR operation is performed on at least one bitstream of the QTC of the Y channel and a bitstream of the DRM metadata in the corresponding position to perform DRM packaging.

Next, the DRM-packaged video frames are encoded by a CABAC encoder to generate DRM-packaged NAL units. (S33)

Next, a plurality of NAL units for which DRM packaging (decoding, packaging, encoding) has been completed are temporarily stored. (S40)

Next, the plurality of temporarily stored NAL units are aligned. (S50)

A sequence number unique to the NAL unit is used to align a plurality of NAL units for which DRM packaging has been completed. Alternatively, a flag for order identification is inserted in a predetermined area (eg, head area) of the NAL unit, and the NAL units are aligned using the inserted flag. Flag insertion may be performed at any step before step S40.

According to the DRM content parallel packaging method and the DRM content parallel packaging system according to an embodiment of the present invention, when performing DRM packaging of existing realistic content, While the required time and amount of calculation have increased, by arranging an appropriate number of DRM packaging modules in parallel and performing DRM packaging in parallel, the required time and amount of calculation are constant regardless of capacity. can be Therefore, efficient DRM packaging can be performed for large-capacity high-definition video content and 8K-class realistic content.

FIG. 12 is a diagram illustrating a computing device according to an embodiment of the invention. The computing device (TN100) of FIG. 12 may be a device described herein (eg, a DRM parallel packaging device, a DRM parallel packaging server, etc.).

In the embodiment of FIG. 12, computing device (TN100) may include at least one processor (TN110), transceiver (TN120), and memory (TN130). In addition, the computing device (TN100) may further include a storage device (TN140), an input interface device (TN150), an output interface device (TN160), and the like. The components included in the computing device (TN100) are connected by a bus (TN170) to communicate with each other.

The processor (TN110) can execute program commands stored in at least one of the memory (TN130) and the storage device (TN140). The processor (TN110) may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor in which the methods according to embodiments of the present invention are performed. can. Processor (TN 110) may be configured to implement the procedures, functions, methods, etc., described in connection with embodiments of the present invention. A processor (TN110) may control each component of the computing device (TN100).

Memory (TN130) and storage device (TN140) may each store various information related to the operation of processor (TN110). Each of the memory (TN130) and the storage device (TN140) may comprise at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory (TN 130) may comprise at least one of read only memory (ROM) and random access memory (RAM).

The transceiver (TN 120) can transmit or receive wired or wireless signals. A transceiver (TN 120) can be connected to a network to perform communication.

Alternatively, the present invention may be embodied as a computer program. The present invention may be embodied as a computer program stored in a computer-readable recording medium in combination with hardware to execute the DRM content parallel packaging method according to the present invention.

Methods according to embodiments of the present invention may be embodied in a program form readable by various computer means and recorded in a computer readable recording medium. Here, the recording medium can include program instructions, data files, data structures, etc., alone or in combination.

The program instructions recorded on the recording medium may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind known and available to those of skill in the computer software arts.

For example, recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CDROMs and DVDs, and magneto-optical media such as floptical disks. ), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of program instructions can include not only machine language, such as produced by a compiler, but also high-level language, which can be executed by a computer using, for example, an interpreter.

Such hardware devices may be configured to act as one or more software modules to perform the operations of the present invention, and vice versa.

An embodiment of the present invention has been described above, but those skilled in the art will be able to add or modify components without departing from the spirit of the present invention described in the scope of claims. , deletions, additions, etc., can be modified and changed in various ways, and these are also considered to be within the scope of the rights of the present invention.

Claims (8)

a NAL division module that divides a video content including a plurality of NAL units (Network Abstraction Layer Units) into individual NAL units;
A module that inserts a flag for order identification into a predetermined region of the NAL unit;
decoding each of a plurality of NAL units divided by the NAL division module using a CABAC decoder; packaging DRM metadata in QTC data extracted through decoding; a parallel packaging module for encoding NAL units for which data packaging has been completed;
the parallel packaging module is formed in parallel with a plurality of DRM packaging modules for packaging the DRM metadata for each of the plurality of divided NAL units;
Each of the DRM packaging modules includes:
decoding means for decoding the NAL unit using a CABAC decoder;
QTC data is selected from data derived as a result of decoding by the decoding means, and DRM packaging is performed by inserting a bitstream of the selected QTC data and a bitstream of DRM metadata. packaging means; and
encoding means for encoding the DRM-packaged NAL unit using a CABAC encoder;
A shared memory that temporarily stores a plurality of NAL units for which DRM packaging has been completed; a NAL alignment module that aligns the plurality of NAL units temporarily stored in the shared memory based on the inserted flag;
DRM content parallel packaging device. Said packaging means comprises:
At least one or more QTC bitstreams and DRM metadata bits among QTCs present in the Y channel representing luminance among the YCbCr channels included in the video frame representing the video image of the NAL unit 2. The DRM content parallel packaging apparatus of claim 1 , wherein DRM packaging is performed by performing an insertion operation on a stream. a communication unit that performs wired/wireless communication with a user terminal;
A NAL division module that divides a video content configured including a plurality of NAL units into individual NAL units, a module that inserts a flag for order identification into a predetermined area of the NAL unit, and the NAL division module. decoding the NAL unit using a CABAC decoder for each of a plurality of NAL units divided by, packaging DRM metadata in QTC data extracted through decoding, and DRM metadata packaging is a parallel packaging unit including parallel packaging modules for encoding completed NAL units;
The parallel packaging section includes:
A shared memory that temporarily stores a plurality of NAL units for which DRM packaging has been completed; a NAL alignment module that aligns the plurality of NAL units temporarily stored in the shared memory based on the inserted flag;
DRM Content Parallel Packaging Management Server. the parallel packaging module is formed in parallel with a plurality of DRM packaging modules for packaging the DRM metadata for each of the plurality of divided NAL units;
Each of the DRM packaging modules includes:
decoding means for decoding the NAL unit using a CABAC decoder;
QTC data is selected from data derived as a result of decoding by the decoding means, and DRM packaging is performed by inserting a bitstream of the selected QTC data and a bitstream of DRM metadata. packaging means; and
4. The DRM content parallel packaging management server of claim 3 , comprising encoding means for encoding the DRM packaged NAL units using a CABAC encoder. Said packaging means comprises:
At least one or more QTC bitstreams and DRM metadata bits among QTCs present in the Y channel representing luminance among the YCbCr channels included in the video frame representing the video image of the NAL unit 5. The DRM content parallel packaging management server of claim 4 , performing an insertion operation on streams for DRM packaging. performed by a computing device, the computing device
dividing a video content composed of a plurality of NAL units into individual NAL units;
inserting a flag for order identification into a predetermined region of the NAL unit;
Decoding each of the plurality of divided NAL units using a CABAC decoder;
packaging DRM metadata in QTC data among the data obtained through the decoding for each of the plurality of divided NAL units;
Encoding the NAL unit for which the DRM metadata packaging has been completed using a CABAC encoder for each of the plurality of divided NAL units ;
temporarily storing a plurality of NAL units for which DRM packaging has been completed;
aligning a plurality of temporarily stored NAL units based on the inserted flag;
A DRM content parallel packaging method, comprising: The step of packaging the DRM metadata includes:
QTC data is selected from the data derived in the decoding step, and DRM packaging is performed by inserting a bitstream of the selected QTC data and a bitstream of DRM metadata. The DRM content parallel packaging method according to claim 6 . The step of packaging the DRM metadata includes:
At least one or more QTC bitstreams and DRM metadata bits among QTCs present in the Y channel representing luminance among the YCbCr channels included in the video frame representing the video image of the NAL unit The DRM content parallel packaging method of claim 7 , wherein DRM packaging is performed by performing an insertion operation on streams.

Images