KR20020045133A - Apparatus, method and record device recoded program for controlling the play, input or output of multimedia contents using watermark - Google Patents

Abstract

PURPOSE: A device for controlling reproduction and input/output of multimedia contents using a watermark is provided to insert a watermark into the multimedia contents, and to control whether the multimedia is reproduced, inputted, or output from the extracted watermark, thereby previously intercepting illegal distribution of the multimedia contents. CONSTITUTION: A DRM(Digital Rights Management) decider(53) decides whether a DRM of MC(Multimedia Contents) is protected through an MC input unit(51), and decides whether the inputted MC for reproduction is protected by a header attached to the MC. If so, a decoder(54) decodes the MC by using a secret key. A decompression unit(55) decompresses the decoded MC or the inputted MC. A watermark detector and decider(56) detects a watermark inserted into the decompressed or the inputted MC, and decides whether the watermark is normal. A watermark inserter(57) inserts a watermark into the decompressed MC or the MC whose watermark is decided as normal. The watermark inserter inserts user information and DRM protection information into the MC protected by the DRM, and inserts user information into MC which is not protected by the DRM. A controller(52) decodes the MC protected by the DRM, and decompresses the MC, then inserts the watermark to reproduce the MC.

Description

Apparatus, method and record device recoded program for controlling the play, input or output of multimedia contents using watermark}

The present invention provides a recording medium on which an apparatus, method, and program for controlling illegally playing, input or output of multimedia content in advance and also being able to detect it after detection through detection of a watermark embedded in the multimedia content. It is about.

Digital Rights Management (hereinafter referred to as "DRM") protects various digital forms of multimedia contents such as music, video, electronic documents, and images delivered online or offline. New computing technology that continually ensures and manages the rights of publishers, service providers, governments and end users (copyrights, licenses, etc.).

Such DRM uses encryption techniques to sell and deliver secure multimedia contents in real time over a network. DRM enables the protection of information throughout the entire process of creating, distributing, using, and disposing of digital content, as well as protecting the use and rights of the user, both online and offline.

However, when the data released from the DRM is illegally copied, tampered with, or otherwise hacked, there is no measure for protecting the information. As an application of watermarking technology to protect intellectual property rights for contents, a method of inserting a watermark and then protecting it with DRM has been attempted. If these two copyright protection technologies are combined, more effective security for multimedia contents is achieved. This will be done.

The above method is mainly a measure for post-discovery when the contents released from DRM are hacked. This method is also a good measure in terms of protecting copyrights by applying watermarking technology, but it is illegal in advance. It is not possible to block the use of the in-media content, and there is also a great need to prevent illegal distribution after using the content released from the DRM.

In addition, various compression encoders and decoders are currently provided free or for a fee, so that data can be easily read from a storage medium such as a CD, a VCD, or a DVD. At this time, if the format of the data is changed, it can be used again in a PC or PD. Since this act is an infringement of copyright, there are many ways to prevent it, but an appropriate and reliable method is not provided.

In addition, the act of copying multimedia contents including a digital image protected by copyright from the input device again or outputting without permission from the output device again becomes a problem.

From this, in order to solve the above problem, the present invention inserts a watermark into the multimedia content under the premise that the quality of the digital multimedia content is not deteriorated. Another object of the present invention is to provide a recording medium on which devices, methods, and programs capable of blocking illegal distribution of multimedia content in advance or being caught in the future by controlling output or not.

In addition, the present invention particularly detects a watermark by reading data from a storage medium such as CD, VCD, DVD, etc. through a compression encoder and decoder, and then replaying the data on a PC or PD having a different storage medium by changing the compression format. And the provision of an apparatus and method for controlling in advance through discrimination.

In addition, an object of the present invention is to provide an apparatus and method for controlling an unauthorized copying of multimedia content from an input device or outputting without permission from an output device through detection of a watermark.

It is also an object of the present invention to provide a recording medium recording an apparatus, a method and a program for processing multimedia content that controls reproduction, input or output that can be properly protected as necessary.

1 is a block diagram illustrating an overall process of distributing and controlling multimedia content.

2 is a block diagram of an apparatus for processing multimedia content controlled by a content provider according to an embodiment of the present invention;

3 is a block diagram briefly illustrating a process of inserting a watermark according to an embodiment of the present invention;

4 is a block diagram illustrating a process of operating the apparatus of FIG. 2;

5 is a block diagram of an apparatus for controlling playback of multimedia content according to an embodiment of the present invention;

6 is a block diagram illustrating a process of operating the apparatus of FIG. 5;

7 is a block diagram illustrating a process of determining whether a watermark detected during the operation of FIG. 6 is normal;

8 is a block diagram of an apparatus for controlling playback by detecting a format conversion of multimedia content according to an embodiment of the present invention;

9 is a block diagram illustrating a process of operating the apparatus of FIG. 8;

10 is a block diagram of an apparatus for controlling input of input devices such as a copier, a scanner, and the like according to an embodiment of the present invention;

FIG. 11 is a block diagram illustrating a process of controlling whether input devices of FIG. 10 are input;

12 is a block diagram of an apparatus for controlling whether output devices such as a printer and a monitor are output according to an exemplary embodiment of the present invention.

FIG. 13 is a block diagram illustrating a process of controlling whether output devices of FIG. 12 are output.

<Explanation of symbols for the main parts of the drawings>

11: service provider 12: content consumer

13: content distributor 14: content provider

15: processing multimedia content creation software

16: multimedia content playback control software or chip

21: multimedia content production unit 22: control unit

23: watermark insertion unit 24: compression unit

25: encryption unit 26: processing multimedia content production unit

51: multimedia content input unit 52: control unit

53: DRM determination unit 54: decoder

55: decompression unit 56: watermark detection and discrimination unit

561: Watermark embedding bit detection and discrimination unit

562: Compression bit detection and discrimination unit

563: Compression enable bit detection and discrimination unit

564: DRM protection detection and determination unit

57: watermark insertion unit

58: multimedia content playback unit

In order to achieve the above object, the multimedia content processing device for controlling the reproduction, input or output of the present invention, a multimedia content production unit for producing a multimedia content for reproduction, input or output; At least one watermark inserting unit inserting a watermark into the multimedia content produced by the multimedia content producing unit; A compression unit compressing the multimedia content embedded with the watermark in the watermark inserting unit; An encryption unit for encrypting the watermark-embedded multimedia content to protect the watermark-embedded multimedia content with DRM; A processed multimedia content producing unit for processing the multimedia content in a state where the watermark is inserted or when the watermark is inserted and encrypted; And compressing the multimedia content by inserting and compressing a first watermark of a first watermark inserter into the multimedia content and then inserting or compressing a second watermark of the second watermark inserter. If not, the second watermark inserting unit inserts the second watermark into the multimedia content. If the DRM protects the watermark, the watermark is inserted into the multimedia content in the encrypted state. And a controller for controlling to process the multimedia contents into the inserted watermarks.

Preferably, the first watermark inserting unit inserts a watermark robust to the multimedia content, and the second watermark inserting unit inserts a soft watermark into the multimedia content.

In addition, the multimedia content processing method for controlling the reproduction, input or output of the present invention, whether to compress the multimedia content produced for playback, input or output is determined, and when compressing the first watermark to the multimedia content Inserting and compressing, and embedding a second watermark in the multimedia content when not compressing; Determining whether to insert the second watermark into the compressed multimedia content by inserting the first watermark, and inserting the second watermark when inserting the second watermark; and waiting to determine whether to insert the second watermark; And determining whether to protect the DRM of the multimedia content into which the watermarks are inserted, and if the DRM protects the DRM to produce the processed multimedia content by encrypting the multimedia content into which the watermarks are inserted. And producing the processed multimedia content with the marks inserted.

Preferably, the first watermark is a strong watermark, and the second watermark is a weak watermark.

In addition, a computer-readable recording medium having recorded thereon a program for processing multimedia content for controlling reproduction, input or output of the present invention is configured to execute the computer including the above method.

From this, the multimedia content processing apparatus, method and recording medium for controlling the reproduction, input or output of the present invention can process the watermark and DRM into multimedia contents that can be protected by appropriately selecting them as necessary. do.

In addition, in order to achieve the above object, the apparatus for reproducing multimedia content using the watermark of the present invention, the decompression unit for decompressing the multimedia content is inserted into the watermark input for reproduction; A watermark detection and discriminating unit for detecting a watermark inserted in the decompressed or uncompressed multimedia content and determining whether the detected watermark is normal; And a control unit which controls the multimedia content to be played only when the watermark detection and determination unit determines that the watermark is a normal watermark.

Preferably, the watermark detection and discrimination unit detects the watermark embedding bit of the watermark, and if the detected bit is 0, determines that it is normal, and if the detected bit is 1, detects the compressed bit of the watermark. Detect and determine a watermark embedding bit detection and discrimination unit, and detects the compression bit, and if the detected compression bit is 1, it is normal, and if the detected bit is 0, the compression bit detection and discrimination that detects the compression permission bit of the watermark. And a compression permission bit detection and discrimination unit for detecting the compression permission bit, determining that the detected compression permission bit is 0, and determining that the detected compression permission bit is not normal.

Preferably, the watermark detection and discrimination unit detects the DRM protection bit of the watermark, and if the detected bit is 0, determines that it is normal, and if the detected bit is 1, detects the DRM protection bit, and It further comprises a determination unit.

Preferably, the apparatus further includes a watermark inserting unit for inserting a user watermark, and if the watermark detected by the watermark detecting and determining unit is determined to be normal, inserting the user watermark and controlling to play the watermark. It is composed.

Preferably, the watermark detection and discriminating unit is configured to detect and discriminate the watermark embedding bit, the DRM protection bit, and the compression permission bit as a robust watermark, and detect and discriminate the compressed bit as a soft watermark.

In addition, the method of reproducing multimedia content using the watermark of the present invention may include detecting a watermark embedded in the multimedia content after decompression when the multimedia content into which the input watermark is inserted for reproduction is compressed. ; And determining whether the detected watermark is normal, and controlling to reproduce the multimedia content only when it is determined to be normal.

Preferably, whether or not the detected watermark is normal detects the watermark embedding bit of the watermark, and if the detected bit is 0, determines that the bit is normal, and if the detected bit is 1, compresses the compressed bit of the watermark. If the detected compression bit is 1, it is determined as normal. If the detected bit is 0, it is detected as a compression permission bit of the watermark. If the detected compression permission bit is 0, it is determined as normal. Is 1, it is configured to determine that it is not normal.

Preferably, the method further comprises detecting whether the detected watermark is normal by detecting a DRM protection bit of the watermark, determining that the detected bit is normal if the detected bit is 0, and determining that the detected watermark is not normal. It is configured by.

Preferably, when the detected watermark is determined to be normal, the method further includes controlling to play after inserting the user watermark.

Further, the computer-readable recording medium which records the program for controlling the reproduction of the multimedia content using the watermark of the present invention is configured to execute the computer including the above method.

From this, the illegal distribution of multimedia content is blocked in advance by controlling whether or not the watermark inserted into the multimedia content is reproduced by the apparatus, method and recording medium for controlling the multimedia content reproduction using the watermark of the present invention. In addition, a watermark is inserted before playback, and post-detection is also possible.

In addition, in order to achieve the above object, the apparatus for reproducing multimedia content using the watermark of the present invention, DRM determination unit for determining whether the DRM protection of the multimedia content input for reproduction; A decoder which decodes the multimedia content when it is determined that the DRM determination unit protects the DRM; A decompression unit configured to decompress the decoded multimedia content or the multimedia content in a state input for the reproduction; A watermark detection and discrimination unit for detecting a watermark inserted in the multimedia content in the input state for the decompressed or uncompressed playback, and determining whether the detected watermark is normal; A watermark insertion unit inserting a watermark into the decoded and decompressed multimedia content or the multimedia content in which the watermark detected by the watermark detection and determination unit is determined to be normal; And, when the multimedia content is protected by the DRM, decompresses and decompresses the multimedia content when the multimedia content is compressed, inserts and plays a watermark, and when the multimedia content is not protected by the DRM, the multimedia content is compressed. And a control unit which decompresses the control unit and controls to insert and reproduce the watermark when it is determined that the watermark is detected and determined as normal.

Preferably, the watermark inserting unit inserts user information and DRM protection information in the case of multimedia content protected by the DRM, and inserts user information in the case of multimedia content not protected by the DRM.

In addition, the method for reproducing multimedia content using the watermark of the present invention may determine whether to protect the DRM of the multimedia content inputted for reproduction, and if the DRM is decoded, the multimedia content is decoded and decompressed and the user is decompressed. Playing after inserting a watermark, and determining whether to compress the multimedia content when it is not protected by DRM; Determining whether the multimedia content is compressed, and if the multimedia content is compressed, decompressing the multimedia content and detecting a watermark embedded in the multimedia content; And determining whether or not the detected watermark is normal, and controlling to insert and reproduce the watermark only when it is determined to be normal.

Preferably, the inserted watermark information includes user information and DRM protection information in the case of the multimedia content protected by the DRM, and user information in the case of multimedia content that is not protected by the DRM.

Further, the computer-readable recording medium which records the program for controlling the reproduction of the multimedia content using the watermark of the present invention is configured to execute the computer including the above method.

From this, the multimedia content reproduction control apparatus, method and recording medium using the watermark of the present invention, by protecting the DRM and extracting and discriminating the watermark embedded in the multimedia content and controlling whether or not to reproduce the illegal content of the multimedia content Phosphorus distribution is blocked in advance, and a watermark is inserted before reproduction, so that it can be caught afterwards.

Further, in order to achieve the above object, the apparatus for reproducing multimedia content using the watermark of the present invention detects the watermark containing the format conversion control information embedded in the multimedia content input for reproduction, and detects the watermark. A watermark detection and discriminating unit for determining whether to convert the format from the format conversion control bit of the mark; And a control unit which controls playback if the bit detected and determined by the watermark detection and discrimination unit is 1, and stops when the detected and determined bit is 0.

Preferably, the watermark detection and discriminating unit is configured to detect and discriminate the format conversion control bit as a soft watermark.

In addition, the method for reproducing multimedia content using the watermark of the present invention detects a watermark containing format conversion control information embedded in the multimedia content input for reproduction, and formats the detected watermark from the format conversion control bit of the detected watermark. Determining whether to convert; And reproducing if the bit detected and determined in the step is 1, and controlling to stop if the bit is 0.

Preferably, the format conversion control bit is composed of a soft watermark.

From this, the apparatus and method for controlling reproduction of multimedia content using the watermark of the present invention reads out the legitimate multimedia content from the original storage medium, changes the compression format, and blocks the playback of the different storage medium in advance. It becomes possible.

In addition, in order to achieve the above object, the input or output control apparatus for multimedia content using the watermark of the present invention, the watermark detection unit for detecting a watermark embedded in the multimedia content received for input or output; And a controller for controlling input or output when the watermark is detected by the watermark detection unit.

In addition, the input or output control method of the multimedia content using the watermark of the present invention, detecting the watermark embedded in the multimedia content received for input or output; And controlling input or output when the watermark is detected in the step.

Thereby, the apparatus and method for controlling the input or output of multimedia content using the watermark of the present invention prevents unauthorized copying of copyright-protected multimedia content from the input device or outputting without permission from the output device in advance. It becomes possible.

EMBODIMENT OF THE INVENTION Hereinafter, it demonstrates in detail, referring drawings which attach this invention.

FIG. 1 is a block diagram illustrating an overall process of distributing and controlling multimedia contents (hereinafter, referred to as "MC"). The service provider 11 provides a service necessary for digital MC distribution in an electronic commerce. (SP: Service Provider), Content Consumer (12) who receives and consumes the MC from Content Distributor (13) and pays for it, and receives Processed MC from Content Distributor (14) Content Distributor (13) distributing online (CD: Content Distributor), Content Provider (14) (CP: Content Provider), Service Provider (11) to produce, produce and process MC and provide it to Content Distributor (13) From the processing MC production software 15 (SP_CP) provided by the content provider 14 from the service provider 11 and the MC playback control software or chip 16 (SP_CC) provided by the content consumer 12 from the service provider 11. It is.

The overall process of deploying and controlling MC is as follows.

The service provider 11 controls the reproduction, which is a technical tool, to the content provider 14 for processing for providing information security of MC data (processing by inserting secured information into data: embedding or encrypting a watermark, etc.). It provides software 15 for manufacturing the processed MC, and also provides the software or chip 16 for controlling the reproduction of multimedia content, which is a technical tool, to the content consumer 12 for the release of the secured information.

The content provider 14 uses the software 15 for producing a processed MC to control playback, and provides the processed MC to the content distributor 13 through a series of processes such as watermark insertion, compression, and encryption for the MC. To produce

In addition, in the device owned by the content consumer 12, the MC data received through the application is decoded, decompressed, watermark extracted, watermark discriminated, etc. using a software or a chip 16 that controls multimedia content playback. Play or stop via Here, encryption and decryption are steps that are executed only when DRM is used.

2 is a block diagram of an apparatus for processing multimedia content controlled by a content provider according to an exemplary embodiment of the present invention, which includes an MC producing unit 21, a control unit 22, a watermark inserting unit 23, and a compression unit. (24), the encryption unit 25, and the processing MC production unit 26.

The MC production unit 21 produces multimedia content in various forms for reproduction, input or output.

The watermark inserting unit 23 inserts one or more watermarks into the MC produced by the MC producing unit 21. As shown in FIG. 3, the watermark embedding algorithm is largely a watermark designing unit 31. And a watermark inserting unit 32. The watermark design unit 31 easily removes the watermark information even if a strong watermark or a minute distortion is applied, which is a watermarking method capable of extracting the watermark information still inserted into any distortion according to each algorithm. Create a fragile watermark, which is a watermarking method. The generated watermark should be inserted in a specific area that cannot be visually and audibly detected in the multimedia content. This process is realized by the watermark embedding unit 32. The watermark inserting unit 32 inserts a strong watermark or a soft watermark generated by the watermark design unit 31.

Therefore, a strong watermark is inserted and compressed into the multimedia content, a soft watermark is inserted in the compressed state by inserting a strong watermark, or a watermark is inserted into a soft watermark.

The compression unit 24 compresses the multimedia content in which the watermark inserted by the watermark embedding unit 23 is inserted.

The encryption unit 25 encrypts the watermark-embedded multimedia content to protect the watermark-embedded multimedia content by DRM.

The processed MC production unit 26 may be one of the MC or the water of the MC in which the strong watermark is inserted or compressed, the soft watermark is inserted in the compressed state of the strong watermark, or the soft watermark is inserted. Marks are inserted and processed into encrypted MC.

When the MC is compressed, the controller 22 inserts and compresses the strong watermark of the first watermark inserter into the MC, and controls not to insert or insert the soft watermark of the second watermark inserter. .

In addition, when the MC is not compressed, a control is made to insert a soft watermark of the second watermark inserter into the MC.

Next, in the case of DRM protection, the watermarks are inserted and processed into an MC in an encrypted state, and when not protected by DRM, the watermarks are processed into an MC in the inserted state.

Therefore, it is possible to process by inserting a watermark into the MC, or by adding DRM to the MC into which the watermark is embedded.

4 is a flowchart illustrating a process of operating the apparatus of FIG. 2.

The copyright holder such as a painter, a singer, an actor, and the like ask a multimedia producer to digitally process a picture, a song, or a content of a performance owned by the creator, and produce an MC for playing, inputting, or outputting (S401).

It is determined whether or not the MC produced for reproduction, input or output is compressed (S402).

As a result of the determination, when compressing, a watermark that is robust to the MC is inserted (S403) and compressed. (S404)

The strong watermark is inserted to determine whether a soft watermark is inserted into the compressed multimedia content (S405). If a soft watermark is inserted, the soft watermark is inserted (S406).

As a result of the above determination, when no compression is performed, a soft watermark is inserted into the MC. (S406)

It is determined whether or not the DRM protection of the MC with the watermarks inserted (S407), and when the DRM protection is protected to encrypt the MC with the watermarks inserted (S408). Managed by (11) and transmitted to the content provider 14 as requested when the service is provided.

If the DRM is protected, the processed MC is encrypted by inserting the watermarks inserted therein (S408), and the processed MC is produced (S409). If the DRM is not protected by the DRM, the processed MC is produced with the watermarks inserted therein. (S409),

As such, a secure and machined MC is created in several stages. The processed MC is managed and distributed by the content distributor 13 according to the user's demand.

Further, as shown in the flowchart of FIG. 4, a computer is executed through a computer-readable recording medium on which a program for processing multimedia content is recorded to control whether reproduction, input, or output of the present invention is performed.

In order to control the reproduction, input or output as described above, a computer-readable recording medium recording a program for processing multimedia contents includes optical recording media (CD, CD-R, CD-RW), floppy disk, hard disk, Zip discs are included. Furthermore, not only a computer-readable recording medium which records a program executable directly by a computer, but also a recording medium on which a program such as that which can be executed by installing on another recording medium (hard disk, etc.), is encrypted or compressed. Also included is a recording medium on which recorded programs have been recorded.

5 is a block diagram of an apparatus for controlling playback of multimedia content according to an embodiment of the present invention, wherein the MC input unit 51, the control unit 52, the DRM determination unit 53, the decoding unit 54, and the decompression unit are shown. 55, a watermark detection and discriminating unit 56, a watermark embedding unit 57, and an MC reproducing unit 58. As shown in FIG.

The DRM determination unit 53 determines whether to protect the DRM of the MC input through the MC input unit 51 for reproduction. The DRM determination unit 53 determines whether the MC is protected by the DRM by a header attached to the MC and transmitted.

The decryption unit 54 decrypts the MC using the transmitted secret key when the DRM determination unit 53 determines that the DRM protection unit 53 is protected by the DRM.

The decompression unit 55 decompresses the decoded MC or the MC in the input state for reproduction.

The watermark detection and discriminating unit 56 detects the watermark inserted in the MC in the input state for the decompressed or uncompressed playback, and determines whether the detected watermark is normal.

In the present invention, a plurality of contents control data (CCD) are included in a watermark, and the MC bit is detected and controlled to detect and control the CCD bits.

That is, as the watermark embedding data (CCD_R1: CCD_Robust watermark 1), the bit value is set to 0 for the existing MC and 1 for the MC protected by the watermark.

In addition, as DRM protected data (CCD_R2: CCD_Robust watermark 2), it is included in the watermark as 1 for MC protected by DRM and 0 for unprotected MC.

In addition, the compressed data (CCD_F: CCD_Fragile watermark) is included in the watermark as 1 for uncompressed MC and 0 for compressed MC.

In addition, the compression allowed data (CCD_R3: CCD_Robust watermark 3) is included in the watermark as 1 when the MC is allowed to be compressed and 0 when the MC is not allowed to be compressed.

From this, the watermark embedding bit detection and discriminating unit 561 of the watermark detecting and discriminating unit 56 detects the watermark embedding bit (CCD_R1) of the watermark, and if the detected bit is 0, it is normal. If the detected bit is 1, the compressed bit of the watermark is detected.

The compression bit detection and determination unit 562 detects the compression bit CCD_F, and if the detected compression bit is 1, determines that it is normal, and if the detected bit is 0, the compression permission bit of the watermark is detected.

The compression permission bit detection and determination unit 563 detects the compression permission bit CCD_R3, and if the detected compression permission bit is 0, determines that it is normal, and if the detected bit is 1, it determines that it is not normal.

The DRM protection bit detection and determination unit 564 detects the DRM protection bit CCD_R2 of the watermark and determines that the detected bit is 0 if it is normal, and if the detected bit is 1, it is not normal.

The watermark embedding bit (CCD_R1), the DRM protection bit (CCD_R2), and the compression permission bit (CCD_R3) are detected and discriminated as a strong watermark, and the compressed bit (CCD_F) is detected and discriminated as a soft watermark.

The watermark inserting unit 57 inserts the watermark into the MC which has been decoded and decompressed or the MC whose watermark detected by the watermark detection and discriminating unit 56 is determined to be normal.

The watermark inserting unit 57 inserts user information and DRM protection information in the case of the MC protected by the DRM, and inserts user information in the case of the MC which is not protected by the DRM.

In the case of the MC protected by the DRM, the control unit 52 controls to decompress the MC when the MC is compressed and insert the watermark to reproduce the watermark.

In the case of the MC that is not protected by the DRM, when the MC is compressed, the compression is decompressed, and when it is determined that the watermark is detected as a result of the watermark detection, the control is performed to insert and reproduce the watermark.

6 is a flowchart illustrating a process of operating the apparatus of FIG. 5.

When the content consumer 12 determines whether to play the MC received from the content distributor 13 (S601), even if the dedicated playback device, the MC protected by DRM confirms and plays it, and the MC not protected by DRM is legal. Only MC should be played. For this reason, it is first determined whether or not the content is protected by DRM by the header of the MC (S602).

First, the MC protected by the DRM decrypts using the transmitted secret key. (S603)

The decompressed MC is decompressed if it is compressed (S604) (S605) and then a watermark is inserted (S606). The purpose of embedding the watermark is to consider the possibility that the user illegally distributes the MC. The purpose is to insert the user's unique information into the watermark.

For example, when the user receives the MC from the sound card or the graphics card of his PC and distributes the MC, the distributor can be determined from the watermark in which the user information is inserted. In addition, the DRM protection data may be inserted together to block the reproduction of the MC released from the DRM.

The watermark is reproduced in the inserted state. (S612)

Next, when the MC is not protected by the DRM, without performing the decoding process, it is determined whether the MC is compressed (S607), and if it is compressed, the compression is released. (S608) Various compression decoders are used to decompress. Is supported.

The decompressed MC extracts and determines the watermark (S609). In this process, whether or not the MC is reproduced is a central part of the present invention. The process of determining whether to play is a process of determining whether or not to be a legitimate MC, so that the illegal MC is not played.

As shown in Fig. 7, the watermark is specifically determined to determine whether to play or stop by checking whether the CCD bit of the watermark inserted into the MC to be reproduced is content that can be played back normally.

If the MC is accepted by the playback apparatus for playback (S701), first, CCD_R1 is detected to determine whether the content is existing (S702). If the detected bit is 0, it is determined that the existing content is normal, and if the detected bit is 1, it is determined as a new MC for which a new service is provided (S703).

If CCD_R2 is 1, it is MC protected by DRM. In this case, it is determined that encryption may have been hacked after being decrypted and is not normal. If CCD_R2 is 0, CCD_F is detected because it is not DRM protected content (S704).

If CCD_F is 1, it is determined that compression is not possible, and if CCD_F is 0, it is determined that MC is compressed. Therefore, it is necessary to verify whether compression is allowed (S705).

If the CCD_R2 is 1, the MC is not allowed to be compressed. Therefore, it is regarded as an illegal MC and is determined to be non-normal.

Only in the case of the MC determined to be normal, the user watermark is inserted and reproduced (S611). (S612)

Further, as shown in the flowcharts of FIGS. 6 and 7, a computer is executed through a computer-readable recording medium on which a program for controlling reproduction of multimedia content using the watermark of the present invention is recorded.

The apparatus, method and program for controlling the reproduction of the multimedia content using the watermark described above may include a computer-readable recording medium including a portable device (PD), a personal digital assistant (PDA), a mobile phone, a PC, It prevents illegal MC playback in advance by installing or applying to devices such as laptops. It is explained that watermark and DRM protect MC at the same time. However, watermark alone can control whether MC is played or not. After detection and discrimination, the user's watermark may be reproduced without inserting.

In particular, the present invention can effectively prevent the data of a storage medium such as a CD, a VCD, a DVD, and the like from being changed through a illegal recording and then being changed and distributed.

FIG. 8 is a block diagram of an apparatus for controlling playback by detecting a format conversion of multimedia content according to an embodiment of the present invention, which includes a watermark detection and discrimination unit 83 and a control unit 82.

The watermark detection and discriminating unit 83 detects a watermark containing format conversion control information inserted into the MC input for reproduction, and determines whether or not to format conversion from the format conversion control bits of the detected watermark.

The control unit 82 controls reproduction if the bit detected and determined by the watermark detection and determination unit 83 is 1, and stops if the detected and determined bit is 0.

That is, if the watermark is detected from the MC into which the soft watermark is inserted as the format control information fragment (FCI_F), the data format does not change. If the watermark is not detected, the data format changes. By discriminating 0, it is possible to reproduce normally only when the FCI_F is detected, thereby effectively preventing distribution due to illegal copying.

9 is a flowchart illustrating a process of operating the apparatus of FIG. 8.

The watermark of FCI_F, which is information for controlling the format conversion inserted in the MC S91 to be protected by the copyright holder, is detected (S92).

The watermark is detected, and if the corresponding bit is detected, the watermark is reproduced as not attacked (S93).

However, if the corresponding bit disappears, the illegal user encodes in another compressed format and illegally distributes it, thereby stopping playback (S94).

In this case, since the relevant information is detected during playback, a method of stopping playback from that time is used. This is because the watermark information must be selectively inserted in a specific part in the process of inserting the watermark information into the MC.

In addition, the multimedia playback control device using the watermark of the present invention can be applied to computer peripheral devices such as an input device and an output device.

FIG. 10 is a block diagram of an apparatus for controlling input of multimedia contents by input devices such as a copy machine and a scanner, according to an exemplary embodiment of the present invention. The apparatus includes a watermark detector 103 and a controller 102. In the present embodiment, a digital image of various types of multimedia contents will be described as an example.

The watermark detection unit 103 detects a watermark embedded in a digital image received for input. If the copy and scan control information (CSCI) is inserted as a watermark, the watermark detection unit 103 is 1 as a protected digital image, If it is not inserted as a watermark, it is 0 as an unprotected digital image.

When the watermark detection unit 103 detects the CSCI as a watermark, the control unit 102 controls the input to an input device such as a scanner or a copy machine.

FIG. 11 is a flowchart illustrating a process of controlling whether input devices of FIG. 10 input multimedia content.

When the copyright holder receives the digital image S111 to be protected by an input device such as a copy machine or a scanner, the watermark detection unit 103 detects and extracts a watermark of CSCI, which is information for controlling an input inserted into the digital image. (S112)

As a result of the detection, if CSCI is 0, copying or scanning is normally operated (S114). If CSCI is 1, the input is canceled to stop copying or scanning for protection of the copyright holder (S115).

In fact, if you copy an image with a watermark embedded on it, nothing is printed on the copy paper, only white paper is printed out, and the scanner cannot obtain any images as well. This is an effective way to make distribution possible only with the permission of the copyright holder for important and easily forged images.

FIG. 12 is a block diagram of an apparatus for controlling output of multimedia content by an output device such as a printer or a monitor according to an exemplary embodiment of the present invention, and includes a watermark detector 123 and a controller 122. In the present embodiment, a digital image of various types of multimedia contents will be described as an example.

The watermark detection unit 123 detects a watermark embedded in a digital image received for output. When the printer and monitor control information (PMCI) is inserted as a watermark, the watermark detection unit 123 is 1 as a protected digital image, and PMCI is added. If it is not inserted as a watermark, it is 0 as an unprotected digital image.

When the watermark detection unit 123 detects the PMCI as a watermark, the control unit 122 controls the output to the output device such as a printer and a monitor.

FIG. 13 is a flowchart illustrating a process of controlling whether the output devices of FIG. 12 output multimedia content.

When the copyright holder receives the digital image S131 to be protected by an output device such as a printer or a monitor, the watermark detection unit 123 detects and extracts the watermark of PMCI, which is information for controlling the output inserted into the digital image. (S132)

As a result of the detection, if PMCI is 0, printing or screen display is normally operated (S134), and if PMCI is 1, the output is canceled to stop printing or screen display for protection of the copyright holder (S115).

Although embodiments of input devices such as scanners and copiers, output devices such as printers and monitors are described for inputting or outputting digital images, input or output for all multimedia contents in various forms including digital images are described. Of course, controllability is possible.

As such, by inserting a watermark into various types of multimedia contents, and detecting and using the watermark, the multimedia contents can be controlled by various devices, so that the protected multimedia contents are not accepted by peripheral devices and devices even if they are illegally copied and distributed. Otherwise, it will become useless and there will be no place for the illegally distributed contents. Therefore, copying digital multimedia content protected by a watermark becomes meaningless.

As described in detail above, the present invention suggests that the application concept of the existing watermark was a concept of post-discovery, but can also be used as a concept of proactive prevention. In other words, the effect of embedding watermark in digital multimedia contents is not only the concept of detecting any illegal use after the data has been distributed or used, but also the right to know whether the data can be used in advance. It is to adjust according to whether or not.

Therefore, in the present invention, by pre-authorizing the reproduction, input or output of the multimedia content in accordance with the authority in advance to prevent illegal use to induce the use of the legitimate content, thereby ensuring the business of the content provider, high quality content It can be made possible.

In addition, the present invention can be used as a means to protect the DRM-protected multimedia content when released from the DRM, as well as a more complete copyright protection solution through complementary interaction with the DRM for the content not protected by the DRM Can be provided.

Up to now, preferred embodiments of a control device, method, etc. for playing multimedia content using watermarks according to the present invention have been disclosed and described, but for those skilled in the art, such embodiments are for illustrative purposes only. It will be apparent that various modifications, changes, substitutions and substitutions can be made without departing from the scope of the spirit of the present invention. In addition, it is to be understood that the technical spirit of the present invention is not limited to the above-described embodiments, but only by the appended claims and equivalent technical principles.

Claims (27)

A multimedia content producing unit for producing multimedia content for reproduction, input or output; At least one watermark inserting unit inserting a watermark into the multimedia content produced by the multimedia content producing unit; A compression unit compressing the multimedia content embedded with the watermark in the watermark inserting unit; An encryption unit for encrypting the watermark-embedded multimedia content to protect the watermark-embedded multimedia content with DRM; A processed multimedia content producing unit for processing the multimedia content in a state where the watermark is inserted or when the watermark is inserted and encrypted; And, In the case of compressing the multimedia content, after inserting and compressing the first watermark of the first watermark inserting part into the multimedia content, the second watermark of the second watermark inserting part is not inserted or inserted and is not compressed. In the case of inserting the second watermark of the second watermark insertion unit into the multimedia content, if the DRM protection, the watermark is inserted into the encrypted multimedia content to process, if not protected by the DRM And a controller for controlling processing of the multimedia contents into the inserted watermarks. The method of claim 1, The first watermark inserting unit inserts a watermark robust to the multimedia content, And the second watermark inserting unit controls whether to play, input, or output a soft watermark into the multimedia content. It is determined whether or not to compress the multimedia content produced for playback, input or output, and when the compression is compressed by inserting a first watermark to the multimedia content, and if not compressed to insert a second watermark into the multimedia content step; Determining whether to insert the second watermark into the compressed multimedia content by inserting the first watermark, and inserting the second watermark when inserting the second watermark; and waiting to determine whether to insert the second watermark; And, If the DRM protection of the multimedia content in which the watermarks are inserted is protected by DRM, the processed multimedia content is produced by encrypting the multimedia content in which the watermarks are embedded, and the watermarks are not protected by DRM. Producing a processed multimedia content in an inserted state; Multimedia content processing method for controlling whether to play, input or output including. The method of claim 3, wherein The first watermark is a strong watermark, And the second watermark controls whether to play, input, or output a soft watermark. Computers to process multimedia content to control playback, input or output, It is determined whether or not to compress the multimedia content produced for playback, input or output, and when the compression is compressed by inserting a first watermark to the multimedia content, and if not compressed to insert a second watermark into the multimedia content step; Determining whether to insert the second watermark into the compressed multimedia content by inserting the first watermark, and inserting the second watermark when inserting the second watermark; and waiting to determine whether to insert the second watermark; And, If the DRM protection of the multimedia content in which the watermarks are inserted is protected by DRM, the processed multimedia content is produced by encrypting the multimedia content in which the watermarks are embedded, and the watermarks are not protected by DRM. Comprising a step of producing a multimedia content processed in the inserted state; computer-readable recording medium recording a program to be executed. A decompressor configured to decompress the multimedia content in which the watermark inputted for reproduction is compressed; A watermark detection and discriminating unit for detecting a watermark inserted in the decompressed or uncompressed multimedia content and determining whether the detected watermark is normal; And, And a controller which controls the multimedia content to be played back only when the watermark detection and determination unit determines that the watermark is a normal watermark. The method of claim 6, The watermark detection and determination unit, A watermark embedding bit detection and discriminating unit for detecting a watermark embedding bit of the watermark and determining that the detected bit is 0 if normal, and detecting the compressed bit of the watermark if the detected bit is 1; A compressed bit detection and discriminating unit for detecting the compressed bit and determining that the detected compressed bit is 1 if normal, and detecting the compressed allowed bit of the watermark if the detected bit is 0; Playback of multimedia content using a watermark including a compression permission bit detection and determining unit which detects the compression permission bit and determines that the detected compression permission bit is 0, and determines that the detected compression permission bit is not normal. controller. The method of claim 7, wherein The watermark detection and determination unit, The multimedia content using the watermark further comprises a DRM protection bit detection and determining unit for detecting the DRM protection bit of the watermark, and if the detected bit is 0, and if the detected bit is 1 is not normal Playback control device. The method according to any one of claims 6 to 8, Further comprising a watermark inserting unit for inserting a user watermark, The control unit, And a watermark detected by the watermark detection and determination unit as normal, inserting and reproducing the user watermark, and controlling the reproduction of the multimedia content using the watermark. The method according to claim 7 or 8, The watermark detection and determination unit, And a watermark for detecting and discriminating the watermark embedding bit, the DRM protected bit, and the compression allowable bit as a robust watermark, and detecting and discriminating the compressed bit as a soft watermark. Detecting a watermark embedded in the multimedia content after decompressing the multimedia content in which the watermark input for reproduction is compressed; And determining whether the detected watermark is normal, and controlling to reproduce the multimedia content only when it is determined to be normal. The method of claim 11, Whether the detected watermark is normal is Detecting a watermark embedding bit of the watermark, determining that the detected bit is 0 if normal, and detecting the compressed bit of the watermark if the detected bit is 1, If the detected compression bit is 1, it is determined to be normal. If the detected bit is 0, the compression permission bit of the watermark is detected. And determining that the detected compression allowed bit is 0 when the detected compression allowable bit is 0, and determining that the detected compression bit is 1 when it is not normal. The method of claim 12, Whether the detected watermark is normal is Detecting the DRM protection bit of the watermark, determining that the detected bit is 0 if the detected bit is 0, and determining that the detected bit is 1 if it is not normal. The method according to any one of claims 11 to 13, And if the detected watermark is determined to be normal, controlling to play after inserting the user watermark. Set the computer to control whether or not the multimedia content with watermark is Detecting a watermark embedded in the multimedia content after decompressing the multimedia content in which the watermark input for reproduction is compressed; And, And determining whether the detected watermark is normal, and controlling to reproduce the multimedia content only when it is determined to be normal. The computer-readable recording medium having recorded thereon a program to be executed. The method of claim 15, Whether the detected watermark is normal is Detecting a watermark embedding bit of the watermark, determining that the detected bit is 0 if normal, and detecting the DRM protection bit of the watermark if the detected bit is 1, If the detected bit is 1, it is determined that it is not normal. If the detected bit is 0, the compressed bit of the watermark is detected. If the detected compression bit is 1, it is determined to be normal, and if the detected bit is 0, the compression permission bit is detected. And determining that the detected compression allowed bit is 0 when the detected compression allowable bit is 0, and determining that it is not normal when the detected bit is 0. 1. A DRM determination unit for determining whether to protect the DRM of the multimedia content inputted for reproduction; A decoder which decodes the multimedia content when it is determined that the DRM determination unit protects the DRM; A decompression unit configured to decompress the decoded multimedia content or the multimedia content in a state input for the reproduction; A watermark detection and discrimination unit for detecting a watermark inserted in the multimedia content in the input state for the decompressed or uncompressed playback, and determining whether the detected watermark is normal; A watermark insertion unit inserting a watermark into the decoded and decompressed multimedia content or the multimedia content in which the watermark detected by the watermark detection and determination unit is determined to be normal; And, In the case of the multimedia content protected by the DRM, the multimedia content is decoded and decompressed when compressed, and the watermark is inserted and played. In the case of the multimedia content that is not protected by the DRM, the multimedia content is compressed. And a control unit releasing the watermark and controlling to play the watermark after inserting the watermark when it is determined that the watermark is detected and determined as normal. The method of claim 17, The watermark inserting unit, In the case of multimedia content protected by the DRM, user information and DRM protection information are inserted. Device for controlling playback of multimedia content using a watermark to insert user information in the case of multimedia content not protected by the DRM. Determining whether the multimedia content inputted for playback is protected by DRM, and when the multimedia content is protected by DRM, the multimedia content is decoded and compressed and then decompressed and inserted by a user watermark, and when the multimedia content is not protected by DRM. Determining whether the multimedia content is compressed; Determining whether the multimedia content is compressed and detecting a watermark inserted in the multimedia content after decompressing the multimedia content; And determining whether the detected watermark is normal, and controlling to play after inserting the watermark only when it is determined to be normal. The method of claim 19, The inserted watermark information, In the case of multimedia content protected by the DRM, the information is user information and DRM protection information. In case of multimedia content not protected by the DRM, a method of controlling playback of multimedia content using a watermark as user information. Set your computer to control whether or not your multimedia content Determining whether the multimedia content inputted for playback is protected by DRM, and if the multimedia content is protected by DRM, the multimedia content is decoded and decompressed when compressed and inserted after decompression and watermark, and when the multimedia content is not protected by DRM. Determining whether the content is compressed; Determining whether the multimedia content is compressed, and if the multimedia content is compressed, decompressing and detecting a watermark embedded in the multimedia content; And, And determining whether the detected watermark is normal, and controlling to insert and reproduce the watermark only when it is determined to be normal. The computer-readable recording medium having recorded thereon a program to be executed. A watermark detection and discrimination unit for detecting a watermark containing format conversion control information inserted into the multimedia content inputted for reproduction, and determining whether to convert the format from the format conversion control bits of the detected watermark; And, And a controller for reproducing when the bit detected and determined by the watermark detection and discrimination unit is 1, and stopping when the detected and determined bit is 0. 2. The method of claim 22, The watermark detection and determination unit, And a watermark for detecting and discriminating the format conversion control bit as a soft watermark. Detecting a watermark containing format conversion control information embedded in the input multimedia content for reproduction, and determining whether to convert the format from the format conversion control bits of the detected watermark; And, And controlling to stop playback if the bit detected and determined in the step is 1 and stop if it is 0. The method of claim 24, And the format conversion control bit is a soft watermark. A watermark detector for detecting a watermark embedded in the multimedia content received for input or output; And, And a controller for controlling input or output when the watermark is detected by the watermark detection unit. Detecting a watermark embedded in the multimedia content received for input or output; And, And controlling input or output when the watermark is detected in the step.