KR101809086B1 - System for Suppling and Authenticating Digital Contents using Real Time Image Watermarking Technic - Google Patents

Abstract

A system for supplying and authenticating digital contents according to the present invention includes: a digital contents providing device for combining a QR code, which includes member identification information and is formed to have transparency of 95 to 99%, with a webtoon image in an m x n matrix where m and n are natural numbers and supplying the webtoon image combined with the QR code to a webtoon user when the webtoon image is requested by the webtoon user; and a digital contents authenticating device for extracting identification information of an illegal leakage member who illegally leaked the corresponding digital contents from the extracted QR code after extracting the QR code from the combined image in which the QR code is combined with the webtoon image in the m x n matrix where m and n are natural numbers. Accordingly, the present invention can maintain a small server capacity and a small resource load.

Description

Technical Field [0001] The present invention relates to a digital content providing and authentication system using a real-time image watermarking technique,

The present invention relates to a digital content providing and authentication system using a real-time image watermarking technique, and in particular, a QR code including member identification information is derived in real time, and a QR code image and a webtoon image are combined in real- To a digital content providing and authentication system using a real-time image watermarking technology provided to a webtootuser.

Recently, the digital contents industry has developed remarkably due to the development of the Internet. As the digital contents industry develops, side effects such as illegal copying and unauthorized distribution of digital contents are also occurring.

In other words, copyright protection of digital contents is hardly achieved, such as illegally copying digital contents after downloading them, and sharing replicated digital contents with a large number of people on the Internet.

Generally, technologies for securing digital contents include data encryption (Data Encryption), digital watermarking (digital water marking), and system security device by hardware / software.

 Data encryption scrambles data by using keys and algorithms such as a secret key algorithm (Public Key Algorithm) or a public key algorithm (Public Key Algorithm) so that only a person having an encryption key can decrypt the encrypted data.

However, the data encryption technology has a problem that after the encrypted digital content is decrypted by a legitimate user, the content can not be prevented from being illegally copied and distributed.

This has led to the emergence of watermarking techniques that can be used to verify ownership in legal disputes over ownership of digital content.

Watermarking is a technique for inserting logos or authentication information inherent in the copyright company into a multimedia product for the purpose of authentication or copyright protection. With this technique, data forgery and deformation can be detected and the owner of the data can be identified.

However, in the Webtoon service, there is no technique of inserting a watermark or detecting an outflower that illegally leaks digital contents based on the watermark.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for extracting a QR code including member identification information in real time and adjusting the size and arrangement of a QR code image according to the size of a Webtoon image, And to provide a digital content providing and authentication system using the real-time image watermarking technology which can provide the webtoot users with accurate personal information of the illegal expatters based on the information.

In order to achieve the object of the present invention, according to the present invention, when a webtoot image is requested by a webtoot user, the QR code including member identification information and having transparency of 95% to 99% is mxn (m and n And a digital content providing device for combining the QR code with a webtoot image and providing the webtoot image combined with the QR code to the webtoot user.

According to the present invention, the digital content providing apparatus may further include: a request receiving unit receiving a webtoon image request signal from the webtoot user; An original image storage unit storing an original image of the webtoon image; A member information database storing member identification information of the webtootuser; An encrypting unit for extracting and encrypting the member identification information of the member requesting the webtoon image from the member information database when the request receiving unit receives the webtoon image request signal; A QR code generation unit for generating a QR code including member identification information by using the data encrypted by the encryption unit; An original image loading unit for loading an original image of the Webtoon image requested by the request receiving unit from the original image storage unit and extracting size information of the loaded original image when the request receiving unit receives the webtoon image request signal; A QR code image adjustment unit adjusting the data area of the QR code to have a transparency of 95% to 99% and adjusting the image size of the QR code to match the original image size transmitted from the original image loading unit; And a QR code transmitted from the QR code image control unit is combined with an original image loaded in the original image loading unit in an array of mxn (where m and n are natural numbers), and a combined image obtained by combining the QR code and the original image And an image combining unit for transmitting the image to the user.

According to the present invention, a QR code is extracted from a combined image in which a QR code is arranged in a matrix of m × n (m and n are natural numbers) in a Webtoon image, and then an illegal outflow And a digital content authentication device for extracting the member identification information.

According to the present invention, the digital content authentication apparatus may further include photographing means for photographing a combined image displayed on a site illegally leaking the webtoon image to obtain a screen image; An image modulator for black-and-white modulating a screen image captured and obtained by the imaging means, wherein the image modulator modulates the webtoon image and the QR code into different colors; A QR code extracting unit for extracting a QR code from a screen image modulated by the image modulating unit; And a decoding unit decoding the QR code extracted by the QR code extracting unit to extract member identification information included in the QR code.

According to the present invention, the image modulating unit sets the reference gray level to a value larger than the gray of the QR code when the QR code is inserted into the background image of the black web-toon image, modulates the QR code image to white, , And when a QR code image is inserted into the background image of a white webtoon image, the reference gray level is set to a value smaller than the gray of the QR code so that the QR code image is modulated to black and the background of the webtoon image is modulated to white .

According to the present invention, the QR code extracting unit extracts only one QR code in which damage is not generated among m × n (m and n are natural numbers) QR codes included in the screen image.

According to the present invention, the QR code extracting unit is characterized by extracting a QR code by combining only the QR codes of the portions where there is no damage when all of m Q (both m and n are natural numbers) codes are damaged .

According to the present invention, when a webtoot image is requested by a webtoot user, the QR code including membership identification information and having transparency of 95% to 99% is m × n (m and n are natural numbers) A digital content providing device for providing the webtoot image combined with the QR code to the webtoot user; And extracting a QR code from a combined image in which the QR code is arranged in a matrix of mxn (m and n are natural numbers) in the Webtoon image, and then extracting the illegally extracted member identification information illegally leaked from the extracted QR code And a digital content authentication device for extracting the digital content.

In this invention, when a webtoot user requests a webtoon content, watermarking including member identification information is inserted in the original webtootage image in real time, so that watermarking does not individually store the inserted webtootage image, There is an advantage to keep.

In addition, since a plurality of watermarking is inserted in the original webtoon image so as to be arranged in a matrix of mxn (m and n are natural numbers), even if some watermarking is damaged, only a normal portion of a plurality of watermarking can be extracted Since it is possible to accurately identify a member illegally leaking the Webtoon image, it is possible to protect the copyright of the digital contents by applying sanctions such as legal action or account blocking for the first leaker.

1 is a view showing a digital content providing and authentication system using a real-time image watermarking technique according to an embodiment of the present invention.
2 is a diagram showing an original webtoon image provided in a digital content providing system.
FIG. 3 is a diagram illustrating a situation where a QR code is inserted into a 2 × 4 matrix in the original WebtoTun image shown in FIG. 2 when the image size of the QR code is smaller than the size of the webtoon image.
4 is a diagram illustrating a situation where a QR code is inserted into a 1 × 3 matrix on the original WebtoTun image shown in FIG. 2 when the image size of the QR code is larger than the size of the webtoon image.
5 is a diagram showing a state in which the original WebtoTun image shown in FIG. 2 is black-modulated.
6 is a diagram illustrating a black and white modulation process when the background color of the Webtoon image is black.
7 is a diagram illustrating a black and white modulation process when the background color of the Webtoon image is white.
8 is a diagram showing a state in which all the QR codes inserted in the original WebtoTun image are damaged.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following detailed description of the operation principle of the preferred embodiment of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the gist of the present invention unnecessarily obscure.

FIG. 1 is a view showing a digital content providing and authentication system using a real-time image watermarking technique according to an embodiment of the present invention. FIG. 2 is a diagram showing an original webtoon image provided in a digital content providing system, FIG. 4 is a diagram showing a situation where a QR code is inserted into a 2 × 4 matrix on the original WebtoTun image shown in FIG. 2 when the image size of the code is smaller than the size of the Webtoon image. FIG. The QR code is inserted into the original WebtoTun image shown in FIG. 2 in a 1x3 matrix. FIG.

6 is a diagram illustrating a black and white modulation process when the background color of the webtoon image is black, FIG. 7 is a view showing a black and white modulation process when the background color of the webtoon image is black, FIG. White modulation process when the background color of the original Webtoon image is white, and FIG. 8 is a diagram showing a state in which all the QR codes inserted in the original Webtoon image are damaged.

Referring to FIGS. 1 to 8, a digital content providing and authentication system using a real-time image watermarking technique according to an embodiment of the present invention includes a QR code including member identification information, a digital content (for example, a Webtoon image) A digital content providing device that provides a combined image combined with m × n (m and n is a natural number) matrix to a webtootuser and a QR code is arranged in a matrix of m × n (m and n are natural numbers) And a digital content authentication device 20 for extracting the QR code from the combined image and extracting the illegally leaked member identification information of the digital content.

At this time, the digital content providing apparatus 10 includes a request receiving unit 11, a member information database 12, an original image storage unit 13, an encryption unit 14, a QR code generation unit 15, an original image loading unit And a digital content authentication apparatus 20 includes a photographing means (for example, a camera) 21, an image modulating section 22, A QR code extracting unit 23 and a decoding unit 24. [

The request receiving unit 11 receives the webtoon image request signal generated when the webtoon user requests the webtoon image. The webtootage image request signal is transmitted to the webtoot image by the webtoot image (or the next page) Or scrolls the web toon image vertically.

The original image storage unit 13 stores the original of the webtoon image created by the webtoon artist.

The member information database 12 stores member identification information such as a user ID of the user who wants to use the webtoon image (i.e., cartoon) stored in the original image storage unit 13, an account number, a payment record, and an online carton purchase history.

The encryption unit 14 extracts the member identification information of the member requesting the webtoon image from the member information database 12 according to the webtoon image request signal transmitted from the request reception unit 11 and encrypts the member identification information through the internal encryption method.

At this time, the encryption unit 14 may encrypt the data using any of various publicly known encryption methods, and the encrypted data in the encryption unit 14 may include the IP information of the computer connected to the member requesting the Webtoon image, It is preferable that an ID is included.

The QR code generation unit 15 generates a QR code using the data encrypted by the encryption unit 14.

At this time, the QR code generated by the QR code generation unit 15 includes member identification information (i.e., a member ID and an IP address).

The original image loading unit 16 loads the original image of the Webtoon image requested by the request receiving unit 11 from the original image storage unit 13 and then transmits the size information of the loaded original image to the QR code image adjusting unit 17, Lt; / RTI >

The QR code image adjusting unit 17 adjusts the background to 100% transparency and the data area to gray having transparency of 95% to 99% with respect to the QR code transmitted from the QR code generating unit 15. The QR code image adjustment unit 17 compares the initial size of the QR code image with the original image size transmitted from the original image loading unit 16, and then determines whether the width and / If the width and / or length of the original image is larger than the width and / or length of the code image, n QR code images are arranged in the columns and / or rows of the original image, The length and / or the length of the original image are reduced by one of the width and height of the QR code image, and then a plurality of QRs Arrange the code. The color of the QR code is not limited to gray, and other color values may be used.

If the transparency of the QR code data area is 96% or less, the QR code may be displayed to the webtootuser. If the transparency of the QR code data area is 99% or more, the QR code may be damaged when the image size of the QR code is adjusted Therefore, it is preferable that the transparency of the QR code data area is adjusted to 97% to 98%.

The image combining unit 18 combines the QR code images generated by the QR code image adjusting unit 17 with m × n (m and n are natural numbers) matrices in the original image loaded in the original image loading unit 16 Then, the combined image of the QR code and the original image is sent to the webtoot user.

The photographing means 21 is a place for photographing a webtoon image displayed on a site illegally leaked from the webtoon image to obtain a screen image, and is composed of a camera.

The image modulating unit 22 modulates the screen image captured and obtained by the photographing means 21 using a black and white modulation method.

At this time, in the black and white modulation method, a pixel whose brightness value is larger than a reference gray level at a certain reference gray level is processed as black, and a pixel whose brightness value is smaller than the reference gray level is processed as white In the present invention, the reference gray level is adjusted to a value between 0 (full white) and 255 (full black) so that the gray color QR code image embedded in the Webtoon image is modulated in white or black. For example, when the gray value of the QR code is 120, if the reference gray level is a value between 0 and 120, the data area of the QR code is modulated to black. If the reference gray level is a value between 120 and 255, Is modulated in white. On the other hand, since the background area of the QR code is 100% transparent, it is modulated in white or black according to the brightness value of the webtoon image.

When the image modulator 22 modulates the screen image by the black and white modulation method, the data area of the QR code is modulated to white (or black), and the webtoon image of the background area of the QR code is modulated to the data area of the QR code There is a black (or white) modulated area which is opposite to the black (or white) area.

In other words, in the area where the original webtoon image is white, the webtoon image is processed in white and the QR code image is processed in black. In the area where the original webtoon image is black, the webtoon image is processed in black and the QR code image is processed in white . In this way, QR codes can be extracted based on the classification of a webtoon image and a QR code image in black / white or white / black in some areas.

The QR code extracting section 23 extracts a QR code from a screen image modulated in black and white by the image modulating section 22. [

In other words, the QR code extracting unit 23 extracts the damaged (i.e., the white or black portion of the original WebtoTun image and the white or black portion of the QR code) of the m × n (m and n are natural numbers) QR codes included in the screen image Extracts only one QR code that has not been detected) and if all the inserted QR codes are damaged, only the parts without the damage are combined to complete one complete QR code, thereby extracting the QR code This is possible.

The decryption unit 24 decrypts the QR code transmitted from the QR code extracting unit 23 and extracts the member identification information included in the QR code.

Hereinafter, the operation of the digital content providing and authentication system using the real-time image watermarking technique of the present invention will be described briefly.

First, a method of inserting a QR code in real time into a digital content, that is, a webtoot image, and then providing a webtoon image embedded with a QR code to a webtoot user will be described.

When a webtootuser accesses a webtoot server (not shown) to receive a webtoon service using a terminal (e.g., a personal PC, a smart phone, etc.), the webtoot server receives a user ID and a fee from the webtoot user, The user authentication of the user is performed.

When the webtootuser clicks the webtoon image after the user authentication of the webtoon user is completed, the request receiving unit 11 of the digital content providing apparatus 10 receives the request signal of the webtoot user, The image request signal is transmitted to the original image loading unit 16 and the encryption unit 14.

Accordingly, the encryption unit 14 extracts the member identification information of the member requesting the Webtoon image from the member information database 12, and then encrypts the member identification information extracted by the internal encryption method.

At this time, the member identification information encrypted by the encryption unit 14 is transmitted to the QR code generation unit 15, and the QR code generation unit 15 generates a QR code including the member identification information.

On the other hand, the original image loading unit 16 loads the original web token image corresponding to the requested web toon image from the original image storage unit 13 according to the request signal transmitted from the request receiving unit 11, Size information (i.e., the length and the length) to the QR code image adjustment unit 17. [

Accordingly, the QR code image adjusting unit 17 sets the background area of the QR code transmitted from the QR code generating unit 15 to 100% transparency, and sets the data area to gray of 95% to 99% transparency, preferably 97 And the initial size of the QR code image is compared with the original image size transmitted from the original image loading unit 16. [ Here, the gray value of the data area of the QR code is preferably 20% to 80% when 0 (full white) is 100% and 255 (full black) is 0%.

If the width and / or length of the original image as shown in FIG. 2 is larger than the initial size (width and / or length) of the QR code image, m × n (m and n 4), and when the width of the original image is smaller than the width of the initial size QR code image as shown in FIG. 4, the width of the QR code image is set as the original size (M and n are natural numbers) toward the vertical length of the original image after arranging the QR codes of the QR codes (three in total in three rows in Fig.

In FIGS. 3 and 4, a portion indicated by a red line is an area of the QR code inserted in the Webtoon image.

The image combining unit 18 arranges the QR code provided by the QR code image adjusting unit 17 in the original Webtoon image provided in the original image loading unit 16 in a matrix of mxn (m and n are natural numbers) The original webtootun image is combined with the QR code image and sent to the webtootone user.

As a result, the webtootuser is provided with a combined image obtained by combining m × n (m and n are natural numbers) QR code images in the webtoon image in real time.

Second, when a webtoon image is illegally leaked by a webtoon user, a QR code is extracted from a combined image in which a QR code is arranged in m × n (m and n are natural numbers) matrices in a webtoon image, The method of extracting the outgoing member identification information is as follows.

When a webtoot image displayed on a site illegally leaked from the webtoon image is photographed by the photographing means 21, the image modulating section 22 modulates the screen image obtained by the photographing means 21 using a black and white modulation method .

For example, when the image modulating section 22 performs black and white processing on the screen image obtained by the photographing means 21, the original WebtoTun image is modulated in black as shown in FIG. 5, and the QR The data area of the code is modulated in white so that the QR code embedded in the Webtoon image can be displayed (a total of 10 QR codes are displayed in FIG. 5).

When modulating the original webtoon image in the image modulating unit 22, the reference gray level is adjusted according to the background color of the original webtoon image to vary the data area of the QR code to black or white, thereby improving the QR code extraction efficiency have. For example, when a QR code is inserted into the background of a black webtoon image as shown in FIG. 6, the reference gray level is set to a value larger than the gray of the QR code so that the QR code image is modulated in white and the background of the webtoon image is modulated in black . 7, when the QR code is inserted into the background image of the white web toon image, the reference gray level is set to a value smaller than the gray of the QR code so that the QR code image is modulated in black and the background of the web toon image is modulated in white .

When the gray ratio of the reference gray level is adjusted during the black-and-white modulation in this manner, the image of the QR code (i.e., watermark) embedded in the Webtoon image becomes clear and the QR code extracting unit 23 The QR code can be extracted.

The QR code extracting unit 23 extracts one QR code (indicated by red in FIG. 5) from which no damage has occurred among a plurality of QR codes (for example, 10 in FIG. 5) In the case of damage to the QR code, only the damaged portions (indicated by red in FIG. 8) are combined and then combined to extract one complete QR code.

When the QR code is extracted, the QR code extracted by the decoding unit 24 is decoded to extract the member identification information included in the QR code, and the accurate personal information of the sender who has leaked the webtoon image through the extracted member identification information .

In this way, the digital content providing and authentication system using the real-time image watermarking technique according to the embodiment of the present invention can embed the watermarking (i.e., QR code) including the member identification information in the real web- Since the stored webtoot images are not individually stored, the server capacity and the resource load can be kept low, and the QR code is inserted into the original webtoon image in such a manner that the QR codes are arranged in the matrix of m × n (m and n are natural numbers) The QR code can be extracted by combining only a normal portion of a plurality of QR codes, thereby accurately identifying a member illegally leaking the Webtoon image.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit of the invention. Accordingly, the scope of the present invention should not be limited to the described embodiments, but should be defined by the following claims as well as equivalents thereof.

10: digital content providing apparatus 11: request receiving section
12: Member information database 13: Original image storage unit
14: Encryption unit 15: QR code generation unit
16: Original image loading unit 17: QR code image adjustment unit
18: image combining unit 20: digital content authentication device
21: photographing means 22: image modulating unit
23: QR code extracting unit 24: Decoding unit

Claims (13)

When a webtoot image is requested by a webtootuser, a QR code including member identification information and having a transparency of 95% to 99% is combined with an original webtoTun image using m × n matrix (m and n are natural numbers) And a digital content providing apparatus provided to the user,
The digital content providing apparatus includes:
A request receiving unit receiving a webtoon image request signal from the webtoot user;
An original image storage unit for storing the original webtoon image;
A member information database storing member identification information of the webtootuser;
A QR code generation unit for generating a QR code including member identification information of a webtoon image requesting webtootome user when the webtoon image request signal is received from the request reception unit;
An original image loading unit loading the webtoon image requested by the request receiving unit from the original image storage unit;
A QR code image controller for adjusting the QR code generated by the QR code generator to a transparency of 95% to 99%; And
The QR code image adjusting unit combines the QR code image whose transparency is adjusted in a matrix of mxn (m and n are natural numbers) matrix in the original WebToon image loaded in the original image loading unit, And an image combining unit for transmitting a combined image combining the original web token image to a webtoot user. The method according to claim 1,
The original image loading unit extracts size information of the original webtoon image loaded from the original image storage unit,
Wherein the QR code image adjusting unit adjusts the QR code image to fit the size of the original WebToon image. The method according to claim 1,
And an encryption unit encrypting the member identification information and providing the encrypted member identification information to the QR code generation unit. And a digital content authentication device for extracting QR code from a combined image in which the QR code is arranged in a matrix of m x n (m and n are natural numbers) in the Webtoon image and extracting member identification information from the extracted QR code,
The digital content authentication apparatus includes:
A photographing means for photographing a webtoon image displayed on a screen to obtain a screen image;
An image modulating unit for performing black and white modulation on a screen image captured and obtained by the imaging unit to display a data area of the QR code and a background area of the QR code in different colors;
A QR code extracting unit for extracting a QR code from a screen image modulated by the image modulating unit; And
And a decoding unit for extracting the member identification information included in the QR code extracted by the QR code extracting unit. The method of claim 4,
The image modulating unit modulates the data area of the QR code to white by setting the reference gray level to a value larger than the gray of the QR code or sets the reference gray level to a value smaller than the gray of the QR code, And the data area is modulated to black. The method of claim 4,
Wherein the QR code extracting unit extracts one QR code in which no damage has occurred in the modulated screen image. The method of claim 4,
Wherein the QR code extraction unit extracts a QR code by extracting two or more QR codes that have been damaged in the modulated screen image, and combines the parts without any damage. When a webtoot image is requested by a webtootuser, a QR code including member identification information and having a transparency of 95% to 99% is combined with an original webtoTun image using m × n matrix (m and n are natural numbers) A digital content providing device for providing the digital content to a user; And
And a digital content authentication device for extracting QR code from a combined image in which the QR code is arranged in a matrix of m x n (m and n are natural numbers) in the Webtoon image and extracting member identification information from the extracted QR code,
The digital content providing apparatus includes:
A request receiving unit receiving a webtoon image request signal from the webtoot user;
An original image storage unit for storing the original webtoon image;
A member information database storing member identification information of the webtootuser;
A QR code generation unit for generating a QR code including member identification information of a webtoon image requesting webtootome user when the webtoon image request signal is received from the request reception unit;
An original image loading unit loading the webtoon image requested by the request receiving unit from the original image storage unit;
A QR code image controller for adjusting the QR code generated by the QR code generator to a transparency of 95% to 99%; And
The QR code image adjusting unit combines the QR code image whose transparency is adjusted in a matrix of mxn (where m and n are natural numbers) matrix in the original WebToon image loaded in the original image loading unit, And an image combining unit for transmitting a combined image combining the original web token image to a webtoot user. The method of claim 8,
And an encryption unit for encrypting the member identification information and providing the encrypted member identification information to the QR code generation unit. The digital content providing and authentication system using the real-time image watermarking technology. The method of claim 8,
The digital content authentication apparatus includes:
A photographing means for photographing a webtoon image displayed on a screen to obtain a screen image;
An image modulating unit for performing black and white modulation on a screen image captured and obtained by the imaging unit to display a data area of the QR code and a background area of the QR code in different colors;
A QR code extracting unit for extracting a QR code from a screen image modulated by the image modulating unit; And
And a decoding unit for extracting the member identification information included in the QR code extracted by the QR code extracting unit, using the real-time image watermarking technique. The method of claim 10,
The image modulating unit modulates the data area of the QR code to white by setting the reference gray level to a value larger than the gray of the QR code or sets the reference gray level to a value smaller than the gray of the QR code, And the data area is modulated in black. The digital content providing and authentication system using the real-time image watermarking technology. The method of claim 10,
Wherein the QR code extracting unit extracts one QR code that has not been damaged in the modulated screen image. The method of claim 10,
Wherein the QR code extracting unit extracts two or more QR codes that have been damaged in the modulated screen image and extracts a QR code by combining the parts without any damage. Authentication system.

Images