KR100545451B1 - Method of Water-marking Multi-media data by Using the Mobile Communication Terminal - Google Patents

Abstract

The present invention relates to a watermarking method of multimedia data using a mobile communication terminal to apply watermarking to a mobile communication terminal in a mobile communication network to watermark the multimedia data using the corresponding mobile communication terminal. A watermarking method of multimedia data using a mobile communication terminal for receiving a watermark or inserting a watermark into multimedia data generated by various peripheral devices, the data encoded by selecting a data download function in a user login state of the mobile communication terminal. Or confirming whether or not to store the digital signal processed data by selecting the multimedia data generating function; Checking whether to insert a watermark when storing the data and selecting a type of watermark according to the size of the data; Generating a watermark by replacing an ESN (Electronic Serial Number) of the mobile communication terminal with a watermark character table according to the watermark type; And after generating the file by inserting the watermark into the data through an MPEG (Moving Picture Experts Group) encoder, recording and storing the name of the file and whether or not the watermark is inserted. By tracking and verifying the authors and distributors of information without the involvement of an accredited certification body, you can solve the problem of copyright protection, misuse and abuse of information, as well as minimize time and economic losses.

Description

Watermarking method of multimedia data using mobile communication terminal {Method of Water-marking Multi-media data by Using the Mobile Communication Terminal}             

1 is a block diagram illustrating a configuration of a system for watermarking multimedia data using a mobile communication terminal according to an exemplary embodiment of the present invention.

FIG. 2 illustrates an example of a format of a binary image file to be used as a watermark in FIG. 1; FIG.

FIG. 3 illustrates in this example the format of a binary image file to be used as a watermark in FIG.

FIG. 4 is a diagram illustrating an example of a character table for format conversion of an ESN (Electronic Serial Number) in FIG. 1; FIG.

FIG. 5 is a diagram showing the form of a character table for format conversion of an ESN in FIG. 1; FIG.

6 is a flowchart illustrating a watermarking method of multimedia data using a mobile communication terminal according to an exemplary embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

100: Network 200: Personal Computer

201: Client

202: Water-making Tool Block

300: mobile communication terminal 400: base station

301: Universal Serial Bus Block

302: Moving Picture Experts Group (MPEG) Processor

303: watermark block 304: signal processing block

305: multimedia data block 306: microprocessor

307: camera / camcorder 308: LCD (Liquid Crystal Display)

309: Speaker 310: Memory

311 Mike

The present invention relates to a method of watermarking multimedia data using a mobile communication terminal. In particular, the present invention relates to a watermarking method of a multimedia data using a mobile communication terminal by applying watermarking to the mobile communication terminal in a mobile communication network. A method of watermarking multimedia data.

In general, in order to distribute copyrighted multimedia data (e.g., music, video and video files), the client transmits user information, multimedia information, and watermark information directly to the certification authority, and then obtains approval from the certification authority. In response to this, the watermarking multimedia data is watermarked using a watermarking tool provided by the certification authority, and the watermarked multimedia data is provided to the consumer using a network or a mobile communication terminal.

In addition, a general mobile communication terminal can increase the utilization of multimedia information by using peripheral devices (eg, cameras, camcorders, microphones, speakers, etc.), microprocessors, DSP processors, MPEG chips, etc., which have improved operation speed and performance. Is being developed.

However, there is a disadvantage in that illegal copying of multimedia data is made using these improved functions and distributed in the market. In addition, using the above-mentioned peripheral devices, the invasive multimedia of others has been produced and has been used commercially.

As described above, the conventional mobile communication terminal can only claim the user's ownership through the certification authority, and it is pointed out as a problem of the information society because illegal copying of information and production of invasive information of others can be easily performed.

 The present invention is to solve the disadvantages or problems as described above, the present invention is to apply the watermarking to the mobile communication terminal in the mobile communication network of the multimedia data using the mobile communication terminal to watermark the multimedia data using the mobile communication terminal It is an object of the present invention to provide a watermarking method.

In addition, the present invention is to perform the watermarking using a mobile communication terminal for information protection in the mobile communication network, to solve the problem of copyright protection and misuse and abuse of information, and to ensure that watermarking without intervention of the certification authority , Its purpose is.

In addition, the present invention applies watermarking to the codec of the mobile communication terminal in the mobile communication network, and by using the unique ESN of the mobile communication terminal as a watermark in the application, it is possible to identify the author and distributor of the information It aims to address copyright protection, misuse and abuse of information.

In addition, when the mobile communication network stores only the mobile communication terminal itself, the present invention does not insert a watermark when uploading a file to the outside (that is, when transmitting an MMS, when transmitting to a personal computer through a personal computer link, etc.). By inserting a watermark to ensure watermarking, it is possible not only to track and confirm the author or provider of information without the involvement of an accredited certification body, but also to minimize time and economic losses.

delete

According to an embodiment of the present invention, a method for watermarking multimedia data using a mobile communication terminal includes a watermark on multimedia data received from a personal computer or generated by various peripheral devices in a mobile communication terminal. A method of watermarking multimedia data using a mobile communication terminal, comprising: storing data encoded by a data download function selection in a user login state of the mobile communication terminal or data digitally processed by a multimedia data generation function selection Checking whether or not; Checking whether to insert a watermark when storing the data and selecting a type of watermark according to the size of the data; Generating a watermark by replacing the ESN of the mobile communication terminal with a watermark character table according to the watermark type; And after generating the file by inserting the watermark into the data through an MPEG encoder, recording and storing the name of the file and whether or not the watermark is inserted.

Alternatively, in the watermarking method of multimedia data using a mobile communication terminal according to an embodiment of the present invention, whether to insert the watermark when uploading the multimedia data to the outside using the mobile communication terminal. The method may further include transmitting the watermarked file after generating a corresponding watermarked file by unconditionally inserting a watermark into the multimedia data without checking.

Preferably, the step of transmitting the watermarked file comprises the steps of checking whether the watermark is inserted by checking the information of the data selected by the data upload function selection in the user login state of the mobile communication terminal; Selecting a type of watermark according to the size of the data when the watermark is not inserted; Generating a watermark by replacing an ESN of the mobile communication terminal with a watermark character table according to the watermark type; And inserting the watermark into the data through an MPEG encoder to generate the watermarked file, and then transmitting the watermarked file.

Further, in the watermarking method of multimedia data using a mobile communication terminal according to an embodiment of the present invention, when the mobile communication terminal receives a download request from the personal computer, the ESN is transmitted to the personal computer. Process of doing; And receiving a ESN from the mobile communication terminal in the personal computer, converting the ESN into a binary image file, and inserting a watermark.

The present invention implements a watermarking system that does not require a certification authority, implements a watermarking system using a mobile communication terminal without involvement of a certification authority, and converts the unique ESN of the mobile communication terminal into a binary image file at the time of watermarking. (I.e., a video file) by converting it into a watermark, it is possible to identify and track illegal users of multimedia information using a mobile communication terminal with watermarking, thereby eliminating the problems of copyright protection and misuse and abuse of information. Make it work. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The system for watermarking multimedia data using a mobile communication terminal according to an embodiment of the present invention is implemented such that watermarking is applied to protect multimedia data transmitted or received through the mobile communication terminal. As shown in FIG. 1, the network 100 includes a personal computer 200, a mobile communication terminal 300, and a base station 400.

Here, the mobile communication terminal 300 is connected to the personal computer 200 and the base station 400 in order to transmit and receive data in a wired or wireless manner, and the personal computer 200 transmits data through the network 100. It is made to share.

The personal computer 200 transmits all the multimedia data received through the network 100 to the mobile communication terminal 300, and downloads an ESN from the mobile communication terminal 300 to obtain a binary image file (ie, It converts the image file into a watermark and performs watermarking.

In addition, the personal computer 200 includes a client 201 for performing communication with the network 100 and the mobile communication terminal 300 and an ESN downloaded through the client 201 as a binary image file. And a watermarking tool block 202 for converting and watermarking the multimedia data using the watermark.                     

The mobile communication terminal 300 receives the multimedia data from the personal computer 200 or the base station 400, or after producing the multimedia data using a variety of peripheral devices within the water, the received or produced multimedia data Insert and store a mark, insert a watermark when uploading (ie, transmitting) multimedia data, and transmit its ESN to the personal computer 200 when the personal computer 200 requests a download. Do this.

The mobile communication terminal 300 includes a USB block 301 for performing serial communication with the personal computer 200, an MPEG processor 302 for encoding, decoding, and watermarking data; A watermark block 303 for generating a watermark, a signal processing block 304 for digital signal processing, a multimedia data block 305 for communicating with the base station 400 and retrieving data to be used; A microprocessor 306 for baseband operation and control, a camera / camcorder 307 as a peripheral device, an LCD 308 and speakers 309, and a memory 310 for storing data. It is done by

Here, the MPEG processor 302 receives the multimedia data through the USB block 301 or receives the multimedia data generated by the peripheral device and generates the watermark block 303 in the frequency domain while performing the DCT. Optionally inserts a watermark and unconditionally inserts a preset watermark when uploading (ie, transmitting) multimedia data to the outside. The watermark block 303 converts the hexadecimal ESN into a binary image file (ie, an image file), which defines the character position of the ESN as shown in FIGS. 2 and 3 and defines the character positions of the ESN. It is defined as a character table as shown in the form.

The watermark used for watermarking is inserted into a binary image file in the form as shown in FIG. 2 or 3. In addition, the hexadecimal characters of the ESN as the corresponding watermark are transformed into a binary image file of the form shown in FIG. 4 or 5 during watermarking. Here, the size of the binary image file is as shown in FIG. 2 or 3.

In the method of watermarking multimedia data using a mobile communication terminal according to an embodiment of the present invention, watermarking multimedia data (eg, an image file, a video file, a sound file, etc.) using the mobile communication terminal 300. There are four ways to apply.

First, all multimedia data originally downloaded from the personal computer 200 connected to the network 100 or the base station 400 at the request of the client 201 (ie, the network 100 or the base station 400). Watermark is inserted while all the multimedia data received through the) is stored in the memory 310 of the mobile communication terminal 300.

Secondly, a watermark is inserted while uploading (ie, transmitting) multimedia data using the mobile communication terminal 300.

Third, multimedia data is produced using various peripheral devices (ie, camera / camcorder 307, LCD 308, and speaker 309) of the mobile communication terminal 300, and the produced multimedia data The watermark is inserted while the memory 310 is stored in the memory 310.

Fourth, the mobile communication terminal 300 transmits (ie downloads) the ESN to the personal computer 200, and the mobile communication is performed in the watermarking tool block 202 provided in the personal computer 200. The ESN of the terminal 300 is received and converted into a binary image file to insert a watermark.

Next, a method of watermarking multimedia data using a mobile communication terminal according to an embodiment of the present invention will be described with reference to the flowchart of FIG. 6.

First, a user of the mobile communication terminal 300 inputs a password using a keypad provided in the mobile communication terminal 300 to perform a user authentication request to the corresponding mobile communication terminal 300, and then the corresponding mobile communication. Receiving a user authentication approval response from the terminal 300, the user is logged in (step S1), and if the multimedia function is selected in the corresponding login state, the multimedia function selection is detected (step S2). Allows you to perform an action.

At this time, it is checked whether the data download using the personal computer 200 or the base station 400 is selected in the second step (S2) (step S3), when the data download is selected in the corresponding third step (S3) In order to prevent illegally copying and distributing multimedia information illegally, watermarking can be selectively performed using the user's ESN.

Therefore, it is determined whether to output the downloaded data (step S4), wherein the downloaded data is data encoded in MPEG format.

Then, in the case of outputting the data, after decoding the data in the MPEG processor 302 (step S5), the decoded data is output through the LCD 308 and the speaker 309 (step S6). .

When the multimedia function is selected in the second step S2, whether the multimedia data generation using the various peripheral devices (ie, the camera / camcorder 307 and the microphone 311) of the mobile communication terminal 300 is selected is selected. (Step S7).

Therefore, in the case where multimedia data generation is selected in the seventh step (S7), in order to solve the problem of copyright protection or misuse and misuse of information on copyright infringing works of others, water is selectively used using the ESN of the user. Allow the marking process to proceed.

Accordingly, the signal processing block 304 performs digital signal processing (for example, data format conversion, etc.) on the generated multimedia data (step S8), and then displays the digital signal processed data on the LCD 308 and the like. It outputs through the speaker 309 (step S9).

At the same time, it is determined whether to store the data decoded in the fifth step S5 or the digital signal processed data in the eighth step S8 (step S10). It is confirmed whether to insert (step S11).

That is, the MPEG processor 302 can selectively perform the watermark embedding, and by allowing the user to set whether to insert the watermark in advance, the watermarking operation is omitted in the case of data that does not require watermark embedding. To minimize unnecessary operations.

Then, if the user applies the watermark embedding in advance in step 11 (S11), the watermark type is selected according to the size of the multimedia data to apply watermarking (step S12).

Then, the ESN of the mobile communication terminal 300 is replaced with the watermark character table as shown in FIG. 4 or 5 according to the type of the selected watermark to generate a watermark for tracking illegal users of the multimedia. (Step S13).

Here, the watermark is generated in the watermark block 303, which uses the only ESN of the mobile communication terminal 300.

The watermark block 303 converts the hexadecimal ESN into a binary value to use as a watermark. In this case, the watermarked data (hereinafter referred to as 'embedded data') is the signal processing block. When performing various digital signal processing operations (ie, filtering, size conversion, compression rate conversion, etc.) at 304, the corresponding watermark is partially destroyed, so that accurate user information cannot be extracted, so that the watermark block 303 Convert a hexadecimal ESN to a binary image file.

In this case, the binary image file is defined in two forms, a form of 15 * 20 pixels 321 as shown in FIG. 2 and a form of 30 * 40 pixels 322 as shown in FIG. 3. This is for selectively applying a watermark according to the size of multimedia data for applying watermarking.

When the size of the multimedia data to be applied to the watermarking is large, even if the watermark is inserted, the distorted portion cannot be visually distinguished from the original data, thereby satisfying the invisibility of watermarking. .

However, when the size of the multimedia data is small, that is, when a relatively large watermark is inserted into the small size of the multimedia data, the embedded data may cause a lot of distortion and become meaningless as the multimedia data. Since the invisibility of the mark may not be satisfied and the watermark may be artificially deleted by the illegal user, it is important to select the watermark type according to the size of the multimedia data to apply the watermarking.

For example, if the original data is larger than or equal to the VGA size (e.g., 640 * 480 pixels), use a file size as shown in Figure 3, whereas if it is smaller than the VGA size, the file size is Use the file size as shown.

When the digital signal processing in the signal processing block 304 is applied to the embedded data, a slight data loss occurs in the extracted watermark, thereby reducing the identification of the ESN, and thus the correction power of the extracted watermark. In order to improve identification and identification, the text positions of the ESN are defined as shown in FIGS. 2 and 3. In addition, the hexadecimal ESN is defined as a character table as shown in FIGS. 4 and 5, wherein the number of pixels of each character is 5 * 3 pixels 321 and 7 * 5 pixels 322, and the file of the original data is defined. Make sure to choose according to the size.

Then, the watermark generated in the thirteenth step S13 is inserted through the encoder of the MPEG processor 302, that is, the MPEG processor 302 inserts a watermark in the frequency domain while performing the DCT. (Step S14).

In this case, it is set in advance that the user does not apply the watermark embedding in the eleventh step S11, or after the watermark is inserted in the fourteenth step S14, the file information is stored. The name and the presence or absence of watermark insertion are recorded and stored in the memory 310 (step S15). Here, the information of the file is used to distinguish the presence or absence of a watermark when checking the file information when uploading the data.

On the other hand, it is checked whether the data upload is selected when the multimedia function of the second step S2 is selected (step S16). In this case, when the data upload is selected in the corresponding step 16 (S16), the copyright protection or the In order to solve the misuse and misuse of information on privacy infringing works, the user's ESN can be used to perform the watermarking process unconditionally.

Accordingly, when the user selects a file for uploading data from the memory 310, the information of the selected file is checked (step S17) to check whether or not the watermark is inserted (step S18).

Therefore, when the watermark is inserted in the eighteenth step S18, the file is directly transmitted (step S19), and watermarking when the watermark is not inserted in the eighteenth step S18. The watermark type is selected according to the size of the multimedia data for applying (step S20).

Then, the ESN of the mobile communication terminal 300 is replaced with the watermark character table as shown in FIG. 4 or 5 according to the type of the selected watermark to generate a watermark for tracking illegal users of the multimedia. (Step S21).

Then, the watermark generated in the twenty-first step S21 is inserted through the encoder of the MPEG processor 302, that is, the MPEG processor 302 inserts the watermark in the frequency domain while performing the DCT. After that (step S22), the watermarked file is transmitted (step S23).

Meanwhile, the watermarking algorithm used in the watermarking method of the multimedia data using the mobile communication terminal according to the above-described embodiments of the present invention is not limited to the above-described embodiments, and various general algorithms may be used. You should know well.

In the watermarking method of multimedia data using a mobile communication terminal according to an embodiment of the present invention, in order to protect copyright of multimedia data created without using the mobile communication terminal 300, the personal computer 200 may be protected. In the watermarking tool block 202, the ESN of the mobile communication terminal 300 is downloaded and converted into a binary image file to be used as a watermark.

On the other hand, in order to extract the watermark after the watermark is used as watermarking as described above, the reverse process is performed on the algorithm used for the watermarking after selecting suspicious multimedia data. The marking algorithm is extracted to extract the watermark.

After the watermark is extracted through the inverse watermarking algorithm as described above, the extracted watermark is compared with the ESN to check whether the watermarking operation is performed normally.

As described above, watermarking is applied to the codec of the mobile communication terminal in the mobile communication network according to the present invention, and by using the unique ESN of the mobile communication terminal as the watermark at the time of application, the author of the information and By tracking and identifying distributors, you can solve the problem of copyright protection, misuse and abuse of information, as well as minimize time and economic losses.

Claims (5)

delete A method of watermarking multimedia data using a mobile communication terminal in which a watermark is inserted into multimedia data received from a personal computer or generated by various peripheral devices in a mobile communication terminal, Determining whether to store data encoded by the data download function selection or data digitally processed by the multimedia data generation function selection in the user login state of the mobile communication terminal; Checking whether to insert a watermark when storing the data and selecting a type of watermark according to the size of the data; Generating a watermark by replacing an ESN (Electronic Serial Number) of the mobile communication terminal with a watermark character table according to the watermark type; And moving the watermark into the data through an MPEG (Moving Picture Experts Group) encoder to generate a file, and then recording and storing the name of the file and whether or not the watermark is inserted. Watermarking method of multimedia data using a communication terminal. The method of claim 2, When uploading the multimedia data to the outside using the mobile communication terminal, the watermarked file is generated by inserting a watermark into the multimedia data unconditionally without checking whether to insert the watermark. After that, the method of watermarking multimedia data using a mobile communication terminal, characterized by further comprising the step of transmitting the watermarked file. The method of claim 3, The transmitting of the watermarked file may include: checking whether data is inserted by checking information of data selected by data upload function selection in a user login state of the mobile communication terminal; Selecting a type of watermark according to the size of the data when the watermark is not inserted; Generating a watermark by replacing an ESN of the mobile communication terminal with a watermark character table according to the watermark type; Inserting the watermark into the data through an MPEG encoder to generate the watermarked file, and then transmitting the watermarked file; and a method of watermarking multimedia data using a mobile communication terminal. . The method of claim 2, When the mobile communication terminal receives a download request from the personal computer, transmitting the ESN to the personal computer; And receiving a ESN from the mobile communication terminal in the personal computer, converting the ESN into a binary image file, and inserting a watermark.

Images