KR101047238B1

KR101047238B1 - Watermarking Method of Recording / Recording Data Using Mobile Communication Network

Info

Publication number: KR101047238B1
Application number: KR1020050045518A
Authority: KR
Inventors: 박정규
Original assignee: 박정규
Priority date: 2005-05-30
Filing date: 2005-05-30
Publication date: 2011-07-06
Also published as: KR20060123882A

Abstract

The present invention prevents tampering or manipulation of recorded data in the case of recording using a mobile communication terminal, and cannot operate information on a terminal that performed recording time, location, and recording. Digitally recorded / recorded data by technically supporting the authenticity of information such as time, location, etc. The objective is to ensure the capacity of evidence for the data. The present invention for achieving the object of the present invention stores the ESN of the mobile communication terminal, when the recording is started, the location information of the mobile communication terminal at the time when the recording and recording and recording time information started recording, the mobile communication terminal Receives the characteristic data of the data to be recorded / recorded in real time, and generates a unique marking at the end of the recording / recording by using this to generate watermarking information. This ensures the authenticity of the content recorded in the watermarking information without transmitting the recording data to the management server.

ESN, management server, soft watermarking, unique code, proof ability

Description

Watermarking method of recording / recording data using mobile communication network {METHOD OF WATERMARKING RECORDED AUDIO / VIDEO DATA USING MOBILE COMMUNICATION SYSTEM}

1 is a schematic diagram showing a general configuration of a mobile communication network;

2 is a flowchart illustrating a watermarking method of recording / recording data using a mobile communication network of the present invention;

3 is a flowchart illustrating a watermarking method of recording / recording data using a mobile communication network of the present invention;

4 is a flowchart illustrating a watermarking method of recording / recording data using a mobile communication network according to another aspect of the present invention.

In the case of recorded or recorded data, there was a risk of tampering or manipulation, so the evidence was not recognized in court, especially when it was recorded or recorded digitally.

The present invention has been made to solve the above problems, and when the recording using the mobile communication terminal to prevent the modulation or manipulation of the recorded data, the recording time, location, recording / recording It is an object of the present invention to provide a method for recording information on a terminal that has performed the data in an inoperable form so that it can be decrypted and authenticated by an authorized authority.

That is, the purpose of the present invention is to secure the capability of proofing digitally recorded data by technically supporting the authenticity of information such as whether the data is digitally recorded and recorded and the time, location, and the like. In this case, the mobile communication terminal used for recording / recording is not limited in form if it is accessible through the mobile communication network.

Watermarking method of recording / recording data using a mobile communication network of the present invention for achieving the above object

When the mobile communication terminal notifies the management server of the start of the recording using the mobile communication network, the management server in the ESN of the mobile communication terminal, the location information and recording of the mobile communication terminal at the time when the recording is started Storing at least one of the disclosed time information in a temporary memory;

Storing the data recorded in the mobile communication terminal in real time until the end of the recording in a streaming manner and storing in a temporary memory;

When the mobile communication terminal notifies the management server of the end of the recording using the mobile communication network, one or more pieces of information of the location information of the mobile communication terminal and the time information on which the recording is started when the recording is terminated. Storing the temporary memory in three steps;

Generating a unique code using at least one of the recording / recording time information stored in the temporary memory, the ESN and location information of the mobile communication terminal, and recording / recording data stored in the temporary memory; ;

Generating, by the management server, watermarking information including at least one of the recording / recording time information, the ESN, and location information of the mobile communication terminal and the unique code stored in a temporary memory; And

Six steps of transmitting the generated watermarking information to the mobile communication terminal.

In this case, a unique code may be generated in real time from the recording / recording data received by the streaming method so that the streaming data may not be stored in the storage device. In addition, instead of directly including the unique code in the watermarking information, the unique code may be stored in the database and only the corresponding serial number may be included in the watermarking information.

Watermarking method of recording / recording data using the mobile communication network of the present invention for achieving the above object,

Receiving watermarking information separated from the recording data stored from the mobile communication terminal and feature data of the recording data from which the watermarking information is separated;

2-1 extracting a unique code by decrypting the received watermarking information using a secret key;

Generating a unique code using the received feature data; And

The unique code extracted in step 2-1 and the unique code generated in step 2-2 may be compared in three steps.

In this case, different implementations may be derived depending on whether the unique code is directly included in the watermarking information, and the management server is configured to receive only the characteristic data of the recording data instead of receiving the recording data from the mobile communication terminal. May be

Hereinafter, a watermarking method of recording / recording data using a mobile communication network of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a general structure of a mobile communication system. In the mobile communication system, the base station (BS) 300 performs functions such as call processing and handoff, such as call establishment and call release, with the mobile communication terminal 100. In a CDMA system, a base station such as 1FA or 3FA is generally used. Have The switching center (MSC) 400 performs a function of enabling call processing by using a base station 300 to which the mobile communication terminal 100 belongs and another base station to which the mobile communication terminal 100 belongs to which the call is to be set up. do. The management server 200 provides watermarking information when recording is made in the mobile communication terminal.

When the mobile communication terminal 100 wants to make a recording, the start and end time of the recording (i.e., information on the time required for recording and the date and time when the recording was made), and recording The watermarking information is generated using the location of the mobile communication terminal 100 at the point of time, the ESN value of the mobile communication terminal 100 that has performed the recording, and inserted into the recording data. Information about the creation process of the can be stored effectively.

However, there are two problems in this case.

First, if the watermarking information is generated by the mobile communication terminal 100 and can be inserted into the recording data, information such as the start and end time of recording / recording, location information of the mobile communication terminal 100, ESN values, and the like can be obtained. Manipulation can also produce watermarking information, so legal evidence of recorded data will not be recognized. Accordingly, since the above information is transmitted to the management server 200 by using the mobile communication system, the watermarking information is generated by the management server 200, thereby ensuring the authenticity of the watermarking information itself. If the management server 200 is directly managed by a mobile communication provider or an organization for ensuring authenticity of data, it is possible to recognize that there was no manipulation of watermarking information. This can be understood if recalling the role of the financial settlement agency to ensure the authenticity and security of various data in the conventional electronic payment.

Second, if the watermarking information includes only the information such as the start and end time of recording / recording, the location information of the mobile communication terminal 100, the ESN value, and the like, the data can be stored with the reproduction time of the recording / recording data itself. You can manipulate it and save it again. There are two ways to solve this problem. One is to use a so-called fragile watermarking technique. That is, the watermarking information is broken even if the data in which the watermarking information is inserted is slightly modified. Unlike robust watermarking in which watermarking information is maintained despite the modification of the data, a fragile watermarking technique may be generally used for data authentication, but the watermarking information may be transferred from the mobile communication terminal 100. There is still room for security holes in that it is inserted into the recording data. That is, there is a disadvantage in that the deformation of the data cannot be prevented from occurring immediately before the watermarking information is received by the mobile communication terminal 100 and inserted into the recording / recording data. The second method to overcome this disadvantage is to generate a unique code in the management server 200 by analyzing characteristics such as the frequency of the recording / recording data. The unique code may be stored only in a DB connected with the management server 200 or included in watermarking information. However, if stored only in the DB connected to the management server 200, the watermarking information is stored in the serial number matching the unique code. Although the concept and generation method of the unique code will be described separately, it refers to unique data having a small size of about tens of bytes to several kilobytes generated based on recording data having a considerable size, recording time information, location information, etc. Additional information of may optionally be included. If a unique code is generated large enough, for example, several kilobytes, the probability of generating the same unique code is inversely proportional to the size of the unique code. If you transform the recording data very slight, when you create a unique code with the modified recording data after the transformation will generate a code completely different from the previous unique code will be generated in the DB connected to the management server 200 If it is stored, the management server 200 can be accessed at any time to check whether the recording data has been modified. On the other hand, if a unique code is included in the watermarking information other than the DB of the management server 200, the unique code is generated using the recording / recording data and compared with the unique code included in the watermarking information to determine whether the data is deformed. Can be.

However, it should be noted that the unique code itself must be generated in the management server 200 in order to prevent the unique code itself is modified in a hacking manner and transmitted to the management server 200, and the watermarking information is moved. The secret key required for decryption of the watermarking information should not be leaked to the outside of the management server 200 so that the communication terminal 100 cannot decrypt it.

If the watermarking information is inserted into the recording data and stored in the mobile communication terminal, the following requirements must be satisfied in order to obtain various information related to the recording data when the stored recording data is reproduced.

The management server 200 transmits the recorded data stored in the mobile communication terminal 100 to the management server 200 or extracts watermarking information from the recorded data and transmits the watermarking information to the management server 200. Using the received information, the recording / recording date and time, the terminal 100 where recording / recording was made, and the location of the recording / recording are extracted and transmitted to the mobile communication terminal 100. That is, data recorded and recorded using the mobile communication terminal 100 may be moved to another mobile communication terminal 100 and other devices, and the other mobile communication terminal 100 and other devices may be connected to the management server 200 as well. By doing so, various information related to the recorded data can be confirmed. The management server 200 extracts all information related to the recorded data by decrypting by using a secret key (corresponding key or private key) necessary for decryption when encrypting using a secret key when generating watermarking information. In this case, when the watermarking information includes a unique code, the management server 200 receives the watermarking information from the mobile communication terminal 100, removes the watermarking information from the recorded data, and then reconstructs the unique code. You can check whether the two match. If the unique code is not included in the watermarking information and is recorded only in the DB connected to the management server 200, the procedure is similar to the above procedure, but the serial number is recorded in the watermarking information instead of the unique code. It is different in that the process of additionally withdrawing the unique code from the DB connected to the management server 200 by using.

2 is a flowchart illustrating a watermarking method of recording / recording data using a mobile communication network of the present invention. Referring to Figure 2 will be described the flow when the recording / recording using the mobile communication terminal 100.

When the mobile communication terminal notifies the management server of the start of the recording using the mobile communication network, the management server in the ESN of the mobile communication terminal, the location information and recording of the mobile communication terminal at the time when the recording is started At least one of the disclosed time information is stored in the temporary memory (S101). When the mobile communication terminal wants to perform recording / recording using watermarking, a start signal is sent to the management server. In this case, the following procedure prevents the modulation of data recorded or recorded using the mobile communication terminal. Watermarking information is inserted, and the start and end time of recording (and thus, the total time of recording) is deduced, the telephone number of the mobile communication terminal, and the location information on which recording is performed are modified. Are stored safely without any risk. When the mobile communication terminal notifies the management server of the start of recording using the mobile communication network, the management server 200 can determine the current position of the mobile communication terminal 100. In this case, as a method of determining the position of the mobile communication terminal 100, a known technique such as a method of calculating a distance from the base station 300 to the mobile communication terminal 100 may be used, and the present invention is not limited thereto. No. In addition, the management server 200 receives the recording time and the ESN value of the mobile communication terminal is started in the mobile communication terminal 100 via the switching center (300).

That is, the mobile communication terminal 100 only sends a request for performing data communication with the management server 200 through the base station 300 and the switching center 400, and the management server 200 transmits the request. Recording start and end time information, current location information of the mobile communication terminal, and ESN values that are not explicitly transmitted by the terminal 100 are collected through the mobile communication network.

The management server receives data recorded in the mobile communication terminal in real time until the end of the recording in the streaming method (S102).

When the recording is finished, the mobile communication terminal 100 notifies the management server that the recording is finished by using the mobile communication network, and the location information and the recording of the mobile communication terminal at the time when the recording is finished. One or more pieces of information of the terminated time information are stored in the temporary memory (S103).

In this case, it is preferable that the recording / recording data received in real time is not stored in a storage device of the management server in consideration of the case of confidential data or private data. The unique code can be generated using the received data (S104). The unique code is generated at the same time as the reception of the recording data or the streaming data is received until the end of the recording. Unique code can be generated. If the recording data is temporarily stored in the management server before generating the unique code, delete it so that it cannot be recovered immediately after generating the unique code. The unique code is a relatively small size of data uniquely generated from the recording data as described above, and may selectively generate or use additional information such as recording time information and location information.

A management server generates watermarking information including at least one of the recording time information, the ESN, and location information of the mobile communication terminal and the unique code stored in the temporary memory, or the recording / recording stored in the temporary memory. Generate watermarking information including a serial number corresponding to at least one of time information, the ESN and location information of the mobile communication terminal and a unique code stored in a database (S105), and generate the generated watermarking information in the mobile communication. Transmission to the terminal (S106). The unique code is included in the watermarking information or is stored only in a database connected to the management server. The watermarking information may include only a serial number for retrieving the stored unique code. The mobile communication terminal receiving the watermarking information inserts and stores the received watermarking information into the recording data. When the watermarking information is generated by the management server 100, the mobile communication terminal 100 generates the watermarking information using a secret key so that the contents of the watermarking information cannot be known. That is, the secret key is used at the time of creation, not at the time of inserting the watermarking information, and the secret key is similarly used to decrypt the generated watermarking information. At this time, the secret key is preferably a private key that is not publicly known.

Another aspect of the invention is characterized in that the recording data is not transmitted to the management server 200.

When the mobile communication terminal notifies the management server of the start of the recording using the mobile communication network, the management server in the ESN of the mobile communication terminal, the location information and recording of the mobile communication terminal at the time when the recording is started At least one of the disclosed time information is stored in the temporary memory (S101).

However, instead of directly transmitting data recorded and recorded in the mobile communication terminal 100 to the management server 200, only characteristic data for generating a unique code is transmitted to the management server 200. In order to prevent data manipulation, it is desirable to be a real time transmission. To define the concept of unique codes and feature data, unique codes can be used for downsampling recorded data, other lossy compression techniques, frequency feature vectors, and other original data in a very small size (several bytes to kilos). Byte) means a code generated by an algorithm for converting into unique data, and as described above, additional information such as recording / recording time information, location information, and terminal information may be included or may be generated or modulated using the same. However, since the generation algorithm and the prediction unique code value of the unique code should not be known in the mobile communication terminal 100, the mobile communication terminal 100 transmits only the characteristic data necessary for generating the unique code to the management server 200. do. The feature data is data extracted from the recording data, and means raw data necessary for generating a unique code that cannot reproduce (insufficient) the recording data alone. The type of feature data required depends on the algorithm used to generate the unique code. By adopting this method, the mobile communication terminal 100 can be recognized the authenticity of the recording data without transmitting the recording data, which may be private or confidential data, to the management server 200.

The management server generates a unique code using the received feature data, and may optionally include or use additional information such as recording / recording time information and location information (S104). A management server generates watermarking information including at least one of the recording time information, the ESN, and location information of the mobile communication terminal and the unique code stored in the temporary memory, or the recording / recording stored in the temporary memory. Generate watermarking information including a serial number corresponding to at least one of time information, the ESN and location information of the mobile communication terminal and a unique code stored in a database (S105), and generate the generated watermarking information in the mobile communication. Transmission to the terminal (S106).

3 is a flowchart illustrating a watermarking method of recording / recording data using a mobile communication network of the present invention. Referring to Figure 3 will be described a process for obtaining information on the recorded data through the mobile communication terminal 100.

The stored recording data is received from the mobile communication terminal or the management server receives the watermarking information separated from the stored recording data and the characteristic data of the recording data from which the watermarking information is separated (S201). When receiving the recording data from the management server, it can be stored in the temporary memory in the limit for extracting the unique code, and does not permanently store the received recording data. The temporary memory may be a virtual memory or a swap memory on a storage device such as a RAM or a hard disk. If the recording data is not received as it is, the watermarking information is separated from the recording data stored in the mobile communication terminal, the separated watermarking information is transmitted to the management server, and the watermarking information is separated. As described above, characteristic data such as frequency characteristic used to generate a unique code is extracted from the data and transmitted to the management server.

The management server decodes the watermarking information to obtain a unique code, and generates a unique code using the recording / recording data (S202). If the recording data is directly received from the mobile communication terminal 100, the management server 200 first separates the watermarking information from the recording data, and then decrypts it using a secret key to include the unique data included in the watermarking information. Obtain the code. The secret key used to decrypt the watermarking information must be managed so that the private key is unknown to the management server. In addition, a unique code is generated from the recording data in which the watermarking information is separated. If the recording time information, the location information, the ESN, etc. are used at the time of generating the unique code, the unique code is generated using these pieces of information obtained by decoding the watermarking information.

If the mobile communication terminal 100 receives watermarking information and feature data, the watermarking information is decrypted using a secret key to obtain a unique code included in the watermarking information. Generate the code.

If the watermarking information includes a serial number for retrieving the unique code stored in the database connected to the management server instead of including the unique code, of course, the watermarking information is decrypted to obtain the serial number and then the database is used. The corresponding unique code is retrieved from.

The obtained unique code is compared with the unique code generated by the management server (S203). If the results of the comparison match, it is determined that the recording data has not been tampered with, and the recording result and the recording start and end time obtained by decoding the judgment result and the watermarking information, the location information or ESN value where the recording was made (or from the The known mobile phone number of the mobile communication terminal) can be transmitted to the mobile communication terminal. Therefore, the mobile communication terminal that has been recorded and the terminal that requests the management server for the modulation of the recording data and the recording / recording time information may be different. / Record data can be moved.

Another aspect of the present invention is characterized in that the watermarking information is inserted in the management server 200, it will be described with reference to FIG.

When the mobile communication terminal notifies the management server of the start of the recording using the mobile communication network, the management server in the ESN of the mobile communication terminal, the location information and recording of the mobile communication terminal at the time when the recording is started At least one of the disclosed time information is stored in the temporary memory (S301).

The management server receives the data recorded in the mobile communication terminal until the end of the recording / recording and stores in the temporary memory (S302).

When the mobile communication terminal notifies the management server of the end of the recording using the mobile communication network, one or more pieces of information of the location information of the mobile communication terminal and the time information on which the recording is started when the recording is terminated. It is stored in the temporary memory (S303).

The watermarking information is generated by generating watermarking information using at least one of the ESN of the mobile communication terminal stored in the temporary memory, the location information of the mobile communication terminal, and the time information when the recording or recording is started or finished (S304). Is inserted into the recording / recording data stored in the temporary memory (S305). In this case, a secret key may be used to generate and insert watermarking information, and a fragile watermarking technique may be used so that watermarking information may be easily removed when the recording / recording data into which the watermarking information is inserted is easily modulated.

When the recording data recorded with the watermarking information is transmitted to the mobile communication terminal (S306), the mobile communication terminal that receives the watermark information is stored in the memory. The recording / recording data in which the stored watermarking information is inserted is removed so that the watermarking information is removed at the time of modulation, so that the recording time, the location where the recording / recording is made, and the ESN value cannot be recognized.

In this case, the management server 200 uses the private key when inserting the watermarking information into the recording / recording data, and confirms the watermarking information by decrypting the recording / stored in the mobile communication terminal 100 using the public key. Anyone can play back the recorded data to check the watermarking information.

Although the present invention has been described with reference to examples, it is obvious that the invention described in the claims of the present invention is not limited to the examples but may be substituted or modified by other components which are considered equivalent. In particular, although the expression of recording / recording is used, this is merely an example of a method of recording a phenomenon using a digital recording device, and includes recording methods other than recording or recording. In particular, the recording is a recording of a continuous picture, the expression recording in the present invention is a concept including the taking of a still picture.

According to the present invention as described above, the start and end time of the recording / recording using the mobile communication terminal 100 can be specified as the time when the connection to the management server 200 in the mobile communication system to start the recording / recording And the end time and the duration of recording / recording become impossible. In addition, at the time when the mobile communication terminal 100 attempts to access the management server 200, the location information of the mobile communication terminal 100 can be easily grasped so that the place where the recording / recording is made cannot be operated. In addition, in the case of the mobile communication terminal 100, an identification number such as an ESN value and a corresponding telephone number is assigned to the mobile communication terminal 100. Thus, the mobile communication terminal 100 moves to an existing information about which mobile communication terminal 100 is used to record or record. Of course, there is an advantage that can be grasped by using a communication system.

According to the present invention, the mobile communication terminal 100 can objectively verify whether the recorded data is modulated and whether the recorded time information, location information, and terminal information are reliable. In addition, since the secret key used for encrypting the watermarking information can be disclosed, the legal proof ability of the recorded / recorded data can be recognized.

Claims

Receiving, by the management server, feature data extracted from data recorded and recorded in the mobile communication terminal in a temporary memory;

When the mobile communication terminal notifies the management server of the end of the recording using the mobile communication network, the management server is the location information of the mobile communication terminal and the time information when the recording is finished when the recording is finished Storing at least one of the information in a temporary memory;

Generating a unique code by using at least one of the recording / recording time information stored in the temporary memory, the ESN, the location information of the mobile communication terminal, and the received feature data;

The management server generates watermarking information including at least one of the recording / recording time information stored in the temporary memory, the ESN, the location information of the mobile communication terminal, and a unique code or a serial number corresponding to the unique code. 5 steps; And

6. The watermarking method of recording / recording data using a mobile communication network, comprising: transmitting the generated watermarking information to the mobile communication terminal.

delete

While receiving the data recorded in the mobile communication terminal in real time until the end of the recording in the streaming method and generates a unique code in real time from the received data in real time without storing the received recording data recording the unique code Storing only bay in temporary memory;

When the mobile communication terminal notifies the management server of the end of the recording using the mobile communication network, one or more pieces of information on the location information of the mobile communication terminal and the time information when the recording is terminated when the recording ends. Storing the data in a temporary memory;

The management server generates watermarking information including at least one of the recording / recording time information stored in the temporary memory, the ESN, the location information of the mobile communication terminal, and a unique code or a serial number corresponding to the unique code. 4 steps; And

The watermarking method of the recording / recording data using a mobile communication network, characterized in that consisting of five steps for transmitting the generated watermarking information to the mobile communication terminal.

delete

In the method to be processed in the management server connected to the mobile communication terminal through a mobile communication network,

2-1 step of decrypting the received watermarking information using a secret key to directly extract a unique code or to decrypt and extract a serial number and extract a unique code corresponding to the serial number extracted from the database;

Generating a unique code using the received feature data; And

3. The watermarking method of recording / recording data using a mobile communication network, comprising: comparing the unique code extracted in step 2-1 with the unique code generated in step 2-2.

delete

A first step of receiving stored recording data from a mobile communication terminal;

Separating watermarking information from the received recording data;

Step 3-1 to decode the watermarking information separated in the second step using a secret key to directly extract or decrypt the unique number to extract the serial number and to extract the unique number corresponding to the extracted serial number from the database. ;

Generating a unique code from the recording / recording data from which the watermarking information is separated in the second step;

4. The watermarking method of recording / recording data using a mobile communication network, comprising: comparing the unique code extracted in step 3-1 with the unique code generated in step 3-2.

delete

Receiving the data recorded by the mobile communication terminal until the end of recording and storing in a temporary memory;

Generating watermarking information using at least one of an ESN of the mobile communication terminal stored in the temporary memory, location information of the mobile communication terminal, and time information when recording or recording is started or finished;

Inserting the generated watermarking information into recording / recording data stored in the temporary memory; And

And transmitting the recording / recording data into which the watermarking information is inserted, to the mobile communication terminal. 6.

delete