KR100665337B1 - Apparatus and method for controlling upload and download of multimedia contents between personal portable terminal and pc - Google Patents

Abstract

Disclosed are an apparatus and method for controlling uploading and downloading of multimedia content between a personal portable terminal device and a PC using digital watermarking technology and header information of a media stream to increase the utilization of multimedia content. The control device receives a main processor for generating an encoded bitstream of multimedia content in the personal portable terminal device, a bitstream output from the main processor and uploaded to the PC, and identifies an identifier or user of the personal portable terminal device for the conditional download service. An information insertion unit for inserting additional information such as ID and control information for user authentication, and an information detection unit for detecting the additional information and the control information from the bitstream into which the information downloaded from the PC to the personal portable terminal device is inserted. When downloading the media content from the personal computer to the personal portable terminal device, if control information embedded in the multimedia content is detected, the download proceeds, otherwise the conditional download is performed by stopping the downloading.

Additional information, control information, personal digital assistant, conditional download, multimedia

Description

Apparatus and method for controlling uploading and downloading of multimedia content between personal mobile terminal device and PC {APPARATUS AND METHOD FOR CONTROLLING UPLOAD AND DOWNLOAD OF MULTIMEDIA CONTENTS BETWEEN PERSONAL PORTABLE TERMINAL AND PC}

1 is a conceptual diagram of an upload and download service of a personal portable terminal device and a PC which are conventionally serviced.

2 is a system schematic diagram for a conditional download service according to the present invention.

3 is a block diagram of a system structure of a personal portable terminal device in which an information insertion unit and an information detection unit are inserted to control a conditional download service according to the present invention.

4 is a block diagram of a system structure of a PC into which an information insertion unit and an information detection unit are inserted for controlling a conditional download service according to the present invention.

5 is a block diagram of an information insertion unit in the form of a watermark for inserting additional information and control information in the form of a watermark according to the present invention;

6 is a block diagram of a watermark type information detection unit for detecting watermark type information for a conditional download service using a digital watermarking technique in accordance with the present invention.

7 is a block diagram of an information insertion unit for inserting control information and additional information into header information of a bitstream in accordance with the present invention.

8 is a block diagram of an information detector for detecting additional information and control information for a conditional download service from header information of a bitstream in accordance with the present invention.

※ Explanation of codes for main parts of drawing

100, 500: personal portable terminal device 200, 400: PC

110: main processing unit 120: information insertion unit

130: internal memory 140: information detector

150: expandable memory 160: interface

170: storage device 180: storage device

122a, 142a: partial decoder 124a, 124b: additional information insertion unit

126a, 126b, 146a, and 146b: switches 128a and 128b: control information insertion section

129a: partial encoders 144a, 144b: additional information detector

148a and 148b: control information detector 300: internet

The present invention relates to an apparatus and a method for controlling uploading and downloading of multimedia content between a personal portable terminal device and a personal computer, and more particularly, using a digital watermarking technology and header information of a multimedia stream. An apparatus and a method for performing a conditional download in between.

Recently, with the development of processors, various demands of users for the utilization of multimedia contents are generated by the appearance of personal portable terminal devices capable of authoring and utilizing various multimedia such as MP3 phones, camera phones, and VOD phones. However, referring to FIG. 1, which shows a conceptual diagram of a personal portable terminal device and a PC upload and download service, which are conventionally serviced, in the personal portable terminal device 100 having multimedia capabilities currently used, the personal portable terminal device Although uploading from the 100 to the PC 200 is possible, the downloading from the PC 200 to the personal portable terminal device 100 is not permitted in principle as a measure for protecting the paid content business rights of the wireless content provider (CP). have.

As described above, disallowing downloading from a personal computer to a personal portable terminal device is a factor in reducing the utilization of an expensive personal portable terminal device having a capability of authoring and utilizing various multimedia contents. Therefore, a user may not use sufficient functions of the device even if he purchases an expensive personal portable terminal device having multimedia capability.

Therefore, the end user of a personal mobile terminal device uploads a media asset created by the user to a PC or a public network so that it can be distributed to everyone who has access to a specific group or public network designated. There is an increasing demand to allow other users with access to the public network to download from their PCs to personal portable terminal devices with built-in detectors.

An object of the present invention is to increase the usability of media content such as moving images, still images, voices, etc., which are authored directly by a user through recording, shooting, recording, etc. in a personal portable terminal device such as a mobile phone or a PDA. In order to enable conditional downloading service from user's PC to personal portable terminal device, additional information and control information is inserted and detected in the multimedia bitstream by using digital watermarking technique in real time or offline, thereby detecting personal portable terminal device from PC. The present invention provides an apparatus and method for controlling a download service to a network.

Another object of the present invention is to insert a control information or additional information directly into the header information of a multimedia bitstream, detect, and interpret it to enable conditional downloading service from a personal portable terminal device user's PC to the personal portable terminal device. An apparatus and method for controlling a downloading service from a personal portable terminal device to a personal portable terminal device are provided.

Another object of the present invention is to extend the application such as to be used as evidence of the court through the integrity verification of the forgery and tampering as other utilization of the authentication information according to the insertion of header information or watermark as well as conditional downloading service. To make it possible.

In order to achieve the object of the present invention as described above, the present invention provides an apparatus for controlling the upload and download of multimedia content between a personal portable terminal device and a PC.

The control apparatus according to the present invention receives the bitstream output from the bitstream generating means and the means for generating the encoded bitstream of the multimedia content in the personal portable terminal device, uploaded to the PC, the information for the conditional download service And an information detector for detecting the information from the bitstream into which the information downloaded from the PC to the personal portable terminal device is inserted.

Both the information insertion unit and the information detection unit according to the present invention can be included in a personal portable terminal device or in a PC.

In addition, to achieve the object of the present invention, the present invention provides a method for controlling the upload and download of multimedia content between a personal digital assistant and a PC.

The control method according to the present invention comprises the steps of: generating an encoded bitstream of the multimedia content in a personal portable terminal device, receiving a bitstream uploaded to a PC, inserting information for a conditional download service, and personal from a personal computer. And detecting information from the bitstream into which the information downloaded to the portable terminal device is inserted.

In one embodiment according to the invention, the information comprises control information in the form of a watermark, preferably further comprising additional information in the form of a watermark.

Further, in another embodiment according to the present invention, the information includes control information directly inserted in the header information of the bitstream, and preferably further includes additional information inserted directly in the header information of the bitstream.

According to the present invention, the insertion of the additional information and the detection of the additional information are selectively performed before the insertion of the control information and the detection of the control information, respectively. In addition, when the control information is extracted from the control information detection unit, the control device continues to download the multimedia content, otherwise performs the conditional download by stopping the download of the multimedia content at that time.

In the present invention, the additional information may be information such as an identifier or a user ID of a personal portable terminal device such as an electronic serial number (ESN) or a telephone number, and the control information is information for user authentication.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

2 is a schematic diagram of a system for a conditional download service according to the present invention, and FIG. 3 is a diagram illustrating a system structure of a personal portable terminal device in which an information insertion unit and an information detection unit are inserted to control a conditional download service according to the present invention. A block diagram is shown.

2 and 3, control information and additional information for controlling conditional download are inserted to upload media content stored in the internal memory 130 in the personal portable terminal device 100 to the PC 200. . The uploaded media content may be shared in the public network 300 and the shared content is downloaded to the PC 400 of another user who is connected to the public network 300. Thereafter, it is possible to download the personal portable terminal device 500 of another user with a built-in detector. When the media content is downloaded from the PC 400 to the personal portable terminal device 500, the media content passes through the information detector 140. In order to be allowed to load the memory from the information detector 140, control information must be detected. If the control information is not detected, the downloading operation is immediately stopped at the point where it is not detected, and if the control information is normally detected, the media content is stored in the internal memory 130 to enable conditional download.

In the uploading process from the personal portable terminal device 100 to the PC 200, the main processing unit 110 performs a series of operations such as recording or photographing an image and recording a voice to convert multimedia content such as JPEG or MPEG. A bitstream encoded in a standardized compressed format is generated, and then the bitstream is output to the information inserting unit 120. Common target content referred to in the present invention is audio, still images, video, and the like. In the information insertion unit 120, information for the conditional download service is inserted into the bitstream of the multimedia content. Thereafter, the bitstream of the embedded multimedia content is stored in the internal memory 130 in the personal portable terminal device 100. Thereafter, the stored multimedia content is uploaded to the PC through the interface 160 between the personal portable terminal device 100 and the PC 200.

In the downloading process from the PC 200 according to this embodiment to the personal portable terminal device 100, the information is transmitted from the PC 200 via the interface 160 between the personal portable terminal device 100 and the PC 200. The bitstream of the multimedia content is downloaded to the detector 140. The information detector 140 checks whether the bitstream of the downloaded multimedia content includes control information for enabling conditional download. If the control information is not confirmed, the download of the multimedia content is stopped at that point, and if the control information is confirmed, the download of the multimedia content continues, and thereafter, the internal memory 130 in the personal portable terminal device 100 is moved. Conditional download is performed by being stored in.

The memory used in this embodiment may be an extended memory 150 such as an internal memory 130 of a personal portable terminal device, a multi-media card (MMC) card, or a secure digital (SD) card. Since the media content in which the control information is inserted is not affected by the insertion of the control information during playback in the dedicated player or the general-purpose player, it is possible to play freely in the playback device capable of playing the media format as well as in the portable terminal device.

There are two paths for playing back media content stored in the memories 130 and 150 in the personal portable terminal device 100. One is when playback is performed in the internal memory 130 and the other is when playback is performed in the extended memory 150. The case where the media content is played back in the internal memory 130 does not cause a special problem, but some problems may occur when the media content is played back in the expandable memory 150 such as a removable MMC card. For example, the problem is that the media content is stored in the extended memory 150 in a format reproducible in the personal portable terminal device in a PC environment or other environment, and then the media content stored in the extended memory 150 is stored in the personal portable terminal device ( Occurs when playback is performed immediately without passing through the information detection unit 140 in the operation 100. In other words, the downloaded media content can be played back regardless of whether the control information is detected or not, which is contrary to the conditional download according to the present invention.

In order to prevent such a problem, when the multimedia content stored in the expandable memory 150 is played back, the information detecting unit 140 checks whether the control information is inserted into the multimedia content, and then, in the main processor 110, the media content is stored. Let it play Similarly, even when the media content is copied from the expandable memory 150 to the internal memory 130, the above-described problems due to the use of the expandable memory 150 can be solved by causing the media content to pass through the information detector.

Hereinafter, as another embodiment according to the present invention, a system structure of a PC into which an information insertion unit and an information detector are inserted will be described. FIG. 4 is a block diagram of a system structure of a PC into which the information insertion unit and the information detection unit are inserted. Illustrated.

As shown in FIG. 4, both the information insertion unit 120 and the information detection unit 140 are located in the PC 200. That is, when the control information for controlling the conditional download is not inserted in the personal portable terminal device 100 and the necessity of sharing is determined, the manager program 170 of the PC 200 is uploaded to the PC 200. Inserted by the plug-in information insertion unit 120 is shared by the PC 200 and the public network (300). When downloading to the PC 200, the information detection unit 140 included as a plug-in of the manager program 170 detects the control information and determines whether to download it. However, such an implementation is not difficult or expensive, but there is a possibility that the security may be compromised when the information insertion unit 120 and the information detection unit 140 in the manager program are cracked by a malicious user. have.

In addition to the above-described embodiment, a method of placing the information detecting unit 140 in the PC 200 with only the information insertion unit 120 in the personal portable terminal device 100, and having only the information detecting unit 140 in the personal portable terminal device 100. There may be a method of placing the information insertion unit 140 in the PC. You may choose one of these methods that is optimized for stability or cost.

 In one embodiment according to the present invention, the information inserted in the information insertion unit 120 is additional information and control information in the form of a watermark.

5 is a block diagram of an information insertion unit in the form of a watermark for inserting additional information and control information in the form of a watermark according to the present invention.

As shown in Fig. 5, the watermark type information insertion unit 120 according to this embodiment includes a partial decoding unit 122a, an additional information insertion unit 124a, a control information insertion unit 128a, and a partial encoding unit. 129a, and is located at the next stage of the main processing unit 110 in the personal portable terminal device 100 as shown in FIG.

The partial decoder 122a receives a bitstream of the encoded media content from the main processor 110 and performs variable length decoding (VLD) as partial decoding on the bitstream in order to insert watermark type information. Entropy Decoding) is performed to obtain quantized DCT coefficient values. Insertion of information In order to minimize the computational complexity, a technique of inserting additional information in the form of watermark into the DCT coefficient region is used.

The additional information inserting unit 124a first determines a coefficient into which the watermark type additional information in the low frequency region is to be inserted among the variable length decoded coefficients input from the partial decoding unit 122a and encodes the additional information to be inserted. . In this encoding process, a secret key may be used for security. Then, the bit string of the encoded side information is inserted into the determined coefficient. The quantized coefficient data into which the bit string of the additional information is inserted is output to the control information inserting unit 128a. The additional information insertion unit 124a in the form of a watermark generally adopts a robust watermarking technique among digital watermarking techniques.

Insertion of the additional information may optionally be performed by the switch 126a before inserting the control information and is actually independent of the control information for the conditional downloading service. The additional information may be information such as an identifier or a user ID of a personal portable terminal device such as an electronic serial number (ESN) or a telephone number. Through this additional information, when a secretly taken image such as a camera is secretly shared without a consent of a photographer, illegal users can be tracked. Therefore, the additional information may be arbitrary information so that such extended application is possible.

The control information inserting unit 128a first determines a coefficient into which the control information in the form of a watermark is inserted among the quantized DCT coefficients. Then, all coefficients except the coefficient into which the control information is inserted are input into the Message Digest part (not shown). In this embodiment, MD2, MD4, MD5 among hash algorithms are used as a method for message digest. Thereafter, the result value of the message digest as control information is inserted into the determined coefficient. Here, in the method of inserting control information, the output value of the current message digest may be directly inserted, but the stored value generated in the previous frame or block may be inserted. Finally, the coefficient values into which the control information is inserted are partially encoded (generally variable length encoded) and stored in the internal memory 130 as a bitstream of the embedded media content.

 6 is a block diagram of a watermark type information detection unit for detecting watermark type information for a conditional download service using a digital watermarking technique according to the present invention.

As shown in Fig. 6, the watermark form information detector 140 according to this embodiment is a partial decoder 142a, additional information detector 144a, and control as a key part for determining continuous conditional downloading. An information detection unit 148a is provided, and is located next to the input (download) interface 160 of the personal portable terminal device 100 as shown in FIG.

When a partial bitstream of the multimedia content downloaded from the PC 200 is input, the partial decoding unit 142a performs partial decoding on the bitstream to detect quantized DCT coefficients so as to detect watermark type information. Acquire.

The additional information detection unit 144a determines a coefficient into which the additional information in the form of a watermark is inserted among the quantized coefficients output from the partial decoding unit 142a, and extracts a bit string of the additional information from this coefficient. Thereafter, message decoding is performed on the extracted bit string of the additional information to detect the additional information. In this decryption process, a secret key may be used for security. Of course, the secret key used for information detection is the same as the secret key used for information insertion. Thereafter, the quantized coefficient data from which the bit string of the additional information is extracted is output to the control information detector 148a. The side information detection can optionally be performed by the switch 146a before inserting the control information.

Thereafter, the control information detector 148a determines the coefficient into which the control information in the watermark form is inserted, extracts the control information, and message digests all coefficients except the coefficient into which the control information is inserted. Thereafter, the control information detection unit 148a compares the result value of the message digest with the extracted control information. In this case, if the result value of the message digest coincides with the extracted control information, the download of the multimedia content is continued. Otherwise, the download of the multimedia content is stopped at that point, thereby enabling conditional download of the multimedia content.

In another embodiment according to the present invention, the information inserted in the information insertion unit 120 shown in FIG. 3 is additional information and control information inserted directly in the header of the bitstream. In this embodiment, the information insertion and information detection using the header information of the bitstream is the same as the method and concept of using the watermarking technique, but directly uses the header information of the bitstream rather than the watermarking technique to insert information. Is different.

7 is a block diagram of an information insertion unit for inserting control information and additional information into header information of a bitstream according to the present invention.

Referring to Fig. 7, the information insertion unit 120 of this embodiment includes an additional information insertion unit 124b and a control information insertion unit 128b. Preferably, the side information inserting unit 124b encodes the side information to be inserted, and then inserts a bit string of the encoded side information into a specific header of the bitstream of the media content, and thereafter, the side information has been inserted. Is output to the control information inserting unit 128b. In this way, the insertion of the additional information is selectively performed by the switch 126b before the insertion of the control information.

The control information inserter 128b receives the bitstream of the encoded media content from the main processor 110 and digests the message, and inserts the result of the message digest directly into a specific header of the bitstream. Thereafter, the bitstream in which the control information is inserted into the specific header is stored in the internal memory 130.

8 is a block diagram of an information detector for detecting additional information and control information for a conditional download service according to the present invention from header information of a bitstream.

Referring to Fig. 8, the information detector 140 of this embodiment includes an additional information detector 144b and a control information detector 148b. The additional information detection unit 144b extracts a bit string corresponding to the additional information from the header of the bit stream of the multimedia content downloaded from the PC 200, and performs message decoding on the extracted bit string of the additional information. The additional information is then detected. Thereafter, the bitstream of the multimedia content from which the additional information is detected is output to the control information detector 148b. Detection of the additional information is optionally performed by the switch 146b before the detection of the control information.

The control information detection unit 148b extracts the control information from the header of the bitstream of the multimedia content downloaded from the PC 200, message digests the bitstream of the media content, and then extracts the extracted control information and the message digest. Compare the results. If the result value of the message digest matches the extracted control information, the download of the multimedia content is continued. Otherwise, the download of the multimedia content is stopped at that point, thereby enabling conditional download.

The foregoing description of the disclosed embodiments is provided to enable any person skilled in the art to make use of the invention. Many variations of these embodiments will be apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Accordingly, the invention is not limited to the embodiments disclosed herein, and the invention is given the broadest scope consistent with the principles and novel features disclosed herein.

According to the present invention, it is possible to conditionally download a downloading service from a PC to a personal portable terminal device, which is currently impossible, thereby increasing user convenience and increasing utilization of a high-performance terminal portable device.

In addition, as an additional function of the present invention, by enabling the integrity authentication of the forgery operation for the content authored by the user, it is possible to make the content authored by the user, such as accident scene shooting, to be adopted as legal evidence.                     

By inserting the information of the terminal into the media content through the information inserted as a watermark, it is easy to apply various enlargement applications such as extracting user information on illegal use.

Claims (12)

An apparatus for controlling uploading and downloading of multimedia content between a personal mobile terminal device and a PC, Means for generating an encoded bitstream of the multimedia content in the personal portable terminal device; An information insertion unit which receives the bitstream output from the bitstream generating unit and uploaded to the PC, and inserts information for a conditional download service; And And an information detector for detecting the information from the bitstream into which the information downloaded from the PC to the personal portable terminal device is inserted. And downloading the multimedia content only when the information is extracted. The method of claim 1, The information includes control information in the form of a watermark, The information insertion unit, A partial decoder for performing partial decoding on the bitstream output from the bitstream generating means to obtain quantized coefficients; A control information insertion unit for inserting the control information for the conditional download service into the quantized coefficients; And A partial encoder which partially encodes the coefficient into which the control information is inserted; The information detector, A partial decoder for performing partial decoding on the bitstream into which the control information is inserted to obtain quantized coefficients; And And a control information detector for extracting the control information from the quantized coefficients. The method of claim 2, The information further includes additional information in the form of a watermark, The information inserting unit further includes an additional information inserting unit inserting the additional information into the quantized coefficients. The information detector further includes an additional information detector for detecting the additional information from the quantized coefficients, The insertion of the additional information and the detection of the additional information are selectively performed before the insertion of the control information and the detection of the control information, respectively. The method of claim 1, The information includes control information inserted directly into the header information of the bitstream, The information inserter includes a control information inserter for directly inserting the control information for a conditional download service into specific header information of the bitstream. And the information detector comprises a control information detector for extracting the control information for the conditional download service from the header information of the bitstream. The method of claim 4, wherein The information further includes additional information inserted directly into the header information of the bitstream, The information inserting unit further includes an additional information inserting unit inserting the additional information into specific header information of the bitstream output from the bitstream generating unit, The information detector further includes an additional information detector for extracting the additional information from the header information of the bitstream, And the additional information insertion and additional information detection are selectively performed before the control information insertion and control information detection, respectively. A personal portable terminal device comprising the information insertion unit and the information detection unit according to any one of claims 1 to 5. A PC comprising the information insertion unit and the information detection unit according to any one of claims 1 to 5. A method for controlling uploading and downloading of multimedia content between a personal digital assistant and a PC, Generating an encoded bitstream of the multimedia content in the personal portable terminal device; Receiving the bitstream uploaded to the PC and inserting information for a conditional download service; And Detecting the information from the bitstream into which the information downloaded from the PC to the personal portable terminal device is inserted; And downloading the multimedia content only when the information is extracted. The method of claim 8, The information includes control information in the form of a watermark, The information insertion step, Performing partial decoding on the bitstream to obtain quantized coefficients; Inserting the control information for a conditional download service into the quantized coefficients; And Partially encoding a coefficient into which the control information is inserted; The information detection step, Performing partial decoding on the bitstream into which the control information is inserted to obtain quantized coefficients; And Extracting the control information from the quantized coefficients. The method of claim 9, The information further includes additional information in the form of a watermark, The inserting of the information further includes inserting the additional information into the quantized coefficients. The detecting of the information further includes detecting the additional information from the quantized coefficients. The insertion of the additional information and the detection of the additional information are selectively performed before the insertion of the control information and the detection of the control information, respectively. The method of claim 8, The information includes control information inserted directly into the header information of the bitstream, The information inserting step includes directly inserting the control information for a conditional download service into specific header information of the bitstream. And the information detecting step includes extracting the control information for the conditional download service from the bitstream header information. The method of claim 11, The information further includes additional information inserted directly into the header information of the bitstream, The information inserting step further includes inserting the additional information into specific header information of the bitstream output from the bitstream generating means, The detecting of the information further includes extracting the additional information from the bitstream header information. The insertion of the additional information and the detection of the additional information are selectively performed before the insertion of the control information and the detection of the control information, respectively.

Images