CN1708084A - Apparatus for identifying a photographer of an image - Google Patents
Apparatus for identifying a photographer of an image Download PDFInfo
- Publication number
- CN1708084A CN1708084A CNA2005100735901A CN200510073590A CN1708084A CN 1708084 A CN1708084 A CN 1708084A CN A2005100735901 A CNA2005100735901 A CN A2005100735901A CN 200510073590 A CN200510073590 A CN 200510073590A CN 1708084 A CN1708084 A CN 1708084A
- Authority
- CN
- China
- Prior art keywords
- image
- watermark
- data
- stream
- identifying information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8358—Generation of protective data, e.g. certificates involving watermark
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
- H04N2201/3226—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Editing Of Facsimile Originals (AREA)
- Image Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Disclosed is an apparatus for processing image data in a portable terminal equipped with a camera. In the apparatus the image data photographed by the camera are coded by a predetermined coding scheme in a photographing mode of the camera, header information of a stream of the coded image data is generated and inserted into the stream, identifying information is generated as a watermark and the watermark is inserted into the stream, and the stream comprising the watermark is stored.
Description
Technical field
The present invention relates to a kind of equipment of image processing of the terminal that is used for being equipped with camera.More particularly, the present invention relates to a kind of equipment that is used for the identification information of portable terminal is inserted into the image of shooting.
Background technology
Usually, image processing equipment comprises camera that is used for photographic images and the display unit that is used to show the picture signal of being taken by camera.Camera can use charge coupled device (CCD) transducer or complementary matal-oxide semiconductor (CMOS) transducer, and display unit can use LCDs (LCD).Along with the microminiaturization of camera, the equipment that is used for photographic images is also microminiaturized day by day.At present, microminiaturized digital camera comes into vogue, and camera is installed on the portable terminal.This portable terminal can photographic images, is motion picture or still frame with the image transitions of taking, and shows motion picture or still frame.In addition, portable terminal also can send to the base station with the image of taking.
Because the digital camera of aforesaid microminiaturization can easily carry also photographic images easily, so they come into vogue.In addition, carried out by mode because use microminiaturized digital camera to take, so audible indication is not provided when taking pictures with electricity.In this case, owing to can under situation about agreeing, take this another people in confidence by portable terminal without another people, so may invade this another people's privacy.Audible indication appears in therefore, current laws and regulations requirement automatically when taking pictures by digital camera.That is, be installed in shooting generation " ticktock " sound that the camera on the portable terminal is carried out by use.This is to be used for notifying other people: by the portable terminal taking photo.
Yet even " ticktock " sound occurs automatically, but other people possibly can't hear this " ticktock " sound under noisy environment.In addition, when the user who uses micro-camera forbade that " ticktocks " occurs, another people can not just recognize and is taken.
And, along with the development of internet etc., because the photo of being taken in confidence can be uploaded to website etc. as mentioned above, so people's privacy can be invaded.Therefore, there are needs, promptly by this terminal, when carrying out by camera when taking, about taking pictures or the terminal information of video can be inserted in the photo to such portable photographic terminal.Therefore, can solve the above problems.
Summary of the invention
Therefore, the present invention is suggested to solve the above-mentioned the problems of the prior art that appear at, and an object of the present invention is to provide a kind of equipment in carrying out the image that the terminal information that is equipped with camera can be inserted into shooting when taking.
Another object of the present invention provides a kind of like this equipment, it is used for the information that is equipped with the portable terminal of camera to be inserted into the image of shooting when carry out taking, and can extract this by the terminal that receives image and be inserted into the information of image and the owner of identification terminal.
Another object of the present invention provides a kind ofly can be compressed and encode by the image of the portable terminal taking that is equipped with camera and will be inserted into the equipment of image encoded about this terminal information.
Another object of the present invention provides a kind of like this equipment and method, it is used to compress and encodes and is inserted into image encoded by the image of the portable terminal taking that is equipped with camera and with photographer's information, thereby receiver extracts about this terminal information from this image, decoding also shows the image that compresses, and checks the end message of this extraction.
Another object of the present invention provide a kind of can be with by the image compression of the portable terminal taking that is equipped with camera and be encoded to still frame and identifying information be inserted into the equipment and the method for the image stream of this still frame.
Another object of the present invention provide a kind of can be with by the image compression of the portable terminal taking that is equipped with camera and be encoded to the resultant motion picture of still frame and identifying information be inserted into the equipment and the method for the image stream of this resultant motion picture.
Another object of the present invention provide a kind of can be with by the image compression of the portable terminal taking that is equipped with camera and be encoded to motion picture and identifying information be inserted into the equipment and the method for the image stream of this motion picture.
Description of drawings
By the detailed description below in conjunction with accompanying drawing, above and other purpose of the present invention, characteristic and advantage will become clearer, wherein:
Fig. 1 is the block diagram that illustrates according to the portable terminal that is equipped with camera of the embodiment of the invention;
Fig. 2 is the block diagram that illustrates according to the image processor of Fig. 1 of the embodiment of the invention;
Fig. 3 is the schematic diagram that illustrates according to the image encoding/decoding device among Fig. 2 of the embodiment of the invention, the figure shows the process that is inserted into the image that is taken according to the identifying information of the embodiment of the invention;
Fig. 4 illustrates the schematic diagram that is inserted in the structure of JPEG (joint photographic experts group) (JPEG) stream wherein according to the identifying information of the embodiment of the invention;
Fig. 5 illustrates the schematic diagram that is inserted in the structure of JPEG 2000 streams wherein according to photographer's information of the embodiment of the invention;
Fig. 6 illustrates the schematic diagram that is inserted in the structure of motion jpeg stream wherein according to photographer's information of the embodiment of the invention;
Fig. 7 illustrates the schematic diagram that is inserted in the structure of Motion Picture Experts Group (MPEG) stream wherein according to photographer's information of the embodiment of the invention;
It is the schematic diagram that is inserted in the structure that H.264 flows wherein according to photographer's information of the embodiment of the invention that Fig. 8 illustrates; And
Fig. 9 is the schematic diagram that illustrates according to the image encoding/decoding device among Fig. 2 of the embodiment of the invention, the figure shows the process that identifying information is extracted from the view data that comprises end message.
Embodiment
Here will be described in detail embodiments of the invention with reference to accompanying drawing below.
In the following description, the specific project such as picture signal form, transport packet format and image compression scheme is exemplary.Be that the present invention can easily be implemented under the situation of the specific examples that does not have to show for what it will be apparent to those skilled in the art.
Hereinafter, the method that identifying information will be inserted into the data format of image encoded is described.In addition, identifying information can be inserted into such as still image and such as the image of the shooting of the motion picture of video.This identifying information can comprise the electronic fingerprint of the device of this image of identification seizure uniquely.In an embodiment of the present invention, will be installed in this hypothesis on the portable terminal and provide description based on camera.Yet the present invention also can be applied to traditional independent digit camera.In addition, according to embodiments of the invention, under the situation of portable terminal, Electronic Serial Number (ESN) or subscriber directory number can be used as identifying information.This information is stored in the database of concentrating that is associated with user's account.Therefore the owner of terminal can be positioned based on ESN or telephone number.Under the situation of camera, the sequence number of camera can be used as identifying information.And the time of shooting and position also can be added to identifying information.
Fig. 1 is the block diagram that illustrates according to the portable terminal that is equipped with camera of the embodiment of the invention.This portable terminal can comprise portable phone.
With reference to Fig. 1, the radio communication function of portable phone is carried out in radio frequency (RF) unit 121.RF unit 121 comprises: be used for conversion and the RF transmitter (not shown) of the frequency of the signal that amplify to send, be used for low noise and amplify the signal that receives and the RF receiver (not shown) etc. of the frequency of the signal that receives of conversion down.Data processor 120 comprises: be used for signal encoding that sends and the transmitter (not shown) of modulation, be used for the signal demodulation of reception and the receiver (not shown) of decoding etc.Data processor 120 can comprise modulator-demodulator and coding decoder.The signal of modulator-demodulator modulation or demodulation transmissions/reception, and can use various types of modulator-demodulators such as the different technology of code division multiplex (CDMA), global system for mobile communications (GSM), Universal Mobile Telecommunications System (UMTS) etc. by use.Coding decoder comprises: the digital coding decoder is used for handling and transmits and receive data etc.; And audio coder-decoder, be used to handle the audio signal of transmission/reception.
Key input unit 123 comprises the key that is used for input digit and text message and is used to be provided with the function key of various functions.Communications interface unit 125 is connected to external equipment by the communications cable and carries out serial communication function with external equipment under the control of controller 100.
Global positioning system (GPS) receiver 170 receives GPS information from gps satellite and sends to controller 100 with the GPS information that will receive.GPS information can be the information about the current location of portable phone.In an embodiment of the present invention, camera site or positional information and temporal information can be received by gps receiver 170.
With reference to Fig. 1, when portable phone used the channel of CDMA scheme, the modulator-demodulator of data processor 120 can be the modulator-demodulator that meets the CDMA scheme.According to embodiments of the invention, data processor 120 comprises the audio coder-decoder to audio-frequency signal coding or decoding.
Portable phone can be taken people or environment on every side and the image of the people that takes or environment on every side shown or send according to an embodiment of the invention.Camera unit 140 can be equipped with or can be connected to the preposition of the outside of portable phone with portable phone.That is, camera unit 140 can be external types of cameras or built-in types of cameras.Camera unit 140 can comprise: be used for the transducer of photographic images, the picture signal that is used for being taken by transducer is converted to signal processor of numerical data etc.Transducer can use cmos sensor or ccd sensor.The image of being taken by camera unit 140 is converted into the signal of telecommunication by internal sensor, and signal processor is converted to DID with the picture signal of taking.The data image signal and the synchronizing signal of conversion are output to image processor 150.Synchronizing signal can comprise horizontal-drive signal (Hsync), vertical synchronizing signal (Vsync) etc.
Fig. 2 is the block diagram of demonstration according to the structure of the image processor 150 of the embodiment of the invention.Picture signal between 150 pairs of camera units 140 of image processor and the display unit 160 is set up interface and is carried out from the image signal encoding of camera unit 140 inputs and the function of decoding.As mentioned above, image processor 150 comprises the image encoding/decoding device 250 that is used for image signal encoding and decoding.In an embodiment of the present invention, image encoding/decoding device 250 can be JPEG coding decoder, motion JPEG coding decoder, mpeg codec or coding decoder H.264.
With reference to Fig. 2, camera interface unit 211 is carried out set up the function of interface from the view data of camera unit 140 outputs.In an embodiment of the present invention, suppose that from the view data of camera unit 140 outputs are view data of yuv format, and display unit 160 shows the view data of rgb format.
The picture signal that scaler 213 is taken by camera unit 140 according to the control signal calibration of slave controller 100 output is so that this picture signal can be displayed on the display unit 160.Scaler 213 will reduce and be cropped to the pixel count that can be displayed on the picture signal on the display unit 160 from the pixel of the picture signal of camera unit 140 output.Yet, have greater than from the view data of the size of the size of the view data of camera unit 140 output the time when display unit 160 can show, scaler 213 can be designed to amplify under the control of controller 100 and show from the picture signal of camera unit 140 outputs.According to amplifying the also method of display image signals, among the pixel of the picture signal of camera unit 140, select the so much intended pixel of pixel count that can be displayed on the picture signal on the display unit 160 from output, and the pixel of selecting is displayed on the display unit 160.
Image encoding/decoding device 250 can be carried out under the control of image process controller 200 the shot image data coding or recover the function of image encoded data.Image encoding/decoding device 250 is imported under the control of image process controller 200 and is encoded from the camera image signal of color converter 215 outputs or the picture signal that shows at display unit 160 by predetermined encoding scheme.In addition, image encoding/decoding device 250 is inserted into identification information the image encoded data and produces the image encoded data.And image encoding/decoding device 250 from image encoded extracting data identification information, perhaps outputs to scaler 213 or LCD interface unit 217 to the image encoded data decode and with decoded image data under the control of image process controller 200.Here, image process controller 200 also can be handled the key data from key input unit 123 during handling image.In an embodiment of the present invention, description is presented based on such hypothesis, promptly, controller 100 is checked the key data from key input unit 123, and with this key data be sent to image process controller 200 when relating to image processing with this key data of box lunch image process controller 200 carry out the order that relates to image processing.
The generation operation of image process controller 200 control image processors 150.That is, image process controller 200 is controlled display unit 160 and is used to show generation operation by camera unit 140 shot image data with control under the control of controller 100.Image process controller 200 control charts as coding decoder 250 identification information is inserted into the identification information that view data or extraction are inserted into view data.According to the method that identification information is inserted into view data, identification information can be fetched water prints to view data, and identification information can be fetched water to print to image data stream or be embedded in the data flow.In an embodiment of the present invention, describe to be presented based on such hypothesis, that is, identification information is fetched water prints to image data stream, and this view data is encoded, and identifying information is fetched water and printed to the image encoded data flow.In addition, can make in this way: before view data is encoded, identifying information is inserted into view data and comprising the coded image data of this identifying information.
Memory 230 is stored or output image data under the control of image process controller 200.The view data that is stored in view data in the memory 230 and can is shot image data or in portable terminal, receive.
With reference to Fig. 2, under the image taking pattern, controller 100 is transferred to image process controller 200 with the control of image processing.Then, image process controller 200 control slave controllers 100 send will be displayed on user data on the display unit 160.In addition, image process controller 200 control allows to be displayed on picture signal that operation on the display unit 160 and the order by the user allow to take by camera unit 140 shot image data and is stored in operation in the memory 130.That is, only when communication function was performed, controller 100 controls related to the operation of communication and the operation of control display unit 160.Suppose the general operation of image process controller 200 control display unit 160 under the communication wait state.When having selected the operation of camera unit 140, the general operation of image process controller 200 control portable terminals.
Hereinafter, will send to the operation of display unit 160 by the picture signal that camera unit 140 is taken with describing.At first, image processor 150 is handled by the picture signal of camera unit 140 shootings and the picture signal that will handle and is presented on the display unit 160.Here, the scaler 213 of image processor 150 can remove some from the pixel of the picture signal of camera unit 140 output so that this picture signal can be displayed on the display unit 160, perhaps can select to comprise the presumptive area of some pixels and the zone of this selection of convergent-divergent.In this case, the picture signal of shooting is not stored in the memory 230 but is displayed on the preview screen of display unit 160.When picture signal was displayed on the preview screen, the image encoding operation was not performed, and photographer's information is not inserted into the picture signal of shooting.
In addition, in the process on the picture screen that will be presented at display unit 160 by the picture signal that camera unit 140 is taken, the user can store the data presented signal.That is to say that the user can be by selecting the function key relevant with image processing or selecting the function relevant with image processing to store the picture signal of demonstration from key input unit 123 from menu.When taking the order generation, image process controller 200 control charts as coding decoder 250 with to encoding by the picture signal of camera interface unit 211 input, identifying information is inserted in the stream of image encoded data, photographer's information fetched water prints to view data, and in memory 230 storing image data.When the view data of view data of storing or reception was reproduced, image processing control unit 200 control charts were arrived the identifying information of view data by watermark with extraction as coding decoder 250.250 pairs of image encoded data of image encoding/decoding device decode and the view data of output decoder to scaler 213, thereby decoded image data is displayed on the display unit 160.Image process controller 200 can show photographer's information of extracting by selector 219 on display unit 160.
Fig. 3 is the schematic diagram of image encoding/decoding device 250.Fig. 3 illustrates according to the image encoding/decoding device 250 of the embodiment of the invention and by the predictive encoding scheme view data is encoded and photographer's information is inserted the process of image encoded data as watermark.Fig. 3 shows the structure of encoder, but decoder is with opposite operation in tandem and have the structure similar to coder structure.
With reference to Fig. 3, encoder 311 is encoded to input image data according to the predictive encoding scheme.Encoding scheme is based on the type of view data.That is to say that image encoding/decoding device 250 is that still image data or moving picture data use different coding methods according to shot image data.In addition, image encoding/decoding device 250 can use different coding methods for still image data or moving picture data.In an embodiment of the present invention, suppose for still image data and use jpeg coder, use MPEG 4 encoders or encoder H.264 for moving picture data.In addition, can use the motion jpeg coder, the synthetic still frame of this jpeg coder synthesizes audio frequency and text data to generate motion picture with motion picture, and handles the motion picture that synthesizes.Encoder 311 input shot image data, and view data is compressed and encoded by the predictive encoding scheme.Encoder 311 can be above-mentioned JPEG coding decoder, motion JPEG coding decoder, mpeg codec or a kind of in the coding decoder H.264.A coding decoder self adaptation inserter 313 inserts the image encoded data flow with head.The information that is used for head can be the header according to the corresponding encoded scheme.The precalculated position of header in the image encoded data flow is inserted into.
Blender 317 generates watermark by portable terminal device information and pseudo random sequence are mixed, and it can use XOR gate.The portable terminal client information is an identifying information, can comprise ESN and Mobile Identification Number (MIN).ESN is the one number of portable terminal and the number that each portable terminal is distributed in representative independently.MIN is the information of portable terminal, can comprise the telephone number of portable terminal.In addition, the portable terminal client information can comprise image taking when and where etc.The information of spot for photography can obtain by gps receiver 170.When not having gps receiver 170, also can use the current information that the base station of radio communication is provided as portable terminal.Pseudo random sequence can be the spreading code (PN sequence) that is used for portable terminal.In addition, also can use can be by the pseudo random sequence of the common agreement of using of all portable terminals.On the other hand, possibly can't use pseudo random sequence.In this case, blender 317 can be omitted.Be used by the watermark information of the mixed mutually photographer's information of blender 317 and specific pseudo random sequence as view data.
Water mark embedding device 315 will be embedded into the image encoded data flow from the watermark of blender 317 outputs.That is to say that water mark embedding device 315 is embedded into precalculated position by the image data stream of head and image encoded data configuration with watermark.Be used for photographer's information method that prints to view data of fetching water can being used the method that photographer's information is embedded into the precalculated position of image encoded data flow by water mark embedding device 315.That is to say, when coded data is stored or send, generate the image encoded data according to preassigned.Therefore, water mark embedding device 315 is embedded into the precalculated position of image encoded data flow with photographer's information, and the position that photographer's information is embedded into must be preassigned position.
Usually, the form of image encoded data flow comprises reserve area.Therefore, the specific part of reserve area can be used as the watermark part of photographer's information.In an embodiment of the present invention, the precalculated position of image encoded data flow is used as aforesaid watermark part.Except aforesaid method of carrying out watermark, also can using directly fetches water photographer's information prints to the method for view data.Can be from the image data stream of water mark embedding device 315 outputs by watermark (identifying information), header and image encoded data flow structure.
Having as mentioned above, the image encoding/decoding device 250 of structure generates according to the image data stream of encoding scheme by encoded in different formats.Here, image encoding/decoding device 250 can be carried out coding that is used for moving picture data and the coding that is used for still image data.Hereinafter, according to embodiments of the invention, JPEG encoding scheme, motion JPEG encoding scheme, mpeg encoded scheme and encoding scheme H.264 will be described.The JPEG encoding scheme is the scheme that is used for the still frame coding.Motion JPEG encoding scheme is to be used for still frame is encoded the scheme of the synthetic position of still frame to motion picture.The mpeg encoded scheme and H.264 encoding scheme be the scheme that is used for moving picture data coding., will be described to Fig. 8 with reference to Fig. 4 according to the embodiments of the invention of aforesaid encoding scheme.Fig. 4 illustrates according to embodiment of the invention identifying information by the schematic diagram of watermark to the structure of its jpeg stream.Fig. 5 illustrates according to embodiment of the invention identifying information by the schematic diagram of watermark to the structure of its JPEG 2000 streams.Fig. 6 be illustrate wherein identifying information according to the embodiment of the invention by the schematic diagram of the structure of the motion jpeg stream of watermark.Fig. 7 illustrates according to embodiment of the invention identifying information by the schematic diagram of watermark to the structure of its mpeg stream.Fig. 8 illustrates according to embodiment of the invention photographer information by the H.264 schematic diagram of the structure of stream of watermark to it.
With reference to Fig. 4, image encoding/decoding device 250 can be the jpeg image coding decoder.Be applied to encoder 311 by camera unit 140 shot image data.Encoder 311 is encoded to input image data according to the JPEG encoding scheme and is generated ECS0～ECSlast shown in the label among Fig. 4 411, and ECS0～ECSlast represents JPEG image encoded data.Then, JPEG image encoded data are applied to a coding decoder self adaptation inserter 313, thereby header is added into the JPEG image encoded data shown in label 411.Header can comprise JFIF mark, length, JFIF string, table/miscellaneous, frame head and probe.Table/miscellaneous the structure that has shown in the label 413 of Fig. 4, frame head has the structure shown in the label 415 of Fig. 4, and probe has the structure shown in the label 417 of Fig. 4.
Shown in the label 411 of Fig. 4, water mark embedding device 315 is embedded in identifying information before the header.Photographer's information comprises the watermark of the mark, watermark length and the X byte that are used to discern watermark.Can be that some the watermark of X byte in ESN, MIN, shooting time and place or these information is included in the identifying information.Can be to be used to discern the ESN of photographer or the possessory information of terminal and the unique information that MIN is portable terminal.
After photographer's information was embedded in jpeg stream, output unit 319 began image (SOI) and image and finishes (EOI) insertion jpeg stream, and finishes and export JPEG image encoded data flow.Then, image process controller 200 can with shown in label 411 the jpeg stream of output unit 319 output be stored in the memory 230 the or jpeg stream that sends to the outside by controller 100.
With reference to Fig. 5, image encoding/decoding device 250 can be the jpeg image coding decoder.Be applied to encoder 311 by camera unit 140 shot image data.Encoder 311 is encoded to input image data according to the JPEG encoding scheme and is generated bit stream shown in the label 451 of Fig. 5.This bit stream is represented the 2000 scheme image encoded data according to JPEG.Then, JPEG image encoded data are applied to a coding decoder self adaptation inserter 313, thereby header is added in the JPEG image encoded data shown in label 451.Header comprises that main labeling head section, a plurality of small pieces division header and data begin (SOD).Therefore, be appreciated that JPEG 2000 view data have main labeling head section, small pieces division header, SOD and the bit stream that comprises shown in the label among Fig. 5 451.Main labeling head section has the structure shown in the label among Fig. 5 453, and the small pieces division header has the structure shown in the label among Fig. 5 455.
In an embodiment of the present invention, photographer's information is printed to by fetching water in the reserve area between SOD and main labeling head section.For this reason, the water mark embedding device 315 after the coding decoder self adaptation inserter 313 as Fig. 5 451 shown in main labeling head section before embed identifying information.Photographer's information comprises the watermark of the mark, watermark length and the X byte that are used to discern watermark.Can be that some the watermark of X byte in ESN, MIN, shooting time and place or these information is included in photographer's information.Can be that to be used to discern photographer or the possessory ESN of terminal and MIN be the unique information of portable terminal.
After photographer's information was embedded in jpeg stream, output unit 319 began code stream the beginning part that (SOC) is inserted into stream, code stream is finished (EOC) be inserted into the decline of stream, and finish and export the 2000 scheme image encoded data flow according to JPEG.Then, image process controller 200 can be stored in 2000 streams of the JPEG shown in label 451 from output unit 319 outputs the memory 200, or JPEG 2000 streams is sent to the outside of terminal by controller 100.
With reference to Fig. 6, image encoding/decoding device 250 can be a motion jpeg image coding decoder.The motion jpeg image is the motion picture that obtains by the jpeg image that synthetic jpeg image and reconstruction are synthesized.In addition, the motion jpeg image can comprise synthetic audio frequency and/or text data.Therefore, the motion jpeg image can be the moving picture signals that synthesizes.In this case, the He Cheng moving picture data structure that has that text data at first is arranged and be interleaved according to frame period corresponding to the voice data and the video data of frame sign.The motion jpeg header is inserted into before synthetic moving picture data.The motion jpeg header has the structure shown in label among Fig. 6 513.In addition, the data be made up of the motion JPEG shown in label among Fig. 6 515 of motion jpeg header and the header that is made of table/miscellaneous, frame head information and probe information shown in label among Fig. 6 517 are formed.Table/miscellaneous the structure that has shown in the label among Fig. 6 519, frame head has the structure shown in the label among Fig. 6 521, and probe has the structure shown in the label among Fig. 6 523.
Water mark embedding device 315 is embedded into motion jpeg header shown in the label 513 of Fig. 6 with photographer's information.Photographer's information comprises mark, the watermark length that is used to discern watermark, and the watermark of X byte.Can be that some the watermark of X byte in ESN, MIN, shooting time and place or these information is included in photographer's information.Can be to be used to discern the ESN of photographer or the possessory information of terminal and the unique information that MIN is portable terminal.
After photographer's information was embedded in the motion jpeg stream, output unit 319 was inserted into the beginning part that SOI is inserted into the motion jpeg header decline of motion jpeg header with EOI, and finishes and export the motion jpeg stream shown in the label 511 of Fig. 6.Then, image process controller 200 can be stored in the motion jpeg stream from output unit 319 outputs the memory 230, or this jpeg stream is sent to the outside of terminal by controller 100.
With reference to Fig. 7, image encoding/decoding device 250 can be a MPEG4 image encoding/decoding device.MPEG4 stream has the structure shown in the label 611 of Fig. 7.MPEG4 stream comprises that profile_and_level_indication, the expression watermark of visual_object_sequence_start_code, representation attribute and the size of expression MPEG4 stream beginning begin and the watermark_start_code of watermark information and watermark, a plurality of visual object, and the visual_obiect_sequence_end_code of insertion last visual object after.
Each visual object comprises visual object information and the object video shown in the label 613 of Fig. 7.Object video comprises object video information and a plurality of video_object_layer shown in the label 615 of Fig. 7.Each video_object_layer comprises object video information and the group_of_videoobjectplane shown in the label 617 of Fig. 7.Group_of_videoobjectplane has the structure shown in the label 619 of Fig. 7.
Fig. 7 shows photographer's information, i.e. watermark is positioned in the visual object example before in the MPEG4 data flow.Yet in the MPEG4 shown in the label 611 of Fig. 7 stream, watermark can be placed in after the visual_object_sequence_start_code or before the visual_object_sequence_end_code.
With reference to Fig. 8, image encoding/decoding device 250 can be an image encoding/decoding device H.264.H.264 stream has structure as shown in Figure 8.H.264 stream comprises that H.264 expression flow the opening code of beginning, and network adaptation layer (NAL) head.The NAL head comprises the forbidden_zero_bit of a bit, the Nal_ref_idc of dibit and the Nal_unit_type of five bits.In the Nal_unit_type of five bits, 0 to 12 is zones default and that use, and 13 to 23 is reserve areas, and 24 to 31 is appointed areas not.In embodiments of the present invention, 13 of Nal_unit_type be set up as watermark Nal head and use.Therefore, watermark Nal head becomes the watermark head.In addition, the watermark of X byte is inserted into after watermark Nal head.In H.264 flowing, watermark Nal head and watermark (being payload) are inserted into.In Fig. 8, be placed on watermark Nal head and payload information afterwards and be included in the existing structure that H.264 flows.
When being stored as mentioned above or being sent by image encoding/decoding device 250 shot image data, 250 pairs of view data of image encoding/decoding device are encoded.When 250 pairs of images of image encoding/decoding device were encoded, image encoding/decoding device 250 was fetched water identifying information and is printed to view data.For this reason, image encoding/decoding device 250 is encoded to view data according to the predictive encoding scheme, generates the header of encoded data stream, and header is inserted into encoded data stream.Then, image encoding/decoding device 250 with identifying information as watermark insert comprise head and the stream of data in.In addition, image encoding/decoding device 250 is inserted into opening code in the stream that comprises watermark, head and data, and stores or send this stream.
As mentioned above, the image encoding/decoding device is inserted into the image encoded data flow with identifying information.When identifying information uses as watermark, can obtain the information of the portable terminal of photographic images by in to image data decoding, analyzing watermark.Operation to the image data decoding that comprises watermark is performed by the order opposite with encoding operation.Fig. 9 is the schematic diagram that the decoder that is used for image encoding/decoding device 250 that coded data is decoded is shown.
With reference to Fig. 9, when coded data was received, input unit 351 was isolated opening code and end code from the image encoded data flow, and extracted and export the stream of watermark, head and coded data.Then, watermark extracting device 353 is extracted in the watermark (being photographer's information) that the precalculated position is inserted into from the data flow that is made up by watermark, head and coded data.The big I of watermark is known by the watermark header and is extracted according to the watermark header.The watermark of being extracted by watermark extracting device 353 is mixed to be generated as original photographer's information by blender 359 and random sequence.Blender 359 can be an XOR gate, and the random sequence of using among random sequence and Fig. 3 is identical.From the identifying information of blender 359 outputs is the photographer's information that is inserted into coding, and this information comprises ESN, MIN, time and/or positional information.Identifying information can be applied to image process controller 200, is shown at display unit 160 then.
Be applied to an extractor 355 from the head of watermark extracting device 353 outputs and the stream of coded data, an extractor 355 extracts header.In addition, 357 pairs of the decoders from the beginning encoded data stream of extractor 355 outputs are decoded, and generate raw image data.As mentioned above, the decoder of image encoding/decoding device 250 is operated by the order opposite with encoder.
In an embodiment of the present invention, the image encoding/decoding device is carried out identifying information fetched water and is printed to operation in the shot image data.Yet, in that being fetched water, identifying information prints in the operation in the shot image data, to carry out when taking when camera unit 140, and terminal information can be used as watermark and is inserted into.In addition, in an embodiment of the present invention, when identifying information was inserted in the view data as watermark, identifying information was inserted into as the precalculated position of payload in data flow.Yet except said method, also can using directly fetches water identifying information prints to the method for shot image data.
Embodiment according to the present invention as described hereinbefore, in having the terminal of camera, identifying information is inserted in the image of being taken by camera as watermark, thus the place of photographic images can be tracked.Current, caught on and miniaturization because be equipped with the terminal of camera, many people can secretly take, and the image of these shootings can be propagated to the public apace by internet etc.In addition, the terminal that can't pass through photographer's photographic images is followed the trail of this photographer.Therefore, identifying information is inserted in the image of shooting, thereby when image is illegally propagated, can follow the trail of photographer.
Although the present invention is described and illustrates with reference to its certain embodiment, it should be appreciated by those skilled in the art that under the situation that does not break away from the spirit and scope of the present invention that are defined by the following claims, can make various changes in form and details.
Claims (32)
1, a kind of equipment that is equipped with camera, this equipment comprises:
The image encoding/decoding device is used for being encoded by the camera shot image data;
Be included in the water mark embedding device in the image encoding/decoding device, be used for identifying information is embedded in the stream of image encoded data as watermark; With
Memory is used to store the stream of the image encoded data that comprise this watermark.
2, equipment as claimed in claim 1 wherein, produces watermark by the random sequence of mixing identifying information and be scheduled to.
3, equipment as claimed in claim 2, wherein, identifying information comprises Electronic Serial Number (ESN) information of portable terminal.
4, equipment as claimed in claim 3, wherein, identifying information also comprises subscriber directory number.
5, equipment as claimed in claim 4, wherein, identifying information also comprises the positional information of shooting.
6, equipment as claimed in claim 3 also comprises the communication unit that is used for being sent in the image encoded data that memory stores.
7, equipment as claimed in claim 6, wherein, communication unit comprises by the communications cable and is connected to external communication device to set up the communications interface unit of interface with this external communication device.
8, equipment as claimed in claim 7, wherein, communication unit comprises and is used to carry out radio frequency (RF) communication unit of communicating by letter with the RF of base station.
9, a kind of equipment that is used at the portable terminal image data processing, this equipment comprises:
Camera;
The image processor that comprises the image encoding/decoding device is used for handling by the camera shot image data under logging mode, and this shot image data is applied to the image encoding/decoding device,
This image encoding/decoding device comprises: encoder is used for by the predictive encoding scheme the coded image data from camera output; A coding decoder self adaptation inserter is used for header is inserted into the stream of image encoded data; And water mark embedding device, be used for identifying information is embedded into stream as watermark;
Memory is used for storing the stream that comprises watermark under logging mode; With
Communication unit is used for sending the predetermined image encoded data of selecting from the image encoded data of storing at memory under communication pattern.
10, equipment as claimed in claim 9 wherein, produces watermark by the random sequence of mixing identifying information and be scheduled to.
11, equipment as claimed in claim 10, wherein, identifying information comprises Electronic Serial Number (ESN) information of portable terminal.
12, equipment as claimed in claim 11, wherein, identifying information also comprises subscriber directory number.
13, equipment as claimed in claim 12, wherein, identifying information also comprises the positional information of shooting.
14, a kind of equipment that is used for display image data, this equipment comprises:
Communication unit is used for receiving view data under communication pattern;
The image encoding/decoding device comprises: the watermark extracting device, and be used to extract watermark and produce identifying information, this watermark has been inserted into the precalculated position from the stream of the image encoded data of communication unit output; Extractor is used for extracting header from output from the stream of the image encoded data of watermark extracting device; And decoder, be used for stream decoding and recovery raw image data to the image encoded data of from the beginning extractor output;
Image processor is used to handle the view data from the output of image encoding/decoding device; With
Display unit is used to show the view data from image processor output.
15, equipment as claimed in claim 14, also comprise be used for to random sequence and by the watermark that the watermark extracting device extracts mix and extract identifying information blender.
16, equipment as claimed in claim 15, wherein, identifying information comprises Electronic Serial Number (ESN) information of portable terminal.
17, equipment as claimed in claim 16, wherein, identifying information also comprises subscriber directory number.
18, equipment as claimed in claim 17, wherein, identifying information also comprises the positional information of shooting.
19, equipment as claimed in claim 16, wherein, communication unit comprises: radio frequency (RF) communication unit is used to carry out with the RF of base station and communicates by letter.
20, a kind of in portable terminal the equipment of image data processing, this equipment comprises:
Camera;
Image processor has the image encoding/decoding device and image processor and the polylith view data that are used to handle from the view data of camera output;
Display unit is used to show the image of camera data;
Communication unit is used under communication pattern sending and outputs to the image encoding/decoding device by image encoding/decoding device image encoded data and with the image encoded data that receive; And
The image encoding/decoding device comprises encoder, is used for according to the predictive encoding scheme encoding from the view data of camera output; A coding decoder self adaptation inserter is used for header is inserted the image encoded data flow; Water mark embedding device is used for identifying information is embedded into stream and stream is outputed to communication unit as watermark; The watermark extracting device is used for extracting the watermark that has been inserted in the precalculated position of the stream of exporting from communication unit, and generates identifying information; Extractor is used for extracting header from the stream from the output of watermark extracting device; And decoder, be used for raw image data is decoded, recovered to the stream of from the beginning extractor output, and export the raw image data that recovers to image processor.
21, a kind of being used in the portable terminal method of processing image data that is equipped with camera, this method may further comprise the steps:
Under the screening-mode of camera, use predetermined encoding scheme to encoding by the camera shot image data;
Generate the image encoded data stream header and header is inserted in the stream;
Generation is inserted in the stream as the identifying information of watermark and with watermark; And
Storage comprises the stream of watermark.
22, method as claimed in claim 21, wherein, the random sequence by will be predetermined mixes with identifying information and generates watermark.
23, method as claimed in claim 22, wherein, identifying information comprises Electronic Serial Number (ESN) information of portable terminal.
24, method as claimed in claim 23, wherein, identifying information also comprises subscriber directory number.
25, method as claimed in claim 24, wherein, identifying information also comprises the positional information of shooting.
26, method as claimed in claim 23, wherein, the ESN and the owner of portable terminal link.
27, method as claimed in claim 24, wherein, Subscriber Number links with the owner of portable terminal.
28, a kind of being used in the portable terminal method of processing image data that is equipped with camera, this method may further comprise the steps:
Under image reproduction mode, be extracted in the watermark that the precalculated position of coded data stream is inserted into, and from the watermark of extracting, detect identifying information
From the data flow of its extraction, extracted header from watermark; And
According to the predetermined decoding scheme header is decoded from the data flow of wherein extracting, and shown decoded data stream.
29, a kind of in being equipped with the portable terminal of camera method of processing image data, this method may further comprise the steps:
Under the image of camera acquisition mode, use the predictive encoding scheme, the view data of being caught by camera is encoded;
Generation be used for the image encoded data stream header and header is inserted into stream;
Generation is embedded in the stream as the identifying information of electronic fingerprint and with electronic fingerprint; And
Storage comprises the stream of electronic fingerprint.
30, method as claimed in claim 29, wherein, by with the mixed electronic fingerprint that generates of pre-determined random sequence and identifying information.
31, method as claimed in claim 29, wherein, view data comprises rest image or motion picture.
32, method as claimed in claim 29 also comprises:
Electronic Serial Number or telephone number via user terminal carry out related with the electronic fingerprint of embedding the user.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20040041167 | 2004-06-05 | ||
| KR1020040041167 | 2004-06-05 | ||
| KR1020040065364 | 2004-08-19 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1708084A true CN1708084A (en) | 2005-12-14 |
| CN100401736C CN100401736C (en) | 2008-07-09 |
Family
ID=35581718
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100735901A Expired - Fee Related CN100401736C (en) | 2004-06-05 | 2005-06-06 | Apparatus for identifying a photographer of an image |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR100678035B1 (en) |
| CN (1) | CN100401736C (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008128383A1 (en) * | 2007-04-23 | 2008-10-30 | Aigo Research Institute Of Image Computing Co., Ltd | Digital camera and its system for watermark information acquiring via external device |
| CN101352045A (en) * | 2005-12-30 | 2009-01-21 | 西门子公司 | Method and device for generating a marked data flow, method and device for inserting a watermark into a marked data flow, and marked data flow |
| CN102244783A (en) * | 2010-05-11 | 2011-11-16 | 美国博通公司 | Method and system for data processing |
| CN102377974A (en) * | 2010-08-04 | 2012-03-14 | 中国电信股份有限公司 | Mobile terminal, receiving end and video acquiring method and system |
| CN102378001A (en) * | 2010-08-11 | 2012-03-14 | 中国电信股份有限公司 | Mobile terminal supporting picture live broadcast mode, video live broadcast method thereof and system thereof |
| CN103404159A (en) * | 2010-12-17 | 2013-11-20 | 摩托罗拉移动有限责任公司 | System and method for conveying session information for use in forensic watermarking |
| CN109040761A (en) * | 2018-09-17 | 2018-12-18 | 俞群爱 | A kind of monitoring on-wall system with encrypted watermark |
| WO2022246704A1 (en) * | 2021-05-26 | 2022-12-01 | 京东方科技集团股份有限公司 | Inter-device communication method, camera, and display |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11842421B1 (en) | 2022-09-30 | 2023-12-12 | AUO Corporation | Method and display device for embedding watermark information to dimming signal of backlight module |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1174868A (en) * | 1996-09-02 | 1999-03-16 | Toshiba Corp | Information transmission method, coder/decoder in information transmission system adopting the method, coding multiplexer/decoding inverse multiplexer |
| JP2001197341A (en) * | 2000-01-13 | 2001-07-19 | Olympus Optical Co Ltd | Photographic system |
| JP2004159219A (en) * | 2002-11-08 | 2004-06-03 | Mitsubishi Electric Corp | Image photographing device, image copying machine, image editing device, photographed image managing method, copied image managing method and edited image managing method |
| JP2004140844A (en) * | 2003-10-29 | 2004-05-13 | Canon Inc | Mobile terminal system, mobile terminal, image processing device, and their operation method |
-
2004
- 2004-08-19 KR KR1020040065364A patent/KR100678035B1/en not_active IP Right Cessation
-
2005
- 2005-06-06 CN CNB2005100735901A patent/CN100401736C/en not_active Expired - Fee Related
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101352045A (en) * | 2005-12-30 | 2009-01-21 | 西门子公司 | Method and device for generating a marked data flow, method and device for inserting a watermark into a marked data flow, and marked data flow |
| CN101352045B (en) * | 2005-12-30 | 2013-09-18 | 西门子公司 | Method and device for generating a marked data flow, method and device for inserting a watermark into a marked data flow, and marked data flow |
| WO2008128383A1 (en) * | 2007-04-23 | 2008-10-30 | Aigo Research Institute Of Image Computing Co., Ltd | Digital camera and its system for watermark information acquiring via external device |
| CN102244783A (en) * | 2010-05-11 | 2011-11-16 | 美国博通公司 | Method and system for data processing |
| CN102244783B (en) * | 2010-05-11 | 2015-03-25 | 美国博通公司 | Method and system for data processing |
| CN102377974A (en) * | 2010-08-04 | 2012-03-14 | 中国电信股份有限公司 | Mobile terminal, receiving end and video acquiring method and system |
| CN102377974B (en) * | 2010-08-04 | 2016-01-20 | 中国电信股份有限公司 | A kind of mobile terminal, receiving terminal, video capture method and system |
| CN102378001A (en) * | 2010-08-11 | 2012-03-14 | 中国电信股份有限公司 | Mobile terminal supporting picture live broadcast mode, video live broadcast method thereof and system thereof |
| CN103404159A (en) * | 2010-12-17 | 2013-11-20 | 摩托罗拉移动有限责任公司 | System and method for conveying session information for use in forensic watermarking |
| CN109040761A (en) * | 2018-09-17 | 2018-12-18 | 俞群爱 | A kind of monitoring on-wall system with encrypted watermark |
| WO2022246704A1 (en) * | 2021-05-26 | 2022-12-01 | 京东方科技集团股份有限公司 | Inter-device communication method, camera, and display |
Also Published As
| Publication number | Publication date |
|---|---|
| KR100678035B1 (en) | 2007-02-02 |
| CN100401736C (en) | 2008-07-09 |
| KR20050115805A (en) | 2005-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7657056B2 (en) | Apparatus for identifying a photographer of an image | |
| CN100401736C (en) | Apparatus for identifying a photographer of an image | |
| KR100554604B1 (en) | Telephone communication system | |
| CN1157973C (en) | Portable telephone, remote supervisory system, portable information terminal and using method thereof | |
| CN100562121C (en) | Make the synchronous method of rest image and moving picture stream | |
| CN1780390A (en) | Picture taking system and method for mobile communication terminal for displaying site of taking pictures | |
| CN101950410A (en) | Digital image processing method and device based on mobile terminal and mobile terminal | |
| CN1150508A (en) | Telecommunications system for transmitting images | |
| CN1722801A (en) | Emergency alert message data structure, emergency alert message processing method and broadcast receiver | |
| TW200822758A (en) | Scalable video coding and decoding | |
| CN101035248A (en) | Method, system and visual phone for sharing the image and/or video data | |
| EP1185105A2 (en) | Method and system for providing and transmitting alternative video data during interruptions in video transmission | |
| CN1223200C (en) | Picture coding method, picture decoding method and apparatus thereof | |
| CN1767589A (en) | Two independently data transmission system between the terminal and methods thereof | |
| CN1612030A (en) | Apparatus and method for photographing a moving picture | |
| CN1638436A (en) | Method for synthesizing photographed image with background scene in apparatus having a camera | |
| US7129969B2 (en) | Telephone unit having telephone directory with picture data and method for generating telephone directory with picture data | |
| CN1638394A (en) | Method and equipment for processing call of radio phone with camera | |
| CN1535005A (en) | User interface used for image treatment device | |
| US7606432B2 (en) | Apparatus and method for providing thumbnail image data on a mobile terminal | |
| KR100761588B1 (en) | Portable videophone unit | |
| CN1454429A (en) | Multimedia communication terminal | |
| CN101420585A (en) | System and method for transmitting non-video information by visible telephone terminal | |
| CN1288913C (en) | Video capture device and method of sending high quality video over a low data rate link | |
| CN1638508A (en) | Apparatus and method for displaying moving picture in a portable terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20080709 Termination date: 20160606 |