JP2000216985A - Digital watermark embedding device and method and recording medium for storing digital watermark embedding program and digital camera and method for controlling the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To embed prescribed data in digital image data indicating one part of an image with a digital watermark. SOLUTION: A digital camera is provided with a watermark information embedding circuit 51 and a watermark information reading circuit 52. Setting for embedding prescribed data in digital image data indicating one part of image in one frame obtained though image pickup by a digital watermark is inputted to the digital camera, and a subject is photographed. The prescribed data are embedded only in the image data which indicate the part of a designated area among the image data obtained, by photographing with a digital watermark with a watermark information embedding circuit 51. Prescribed data are not embedded in the image data which indicate other images. The prescribed data are read from the image data, in which the prescribed data are embedded by the digital watermark with a watermark information reading circuit 52.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a digital watermark embedding apparatus and method, a recording medium storing a digital watermark embedding program, a digital camera, and a control method therefor.

[0002]

2. Description of the Related Art Various kinds of information are embedded in digital image data using digital watermarks. Image processing (for example, filtering processing such as blur processing and sharpness processing) and image format conversion (for example, JPEG (Joint Photographic coding Expert) are performed on digital image data in which predetermined data is embedded by digital watermarking.
s Group) format to bitmap format), the data embedded in the processed or converted digital image data is not lost. Utilizing such properties, information relating to the copyright of the image represented by the digital image data (such as the fact that the copyright is held, the name of the copyright holder, etc.) is added to the digital image data.
Embedded by digital watermark. Even if the digital image data is processed or converted, the copyright information can still be read from the processed or converted digital image data, and it is possible to assert that the copyright is held.

Conventionally, digital watermark data is embedded in the entire digital image data representing one frame of an image. For this reason, when a part of the digital image data (most of the digital image data) in which the data is embedded by the digital watermark is lost, there is a possibility that the embedded data cannot be read out and reproduced. Further, when a plurality of persons are displayed in an image, it is not possible to clarify the correspondence between one person and copyright information (portrait right information) embedded in digital image data.

[0004]

DISCLOSURE OF THE INVENTION An object of the present invention is to provide an apparatus and a method capable of embedding data by a digital watermark in a part of image data representing an image.

Another object of the present invention is to provide a digital camera capable of embedding data by digital watermarking into image data obtained by imaging, and a control method thereof.

A further object of the present invention is to provide an apparatus capable of embedding data having different contents into a plurality of portions of an image represented by image data by digital watermarking.

A digital watermark embedding device according to a first aspect of the present invention is determined based on position designating means for designating a desired position in an entire image represented by original image data, and a position designated by the position designating means. A first digital watermark embedding means for embedding predetermined data in a partial image data representing a partial image by a digital watermark is provided.

A digital watermark embedding method according to a first aspect of the present invention is a method of designating a desired position in an entire image represented by original image data, and displaying partial image data representing an image of a portion determined based on the designated position. Then, predetermined data is embedded by a digital watermark.

[0009] The first invention also provides a recording medium storing a program for implementing the above method.

According to the first aspect, predetermined data is embedded in a partial image data representing an image of a portion determined based on a desired position in a designated whole image by a digital watermark. Predetermined data can be embedded in the image data representing the image of the part desired by the user in the entire image by digital watermarking.

Preferably, the digital watermark embedding device includes:
Electronic watermark reading means for reading predetermined data embedded in the partial image data embedded by the electronic watermark may be provided. The predetermined data can be read from the partial image data in which the predetermined data is embedded by the digital watermark. The reading of the predetermined data by the digital watermark reading means may be simply by reading the content of the predetermined data from the partial image data in which the predetermined data is embedded by the digital watermark, or may be embedded by the digital watermark. It may extract predetermined predetermined data.

In one embodiment, the position designation means designates a desired position on the whole image displayed on a display screen of a display device. While viewing the entire image displayed on the display screen of the display device, it is possible to specify a position where predetermined data is embedded by a digital watermark.

[0013] The position specifying means may specify a plurality of desired positions. Predetermined data (either the same data or different data) can be embedded in each partial image data representing an image of a plurality of portions in the entire image by digital watermarking.

In the case where a plurality of desired positions are designated by the position designating means, each of partial image data representing an image of a plurality of parts determined on the basis of the plurality of desired positions designated by the position designating means. about,
It is preferable to further include an embedding data specifying unit that specifies data to be embedded by a digital watermark. In this case, the first digital watermark embedding unit embeds the embedding data designated by the embedding data designating unit in the corresponding partial image data by the electronic watermark.

[0015] Data corresponding to the content of the image of the portion determined based on the position specified by the position specifying means can be embedded as embedded data. For example, when a plurality of persons are displayed in the entire image, information about each person can be embedded in the partial image data representing the image of the person by a digital watermark.

Preferably, there is further provided a third digital watermark embedding means for embedding the same or different data as the predetermined data by digital watermark over all of the original image data. The same or different data is embedded in each of the partial image data and the original image data by a digital watermark.

When different data is embedded in each of the partial image data and the original image data, for example, the data to be embedded in the partial image data is data relating to the person represented by the partial image data, and the original image representing the entire image The data to be embedded in the image data is data relating to the photographer.
Information on a plurality of copyrights (portrait rights) can be embedded in the image data representing one frame of image in a superimposed manner. Further, by embedding the same data in both the partial image data and the original image data, even if most of the original image data is lost, the embedded data can be read and reproduced easily. .

A digital watermark embedding device according to a second aspect of the present invention is characterized in that the contour extracting means extracts contour data representing a contour portion of an entire image represented by original image data or a part of the image, and the contour extracting means extracts the contour data. A second digital watermark embedding unit that embeds predetermined data into the contour data thus obtained by using a digital watermark is provided.

A digital watermark embedding method according to a second aspect of the present invention extracts contour data representing a contour portion of an entire image represented by original image data or a part of the image, and applies a digital watermark to the extracted contour data. This is for embedding predetermined data.

The image of the outline portion changes significantly. Therefore, even if noise is mixed in the outline data representing the outline portion, the noise is hardly noticeable when the image is displayed as an image. According to the second aspect, predetermined data is embedded in such contour data (either the entire image represented by the original image or the contour data representing the contour portion of a part of the image) by a digital watermark. It is. An image represented by image data in which predetermined data is embedded by a digital watermark can be more naturally displayed on a display device or the like.

In one embodiment, the apparatus further comprises an area designating means for designating a partial area in the whole image, wherein the contour extracting means extracts a contour part of the image in the area designated by the area designating means. This is for extracting contour data to be represented.

In another embodiment, the apparatus further comprises means for designating a part of a contour represented by the contour data extracted by the contour extracting means, and wherein the second digital watermark embedding means comprises: A predetermined data is embedded by a digital watermark into the partial outline data representing the outline part specified by the means for specifying the part.

The predetermined data is embedded in the outline data representing the outline of the image data in the specified area or the partial outline data of the specified outline part by the electronic watermark. Even if the partial image data including the embedded outline is cut out from the image data representing the entire image, predetermined data can be read from the cut out partial image data and reproduced almost completely.

The digital camera according to the third invention is
Imaging means for imaging a subject and outputting original image data representing the subject image, embedding predetermined data in the original image data by digital watermarking, and outputting watermark image data in which the predetermined data is embedded by digital watermarking Digital watermark embedding means, and a recording medium control means for recording the watermark image data output by the digital watermark embedding means on a recording medium.

According to a third aspect of the present invention, there is provided a digital camera control method, wherein a subject is imaged, original image data representing the subject image is output, predetermined data is embedded in the original image data by digital watermarking, and the predetermined data is embedded. Outputs watermark image data embedded with a digital watermark, and records the output watermark image data on a recording medium.

According to the third aspect, it is possible to embed predetermined data such as copyright information in the original image data obtained by imaging by an electronic watermark and record the data on a recording medium. For watermark image data recorded on a recording medium,
You can claim that you own the copyright.

In one embodiment, the digital camera reads the watermark image data in which predetermined data is embedded by the digital watermark embedding means, and the watermark image data is read by the watermark image data reading means. Electronic watermark reading means for reading the predetermined data from the watermarked image data.
In a digital camera, predetermined data embedded by an electronic watermark can be read.

[0028]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment FIGS. 1 to 8 show a first embodiment. In the first embodiment, data such as copyright information is embedded by digital watermark over the entire digital image data representing the subject image obtained by imaging using a digital camera.

FIG. 1 is a block diagram showing an electric configuration of the digital camera, FIG. 2 is a part of the operation section of the digital camera, and FIG. 3 is a display example of an operation LCD of the digital camera. is there.

The entire operation of the digital camera is controlled by the main CPU 40.

The digital camera includes a non-volatile memory 54 and a timer 55. It is assumed that the nonvolatile memory 54 stores the name of the photographer (“Taro Taro”) and data indicating that the copyright is held (“Copyright”) (hereinafter referred to as copyright information). The time is measured by the timer 55. In the digital image data representing the subject image obtained by the imaging, the data stored in the nonvolatile memory 54 and the photographing date / time information (including the date and time) representing the time measured by the timer 55 are embedded by a digital watermark. Be included.

The copyright information is created in advance using an external device such as a personal computer. The digital camera includes a transmission / reception circuit 66 and can receive the copyright information transmitted from the personal computer 67. The copyright information received by the transmission / reception circuit 66 is input to the non-volatile memory 54 through the driver 65 and the main CPU 40 and stored.

The digital camera includes a watermark information embedding circuit 51 for embedding copyright information or shooting date and time information by digital watermarking into digital image data obtained by imaging. The digital camera also includes a watermark information reading circuit 52 for reading copyright information or shooting date and time information embedded in digital image data by a digital watermark. The details of the process of embedding data in digital image data by the watermark information embedding circuit 51 and the process of reading data from digital image data in which the data is embedded by a digital watermark in the watermark information reading circuit 52 will be described later.

The digital camera includes an operation unit 63. The signal set by the operation unit 63 is input to the main CPU 40. Mainly referring to FIG. 2, the operation unit 63 includes a mode selection dial 63a for selecting various modes, a cross key 63b for selecting a setting item set in advance for each mode, a selection of a setting value, and a confirm button. 63c and the entire digital image data obtained by imaging,
Alternatively, a whole / partial setting switch 63d (push-up / press-down type) for setting whether to embed the copyright information or the like by a digital watermark in any part thereof is provided. The whole / partial setting switch 63d may be a switch of another shape (configuration) such as a slide type.

The mode selection dial 63a is freely rotatable, thereby setting five modes of a photographing mode (REC), a reproducing mode (PLAY), a camera setting mode (SETUP), an erasing mode (ERASE), and a PC mode (PC). One of these modes is selected. The mode set to the position of arrow A is the selected mode.

In the photographing mode (REC), one frame of digital image data obtained by photographing a subject and photographing is recorded on the memory card 61. If it is set that the copyright information or the photographing date / time information should be embedded by the digital watermark (the details of this setting will be described later), the digital watermark is applied to the entire digital image data of one frame obtained by the photographing. As a result, the copyright information and the like are embedded, and the digital image data in which the copyright information and the like are embedded is recorded on the memory card 61.

In the reproduction mode (PLAY), of the digital image data recorded on the memory card 61,
The specified one frame of image data is reproduced. For digital image data in which copyright information or the like is embedded by a digital watermark, an image represented by the designated one frame of digital image data is reproduced, and the digital image data is embedded in the digital image data by a digital watermark. Data (either copyright information or shooting date and time information) is read.

In the camera setting mode (SETUP), whether to embed data by digital watermark in digital image data obtained by photographing, whether to embed data is copyright information or photographing date and time information, or both. Various settings such as are performed.

In the erase mode (ERASE), the memory
The specified digital image data among the digital image data recorded on the card 61 is deleted.

In the PC mode (PC), data is transmitted and received between an external device 67 such as a personal computer and a digital camera.

Referring mainly to FIG.
Includes a mode display area A1, a setting item display area A2, and a setting value display area A3. The mode set by the mode selection dial 63a is displayed in the mode display area A1. Items to be set for the digital camera are displayed in the setting item display area A2. Detailed setting values for the setting items displayed in the setting item display area A2 are displayed in the setting value display area A3.

In the photographing mode (REC), whether to embed data by digital watermarking into digital image data representing a subject image to be photographed and, if so, whether to embed the copyright information or the photographing date and time information are set. ,
Before imaging, it is set in advance as follows.

The power switch (not shown) of the digital camera is turned on, and the mode selection dial 63a is set to "camera setting mode (SETUP)". Characters representing the selected mode (SETUP) are displayed in the mode display area A1 of the operation LCD 62 of the digital camera.

Items to be set (setting items) are predetermined in each of the above five modes.
When any of the five modes is selected by the mode selection dial 63a, one of the item names of the predetermined setting items for the selected mode is displayed on the operation LCD 62. When the up arrow or down arrow of the cross key 63b is pressed, the operation LCD is displayed.
The item name displayed in the 62 setting item display area A2 changes.

With respect to the displayed setting item, a value (setting value) to be set in more detail is displayed in the setting value display area A3 of the operation LCD 62. When the left arrow or right arrow of the cross key 63b is pressed, the set value displayed in the set value display area A3 of the operation LCD 62 changes.

One of the setting items of the camera setting mode (SETUP) is an item "information embedding" for setting whether to embed data by digital watermark in digital image data obtained by photographing. When the setting item "information embedding" is selected, one of the three setting values of "none", "copyright" or "shooting date and time" is displayed in the setting value display area A3 of the operation LCD 62 (FIG. , "Information embedding" is displayed in the setting item display area A2, and "copyright" is displayed in the setting value display area A3.)

When the set value "copyright" is selected by pressing the left arrow portion or the right arrow portion of the cross key 63b and the confirm button 63c is pressed, the image is obtained by the subsequent imaging using the digital camera. The digital camera is controlled by the main CPU 40 so that the copyright information is embedded in the digital image data by digital watermarking. When the set value “shooting date and time” is selected, the digital camera is controlled by the main CPU 40 so that the shooting date and time information is embedded in the digital image data obtained thereafter by digital watermarking. Setting data set in the camera setting mode (SETUP) (in the above case, digital image data obtained by imaging
The copyright information or the photographing date / time information is embedded by a digital watermark) is stored in the nonvolatile memory 54. When the setting value “none” is selected, no data is embedded in the image data by the digital watermark.

The main CPU 40 is mutually connected to the photometry / distance measurement CPU 30 by a communication line. The photometry / distance measurement CPU 30 controls an optical unit 21 including a focus lens and an aperture, a charge / emission control circuit 31 for controlling charging and emission of the strobe 22, a CCD 41, an imaging circuit 42, and an analog / digital conversion circuit 43. Clock
A generator (Clock Generator: CG) 32 is connected.

Record the mode selection dial 63a (REC)
In accordance with the mode, the subject image formed on the light receiving surface of the CCD 41 is supplied to the analog / digital circuit 43 through the image pickup circuit 42 (just passing through), and R (red), B (blue),
It is converted into G (green) digital image data. RGB
The image data passes through a buffer memory 44 and a YC processing circuit 46.
, Where luminance (Y) data and color (C) data are generated. The luminance data and the color data are converted to YC processing circuit 46
Is input to the buffer memory 44, where it is temporarily stored. The luminance and color data are read from the buffer memory 44 and input to the YC / RGB conversion circuit 53. YC /
In the RGB conversion circuit 53, luminance and color data are converted into RGB.
Returned to image data.

The RGB image data is supplied from a YC / RGB conversion circuit 53 to an image display LCD 57 via a driver 56. An image representing the subject image captured by the CCD 41 is displayed on the image display LCD 57.

The user (photographer) of the digital camera looks at the subject image displayed on the image display LCD 57,
Or, while looking at the subject image that appears in the viewfinder of the digital camera,
Press switch 64.

FIG. 4 is a flowchart showing a process for recording digital image data obtained by imaging. FIG. 6 shows in detail the flow of processing for embedding data (copyright information or shooting date and time information) in digital image data by digital watermarking (upper part in FIG. 6) and reading processing (lower part in FIG. 6). FIG. 7 conceptually shows a subject image in which copyright information (Copyinght Patent Taro) is embedded by a digital watermark, and also shows the contents of the copyright information and a subject image in which the copyright information is not embedded. is there.

Referring to FIGS. 1 and 4, when the shutter release switch 64 is pressed, a signal indicating that the shutter release switch 64 is pressed is input to the main CPU 40 (step 101). A signal indicating depression is output from the main CPU 40 and supplied to the clock generator 32 through the communication line and the photometry / distance measurement CPU 30. A clock pulse is generated from the clock generator 32, and in response to the clock pulse, a still image video signal for one frame representing the subject image is transmitted to the CC.
It is output from D41 and input to the imaging circuit. Imaging circuit 42
Performs image processing such as white balance adjustment and gamma correction on a still image video signal, and outputs the result.

The still image signal representing the subject image output from the imaging circuit 42 is applied to an analog / digital circuit 43, where it is converted into digital image data (step 102) and input to a buffer memory 44. One frame of digital image data (RGB image data) representing the subject image is input from the buffer memory 44 to the YC processing circuit 46, where it is converted into luminance data and color data and returned to the buffer memory 44. . The buffer memory 44 temporarily stores luminance data and color data representing the subject image (step 103).

The main CPU 40 reads, from the nonvolatile memory 54, setting data (data of setting items and item values previously set in the camera setting mode (SETUP)) relating to embedding by the digital watermark (step 104). The process proceeds to an embedding process using a digital watermark (step 105).

Digital image data temporarily stored in the buffer memory 44 is read out, and digital image data of 8 × 8 pixels (hereinafter referred to as block image data).
Are input to the compression / decompression circuit 45 in order. The compression / expansion circuit 45 performs DCT (Discrete Cosine) processing on one frame of image data in units of input block image data.
Transform; discrete cosine transform) is performed. The block image data is converted into spatial frequency component data by DCT. Further, the block image data is subjected to linear quantization in the compression / expansion circuit 45 to generate quantized data.

If the set value "copyright" is selected (copyright in step 111 of FIG. 5), the copyright information is read from the memory 54 and input to the watermark information embedding circuit 51 (step 112). ). The watermark information embedding circuit 51 rewrites the quantized data of a specific spatial frequency component of the quantized block image data using a data bit string representing copyright information. A part of the copyright information is embedded in the block image data by rewriting the quantized data (digital watermark; step 113). The block image data in which the copyright information is embedded is output from the watermark information embedding circuit 51 and sequentially input to the buffer memory 44.

The entire digital image data in which the copyright information is embedded is transferred from the buffer memory 44 to the compression / decompression circuit 45.
And encoded. Thereby, embedding of the copyright information in the digital image data and compression of the digital image data in which the copyright information is embedded are completed (compressed watermark image data; step 106).

If the set value “shooting date and time” is selected (shooting date and time in step 111), the watermark information embedding circuit
51 obtains date and time information when the shutter release switch 64 is pressed down from the timer 55 (step 114),
This is embedded in the block image data by a digital watermark (step 115). The block image data in which the shooting date and time information is embedded is output from the watermark information embedding circuit 51 and sequentially input to the buffer memory 44. The entire digital image data with the shooting date and time information embedded is buffer memory
The data is supplied from 44 to a compression / expansion circuit 45 and encoded. Embedding of the shooting date and time information in the digital image data and compression are completed (step 106).

The digital camera has a card I / F 47 in which a memory card 61 can be mounted.
Copyright information or shooting date and time information is embedded by digital watermarking, and the compressed digital image data is recorded on the memory card 61 (step 107).

The right side of FIG. 7 shows a subject image in which copyright information is embedded by a digital watermark. Here, for the sake of simplicity, the manner in which the copyright information is embedded in the subject image by a digital watermark is shown by oblique lines (the oblique lines are not visible in the actual image).

In the camera setting mode (SETUP), if information is not embedded ("none") (FIG. 5, step 111: no setting), the information is temporarily stored in the buffer memory 44. The input digital image data is not input to the watermark information embedding circuit 51 (the processing of step 105 in FIG. 4 is skipped) and the compression / decompression circuit
The data is compressed in 45 and stored in the memory card 61 (steps 106 and 107).

From the digital image data in which the copyright information or the photographing date and time information recorded on the memory card 61 is embedded by a digital watermark, the above-described embedding process is reversed (lower part in FIG. 6). Information can be read.

That is, the mode selection dial 63a is set to the reproduction mode (PLAY). A frame to be reproduced in the reproduction mode is specified. From the compressed watermark image data recorded on the memory card 61, the compressed watermark image data representing the image of the designated frame is read. The compressed watermark image data read from the memory card 61 is input to the compression / expansion circuit 45, where it is decoded. The decoded image data (quantized data) is temporarily stored in the buffer memory 44.
, From which block image data of 8 × 8 pixels is supplied to the watermark information reading circuit 52. The watermark information reading circuit 52 reads the copyright information or the shooting date / time information from the quantized data of the spatial frequency component in which the copyright information of the block image data or the shooting date / time information is embedded. The block image data used for reading out the copyright information or the photographing date / time information is again supplied to the compression / expansion circuit 45 and subjected to an expansion process (inverse quantization and inverse DCT). The expanded block image data is sequentially input to the buffer memory 44.

When the above processing is completed for all the block image data of one frame, the reading of the copyright information or the photographing date and time information is completed. The copyright information or the shooting date / time information is still embedded in the image data from which the copyright information or the shooting date / time information has been read out by a digital watermark (watermark image data).

The digital camera includes a character generator (Character Generator) 59. The copyright information or the shooting date and time information read from the compressed watermark image data is input to the buffer memory 44. Character data representing copyright information and the like is read from the character generator 59 by the main CPU 40, and the copyright information and the like are superimposed on the watermark image data in the buffer memory 44. The image data that has been subjected to the superimposing process is converted into a YC / RGB conversion circuit 53 and a driver 56.
Is supplied to the image display LCD 57. The subject image on which the copyright information and the like have been superimposed is displayed on the image display LCD 57 (see FIG. 8).

In the above example, either copyright information or shooting date and time information is embedded in digital image data obtained by imaging, but both the copyright information and shooting date and time information are embedded by digital imaging. It goes without saying that it may be embedded in the obtained digital image data. In that case, all the processes of steps 112 to 115 in FIG. 5 are performed.

A digital camera can store not only digital image data obtained by imaging but also a memory card.
Copyright information can also be embedded by digital watermarking into digital image data taken into the digital camera from an external device such as 61 or a personal computer. The digital image data recorded on the memory card 61 passes through a card I / F 47 and a compression / expansion circuit 45 to a buffer memory 44.
Is stored temporarily. Digital image data stored in an external device 67 such as a personal computer is taken into the digital camera from the transmission / reception circuit 66 and temporarily stored in the buffer memory 44 via the driver 65 and the main CPU 40 (mode selection dial). 63a is "PC mode (P
C)). ). In the same manner as embedding in digital image data obtained by imaging, copyright information and the like are embedded in digital image data temporarily stored in the buffer memory 44 by digital watermarking.

The copyright information or the photographing date / time information is read out not only from the compressed watermark image data recorded on the memory card 61 but also from the compressed watermark image data stored in the external device 67 such as a personal computer. It is needless to say that the data embedded in the digital watermark of the compressed watermark image data can be read out by the digital camera.

The watermark information reading circuit 52 may have a function of extracting (separating) copyright information and the like from the compressed watermark image data instead of a function of reading the copyright information and the like from the compressed watermark image data. In this case, after going through the process of reading the data embedded by the digital watermark (lower part of FIG. 6), data such as copyright information is extracted from the compressed watermark image data in the watermark information reading circuit 52, and finally the copyright information is extracted. And digital image data (original image data) in which copyright information or the like is not embedded.

Second Embodiment FIGS. 9 to 12 show a second embodiment of the present invention. In the second embodiment, a user designates a desired position in a subject image obtained by imaging, and digital image data representing an image portion near the designated position is converted into digital image data by digital watermarking. It is embedded.

FIG. 9 is a flowchart showing an embedding process (FIG. 4, step 105) by a digital camera using a digital watermark, and corresponds to the flowchart shown in FIG. 5 of the first embodiment. FIG. 10 shows an example of a display screen for designating an embedding position of data such as copyright information by a digital watermark. FIG. 11 conceptually shows a state in which data such as copyright information is embedded in digital image data representing an image near a specified position. In the second embodiment, the electrical configuration of the digital camera is shown in FIG.
Is the same as

In the flowchart shown in FIG.
The same reference numerals are given to the same processes as those in the above, and the description is omitted.

When embedding data such as copyright information in the vicinity of the designated position, the embedding is partially set by the whole / partial setting switch 63d of the operation unit 63.

The subject image is displayed on the image display LCD 57 as shown in FIG. Data representing the cross mark is output from the memory 54 and supplied to the image display LCD 57. A cross mark 71 is displayed over the subject displayed on the image display LCD 57. The cross mark 71 moves on the subject image displayed on the image display LCD 57 in the direction of the arrow in response to the pressing of each arrow of the cross key 63b of the operation unit 63. Data is embedded around the intersection of the cross mark 71 by an electronic watermark.

The cross mark is moved to a position where data is to be embedded by a digital watermark. Thereafter, the shutter release switch 64 is pressed (step 101).

Then, as described above, the buffer memory 44
The image data is output for each 8 × 8 pixel block image data, and is input to the compression / expansion circuit 45. The block image data is subjected to DCT and linear quantization in a compression / expansion circuit 45 and input to a watermark information embedding circuit 51.
When block image data of a portion (around the cross mark 71, for example, several blocks) specified by the embedding designation is input to the watermark information embedding circuit 51, copyright information and the like are embedded in the block image data by a digital watermark. (YES at step 131, step 113, or step
YES at 133, step 115).

The block image data of the portion for which embedding is not specified simply passes through the watermark information embedding circuit 51 and is input to the buffer memory 44 (the block image data of the portion where copyright information or the like is to be embedded by a digital watermark). May be input to the watermark information embedding circuit 51). For the block image data of the portion for which embedding is not specified (NO in step 131 or NO in step 133), the processing in step 113 or 115 is skipped. Steps 131 and 113 until the embedding process by the digital watermark is completed
Alternatively, the processing of steps 133 and 115 is repeated (step 132 or step 134).

FIG. 11 shows a state in which data such as copyright information is embedded by a digital watermark in a part of image data obtained by photographing. Copyright information or the like is embedded in a portion indicated by hatching by a digital watermark.

By designating the position, data such as copyright information can be embedded by a digital watermark only in a portion desired by the user in the entire image. For example, when a plurality of persons are shown in an image for one frame, data about the persons such as the names and occupations of the persons can be embedded in the image representing the corresponding persons by an electronic watermark.

FIG. 12 is an example of an image displayed on the viewfinder of the digital camera. In a digital camera having a viewfinder, a focus area 72 used for focusing is displayed on the viewfinder. In such a digital camera,
With reference to the focus area 72, copyright information or the like may be embedded in image data representing an image in the vicinity thereof by an electronic watermark (a state in which data is embedded by an electronic watermark is indicated by hatching).

The same applies to the case where the focus area 72 is displayed on the image display LCD 57.

Third Embodiment FIGS. 13 to 15 show a third embodiment of the present invention. In the third embodiment, data such as copyright information is embedded in a plurality of portions of an image represented by one frame of image data obtained by imaging by digital watermarking.

FIG. 13 is a flowchart showing the embedding process by the digital watermark of the digital camera.

First, the user selects the mode selection dial.
63a is operated to set the reproduction mode (PLAY). In the reproduction mode, a frame of an image in which data is to be embedded is designated by a digital watermark. Image data representing the image of the designated frame is read from the memory card 61. The read image data is reproduced as described above (step 140) and displayed on the image display LCD 57 (see FIG. 14).

When the reproduced image is displayed on the image display LCD 57, an area in which data is to be embedded by a digital watermark is designated as follows (step 141).

When data such as copyright information is embedded in a plurality of areas of an image for one frame by digital watermark, data such as copyright information is embedded in one area.
Then, proceed to embedding in other areas. Introduction Figure 14
A case will be described in which the area a surrounding the first subject image Ob _a is designated as an embedding area and the area b surrounding the second subject image Ob _b is designated as an embedding area thereafter.

The designation of the embedding area is input using an area designation switch (not shown) of the operation unit 63. Then
A cross cursor for specifying an area is displayed on the LCD 57 for image display.
73 is displayed. The user operates the cross key 63b of the operation unit 63 to position the cross cursor 73 at the upper left vertex p1 of the area (rectangular area) in which data such as copyright information is to be embedded, and presses the enter button 63c. The cross cursor 73 is positioned at the lower right vertex p2, and the confirm button 63c is pressed again. A rectangular area a having a diagonal line between the vertices p1 and p2 is displayed on the subject image.

Digital image data representing a portion of the image area surrounded by the rectangular area a is read from the reproduced digital image data (temporarily stored in the buffer memory 44) (step 142). . The read digital image data is input from the buffer memory 44 to the watermark information embedding circuit 51.

Copyright information and the like are embedded in the digital image data representing the image in the rectangular area a by the watermark in the watermark information embedding circuit 51 (step 143).
). The digital image data of the rectangular area a in which the copyright information and the like are embedded is sent from the watermark information
The image data is sent to the memory 44 and is replaced (overwritten) with the image data of the portion corresponding to the rectangular area a of the image data used for reproduction here (step 144).

Next, copyright information and the like are embedded in image data representing an image in the rectangular area b (YE in step 145).
S). Digital camera users use LCD for image display
While looking at the image displayed on 57, press the four-way controller 63
A rectangular area b in which data such as copyright information is to be embedded is designated again using b (step 141). This designation is performed in the same manner as the designation of the rectangular area a.

Digital image data representing an image in the designated rectangular area b is read from the digital image data in the buffer memory 44 being reproduced. Copyright information or the like is embedded in the read image data by a digital watermark in the watermark information embedding circuit 51 (step 14).
2, 143). The image data of the rectangular area b in which the copyright information or the like is embedded by the digital watermark is sent to the watermark information
Is sent to the buffer memory 44 and is replaced with the image data of the portion corresponding to the rectangular area b of the digital image data used for reproduction (step 144).

Information indicating that embedding has been completed is input from an end button (not shown) of the operation section 63 (NO in step 145), and image data representing images of the rectangular area a and the rectangular area b are respectively added to image data representing copyright information. Digital image data in which is embedded by an electronic watermark is recorded on the memory card 61.

When digital image data of a plurality of rectangular areas is read and copyright information or the like is embedded in each of the plurality of rectangular areas by a digital watermark, the content of data to be embedded can be made different for each area. . For example, for the image data of the rectangular area a, personal information (such as a name) corresponding to the first subject image Ob _a is stored in the rectangular area b.
For the image data of (1), information (group name, affiliation, etc.) of the group corresponding to the second subject image Ob _b can be data to be embedded by a digital watermark. Of course, the same data may be embedded in the image data representing the images in the rectangular areas a and b, respectively.

When embedding any of a plurality of data stored in the memory 54 in advance, data to be embedded is selected by the user in an embedding process using a digital watermark (step 143). Is embedded in the digital image data of the area being read out by a digital watermark.

FIG. 15 shows a modification of the third embodiment, in which predetermined data is embedded by digital watermarking into digital image data representing a part of the entire image represented by one frame of digital image data. FIG. 3 conceptually shows a state in which predetermined data is embedded by a digital watermark over all digital image data representing the entire image.

In the image shown in FIG. 15, predetermined data such as copyright information is embedded in image data representing a part of the image (rectangular areas a and b) and over all of the image data representing the entire image. Is embedded. Rectangular area a
The data is embedded in the image data representing the images in b and b by a digital watermark in a superimposed manner. The embedding of the copyright information or the like is first performed over the image data representing the entire image (first embodiment), and then is performed on the image data representing the images in the rectangular areas a and b (third embodiment). Good or vice versa.

The data to be embedded in the image data representing each of the rectangular areas a and b and the entire image of one frame is also
It goes without saying that the contents can be different from each other. For example, for the rectangular areas a and b, data on the subject image and the like existing in each area are described.
For the entire image of one frame, data on the photographer who captured this image is embedded by a digital watermark. It goes without saying that the same data can be embedded in the image data representing each of the rectangular areas a and b and the entire image.

When embedding data by a digital watermark in a portion other than a specific area in the entire image, the image data may be read except for the specific area.

Fourth Embodiment FIGS. 16 and 17 show a fourth embodiment of the present invention.
In the fourth embodiment, data is embedded by digital watermarking into image data representing the outline of an image represented by one frame of image data obtained by shooting.

FIG. 16 is a flowchart showing the flow of a data embedding process using a digital watermark in the fourth embodiment. In the flowchart shown in FIG. 16, the same processes as those shown in FIG. 13 are denoted by the same reference numerals, and description thereof will be omitted. FIG. 17 shows an example of an image displayed on the image display LCD 57.

In the fourth embodiment, a contour extraction circuit 58 is provided in a digital camera (see FIG. 1). The contour extraction circuit 58 is a circuit that extracts, from image data representing an image, contour image data representing a contour portion of the image.

The reproduction mode (PLAY) is set by the mode selection dial 63a. Image data representing a desired image is read from the image data stored in the memory card 61. The read image data is temporarily stored in the buffer memory 44. Image data is buffered
An image read from the memory 44 and represented by the read image data is displayed on the image display LCD 57.

Next, as described above, a partial region in the entire image is designated (here, regions c and d are designated) (step 141). The rectangles representing the regions c and d are displayed on the image displayed on the image display LCD 57 so as to be superimposed (indicated by chain lines in FIG. 17).

Digital image data representing the images in the rectangular areas c and d is read from the buffer memory 44 and input to the contour extraction circuit 58 (step 142).

The contour extracting circuit 58 receives the input areas c and d.
An outline extraction process is performed on digital image data representing an image in the image (step 151). The contour extraction circuit 58 extracts multivalued data (contour image data) representing the contour portion of the image represented by the digital image data.
The contour image represented by the extracted contour image data is displayed on the image display LCD 57 as shown in FIG.

The contour image data extracted by the contour extraction circuit 58 is also supplied to the watermark information embedding circuit 51. In the watermark information embedding circuit 51, data such as copyright information is embedded in the image data representing the contours of the images in the areas c and d by an electronic watermark (step 152). Watermark contour image data in which data is embedded in the contour image data by a digital watermark is input from the watermark information embedding circuit 51 to the buffer memory 44. It is replaced with the outline data of the digital image data temporarily recorded in the buffer memory 44 (step 144).

A contour extraction process is performed on the entire image represented by the captured image data of one frame to extract contour image data representing the contour, and then an area in which the data is embedded by a digital watermark is read. Alternatively, predetermined data may be embedded in the data representing the outline of the read area by a digital watermark.

The process of embedding predetermined data in a part or the entirety of one frame of digital image data by digital watermarking is not limited to a digital camera, but can be realized by another image processing device such as a personal computer. It is possible. In this case, a device such as a personal computer is provided with a watermark information embedding circuit 51, a watermark information reading circuit 52, a compression / expansion circuit 45, or a program for performing processing equivalent to the processing performed by these circuits. As shown in FIG. 1, a program for realizing the processing performed by these circuits is a CD-ROM 68
Is stored in The program stored in the CD-ROM 68 is read by the personal computer 67 and stored in the hard disk or the like.

When a computer or the like connected to a network (for example, the Internet) performs data embedding / reading processing using a digital watermark, the contents of data to be embedded may be contents used on the Internet. For example, the link information (URL: UniformR) of the Internet home page of the content of the data
esource Locator). When a product part displayed on the display screen is clicked with the mouse, data embedded in the product part (area) by the digital watermark is read out (clicked part (area) Is applied to the watermark information readout circuit 52 to read out the embedded data.) Based on the content (URL) of the read data, the computer displaying the product image can be connected to another computer (for example, a computer of a company that handles the displayed product) via the Internet. . The homepage (HTML file) of the company that handles the displayed product can be transmitted to the computer on which the product information is displayed, and can be used for online product sales and the like.

Fifth Embodiment FIGS. 18 to 20 show a fifth embodiment of the present invention.

FIG. 18 shows the overall configuration of the laboratory system. FIG. 20 shows a flow of processing for embedding a user ID (AA00001) in image data by digital watermarking in a digital camera.

The laboratory system comprises a plurality of laboratories 81, a management center 82, and a network 80.

The laboratory 81 is provided with a laboratory device 81a that prints image data recorded on the memory card 61 mounted on the digital camera. The user photographs a subject with a digital camera, and a memory card 61 on which image data representing the subject image is recorded.
To one of the multiple laboratories 81. In the laboratory 81 in which the memory card 61 is brought in, the image data recorded in the memory card 61 is printed on photographic paper or the like using the laboratory device 81a.

The laboratory device 81a includes a watermark information reading circuit and a decompression circuit for reading predetermined data from digital image data in which predetermined data is embedded by a digital watermark. When predetermined data is embedded in the compressed image data recorded on the memory card 61 by digital watermarking, the predetermined data can be read by the laboratory device 81a.

The management center 82 is a host computer 82a.
The host computer 82a and a plurality of laboratory devices 81a are connected by a network 80. The host computer 82a of the management center 82 and the laboratory device 81a can mutually communicate data via the network 80.

The use of the laboratory system will be described.

In the laboratory 81, user registration of a user having a digital camera is performed in advance. A user who owns a digital camera brings the digital camera to the laboratory 81 in advance (laboratory
The digital camera brought in 81 has the same electrical configuration as the first embodiment (FIG. 1). Laboratory
At 81, the operator inputs information (name, address, etc.) regarding the new user to the laboratory device 81a.

The information on the new user input to the laboratory device 81a is transmitted to the management center via the network 80.
82 to the host computer 82a. The host computer 82a of the management center 82 that has received the information about the new user stores the received information about the new user and also has a unique user ID for that user.
Generate

Further, to the laboratory device 81a, the key data used for the digital watermark embedding process and the reading process of the digital camera and the generated user ID are transmitted from the host computer 82a. The key data may be specific to a particular user, but may be specific to a particular laboratory.
Nor is it unique to. The key data may not be transmitted via the network 80 but may be stored in the laboratory device 81a in advance.

The user ID and key data transmitted from the host computer 82a are received by the laboratory device 81a. The received user ID and key data are read from the laboratory device 81a and stored in the non-volatile memory 54 built in the digital camera carried by the user. The user ID stored in the memory 54 can be displayed on the operation LCD 62 of the digital camera.

When a subject is photographed using a digital camera having the user ID and key data stored in the memory 54, key data (for example, 64-bit data) is included in the image data representing the subject image obtained by the photographing. The user ID (AAA00001) is embedded based on the digital watermark.

To extract a user ID from image data in which a user ID is embedded based on the key data, the same key data as the key data used for embedding the user ID is required. By performing the reading process based on the same key data as the key data used for embedding, the user ID can be read from the image data. If key data different from the key data used for embedding is used, the user ID cannot be read from the image data.

FIG. 20 is a diagram showing a state in which the laboratory 81 stores a memory card 61 on which image data in which a user ID is embedded by a digital watermark based on key data is recorded.
It shows the flow of processing up to the point where the image is carried out and the image is printed.

When the memory card 61 is brought into the laboratory 81, the operator of the laboratory 81 operates the laboratory device.
The memory card 61 is attached to 81a. Memory card 61
The image data is read out from (step 161).

The laboratory device 81a receives the key data from the host computer 82a, and reads out the user ID from the image data based on the received key data (step 162). If the laboratory device 81a holds the key data in advance, it is not necessary to receive the key data from the host computer 82a.

If the image data read from the memory card 61 has not been embedded with a digital watermark (NO in step 163), the image data is printed as it is (step 166). The image represented by the image data is printed on, for example, photographic paper or the like and output from the laboratory device 81a.

If the image data read from the memory card 61 has been embedded with a digital watermark in the image data (YES in step 163), the operator of the laboratory apparatus 81a hears the user ID from the user, and
Is input to the laboratory device 81a (step 164).

The user I input to the laboratory device 81a
If D and the user ID read from the image data match each other (YES in step 165), the memory card
Print processing of the image represented by the image data recorded in 61 is performed (step 166).

The user I input to the laboratory device 81a
If D is different from the user ID read from the image data, print processing of the image represented by the image data recorded on the memory card 61 is not performed (NO in step 165).

The key data cannot be known by the user having the digital camera, and of course, cannot be known by other third parties. Even if a third party who obtains the image data in which the user ID is embedded by digital watermark tries to remove the user ID from the image data, it is difficult to remove the user ID from the image data because the third party does not know the key data. It is. Of course, even if filtering processing or format conversion is performed on the image data, the user ID cannot be removed.

Furthermore, the memory card 61 is stored in the laboratory 81.
Even if the third party does not know the user ID, the printing process of the image represented by the image data recorded on the memory card 61 is not performed (NO in step 165).

After all, the user who knows the user ID is
The print can be obtained only when the card 61 (or the image data recorded on the memory card 61) is brought into the laboratory 81.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an electrical configuration of a digital camera according to a first embodiment.

FIG. 2 shows a part of an operation unit of the digital camera.

FIG. 3 shows a display example of an operation LCD of the digital camera.

FIG. 4 is a flowchart showing the flow of processing of the digital camera from photographing a subject in the first embodiment to embedding data into one frame of image data obtained by digital watermarking and recording the data in a memory card; is there.

FIG. 5 is a flowchart illustrating a process of embedding data into image data by a digital watermark in the first embodiment.

FIG. 6 illustrates a process of embedding data in an image data by a digital watermark and a process of reading the image data in the first embodiment.

FIG. 7 conceptually shows how copyright information is embedded in the entire image data by a digital watermark.

FIG. 8 shows an example in which image data in which copyright holder information is embedded by a digital watermark is displayed on a display screen.

FIG. 9 is a flowchart illustrating a process of embedding data in a part of obtained image data by a digital watermark according to the second embodiment.

FIG. 10 shows a display example of an image display LCD used to specify a position where data is to be embedded by a digital watermark in the second embodiment.

FIG. 11 conceptually shows how data is embedded in a part of image data by a digital watermark.

FIG. 12 shows an example of an image projected on a viewfinder of a digital camera.

FIG. 13 is a flow chart showing a third embodiment and showing a flow of processing for embedding data in one or a plurality of parts of obtained image data by digital watermarking.

FIG. 14 shows a display example of an image display LCD used to specify an area in which data is to be embedded by a digital watermark in the third embodiment.

FIG. 15 shows a modification of the third embodiment, and is a conceptual diagram showing a state in which data is embedded in an image data by a digital watermark in a superimposed manner.

FIG. 16 is a flowchart illustrating a process of embedding data in a contour portion of obtained image data by a digital watermark according to the fourth embodiment.

FIG. 17 shows an image on which contour extraction processing has been performed.

FIG. 18 shows the fifth embodiment, and shows the entire configuration of a laboratory system.

FIG. 19 illustrates a process of embedding data in an image data by a digital watermark and a process of reading data in the fifth embodiment.

FIG. 20 is a flowchart illustrating an image printing process in a laboratory.

[Explanation of symbols]

 44 Buffer memory 45 Compression / expansion circuit 51 Watermark information embedding circuit 52 Watermark information reading circuit 54 Nonvolatile memory 55 Timer 57 LCD for image display 61 Memory card

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B057 BA02 BA24 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CB19 CC02 CC03 CE08 CG05 CG06 CG07 DA06 DA16 DA17 DB02 DB06 DB09 DC16 5C076 AA12 AA14 AA31 AA40 BA06 CA02 CA10

Claims (17)

[Claims] 1. A position specifying means for specifying a desired position in an entire image represented by original image data, and partial image data representing an image of a portion determined based on the position specified by the position specifying means. A first digital watermark embedding unit for embedding predetermined data by a digital watermark. 2. The digital watermark embedding device according to claim 1, wherein said position specifying means specifies a desired position on said entire image displayed on a display screen of a display device. 3. The digital watermark embedding device according to claim 1, wherein said position specifying means specifies a plurality of desired positions. 4. An embedding data designation for designating data to be embedded by a digital watermark for each of partial image data representing a plurality of partial images defined based on a plurality of desired positions designated by the position designation means. 4. The digital watermark embedding device according to claim 3, further comprising: a first digital watermark embedding unit configured to embed the embedding data specified by the embedding data specifying unit in the corresponding partial image data by a digital watermark. apparatus. 5. An outline extracting means for extracting outline data representing an outline part of an entire image represented by the original image data or a part of the image, and an electronic watermark for the outline data extracted by the outline extracting means. A digital watermark embedding unit for embedding predetermined data. 6. An image processing apparatus according to claim 1, further comprising an area designating means for designating a partial area in the whole image, wherein the contour extracting means comprises contour data representing a contour part of the image in the area designated by the area designating means. 6. The method of claim 5, wherein
3. A digital watermark embedding device according to claim 1. 7. The digital still camera according to claim 1, further comprising means for designating a part of a contour represented by the contour data extracted by the contour extracting means, wherein the second digital watermark embedding means designates the contour part. 6. The electronic watermark embedding device according to claim 5, wherein predetermined data is embedded in the partial outline data representing the outline specified by the means by an electronic watermark. 8. The digital watermark embedding device according to claim 6, wherein the area designating means designates a desired area on the entire image displayed on the display screen of the display device. 9. The method according to claim 7, wherein said means for designating a contour portion designates a contour portion at a desired position of a contour represented by contour data displayed on a display screen of a display device. The electronic watermark embedding device according to the above. 10. A digital watermark embedding means for embedding data identical to or different from the predetermined data by a digital watermark over all of the original image data. 3. A digital watermark embedding device according to claim 1. 11. The digital watermark reading device according to claim 1, further comprising digital watermark reading means for reading predetermined data embedded by said first, second and third digital watermark embedding means. The electronic watermark embedding device according to the above. 12. An imaging means for imaging a subject and outputting original image data representing the subject image, embedding predetermined data in the original image data by digital watermarking, and embedding the predetermined data by digital watermarking. A digital camera comprising: digital watermark embedding means for outputting watermark image data; and recording medium control means for recording the watermark image data output by the digital watermark embedding means on a recording medium. 13. A watermark image data reading means for reading watermark image data in which predetermined data is embedded by said digital watermark embedding means, and a watermark image data read by said watermark image data reading means.
13. The digital camera according to claim 12, further comprising electronic watermark reading means for reading the predetermined data embedded by an electronic watermark. 14. A desired position in the whole image represented by the original image data is designated, and predetermined data is embedded in the partial image data representing an image of a portion determined based on the designated position by an electronic watermark. Embedding, digital watermark embedding method. 15. An electronic watermark which extracts outline data representing an outline portion of an entire image represented by original image data or a part of the image, and embeds predetermined data in the extracted outline data by electronic watermarking. Embedding method. 16. A watermark image in which a subject is imaged and original image data representing the subject image is output, predetermined data is embedded in the original image data by digital watermarking, and the predetermined data is embedded by digital watermarking. A digital camera control method for outputting data and recording the output watermark image data on a recording medium. 17. A program for embedding predetermined data in an original image data by a digital watermark, wherein the program designates a desired position in the whole image represented by the original image data, based on the designated position. A computer-readable recording medium storing a program for controlling a computer to embed predetermined data by digital watermark in partial image data representing an image of a predetermined portion.