JP2003204427A - Processor and method for processing information, method of processing image data, recording medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor that can easily and effectively bury prescribed information for protecting the copyright, etc., of the objective information of digital watermarking, etc., in the objective information without deteriorating the objective information. <P>SOLUTION: At the time of recording the prescribed information for protecting the copyright of the objective information (photographed image) prepared based on the photographing operation from the user (photographer) of the information processor, a recording means 507 acquires the bio-information on the user and, when the bio-information is already registered, records the user information related to the bio-information on the objective information as the prescribed information at the time of registering the objective information. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, an image data processing method, which is applied to, for example, an image pickup apparatus for processing digital photographed image data obtained by photographing a subject. The present invention relates to an information processing method, a computer-readable storage medium storing a program for implementing the method, and the program.

[0002]

2. Description of the Related Art In recent years, digital cameras such as digital still cameras and digital video cameras, which are rapidly becoming widespread, convert captured images obtained by capturing an image of an object with an image sensor such as a CCD sensor into image data in digital format. The digital image data is converted and can be recorded in a recording medium such as a memory card.

By the way, since digital image data is digital, for example, data correction, processing, printing or the like can be easily performed on a personal computer, and it has come to be used in general households. At the same time, the development of networks, especially the development of the Internet, has made it easy to distribute digital image data among an unspecified number of users. Against this background, the need for digital still cameras and digital cameras is increasing dramatically.

However, with regard to the handling of digital image data, it does not cause a big problem if it is used to the extent that the individual user enjoys it within the scope of his hobby. It is hard to overlook that digital image data is used (for example, easily copied and distributed by non-rights), and there is a problem that the rights of copyright holders such as photographers are not sufficiently protected. Come on. Therefore, a measure for protecting the copyright of digital image data is strongly desired.

With the above copyright protection as one purpose,
A technique called "watermark" (hereinafter referred to as "digital watermark technique") has been widely studied. Digital watermark technology is a method of superimposing other information on target information (digital data) such as images and sounds so that it is not perceived by humans or actively perceived according to its purpose. It is a technology that allows the embedded information to be taken out or removed only by a user who has a legitimate right or qualification.

Regarding the digital watermark technology as described above,
For example, JP-A-10-290359 and JP-A-10-290359.
-150517, etc. The principle of the digital watermark technology will be described below. Here, for simplicity of explanation, it is assumed that the target information is digital image data and the embedded information is not perceived by the user (or is in a state very close to non-perception).

First, FIG. 6 is a diagram focusing on a processing configuration for embedding different information (embedded data) 811 in digital image data (original image) in an information processing apparatus 800 having a processing function by a digital watermark technique. is there. The information processing device 800, as shown in FIG.
1, an orthogonal transformation processing unit 802, an embedding processing unit 803, an inverse orthogonal transformation processing unit 804, and a reconstruction processing unit 805.

In the information processing apparatus 800, first, the division processing unit 801 makes a plurality of blocks in an n pixel × m pixel block 901 (1) for digital image data of an original image 901 as shown in FIG. 7, for example. The process of dividing into two (division process) is performed. The orthogonal transformation processing unit 802 is a division processing unit 80.
By performing orthogonal transform processing such as discrete cosine transform (DCT transform) on the plurality of block data obtained in 1, a frequency component matrix of n pixels × m pixels is acquired.

The embedding processing unit 803 indicates to which frequency component of the frequency component matrix obtained by the orthogonal transform processing unit 802 the embedding data 811 is embedded, prior to executing the embedding process of the embedding data 811. The embedded component is determined by random number generation, and further, the change amount indicating how much the value of the frequency component is changed is determined, and the embedded component and the change amount are acquired and stored as the key information 812. . For example, by selecting the low frequency part of the frequency component matrix as the embedding component, the embedding data 81 can be made invisible to humans.
1 can be embedded. Further, since the difference from the original value of the frequency component matrix can be changed by changing the change amount of the frequency component in which the embedding data 811 is embedded, it is possible to control the deterioration of the image quality due to the information embedding.

The embedding processing unit 803 is an orthogonal transformation processing unit 80.
For the frequency component matrix of multiple blocks obtained in 2,
For each block, the value of the frequency component matrix is used as key information
Perform processing to change based on (embedded component and change amount).
As a result, the embedded data 811 is embedded in each of the plurality of blocks obtained by the orthogonal transform processing unit 802.

The inverse orthogonal transform processing unit 804 is an embedding processing unit 8.
By performing an inverse orthogonal transform process on the frequency component matrix of a plurality of blocks in which the embedded data 811 is embedded by 03, a plurality of block data of n pixels × m pixels is acquired. The reconstruction processing unit 805 generates watermark image data in which the embedding data 811 is embedded by connecting the block data obtained by the inverse orthogonal transform processing unit 804 (reconstruction processing).

FIG. 8 is a diagram showing the configuration of an information processing apparatus 800 'having a function of extracting embedded data 811 from the watermark image data obtained as described above. As shown in FIG. 8, the information processing device 800 ′ has a division processing unit 821, an orthogonal transformation processing unit 822, and an extraction processing unit 82.
Equipped with 3.

In the information processing apparatus 800 ', first, the division processing section 821 divides the watermark image data into a plurality of blocks of n pixels × m pixels (division processing).
Give. The orthogonal transform processing unit 822 performs an orthogonal transform process such as a discrete cosine transform (DCT transform) on the plurality of block data obtained by the division processing unit 821 to obtain n.
A frequency component matrix of pixels × m pixels is acquired (orthogonal transformation process). The extraction processing unit 823 acquires the embedding component and the change amount from the key information 812 used in the embedding process of the embedding data, and the orthogonal transformation processing unit 822 obtains the embedding component and the change amount. The embedded data is extracted from the frequency component matrix of a plurality of blocks (extraction processing).

The digital watermark technique as described above is, for example,
It has the following features (1) to (4). (1) Key information 8 used when embedding the embedded data 811
If there is no 12, the embedded data 811 from the watermark image data
Cannot be extracted. (2) Since the embedded component included in the key information 812 is generated by random number generation and is not fixed, it is difficult to decrypt the embedded data 811. (3) By devising the above-mentioned embedding component, it is possible to embed the embedding data 811 that cannot be perceived by humans. (4) By changing the amount of change included in the key information 812,
The degree of image quality deterioration due to the embedding process of the embedding data 811 can be controlled.

Here, the digital watermark technology in the case where the embedded data is "invisible data embedding" which is not perceived by humans has been described. However, as mentioned earlier, in contrast to this, the embedded data is also reversed. As a result, by actively using perceptible data such as copyright information and embedding the embedded data in the original image, we expect the effect of discouraging unauthorized use of the image by a third party. There is also a digital watermark technology called "embedding." Regarding the digital watermark technique of "embedding visible data", for example, US Pat. No. 55307.
The details are described in JP-A No. 8-241403.

While the copyright protection by the digital watermark technology as described above is being researched, the technology for authenticating a specific individual is also widely researched from the viewpoint of privacy and security protection.

As a method for authenticating an individual, as a method that has been generally used since ancient times, a method of confirming with a key, a card or a seal stamp that can be possessed only by the specific person, or a method of identifying the specific person There is known a method of performing confirmation by inputting a password or a personal identification number that can be known only by a person. However, these methods have a fundamental problem that it is relatively easy for another person to impersonate the specific person due to theft, forgery, information leakage, or the like.

Therefore, as a method of solving the above problem, the biometrics personal authentication method, which uses the physical characteristics of a specific person to be authenticated, has been attracting attention.
The physical characteristics here are required to be unique to each person, have randomness, and not change for a long time. However, it is necessary to develop a device that performs authentication by the biometrics personal authentication method. Considering this, factors such as the time to acquire the data required for authentication and the cost of the device are taken into consideration. Therefore, at present, fingerprints, palm prints, iris patterns,
The use of voiceprints, facial features, and the like as physical features is being widely used.

An example of the biometrics personal authentication method as described above is described in, for example, Japanese Patent Application Laid-Open No. 8-504979. The principle of the biometrics personal authentication method will be described below. Here, for the sake of simplicity of explanation, the physical characteristic is assumed to be an “iris pattern”.

FIG. 9 focuses on the processing configuration in the information processing apparatus 1000 having the processing function according to the biometrics personal authentication method until the subject is judged to be a specific individual by the iris pattern of the subject. It is a figure. As shown in FIG. 9, the information processing apparatus 1000 includes an eyeball image acquisition unit 1001, an analysis band / coordinate system setting unit 1002, an image data analysis unit 1003, a coding unit 1004, a matching unit 1005, a determination unit 1006, and a template. It is equipped with 1007.

In the information processing apparatus 1000, first, the eyeball image acquisition unit 1001 acquires an eyeball image of a subject by controlling illumination and focus. The analysis band / coordinate system setting unit 1002 detects the eyelids and eyelashes from the eyeball image data obtained by the eyeball image acquisition unit 1001, and further detects the boundary 1101 between the pupil and the iris and the iris as shown in FIG. The outer boundary 1102 of each of the regions, and based on these detection results, divides into an area 1103 called an analysis zone,
The coordinate system of the analysis band 1103 is set.

The image data analysis unit 1003 performs image analysis mainly on the extraction of the shade change of the analysis band 1103 by the coordinate system of the analysis band 1103 obtained by the analysis band / coordinate system setting unit 1002. The coding unit 1004 codes the analysis result of the image data analysis unit 1003.
The personal authentication code generated by the encoding here is
It is represented by an enumeration of bits of "1" and "0" having a certain length.

The matching unit 1005 includes a coding unit 10
The personal authentication code obtained in 04 is matched with the personal authentication code as the template 1007 previously acquired from a specific individual. That is, the degree of coincidence between the individual authentication code of the subject and the individual authentication code of the specific individual is calculated according to a certain evaluation function. The determination unit 1006 performs the same person determination that the subject is a specific individual based on the result of the matching performed by the matching unit 1005, that is, when the calculation result of the evaluation function exceeds a certain threshold.

As a physical feature, for example, when a fingerprint and a palm print are used, a finger image and a palm image of the subject are acquired, and the feature points of the ridges forming the fingerprint and the palm print obtained from these images are obtained. Are coded based on the end points and branch points, and the personal authentication code of the subject acquired by this is matched with the personal authentication code previously acquired from a specific individual.

As a technique using the digital watermark technique and the biometrics personal authentication method as described above, for example,
Japanese Patent Laid-Open No. 2000-196998 and the like disclose a configuration in which eye information (eyeball image) is directly embedded in captured image data as embedded data. With this configuration, the iris pattern and the retinal pattern are extracted from the eyeball image (eyeball of the photographer) that is acquired almost at the same time as the shooting of the subject, and this extracted information is embedded as embedded data in the shot image data. , The photographer's information has a one-to-one correspondence, and
Since there is no room for a third party to intervene, it is effective in having high reliability as copyright information.

[0026]

By the way, in the conventional copyright protection method using the digital watermark technology and the biometrics personal authentication method as described above, for example, an iris pattern or a retina pattern is used as a physical feature, When this information is embedded as embedded data in the captured image (original image) data, the embedded data is the eyeball image data itself acquired at the time of capturing, or "1" and "1" encoded by image analysis. It is understood that the bit data has a constant length of "0".

Then, if the embedding data is the eyeball image data itself acquired at the time of photographing, the resolution of the embedding data is such that an iris pattern or a retina pattern can be extracted and recognized from the embedding data. Will be needed.
Therefore, the data capacity of the embedded data is inevitably huge. In addition, when the embedded data is bit data of a fixed length of "1" and "0" coded by image analysis, the embedded data must have a bit length with accuracy for personal authentication. Is required. Therefore, although the data capacity of the embedded data is smaller than that of the eyeball image data itself, the data capacity is still large.

That is, in the conventional copyright protection method using the digital watermark technology and the biometrics personal authentication method as described above, since the data volume of the embedding data to be embedded in the original image is large, the original image to be embedded is Is increased, and as a result, the original image is deteriorated before it can be recognized by the observer. Further, in order to prevent such deterioration of the original image, there is no choice but to enlarge the data capacity of the original image itself and secure a data capacity capable of embedding the embedded data as invisible.

Therefore, the present invention has been made in order to eliminate the above-mentioned drawbacks, and predetermined information for copyright protection of the target information without causing deterioration of the target information such as digital watermark processing. An information processing apparatus, an image data processing method, an information processing method, and a computer-readable storage medium storing a program for implementing the information processing method, which can easily and effectively embed the target information into the target information, and The purpose is to provide the program.

[0030]

[Means for Solving the Problems] Under such a purpose,
According to a first aspect of the present invention, a biometric information acquisition unit that acquires biometric information of a photographer along with a photographing operation of a subject by the imaging unit, biometric information obtained by the biometric information acquisition unit, and a plurality of preregistered units Based on the matching result with the biometric information of the registered user, personal data corresponding to the biometric information obtained by the biometric information acquisition means is extracted from a plurality of preregistered personal data, and the acquired personal data is obtained. Is an information processing apparatus including: a control unit that records the image data together with the image data obtained by the photographing operation.

The second invention is the same as the first invention,
The above-mentioned biometric information acquisition means is characterized in that the biometric information of the photographer is acquired along with the operation on the operation means for starting the photographing operation.

A third invention is the same as the first invention,
The control means controls to embed the personal data in the target image data as digital watermark information.

A fourth invention is the same as the first invention,
The control means controls to write the personal data as one item of additional information of the target image data.

According to a fifth aspect of the invention, the biometric information acquisition step of acquiring the biometric information of the photographer along with the photographing operation of the subject by the imaging means, and the biometric information obtained in the biometric information acquisition step are registered in advance. Based on the matching result with the biometric information of the plurality of registered users, personal data corresponding to the biometric information obtained in the biometric information acquisition step is extracted from the plurality of preregistered personal data, and the acquired personal data is acquired. And a control step of recording the personal data together with the image data obtained by the photographing operation.

A sixth aspect of the invention is the same as the fifth aspect of the invention.
The biometric information acquisition step is characterized in that the biometric information of the photographer is acquired in accordance with an operation on the operation means for starting the imaging operation.

A seventh aspect of the present invention is a biometric information acquisition step of acquiring biometric information of the user along with a photographing operation, and a coding for coding the biometric information acquired in the biometric information acquisition step into a personal authentication code. Step, a registration step of pre-registering personal authentication codes of biometric information for a plurality of registered users in association with the personal data of the corresponding registered user, a personal authentication code obtained by the encoding step, and the registration As a result of the matching by the individual identification step and the individual identification step, the personal identification code obtained by the encoding step is the registered individual authentication code by the registration step. Obtained as a result of the above coding step, if present as And personal data acquisition step of acquiring personal data corresponding to the personal authentication code from the personal data of a plurality of registered users by the registration step,
And a control step for recording the personal data obtained by the personal data acquisition step together with the image data obtained by the photographing operation.

An eighth invention is the above-mentioned seventh invention, wherein
The control step includes a step of embedding the personal data in the image data as digital watermark information.

The ninth invention is the same as the seventh invention,
The control step includes a step of writing the personal data as one item of image metadata which is additional information of the photographed image information.

A tenth invention is characterized in that a program for causing a computer to realize the information processing apparatus according to any one of claims 1 to 4 is recorded in a computer-readable storage medium.

An eleventh invention is a computer-readable program for causing a computer to execute the processing steps of the image data processing method according to claim 5 or 6 or the information processing method according to any one of 7 to 9. It is recorded on a different storage medium.

A twelfth invention is a program for causing a computer to realize the function of the information processing apparatus according to any one of claims 1 to 4.

A thirteenth invention is a program for causing a computer to execute the processing steps of the image data processing method according to claim 5 or 6 or the information processing method according to any one of 7 to 9. Characterize.

Specifically, for example, at the same time when the photographer (user) releases the shutter, a biometric information image for personal authentication of the photographer is taken in, and the biometric information image is encoded by image processing or the like. , Generate a personal authentication code of the photographer. On the other hand, in advance, for each prospective person (registered user) who will use this apparatus (image capturing apparatus), the individual authentication code of the biometric information image of the registered user and personal data (user information) such as name are registered in pairs. Keep it. The personal identification code acquired at the time of shooting is the personal identification code registered in advance (registered personal identification code).
If the personal identification code that is determined to be the same person as the photographer is registered as a result of matching by the same person determination as to whether or not it matches, the pair is registered and held with the personal authentication code. User information is recorded for a captured image.

According to the above arrangement, since the photographed image and the photographer's information correspond one-to-one, it is essentially possible to specify the copyright holder without forgery, and at the same time,
There is no need to be bothered with subsequent work. Further, since the data (user information) to be recorded for the captured image for copyright protection requires a small capacity, it is advantageous for the deterioration of the image quality of the captured image.

Further, for example, when the user information is embedded as digital watermark information in the photographed image, the photographed image (digital image data) and the copyright information can be inseparably integrated. Further, since the user information is directly embedded in the photographed image, when a third party uses digital watermark information extraction software or the like, it becomes easy to confirm the photographer who is the copyright holder.

Further, for example, when the user information is configured to be written as one item of supplementary information (image metadata) of the photographed image, the photographed image (digital image data) and the copyright information are managed in a one-to-one relationship. Moreover, since there is no need to directly change the captured image, there is no concern about deterioration of the image quality of the captured image. Furthermore, since the user information is directly written in the photographed image, it becomes easy to confirm the photographer who is the copyright holder when a third party uses the image metadata reading software or the like. The “image metadata” (supplementary information) here is, for example, often added to a captured image,
User information is described as one of these items, including the model name of the camera, incidental information such as shooting date, shutter speed, and aperture value.

[0047]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment] The present invention is applied to a digital still camera 100 as shown in FIG. 1, for example, as an information processing apparatus. The digital still camera 100 according to the present embodiment has a function of embedding predetermined information (embedded data) for copyright protection of a captured image in the captured image data by the digital watermark technology and the biometrics personal authentication method. Have. In the present embodiment, the configuration and operation of the digital still camera 100 will be specifically described below by taking the embedded data as “iris image” data, which is information on the physical characteristics obtained from the photographer, as an example.

<Structure of Digital Still Camera 100> In the digital still camera 100, as shown in FIG. 1, a shutter button 102, a liquid crystal 104 for displaying photographing information,
A set button group 105 and a mode dial 106 are provided.

When the shutter button 102 is pressed, a signal to start photographing is generated. As a result, photographing of a subject image by the image pickup element described later is started. The shooting information display liquid crystal 104 displays various information such as a shutter speed, an aperture value, and a set shooting mode. The setting button group 105 is
The digital camera 100 has buttons for making various settings. The mode dial 106 is the digital camera 1
00 is a dial for switching the photographing mode.

FIG. 2 is a schematic sectional view of a main part of the digital still camera 100 shown in FIG.

In FIG. 2, 201 is a photographing lens group. In FIG. 2, for the sake of simplicity of description, the photographing lens group 201 is illustrated as being composed of two lenses, but the number of lenses is not limited to this, and for example, it is composed of many lenses. You may.

Reference numeral 202 is a main mirror. Main mirror 20
Reference numeral 2 obliquely or retreats the subject light from the photographing lens group 201 to the photographing optical path according to the observation state of the subject image by the finder system and the photographing state of the subject image. 203
Is a sub-mirror, and 205 is a focus detection device. The sub mirror 203 transmits the light flux transmitted through the main mirror 202,
The light is reflected toward the focus detection device 205 located below the camera body.

Reference numeral 204 is a shutter, and 504 is an image pickup device described later. Reference numeral 206 denotes a focusing plate arranged on the planned image forming surface of the photographing lens group 201, and 207 denotes a pentaprism for changing the finder optical path. Reference numerals 208 and 209 are an imaging lens and a photometric sensor for determining the brightness of the subject image.

Reference numeral 210 is an eyepiece having a spectroscope 210a. The eyepiece lens 210 is the penta prism 20.
The focus plate 206 provided by the photographer is disposed behind the exit of 7
Used to observe. The spectroscope 210a is composed of, for example, a dichroic mirror that reflects infrared light, and transmits visible light.

Reference numeral 211 is a light receiving lens. 220 is
An iris detection sensor using an image pickup device such as a CCD.
The iris detection sensor 220 is arranged so as to be conjugate with the vicinity 214 of the photographer's pupil at a predetermined position with respect to the light receiving lens 211. Reference numerals 213a and 213b are infrared light emitting diodes for illuminating the vicinity 214 of the photographer's pupil.

Therefore, the iris of the photographer is the spectroscope 21.
0a, the light receiving lens 211 forms an image,
An image is formed by forming an image on the iris detection sensor 220.

FIG. 3 is an internal block diagram of the digital still camera 100 shown in FIGS. 1 and 2. The main functional configuration of the digital still camera 100 shown in FIG. 3 will be described below.

In the digital still camera 100 shown in FIG. 3, the camera control microcontroller (MCU)
For 500, the IRED drive circuit 524 for driving the infrared light emitting diode 213 for illuminating the vicinity of the pupil, the signal input circuit 501, and the liquid crystal drive circuit 502 for the liquid crystal 104 for photographing information display together with the iris detection sensor 220. Various circuits and sensors for camera control such as are connected. The camera control MCU 500 is, for example, a CPU that controls the operation of the entire digital still camera 100, and an R that stores a processing program for executing the operation control.
RAM for storing OM, variables, etc., and EEPROM for storing correction data, other parameters, etc.
It has computer functions as described later, including (electrically erasable / writable memory).

The iris detection sensor 220 detects the iris of the photographer and transmits an electric signal (analog signal) indicating the detection result to the camera control MCU 500. The camera control MCU 500 A / D-converts the electric signal transmitted from the iris detection sensor 220, and sequentially stores the iris image data acquired by the A / D conversion in the RAM.

The signal input circuit 501 includes the shutter button 10
2. The operation states of the setting button group 105, the mode dial 106 (see FIG. 1), etc. are transmitted to the camera control MCU 500. The camera control MCU 500 controls the entire digital still camera 100 based on the operation state transmitted from the signal input circuit 501.

The liquid crystal drive circuit 502 is an MC for camera control.
Digital still camera 1 according to the instruction from U500
00 Liquid crystal 10 for photographing information display arranged outside the main body
4 (see FIG. 1 above), various information is displayed.

A digital MCU 507 is connected to the camera control MCU 500 via a signal line 503. The digital MCU 507 controls a digital image capturing operation according to an instruction from the camera control MCU 500. For example, the digital MCU 507 executes a processing program stored in advance in the flash memory 509 to control the operation of each component related to shooting via the signal line 514.

Under the control of the digital MCU 507, a subject image is first formed on the image pickup device 504 (CCD or CMOS area sensor) at the timing of pressing the shutter button 102 (see FIG. 1). A / D converter 5
Reference numeral 05 digitizes and outputs the electrical signal of the subject image output from the image sensor 504.

The signal processing circuit (IC) 506 performs signal processing such as color interpolation processing and filtering processing on the data (digital image data) output from the A / D converter 505, and after the processing. Image data is temporarily stored in the DRAM 511 via the data bus 514. The color monitor 508 displays the digital image data stored in the DRAM 511 as needed.

In this embodiment, the digital image data stored in the DRAM 511 is integrated with the embedded data for copyright protection according to the method described later, and then the compression circuit (JPEG IC). ) 510, the processed digital image data is compressed and written to the removable memory card 516 via the memory card interface (I / F) 513. Further, the processed image data can be output to the serial bus 515 via the serial I / F 512.

<Characteristic Operation of Digital Still Camera 100> FIG. 4 shows a characteristic operation of the digital still camera 100 (embedding processing of embedding data for copyright protection).
Is shown by a flowchart.

Steps S600 and S601: In the digital still camera 100, the shutter button 10
When 2 is pressed (turned on) by the user (step S60)
0), the camera control MCU 500 performs the photometry of the subject image and the photometric calculation to determine the exposure value and to perform focus adjustment on the subject (step S601).

Along with the photographing operation in step S601, the processing in steps S602 to S604,
The processes of steps S611 to S617 are simultaneously executed.

Steps S602 to S604: When a subject image starts to be formed on the image sensor 504 (accumulation of the subject image is started) (step S602), the image signal processing IC 506 causes the A / D converter 505 to operate. The accumulated signal is acquired as digital image data from the image sensor 504 via the image pickup device 504 (step S603), signal processing is performed on the digital image data (step S604), and the processed image data (subject image data) is stored in the DRAM 51.
Store in 1. Then, it progresses to step S605.

Steps S611 to S617: At step S602, the iris detection sensor 113 acquires an image of the iris of the photographer at the same time when a subject image starts to be formed on the image sensor 504 (image accumulation is started). Yes (step S611). MCU500 for camera control
The iris portion of the photographer's iris image obtained by the iris detection sensor 113 is analyzed by the same configuration as the configuration shown in FIG. 9 (processing configuration based on the principle of individual authentication by the iris pattern). And the coordinate system is set (step S612), image analysis is performed based on the principle of extracting the shade change of the analysis band (step S613), and coding is executed based on the analysis result (step S61).
4) Obtain the coded data (iris data) as a personal authentication code of the photographer.

A procedure for a user who intends to use the digital still camera 100 to register a personal authentication code generated from his / her iris image and personal data such as a name will be described. The data registered here is used in the matching process of step S615 following step S614.

First, the user uses the mode dial 106.
By rotating (see FIG. 1 above), the shooting mode is switched to the “copyright data registration mode”. Then, the user holds the digital still camera 100, looks into a finder (not shown), and presses down the shutter button 102. The subject is not photographed by operating the shutter button 102 at this time.

When the above-mentioned user operation is performed, the iris detection sensor 113 acquires an image of the iris of the user. With this shooting operation, the MCU 500 for camera control
Has a configuration similar to that shown in FIG. 9 (processing configuration based on the principle of individual authentication by an iris pattern),
With respect to the iris image of the user obtained by the iris detection sensor 113, the iris portion is divided into analysis bands to set a coordinate system,
An image analysis is performed based on the principle of extracting the change in shade of the analysis band, coding is performed based on the analysis result, and the coded data (iris data) is registered as a user's individual authentication code.

Further, the user operates the setting button group 105 (see FIG. 1) and the like to set personal data (user information) such as his / her name, address, and affiliation.

The settings (personal data) set by the user operation described above are transferred to the M for camera control via the signal input circuit 501.
It is transmitted to the CU500. MCU500 for camera control
Stores the personal data as a pair in association with the personal authentication code registered previously.

Therefore, a plurality of users sequentially perform the registration work by the above-mentioned operation, so that the digital camera 100 (specifically, the camera control MCU 500) is provided.
In, the personal authentication code and the personal data associated as a pair are stored.

Then, the camera control MCU 500, following the process of step S614, performs matching between the personal authentication code of the photographer acquired in the execution of the process and a plurality of personal authentication codes registered previously. (Step S615). Then, the camera control MCU 500 determines whether or not the code corresponding to the personal authentication code of the photographer is registered as a result of the matching in step S615 (step S616), and as a result of this determination, the corresponding code is registered. If not, step S6 is performed as it is.
If the corresponding code is registered, the process proceeds to step S605 via step S617 and step S605.

At step S617, the camera control MC
The U500 extracts the personal data associated with the code determined to correspond to the personal authentication code of the photographer in step S616 (step S617).

Step S605: Digital MCU 507
Is D by the image signal processing IC 506 in step S604.
For the subject image data stored in the RAM 511,
In step S617, a process of embedding the personal data extracted by the camera control MCU 500 (digital watermark embedding process) is executed. The process here is step S61.
If it is determined in 6 that the current personal authentication code of the photographer does not exist in the previously registered personal authentication codes, it is ignored and the process directly proceeds to the next step S606.

Steps S606 and S607: The digital MCU 507 receives the subject image data stored in the DRAM 0511 by the image signal processing IC 506 in step S604 or the digital watermark embedding process in step S605 after the subject image data. The data is compressed by the compression circuit (JPEG IC) 510 and then stored in the flash memory 509 (step S60).
6). After that, this processing ends (operation of one shooting ends) (step S607).

As described above, in the present embodiment, by encoding the iris image data (physical characteristics) of the photographer,
The personal authentication code of the photographer is acquired, and the personal authentication code is matched with the personal authentication codes obtained from the iris image data of a plurality of pre-registered users (registered users), and the personal authentication of the photographer is performed. When the code is registered, the photographed image obtained by the operation of the photographer by using the user's personal data (user information) held in a pair in association with the registered personal authentication code as digital watermark embedded data. It is configured to be embedded in (target information).

With the above-described configuration, the data amount of the data to be embedded in the photographed image needs to have a resolution enough to extract and recognize the iris pattern as in the conventional case, or the bit length has the accuracy for personal authentication. It is not necessary to secure a large capacity so that the capacity does not become large.
Therefore, it is possible to prevent image deterioration due to data embedding. In addition, since the photographed image and the personal data (data of the photographer of the photographed image) correspond one-to-one, it is essentially possible to identify the copyright holder without any forgery, and also for subsequent work. No more bothered. Further, since the data such as the name of the photographer is used as the personal data to be embedded in the photographed image, the photographed image and the copyright can be inseparably integrated. Furthermore, this personal data makes it easy to confirm the photographer who is the copyright holder, for example, when a third party uses digital watermark information extraction software or the like.

[Second Embodiment] In the first embodiment, personal data stored in association with a personal authentication code that is coded iris image data (physical characteristics) of the photographer is embedded in the photographed image. As configured. In the present embodiment, for example, the personal data is written as one item of image metadata (accompanying information) of a captured image. Therefore, the digital still camera 100 operates according to the flowchart shown in FIG.

Here, only the configuration and operation different from those of the first embodiment will be specifically described.

First, the photographer uses the digital still camera 10
Image metadata as additional information is added to a captured image obtained by capturing an object with 0.

Specifically, for example, as a file format standard for a captured image acquired by a digital camera, a standard is defined in which various attribute information relating to the captured image is stored as one file together with the captured image ( There is a standard such as Exif file, which is widely used. Examples of this attribute information include information such as shooting date / time, exposure information, shooting mode, image compression ratio, and white balance.When reading a shot image from a digital camera in a personal computer having an image reading function, Used by any software.

In the present embodiment, information for explaining the captured image, which is different from the captured image itself and is added to the captured image, like the attribute information described above, is used as image metadata. The personal data of the photographer is written as one item of this image metadata.

Therefore, in the process shown in FIG. 5, it is determined in step S616 that the code corresponding to the personal authentication code of the photographer is registered, and step S616 is performed.
Upon proceeding to step S605 ′ via 617, the digital MCU 507 determines in step S604 the image signal processing IC 5
As one item of image metadata of the subject image data stored in the DRAM 511 according to 06, step S617
At, the personal data extracted by the camera control MCU 500 is written.

Steps S606 and S607: The digital MCU 507 determines that the subject image data stored in the DRAM 0511 by the image signal processing IC 506 in step S604 or the personal data is one of the image metadata in step S605 'for the subject image data. The data after being written as an item is compressed by a compression circuit (JPEG
It is stored in the flash memory 509 after being compressed by the IC) 510 (step S606). After that, this processing ends (operation of one shooting ends) (step S607).

As described above, in the present embodiment, the iris image data (physical characteristics) of the photographer (information creator) is coded to acquire the photographer's individual authentication code, and the individual authentication code is acquired. And the personal identification codes obtained from the iris image data of a plurality of users registered in advance are matched, and if the personal identification code of the photographer is registered, the personal identification codes are associated with the registered personal identification codes. The personal data of the user held in (1) is written as one item of image metadata (incidental information) of the photographed image (target information) obtained by the operation of the photographer (information creator).

With the above configuration, in addition to the effects of the first embodiment, it is possible to manage the photographed image and the copyright information in a one-to-one correspondence, and the photographed image is not directly changed. As a result, it is possible to obtain an effect that there is no fear of deterioration of image quality.

In the first and second embodiments, the iris is used as the physical characteristic information (biological information), but the invention is not limited to this, and information that can identify an individual, such as a fingerprint, is used. Various biometric information such as a palm print and a palm print can be applied.

The present invention is not limited to the digital still camera, but can be applied to devices such as image recording devices and systems.

Further, an object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the host and the terminal of the first and second embodiments to a system or apparatus, and the system or apparatus. It is needless to say that it is also achieved by the computer (or CPU or MPU) of the device reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the first and second embodiments, and the storage medium storing the program code and the program code constitute the present invention. Becomes A ROM, flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, non-volatile memory card, or the like can be used as a storage medium for supplying the program code.

[0096]

As described above, in the present invention, for example, predetermined information for copyright protection of the target information is added to the target information (photographed image etc.) generated based on the operation by the user. When recording, the user (photographer, etc.)
When the biometric information of the user is registered in advance and the biometric information of the user is registered in advance, the corresponding user information associated with the biometric information at the registration is recorded in the target information. As a result, since the data amount of the information to be recorded (user information) does not become large compared to the configuration in which the biometric information is directly recorded in the target information, deterioration of the target information due to information recording can be prevented. . Further, since the target image and the user information correspond one-to-one, it is essentially possible to specify the copyright holder without room for forgery.

Specifically, for example, when the present invention is applied to an image recording device such as a digital still camera, the following effects can be obtained. (1) Since photographed images (target information) and photographer information (user information) have a one-to-one correspondence and there is no room for a third party to intervene, it can be used as highly reliable copyright information. it can. Also, in the series of actions of shooting action,
Since the biometric information of the photographer (user) is acquired, the photographer is not forced to perform a specific operation and is not made uncomfortable. (2) Since personal data (user information) such as the name of the photographer (user) is added to the captured image (target information), the amount of data to be added to the captured image can be reduced, and deterioration of the image can be prevented. Is advantageous.

(3) When the personal data (user information) of the photographer (user) is embedded as digital watermark information in the photographed image (target information), the copyright information and the photographed image must be treated as an integral part. Is possible. (4) Since copyright information, which is personal data (user information) of a photographer (user), can be added as one item of image metadata without directly changing the captured image (target information), The effect is that there is no fear of deterioration in the quality of the captured image.

[Brief description of drawings]

FIG. 1 is a front perspective view of a digital still camera according to a first embodiment of the present invention.

FIG. 2 is a schematic view of a cross-sectional main part of the digital still camera.

FIG. 3 is a block diagram showing an internal configuration of the digital still camera.

FIG. 4 is a flowchart for explaining the operation of the digital still camera.

FIG. 5 is a flowchart for explaining the operation of the digital still camera according to the second embodiment.

FIG. 6 is a diagram for explaining a digital watermark embedding process.

FIG. 7 is a diagram for explaining an image division process in the digital watermark embedding process.

FIG. 8 is a diagram for explaining a process of extracting embedded data by the digital watermark embedding process.

FIG. 9 is a diagram for explaining a personal authentication process using an iris image;

FIG. 10 is a diagram for explaining eyeball image coordinate setting processing in the personal authentication processing.

[Explanation of symbols]

100 digital still camera 102 shutter button 104 LCD for shooting information display 105 setting button group 106 mode dial 213 Infrared light emitting diode 220 Sensor for iris detection 500 MCU for camera control 501 signal input circuit 502 LCD drive circuit 503 signal line 504 image sensor 505 A / D converter 506 Image signal processing IC 507 Digital MCU 508 color monitor 509 flash memory 510 compression circuit 511 DRAM 512 serial I / F 514 signal line 513 memory card I / F 515 signal line 516 memory card 524 IRED drive circuit

Continued front page    F term (reference) 5B057 AA20 BA02 BA19 CB19 CE08                       CG07 CH18 DC32                 5C022 AA13 AB02 AB24 AC03 AC13                       AC42                 5C063 CA11 CA34 CA36 DA07 DA13                       DA20                 5C076 AA14 BA06

Claims (13)

[Claims] 1. A biometric information acquisition unit for acquiring biometric information of a photographer along with a photographing operation of a subject by the imaging unit, biometric information obtained by the biometric information acquisition unit, and a plurality of registrations registered in advance. Based on the matching result with the biometric information of the user, personal data corresponding to the biometric information obtained by the biometric information acquisition means is extracted from a plurality of preregistered personal data, and the obtained personal data is An information processing apparatus, comprising: a control unit that records the image data obtained by the photographing operation together with the image data. 2. The information processing apparatus according to claim 1, wherein the biometric information acquisition means acquires biometric information of a photographer in accordance with an operation on the operation means for starting a photographing operation. 3. The information processing apparatus according to claim 1, wherein the control means controls the personal data to be embedded in the target image data as digital watermark information. 4. The information processing apparatus according to claim 1, wherein the control unit controls the personal data to be written as one item of additional information of the target image data. 5. A biometric information acquisition step of acquiring biometric information of a photographer along with a photographing operation of a subject by the image pickup means, the biometric information obtained in the biometric information acquisition step, and a plurality of registered registrations in advance. Based on the matching result with the biometric information of the user, personal data corresponding to the biometric information obtained in the biometric information acquisition step is extracted from a plurality of preregistered personal data, and the acquired personal data is And a control step of recording together with the image data obtained by the photographing operation. 6. The biological information acquisition step is accompanied by an operation on an operation means for starting a photographing operation,
6. The biometric information of the photographer is acquired.
Image data processing method described. 7. A biometric information acquisition step of acquiring biometric information of the user in association with a photographing operation; a coding step of coding the biometric information acquired by the biometric information acquisition step into a personal authentication code; The registration step of pre-registering the personal authentication code of the biometric information about the registered user in association with the personal data of the corresponding registered user, the personal authentication code obtained by the encoding step, and the registered individual by the registration step. In the case where the individual identification step of performing the same person determination matching with the authentication code and the personal identification code obtained in the encoding step as a result of the matching in the individual identification step exist as the registered individual authentication code in the registration step. In addition, the personal authentication obtained by the above coding step A personal data acquisition step of acquiring the personal data corresponding to the card from the personal data of the plurality of registered users in the registration step, and the personal data obtained in the personal data acquisition step in the image obtained by the photographing operation. An information processing method comprising: a control step of recording together with data. 8. The information processing method according to claim 7, wherein the control step includes a step of embedding the personal data in the image data as digital watermark information. 9. The information processing method according to claim 7, wherein said control step includes a step of writing said personal data as one item of image metadata which is incidental information of said photographed image information. 10. A computer-readable storage medium recording a program for causing a computer to realize the information processing apparatus according to claim 1. 11. A computer-readable storage medium storing a program for causing a computer to execute the processing steps of the image data processing method according to claim 5 or 6 or the information processing method according to any one of 7 to 9. Medium. 12. A program for causing a computer to realize the functions of the information processing device according to claim 1. 13. A program for causing a computer to execute the processing steps of the image data processing method according to claim 5 or 6, or the information processing method according to any one of 7 to 9.