JPH11168616A - Image information processing method and image information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image information processing method by which image information resulting from superimposing adaptable information on main image information is generated, without distinguishing an electronic medium from a non-electronic medium and the recorded adaptable information is reproduced. SOLUTION: After binary imbedded information is generated by applying binary-coding for imbeddeding information 101 consisting of character, image and audio data or the like, the resulting information is converted into monochromatic binary image information of a predetermined specific format to generate imbedded image information being visible information. Then the generated imbedded image information is imbedded to imbedded image information 102 consisting of multi-value color images in an invisible state to generate composited image information 107. The generated synthesis image information 107 is recorded on an electronic medium or a non-electronic medium, and the imbedded image information is extracted from the synthesis image information stored in the electronic medium or the non-electronic medium to reproduce the imbedded information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to, for example, superimposing another additional image information on main image information and recording the image information or superimposing the additional image information on the additional image information. The present invention relates to an image information processing method and an image information processing apparatus for reproducing an image.

[0002]

2. Description of the Related Art In recent years, with the digitization of information and the spread of the Internet, techniques such as digital watermarks and digital signatures have become increasingly important. As one of those fields,
Research on a special encryption format called "image deep encryption" is underway. This technology embeds and records additional information in the main image information in an invisible state. For example, countermeasures against unauthorized copying, counterfeiting, and falsification of ID cards with printed face photographs and photographs with embedded copyright information It is effective for

[0003] For example, regarding the "method of synthesizing text data to an image using a color density pattern", Journal of the Institute of Image Electronics Engineers of Japan, 17-4 (1988), pp 194-1.
No. 98 discloses a method of superimposing information on a digital image represented by pseudo gradation.

[0004] For example, see Japanese Patent Application Laid-Open No. 4-294862.
Japanese Patent Application Laid-Open Publication No. H11-176,086 discloses a method capable of specifying a recorded color copier or the like from a hard copy output of the color copier.

[0005]

However, the "method of synthesizing and encoding text data into an image using a color density pattern" and Japanese Patent Application Laid-Open No. H4-294862 disclose only electronic media as objects for embedding image information. Alternatively, it is intended for only non-electronic media (paper), and no technology applicable to both is disclosed or suggested.

Further, although a method of embedding image information is disclosed, there is no disclosure about a system-like configuration that embeds, records, and reproduces image information. Therefore,
The present invention can create image information in which additional information is superimposed on main image information without discriminating between electronic media and non-electronic media, and can record any type of recording medium. It is an object of the present invention to provide an image information processing method and an image information processing apparatus that can reproduce the added image information.

[0007]

According to the image information processing method of the present invention, embedded image information is created by converting embedded information composed of characters, images, sounds and the like into visualized information, and the created embedded image information is created. Creating composite image information in which the information is embedded in the embedded image information in an invisible state, and recording the created composite image information on a recording medium;
The method is characterized in that the embedded image information is extracted from the composite image information recorded on the recording medium and the embedded information is reproduced.

Further, according to the image information processing method of the present invention, after embedding information composed of characters, images, voices and the like is binary-coded to generate binary embedding information, a monochrome binary of a predetermined specific format is created. Creates embedded image information that is visualization information by converting it into image information, and synthesizes the created embedded image information into the embedded image information composed of multi-valued color images in an invisible state. Is recorded on a recording medium, and the embedded image information is extracted from the composite image information recorded on the recording medium to reproduce the embedded information.

Further, the image information processing method of the present invention creates embedded image information by converting embedded information composed of characters, images, sounds, and the like into visualization information, and uses the created embedded image information in advance. Modulation is performed on predetermined pattern image information to be set to create pattern modulation image information, and composite image information is created by superimposing the created pattern modulation image information on embedded image information, The created composite image information is recorded as a soft copy on an electronic medium, and the pattern image information is electronically superimposed on the composite image information recorded on the electronic medium to perform a masking process. After visualizing, the embedded information is reproduced by extracting and decoding the embedded image information. To.

Further, the image information processing method of the present invention creates embedded image information by converting embedded information composed of characters, images, sounds, and the like into visualization information, and uses the created embedded image information in advance. Modulation is performed on predetermined pattern image information to be set to create pattern modulation image information, and composite image information is created by superimposing the created pattern modulation image information on embedded image information, The created composite image information is recorded as a hard copy on a non-electronic medium, and the composite image information recorded on the non-electronic medium has a transmission distribution of the same pattern as that of the pattern image information. The embedding image is formed by physically superposing a sheet-shaped mask sheet arranged at the same resolution and the same size on a medium. After the information has been visualized, the reading of embedded image information optically by decoding extracted and characterized by reproducing the embedded information.

Further, the image information processing apparatus of the present invention comprises an embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds and the like into visualization information, Synthetic image information creating means for creating composite image information in which the embedded image information created by the information creating means is embedded in the embedded image information in an invisible state, and a composite image information created by the synthetic image information creating means. Recording means for recording the composite image information; and reproducing means for extracting the embedded image information from the composite image information recorded by the recording means and reproducing the embedded information.

Further, the image information processing apparatus of the present invention generates binary embedded information by performing binary coding on embedded information composed of characters, images, sounds, and the like, and then converts the embedded binary information into a monochrome binary data of a predetermined format. Embedded image information creating means for creating embedded image information which is visualization information by converting the image information into embedded image information; and embedding image information created by the embedded image information creating means for embedded image information comprising a multi-valued color image. Composite image information creating means for creating composite image information embedded in an invisible state, recording means for recording the composite image information created by the composite image information creating means, and recording information recorded by the recording means. Reproducing means for extracting the embedded image information from the composite image information and reproducing the embedded information.

Further, the image information processing apparatus of the present invention comprises an embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds and the like into visualization information, Pattern modulation image information creating means for creating pattern modulation image information by modulating predetermined pattern image information set in advance with the embedded image information created by the information creating means; Means for creating composite image information by superimposing the pattern-modulated image information created by the means on the embedded image information, and soft-copying the composite image information created by the composite image information creation means Means for recording an image on an electronic medium, and composite image information recorded on the electronic medium by the recording means. Reproducing means for reproducing the embedded information by extracting and decoding the embedded image information after visualizing the embedded image information by electronically superimposing the pattern image information and performing a masking process; Is provided.

Further, the image information processing apparatus of the present invention comprises an embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds and the like into visualization information, Pattern modulation image information creating means for creating pattern modulation image information by modulating predetermined pattern image information set in advance with the embedded image information created by the information creating means; Means for creating composite image information by superimposing the pattern modulation image information created by the means on the embedded image information, and hard-copying the composite image information created by the composite image information creation means Recording means for recording on a non-electronic medium as a recording medium, and a composite image recorded on the non-electronic medium by the recording means For the information, the pattern image information has the same pattern distribution distribution as the pattern image information, by physically superimposing a sheet-shaped mask sheet arranged at the same resolution and the same size on another non-electronic medium, After the embedded image information is visualized, a reproducing means for optically reading, extracting and decoding the embedded image information to reproduce the embedded information is provided.

[0015]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a flowchart for explaining the overall flow of the image information processing method according to the present embodiment. Hereinafter, the flow of the image information processing method will be described with reference to this flowchart.

The embedding information 101 is information that the creator wants to embed invisibly, such as characters, images, and sounds. The embedded image information 102 is information for creating a full-color image with a target image in which information is to be embedded, such as a face photograph of an identification card. The mask image information (pattern image information) 103 is information for creating a binary image used in the combination processing step 106, the restoration processing step (a) 109, and the restoration processing step (b) 112 described later.

First, in a binary coding step 104, the embedding information 101 is binary-coded. In this case, for analog data such as voice, A / D (analog
The digital data after the (digital) conversion is binary-coded, and in the case of digital data such as characters and images, the digital data is binary-coded as it is.

Next, an embedded image information creating step 105
In step (2), embedded image information is created by converting binary data created by binary encoding in the binary encoding step 104 into binary image information according to a predetermined format. At this stage, all invisible data such as audio data which is not visible in the normal state also becomes visible data (= binary image information).

Next, in the synthesis processing step 106,
By performing the combining process 106 using the embedded image information, the embedded image information 102, and the mask image information 103 created in the embedded image information creating step 105, full-color combined image information 107 is created. At first glance, the composite image information 107 looks the same as the embedded image information 102 at first glance, and looks the same image, but internally, the embedded image information is hidden in an invisible state. Note that the composite image information 107 can be stored in a generally popular image format, for example, TIFF or JPEG.

The composite image information 107 thus created
Can be distributed either by recording on an electronic medium such as a homepage on the Internet or e-mail, or by recording on a non-electronic medium such as paper.

First, a description will be given of a case where the composite image information 107 is distributed on an electronic medium. In a recording step 108 on the electronic medium, the composite image information 107 created in the composite processing step 106 is stored in a homepage, an e-mail, On an electronic medium.

Next, when the composite image information 107 recorded on the electronic medium is received, the composite image information 107 is restored (step (a) 10).
By performing step 9, the embedded image information that has been embedded in the composite image information 107 in an invisible state is made visible. Thereafter, the reproduction processing step (a) 110 is performed to reproduce the embedded information 101 from the embedded image information.

On the other hand, the case of distributing the composite image information 107 on a non-electronic medium will be described. In the recording step 111 on the non-electronic medium, the composite image information 107 created in the composite To record.

Next, the received composite image information 107 recorded on the non-electronic medium is subjected to a restoration process (b) 112, so that the embedded image that has been embedded in the composite image information 107 in an invisible state is obtained. Make image information visible. After that, the reproduction information step (b) 113 is performed to reproduce the embedded information 101 from the embedded image information.

Next, a method of creating embedded image information will be described in more detail with reference to FIG. First, in an A / D conversion step 201, the embedded information 101 composed of analog data such as audio is A / D converted and converted into digital data. In the case of the digital data format, the A / D conversion step 201
Is omitted.

Next, in a header creation step 202, a header of the embedding information is created. In this method, an embedding position, an embedding amount, a type of embedding information, and other attribute information are added in order to associate the embedding information with the embedding image information, and are used when the embedding information is reproduced. Table 1 below shows an example of an embedded information header.

[0027]

[Table 1]

Here, the type of embedded information describes what the embedded information is. For example, in hexadecimal notation, xy _H x (upper 4 bits)... Representing the type of data = 1... Text = 2... Image... 3... Voice y (lower 4 bits). Playback immediately after restoration = 2 ... Playback after confirmation at restoration = 3 ... Restoration only.

Next, in a binary coding step 104, the embedding information converted into digital data and the embedding information header are converted into a binary image using a two-dimensional code. To do this, embed information is divided into 4-bit blocks in order from the top, and according to the value of each block,
As shown in FIG. 3, the image is replaced with monochrome image information of 2 × 2 pixels.

For example, if the embedding information is arranged in hexadecimal notation from the beginning as follows, FF 01 45 D3... Are replaced as shown in FIG.

Further, the binary image information is magnified n times so that the embedded image information is not damaged at the time of the smoothing process at the time of the synthesizing process described later. Here, n = 2 to 4 is desirable. For example, FIG. 5 shows the result of enlarging the binary image information of FIG. 4 with n = 2.

Although the color code is applied to the two-dimensional coding in the present embodiment, other two-dimensional bar codes such as a matrix two-dimensional code and a glyph code can be used without any problem.

After all the replacement by the two-dimensional code is performed, the embedded image information creating step 1
At 05, these are two-dimensionally laid out based on the information in the information header to obtain embedded image information. In this example, the embedded information header a, the first
Embedded information b, second embedded information c, third embedded information d,
The fourth embedding information e has been converted.

At the time of creating the embedded information header and the embedded image information, the embedding information is associated with the embedded image information. This is a guide when the user extracts certain specific information from a plurality of embedded information from the composite image information.

For example, when the present invention is applied to an electronic picture book, a landscape photograph of a zoo is used as embedded image information. In the zoo photos, the embedding image information should be associated with the embedding information relatively easily, for example, a lion's meow in a lion's photo and a penguin's ecology in a penguin's photo. This makes it easy to find the desired embedded information from among the plurality of embedded information.

For example, when the present invention is used for an identification card, a photo of the owner's face is used for the embedded image information, and personal information that can identify the owner is used for the embedded image information.
For example, voiceprint information can be embedded in the mouth of a face photograph using a fingerprint image or a voiceprint.

Next, referring to FIG. 6, the details of the combining step 106 in FIG. 1 will be described. The embedded image information 102 is image information in which the embedded information is embedded, and corresponds to a photo of the owner's face in the identification card. This has information of 24 bits (8 bits for each of RGB) per pixel. The embedded image information is obtained by dividing the information to be embedded by the above-described method.
This is converted into a value image, and corresponds to, for example, a password in an identification card. It has one bit of information per pixel. The mask image information 103 is image information used at the time of synthesis processing and restoration of embedded image information.
Each pixel has one bit of information.

First, in the smoothing processing step 301, the black pixel of the embedded image information is "1" and the white pixel is "0".
To perform a smoothing process. Here, a 3 × 1 pixel region is cut out from the pixels at both ends of the target pixel in the x direction,
The weighted average is calculated as in the following equation (1).

W (i) = (STL (i−1) + 2 · STL (i) + STL (i + 1)) / 4 (1) W (i): x = average weight of pixel i STL (i) : X = embedded image information of i pixel = 1 or
0 As described above, it should be noted that the embedded image information is destroyed during the smoothing process unless the number is multiplied by n when creating the embedded image information. The larger the enlargement ratio n, the higher the safety factor at which the embedded image information is not destroyed, but the more easily the hidden data is exposed.

For example, when the mask image information is shown in FIG. 7 and the embedded image information is shown in FIG. 8, the result of the smoothing process is as shown in FIG. The embedded image information is set to n = 4, and the embedded image information is enlarged four times. Also, two pixels around the outside are set to “0” as an embedding margin.

Next, in the phase modulation step 302,
Based on the result of the smoothing processing in the smoothing processing step 301, the phase modulation of the mask image information 103 is performed according to the rules of the following equations (2-1) to (2-3).

When W (i) = 0 → DES (i) = MSK (i) (2-1) When W (i) = 1 → DES (i) = MSK (i + 2) (2) -2) Other than the above → DES (i) = MSK (i + 1) (2-3) DES (i): x = Phase modulation result of i pixel = 1 or
0 MSK (i): x = mask image information of i pixel = 1 or
0 Here, the x = 0 column and the x = 15 column cannot be subjected to the smoothing processing due to the end of the image information, and therefore cannot be phase-modulated.
Therefore, the exclusive OR of the mask image information and the embedded image information is calculated at the end. Here, an example of the result of the phase modulation is shown in FIG.
0 is shown.

Next, in the color difference modulation step 303,
Based on the phase modulation result in the phase modulation step 302,
The color difference modulation processing is performed according to the rules of the following equations (3-1) to (3-6). In this case, R (red), G (green), B
The three components (blue) are calculated separately. FIG. 11 shows an example of the color difference modulation result of the red component.

When DES (i) = 1 → VR (i) = − ΔV (3-1) → VG (i) = + ΔV (3-2) → VB (i) = + ΔV ( 3-3) When DES (i) = 0 → VR (i) = + ΔV (3-4) → VG (i) = − ΔV (3-5) → VB (i) = − ΔV … (3-6) VR (i): color difference modulation result of x = i pixel Red component: integer in the range of −255 to 255 VG (i): color difference modulation result of x = i pixel Green component: range of −255 to 255 VB (i): Color difference modulation result of x = i pixel Blue component An integer in the range of −255 to 255 Note that the color difference amount ΔV is set in advance to “0 to 2”.
55 ". The larger the color difference amount ΔV is, the higher the contrast of visualization at the time of restoring the embedded image information is, and the reproduction is easy. However, if it is too large, the embedded information is easily exposed. Therefore, the color difference amount Δ
V is desirably about 16 to 96, but here Δ
V = 48 is used.

Finally, in the superposition processing step 304, the following equations (4-1) to (4) are obtained from the color difference modulation result in the color difference modulation step 303 and the embedded image information 104.
By performing the superimposition process shown in -3), the composite image information 107 is created.

DESR (i) = VR (i) + SRCR (i) (4-1) DESG (i) = VG (i) + SRCG (i) (4-2) DESB (i) = VB ( i) + SRCB (i)... (4-3) DESR (i): Result of superposition processing of x = i pixels Red component Integer in the range of 0 to 255 DESG (i): Result of superposition processing of x = i pixels Green component Integer in the range of 0 to 255 DESB (i): Result of superposition processing of x = i pixels Blue component Integer in the range of 0 to 255 SRCR (i): Embedded image information of x = i pixels Red component 0 to 255 SRCG (i): embedded image information of x = i pixels Green component An integer in the range of 0 to 255 SRCB (i): Embedded image information of x = i pixels Blue component Integer in the range of 0 to 255 DESR (i), DESG (i), DESB
(I) is an integer in the range of “0 to 255”, and is set to “0” when the calculation result is “0” or less,
In the case of “255” or more, “255” is set.

FIG. 12 shows the result of the red component when all the pixels of the embedded image information 102 are (R, G, B) = (127, 127, 127). All values are "0-25
Taking an integer in the range of "5", "255" indicates that the red component is the largest. In FIG. 12, the value of (0, 0) pixel =
79, the value of the (1,0) pixel = 79, the value of the (2,0) pixel = 175..., The pixel where the red component is small and the red component Are repeated.

As shown in the equations (3-1) to (3-3) or the equations (3-4) to (3-6), the signs of the color difference amounts of red, green, and blue are inverted. Therefore, green and blue are reduced in a pixel having a large amount of red component, and other components are increased in a pixel having a small amount of red component. Red and (green, blue) = cyan have a complementary color relationship. Even if red and cyan are adjacent to each other, it is difficult for the human eye to distinguish them, and it looks achromatic. Since the red-rich pixels and the cyan-rich pixels are repeatedly arranged in units of two pixels, human eyes cannot discriminate these small differences in color difference, and the color difference amount is determined to be plus or minus “0”. Resulting in.

For example, in the above equation (4-1), it is erroneously determined that DESR (i) SRCR (i) (5), and it becomes impossible to distinguish that the image information is embedded. Therefore, according to this principle, it is possible to create composite image information in which the embedded image information is embedded in the embedded image information in an invisible state.

When the composite image information is recorded on an electronic medium,
Usually, it is recorded in a general-purpose image format such as JPEG or TIFF. In the present embodiment, since the embedding information does not depend on the image format, there is no problem if the format is changed to a new format in the future in addition to the currently distributed image format.

Next, a method of restoring embedded image information from composite image information and reproducing the embedded information will be described in detail with reference to FIG. For example, when distributed by electronic media on a homepage on the Internet or by e-mail, the inside of the composite image information recorded on the electronic media is as shown in FIG.
It looks like 2. To restore this, the mask image information 103 shown in FIG. 7 is used. Mask image information 10
When the value of the mask image information 103 is “1”, the value of the mask image information 103 is “1”, and the value of the mask image information 103 is “0”. It is determined that the composite image information is invalid. This result is shown in FIG.
Shown in In the figure, pixels with halftone dots are invalid data. Effective data (expressed in white) in FIG. 13 is cut out in a predetermined size.

In FIG. 8, since n = 4 is set and the embedded image information is quadrupled, two neighboring pixels for embedding are removed and then cut out in units of 4 × 4 pixels. If the valid data value within the 4 × 4 pixel range is a red-rich value (“175” in the present embodiment), the embedded image information = 1.
If the value is a cyan-rich value (“79” in the present embodiment), the embedded image information = 0. When the effective data includes both red-rich and cyan-rich, the larger one is adopted.

This is due to the smoothing processing in the synthesis processing. FIG. 14 shows the result of restoring the embedded image information by this method. The bold-line frame portion in the figure is the portion of the embedded image information, which coincides with FIG. 8 and shows that the information has been completely restored. Further, by performing the reverse procedure of creating the embedded image information shown in FIG. 2, the embedded information can be reproduced.

On the other hand, when printing on a non-electronic medium such as paper by a color printer, the same method can be used to restore a non-electronic medium. In this case, the non-electronic medium on which the composite image information 107 is printed is read by an optical reading unit, is converted into digital data, the state shown in FIG. 12, and restoration is performed in a similar procedure.

In the present embodiment, for example, printing is performed at a resolution of 400 dpi by a sublimation type thermal transfer printer, and reading is performed at a resolution of 1200 dpi by an optical scanner. It was possible.

In the case of reproduction from a non-electronic medium, another reproduction method has a transmission distribution rate of the same pattern as that of the mask image information 103 and has the same recording resolution as that used when recording the composite image information. The embedded image information can be restored by physically superimposing the sheet on the composite image information. In this case, there is an advantage that complicated operations and complicated devices are not required for restoring the embedded image information.

When reading the composite image information 107 recorded on a non-electronic medium such as paper by an optical reading means, the accuracy of the reading position is important. Therefore, when the composite image information 107 is created and then recorded on a non-electronic medium such as paper, the reading position is recorded by recording an alignment mark M on the composite image information 107 as shown in FIG. Accuracy can be improved.

In this embodiment, the mask image information 103
As shown in FIG. 7 and FIG.
Although an irregular checkerboard pattern of × 2 pixels is used, 2 × 2 units or 8 × 2 units can be used without any problem. It is better to change the type of the mask image information 103 according to the image creation time or the target object, because the embedded information does not need to be stolen by a third party.

Therefore, a part of the mask image information 103 is used as the alignment mark M in FIG.
By recording at the corner of No. 7, an extremely excellent system having both the function of positioning and the function of determining the type of the mask image information 103 is provided.

In the present embodiment, the fact that the above equation (4-1) is taken as the above equation (5) in order to embed information is utilized due to insufficient sensitivity of human eyes. Therefore, in order for the embedded information not to be known, the smaller the color difference amount ΔV is, the smaller the absolute value of VR (i) in the equation (4-1) becomes, and the embedded information becomes difficult to understand.
When the composite image information 107 is recorded on an electronic medium and distributed, it is relatively easy to determine numerically even if the color difference amount ΔV is small, but if the composite image information 107 is recorded on a non-electronic medium as described above, To read the embedded image information, it is necessary to perform optical reading. In this case, in consideration of optical reading means, environmental conditions, and variation in printing the combined image information during printing, the color difference amount ΔV may be buried in noise and cannot be distinguished unless it has a certain magnitude.

Therefore, when creating the composite image information,
When the output destination medium is known, the color difference amount ΔV = ΔV1 for the electronic medium output, and ΔV = ΔV for the non-electronic medium output
2. However, by setting ΔV1 ≦ ΔV2, optimal combined image information can be obtained. Note that ΔV1 is “1
6 to 64 ”, and ΔV2 is preferably in the range of“ 48 to 96 ”.

When recording the composite image information on a non-electronic medium, the larger the color difference amount ΔV is, the easier it is to discriminate, so that the safety factor of reproduction is increased. However, in some cases, the image information embedded in the composite image information in an invisible state may be easily exposed to a third party. Therefore, when the composite image information is printed out by a color printer or the like, by performing error diffusion processing as image processing and outputting the resultant, it is possible to prevent the embedded image information from being exposed without destroying the embedded image information. This is because the density of each pixel of the composite image information is compensated for by the error diffusion process, so that the embedded image information in a macroscopically invisible state is stored.

Further, by performing the error diffusion processing, the low frequency component decreases and the high frequency component increases. Since the embedded image information embedded in the composite image information is composed of high-frequency components, other high-frequency components are mixed in by the error diffusion process, so that the image cannot be visually identified.

Next, an image information processing apparatus for realizing the above-described image information processing method will be described. This image information processing apparatus is roughly classified into an image creation / recording apparatus that creates composite image information and records it on an electronic medium or a non-electronic medium, and a composite image recorded on an electronic medium or a non-electronic medium by the image creation / recording apparatus. It comprises an image reproducing apparatus for reproducing embedded image information from image information.

First, the image forming and recording apparatus will be described with reference to FIG. A CPU (Central Processing Unit) 401 performs overall control, and a ROM
A (read only memory) 402 stores a program executed by the CPU 401 to control the operation of the entire apparatus. A RAM (random access memory) 403 is used as a working memory of the CPU 401. The image memory 404 stores image information when performing image combining processing and the like, and is used for performing processing described later.

The embedded image information is divided into fixed information and flow information. The fixed information is, for example, a serial number unique to the system.
Information such as voice. The fixed information is sent from the embedded image information storage ROM 409, and the flow information is sent from the embedded image information input unit 410 to the embedded image information creating unit 408, and the embedded image information created by the procedure shown in FIG. 404.

From the embedded image information input section 407, for example, embedded image information 1 such as a portrait of a person or a landscape image is input.
02 is input and written to another area of the image memory 404.

In response to an instruction from the operator, the CPU 401 operates the smoothing processing unit 411 to make the CPU 401 operate as shown in FIG.
A smoothing process is performed on the embedded image information stored in the image memory 404, and the result is sent to the phase modulation unit 412.

The phase modulating section 412 performs the phase modulating processing as shown in FIG. 10 based on the result of the smoothing processing and the mask image information 103 from the mask image information storage ROM 405, and outputs the result to the color difference modulating section 413. send.

The color difference modulation section 413 performs color difference modulation as shown in FIG. 11 based on the result of the phase modulation processing and the color difference information from the color difference information storage ROM 406, and passes the result to the superposition processing section 414.

The superimposition processing section 414 outputs the color difference modulation result and the embedded image information 10 stored in the image memory 404.
The composite image information 107 is created by performing the superimposition process of No. 2 and stored in the image memory 404.

When the composite image information 107 is distributed on an electronic medium, the composite image information 107 is distributed from a composite image output unit (electronic medium) 415 via, for example, a network. When distributing by a non-electronic medium, a composite image output unit (non-electronic medium) 4 including a printer driving unit and a color printer is used.
16 and outputs the combined image information 417 (107).
Print record.

Next, an image reproducing apparatus will be described with reference to FIG. The CPU 501 performs overall control, and R
The OM 502 stores a program executed by the CPU 501 to control the operation of the entire apparatus.
503 is used as a working memory of the CPU 501. The image memory 504 stores image information when performing a process of reproducing embedded information, and is used for performing a process described later.

The composite image information 507 (107) recorded on a non-electronic medium such as paper is read by the composite image reading unit 506, converted into digital data, and stored in the image memory 504. The composite image reading unit 506 includes an optical scanner and its driving circuit.

In the case of composite image information recorded on an electronic medium, the information is directly stored in the image memory 504. When the combined image information 507 is read, the alignment mark M as shown in FIG. 15 is also read and stored in the RAM 503.

The CPU 501 controls each unit to reproduce embedded information according to an instruction from the operator. The mask image information creation unit 508 determines the type of the mask image information from the information of the alignment mark M stored in the RAM 503,
The mask image information necessary for restoration / reproduction is extracted from the mask image information storage ROM 505, the mask image information 103 is generated, and stored in the image memory 504.

The embedded image visualization processing unit 509 includes the mask image information 103 on the image memory 504 and the composite image information 5
07 and 107 are superimposed as shown in FIG. 7 and FIG. 8 to make the embedded image information in a visualized state, and then only valid data of the embedded image information is extracted. After that, the embedded image reproduction processing unit 510 performs the reverse process of the procedure in FIG. 2 to reproduce the embedded information.

As described above, according to the above embodiment, it is possible to create image information in which additional information is superimposed on main image information without distinguishing between electronic media and non-electronic media. Recording can be performed regardless of the type of recording medium, and the recorded added image information can be reproduced.

Therefore, multimedia contents such as electronic picture books, picture mails, pictures with sound, etc. can be created very easily. Further, by applying the present invention to an identification card, it becomes possible to confirm the user and the owner of the identification card.

[0080]

As described above in detail, according to the present invention, it is possible to create image information in which additional information is superimposed on main image information without discriminating between electronic media and non-electronic media. It is possible to provide an image information processing method and an image information processing apparatus capable of recording regardless of the type of a recording medium and further reproducing the recorded added image information.

[Brief description of the drawings]

FIG. 1 is a flowchart for explaining the overall flow of an image information processing method according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a procedure for creating embedded image information.

FIG. 3 is a view for explaining conversion of embedded image information into a binary image using a two-dimensional code.

FIG. 4 is a view for explaining conversion of embedded image information into a binary image using a two-dimensional code.

FIG. 5 is a view for explaining conversion of embedded image information into a binary image using a two-dimensional code.

FIG. 6 is a view for explaining a procedure for creating composite image information.

FIG. 7 is a diagram showing a specific calculation example in creating composite image information.

FIG. 8 is a diagram showing a specific calculation example in creating composite image information.

FIG. 9 is a diagram showing a specific calculation example in creating composite image information.

FIG. 10 is a diagram showing a specific calculation example in creating composite image information.

FIG. 11 is a diagram showing a specific calculation example in creating composite image information.

FIG. 12 is a diagram showing a specific calculation example in creating composite image information.

FIG. 13 is a view showing a specific calculation example in creating composite image information.

FIG. 14 is a diagram showing a specific calculation example in creating composite image information.

FIG. 15 is a view for explaining the alignment mark of the composite image information.

FIG. 16 is a diagram showing an example of mask image information converted into a binary image.

FIG. 17 is a block diagram schematically showing the configuration of an image creation / recording apparatus.

FIG. 18 is a block diagram schematically showing a configuration of an image reproducing device.

[Description of References] 101 ... embedded information, 102 ... embedded image information,
103: mask image information, 107: composite image information,
M: alignment mark, 401: CPU, 402:
ROM, 403: RAM, 404: Image memory, 4
05 ROM for storing mask image information, 406 ROM for storing color difference, 407 embedded image information input unit, 40
8 ... embedded image information creation unit, 409 ... embedded image information storage ROM, 410 ... embedded image information input unit, 4
11: smoothing processing section, 412: phase modulation section, 413
.., Color difference modulator, 414, superimposition processor, 415, composite image output unit (electronic medium), 416, composite image output unit (non-electronic medium), 417, composite image information, 501
CPU, 502, ROM, 503, RAM, 504
...... Image memory, 505 Mask image information storage RO
M, 506: combined image reading unit, 507: combined image information, 508: mask image information creation unit, 509: embedded image visualization processing unit, 510: embedded image reproduction processing unit

[Procedure amendment]

[Submission date] September 16, 1998

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] 0004

[Correction method] Change

[Correction contents]

In recent years, there has been disclosed a system capable of specifying a recorded color copier or the like from a hard copy output of the color copier.

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0005

[Correction method] Change

[Correction contents]

[0005] However, in the conventional method as described above, only an electronic medium is used as an object for embedding image information.
Alternatively, it is intended for only non-electronic media (paper), and no technology applicable to both is disclosed or suggested.

[Procedure amendment 3]

[Document name to be amended] Drawing

[Correction target item name] FIG.

[Correction method] Change

[Correction contents]

FIG. 14

Claims (22)

[Claims] An embedded image information is created by converting embedded information composed of characters, images, sounds, and the like into visualization information, and the created embedded image information is invisible to the embedded image information. Creating composite image information embedded in a state, recording the created composite image information on a recording medium, extracting the embedded image information from the composite image information recorded on the recording medium, and reproducing the embedded information; An image information processing method comprising: 2. Embedding information composed of characters, images, sounds, and the like is binary-coded to generate binary embedding information, and then converted into monochrome binary image information of a predetermined specific format, and converted into visualized information. Creates embedded image information, and creates synthesized image information in which the created embedded image information is embedded in an invisible state with respect to the embedded image information composed of a multi-valued color image. An image information processing method, comprising: recording information on a recording medium; extracting the embedded image information from the composite image information recorded on the recording medium; and reproducing the embedded information. 3. The created composite image information is recorded on an electronic medium as a soft copy, and after the embedded image information is visualized from the composite image information recorded on the electronic medium, the embedded information is extracted and reproduced. 3. The image information processing method according to claim 2, wherein: 4. The created composite image information is recorded as a hard copy on a non-electronic medium, and after the embedded image information is visualized from the composite image information recorded on the non-electronic medium, the embedded information is extracted. 3. The image information processing method according to claim 2, wherein the image is reproduced. 5. When creating the composite image information, pattern modulation image information is created by modulating predetermined pattern image information set in advance with the created embedded image information, and the created pattern modulation information is created. 2. The image information processing method according to claim 1, wherein the composite image information is created by superimposing the image information on the embedded image information. 6. The method according to claim 1, wherein the step of creating the composite image information includes creating the composite image information by embedding the embedded image information at a specific position highly relevant to the embedded image information of the embedded image information. The image information processing method according to claim 1. 7. The method according to claim 1, wherein when creating the embedded image information, the embedded image information is created by adding the type, size, creation date, embedding position, and other attribute information of the embedded information in addition to the embedded information. Item 3. The image information processing method according to Item 2. 8. The image information processing method according to claim 2, wherein at the time of creating the embedded image information, the embedded information is converted into a binary two-dimensional barcode. 9. The composite image information according to claim 5, wherein at the time of generation of the composite image information, at the time of reproduction of the composite image information, an alignment mark for performing superposition for reproducing embedded image information is added to the composite image information. Image information processing method. 10. When creating the composite image information, pattern modulation image information is created by modulating predetermined pattern image information set in advance with the created embedded image information. The image information is multiplied by a predetermined first color difference amount, and the composite image information is created by superimposing the pattern modulation image information multiplied by the first color difference amount on the embedded image information. Item 3. The image information processing method according to Item 3. 11. When creating the composite image information, pattern modulation image information is created by modulating predetermined pattern image information set in advance with the created embedded image information, and the created pattern modulation information is created. The image information is multiplied by a second color difference amount having a relationship of [first color difference amount ≦ second color difference amount] between the first color difference amount and the pattern modulation image information multiplied by the second color difference amount. 5. The image information processing method according to claim 4, wherein the composite image information is created by superimposing the embedded image information. 12. The image information processing method according to claim 3, wherein when recording the composite image information on an electronic medium, the composite image information is recorded without performing error diffusion processing. 13. The image information processing method according to claim 4, wherein when recording the composite image information on an electronic medium, the composite image information is recorded after performing an error diffusion process. 14. Embedding image information is created by converting embedded information composed of characters, images, sounds, and the like into visualization information, and the created embedded image information is used to generate predetermined pattern image information. To create pattern-modulated image information by performing modulation on the embedded image information, create composite image information by superimposing the created pattern-modulated image information on embedded image information, and soft-copy the created composite image information. After the embedded image information is visualized by electronically superimposing the pattern image information on the composite image information recorded on the electronic medium and performing a masking process, the embedded image information is An image information processing method, wherein the embedded information is reproduced by extracting and decoding. 15. Embedding image information is created by converting embedded information composed of characters, images, sounds, and the like into visualization information, and the created embedded image information is used to generate predetermined pattern image information. To create pattern-modulated image information by performing modulation on the embedded image information, create composite image information by superimposing the created pattern-modulated image information on the embedded image information, and hard copy the created composite image information. Recorded on a non-electronic medium, and for the composite image information recorded on the non-electronic medium, having the same pattern transmission ratio as the pattern image information,
After visualizing the embedded image information by physically superimposing a sheet-shaped mask sheet arranged at the same resolution and the same size on another non-electronic medium, the embedded image information is optically read and extracted. Decoding the embedded information to reproduce the embedded information. 16. Embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds, and the like into visualization information, and an embedded image created by the embedded image information creating means. Composite image information creating means for creating composite image information in which information is embedded in the embedded image information in an invisible state, and recording means for recording the composite image information created by the composite image information creating means. A reproducing unit for extracting the embedded image information from the composite image information recorded by the recording unit and reproducing the embedded information. 17. After embedding information composed of characters, images, sounds, and the like is binary-coded to create binary embedding information, the information is converted into monochrome binary image information of a predetermined specific format, and is converted into visualized information. Embedded image information creating means for creating certain embedded image information; and embedding the embedded image information created by the embedded image information creating means into embedded image information comprising a multi-valued color image in a state in which it is invisible. Means for creating composite image information, recording means for recording the composite image information created by the composite image information creating means, and embedding image information from the composite image information recorded by the recording means. And a reproducing means for extracting and reproducing the embedded information. 18. The recording means records the composite image information created by the composite image information creation means on an electronic medium as a soft copy, and the reproduction means reads the composite image information recorded on the electronic medium from the composite image information. 18. The image information processing apparatus according to claim 17, wherein after embedding image information is made visualization information, the embedding information is extracted and reproduced. 19. The recording means records the composite image information created by the composite image information creation means as a hard copy on a non-electronic medium, and the reproduction means records the composite image information recorded on the non-electronic medium. 18. The image information processing apparatus according to claim 17, wherein after embedding the embedded image information as visualization information, the embedded information is extracted and reproduced. 20. The composite image information creating means according to the embedded image information created by the embedded image information creating means,
Create modulated pattern image information by performing modulation on predetermined pattern image information that is set in advance,
17. The image information processing apparatus according to claim 16, wherein the created image information is created by superimposing the created pattern modulated image information on the embedded image information. 21. An embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds, and the like into visualization information, and an embedded image created by the embedded image information creating means. Pattern modulation image information creating means for creating pattern modulation image information by modulating predetermined pattern image information set in advance with the information; and pattern modulation image information created by the pattern modulation image information creation means. A composite image information creating unit for creating composite image information by superimposing the composite image information on the embedded image information, and a recording unit for recording the composite image information created by the composite image information creation unit on an electronic medium as a soft copy. The pattern image information for the composite image information recorded on the electronic medium by the recording means. Reproducing means for reproducing the embedded information by visualizing the embedded image information by electronically superimposing and performing a masking process, and then extracting and decoding the embedded image information. Image information processing apparatus. 22. An embedded image information creating means for creating embedded image information by converting embedded information composed of characters, images, sounds, and the like into visualization information, and an embedded image created by the embedded image information creating means. Pattern modulation image information creating means for creating pattern modulation image information by modulating predetermined pattern image information set in advance with the information; and pattern modulation image information created by the pattern modulation image information creation means. Means for creating composite image information by superimposing the composite image information on embedded image information, and recording means for recording the composite image information created by the composite image information creation means as a hard copy on a non-electronic medium And the composite image information recorded on the non-electronic medium by the recording means. After visualizing the embedded image information by physically superimposing a sheet-shaped mask sheet that is disposed at the same resolution and the same size on another non-electronic medium, having the same transmission distribution ratio as the information, A reproduction means for reproducing the embedded information by optically reading, extracting, and decoding the embedded image information.