JP6001275B2 - Non-visualization information embedding device, non-visualization information embedding method, and non-visualization information embedding program - Google Patents

Description

  The present invention relates to an invisible information embedding device, an invisible information embedding method, and an invisible information embedding program, and in particular, a non-visualization information for embedding highly accurate invisible information with reduced visual visibility in an image. The present invention relates to a visualization information embedding device, a non-visualization information embedding method, and a non-visualization information embedding program.

  Conventionally, a digital watermark technology that uses human perception (visual and auditory) characteristics in moving images and embeds information different from content into digital content such as still images, moving images, and audio so that it cannot be perceived by humans Is known (see, for example, Patent Documents 1 and 2).

  Also, conventionally, when embedding non-visualization information at a predetermined position of an acquired image, object information and position information included in the image are acquired, and it is determined from the acquired object information whether the image is an image to be embedded. A non-visualization information embedding device that embeds a two-dimensional code in an image based on the determination result is known (see, for example, Patent Document 3).

International Publication No. 2005/074248 Pamphlet International Publication No. 2007/015452 Pamphlet JP 2011-142607 A

  By the way, the above-described non-visualization information is very useful because it can provide additional information by allowing the user to read it using mechanical means such as a barcode reader or a scanner. However, in the above-described conventional method, a certain degree of visualization is unavoidable because it is mechanically read, and as a result, there is a certain degree of visibility even with the naked eye (the naked eye).

  For example, when embedding a two-dimensional code as non-visualization information, since the edge portion of the code is sharp as a whole, the object (object) displayed in the background image includes many rounds, curves, and the like. In some cases, the embedded two-dimensional code is easily visible.

  In addition, when embedding information in an image using conventional digital watermark technology, it is impossible to determine which part of the image contains the digital watermark information if it is embedded in a part of the screen. The data must be embedded in the entire image. In such a case, for example, information cannot be embedded only in a partial object (for example, a flower or a person) included in the video displayed on the television, and as a result, it is displayed on the screen. You have to get information about all the objects you have. For this reason, conventionally, it has been necessary to acquire extra information that is not requested by the user. In addition, when a digital watermark is embedded in the entire TV screen, it has been necessary to shoot at a considerably distant position when recognizing it with a lens provided on a mobile phone or the like.

  The present invention has been made in view of the above-described problems, and is a non-visualized information embedding device and non-visualized information embedding method for embedding highly accurate non-visualized information with reduced visual visibility in an image. And a non-visualized information embedding program.

  In order to solve the above-described problems, the present invention employs means for solving the problems having the following characteristics.

The present invention provides a non-visualization information embedding device that embeds non-visualization information at a predetermined position of an acquired image, an image analysis unit that acquires object information and position information included in the image, and the image analysis unit. Embedded image determination means for determining whether the image is an image to be embedded based on the object information obtained, non-visualization information setting means for setting a contour shape of the non-visualization information combined with the image, Based on the determination result obtained by the non-visualization information generation means for generating the non-visualization information using the contour shape corresponding to the setting information obtained by the visualization information setting means and the embedding target image determination means, the image It possesses an image synthesizing means for synthesizing an image by embedding an invisible information obtained by the non-visible information generating means to a predetermined position, the non-visible information setting means , And sets the presence or absence of blurring of the contour of the non-visible information.

Further, the present invention provides a non-visualization information embedding method for embedding non-visualization information at a predetermined position of an acquired image, an image analysis step for acquiring object information and position information included in the image, and the image analysis step. An embedding target image determination step for determining whether the image is an image to be embedded from the obtained object information, a non-visualization information setting step for setting an outline shape of the non-visualization information to be combined with the image, Based on the non-visualization information generation step for generating non-visualization information using the contour shape corresponding to the setting information obtained by the de-visualization information setting step, and the determination result obtained by the embedding target image determination step, the Image composition that synthesizes an image by embedding the invisible information obtained by the invisible information generation step at a predetermined position of the image It possesses a step, the non-visible information setting step, and sets the presence or absence of blurring of the contour of the non-visible information.

  The present invention is also a non-visualized information embedding program for causing a computer to function as each unit included in the non-visualized information embedding device according to any one of claims 1 to 4.

  In addition, what applied the component, expression, or arbitrary combination of the component of this invention to a method, an apparatus, a system, a computer program, a recording medium, a data structure, etc. is effective as an aspect of this invention.

  According to the present invention, it is possible to embed highly accurate non-visualized information with reduced visual visibility in an image.

It is a figure which shows an example of the mechanism structure of the invisible information embedding apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions which can implement | achieve the invisible information embedding process in this embodiment. It is a flowchart which shows an example of the non-visualization information embedding process procedure in this embodiment. It is a flowchart which shows an example of the image composition processing procedure in this embodiment. It is a figure which shows an example of the concept of the invisible information in this embodiment. It is a figure which shows an example of the non-visualization information actually produced | generated. It is a figure which shows the example of an image which embedded the invisible information in this embodiment. It is a figure which shows an example of the evaluation result with respect to the image obtained by this embodiment.

<About the present invention>
In the present invention, for example, for images and videos displayed on the screen or various print media such as paper, postcards, posters, etc., non-visualized information (markers) by processing that cannot be recognized by the user's visual (visual), Partially embed in the image. At this time, in the present invention, the invisible information in which the edge portion is reduced is generated by changing the edge portion (contour shape) of the invisible information or performing blurring (for example, gradation) processing.

  Further, in the present invention, for example, an embedded part of the invisible information is searched from the image, and the shape of the edge part of the invisible information to be embedded is modified in accordance with the shape of the object (object etc.) in the background of the embedded part. To do. As a result, the present invention makes the non-visualized information less noticeable, and can reduce the visual (visual) visibility without degrading machine recognition.

  Hereinafter, embodiments in which the invisible information embedding device, the invisible information embedding method, and the invisible information embedding program according to the present invention are suitably implemented will be described with reference to the drawings. Note that the “image” described in the present embodiment includes, for example, a single image such as a photograph or a continuous frame unit image in a video.

<Non-visualization information embedding device: functional configuration example>
Here, an example of a mechanism configuration of the invisible information embedding device according to the present embodiment will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a mechanism configuration of the invisible information embedding device according to the present embodiment.

  The invisible information embedding device 10 shown in FIG. 1 includes an input unit 11, an output unit 12, a storage unit 13, an image acquisition unit 14, an image analysis unit 15, an embedding target image determination unit 16, and a non-display unit. Visualization information setting means 17, non-visualization information generation means 18, image composition means 19, transmission / reception means 20, and control means 21 are configured.

  The input means 11 starts / starts various instructions such as an image acquisition instruction from the user, an image analysis instruction, an embedding target image determination instruction, a non-visualization information setting instruction, a non-visualization information generation instruction, an image synthesis instruction, and a transmission / reception instruction. Accepts input such as end. Note that the input unit 11 includes a pointing device such as a keyboard or a mouse if it is a general-purpose computer such as a personal computer, and includes a group of operation buttons if it is a portable terminal or game device. The input unit 11 also has a function of inputting an image or video captured by an imaging unit such as a digital camera. Note that the above-described imaging unit may be provided in the invisible information embedding device 10 or may have an external functional configuration.

  The output unit 12 outputs the content input by the input unit 11 and the content executed based on the input content. Specifically, the output unit 12 includes the acquired image, the image analysis result, the embedding target image determination result, the set non-visualization information, the generated non-visualization information, the synthesized image obtained by synthesizing the non-visualization information, Screen display of results of processing in each configuration, audio output, and the like are performed. The output unit 12 includes a display, a speaker, and the like.

  Furthermore, the output unit 12 may have a printing function such as a printer, and can print the above-described output contents on various print media such as paper, postcards, and posters and provide them to the user. .

  The storage unit 13 stores various information necessary in the present embodiment and various data at the time of execution or after execution of the embedding process. Specifically, the storage unit 13 acquires one or a plurality of images or videos acquired by the image acquisition unit 14 that is input or stored in advance. In addition, the storage unit 13 is generated by the result analyzed by the image analysis unit 15, the determination result by the embedding target image determination unit 16, the setting content by the non-visualization information setting unit 17, and the non-visualization information generation unit 18. The non-visualized information, the image synthesized by the image synthesizing means 19 and the like are accumulated. Further, the storage means 13 can read out various data stored as required.

  The image acquisition unit 14 acquires an image, video, or the like that is a target for embedding information. Note that the images, videos, and the like may be images, videos, and the like obtained by imaging means such as a camera, for example, and may be target images that are applied to posters, photos, cards, stickers, and the like. The image acquisition unit 14 can also acquire information and images stored in an external device connected to the communication network via the transmission / reception unit 20 and images and videos stored in a database. You may use the image which the user etc. actually image | photographed with the camera etc. via the means 11. FIG.

  The image analysis unit 15 analyzes the image acquired by the image acquisition unit 14 and analyzes the contents included in the image. Specifically, an object consisting of object information, coordinates, etc., such as what part (position, region) in the image is projected, how the object is moving in the video, etc. Get location information. For example, when the object is a person, the image analysis unit 15 may detect the face from the feature portion of the face, or may digitize the feature amount and specify the person based on the result.

  Further, the image analysis unit 15 analyzes for each object how much the edge amount is based on the contour shape or pattern of the object (background portion) included in the image in which the invisible information is embedded. In the present embodiment, in accordance with the edge amount analyzed by the image analysis unit 15, the shape of the invisible edge portion is deformed by the preset non-visualization information generation unit 18, or blurring processing is performed.

  Based on the result analyzed by the image analysis unit 15, the embedding target image determination unit 16 determines whether or not the object displayed in the image is a target for embedding preset invisible information. Note that whether or not the object is information that embeds invisible information is determined by, for example, storing preset embedding determination information in the storage unit 13 or the like and comparing the information with the embedding determination information. It is also possible to search whether any additional information for the object is stored in the storage means 13, and if the additional information is stored, it may be determined that the object is an embedding target object. .

  Therefore, for example, when the image is analyzed by the image analysis unit 15 and it is analyzed that a part of the image includes a personal computer image, the embedding target image determination unit 16 stores additional information about the personal computer. 13 is determined. If additional information relating to the personal computer exists, it is determined that the personal computer is an image to be embedded. The contents to be embedded (additional information) are set by, for example, the non-visualization information setting unit 17, and the set contents are stored in the storage unit 13.

  In addition to embedding non-visualization information for a part of an object in an image, when embedding non-visualization information for the entire image, a predetermined position (for example, the center of the image or the image Are set to preset coordinate positions such as at least one of the four corners (for example, lower right).

  In addition, when there are a plurality of objects in the image, the embedding target image determination unit 16 may set all the objects as the embedding target, or may set at least one object as the embedding target. In this case, for example, for an object, the priority is set in advance, the position and size of the display area with respect to the entire screen of the object, and if the image is displayed, the time is set arbitrarily. The detailed information of these images is also stored in the storage means 13.

  The non-visualization information setting means 17 determines what information is embedded as additional information based on the object information determined as the embedding target obtained by the embedding target image determination means 16, the contents of the specific information, etc. Set. For example, if the object information is a product such as cosmetics or clothes, the brand name, product name, price, homepage address, etc. are set. If the object information is a person, the name and age of the person If the object information is a book, the title, author, publication date, price, information about the author, etc. are set. Note that the additional information set by the non-visualization information setting unit 17 includes video.

  Further, the non-visualization information setting unit 17 sets in what form the embedded information is added. For example, whether the additional information is a specific encrypted character, a pattern, a symbol, code information, or the like is set. The invisible information setting unit 17 can set at least one form from a plurality of preset forms. Therefore, the non-visualization information setting unit 17 can select and set appropriate embedding information according to the content of the image to be embedded, for example.

  Further, when setting the invisible information as the code information, the invisible information setting unit 17 sets a plurality of contour shapes in advance so that the shape of the edge portion can be changed. The outline shape includes a circular shape, an elliptical shape, a polygonal shape that is equal to or greater than a triangle, and the present invention is not limited to this. For example, a star shape (for example, a concept such as a pentagram or a hexagonal star). ), A shape including irregularities, a curved shape based on a preset function, and the like. Information regarding the set contour shape and other setting information are stored in, for example, the storage unit 13 and can be read sequentially, and can be set with reference to the read information.

  Further, the non-visualization information setting unit 17 sets whether or not the outline shape of the above-described non-visualization information is blurred (for example, gradation or the like). Note that the above-described setting of the contour shape and the presence / absence of blurring can be set by the user or the like according to the shape or pattern of the object in the image in which the invisible information is embedded using the input unit 11.

  The non-visualization information generating means 18 generates non-visualization information to be embedded in the embedding target image. The non-visualization information generating means 18 may generate non-visualization information using direct character information, or may generate non-visualization information using code information. As the code information, for example, a two-dimensional barcode such as a QR code (registered trademark) can be used. In the present embodiment, the code information is not limited to a QR code, and various bar codes such as JAN code, ITF code, NW-7, CODE39, CODE128, PDF417, CODE49, Data Matrix, Maxi Code are selectively used. It can also be used.

  Further, the non-visualized information generating means 18 sets the information to be embedded as the high-frequency unit for the color information of the original image in order to make the embedded information difficult to see against the image actually provided to the user. An image using the low frequency part is generated. The details of the invisible information in the invisible information generating means 18 will be described later.

  In addition, the non-visualization information generation unit 18 generates coordinate information on which position of the embedded image is embedded in addition to the non-visualization information. In this embodiment, when embedding the invisible information, for example, it is preferable to embed it on or around the position of the embedding target object displayed in the image. Therefore, the coordinate information is generated corresponding to the position information of the object obtained by the embedding target image determination unit 16.

  Thus, according to the present embodiment, a plurality of pieces of non-visualization information can be embedded in an appropriate place for each object in the image, for example, instead of giving one embedded information to the entire image.

  Further, the non-visualization information generating unit 18 generates non-visualization information including each data block using a high frequency component, a low frequency component, and the like based on the contour shape included in the setting information obtained by the non-visualization information setting unit 17. To do. Further, the non-visualization information generating means 18 performs a predetermined blurring process or the like when there is a setting for blurring the outline portion of each data block based on the setting information described above. The predetermined blurring process can blur the contour shape by sequentially increasing the gradation ratio as the distance from the center of each region of the high frequency region or the low frequency region included in the invisible information is increased, for example. . Note that the blurring process is not limited to this.

  Note that there may be one or more contour shapes deformed with respect to the invisible information combined on one screen. Therefore, in this embodiment, for example, non-visualization information with different contour shapes can be embedded in one screen based on the amount of edges such as the shape or pattern of a background object.

  The image synthesizing unit 19 generates the non-visualization information generated by the non-visualization information generation unit 18 based on the image obtained by the image analysis unit 15 and the object position information including the object information and coordinate information of the image. Is embedded at a predetermined position to synthesize an image.

  When the image to be synthesized is a video, the image synthesizing unit 19 follows the non-visualization information in accordance with the movement of the object in the video being reproduced. For example, the non-visualization information is always on the object. It can also be synthesized as if it were embedded. Therefore, the image synthesis means 19 synthesizes the invisible information for each image frame included in the video, for example, and sequentially displays the synthesized image. The present invention is not limited to this. For example, when the object does not move, the invisible information may be embedded every few frames.

  Further, when embedding the non-visualization information, the image synthesizing unit 19 embeds the non-visualization information by rotating the non-visualization information by a predetermined angle in a predetermined direction in accordance with the outline shape or color of the object at the embedding position, the edge portion, or the like. it can. That is, the image synthesizing unit 19 can optimize and embed the invisible information embedding method in correspondence with the embedding location. Thereby, in this embodiment, non-visualization information can be embedded without a sense of incongruity.

  The transmission / reception means 20 obtains a desired external image (captured image, composite image, etc.), an execution program for realizing the invisible information embedding process in the present invention, from an external device connectable using a communication network or the like. It is an interface to do. The transmission / reception means 20 can transmit various information generated in the non-visualization information embedding device 10 to an external device.

  The control means 21 controls the entire components of the invisible information embedding device 10. Specifically, the control unit 21 acquires an image, analyzes an image, determines whether the image is an embedding target image, sets non-visualization information, and the like based on an instruction from the input unit 11 by a user or the like, for example. Control of processing such as generation and image composition is performed.

  In this embodiment, by embedding the above-described invisible information in an image or the like, it is possible to provide a highly accurate image with excellent added value by efficiently acquiring information.

<Non-Visualization Information Embedding Device 10: Hardware Configuration>
Here, in the invisible information embedding device 10 described above, an execution program (invisible information embedding program) capable of causing a computer to execute each function is generated, and for example, a general-purpose personal computer, server, portable terminal By installing the execution program in a game machine or the like, the invisible information embedding process and the invisible information recognition process in the present invention can be realized.

  Here, a hardware configuration example of a computer capable of realizing the invisible information embedding process according to the present embodiment will be described with reference to the drawings.

  FIG. 2 is a diagram illustrating an example of a hardware configuration capable of realizing the invisible information embedding process according to the present embodiment. 2 includes an input device 31, an output device 32, a drive device 33, an auxiliary storage device 34, a memory device 35, a CPU (Central Processing Unit) 36 that performs various controls, and a network connection device. 37, and these are connected to each other by a system bus B.

  The input device 31 has a pointing device such as a keyboard and a mouse operated by a user or the like, and inputs various operation signals such as execution of a program from the user or the like. Further, the input device 31 may include an image input unit that inputs an image taken from an imaging unit such as a camera.

  The output device 32 has a display for displaying various windows and data necessary for operating the computer main body for performing the processing according to the present invention, and displays the program execution progress and results by the control program of the CPU 36. can do.

  Here, the execution program installed in the computer main body in the present invention is provided by a portable recording medium 68 such as a USB (Universal Serial Bus) memory or a CD-ROM, for example. The recording medium 38 on which the program is recorded can be set in the drive device 33, and the execution program included in the recording medium 38 is installed in the auxiliary storage device 34 from the recording medium 38 via the drive device 33.

  The auxiliary storage device 34 is a storage means such as a hard disk, and can store an execution program according to the present invention, a control program provided in a computer, and the like, and can perform input / output as necessary.

  The memory device 35 stores an execution program read from the auxiliary storage device 34 by the CPU 36. The memory device 35 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like.

  The CPU 36 controls processing of the entire computer, such as various operations and input / output of data with each hardware component, based on a control program such as an OS (Operating System) and an execution program stored in the memory device 35. Thus, each process in embedding the invisible information can be realized. Various information necessary during the execution of the program can be acquired from the auxiliary storage device 34, and the execution result and the like can also be stored.

  The network connection device 37 acquires an execution program from another terminal connected to the communication network by connecting to a communication network or the like, or an execution result obtained by executing the program or an execution in the present invention The program itself can be provided to other terminals.

  With the hardware configuration described above, the invisible information embedding process in the present invention can be executed. Further, by installing the program, the non-visualized information embedding process in the present invention can be easily realized by a general-purpose personal computer or the like.

  Next, the invisible information embedding process will be specifically described.

<Non-visible information embedding procedure>
First, a non-visualized information embedding process procedure in the present embodiment will be described. FIG. 3 is a flowchart showing an example of the non-visualized information embedding processing procedure in the present embodiment.

  In the invisible information embedding process shown in FIG. 3, first, an image taken by an imaging means such as a camera is acquired (S01), the image is analyzed (S02), and object information and object position information included in the image are obtained. Get the edge amount.

  Next, in the invisible information embedding process, an embedding target image is determined based on the information obtained in the process of S02 (S03), and whether or not the invisible information (marker) is embedded in the object. Is determined (S04). Here, in the invisible information embedding process, in the case where the invisible information is embedded (YES in S04), the invisible information is set (S05), and the invisible information is embedded in the image based on the invisible information set by the process of S05. The invisible information to be synthesized is generated (S06).

  Note that the invisible information in the present embodiment may be set in advance, or the invisible information may be set in association with an object (object) in the image. In the present embodiment, the contour shape of the non-visualization information can be changed by the setting of the user or the like, and the blur processing can be performed on the contour shape.

  Further, in the invisible information embedding process, the invisible information generated in the process of S06 is synthesized at a predetermined position of the image (S07), and the synthesized image is displayed or output as output data by an output means such as a display ( S08).

  In the non-visualization information embedding process, when the non-visualization information is not embedded after the process of S08 is completed or in the process of S04 (NO in S04), it is determined whether or not the non-visualization information is embedded in another image (S09). ). Further, in the invisible information embedding process, when invisible information is embedded in another image (YES in S09), the process returns to S01 and the subsequent processes are repeatedly executed. In the non-visualization information embedding process, if the non-visualization information is not embedded in another image in the process of S09 (NO in S09), the non-visualization information embedding process is terminated.

<Image composition processing procedure>
Next, the image composition processing procedure in S07 described above will be described. FIG. 4 is a flowchart showing an example of an image composition processing procedure in the present embodiment.

  In the image composition processing shown in FIG. 4, first, the ease of embedding is scored for each pixel (pixel) according to the luminance of the background to be embedded (S11). Next, in the image composition process, an area where the sum of the points of the embedded area is maximized is searched (S12). Further, the image composition processing extracts the edge of the background portion in the embedding area (S13), and for example, a predetermined edge portion such as a finder pattern of the non-visualized information follows the edge of the background portion extracted in the processing of S13. The invisible information is rotated (S14). A finder pattern is a cut-out symbol at three corners for detecting the position and orientation of a two-dimensional bar code such as a QR code (in the case of micro QR, one cut-out symbol). However, the present invention is not limited to this.

  Thereafter, in the image composition processing, the shape (contour shape) of the data block of the non-visualization information is deformed and embedded so as to follow the background edge of the image (S15).

  Through the above-described processing, it is possible to provide a highly accurate image with excellent added value by efficiently acquiring information. Further, by installing the program, the non-visualized information embedding process in the present invention can be easily realized by a general-purpose personal computer or the like.

<About invisible information>
Here, the invisible information in the present embodiment will be specifically described. Note that as the invisible information, letters, numbers, symbols, marks, patterns, colors, one-dimensional codes, two-dimensional codes, and the like can be used.

  Here, FIG. 5 is a diagram showing an example of the concept of the invisible information in the present embodiment. 5A shows an example in which the contour shape of the invisible information is blurred in a circle, FIG. 5B shows an example in which the contour shape of the invisible information is blurred in a triangle, and FIG. An example in which the contour shape of the invisible information is blurred in a star shape is shown. FIG. 5B shows an example of triangular blurring, but in the present invention, other polygon blurring processing may be performed. In the present embodiment, the blurring process can be performed on a normal quadrangular contour shape.

  In addition, the non-visualization information 40-1 to 40-3 shown in FIGS. 5A to 5C is non-visualization information by QR codes, and three corners for recognizing the direction of the non-visualization information as a finder pattern. Square cut-out symbols 41-1a to 41-1c, 41-2a to 41-2c, and 41-3a to 41-3c are provided.

  In the present embodiment, as shown in FIG. 5, the shape of the low-frequency portion of each of the invisible information 40-1 to 40-3 is changed from a normal quadrangular shape to a predetermined shape, and a blurring process is performed as necessary. It is possible to provide invisible information that is difficult to visually recognize. Note that the blurring process may be performed on only the low frequency part, only the high frequency part, or both high frequency and low frequency.

  Further, in the present embodiment, the above-described selection of the contour shape and the presence / absence of blurring can be appropriately set based on the edge amount and color information of the object of the target image to be embedded, a user instruction, and the like.

  FIG. 6 is a diagram illustrating an example of the invisible information actually generated. 6A to 6E are obtained by extracting the invisible information portion from the entire image. Here, FIG. 6A shows an example of a quadrangle blur of the invisible information, FIG. 6B shows an example of a circular blur of the invisible information, and FIG. 6C shows a triangle blur of the invisible information. FIG. 6D shows an example of hexagonal blurring of invisible information, and FIG. 6E shows a star-shaped blurring example of invisible information.

  Images 42-1 to 42-5 shown in FIG. 6 show an example in which a high-frequency portion is circular, triangular, hexagonal, or star-shaped with respect to a gray background. In the present invention, other polygon blurring processing may be performed. Further, in the example of FIG. 6, the low frequency part is blurred, but the high frequency part may be blurred. In this way, by performing the blurring process, the invisible information is made inconspicuous, and visibility with the naked eye can be reduced without degrading machine recognition.

<Example of image with invisible information embedded>
FIG. 7 is a diagram illustrating an example of an image in which the invisible information is embedded in the present embodiment. FIG. 7A shows an example of an image in which the circular blur non-visualization information shown in FIG. 5A is embedded, and FIG. 7B shows the triangular blur non-visualization information shown in FIG. 5B. FIG. 7C shows an example of an embedded image, and FIG. 7C shows an example of an image in which the star-blurred non-visualization information shown in FIG. 5C is embedded.

  In each of the images 50-1 to 50-3 illustrated in FIG. 7, invisible information obtained by transforming the regions 51-1 to 51-3 into a predetermined contour shape and performing a predetermined blurring process is embedded. .

  In the example of FIG. 7, as in FIG. 6, the high-frequency part is transformed into a circle, a triangle, and a star, and the low-frequency part is blurred. In the present invention, the present invention is not limited to the example shown in FIG. 7. In this case, the blurring process may be performed only on the high frequency portion, or the blurring process may be performed on both components. At this time, in this embodiment, the amount to be blurred may be changed for each component (high frequency, low frequency), or may be set to the same amount. These settings may be included in the setting information set by the non-visualization information setting unit 17 and can be appropriately changed according to the edge amount, color information, etc. of the object embedded in the non-visualization information. .

<Specific example of embedding additional information>
Next, a specific example of embedding additional information in the image composition means 19 of the present embodiment will be described with reference to the drawings. In the following description, an example of embedding a two-dimensional code as additional information will be described. When the invisible information in the present embodiment is enlarged, the low frequency part and the high frequency part are arranged in a predetermined region (for example, a square) based on a predetermined condition. Here, the code is embedded with the low frequency portion set to “0” and the high frequency portion set to “1”. Further, the high-frequency unit arranges the dark color and the light color alternately in predetermined pixel units, and adjusts the color so as to be the color of the original image when averaged when viewed from a further distance.

<About low frequency and high frequency>
Here, for the low frequency and the high frequency in the present embodiment, each component can be obtained using, for example, the technique disclosed in Patent Document 3 described above. The contents will be described below. Normally, there are frequencies for time (temporal frequency) and frequencies for space positions (spatial frequency). In the present embodiment, the frequency refers to the spatial frequency unless otherwise specified. Spatial frequency is defined as “the reciprocal of the period of the pixel value relative to the unit length”.

  The frequency in the present embodiment is not particularly limited. For example, the frequency may be set in the range of 0.2 to 2 [cycle / pixel] in the high frequency part and 0 to 1 [cycle / pixel] in the low frequency part. Specifically, it is sufficient that the high frequency portion has a higher frequency than the low frequency portion.

  In addition, a grid composed of predetermined pixel regions (for example, 4 × 4 px (pixels) or the like) formed in a high-frequency part is sufficient if a bright part and a dark part are periodically repeated. For example, vertical stripes, horizontal stripes, grids State. In addition, the brightness difference between the bright part and the dark part at that time may be 10 or more, preferably 50 or more, and more preferably 100 or more.

  The usable pixel size of the additional information described above is not limited because it varies depending on the distance between the image and the person viewing the image, for example. About 0.5 to 2 mm is preferable, and if the distance is 10 m, about 0.5 to 20 mm is preferable. Even when used from a further distance, it is preferable to maintain the same pixel size / distance ratio.

<Embedding the low frequency code>
Next, an example of embedding the above-described low-frequency code is described. For example, when a predetermined grid is formed in the image, the low-frequency code is embedded by applying a so-called blur filter to the entire grid by, for example, a filtering process using a Gaussian filter. Smooth the value. That is, the brightness of the grid is smoothed around 130.

<Embedding high-frequency code>
Next, a description will be given of an example of embedding the above-described high-frequency code. The code of the high frequency part generates a striped pattern in order to embed a high frequency in a predetermined grid. Therefore, processing is performed to increase the brightness of even rows (columns) of the grid and decrease the brightness of odd rows (columns). In addition, the increase / decrease value of the brightness can be determined by judging from the brightness of the background, for example. As described above, in the present embodiment, by setting the increase / decrease value corresponding to the brightness value, the embedded information can be generated efficiently and the embedded information can be made less noticeable.

  Specifically, when the pixel line of the grid in the image is an odd number, the process of decreasing the brightness is performed, and the increase / decrease value is changed from “152” to “127” using “−35”. Further, in the case of an even-numbered line, processing for increasing brightness is performed, and the increase / decrease value is changed from “120” to “150” using “+30”. In the present embodiment, a two-dimensional code can be generated by performing the low frequency portion and high frequency portion code embedding processing on the invisible region as described above.

<Evaluation result by comparison with the conventional case when this embodiment is applied>
Next, a reading accuracy evaluation between an image and a conventional image when this embodiment is applied, and an invisibility evaluation result will be described with reference to the drawings. FIG. 8 is a diagram illustrating an example of an evaluation result for an image obtained according to the present embodiment. 8A shows an example of reading accuracy evaluation, and FIG. 8B shows an example of invisibility evaluation.

  In the reading accuracy evaluation shown in FIG. 8A, for example, the contour shape of the non-visualized information (contour shape for high frequency or low frequency, or both frequency components) is square with respect to the gray background image as shown in FIG. The recognition accuracy evaluation of circle, triangle, hexagon and star is shown. In the example of FIG. 8, the average value of the three experimental results is taken for each shape so that there is no error with respect to sudden errors.

  According to the evaluation result shown in FIG. 8A, the best recognition accuracy is the quadrangle, but the reading accuracy of the other shapes can be obtained substantially the same as the quadrangle. It can be seen that the reading accuracy is particularly high for circular and hexagonal shapes compared to other shapes.

  In addition, regarding the evaluation of the invisibility shown in FIG. 8 (b), 5 points, 4 points, 3 points, etc. were sequentially given to the plurality of experiment participants (6 people in this experiment) in order from the images that are difficult to see. They are ranked in descending order of the total score. According to the example of FIG. 8B, it is understood that the order of circle → hexagon → rectangle → triangle → star shape is in order of difficulty.

  According to the evaluation results described above, it is particularly preferable to change to a star shape or hexagonal shape. Therefore, when setting the contour shape of the non-visualization information by the user's instruction in the non-visualization information setting unit 17, it is preferable to set a circle or a hexagon.

  In this embodiment, when embedding non-visualization information, the non-visualization information is rotated according to the shape of the object (object) of the background image at that position, the edge portion of the pattern, or the like. By changing the size so as to fit (enlarge or reduce), the human visual recognition can be further reduced.

  As described above, according to the present invention, it is possible to embed highly accurate invisible information with reduced visibility in an image. Further, according to the present invention, it is possible to efficiently acquire information and provide a highly accurate image with excellent added value.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

DESCRIPTION OF SYMBOLS 10 Non-visualization information embedding apparatus 11 Input means 12 Output means 13 Storage means 14 Image acquisition means 15 Image analysis means 16 Embedding target image determination means 17 Non-visualization information setting means 18 Non-visualization information generation means 19 Image synthesis means 20 Transmission / reception means 21 Control Unit 31 Input Device 32 Output Device 33 Drive Device 34 Auxiliary Storage Device 35 Memory Device 36 CPU (Central Processing Unit)
37 Network connection device 38 Recording medium 40 Non-visible region 41 Symbol 42, 50 Image 51 region

Claims (7)

In the non-visualization information embedding device that embeds the non-visualization information at a predetermined position of the acquired image,
Image analysis means for acquiring object information and position information included in the image;
An embedding target image determination unit that determines whether the image is an image to be embedded from the object information obtained by the image analysis unit;
Non-visualization information setting means for setting a contour shape of the non-visualization information combined with the image;
Non-visualization information generating means for generating non-visualization information using a contour shape corresponding to the setting information obtained by the non-visualization information setting means;
Based on the determination result obtained by the embedding target image determining unit, it has a image combining means for combining an image by embedding an invisible information obtained by the non-visible information generating means to a predetermined position of the image ,
The non -visualized information embedding device , wherein the non-visualized information setting means sets whether or not the contour shape of the non-visualized information is blurred . The image analysis unit analyzes an edge amount of an object shape with respect to the object information,
2. The non-visualization information according to claim 1 , wherein the non-visualization information generation unit deforms a contour shape of the non-visualization information according to an edge amount of the object shape obtained by the image analysis unit. Implanting device. The image composition means includes
The invisible information embedding apparatus according to claim 2 , wherein the invisible information is rotated and embedded in the image in correspondence with an edge portion of the object shape obtained by the image analysis unit. In the non-visualization information embedding method of embedding non-visualization information at a predetermined position of the acquired image,
An image analysis step of acquiring object information and position information included in the image;
An embedding target image determination step for determining whether the image is an image to be embedded from the object information obtained by the image analysis step;
A non-visualization information setting step for setting a contour shape of the non-visualization information combined with the image;
A non-visualization information generating step for generating non-visualization information using a contour shape corresponding to the setting information obtained by the non-visualization information setting step;
Based on the determination result obtained by the embedding target image determination step, have a an image combining step of combining the image by embedding the non-visible information obtained by the non-visible information generating step in a predetermined position of the image ,
The non -visualization information embedding method , wherein the non-visualization information setting step sets whether or not the contour shape of the non-visualization information is blurred . The image analysis step analyzes an edge amount of an object shape with respect to the object information,
5. The non-visualization information according to claim 4 , wherein the non-visualization information generation step deforms a contour shape of the non-visualization information in accordance with an edge amount of the object shape obtained by the image analysis step. Embedding method. The image composition step includes
6. The invisible information embedding method according to claim 5 , wherein the invisible information is rotated and embedded in the image in correspondence with an edge portion of the object shape obtained by the image analysis step. The non-visualization information embedding program for functioning a computer as each means which the non-visualization information embedding apparatus of any one of Claims 1 thru | or 3 has.