JP5719665B2 - Image composition processing device, image separation processing device, image processing system, image composition processing method, image separation processing method, image processing method, and program - Google Patents

Description

  The present invention relates to an image composition processing device, an image separation processing device, an image processing system, an image composition processing method, an image separation processing method, an image processing method, and a program, and in particular, an image that synthesizes or separates an insertion image from an original image. The present invention relates to a composition processing device, an image separation processing device, an image processing system, an image composition processing method, an image separation processing method, an image processing method, and a program.

  2. Description of the Related Art Conventionally, a digital watermark technique for synthesizing another image data as an insertion image with an original image that is a natural image is known. In the digital watermark technique, it is necessary to synthesize an inserted image so as not to stand out from the original image. Therefore, it is known that the spatial frequency component of the original image is extracted and the inserted image is synthesized in the high frequency region, thereby making the inserted image less noticeable with respect to the original image (see, for example, Patent Document 1).

  As another electronic watermarking technique, a pixel replacement method is known in which an inserted image is synthesized with a portion having little influence on the appearance of an original image. In addition, a pixel space utilization method for performing Amadal transformation on an original image and an inserted image is known.

JP 2010-011252 A

  However, when the insertion image is synthesized with the original image using the spatial frequency component of the original image, the insertion image is synthesized using the coefficients after converting the original image into the frequency component. The load on the memory amount becomes high. Even when an insertion image is synthesized with an original image using an image replacement method and a pixel space utilization method, the synthesis principle and procedure are often complicated and difficult to implement. Similarly, when an insertion image is separated from a composite image, the separation principle and procedure are similarly complicated, and this is often difficult to implement.

  In view of such circumstances, it is an object of the present invention to provide an image processing device, an image processing system, an image processing method, and a program that make it easier to synthesize or separate an inserted image from an original image.

An image composition processing device according to the present invention is an image composition processing device for compositing at least one insertion image to an original image based on a predetermined composition condition, and is configured to block an inserted image that has been blocked in accordance with the composition condition . An embedded image that creates an embedded image by inserting a predetermined code element that is equal to the data amount of each element into a position adjacent to the position of each element that is quantized data in a predetermined direction. Elements included in the quantized data of the original image that is blocked in each of the element of the inserted image included in the embedding image and the code element inserted in the element according to the synthesis condition and the synthesis condition A decompressed original image creating unit that creates a decompressed original image by decompressing the original image in a predetermined direction by duplicating each element of the quantized data of the original image in order to synthesize one of them, the synthesis conditions Therefore, and a composite image creation unit that creates a synthesized and the synthesized image and the elements included in each element and an extended original images included in the embedded image.

  According to such a configuration, since the composite image is created by inserting a predetermined code element into the inserted image, decompressing the original image, and compositing according to a predetermined condition, the composite image can be created with a simple operation.

  An image separation processing device according to the present invention is an image separation processing device that separates an insertion image from a composite image created by the image composition processing device, wherein each element that is quantized data of a blocked composite image A decompressed original image restoration unit that restores each element of the decompressed original image using a predetermined composition condition from an element in which the predetermined code element and each element of the decompressed original image are synthesized is blocked. Among the elements that are the quantized data of the combined image, the elements of the expanded original image extracted at positions adjacent to each other in the predetermined direction from the elements in which the elements of the inserted image and the elements of the expanded original image are combined An insertion image restoration unit that restores each element of the insertion image from each element of the synthesized image by removing the elements using a predetermined synthesis condition.

  According to such a configuration, restoration of the decompressed original image from the synthesized image, restoration of each element of the inserted image by removing elements of the decompressed original image from the synthesized image, and combination of each element of the restored inserted image, The inserted image can be separated from the composite image with a simple operation.

  An image processing system according to the present invention includes the above-described image composition processing device that creates a composite image, and the above-described image separation processing device that separates an insertion image from the composite image.

  According to such a configuration, the insertion image and the original image can be combined with a simple operation, and the insertion image can be separated from the composite image with a simple operation. Therefore, the composite image can be created and separated with a simple operation as a whole. Can do.

An image composition method according to the present invention is an image composition processing method for compositing at least one inserted image to an original image based on a predetermined composition condition , wherein a quantum of an inserted image blocked according to the composition condition into a position adjacent in the predetermined direction with respect to the position of each element of the data, by inserting a predetermined code elements that are equally blocked into data amount of each element, creating a buried image, wherein One of the elements included in the quantized data of the original image blocked in each of the element of the inserted image included in the embedded image and the code element inserted for the element according to the synthesis condition the order to synthesize in correspondence, and creating an extension original image by decompressing the original image in a predetermined direction by duplicating each element of the quantized data of the original image, according to the synthesis conditions, Umakomiga And a step of creating a composite to composite images and each element in the extended original image and each element in.

  According to such a configuration, since a composite image is created by inserting a predetermined code element into the inserted image, decompressing the original image, and compositing according to a predetermined compositing condition, it is possible to create a composite image with a simple operation.

  An image separation method according to the present invention is an image separation method for separating an inserted image from a composite image created by the above image composition method, and is a predetermined element among elements that are quantized data of a composite image that has been blocked. A step of restoring each element of the decompressed original image from the elements in which the code element of the image and each element of the decompressed original image are synthesized using a predetermined composition condition, and quantized data of the blocked composite image Among the elements that are, the elements of the expanded original image extracted at positions adjacent to each other in the predetermined direction from the elements in which the elements of the inserted image and the elements of the expanded original image are combined And removing the elements of the combined image from the elements of the combined image, and combining the restored inserted image.

  According to such a configuration, restoration of the decompressed original image from the synthesized image, restoration of each element of the inserted image by removing elements of the decompressed original image from the synthesized image, and combination of each element of the restored inserted image, The inserted image can be separated from the composite image with a simple operation.

  An image processing method according to the present invention includes the above-described image composition method for creating a composite image, and the above-described image separation method for separating an insertion image from the composite image.

  According to such a configuration, the inserted image and the original image can be combined with a simple operation, and the inserted image can be separated from the combined image with a simple operation. Therefore, the composite image can be created and separated with a simple operation as a whole. Can do.

A program according to the present invention is a program that causes a computer to function as an image composition processing device that synthesizes at least one inserted image with an original image based on a predetermined composition condition. Insert a predetermined code element that is equal to the data amount of each element and embed it at a position adjacent to the position of each element that is quantized data of the inserted insertion image in a predetermined direction. An embedded image creating unit for creating an image, and in accordance with the synthesis condition, each of an element of an inserted image included in the embedded image and a code element inserted with respect to the element are quantized to block the original image In order to synthesize one of the elements included in the quantized data, the original image is expanded and stretched in a predetermined direction by duplicating each element of the quantized data of the original image. An elongate original image creating section that creates an original image, in accordance with the synthesis conditions, as a composite image creation unit that creates a synthesized and the synthesized image and the elements included in each element and an extended original images included in the embedded image Make it work.

  According to such a configuration, since the composite image is created by inserting a predetermined code element into the inserted image, decompressing the original image, and compositing according to a predetermined condition, the composite image can be created with a simple operation.

  A program according to the present invention is a program that causes a computer to function as an image separation processing device that separates an inserted image from a composite image created by using a program that causes the computer to function as the image composition processing device. Is decompressed from the elements that are the quantized data of the blocked composite image, using the predetermined composition conditions, from the elements in which the predetermined code element and each element of the decompressed original image are combined The decompressed original image restoration unit that restores each element of the original image, and among the elements that are the quantized data of the blocked composite image, the elements of the inserted image and the elements of the decompressed original image are combined The elements of the inserted image are restored from the elements of the composite image by removing the elements of the decompressed original image extracted at adjacent positions in the predetermined direction from the elements of the composite image. To function as an insertion image restoration unit that.

  According to such a configuration, restoration of the decompressed original image from the synthesized image, restoration of each element of the inserted image by removing elements of the decompressed original image from the synthesized image, and combination of each element of the restored inserted image, The inserted image can be separated from the composite image with a simple operation.

  In addition, a program according to the present invention includes a program that causes a computer to function as the image synthesis processing device that creates a composite image, and a program that causes the computer to function as the image separation processing device that separates an insertion image from the composite image.

  According to such a configuration, the inserted image and the original image can be combined with a simple operation, and the inserted image can be separated from the combined image with a simple operation. Therefore, the composite image can be created and separated with a simple operation as a whole. Can do.

  As described above, according to the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, There is an excellent effect that the separation can be simplified.

1 shows a system configuration diagram of an image processing system according to an embodiment of the present invention. FIG. 2 is a hardware configuration diagram of an image composition processing device (image separation processing device) according to the embodiment. FIG. 1 is a block diagram of an image composition processing device according to the embodiment. FIG. The block diagram of the synthetic | combination condition determination part which concerns on the same embodiment is shown. The block diagram of the image composition part concerning the embodiment is shown. FIG. 2 is a block diagram of an image separation processing device according to the embodiment. The block diagram of the image separation part which concerns on the same embodiment is shown. 3 shows a flowchart in creating a composite image according to the embodiment. 6 shows a flowchart for determining a synthesis condition according to the embodiment. 5 shows a flowchart of separating an inserted image according to the embodiment. The schematic which synthesize | combines the insertion image and original image which concern on the embodiment is shown. The schematic diagram which isolate | separates an insertion image from the synthesized image which concerns on the embodiment is shown. FIG. 13A shows a first original image, FIG. 13B shows a second original image, and FIG. 13C shows an original image and an inserted image according to the embodiment. An inserted image is shown. FIG. 14A shows a first synthesized image synthesized at a predetermined mixing ratio and an inserted image separated from the first synthesized image according to the embodiment, and FIG. FIG. 14B shows an insertion image separated from the first composite image. FIG. 15A shows a second synthesized image synthesized at a predetermined mixing ratio and an inserted image separated from the second synthesized image according to the embodiment, and FIG. FIG. 15B shows an insertion image separated from the second composite image. The block diagram of the image composition part based on other embodiments is shown. The flowchart in determination of the synthetic | combination conditions based on other embodiment is shown. FIG. 18A shows a third synthesized image synthesized at a predetermined relative ratio and an inserted image separated from the third synthesized image according to another embodiment, and FIG. FIG. 18B shows the inserted image separated from the second composite image. FIG. 19A shows a fourth synthesized image synthesized at a predetermined relative ratio and an inserted image separated from the fourth synthesized image according to another embodiment, and FIG. FIG. 19B shows an inserted image separated from the fourth composite image.

<First Embodiment>
FIG. 1 to FIG. 15 show a first embodiment of an image composition processing device, an image separation processing device, an image processing system, an image composition processing method, an image separation processing method, an image processing method, and a program according to the present invention. Take this into account.

  As shown in FIG. 1, an image processing system 1 includes an image composition processing device 2 that synthesizes an original image and an insert image embedded in the original image, and an image providing device that provides the image composition processing device 2 with the original image and the insert image. 3, a synthesized image output device 4 that outputs a synthesized image synthesized by the image synthesis processing device 2, and an image separation processing device 5 that separates an insertion image from the synthesized image output by the synthesized image output device 4. The original image may be a natural image having a plurality of gradations, for example. Further, the insertion image may be a binary image represented by white and black, for example. In the present embodiment, description will be made assuming that the original image is a natural image having a plurality of gradations, and the inserted image is a QR code (registered trademark).

[Image composition processing device]

  As shown in FIG. 2, the image composition processing device 2 according to the present embodiment includes a CPU 205 peripheral unit including a CPU 205, a RAM 220, a graphic controller 275, and a display device 280 connected to each other by a host controller 282. An input / output unit having a communication interface 230, a hard disk drive 240, and a CD-ROM drive 260 connected to the host controller 282 by the output controller 284, a ROM 210 connected to the input / output controller 284, and an input / output chip 270 It has a legacy input / output unit.

  The host controller 282 connects the RAM 220 to the CPU 205 and the graphic controller 275 that access the RAM 220 at a high transfer rate. The CPU 205 operates based on programs stored in the ROM 210 and the RAM 220 to control each unit. The graphic controller 275 acquires image data created on a frame buffer provided in the RAM 220 by the CPU 205 or the like and displays it on the display device 280. Alternatively, the graphic controller 275 may include a frame buffer that stores image data created by the CPU 205 or the like.

  The input / output controller 284 connects the host controller 282 to the communication interface 230, the hard disk drive 240, and the CD-ROM drive 260, which are relatively high-speed input / output devices. The communication interface 230 communicates with other devices via a network. The hard disk drive 240 stores programs and data used by the CPU 205 in the image composition processing apparatus 2. The CD-ROM drive 260 reads a program or data from the CD-ROM 295 and provides it to the hard disk drive 240 via the RAM 220.

  The input / output controller 284 is connected to the ROM 210 and a relatively low-speed input / output device of the input / output chip 270. The ROM 210 stores a boot program that the image composition processing device 2 executes at startup, a program that depends on the hardware of the image composition processing device 2, and the like. The input / output chip 270 connects various input / output devices via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the hard disk drive 240 via the RAM 220 is stored in a recording medium such as a CD-ROM 295 or an IC card and provided by a user. The program is read from the recording medium, installed in the hard disk drive 240 in the image composition processing apparatus 2 via the RAM 220, and executed by the CPU 205. A program installed and executed in the image composition processing apparatus 2 works on the CPU 205 or the like to function as a control unit, and controls the image composition processing apparatus 2.

  The image composition processing device 2 may be, for example, a mobile terminal, a personal computer, or the like. The image composition processing device 2 is connected to the image providing unit 3 and the composite image output device 4 by wire or wirelessly, and transmits and receives an original image, an insertion image, and a composite image. As illustrated in FIG. 3, the image composition processing device 2 is acquired by the input device 21 a that receives input from the user, the image acquisition unit 21 that acquires the original image and the insertion image from the image providing device 3, and the image acquisition unit 21. An image storage unit 22 for storing the original image and the inserted image, a synthesis condition determination unit 23 for determining a synthesis condition for the original image and the insertion image, and a synthesis condition storage unit for storing the synthesis condition determined by the synthesis condition determination unit 23 24, an image combining unit 25 that combines the original image and the inserted image in accordance with the determined combining condition, and an image output unit 26 that outputs the combined image and the determined combining condition to the combined image output unit 4.

  The input device 21a is, for example, a keyboard or a mouse. The input device 21a accepts input of information for selecting an original image and an insertion image desired to be synthesized from a user among original images and synthesized images stored in the image providing device 3. The input device 21 a sends the input information for selecting the original image and the inserted image to the image acquisition unit 21.

  The input device 21a may be an image reading unit such as a scanner, and an original image or an insertion image may be directly input to the input device 21a. When the original image or the insertion image is input to the input device 21 a, the input device 21 a sends the input original image or insertion image to the synthesis condition determination unit 23. Further, the input device 21a may accept an input of a synthesis condition for synthesizing the original image and the insertion image. When the synthesis condition is input, the input device 21 a sends the input synthesis condition to the synthesis condition determination unit 23.

  The image acquisition unit 21 includes, for example, a LAN card, a wireless communication unit, an I / O port, or the like. The image acquisition unit 21 acquires information for selecting an original image and an insertion image sent from the input device 21a. The image acquisition unit 21 acquires the selected original image and insertion image from the image providing device 3. The image acquisition unit 21 sends the acquired original image and insertion image to the image storage unit 22.

  The image storage unit 22 may be a storage device such as a hard disk, a RAM, an optical medium, or an SSD. The image storage unit 22 stores the original image and the insertion image received by the image receiving unit 21.

  As shown in FIG. 4, the synthesis condition determination unit 23 includes an image evaluation unit 231 that evaluates each of the original image and the insertion image, and a mixing ratio determination unit that determines a mixing ratio in the composite image of the original image and the insertion image. 232, a code insertion condition determining unit 233 that determines an insertion condition of a code element to be embedded in the inserted image, and an expansion condition determining unit 234 that determines an expansion condition of the original image. The synthesis condition determination unit 23 determines a predetermined synthesis condition for the original image and the insertion image by the function of the CPU 205 as a whole.

  The image evaluation unit 231 reads the original image and the insertion image stored in the image storage unit 22. The image evaluation unit 231 evaluates the number of read insertion images, the size of the quantized original image, and the size of the quantized insertion image. The image evaluation unit 231 sends the number of insertion images obtained by evaluation, the size of the quantized original image, and the size of the quantized insertion image to the decompression condition determination unit 234 and the synthesis condition storage unit 24. . In this embodiment, for the sake of simplicity, the image evaluation unit 231 evaluates that the number of inserted images is one, the size of the original image and the size of the inserted image are the same, and the evaluation result is a code insertion condition. The data is sent to the determination unit 233, the expansion condition determination unit 234, and the synthesis condition storage unit 24.

  In addition, the image evaluation unit 231 evaluates the pixel values and the like of the acquired original image and insertion image. For example, in this embodiment, the image evaluation unit 231 evaluates the pixel values of the pixels included in the original image and the inserted image, the hue of the entire image, the luminance value, and the like. For example, the image evaluation unit 231 performs an evaluation that the luminance value of the original image is high as a whole and the luminance value of the insertion image is low as a whole. The image evaluation unit 231 sends the results obtained by evaluating the pixel values of the original image and the insertion image to the mixing ratio determination unit 232, the code insertion condition determination unit 233, and the expansion condition determination unit 234.

  The mixing ratio determination unit 232 determines the mixing ratio of the original image and the insertion image in the composite image from the evaluation result received from the image evaluation unit 231. The mixing ratio determining unit 232 determines a mixing ratio such that the insertion image is not noticeable with respect to the original image and the insertion image can be extracted from the original image.

  For example, when it is evaluated that the luminance value of the original image is high as a whole and the luminance value of the insertion image is low as a whole, the mixing ratio determination unit 232 performs the original ratio in the composite image with respect to a predetermined mixing ratio as a reference. The mixing ratio of images is relatively low, and the mixing ratio of inserted images is relatively high. The mixing ratio determination unit 232 sends the determined mixing ratio to the synthesis condition storage unit 24. When the input device 21 a receives a mixture ratio, the mixture ratio determination unit 232 sends the input mixture ratio to the synthesis condition storage unit 24.

  It should be noted that the mixing ratio at which the inserted image is less noticeable than the original image and the inserted image can be extracted from the original image is preferably such that the S / N ratio between the original image and the inserted image is about 40 dB. For example, when the composite image output device 4 stores the composite image as electronic data, the mixing ratio determination unit 232 preferably sets the mixing ratio of the inserted image to about 0.004. That is, it is preferable that the mixing ratio of the original image is about 0.996. When the image composition processing device 2 outputs the composite image as a printed matter to the composite image output device 4, the mixing ratio determination unit 232 may set the mixing ratio of the inserted image to about 0.3 to 0.03. preferable. That is, it is preferable that the mixing ratio of the original image is set to a value between 0.7 and 0.97. In the present embodiment, description will be made assuming that the mixing ratio of the original image is 0.996 and the mixing ratio of the inserted image is 0.004.

  The code insertion condition determination unit 233 uses the evaluation result received from the image evaluation unit 231 to determine a code element to be inserted into the insertion image in order to create an embedded image. That is, the code insertion condition determination unit 233 determines a code element to be inserted into the insertion image using the size of the original image, the size of the insertion image, the pixel values of the original image and the insertion image, and the like. Here, the code insertion condition determination unit 233 blocks the quantized data of the inserted image for each predetermined data amount, and determines a code element having the same data amount as each element included in the block. Specifically, the code insertion condition determination unit 233 blocks the quantized data of the inserted image for each row vector, and determines a code element having a data amount equal to the data amount of each element included in the block.

  For example, consider a case where the code insertion condition determination unit 233 receives an evaluation that the sizes of the original image and the inserted image are the same, the luminance of the original image is high, and the luminance of the inserted image is low. In this case, the code insertion condition determination unit 233 determines a code element having data closer to white with the same data amount as the element included in each row vector of the quantized data of the blocked insertion image as the code element. . In the present embodiment, for the sake of simplicity, the code insertion condition determination unit 233 determines a row vector in which the odd-numbered columns are 0 and the even-numbered columns are 1 as code elements. That is, the code insertion condition determination unit 233 determines a code element as a row vector of (1, 0, 1, 0, 1, 0,...). The code insertion condition determination unit 233 sends the determined code element to the synthesis condition storage unit 24. When the input device 21a accepts direct input of a code element, the code insertion condition determination unit 233 determines the input code element instead of determining the code element using image evaluation by the image evaluation unit 231. It may be sent to the synthesis condition storage unit 24 as a code element.

  The expansion condition determination unit 234 determines an expansion condition for expanding the original image in a predetermined direction from the evaluation result received from the image evaluation unit 231. Specifically, the expansion condition determination unit 234 determines an expansion condition for expanding the original image in a predetermined direction from the number of inserted images and the size of the original image and the inserted image.

  In this embodiment, since it is evaluated that the number of inserted images is one and the sizes of the original image and the inserted image are equal, the decompression condition determination unit 234 determines that the original image is doubled in the vertical direction. Determine as. In other words, the expansion condition determining unit 234 determines that the quantized data of the original image is expanded twice in the column direction as the expansion condition. The expansion condition determination unit 234 sends the determined expansion condition to the synthesis condition storage unit 24. When the input device 21a accepts direct input of the expansion condition, the expansion condition determination unit 234 may send the input expansion condition to the synthesis condition storage unit 24 instead of the determined expansion condition.

  The synthesis condition storage unit 24 may be a storage device such as a hard disk, a RAM, or an SSD, for example. The composition condition storage unit 24 sends the number of inserted images sent from the image evaluation unit 231, the size of the inserted image and the original image, the mixing ratio sent from the mixing ratio determination unit 232, and the code insertion condition determination unit 233. The code element and the decompression condition sent from the decompression condition determination unit 234 are stored as a composition condition for the original image and the insertion image.

  As shown in FIG. 5, the image composition unit 25 creates an embedded image creation unit 251 that creates an embedded image according to the determined composition condition, and a decompressed image creation that creates a decompressed original image according to the determined composition condition. A unit 252 and a synthesized image creating unit 253 that synthesizes the created embedded image and the created decompressed original image. The image combining unit 25 combines the embedded image and the decompressed original image by the CPU 205 functioning as a whole.

  The embedded image creation unit 251 acquires an insertion image stored in the image storage unit 22. In addition, the embedded image creation unit 251 acquires the synthesis condition stored in the synthesis condition storage unit 24. The embedded image creating unit 251 blocks the inserted image using a predetermined method. The embedded image creating unit 251 is a predetermined code element that is blocked equal to the data amount of each element at a position adjacent to the position of each element in the quantized data of the blocked insertion image in a predetermined direction. To create an embedded image. Note that the embedded image creation unit 251 may acquire and use a method stored in advance in the synthesis condition storage unit 24 as a method of blocking, and receive it from the code insertion condition determination unit 233 as a synthesis condition. Also good. The embedded image creation unit 251 sends the created embedded image to the composite image creation unit 253.

  More specifically, the embedded image creating unit 251 inserts the determined code element into the inserted image according to the number of inserted images, the expansion condition, and the code element included in the acquired composition condition, and inserts the embedded image. create. For example, when the number of inserted images is one, the embedded image creating unit 251 has the same size of the embedded image with the number of inserted images added to the size of the decompressed original image created in accordance with the decompression conditions. An embedded image is created as follows. That is, when the composition condition includes one insertion image and the expansion condition that the quantized data of the original image is expanded twice in the column direction and the code element, the embedded image creation unit 251 Creates an embedded image by inserting a code element included in the synthesis condition into a row immediately above each row vector of the blocked insertion image. Thereby, the embedded image creating unit 251 creates an embedded image in which the size in the column direction is doubled with respect to the size of the inserted image. In this way, the embedded image creation unit 251 sets the size of the original image that is doubled in the column direction and the size of the created embedded image to the same size. The embedded image creation unit 251 sends the created embedded image to the composite image creation unit 253.

  In the present embodiment, the embedded image creation unit 251 includes a decompression condition that there is one inserted image and the quantized data of the original image is doubled in the column direction, and a row vector (1,0) of the code element. , 1, 0, 1, 0,...) To create an embedded image. The embedded image creation unit 251 inserts a code element in the line immediately above the inserted image, thereby making the size of the expanded original image the same as the size of the embedded image. Thereby, the embedded image creation unit 251 creates an embedded image in the quantized data of the embedded image, with the odd-numbered row as the row vector of the code element and the even-numbered row as each row vector of the quantized data of the inserted image.

  The expanded image creation unit 252 acquires the original image from the image storage unit 22. In addition, the decompressed image creation unit 252 acquires a synthesis condition from the synthesis condition storage unit 24. The decompressed image creating unit 252 includes, among the elements included in the quantized data of the original image that is blocked in each of the element of the inserted image included in the embedded image and the code element inserted into the element. In order to synthesize one of these, the original image is expanded in a predetermined direction by duplicating each element of the quantized data of the original image to create a decompressed original image. Specifically, the decompressed image creation unit 252 decompresses the original image according to the decompression conditions included in the synthesis conditions, thereby allowing each of the embedded image element and the code element inserted for the element to be embedded. The original image is copied by duplicating each element of the quantized data of the original image in order to synthesize a set of blocks having the same elements among the elements included in the quantized data of the blocked original image. An expanded original image is created by expanding in a predetermined direction. The expanded image creation unit 252 sends the created expanded original image to the composite image creation unit 253.

  In the present embodiment, since the synthesis condition includes an expansion condition that the original image is expanded twice in the column direction, the expanded image creation unit 252 expands the quantized data of the original image twice in the column direction. Specifically, the expanded image creation unit 252 creates an expanded original image by expanding the original image by duplicating each element of each row vector of the original image directly above the row vector. That is, the decompressed image creating unit 252 decompresses the originals in which each element included in the (2n-1) -row row vector (n is a natural number) is equal to each element included in the 2n-row row vector (n is a natural number). Create an image.

  The composite image creation unit 253 acquires the composite condition from the composite condition storage unit 24. In addition, the composite image creation unit 253 creates a composite image by combining each element included in the embedded image and each element included in the decompressed original image in accordance with the acquired composite condition.

That is, the composite image creation unit 253 creates a composite image so as to satisfy the following expression, using a mixing ratio included in a predetermined composition condition.
(Formula 1)
X _ij = A ₁ S _{1, ij} + A ₂ S _{2, ij}

Here, X _ij indicates the i-th row and j-th column of the quantized composite image, A ₁ indicates the mixing ratio of the decompressed original image (original image), and S _{1, ij} is quantized. A ₂ indicates the mixing ratio of the embedded image (inserted image), and S _{2, ij} indicates the i-th row of the quantized embedded image. The j-th column is shown.

  In this way, the composite image creation unit 253 creates a composite image by associating each element that is the quantized data of the decompressed original image with each element that is the quantized data of the embedded image. In the present embodiment, the composite image creation unit 253 includes an odd row in which the code element and each row vector of the copied original image are combined, and an even row in which each row vector of the insertion image and each row vector of the original image are combined. Create a composite image with The composite image creation unit 253 sends the created composite image to the image output unit 26. In the present embodiment, the composite image creation unit 253 combines the decompressed original image and the embedded image using the decompressed original image mixing ratio of 0.996 and the embedded image blending ratio of 0.004. The composite image creation unit 253 then generates an odd number obtained by combining the row vector (1,0,1,0,1,0, ...) of the code element and the row vector of the quantized data of the copied original image. A composite image having a row and even rows obtained by combining each row vector of the quantized data of the blocked insertion image and each row vector of the quantized data of the blocked original image is created.

  The image output unit 26 includes, for example, a LAN card, a wireless communication unit, an I / O port, or the like. The image output unit 26 sends the generated composite image to the composite image output device 4. In addition, the image output unit 26 acquires the synthesis condition stored in the synthesis condition storage unit 24 together with the created synthesized image, and sends the synthesis condition to the synthesized image output device 4.

[Image providing device]
The image providing device 3 is, for example, a server including a database, and stores at least one original image and at least one inserted image provided to the image composition processing device 2.

[Composite image output device]
The composite image output device 4 is, for example, a server, a personal computer, a portable terminal, or the like. The composite image output device 4 acquires a composite image from the image composite processing device 2 and uses the composite image and the composite condition sent from the image providing device 3 as the composite image. The data is stored in a database (not shown) provided in the output device 4. The composite image output device 4 may be, for example, a printer, obtains a composite image from the image composition processing device 2, and prints the composite image.

[Image Separation Processing Device]
Next, the image separation processing device 5 will be described. The hardware configuration of the image separation processing device 5 is such that a program that is installed and executed in the image separation processing device 5 operates on the CPU 205 or the like to function as a control unit with respect to the hardware configuration of the image providing device 3. The difference is that the separation processing device 5 is controlled. The other configuration is the same as the configuration of the image providing device 3, and the description thereof is omitted here.

  As illustrated in FIG. 6, the image separation processing device 5 selects and inputs a composite image acquired from the composite image output device 4, and acquires a composite image selected from the composite image output device 4. 51, an image storage unit 52 that stores the composite image acquired by the composite image acquisition unit 51, an image display unit 53 that displays the composite image and the extracted inserted image, and a composite condition of the acquired composite image A synthesizing condition acquisition unit 54, a synthesizing condition storage unit 55 that stores the synthesizing condition acquired from the synthesizing image output device 4, and an image separation unit 56 that separates the inserted image from the synthesizing image based on the synthesizing condition. In the present embodiment, a case will be described in which the insertion image is separated from the composite image detailed in the embodiment of the image composition processing device 2.

  The input device 51 a is, for example, a keyboard or a mouse, and receives from the user a selection input of a composite image for which an insertion image is desired to be separated from a composite image stored in the composite image output device 4. The input device 51a sends the input composite image selection to the composite image acquisition unit 51. When the composite image output device 4 is a printing device such as a printer, the input device 51 a may include an image reading unit such as a scanner, or may read a composite image and send it to the composite image acquisition unit 51. Furthermore, the input device 51a may receive an input of a synthesis condition related to the synthesized image and send the input synthesis condition to the synthesis condition acquisition unit 54.

  The composite image acquisition unit 51 includes, for example, a LAN card, a wireless communication unit, an I / O port, or the like. The composite image acquisition unit 51 acquires a composite image from the composite image output device 4 based on the selection of the composite image input to the input device 51a. The composite image acquisition unit 51 sends the acquired composite image to the image storage unit 52. Further, the composite image acquisition unit 51 acquires a composite condition of the composite image from the composite image output device 4 and sends it to the image display unit 53. If the input device 51 a is an image reading unit such as a scanner, the composite image acquisition unit 51 sends the composite image data read by the input device 51 a to the image storage unit 52.

  The image storage unit 52 may be a storage device such as a hard disk, a RAM, an optical medium, or an SSD, for example. The image storage unit 52 stores the composite image sent from the composite image acquisition unit 51.

  The image display unit 53 is, for example, a display, acquires the composite image stored in the image storage unit 52, and displays it to the user. The image display unit 53 displays the insertion image separated by the image separation unit 56 to the user.

  The composite condition acquisition unit 54 acquires the composite condition corresponding to the selected composite image from the composite image output device 4 when the CPU 205 functions. The synthesis condition acquisition unit 54 sends the acquired synthesis conditions to the synthesis condition storage unit 55. When a synthesis condition is input to the input device 51a, the synthesis condition acquisition unit 54 sends the input synthesis condition to the synthesis condition storage unit 55. In the present embodiment, the synthesis condition acquisition unit 54 has one inserted image, the size of the original image and the inserted image is the same, and the code element is (1, 0, 1, 0, 1, 0,...). A composite condition such that the original image expansion condition is double in the column direction, the original image mixing ratio is 0.996, and the insertion image mixing ratio is 0.004 is acquired from the composite image output device 4. To do.

  The synthesis condition storage unit 55 may be a storage device such as a hard disk, a RAM, an optical medium, or an SSD. The synthesis condition storage unit 55 stores the synthesis conditions sent from the synthesis condition acquisition unit 54.

  As illustrated in FIG. 7, the image separation unit 56 includes an original image restoration unit 561 that restores an original image from a synthesized image, and an insertion image restoration unit 562 that restores the original image from the synthesized image.

  The original image restoration unit 561 acquires a composite image from the image storage unit 52. In addition, the original image restoration unit 561 acquires the synthesis condition relating to the synthesized image from the synthesis condition storage unit 55. The original image restoration unit 561 obtains a synthesis condition acquired from an element in which a predetermined code element and each element of the copied original image are synthesized among the elements that are the quantized data of the synthesized image that has been blocked. Is used to restore each element of the decompressed original image. That is, the original image restoration unit 561 identifies an element in which a predetermined code element and each element of the decompressed original image are synthesized, and restores the original image from the synthesized image using the synthesis condition. The original image restoration unit 561 sends the synthesized image quantization data and the restored original image quantization data to the insertion image restoration unit 562.

  For example, the original image restoration unit 561 pays attention to a row corresponding to an odd-numbered row among elements that are quantized data of a combined composite image that has been blocked. The original image restoration unit 561 takes into account the mixing ratio of the embedded image from the element in which the code element and the copied original image block are combined using the mixing ratio and the code element included in the combining condition. Then, the code element is removed. As a result, the original image restoration unit 561 has only the elements of the duplicated original image block in which the mixing ratio of the decompressed original image is added from the element in which the code element and the duplicated original image block are combined. Can be extracted. The original image restoration unit 561 further restores each element of the duplicated original image block by using the mixing ratio of the decompressed original image and combines the duplicated original image blocks in the column direction. To restore the original image. The original image restoration unit 561 sends the block-combined synthesized image quantization data and the restored original image quantization data to the insertion image restoration unit 562.

More specifically, the original image restoration unit 561 focuses on odd rows for each element of the quantized data of the composite image. Then, each element of the quantized data of the original image that has been blocked is restored using Expression 2 obtained by transforming Expression 1.
(Formula 2)
_{S 1, (2i) j =} S 1, (2i-1) j = X (2i-1) j / A 1 -A 2 S 2, (2i-1) j / A 1

Here, X _ij indicates the i-th row and j-th column of the quantized composite image, A ₁ indicates the mixing ratio of the decompressed original image (original image), and S _{1, ij} is quantized. A ₂ indicates the mixing ratio of the embedded image (inserted image), and S _{2, ij} indicates the i-th row of the quantized embedded image. The j-th column is shown.

  In the present embodiment, the original image restoration unit 561 focuses on odd-numbered rows of the composite image. First, the original image restoration unit 561 extracts odd-numbered rows of the composite image from the composite image. Then, the original image restoration unit 561 combines the extracted elements in the column direction. The original image restoration unit 561 removes the code element (1, 0, 1, 0, 1, 0,...) From the combined image in consideration of the mixing ratio 0.004 of the embedded image. As a result, the original image restoration unit 561 restores the original image. The original image restoration unit 561 sends the block-combined synthesized image quantization data and the restored original image quantization data to the insertion image restoration unit 562.

  The inserted image restoration unit 562 acquires, from the original image restoration unit 561, the quantized data of the combined composite image and the restored quantized data of the original image. The inserted image restoration unit 562 is adjacent in a predetermined direction from elements in which each element of the inserted image and each element of the decompressed original image are synthesized among the elements that are the quantized data of the synthesized image that has been blocked. Each element of the decompressed original image extracted at the position to be restored is restored. Specifically, the inserted image restoration unit 562 uses the number of inserted images, the mixing ratio, and the elements of the copied original image included in the synthesis condition to quantize the quantized data of the synthesized image that has been blocked. Restore each element of the inserted image from the even rows of.

  For example, the inserted image restoration unit 562 pays attention to the elements in the even-numbered rows in which the elements of the inserted image and the elements of the original image are combined among the elements that are the quantized data of the combined image that has been blocked. To do. The inserted image restoration unit 562 uses the mixing ratio included in the composition condition and each element of the duplicated original image, and even-numbered elements in which each element of the inserted image and each element of the original image are synthesized Then, each element of the original image is removed in consideration of the mixing ratio of the expanded original image. Thereby, the inserted image restoration unit 562 can extract the elements of the inserted image in which the mixing ratio of the embedded image is added from the elements in the even-numbered rows in which the elements of the inserted image and the elements of the original image are combined. . The inserted image restoration unit 562 further restores each element of the inserted image using the mixing ratio of the embedded images.

More specifically, the inserted image restoration unit 562 focuses on even-numbered rows for each element of the quantized data of the composite image. Then, based on S _{1, (2i) j} obtained in Expression 2, each element of the quantized data of the original image is restored using Expression 3 below.
(Formula 3)
_{S 2, (2i) j =} X (2i) j / A 2 -A 1 S 1, (2i) j / A 2

Here, X _ij indicates the i-th row and j-th column of the quantized composite image, A ₁ indicates the mixing ratio of the decompressed original image (original image), and S _{1, ij} is quantized. A ₂ indicates the mixing ratio of the embedded image (inserted image), and S _{2, ij} indicates the i-th row of the quantized embedded image. The j-th column is shown.

In the present embodiment, the inserted image restoration unit 562 focuses on even-numbered rows of the composite image. First, the inserted image restoration unit 562 extracts even-numbered rows of the composite image from the composite image. The inserted image restoration unit 562 combines the extracted elements in the even-numbered rows. The inserted image restoration unit 562 removes each element of the original image from the combined elements by adding the expansion original image mixing ratio of 0.996 from the combined elements. Thereby, the inserted image restoration unit 562
The inserted image restoration unit 562 may acquire the synthesis condition from the synthesis condition storage unit 55 and restore the inserted image in accordance with the number of inserted images included in the synthesis condition.

  The configuration of the image composition processing device, the image separation processing device, the image processing system, the image processing method, and the program according to the present embodiment is as described above. Next, the image composition processing device, the image separation according to the present embodiment. The operations of the processing device, the image processing system, the image processing method, and the program will be described using the flowcharts shown in FIGS.

[Create composite image]
First, a procedure for creating a composite image from an original image and an inserted image will be described using the flowcharts shown in FIGS. The image acquisition unit 21 acquires an original image from the composite image output device 4 (step S61). The image acquisition unit 21 may acquire the original image from the composite image output device 4 in accordance with an input for selecting the original image input to the input device 21a. The image storage unit 22 stores the original image acquired by the image acquisition unit 21.

  Furthermore, the image acquisition unit 21 acquires an insertion image from the composite image output device 4 (step S62). The image acquisition unit 21 may acquire an insertion image from the composite image output device 4 in accordance with an input for selecting the insertion image input to the input device 21a. The image storage unit 22 stores the insertion image acquired by the image acquisition unit 21.

  The composition condition determination unit 23 determines a composition condition for the original image and the insertion image stored in the image storage unit 22 (step S63). As shown in FIG. 9, the composition conditions are determined by evaluating the pixel values of the original image and the inserted image (step S631), determining the mixing ratio of the original image and the inserted image (step S632), This includes determining a condition for inserting a code element into the inserted image (step S633) and determining an expansion condition for the original image (step S634).

  First, the image evaluation unit 231 evaluates the number of inserted images to be inserted into the original image, the size of the original image, and the size of the inserted image. Further, the image evaluation unit 231 evaluates the pixel values of the pixels included in the original image and the inserted image, the color and luminance of the entire image, and the like (step S631). The image evaluation unit 231 sends the evaluation result as an evaluation result to the mixing ratio determination unit 232, the code insertion condition determination unit 233, and the expansion condition determination unit 234. In addition, the image evaluation unit 231 sends the evaluation result to the synthesis condition storage unit 24.

  The mixing ratio determining unit 232 determines the respective mixing ratios of the original image and the inserted image in the combined image obtained by combining the original image and the inserted image, according to the evaluation result sent from the image evaluation unit 231 (step S632). The mixing ratio determining unit 232 determines a mixing ratio in the combined image such that the inserted image is not conspicuous with respect to the original image and the inserted image can be separated from the combined image. The mixing ratio determination unit 232 sends the determined mixing ratio to the synthesis condition storage unit 24.

  The code insertion condition determination unit 233 determines a code element to be inserted into the insertion image according to the evaluation result sent from the image evaluation unit 231 (step S633). For example, when the image evaluation unit 231 evaluates that the luminance of the original image is high and the luminance of the insertion image is low in the evaluation result, the code insertion condition determination unit 233 selects a code element that becomes quantized data close to white. The code element to be inserted into the inserted image is determined. The code insertion condition determination unit 233 sends the determined code element to the synthesis condition storage unit 24. The composition condition storage unit 24 stores the number of inserted images, the expansion condition, the mixing ratio, and the code element as composition conditions.

  The expansion condition determination unit 234 determines the expansion condition of the original image according to the evaluation result sent from the image evaluation unit 231 (step S634). The expansion condition determination unit 234 determines the expansion rate and expansion direction of the original image as expansion conditions for expanding the original image. More specifically, the expansion condition determination unit 234 determines the expansion rate and expansion direction of the original image according to the number of insertion images combined with the original image and the size of the insertion image with respect to the original image. For example, when one inserted image having the same size as the original image is synthesized, the expansion condition determination unit 234 determines an expansion condition for expanding the original image twice in the vertical direction. The expansion condition determination unit 234 sends the determined expansion condition to the synthesis condition storage unit 24. The synthesis condition storage unit 24 stores the sent decompression conditions.

  The embedded image creation unit 251 reads the insertion image stored in the image storage unit 22. Further, the embedded image creation unit 251 reads out the synthesis condition stored in the synthesis condition storage unit 24. Then, the embedded image creating unit 251 creates an embedded image by inserting a predetermined code element into the inserted image in accordance with the read synthesis condition (step S64). The embedded image creation unit 251 sends the created embedded image to the composite image creation unit 253.

  The expanded image creation unit 252 reads the insertion image stored in the image storage unit 22. In addition, the decompressed image creation unit 252 reads the synthesis condition stored in the synthesis condition storage unit 24. Then, the expanded image creation unit 252 creates an expanded original image by expanding the original image in accordance with the read synthesis condition (step S65). The expanded image creation unit 252 sends the created expanded original image to the composite image creation unit 253.

  The composite image creation unit 253 reads out the synthesis conditions stored in the synthesis condition storage unit 24. The composite image creation unit 253 obtains an embedded image from the embedded image creation unit 251 and obtains an expanded original image from the expanded image creation unit 252. The composite image creation unit 253 then synthesizes the embedded image sent from the embedded image creation unit 251 and the decompressed original image sent from the decompressed image creation unit 252 in accordance with the composition conditions, Create (step S66).

  More specifically, the composite image creation unit 253 sends the embedded image sent from the embedded image creation unit 251 and the expanded image creation unit 252 in accordance with the mixing ratio of the original image and the insertion image included in the synthesis conditions. The expanded original image is synthesized to create a synthesized image. The composite image creation unit 253 sends the created composite image to the image output unit 26.

  The image output unit 26 reads the synthesis condition from the synthesis condition storage unit 24. The image output unit 26 outputs the read synthesis condition and the synthesized image sent from the synthesized image creation unit 253 to the synthesized image output device 4 (step S67).

[Separation of inserted images]
Next, the procedure for separating the insertion image from the composite image will be described using the flowchart shown in FIG. The composite image acquisition unit 51 acquires a composite image from the output device 4 based on information for selecting the composite image input to the input device 51a (step S70). The composite image acquisition unit 51 sends the acquired composite image to the image storage unit 52. The image storage unit 52 stores the composite image sent from the composite image acquisition unit 51. The image display unit 53 acquires and displays the composite image stored in the image storage unit 52.

  Based on the information for selecting the composite image input to the input device 51a, the composite condition acquisition unit 54 acquires the composite condition of the composite image from the composite image output device 4 (step S71). The synthesis condition acquisition unit 54 sends the acquired synthesis conditions to the synthesis condition storage unit 55. The synthesis condition storage unit 55 stores the synthesis conditions sent from the synthesis condition acquisition unit 54.

  The image separation unit 56 acquires the composite image stored in the image storage unit 52. In addition, the image separation unit 56 acquires the synthesis conditions stored in the synthesis condition storage unit 55. The original image restoration unit 561 is an element in which the code element and each element of the quantized data of the blocked original image are synthesized from each element of the quantized data of the blocked synthesized image according to the synthesis condition. Identify and extract Further, the original image restoration unit 561 removes the code element from the element in which the code element and each element of the quantized data of the blocked original image are synthesized according to the synthesis condition. As a result, the original image restoration unit 561 restores each element of the original image from the code element and each element of the quantized data of the blocked original image (step S72). The original image restoration unit 561 sends the quantized data of the composite image that has been blocked and each element of the restored original image to the insertion image restoration unit 562.

  The inserted image restoration unit 562 identifies and extracts an element in which each element of the inserted image and each element of the original image are synthesized from each element of the quantized data of the blocked synthesized image according to the synthesis condition. . The inserted image restoration unit 562 combines the extracted elements. Furthermore, the inserted image restoration unit 562 combines each element of the inserted image and each element of the original image using each element of the original image sent from the original image restoration unit 561 according to the synthesis condition. The inserted image is restored by removing each element of the original image from the elements. The inserted image restoration unit 562 sends the combined inserted image to the image display unit 53. The image display unit 53 displays the sent composite image (step S73).

  Next, the synthesis of the original image that is the quantized data and the inserted image that is the quantized data, and the separation of the inserted image that is the quantized data from the synthesized image that is the quantized data, are simplified. This will be explained using various models. Here, for the sake of simplicity, description will be made assuming that the image size of the original image and the inserted image is a 2 × 2 matrix, the code element is a row vector of (0, 2), and the mixing ratio is 50%.

[Create composite image]
This will be described with reference to FIG. The embedded image creating unit 251 creates an embedded image by inserting the row vector of the code element (0, 2) immediately above each row of the inserted image that is quantized data. Thus, the embedded image has an odd number of rows having a row vector of (0, 2) and an even number of rows having a row vector of the insertion image. That is, the embedded image becomes 2 × 4 matrix quantized data as shown in FIG.

  The expanded image creation unit 252 creates an expanded original image by replicating each row vector of the original image, which is quantized data, in the column direction. As a result, the decompressed original image has the first and second rows having the same element row vector, and the third and fourth rows having the same element row vector. That is, the decompressed original image becomes 2 × 4 matrix quantized data as shown in FIG.

  The image composition unit 25 synthesizes the embedded image that is the quantized data and the expanded original image that is the quantized data at a mixing ratio of 50%. As a result, a composite image that is 2 × 4 matrix quantized data as shown in FIG. 11 is generated.

[Separation of inserted images]
With reference to FIG. 12, the case where an insertion image is isolate | separated from the synthetic | combination image produced | generated in FIG. 11 is demonstrated. First, the original image restoration unit 561 extracts and combines odd-numbered rows from the synthesized image that is the quantized data. The original image restoration unit 561 restores the original image by removing the code element (0, 2) from the combined elements in consideration of the mixing ratio of 50%. Thereby, the original image restoration unit 561 can separate the original image which is the quantized data before the synthesis from the synthesized image. In FIG. 11, an estimated original image is described as an image estimated as an original image.

  The inserted image restoration unit 562 extracts and combines even-numbered rows from the synthesized image that is the quantized data. The inserted image restoration unit 562 restores the inserted image by removing each element of the original image from the combined elements in consideration of the mixing ratio of 50%. Accordingly, the inserted image restoration unit 562 can separate the inserted image that is the quantized data before the synthesis from the synthesized image.

<Example 1>
Next, examples according to the present embodiment will be described. In Example 1, the image shown in FIG. 13A was used as an original image, and one image shown in FIG. 13C was used as an insertion image. Also, the mixing ratio of the original image was 0.996, and the mixing ratio of the inserted image was 0.004.

  By synthesizing the original image and the insertion image using the image composition processing device 2, a composite image in which the insertion image is not conspicuous as shown in FIG. 14A can be obtained. Then, by using the image separation processing device 5 to separate the insert image from the composite image shown in FIG. 14A, the insert image shown in FIG. 12B can be obtained. Thus, the inserted image can be made inconspicuous in the synthesized image, and the inserted image can be extracted from the synthesized image.

<Example 2>
As Example 2, the image shown in FIG. 13B was an original image, and one image shown in FIG. 13C was an inserted image. Also, the mixing ratio of the original image was 0.996, and the mixing ratio of the inserted image was 0.004.

  By synthesizing the original image and the insertion image using the image composition processing device 2, a composite image in which the insertion image is not conspicuous as shown in FIG. 15A can be obtained. Then, the insertion image shown in FIG. 15B can be obtained by separating the insertion image from the composite image shown in FIG. 15A by using the image separation processing device 5. Thus, the inserted image can be made inconspicuous in the synthesized image, and the inserted image can be extracted from the synthesized image.

  As described above, the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment synthesize or separate the inserted image from the original image. It can be simpler. That is, the separation principle and procedure of the original image and the inserted image can be simplified, and the load such as memory usage can be reduced.

  Further, since the inserted image can be inserted into the original image to make it unnoticeable, it is not necessary to display or print the original image and the inserted image separately. Therefore, the appearance of the inserted image can be prevented from being conspicuous with respect to the original image, and the appearance of the original image can be kept good. In particular, when the inserted image is a QR code (registered trademark), a barcode, or the like, it is possible to prevent the QR code (registered trademark), a barcode, or the like from being conspicuous with respect to the original image, and to maintain a good appearance of the original image. be able to.

<Second Embodiment>
Next, the second embodiment of the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention will be described with reference to FIGS. To explain. 16 to 19, the parts denoted by the same reference numerals as those in FIGS. 1 to 15 represent the same configurations or elements as those in the first embodiment.

  An image composition processing device, an image separation processing device, an image processing system, an image composition processing method, an image separation processing method, an image processing method, and a program according to the present embodiment are the same as those in the first embodiment as shown in FIG. A mixture ratio determining unit 232 is changed to a relative ratio determining unit 235 for the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program. It is. Therefore, in this embodiment, description other than the relative ratio determination unit 235 is omitted.

  The relative ratio determination unit 235 determines the relative ratio between the original image and the insertion image in the composite image from the evaluation result received from the image evaluation unit 231. The relative ratio determination unit 235 determines a relative ratio such that the insertion image is not noticeable with respect to the original image and the insertion image can be extracted from the original image. The relative ratio determination unit 235 sends the determined relative ratio to the synthesis condition storage unit 24. When a relative ratio is input to the input device 21a, the relative ratio determination unit 235 sends the input relative ratio to the synthesis condition storage unit 24.

  For example, when it is evaluated that the luminance value of the original image is high overall and the luminance value of the inserted image is low overall, the relative ratio determination unit 235 converts the luminance value of the original image from the reference relative ratio. At the same time, increase the relative ratio. Further, when it is evaluated that part of the original image is white and the inserted image is black, the relative ratio determination unit 235 lowers the relative ratio from the reference relative ratio.

Here, the relative ratio is a ratio that changes the pixel value of the inserted image relative to the original image. By using the relative ratio, each element of the composite image is determined using the following formula.
(Formula 4)
X _ij = (PS _{2, ij} +1) S _{1, ij}

Here, X _ij represents the pixel value of the i-th row and j-th column of the composite image X, P represents the relative ratio, and S _{1, ij} represents the i-th row and j-th column of the original image S ₁ . S _{2, ij} indicates the pixel value of the i-th row and j-th column of the insertion image S ₂ .

That is, when the relative ratio is used, the mixing ratio of Expression 1 in the case of using the mixing ratio can be replaced with Expression 5 below.
(Formula 5)
A ₁ = PS _{1, ij}
A ₂ = 1

  The configurations of the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment are as described above. Next, the present embodiment The operation of the image composition processing device, image separation processing device, image processing system, image composition processing method, image separation processing method, image processing method, and program according to FIG. 17 will be described. Except for the operation of the synthesis condition determination unit 23, the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, and the image separation according to the first embodiment except that the mixture ratio is used. Since the processing method, the image processing method, and the program are the same, the description thereof is omitted here.

  That is, in the flowchart shown in FIG. 17, the determination of the mixing ratio (step S632) in the flowchart shown in FIG. 9 in the first embodiment is replaced with the determination of the relative ratio. The relative ratio determination unit 235 determines the relative ratio of the insertion image to the original image in the combined image obtained by combining the original image and the insertion image in accordance with the evaluation result sent from the image evaluation unit 231 (step S635). The relative ratio determining unit 235 determines a relative ratio in the synthesized image so that the inserted image is not conspicuous with respect to the original image and the inserted image can be separated from the synthesized image. The relative ratio determination unit 235 sends the determined mixing ratio to the synthesis condition storage unit 24.

<Example 3>
As Example 3, the same original image shown in FIG. 13A as in Example 1 and the inserted image shown in FIG. 13C were used. The relative ratio was set to -0.04.

  By synthesizing the original image and the insertion image using the image composition processing device 2, a composite image in which the insertion image is not conspicuous as shown in FIG. 18A can be obtained. Then, the insertion image shown in FIG. 18B can be obtained by separating the insertion image from the composite image shown in FIG. 18A by using the image separation processing device 5. Thus, the inserted image can be made inconspicuous in the synthesized image, and the inserted image can be extracted from the synthesized image.

<Example 4>
As Example 4, the same original image shown in FIG. 13B and the inserted image shown in FIG. 13C were used as in Example 2. The relative ratio was set to -0.04.

  By synthesizing the original image and the insertion image using the image composition processing device 2, a composite image in which the insertion image is not conspicuous as shown in FIG. 19A can be obtained. Then, by using the image separation processing device 5 to separate the insertion image from the composite image shown in FIG. 19A, the insertion image shown in FIG. 19B can be obtained. Thus, the inserted image can be made inconspicuous in the synthesized image, and the inserted image can be extracted from the synthesized image.

  As described above, according to the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment, as in the first embodiment. Thus, the composition or separation of the inserted image with respect to the original image can be simplified. That is, the separation principle and procedure of the original image and the inserted image can be simplified, and the load such as memory usage can be reduced.

  Further, since the inserted image can be inserted into the original image to make it unnoticeable, it is not necessary to display or print the original image and the inserted image separately. Therefore, the appearance of the inserted image can be prevented from being conspicuous with respect to the original image, and the appearance of the original image can be kept good. In particular, when the inserted image is a QR code (registered trademark), a barcode, or the like, it is possible to prevent the QR code (registered trademark), a barcode, or the like from being conspicuous with respect to the original image, and to maintain a good appearance of the original image be able to.

  The image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention are not limited to the above-described embodiments. Of course, various modifications can be made without departing from the scope of the present invention. Further, the configurations and methods of the plurality of embodiments described above may be arbitrarily adopted and combined (even if the configurations and methods according to one embodiment are applied to the configurations and methods according to other embodiments). Of course, it is of course possible to arbitrarily select configurations, methods, and the like according to various modifications described below and employ them in the configurations, methods, and the like according to the above-described embodiments.

  For example, in the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, the mixing ratio determination unit 232 determines the mixing ratio. Before the code element is determined by the code insertion condition determination unit 233, the expansion condition determination unit 234 may determine the expansion condition of the original image.

  Further, in the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, each column vector of the quantized data of the original image and Each column vector of the quantized data of the inserted image may be blocked. That is, any blocking method may be adopted as long as the data amount included in each block of the original image and the data amount included in each block of the inserted image are equalized. . Thereby, a suitable blocking method can be adopted in accordance with the pixel value of the original image or the inserted image.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment, a QR code (registered trademark) is used as an insertion image. Although described using, the inserted image may be any image. For example, it may be a character or a symbol.

  The code insertion condition determination unit 233 is employed in the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment. Alternatively, the blocking method or the code element insertion method may be included in the synthesis condition and sent to the synthesis condition storage unit 24. As a result, in the image separation processing device 5, the image separation unit 56 obtains the composition condition, so that the insertion image is extracted from the composite image using the blocking method or the code element insertion method employed in the image providing device 3. Can be separated.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present embodiment, the mixing ratio determining unit 232 is an original image or an insertion A different mixing ratio may be determined for each region included in the image. For example, when the mixing ratio determination unit 232 determines the mixing ratio of the original image, the mixing ratio determination unit 232 determines a high mixing ratio for a region with a lot of white and a low mixing for a region with a lot of black. The ratio may be determined.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, when there are two or more inserted images, The expanded image creation unit 252 may expand the original image four times or more and insert two or more inserted images. For example, when there are two inserted images, the expanded image creation unit 252 expands the original image four times by copying each element of each row vector of the original image three times to the row immediately above the row vector. To create a decompressed original image. That is, the decompressed image creating unit 252 includes each element included in the (4n-3) row vector (n is a natural number), the (4n-2), (4n-1), and 4n row vectors (n Is an expanded original image in which each element included in each is a natural number). The composite image creation unit 253 inserts the row vector of the embedded image related to the first inserted image into the (4n-3) row and the (4n-2) row, and the (4n-1) row and the 4n row. By inserting the row vector of the embedded image related to the second inserted image, the two inserted images can be combined with the original image.

  In this case, the inserted image restoration unit 562 of the synthesized image output device 4 acquires that the number of inserted images included in the synthesized condition is two. The inserted image restoration unit 562 separates the first inserted image from rows (4n-3) and (4n-2), and separates the second inserted image from rows (4n-1) and 4n. . Thereby, it is possible to insert information related to a plurality of insertion images together with the original image.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, the expanded image creation unit 252 includes the quantum of the original image. The data may be expanded in the column direction in accordance with the expansion rate in the column direction, and may be expanded in the row direction in accordance with the expansion rate. As a result, the original image and the inserted image can be synthesized without destroying the aspect ratio of the original image.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, the quantized data of the blocked original image Each element of the embedded image may be combined in any direction as long as the position is adjacent to each element. For example, when a single inserted image is combined with the original image, and the sizes of the original image and the inserted image are the same, the expanded image creation unit 252 converts the quantized data of the blocked original image into the row direction and the column direction. In this case, eight times may be created by replicating one block of the original image by multiplying each by three to create an expanded original image. The embedded image creation unit 251 may create an embedded image by inserting a code element into 8 blocks around each element of the quantized data of the blocked insertion image. The composite image creation unit 253 may create a composite image by combining the decompressed original image and the embedded image.

  Thus, the composite image includes eight elements in which the code element and the element of the original image are combined with one element in which the element of the insertion image and the element of the original image are combined. Therefore, by executing the threshold processing of each element of the original image obtained by removing the sign element from the eight elements, the elements of the original image can be more reliably separated from the synthesized image. That is, each element of the original image can be more reliably separated from the synthesized image even if there is a quantization error or noise. Therefore, each element of the inserted image can be more reliably separated from the synthesized image. In particular, when the composite image output device 4 is a printer or the like, the image separation processing device 5 can read the composite image printed by the composite image output device 4 and more reliably separate the insertion image from the composite image.

  In the image composition processing device, image separation processing device, image processing system, image composition processing method, image separation processing method, image processing method, and program according to the present invention, the image composition processing device 2 provides an image as electronic data. When outputting a composite image to the device 3, the image composition unit 25 may include a composition condition in the header of the composite image. In this case, the image output unit 26 may output only the synthesis condition to the synthesized image output device 4. Thereby, the image separation processing device 5 does not need to acquire the synthesis condition separately other than the acquisition of the composite image. Therefore, in the image separation processing device 5, it is possible to prevent the combined image from being acquired and the inserted image from being separated.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, as the pixel value, an RGB component, a CMY component, or Each of these components can be utilized. Thereby, for example, the image composition unit 25 may create a composite image using only the R component of the decompressed original image and the embedded image. As a result, a composite image can be created in accordance with the colors of the original image and the inserted image.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, the composition condition determining unit 23 does not determine the composition condition. In addition, a known synthesis condition may be stored in the synthesis condition storage unit 24, and the image synthesis unit 25 may synthesize the decompressed original image and the embedded image using the known synthesis condition. Similarly, the synthesis condition storage unit 55 stores the same known synthesis conditions as the synthesis conditions stored in the synthesis condition storage unit 24, and the image separation unit 56 uses the known synthesis conditions to generate a synthesized image. You may isolate | separate into an original image and an insertion image.

  In the image composition processing device, the image separation processing device, the image processing system, the image composition processing method, the image separation processing method, the image processing method, and the program according to the present invention, the image providing device 3 includes the original image and the inserted image in advance. And the original image and the inserted image may be stored.

  DESCRIPTION OF SYMBOLS 1 ... Image processing system, 2 ... Image composition processing apparatus, 3 ... Image provision apparatus, 4 ... Composite image output apparatus, 5 ... Image separation processing apparatus, 21 ... Image acquisition part, 21a ... Input device, 22 ... Image storage part, 23... Composition condition determining unit 24... Composition condition storage unit 25... Image composition unit 26... Image output unit 51... Composite image acquisition unit 51 a. 54 ... Composition condition acquisition unit, 55 ... Composition condition storage unit, 56 ... Image separation unit, 231 ... Image evaluation unit, 232 ... Mixing ratio decision unit, 233 ... Code insertion condition decision unit, 234 ... Decompression condition decision unit, 235 ... Relative ratio determination unit, 251 ... embedded image creation unit, 252 ... expanded image creation unit, 253 ... composite image creation unit, 561 ... original image restoration unit, 562 ... insertion image restoration unit

Claims (9)

An image composition processing device for compositing at least one insertion image with an original image based on a predetermined composition condition ,
In accordance with the synthesis condition, a predetermined code element that is blocked equal to the data amount of each element is placed at a position adjacent to the position of each element that is quantized data of the blocked insertion image in a predetermined direction. An embedded image creating unit for inserting and creating an embedded image;
According to the synthesis condition , one of the elements included in the quantized data of the original image blocked into each of the element of the inserted image included in the embedded image and the code element inserted into the element A decompressed original image creating unit that creates an expanded original image by expanding each original image in a predetermined direction by duplicating each element of the quantized data of the original image,
The following synthesis conditions, the image synthesis processing apparatus characterized by comprising a composite image creation unit that creates a synthesized and the synthesized image and the elements included in the extended original image and each of the elements included in the embedded image. An image separation processing device for separating an insertion image from a composite image created by the image composition processing device of claim 1,
Of the elements that are the quantized data of the combined image that has been blocked, the elements of the expanded original image are synthesized from the elements in which the predetermined code element and each element of the expanded original image are combined using predetermined composition conditions. A decompressed original image restoration unit for restoring each element;
Out of the elements that are the quantized data of the combined image that has been blocked, the expansion extracted from the element in which each element of the inserted image and each element of the expanded original image are combined in a predetermined direction An image separation processing apparatus comprising: an insertion image restoration unit that restores each element of an insertion image from each element of a synthesized image by removing elements of the original image using a predetermined synthesis condition.   An image processing system comprising: the image composition processing device according to claim 1 that creates a composite image; and the image separation processing device according to claim 2 that separates an insertion image from the composite image. An image composition processing method for compositing at least one inserted image with an original image based on a predetermined composition condition ,
In accordance with the synthesis condition, a predetermined code element that is blocked equal to the data amount of each element is placed at a position adjacent to the position of each element that is quantized data of the blocked insertion image in a predetermined direction. Inserting to create an embedded image;
According to the synthesis condition , one of the elements included in the quantized data of the original image blocked into each of the element of the inserted image included in the embedded image and the code element inserted into the element To create a decompressed original image by decompressing the original image in a predetermined direction by duplicating each element of the quantized data of the original image in order to synthesize them in correspondence with each other;
The following synthesis conditions, the image synthesis processing method characterized by comprising the steps of: creating a synthesized and the synthesized image and the elements included in the extended original image and each of the elements included in the embedded image. An image separation processing method for separating an insertion image from a composite image created by the image composition method of claim 4,
Of the elements that are the quantized data of the combined image that has been blocked, the elements of the expanded original image are synthesized from the elements in which the predetermined code element and each element of the expanded original image are combined using predetermined composition conditions. Restoring each element; and
Out of the elements that are the quantized data of the combined image that has been blocked, the expansion extracted from the element in which each element of the inserted image and each element of the expanded original image are combined in a predetermined direction Restoring each element of the inserted image from each element of the synthesized image by removing elements of the original image using a predetermined synthesis condition;
And a step of combining the elements of the restored inserted image.   An image processing method comprising: an image composition processing method according to claim 4 for creating a composite image; and an image separation processing method according to claim 5 for separating an insertion image from the composite image. A program for causing a computer to function as an image composition processing device for compositing at least one insertion image to an original image based on a predetermined composition condition ,
Computer
In accordance with the synthesis condition, a predetermined code element that is blocked equal to the data amount of each element is placed at a position adjacent to the position of each element that is quantized data of the blocked insertion image in a predetermined direction. An embedded image creation unit that inserts and creates an embedded image,
According to the synthesis condition , one of the elements included in the quantized data of the original image blocked into each of the element of the inserted image included in the embedded image and the code element inserted into the element A decompressed original image creating unit that creates an expanded original image by expanding each original image in a predetermined direction by duplicating each element of the quantized data of the original image,
The following synthesis conditions, a program for causing to function as the composite image creation unit that creates a synthesized and the synthesized image and the elements included in each element and an extended original images included in the embedded image. A program that causes a computer to function as an image separation processing device that separates an insertion image from a composite image created by using a program that causes the computer to function as an image composition processing device according to claim 7,
Computer
Among the elements that are quantized blocks of the synthesized image, the elements of the decompressed original image are synthesized from the elements in which the predetermined code element and each element of the decompressed original image are synthesized using a predetermined composition condition. A decompressed original image restoration unit that restores each element,
Out of the elements that are the quantized data of the combined image that has been blocked, the expansion extracted from the element in which each element of the inserted image and each element of the expanded original image are combined in a predetermined direction A program that functions as an inserted image restoration unit that restores each element of an inserted image from each element of a synthesized image by removing elements of the original image using a predetermined synthesis condition.   A program for causing a computer to function as the image composition processing device according to claim 7 for creating a composite image, and a program for causing the computer to function as the image separation processing device according to claim 8 for separating an insertion image from the composite image. A featured program.