JP2012175668A - Image combination method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image combination method with which, when an image-correspondent subject is required, a synthetic image is produced by inserting the image-correspondent subject to a photographed image.SOLUTION: An image combination method for combining a real image obtained by photographing a subject and a virtual image which has been produced already includes a photographing step of photographing, by a predetermined device, a subject including an image-correspondent subject to which the virtual image is made correspondent and which is hardly visible for a human being or is invisible and can be identified by the predetermined device, an information acquiring step of analyzing the photographed image, detecting the image-correspondent subject and acquiring combination information for specifying the virtual image which is made correspondent to the detected image-correspondent subject, and an image combination step of combining the virtual image specified on the basis of the combination information and the photographed real image.

Description

  The present invention relates to an image composition method for compositing a captured real image and a generated virtual image.

  As an image synthesis method for synthesizing a captured real image and a generated virtual image, for example, an additional image associated with a specific visible subject included in the captured captured image is selected according to the position of the specific subject. An image composition method is known in which a composite image is generated by being arranged on a captured image (see, for example, Patent Document 1).

JP 2010-187052 A

  In the conventional image synthesizing method, the image-corresponding subject as the specific subject to which the additional image is associated is visible, so that a human can see with the naked eye. However, the subject is not only an object photographed only for generating a composite image, but also a subject that may be seen by a person who does not need the composite image. For such a subject, it is desirable that the person who does not need the image corresponding subject cannot see the image corresponding subject.

The present invention has been made in view of such problems, and an object of the present invention is to generate a composite image of a virtual image and a real image using an image-corresponding subject that is difficult or invisible to the naked eye. An object of the present invention is to provide an image composition method capable of

  In order to achieve this object, the image composition method of the present invention is an image composition method for compositing a real image obtained by photographing a subject and a virtual image that has already been generated, and the virtual image is associated with the image. A photographing step of photographing the subject including the image-corresponding subject that is difficult for humans to visually recognize or cannot be visually recognized and can be identified by a predetermined device, and analyzing the photographed image to analyze the captured image An information acquisition step of detecting an image-corresponding subject and acquiring composite information for specifying the virtual image associated with the detected image-corresponding subject; and the virtual image specified based on the composite information; An image composition method comprising: an image composition step for compositing a captured real image.

  According to such an image composition method, the image-corresponding subject to which the virtual image is associated is difficult or impossible for humans to visually recognize, so that the image-corresponding subject is difficult or does not appear in the human field of view. . In addition, since the image-corresponding subject can be identified by a predetermined device, the virtual image associated with the image-corresponding subject is captured by photographing the place where the image-corresponding subject is disposed in the field of view with the predetermined device. It is possible to specify. For this reason, it is possible to generate a composite image obtained by combining a virtual image and a real image using an image-corresponding subject that is difficult or invisible to the naked eye.

  In this image composition method, the image-corresponding subject is formed of a colorless and transparent paint that absorbs a predetermined component of light, and the predetermined device includes a polarizing filter that transmits the predetermined component. It is desirable that

  According to such an image composition method, an image corresponding subject formed of a colorless and transparent paint absorbs a predetermined component of light. Therefore, a polarization filter that transmits a predetermined component is applied to a subject including the image corresponding subject. When the image is taken with a predetermined apparatus, an image with a small amount of incident light is taken only for the image corresponding subject. Since the part where the amount of light is small is black, an image in which the part of the image corresponding subject is black is photographed, and a composite image can be generated by specifying the image corresponding subject from the photographed image. Therefore, it is possible to easily generate a composite image using an image-corresponding subject that is colorless and transparent and difficult to see with the naked eye.

  In this image synthesis method, the paint is preferably a methacrylic acid special ester or an acrylic acid special ester.

  According to such an image synthesis method, the methacrylic acid special ester and the acrylic acid special ester are colorless and transparent and absorb a predetermined component. Accordingly, it is possible to easily generate an image-corresponding subject that is difficult for humans to visually recognize or is invisible and that can be identified by a predetermined device.

  In this image composition method, the image-corresponding subject easily absorbs a specific wavelength and is formed of a material having the same color as the ground, and the predetermined device detects light of the specific wavelength. It is desirable that

  According to such an image composition method, the image-corresponding subject is formed in the same color as the background, so that it is difficult to visually recognize and absorbs a specific wavelength. Since the light having the wavelength of is not reflected, the image-corresponding subject portion becomes black when the image is taken with a predetermined device that detects the light having the specific wavelength. Therefore, it is possible to easily generate a composite image using an image-corresponding subject that is difficult for a human to visually recognize and can be identified by a predetermined device.

  In this image composition method, it is preferable that the material is black ink that easily absorbs infrared rays, the image corresponding subject is provided on the black base, and the apparatus is an infrared camera.

  According to such an image composition method, it is possible to easily generate an image-corresponding subject that is difficult for humans to visually recognize by forming an image-corresponding subject with black on a black background. By shooting an image corresponding subject formed of black, it is possible to identify the image corresponding subject and easily form a composite image.

  In this image composition method, the actual image captured by the actual image capturing device for capturing the actual image, and the virtual image identified by capturing by the predetermined device are used as the actual image. It is desirable to combine based on the photographing position by the photographing device and the photographing position by the predetermined device.

  An image captured by a predetermined apparatus that can identify an image-corresponding subject that is difficult for humans to visually recognize or cannot be visually recognized may differ from an actual image captured by a normal camera or the like. For this reason, a predetermined device is used to acquire information for specifying and combining virtual images, and a real image captured by a real image photographing device different from the predetermined device is combined with the virtual image. Thus, it is possible to generate a composite image in which a virtual image is combined with a real image close to reality.

  According to the present invention, there is provided an image composition method capable of generating a composite image of a virtual image and a real image using an image-corresponding subject that is difficult or invisible to the naked eye.

It is a block diagram which shows an example of the apparatus for implement | achieving the image composition method which concerns on 1st Embodiment. It is a flowchart for demonstrating the image composition method of 1st Embodiment. FIG. 3A is a diagram illustrating an image of a shooting range, and FIG. 3B is a diagram illustrating an actual image captured by a normal camera. FIG. 3C is a diagram illustrating a real image captured by the imaging device according to the first embodiment, and FIG. 3D is a diagram illustrating an actual image captured by the imaging device according to the first embodiment and a virtual image. It is a figure which shows the synthesized image with which the image was synthesize | combined. It is a block diagram which shows an example of the apparatus for implement | achieving the image composition method which concerns on 2nd Embodiment. It is a figure for demonstrating the imaging | photography state of 2nd Embodiment. It is a flowchart for demonstrating the image composition method of 2nd Embodiment.

Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
In the image composition method according to the first embodiment, a subject including an image-corresponding subject that is difficult to visually recognize or is invisible is associated with information on a virtual image that is generated in advance, and is photographed. The virtual image based on the information about the image-corresponding subject and the photographed actual image are synthesized.

  In the first embodiment, the image-corresponding subject is a colorless and transparent paint on the indoor wall, and absorbs a light component that vibrates in a predetermined direction as a predetermined component of light, for example, methacrylic acid special ester or acrylic acid special A marker is formed with an ester. On the other hand, an example will be described in which the imaging unit of the image composition apparatus photographs a wall provided with a marker through a polarizing filter that transmits a component of light that vibrates in the predetermined direction.

FIG. 1 is a block diagram illustrating an example of an apparatus for realizing the image composition method according to the first embodiment.
An image composition device 1 for realizing the image composition method according to the first embodiment includes an image capturing unit 10 that captures a subject, and a process that combines a real image of the captured subject and a pre-formed virtual image. A control unit 12 for controlling the synthesizing device 1, a storage unit 14 for storing various information and data necessary for synthesizing images, a display unit 16 for displaying the synthesized image, and the present image synthesizing device 1. And an operation unit 18 for operating.

  The image synthesizing apparatus 1 according to the first embodiment includes, for example, an imaging unit 10 and a display unit 16 that displays a captured image, and is portable, for example, a digital camera, a digital video camera, a mobile phone, a portable information terminal ( A program that can execute image composition processing is stored in a PDA), a mobile computer, or the like.

  Then, when the user of the image composition device 1 photographs the subject, the captured actual image is displayed on the display unit 16. At this time, the photographed real image 20 (FIG. 3) includes a marker 21 as a subject corresponding to an image indicating predetermined composite information such as a QR code (registered trademark) or a barcode set in advance. If it is, the composite image obtained by detecting the marker 21 and acquiring composite information, and combining the captured real image 20 and the pre-stored virtual image 23 (FIG. 3) based on the acquired composite information. 24 (FIG. 3) is generated, and the generated composite image 24 is displayed on the display unit 16.

  In the first embodiment, the marker 21 is a colorless and transparent paint, which is formed of a paint that absorbs a light component that vibrates in a predetermined direction, and is indicated by “A” in FIG. 3 and is invisible to the naked eye. It is expressed with a one-dot chain line.

  The imaging unit 10 converts optical information into electrical information by an imaging element such as a CCD sensor that generates image data of a plurality of pixels constituting an image by photographing, such as a digital camera or a digital video camera. It is configured as follows. The imaging unit 10 of the first embodiment is provided with a polarizing filter 11 that transmits the same light component as the light component absorbed by the marker 21.

  The display unit 16 is configured by, for example, a liquid crystal panel that can display image data of a plurality of pixels constituting an image corresponding to each element. Here, the image data of each pixel is, for example, data indicating each component obtained by decomposing each pixel into an R (red) component, a G (green) component, and a B (blue) component.

  The operation unit 18 is a part where a user who uses the image composition device 1 performs an operation such as photographing or changing settings on the image composition device 1, and photographs at least the actual image 20. So-called shutters are provided.

  The storage unit 14 stores various types of information for generating a composite image in the image composition apparatus 1, and also stores an information storage area 14a in which information is stored and an image in the process of generating the composite image. It has an image virtual development area 14b which is a work area in which data is rewritten.

  In the information storage area 14a, information for specifying the virtual image 23 associated with the marker 21 included in the subject, the image data of the virtual image 23, and the position to be arranged with respect to the actual image 20 of the virtual image 23 are displayed. Compositing information such as position information to be shown is stored. The information storage area 14a also stores calculated information such as information indicating the distance from the viewpoint of the imaging unit 10 measured at the time of shooting to the subject.

  The image virtual development area 14b is a storage area in which photographed image data is stored for each pixel. As described above, since the image data of each pixel has data indicating three components of R, G, and B, the image virtual development area 14b has a storage area that is three times the number of pixels constituting the composite image. ing.

  The image data stored in the image virtual development area 14b is rewritten with the corresponding pixel image data as necessary when generating a composite image. The three data stored for each pixel in the image virtual development area 14b are rewritten respectively for the R component, the G component, and the B component when the image data of each pixel is rewritten. At this time, in the image virtual development area 14b, the storage area does not need to be arranged in the same manner as the elements of the display unit 16 or the imaging unit 10, and the image data of each storage area is the element of the display unit 16 or the imaging unit 10. As long as they are stored in association with each other.

  The control unit 12 controls the imaging unit 10 and the display unit 16 by operating the operation unit 18 by the user, or detects the marker 21 from the image data of the captured real image 20. Various processes such as an analysis process for analyzing the displayed information and an image synthesis process for synthesizing the actual image 20 and the virtual image 23 stored in the storage unit 14 are executed based on the analyzed information.

Next, an image composition method by the control unit 12 in the first embodiment will be described.
The image synthesizing method of the first embodiment is provided in the image synthesizing apparatus 1, and a process is started by operating a shutter which is an operation unit 18 for photographing with the imaging unit 10. At this time, the operation unit 18 may be provided with a switch for switching processing between when the image composition device 1 simply captures a real image and when a composite image is generated, such as a digital camera. Further, it is set to always execute the process of generating the composite image, and the process of generating the composite image may be executed only when the marker 21 is detected in the captured real image.

  As described above, in the first embodiment, when the image capturing unit 10 of the image composition device 1 captures an image, the image corresponding subject indicating information such as a QR code (registered trademark) or a barcode is present in the capturing range F1. A composite image 24 is generated according to the state in which the marker 21 is included.

  FIG. 2 is a flowchart for explaining the image composition method according to the first embodiment. FIG. 3A is a diagram illustrating an image of the photographing range, and FIG. 3B is a diagram illustrating an actual image photographed by an imaging unit without a polarizing filter. FIG. 3C is a diagram illustrating a real image captured by the imaging unit according to the first embodiment, and FIG. 3D is a diagram illustrating an actual image captured by the imaging unit according to the first embodiment and a virtual image. It is a figure which shows the synthesized image with which the image was synthesize | combined.

  When the shutter is operated, the control unit 12 captures a subject with the imaging unit 10 (imaging step S1), generates image data of each pixel constituting the captured actual image 20, and stores the generated image data. The image is stored in the image virtual development area 14b of the unit 14 (S2). At this time, when the image is taken in the photographing range F1 as shown in FIG. 3A and taken with a normal camera, a real image 20a as shown in FIG. Since the polarizing filter 11 is provided, a real image 20 as shown in FIG.

  Specifically, although the light reflected in the imaging range F1 is incident on the imaging unit 10, the marker 21 is formed of a paint that absorbs a component of light that is colorless and transparent and vibrates in a predetermined direction. The reflected light of the marker 21 does not contain a light component that vibrates in a predetermined direction. At this time, when photographing is performed with an imaging unit that is not provided with the polarization filter 11 that transmits the same light component as the light component absorbed by the marker 21, it is visible to the naked eye due to other light components. A real image 20a as shown in FIG. At this time, since the marker 21 is colorless and transparent, the marker 21 does not appear on the image. However, the imaging unit 10 of the first embodiment is provided with a polarizing filter 11 that transmits the same light component as the light component absorbed by the marker 21, and the reflected light of the marker 21 is directed in a predetermined direction. Since the component of the oscillating light is not included, a black actual image 20 is formed only at the marker 21 as shown in FIG.

  Further, the control unit 12 uses the principle of an autofocus mechanism mounted on a general camera based on information acquired from the imaging unit 10 at the time of capturing the actual image 20, for example, the upper half and the lower half of the lens. The distance between the subject and the viewpoint position of the imaging unit 10 is measured using the difference in the center of gravity position generated in half, and the measured distance information is stored in the storage unit 14.

  Next, the control unit 12 analyzes whether or not the marker 21 as the image corresponding subject is captured in the image data of the captured actual image 20 (S3). At this time, if the marker 21 is captured in the image data of the real image 20 (S4), information associated with the marker 21 is acquired from the storage unit 14 (information acquisition step S5). Here, the acquired information includes information for specifying the virtual image 23 associated with the marker 21, position information for combining the captured real image 20 and the virtual image 23, and the like.

  Further, when the image data of the photographed real image 20 is analyzed and the marker 21 is not photographed in the image data of the real image 20, the image data of the real image 20 stored in the image virtual development area 14b is used. Based on this, the actual image 20 is displayed on the display unit 16 (S7).

  In the case of the first embodiment, the image data of the captured actual image 20 is analyzed (S3), the marker 21 is detected in the image data of the actual image 20 (S4), and the information associated with the marker 21 is detected. Is acquired from the storage unit 14 (S5). At this time, position information for combining the virtual image 23 of the system kitchen to be combined with the captured real image 20, that is, information indicating that the virtual image 23 of the system kitchen is arranged in alignment with the position of the marker 21. Is acquired (S5).

  Next, based on the acquired information, the control unit 12 stores the image data of the target pixel of the real image 20 stored in the image virtual development area 14b in the information storage area 14a in association with the marker 21. The composite image 24 is generated by rewriting the image data of the virtual image 23 that has been created (image composition step S6). At this time, since the actual image 20 photographed by the imaging unit 10 has a higher density or a different color tone than the naked eye due to the influence of the polarization filter 11, the polarization filter 20 is added to the actual image 20 before synthesis. Corrections may be made to reduce the influence of.

  Then, the synthesized image 24 synthesized in the image virtual development area 14b is displayed on the display unit 16 (S7).

  According to the image composition method of the first embodiment, since the marker 21 associated with the virtual image 23 is colorless and transparent, the marker 21 is difficult or does not appear in the human field of view. Therefore, it is possible to place the marker 21 at a desired position without making the person who does not need the marker 21, that is, the person who does not need the composite image 24 aware of the presence of the marker 21. Further, since the marker 21 can be identified by the image synthesizing apparatus 1 having the imaging unit 10 including the polarizing filter 11 that transmits the same light component as the light component absorbed by the marker 21, the polarizing filter 11 is By taking a picture with the imaging unit 10 provided, and taking a picture of a place where the colorless and transparent marker 21 is arranged in the field of view, for example, the virtual image 23 of the system kitchen associated with the marker 21 is specified. Is possible. For this reason, a person who wants to arrange the marker 21 without noticing a person who does not need the marker 21 and want to synthesize the real image 20 and the virtual image 23 can use the synthesized image in the image synthesizer 1 including the polarizing filter 11. Can be provided.

  In addition, since the marker 21 is a methacrylic acid special ester or an acrylic acid special ester and the vibration component in a predetermined direction of light is absorbed by the marker 21, the methacrylic acid special ester or the acrylic acid special ester It is possible to easily arrange the marker 21 so as not to be noticeable by a colorless and transparent material, and by simply providing a polarizing filter in the imaging unit 10 due to the characteristic of absorbing a light component that vibrates in a predetermined direction. It is possible to generate a composite image 24 in which the real image 20 and the virtual image 23 are combined.

  In the first embodiment, an example in which the marker 21 is a methacrylic acid special ester or an acrylic acid special ester and the polarizing filter 11 is provided in the imaging unit 10 has been described. However, the present invention is not limited to this. For example, a device that easily absorbs a specific wavelength, is formed of a material having the same color as the base, and picks up an image may be a device that can detect light of a specific wavelength. Specifically, a marker formed of black that easily absorbs infrared rays may be provided in a black region to be imaged, and a so-called infrared camera may be used as an imaging unit as a predetermined device. Also in this case, the black marker provided on the black background is difficult to see and when reflected, the reflected light from the marker does not contain infrared light, so only the marker area is black. Is done. Then, a marker may be detected from the captured real image, a virtual image associated with the marker may be specified, and the specified virtual image and the real image may be combined to generate a combined image.

Next, a second embodiment will be described.
FIG. 4 is a block diagram illustrating an example of an apparatus for realizing the image composition method according to the second embodiment.

  In the image composition method according to the second embodiment, as the image composition device 1a, the two image capturing units 10a and 10b are used to photograph a subject including a marker 21a formed with black on a black background portion, and a composite image. An example of generating 24 will be described. In the following description, the same parts and portions as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted.

FIG. 5 is a diagram for explaining a shooting state of the second embodiment.
The image composition device 1a according to the second embodiment has two image capturing units 10a and 10b, and one image capturing unit 10a is a so-called normal camera that captures an image of a subject to be seen with the naked eye. The imaging unit 10b is a so-called infrared camera using a sensor whose infrared wavelength is also included in the sensitivity region, and is configured to be photographed simultaneously. Hereinafter, the other imaging unit 10b is referred to as an infrared imaging unit 10b when distinguished from the other imaging unit 10a. None of these two imaging units 10a and 10b have a polarizing filter. The two imaging units 10a and 10b are opposed to each other in front of the shooting target, and are arranged so that the direction in which the two imaging units 10a and 10b are arranged parallel to the shooting target is fixed integrally. Has been. The two imaging units 10a and 10b are arranged at a predetermined interval, and relative position information indicating the distance between the imaging units 10a and 10b is stored in the information storage area 14a.

  In the storage unit 14 of the second embodiment, an image virtual development area 14b is provided for each of the imaging units 10a and 10b.

  In the image composition process in the image composition method of the second embodiment, the control unit 12 stores the measured distance and the information storage area 14a when the images are captured by the two image capturing units 10a and 10b. Based on the distance between the imaging units 10a and 10b, the image data of the virtual image 23 is corrected and synthesized with the actual image 20. Specifically, in the second embodiment, the actual image 20 that is combined to generate the combined image 24 is captured by the imaging unit 10a that captures an image that can be seen with the naked eye, and is formed of black. An image for detecting the marker 21a is taken by the infrared imaging unit 10b that can identify the marker 21a. For this reason, if the virtual image 23 in which the position of the marker 21a is specified by the infrared imaging unit 10b is combined with the real image 20 captured by the imaging unit 10a, the composite image may become unnatural due to a difference in viewpoint. There is. For this reason, in the second embodiment, the image data of the virtual image 23 is obtained based on the position specified by the infrared imaging unit 10b, the distance measured at the time of shooting, and the relative position information stored in the information storage area 14a. Processing to match the viewpoint of the imaging unit 10a is executed.

FIG. 6 is a flowchart for explaining an image composition method according to the second embodiment.
Next, an image composition method by the control unit 12 in the second embodiment will be described.

  The image composition method according to the second embodiment is provided in the image composition apparatus 1a, and a process is started by operating a shutter which is an operation unit 18 for photographing with the imaging units 10a and 10b. At this time, the image synthesizing apparatus 1a is provided with a shutter that allows the two imaging units 10a and 10b to capture images simultaneously.

  When the shutter is operated, the control unit 12 captures the subject with the imaging units 10a and 10b (imaging step S11), and the image data of each pixel constituting the actual images 20 and 20a captured by each imaging unit. And the generated image data is stored in the image virtual development area 14b of the storage unit 14 (S12). At this time, the real image 20 of the wall without the marker 21a is generated in the imaging unit 10a arranged on the left side, and the black real image 20 is formed only on the marker 21a in the infrared imaging unit 10b arranged on the right side. .

  Specifically, the light reflected in the imaging range F1 is incident on the imaging unit 10, but the marker 21a is formed of black and transparent ink that easily absorbs infrared rays. Does not contain infrared. At this time, when the infrared imaging unit 10b using the sensor having the infrared wavelength as a sensitivity region is used, only the portion of the reflected light of the marker 21a that does not include infrared is blackened and the actual image 20a is displayed. Is formed.

  At this time, the control unit 12 measures the distance between the subject and the viewpoint position of the imaging unit 10 and stores the measured distance information in the storage unit 14.

  Next, the control unit 12 analyzes whether or not the marker 21a as the image corresponding subject is captured in the image data of the actual image 20a captured by the infrared imaging unit 10b (S13). At this time, when the marker 21a is captured in the image data of the actual image 20a (S14), information associated with the marker 21a is acquired from the storage unit 14 (information acquisition step S15). The information acquired here is the same as in the first embodiment.

  Further, when the image data of the captured real image 20 is analyzed and the marker 21 is not captured in the image data of the actual image 20, the captured image is captured by the imaging unit 10a and stored in the image virtual development area 14b. The actual image 20 is displayed on the display unit 16 on the imaging unit 10a side based on the image data of the actual image 20 (S18).

  In the case of the present embodiment, the image data of the captured real image 20a is analyzed (S13), the marker 21a is detected in the image data of the real image 20a (S14), and the information associated with the marker 21a is present. Obtained from the storage unit 14 (S15). At this time, the position information for combining the virtual image 23 of the system kitchen to be combined with the real image 20 captured by the imaging unit 10a, that is, the virtual image 23 of the system kitchen is arranged in alignment with the position of the marker 21a. Is obtained (S15).

  Next, as described above, the control unit 12 determines the virtual image 23 based on the position specified by the infrared imaging unit 10b, the distance measured at the time of shooting, and the relative position information stored in the information storage area 14a. A process of matching the image data with the viewpoint of the imaging unit 10a is executed (S16).

  Next, based on the acquired information, the control unit 12 corrects the image data of the pixel that is the target of the real image 20 captured by the imaging unit 10a stored in the image virtual development area 14b, as a corrected virtual image. 23 is rewritten with the image data 23 to generate a composite image 24 (image composition step S17).

  Then, the synthesized image 24 synthesized in the image virtual development area 14b is displayed on the display unit 16 on the imaging unit 10a side (S18).

  In the image composition method using the marker 21a formed with black and the infrared imaging unit 10b, an image captured by the infrared imaging unit 10b is different from an actual image captured by a normal camera or the like such as the imaging unit 10a. . Therefore, as in the second embodiment, the infrared imaging unit 10b is used to acquire information for specifying and synthesizing the virtual image 23, and imaging for capturing a real image different from the infrared imaging unit 10b. By combining the real image 20 and the virtual image 23 captured by the unit 10a, it is possible to form an image close to reality by combining the virtual image 23 on the real image 20. Furthermore, since the virtual image 23 in which the difference between the viewpoint positions of the two imaging units 10a and 10b is corrected is synthesized with the real image 20, it is possible to form a more realistic image.

  In the second embodiment, the example in which the two imaging units 10a and 10b are simultaneously photographed has been described. However, the two imaging units 10a and 10b are fixed at predetermined positions, and the subject moves or If the object does not change, it is not always necessary to photograph at the same time.

  The above embodiment is for facilitating the understanding of the present invention, and is not intended to limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and it is needless to say that the present invention includes equivalents thereof.

  In the above embodiment, an example of combining still images has been described. However, when combining moving images, a combined image may be generated and displayed in accordance with the frame rate of the moving images. For example, if the frame rate is 15 fps, it can be realized by rewriting the image on the display unit by repeating the image composition processing as described above 15 times per second.

DESCRIPTION OF SYMBOLS 1 Image composition apparatus 1a Image composition apparatus 10 Imaging part 10a Imaging part 10b Infrared imaging part (imaging part)
DESCRIPTION OF SYMBOLS 11 Polarization filter 12 Control part 14 Storage part 14a Information storage area 14b Image virtual expansion | deployment area | region 16 Display part 18 Operation part 20 Real image 20a Real image 21 Marker 21a Black marker 23 Virtual image 24 Composite image

Claims (6)

An image composition method for compositing a real image obtained by photographing a subject and a virtual image that has already been generated,
A photographing step of photographing the subject including the image-corresponding subject that is associated with the virtual image and is difficult for humans to visually recognize or is invisible and that can be identified by a predetermined device, with the predetermined device. When,
An information acquisition step of analyzing the captured image to detect the image-corresponding subject, and acquiring composite information for specifying the virtual image associated with the detected image-corresponding subject;
An image synthesis step of synthesizing the virtual image identified based on the synthesis information and the captured real image;
An image synthesizing method characterized by comprising: The image composition method according to claim 1,
The image corresponding subject is formed of a colorless and transparent paint that absorbs a predetermined component of light,
The image synthesizing method, wherein the predetermined device includes a polarizing filter that transmits the predetermined component. The image composition method according to claim 2,
The image composition method, wherein the paint is a methacrylic acid special ester or an acrylic acid special ester. The image composition method according to claim 1,
The image-corresponding subject is easy to absorb a specific wavelength and is formed of a material having the same color as the base,
The image synthesizing method, wherein the predetermined device is a device that detects light of the specific wavelength. The image composition method according to claim 4,
The material is ink that easily absorbs infrared rays,
The image-corresponding subject is provided on the black base,
The image synthesizing method, wherein the apparatus is an infrared camera. An image composition method according to any one of claims 1 to 5,
An actual image captured by an actual image capturing device for capturing the actual image;
The virtual image identified by photographing with the predetermined device;
Is synthesized based on the photographing position by the real image photographing device and the photographing position by the predetermined device.

Images