JP2017073717A - Information processing unit, information processing method, computer program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To project a relevant image so that the relevancy with an object can be understood easily.SOLUTION: An information processing unit including an imaging device and a projector detects an object for an image obtained through the imaging device (S202), and acquires the relevant information of the object (S203). Thereafter, the information processing unit captures an image including the object (S205), generates a superposed image by superposing the relevant image, obtained from the relevant information thus obtained, on the image of the object (S208), before projecting the superposed image. Consequently, the relationship of the object and relevant image becomes clear, even if the superposed image is projected to a place remote from the object.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technique for displaying information related to an object recognized from an image.

2. Description of the Related Art Conventionally, a technique for projecting and displaying related information on a target focused by a user is known. For example, Patent Document 1 discloses a technique for capturing an image of an object, searching for related information related to the imaged object, and projecting the image on the object. In this technique, the position and shape of an object are detected, and related information retrieved based on the detected position and shape is projected onto the object.
Patent Document 2 discloses a technique for automatically changing the projection position of related information when it is determined that the projection plane is not suitable for projecting related information.

JP-A-8-86615 JP 2012-68363 A

According to the system of Patent Literature 1, it is possible to project related information related to the captured object onto the object. Further, according to the system of Patent Document 2, when related information is projected, it can be automatically changed to a place suitable for projection, so that the user can read the projected related information. become.
However, when there is no place suitable for projection around the object, it is not possible to secure a place where projection can be performed even if the related information is moved. In addition, when there is a place suitable for projection at a place further away from the periphery of the object, related information can be projected at that place. However, in this case, since the distance between the object and the projected related information is large, it is difficult for the user to understand the relationship between the two. In particular, when there are a plurality of objects, it is difficult to understand which of the plurality of objects corresponds to the projected related information.
Therefore, when projecting related information about an object, it is desired to project the related information so that the relationship with the object becomes clear.

  In order to solve the above problems, an information processing apparatus according to the present invention uses an imaging unit that images a target, an image projection unit, and a captured image that includes the target and is captured by the imaging unit. And control means for acquiring related information related to, and generating a related image generated from the related information. The control unit generates a superimposed image in which the related image is superimposed on a captured image including the object, and the image projecting unit projects the generated superimposed image.

  According to the present invention, by superimposing and projecting an image of an object and related information, even if there is no place suitable for projection in the periphery including the object, the object and its Relevance with related information can be shown. Therefore, the related information can be projected so that the relevance with the object becomes clear.

(A) is a block diagram showing a hardware configuration of the information processing apparatus, (b) is a block diagram showing this functional configuration. The flowchart which shows the process in 1st Embodiment. (A)-(e) is explanatory drawing of the relationship between a target object and a superimposed image. The flowchart which shows the process of image acquisition and projection. The flowchart which shows the process of image acquisition and projection. The flowchart which shows the process which projects a superimposition image on either of a target object and the periphery of a target object. The flowchart which shows a process in case there exist multiple target objects. Explanatory drawing of a projection result in case a plurality of objects exist.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. It should be noted that the following embodiments are illustrative and are not intended to limit the scope of the present invention.
<First Embodiment>
FIG. 1A is a hardware configuration diagram of the information processing apparatus 10 according to the first embodiment of the present invention. The information processing apparatus 10 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 as functional components. The information processing apparatus 10 includes an HDD (Hard Disk Drive) 104, a projector 105 as an image projection unit, a communication interface (hereinafter referred to as I / F) 106, an imaging device 107, a system bus 108, and an input unit 120. Have. The CPU 101 performs communication and control with the ROM 102 and the like through the system bus 108.

  The CPU 101 reads and executes programs stored in the ROM 102 and the HDD 104. Thereby, the CPU 101 controls each hardware component. The ROM 102 is a program memory, and stores a control program including various processing procedures to be described later that are executed by the CPU.

  A RAM (Random Access Memory) 103 is a data memory, and includes a work area for a program read by the CPU 101, a data save area for error processing, a load area for the control program, and the like. Note that the program memory may be realized by loading a program into the RAM 103 from an external storage device connected to the information processing apparatus 10 or the like. The HDD 104 is a hard disk for storing a plurality of electronic data and programs according to the present embodiment. An external storage device may be used as the same role.

  Here, the external storage device may include, for example, a medium (recording medium) and an external storage drive for realizing access to the medium. As such media, for example, a flexible disk (FD), a CD-ROM, and a DVD (Digital Versatile Disk) are known. Also known are USB (Universal Serial Bus) memory, MO disk (Magneto-Optical disk), flash memory, and the like. The external storage device may be a server device connected via a network.

  The projector 105 is a device that displays an object imaged by the imaging apparatus 107 and information related to the object. The communication I / F 106 can be connected to another information processing apparatus 10 or an external storage device by a known communication technique in a wired or wireless manner, and can transmit and receive information bidirectionally. In addition to directly communicating with the other information processing apparatus 10, indirect communication using a relay apparatus can also be used. The imaging device 107 is a device for acquiring images and videos.

  FIG. 1B is a block diagram illustrating an example of a functional configuration of the information processing apparatus 10 according to the present embodiment. The information processing apparatus 10 includes an information acquisition instruction unit 109, an object detection unit 110, a related information acquisition unit 111, an imaging unit 112, a projection instruction unit 113, a superimposed image generation unit 114, and a display unit 115. Each of these functional units is realized by the CPU 101 developing a program stored in the ROM 102 in the RAM 103 and executing processing according to each flowchart described later. Hereinafter, each element will be described.

The information acquisition instructing unit 109 issues an instruction to acquire a captured image based on an imaging instruction input from the user input through the input unit 120, or acquires a captured image based on the detection result of the object detection unit 110. Give instructions. The imaging unit 112 controls the imaging device 107 to perform imaging. The object detection unit 110 detects an object from an image captured by the imaging unit 112 through the imaging device 107. An object in imaging may be an object or a special symbol such as an AR (Augmented Reality) marker.
The related information acquisition unit 111 accesses an external server (not shown) via the communication I / F 106 and acquires information related to the object. In addition, when there is a holding unit that holds related information in the information processing apparatus 10, the related information of the object may be acquired directly from the holding unit without using the communication I / F 106.

  The imaging unit 112 performs imaging through the imaging device 107. In this imaging, the object and the periphery of the object are imaged. Hereinafter, unless otherwise specified, the term “around the object” refers to a region within a certain range from the object. Note that the object itself may or may not be included in the “periphery of the object”. The projection instruction unit 113 instructs whether or not to display related information in a region where an image is projected by the projector (hereinafter referred to as a projection region). In this embodiment, the projection instruction unit 113 performs a projection instruction based on a user input for a projection instruction, or performs a projection instruction based on the determination result of the state of the projection region, as will be described later. The superimposed image generation unit 114 generates an image in which the image of the target object and related information are superimposed. The display unit 115 displays related information on the object via the projector 105, and projects the superimposed image generated by the superimposed image generation unit 114 onto the projection plane.

FIG. 2 is a flowchart showing basic processing of the information processing apparatus 10 according to the present embodiment. Unless otherwise specified, in each embodiment, the processing shown in the flowchart and the like is controlled and executed by the CPU 101.
The information acquisition instruction unit 109 instructs the imaging unit 112 to capture an image, and in response to this, the imaging unit 112 captures an image through the imaging device 107 (S201). Hereinafter, an image captured by the imaging unit 112 is referred to as a captured image. The object detection unit 110 detects the object from the captured image (S202). This detection is performed by, for example, image recognition.

  Next, the related information acquisition unit 111 acquires related information for the object detected by the object detection unit 110 (S203). In this embodiment, the related information acquisition unit 111 acquires related information by accessing an external server via the communication I / F 106. The acquired related information is stored in the RAM 103 by the related information acquisition unit 111 (S204). Thereafter, the imaging unit 112 captures an image (S205), captures an area including the object, and stores the image in the RAM 103 (S206).

  The projection instruction unit 113 receives a projection instruction from the user (S207). In response to receiving the projection instruction, the superimposed image generation unit 114 generates a superimposed image in which the image stored in the RAM 103 and the related image generated from the related information are superimposed (S208). The related image may be included in the related information. Alternatively, the related image may be generated by the superimposed image generation unit 114 from data such as text data included in the related information. Next, the display unit 115 projects the superimposed image generated by the superimposed image generation unit 114 (S209), and ends the process.

  In this way, by generating a superimposed image in which an image including the target object and a related image are superimposed, even if the superimposed image is projected to a place away from the target object, the projected related image remains on the target object. It can be easily understood that they are related. Preferably, the object is imaged, and the related information is superimposed on the imaged object, thereby further clarifying that the related information is information regarding the imaged object.

  In the example of FIG. 2, after the image is captured in S201, the image is captured again in S205. However, a related image can be superimposed on the image captured in S201. For example, when the related information is acquired and stored in S203 and 204 in a short time, the image obtained by imaging in S201 substantially matches the image obtained in S205. In this case, without executing S205 and S206, after executing S206 and 207, in S208, the image captured in S201 and the related image are superimposed. Similarly in the following embodiments, S205 and S206 may be omitted as necessary.

FIGS. 3A to 3E are explanatory diagrams showing the relationship between the object and the superimposed image according to the present embodiment. FIG. 3A is an explanatory diagram of a state in which the information processing apparatus 10 is directed toward the object 701. The marker 702 is a marker provided corresponding to the object. The object detection unit 110 acquires related information of the object from the captured image using the marker 702 as a key, that is, in response to the recognition of the marker 702 in the image.
FIG. 3B is an explanatory diagram of a state in which the superimposed image 704 is projected by executing S209 of FIG. When the object 701 is suitable for projection, the projection instruction unit 113 projects onto the object as shown in FIG.

On the other hand, FIG.3 (c) is explanatory drawing when the target object 705 is not suitable for projection. In this figure, the object 705 is not suitable for projection because it is difficult to visually recognize an image projected in black.
FIG. 3D is an explanatory diagram of a state in which a superimposed image is projected by executing S209 of FIG. 2 on a black object 705 that is not suitable for projection. Since the object 705 is black and is not suitable for projection, the related image 707 projected on the object 705 is difficult to visually recognize.
FIG. 3E is an explanatory diagram in the case where there is a region 709 suitable for projection on the right side of the black object. For example, the user moves the information processing apparatus 10 to the right after S209 in FIG. 2 is executed and the superimposed image is projected onto the object as shown in FIG. Turn to. Thereby, the superimposed image 708 can be projected on the area 709 on the right side of the object 705. In the superimposed image 708, the image 708a is an image representing the object 705, and the related image 708b is a related image displayed together with the image 708a. In this example, the superimposed image 708 also includes a marker image 702a generated corresponding to the marker 702. The marker image 702a is an image generated by photographing the marker 702 provided on the object 705.

  As described above, in this embodiment, it is possible to project the image of the target object and the related image of the target object in a superimposed manner. If a related image of an object is simply projected, it may be difficult to determine whether or not the projected related image is related to the object when the related image is projected not around the object but around the object. is there. However, in this embodiment, the related image is superimposed on the image of the object. Therefore, even when the object is away from the place where the object exists, it becomes clear that the related image is associated with the object as shown in FIG. Therefore, the user can easily grasp that the related information is associated with the object.

Second Embodiment
In the second embodiment, an example in which the user instructs image acquisition and projection is shown as a modification of the first embodiment. In this embodiment, the user adjusts the position and orientation of the information processing apparatus 10 and inputs an image acquisition instruction in a state where the information processing apparatus 10 is directed toward the object. Similarly, the user inputs a projection instruction through the input unit 120.
FIG. 4 is a flowchart showing processing when the user instructs image acquisition and projection. Note that the same processes as those in the flowchart of FIG.

First, the input unit 120 determines whether an imaging instruction has been received from the user (S401). When the imaging instruction from the user has not been received (S401: N), the processing of the CPU 101 returns to S401. When the imaging instruction from the user is received (S401: Y), the imaging unit 112 captures an image through the imaging device 107 under the control of the CPU 101, and performs object detection in S202. Thereafter, after executing S203 to S206, the CPU 101 determines whether a projection instruction from the user has been received through the input unit 120 (S402). When the projection instruction from the user is not accepted (S402: N), the CPU 101 executes S402 again. When the projection instruction from the user is received (S402: Y), the process of the CPU 101 proceeds to S208, and the related image is superimposed on the image that is captured after the execution of S401 and the target object is detected, and is obtained in S209. A superimposed image is projected.
The input unit 120 can use any existing input means such as buttons, switches, touch panels, gesture recognition, and voice recognition.

  As described above, in the second embodiment, when the user issues an imaging instruction and a projection instruction, the image can be acquired at a timing at which information can be reliably acquired, that is, the information processing apparatus 10 can capture an object. Can give instructions. In addition, since a projection instruction can be issued with the information processing apparatus 10 facing in a direction suitable for projection, there is an advantage that a user can easily see the projected image.

<Third Embodiment>
In the third embodiment, an example in which an imaging instruction and a projection instruction are automated is shown. A flowchart showing the processing in this case is shown in FIG. In FIG. 5, the same processes as those in the flowchart of FIG.

In FIG. 5, the object detection unit 110 determines whether or not an object has been detected based on the object detection result performed in S202 (S501). When the object is not detected (S501: N), the processing of the CPU 101 returns to S202. When an object is detected (S501: Y), the processing of the CPU 101 proceeds to S203, and related information is acquired. Next, the CPU 101 stores related information in S204.
Thereafter, the CPU 101 captures an image in S205, stores the captured image in S206, and diagnoses the projection area situation (S502).

In this diagnosis, the CPU 101 diagnoses whether or not the projection area satisfies a predetermined condition from the captured image by using the area imaged in S205 as a projection area. For example, it is diagnosed whether the image projected onto the projection area is not sufficiently visible, or whether the area that can be projected in the projection area is narrow enough to display related information. When such a condition is satisfied, the CPU 101 diagnoses that the superimposed image cannot be projected. This is because when such a condition is satisfied, the visibility of the superimposed image cannot be ensured. For example, when the projection area is black or the reflection is strong, it is diagnosed that the projected image is not sufficiently visible. These diagnoses can be realized by existing image recognition (color recognition, area division, etc.) techniques.
In S501, since the process proceeds to S203 and subsequent steps only when the object is detected in S202, the object is included in the captured image in S205 after executing S204.
Therefore, when the projection region status is diagnosed in S502 after sequentially executing S204 to S206, the region including the object becomes the projection region.

Thereafter, the CPU 101 determines whether the projection area is suitable for the projection of the superimposed image and the projection of the superimposed image is possible (S503). If projection is possible (S503: Y), the CPU 101 generates a superimposed image in S208, projects the superimposed image in S209, and ends the process.
On the other hand, if it is determined that projection is not possible (S503: N), the processing of the CPU 101 returns to S205 to perform imaging, and the captured image is stored in S206. Thereafter, the CPU 101 executes S502 again to diagnose the situation of the projection area.

Therefore, after the user moves the information processing apparatus 10 or changes its orientation, the CPU 101 executes the process of S205 after it is determined that projection is not possible in S503. Change from. With respect to the changed image, the processes after S206 are performed. By executing S205 to S503 until it is determined that the projection area can be projected, it is possible to project the superimposed image on the area that can be projected. Therefore, the visibility of the projected superimposed image is ensured. For example, when it is determined in step S503 that projection is not possible because the image projected onto the projection area is not sufficiently visible, or the area that can be projected in the projection area is narrow to display related information. The user moves the information processing apparatus 10. As a result, when it is determined in S503 that the image captured in S205 after moving the information processing apparatus 10 can be projected in S503, a superimposed image is projected onto the projection area in S209.
With such a configuration, it is possible to automate the image acquisition instruction and the projection instruction, and it is possible to save the user from inputting the instruction.

<Fourth embodiment>
In the fourth embodiment, as a modified example of the third embodiment, when a superimposed image is projected, if the related information can be projected on the object, the projection is performed. A superimposed image is projected around the object. FIG. 6 shows a flowchart in the case where the related information is projected onto the object or the superimposed image is projected onto a place other than the object in the fourth embodiment. In FIG. 6, the same processes as those in the flowchart of FIG.
In FIG. 6, after executing S202 to S204, the CPU 101 determines the projection area status for the object detected in S202 (S601).

  Thereafter, the CPU 101 determines whether the projection area is suitable for displaying related information and the related information can be projected (S602). When the determination result of the projection area determination unit can be projected (S602: Y), the CPU 101 projects the related information stored in the related information acquisition unit 111 onto the object through the display unit 115 (S603), and performs processing. finish.

On the other hand, when the determination result of the projection area determination unit is not projectable (S602: N), the CPU 101 performs imaging again in S205. Thereafter, the CPU 101 stores the captured image in S206, and generates a superimposed image in S208. Further, the CPU 101 executes S502 to diagnose the projection region status, and determines in S503 whether the projection region is suitable for projecting the superimposed image and can be projected. If the projection is possible (S503: Y), the CPU 101 projects the superimposed image on the projection area (S209) and ends the process. If projection is not possible (S503: N), the CPU 101 changes the imaging area (S604) and executes S205 again. This change of the imaging area is performed by the user moving the information processing apparatus 10 or the like. Further, when the information processing apparatus 10 is provided with a mechanism for changing the orientation of the imaging apparatus, the CPU 101 may change the imaging area by controlling the changing mechanism.
If the object is not projectable, S604 to S503 are repeated until it is determined that the imaging region can be projected.
If the determination result in S503 is N, the superimposed image creation process in S208 is repeated a plurality of times. However, as described above, in this embodiment, since the related image is superimposed on the image including the object captured after S501, the superimposed image in S208 only needs to be executed once. It is not necessary to repeatedly create a superimposed image after the first time. The same applies to the following embodiments. If it is determined that the imaging region becomes a peripheral region of the target object and can be projected, the CPU 101 projects the superimposed image in S209 and ends the process.
As described above, when the CPU 101 controls the orientation change mechanism of the imaging device, the orientation of the projector needs to be changed according to the orientation of the imaging device. In this case, the projector is provided with a projection direction changing mechanism. The CPU 101 controls the projection direction changing mechanism according to the change in the orientation of the imaging apparatus, and controls the projection direction by the projector.

  As described above, in this embodiment, the information processing apparatus 10 projects the related information directly on the object when the superimposed image can be projected on the object under the control of the CPU 101. On the other hand, when the superimposed image cannot be projected on the target object, it is possible to project the peripheral image and related information on another place in a superimposed manner. Therefore, in any case, the user can intuitively grasp the related information of the object.

<Fifth Embodiment>
The fifth embodiment shows an example of processing when a plurality of objects are included in a captured image as a modification of the fourth embodiment.
FIG. 7 is a flowchart showing processing when a plurality of objects are included in a captured image. In FIG. 7, the same processes as those in the flowchart of FIG. The flowchart of FIG. 7 shows a process for displaying the related information of the detected target object while moving the information processing apparatus 10 toward the area where the user can project. In this process, when a plurality of objects are detected at a time, the related information of each of the detected objects is displayed.

  In this embodiment, after at least one object is detected and it is determined in S503 that there is no area suitable for projection, an operation for directing the information processing apparatus 10 to an area that can be projected is performed. Hereinafter, description will be made assuming that this operation is performed by the user. However, a direction adjustment device for changing the orientation of the imaging unit 112 may be provided in the information processing apparatus 10, and the direction adjustment device may be controlled by the CPU 101 so that the imaging unit 112 is directed to a projectable region.

As shown in FIG. 7, in the fifth embodiment, similar to the processing in the fourth embodiment shown in FIG. 6, the processing from S202 to S206 is executed, and the captured image is stored (S206) and then superimposed. An image is generated (S701). In this embodiment, as will be described later, the imaging processing in S205 may be executed a plurality of times, and a plurality of images may be stored in the RAM 103.
In S701, when a plurality of images are stored in the RAM 103, at least two images may be combined into one image like a panoramic image. Thereby, even when there are a plurality of objects and only a part of the objects can be imaged by one imaging, it is possible to generate a combined image including a plurality of objects, preferably all the objects. A superimposed image in which related images are superimposed on a plurality of objects in the combined image can be generated and projected. Note that image combination can be realized by existing image processing. Further, the related information may be superimposed on the peripheral image and then combined, or the related information may be superimposed after the peripheral image is combined.

After executing S701, the CPU 101 diagnoses whether the projection area is suitable for the projection of the superimposed image (S502), and determines whether the projection of the superimposed image is possible (S503). In this embodiment, when a plurality of objects are detected, it is determined that the projection area is suitable for projection only when all the objects are suitable for projection. If at least one of the detected objects is not suitable for projection, it is determined that the projection area is not suitable for projection.
If it is determined in S503 that the object is suitable for projection (S503: Y), the CPU 101 projects a superimposed image (S209) and ends the process.

On the other hand, when the superimposed image cannot be projected onto the projection area (S503: N), the object detection unit 110 performs an object detection process (S702), and determines whether or not the object is detected (S703). ). When the object is not detected (S703: N), the process of the CPU 101 returns to S502.
When the target object detection unit 110 detects a target object (S703: Y), the CPU 101 acquires related information of the target object detected by the target object detection unit 110 through the related information acquisition unit 111 (S704). Thereafter, the related information acquisition unit 111 stores the acquired related information in the RAM 103 (S705), the processing of the CPU 101 executes S205 and S206, and further executes the above-described processing after S701.

  Note that in the process of determining whether or not projection is possible in S503, when an object whose periphery is suitable for projection and an object whose periphery is not suitable for projection are mixed, only the object suitable for projection is related. Information may be projected around the object. Moreover, when projecting after the information processing apparatus 10 is moved, information on the object may be projected together. Even in this case, the determination result of S503 is N, and the process of the CPU 101 proceeds to S702.

Next, an explanatory diagram of a projected image in the fifth embodiment is shown in FIGS. In FIG. 8A, each of the regions 801 to 806 indicates an object. Of these regions, regions 801, 803, and 805 are objects whose surfaces are black and are not suitable for projection. Regions 802, 804, and 806 indicate objects whose surfaces are white and suitable for projection.
The projection area 808 includes the entire areas 801 and 804, and part of the areas 802 and 805. As described above, since the region 801 is not suitable for projection, it is not projected at this stage. Note that the user can move the information processing apparatus 10 in an arbitrary direction.

  In this embodiment, the information processing apparatus 10 is moved so that all projection objects are within the projection area. Accordingly, the user moves the information processing apparatus 10 from the left to the right, and in the process, portions of the regions 802 and 805 that are outside the projection region in FIG. 8A enter the projection region. Further, the regions 803 and 806 are entirely within the projection region. As a result, in S205, the peripheral image is captured a plurality of times, and the regions 801 to 806 are all included in the peripheral image in the process. Therefore, an image including the regions 801 to 806 can be obtained by combining the peripheral images.

  The RAM 103 stores the peripheral image and related information of the objects 801 to 806 captured during the movement by moving the information processing apparatus 10 to the right side of the objects 801 to 806. As shown in FIG. 8B, the superimposed image generation unit 114 generates an image 810 in which these images are superimposed in S701 of FIG. 7 and projects the image on a region 809 suitable for projection. In the example of FIG. 8B, the region 809 suitable for projection is located on the right side of the regions 801 to 806. Note that the area suitable for projection is not limited to the right of the areas 801 to 806. For example, it may be below the regions 801 to 806. In this case, the region 809 suitable for projection is below the regions 801 to 806 in FIG.

As described above, in this embodiment, even when a plurality of objects are detected and these objects do not fit within one projection area, a combined image including these objects can be obtained. In addition, related information can be superimposed on the obtained combined image.
When a plurality of objects are detected, it is not convenient for the user to project the superimposed image individually for the detected objects, and it takes a long time to project the images individually. However, in this embodiment, since a plurality of objects are displayed as a single image by the combined image, the convenience for the user is improved and the time required for projection can be shortened.
Furthermore, since objects suitable for projection can be projected together, there is an advantage that the positional relationship between the objects can be easily reproduced, and the user can easily grasp the correspondence between a plurality of objects and related information. .

  As the information processing apparatus 10 according to the present embodiment, an arbitrary apparatus that includes an imaging device and a projection device such as a projector and performs information processing can be used. For example, any information processing apparatus such as a smartphone equipped with a camera and a projector can be used as the information processing apparatus 10. Further, the information processing apparatus 10 does not necessarily include an imaging device and a projection device. For example, the information processing apparatus, the imaging apparatus, and the projection apparatus may be connected by wire or wireless to control the timing of imaging and projection and the projection direction of the projection apparatus.

  Although the embodiment according to the present invention has been described above, the information processing apparatus according to the present invention is not limited to the above embodiments. For example, the information processing apparatus according to the present invention can be realized by a computer program that operates on a general-purpose information processing apparatus such as a normal personal computer. In addition, the above-described computer program can be supplied to a system or apparatus via a network or a computer-readable recording medium, and one or more processors in the computer of the system or apparatus can read and execute the program. is there. Further, it can be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (12)

An imaging means for imaging an object;
Image projection means;
Control means for acquiring related information related to the object using a captured image including the object captured by the imaging means, and generating a related image generated from the related information;
The control means generates a superimposed image in which the related image is superimposed on a captured image including the object,
The image projecting unit projects the generated superimposed image,
Information processing device. The object includes a marker corresponding to the object,
The control means generates a related image including information related to the object with reference to the marker in the captured image,
The information processing apparatus according to claim 1. A first input unit for inputting an imaging instruction of an object from a user;
The imaging means performs imaging of the object in response to an input of an imaging instruction from the first input unit.
The information processing apparatus according to claim 1 or 2. A second input unit for inputting a projection instruction of the superimposed image from a user;
The image projecting unit projects the superimposed image in response to an input of an imaging instruction from the second input unit.
The information processing apparatus according to any one of claims 1 to 3. The control means determines whether or not an object is included in the captured image, and acquires the related information when included in the captured image.
The information processing apparatus according to any one of claims 1 to 4. The control means determines whether or not the object is suitable for projection of the superimposed image from the captured image when the captured image includes the object, and if so, the image Projecting the superimposed image onto the object through projection means,
The information processing apparatus according to claim 5. The control means performs the determination on each target object when the captured image includes a plurality of the target objects, and determines that at least one of the target objects is not suitable for projection when the superimposition is performed. The image is not projected,
The information processing apparatus according to claim 6. After determining that the object is not suitable for projection, the control unit performs imaging by the imaging unit and determination of whether an area captured by the imaging unit is suitable for projection of the superimposed image. And repeatedly projecting the superimposed image through the image projecting means after determining that the object is suitable for projection, until it is determined that the region is suitable for projection of the superimposed image. ,
The information processing apparatus according to claim 7. The control unit performs imaging a plurality of times through the imaging unit to obtain a plurality of captured images, generates a combined image obtained by combining at least two of the obtained captured images, and adds the related image to the combined image. Generating a superimposed image on which is superimposed,
The information processing apparatus according to any one of claims 1 to 8. An image capturing unit configured to image an object; and an image projecting unit. The related information related to the object is acquired using a captured image captured by the image capturing unit and including the object. A method executed by an information processing apparatus that generates a related image generated from
The information processing apparatus generates a superimposed image in which the related image is superimposed on a captured image including the object, and the image projecting unit projects the generated superimposed image.
Information processing method. A computer comprising imaging means for imaging an object and image projection means,
The related information related to the target object is acquired using the captured image including the target object captured by the imaging unit to generate the related image generated from the related information, and the target object is included. A superimposed image in which the related image is superimposed on a captured image is generated, and the generated superimposed image is
A computer program for functioning as control means for projecting through the image projecting means. A computer program according to claim 11 is stored,
Computer-readable recording medium.