JP2013073386A - Image projecting apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To directly give a user additional information by an expanding real technique more realistic, without limiting, for example, a place where the apparatus is used.SOLUTION: The image projector comprises: a GPS antenna 121 and a GPS receiver 118 that obtain information about the current position where the apparatus 100 is present; a WAN interface 102 and a WAN antenna 101 that transmit a request signal for an image (object information) based on the obtained current position information and receive an image signal corresponding to the transmitted request signal; and projection systems (103 to 107) that form an optical system corresponding to the received image signal and project it to outside.

Description

  The present invention relates to an image projection apparatus having a lighting function.

  Conventionally, in order to realize smooth communication between a patient and a medical staff, a technique has been considered that uses an AR (Augmented Reality) system to project in-vivo information onto the patient's body surface following the movement of the patient. . (For example, Patent Document 1)

JP 2007-151686 A

  The technique of the above-mentioned patent document is a 3DCG model of in-vivo information by estimating the position of a patient body surface as a projection target by detecting the position and orientation of a thermal marker having a predetermined shape from a captured infrared image. Is projected onto the patient's surface. For this reason, the camera and projector are fixedly installed within a range suitable for imaging and projection, and a thermal marker with a predetermined orientation is attached to a predetermined position of the patient. It can be realized only under the environment.

  Aside from this, using smartphones that have recently become popular, and using AR technology to display the scene in front of the screen with a camera, additional information related to the location and object, such as buildings and signs, etc. Software called “Sekai Camera (registered trademark)” that displays or reproduces (characters, images, sounds) in a superimposed manner is known. In this type of augmented reality software, augmented reality information is displayed on the screen of a smartphone on which the software is installed.

  Therefore, the user who uses the software looks at the “real reality in the screen” on which the “additional information” is displayed and compares it with the “real reality” that is the actual scenery that can be seen. The object pointed to by “information” is recognized by the human eye. In this way, despite the name “augmented reality”, there is a problem that only information with poor reality can be given.

  The present invention has been made in view of the above-described circumstances, and the object of the present invention is to directly provide additional information to augmented reality technology to a user without limiting the place of use or the like. An object of the present invention is to provide an image projection apparatus capable of performing the above.

  One aspect of the present invention is a projection apparatus that projects a light image onto an object, the position information acquiring unit acquiring position related information related to the position where the object exists, and the position information acquiring unit. Object information acquisition means for acquiring object information based on the position-related information, and projection means for forming an optical image corresponding to the object information acquired by the object information acquisition means and projecting it to the outside It is characterized by comprising.

  According to the present invention, it is possible to directly give additional information to the user by using augmented reality technology that is more realistic without limiting the place of use.

The block diagram which shows the function circuit structure of the flashlight type projector apparatus which concerns on one Embodiment of this invention. 6 is a flowchart showing processing details of a basic projection operation according to the embodiment. The figure explaining the 1st usage example which concerns on the same embodiment. The figure explaining the 2nd usage example which concerns on the same embodiment. The figure explaining the 3rd usage example which concerns on the same embodiment. The figure explaining the 4th usage example which concerns on the same embodiment. The figure explaining the 5th usage example which concerns on the embodiment.

  Hereinafter, an embodiment in which the present invention is applied to a flashlight projector adopting a DLP (Digital Light Processing) (registered trademark) system will be described with reference to the drawings.

  FIG. 1 is a diagram for explaining a functional configuration of mainly an electronic circuit of the flashlight projector 100 according to the present embodiment. In the figure, a WAN interface (I / F) 102 receives information data (object information) from an information server (not shown) via a WAN (Wide Area Network) antenna 101.

  The WAN interface 102 is an interface circuit compliant with, for example, mobile WiMAX (World wide interoperability for Microwave Access) conforming to the IEEE 802.16e standard, and transmits and receives wireless data through the WAN antenna 101 under the control of the CPU 113 described later. Control.

  Here, a case where the information data is an image (information image) will be described first.

  The received information data (information image data) is sent to the projection image driving unit 103 via the system bus SB. The projection image driving unit 103 multiplies a frame rate according to a predetermined format, for example, 60 [frames / second], the number of color component divisions, and the number of display gradations according to the transmitted image data. The micromirror element 104 is driven to display by faster time-division driving.

  The micromirror element 14 performs a display operation by individually turning on / off each inclination angle of a plurality of micromirrors arranged in an array, for example, WXGA (horizontal 1280 pixels × vertical 768 pixels) at high speed. Then, an optical image is formed by the reflected light.

  On the other hand, R, G, B primary color lights are emitted cyclically from the light source unit 105 in a time-sharing manner. The primary color light from the light source unit 105 is totally reflected by the mirror 106 and applied to the micromirror element 104.

  Then, an optical image is formed by the reflected light from the micromirror element 104, and the formed optical image is projected to the outside via the projection lens unit 107 and displayed.

  The projection lens unit 107 includes a focus lens for moving a focus position and a zoom lens for changing a zoom (projection) angle of view in an internal lens optical system.

  The photographing lens unit 108 is disposed so as to be adjacent to the projection lens unit 107. An external optical image that enters the photographing lens unit 108 is formed on a CMOS image sensor 109 that is a solid-state imaging device.

  The taking lens unit 108 includes, for example, a lens group that includes a focus lens that moves in the optical axis direction and has a slightly larger taking field angle in consideration of both parallaxes in accordance with the maximum zoom field angle of the projection lens unit 107. It shall consist of

  An image signal obtained by imaging with the CMOS image sensor 109 is digitized by the A / D converter 110 and then sent to the imaging control unit 111.

  The photographing control unit 111 drives the motor (M) 112 by, for example, a contrast AF (automatic focusing) function, and moves the position of the focus lens in the photographing lens unit 108 to the in-focus position. The distance to the subject image to be imaged can be acquired from the position of the focus lens obtained by this AF operation.

  In addition, the imaging control unit 111 scans the CMOS image sensor 109 to execute an imaging operation, and performs image processing such as contour extraction of image data obtained by imaging, thereby projecting an image as described later. Extract suitable areas.

  The CPU 113 controls all the operations of the above circuits. The CPU 113 is directly connected to the main memory 114 and the program memory 115. The main memory 114 is configured by an SRAM, for example, and functions as a work memory for the CPU 113. The program memory 115 is composed of an electrically rewritable nonvolatile memory such as a flash ROM, and stores an operation program executed by the CPU 113, various fixed data, and the like.

  The CPU 113 controls the flashlight projector 100 by reading out the operation program, standard data, and the like stored in the program memory 115, developing and storing them in the main memory 114, and executing the program. And control.

The CPU 113 executes various projection operations in response to key operation signals from the key operation unit 116.
The key operation unit 116 includes a power key for turning on / off the power of the flashlight projector 100 and a mode key for switching between an illumination mode and an AR mode, which will be described later. The key operation unit 116 outputs signals based on those key operations to the key operation unit 116.

The CPU 113 is further connected to a motor (M) 117, a GPS (Global Positioning System) receiver 118, a triaxial acceleration sensor 119, and a geomagnetic sensor 120 via the system bus SB.
The motor 117 moves the positions of the focus lens and zoom lens of the projection lens unit 107.

  The GPS receiver 118 receives incoming radio waves from GPS satellites (not shown) via the GPS antenna 121 and analyzes them to accurately detect the current position in the three-dimensional space, that is, latitude, longitude, and altitude information. Current time information is calculated.

  The triaxial acceleration sensor 119 detects each acceleration in the triaxial directions orthogonal to each other. The CPU 113 determines the current posture angle of the flashlight projector 100, specifically the projection optical axis of the projection lens unit 107 and the photographing lens unit 108, from the gravitational acceleration included in the detection output of the three-axis acceleration sensor 119. A user who possesses the flashlight projector 100 by calculating an elevation angle / an depression angle of the photographing optical axis and a rotation angle indicating how much the projection optical axis and the photographing optical axis are rotated with respect to a plane orthogonal to each other. In contrast, it is possible to project an image with the correct top and bottom direction.

  The geomagnetic sensor 120 is composed of a high-sensitivity micromagnetic sensor that realizes a magnetic impedance effect, which is prominent in a high-permeability alloy magnetic material such as a cylindrical zero-magnetostrictive amorphous alloy wire, with a CMOS electronic circuit. Function as.

Next, the operation of the above embodiment will be described.
The operation shown below is executed after the CPU 113 expands the operation program read from the program memory 115 and the standard data in the main memory 114 as described above. The operation program and the like stored in the program memory 115 are not only those stored in the program memory 115 when the flashlight projector 100 is shipped from the factory, but also after the user purchases the flashlight projector 100 and the WAN antenna 101 and It includes contents installed by a version upgrade program downloaded via the WAN interface 102.

  Also, in this operation, as a server device that can be connected to the flashlight projector 100 by wireless WAN technology, an information image is requested by attaching necessary various information including the current position. It is assumed that a connection environment to an information server that selects and sends back an information image as target object information is set in advance.

  FIG. 2 is a flowchart showing the processing contents of basic projection operations in the illumination mode and AR (augmented reality) mode, which are executed after the power is turned on by the power key of the key operation unit 116. At the beginning of the process, the CPU 113 determines whether or not the mode key of the key operation unit 116 has been operated to the position of the illumination mode (step S101).

  If it is determined that the illumination mode has been operated, the CPU 113 displays the R, G, and B primary color lights from the D / A converter 15 displayed on the micromirror element 104 by the projection image driving unit 103. As a corresponding image, an image in which all the pixels are always on (reflection direction to the projection lens unit 107) is displayed during the display period. As a result, all the R, G, and B color images are all in full gradation. Thus, an image that is entirely white due to the mixed color is projected (step S102).

  At the same time, the CPU 113 causes the motor 117 to move the zoom lens of the projection lens unit 107 to a position where the projection angle of view is the narrowest, and the focus lens of the projection lens unit 107 is a position where the in-focus position is at infinity. By moving to, it is possible to realize irradiation light as spot light having as sharp a luminous flux as possible.

  Thereafter, the CPU 113 determines whether or not the illumination mode has been canceled by operating the mode key by an input from the key operation unit 116 (step S103).

  If it is determined that the mode key has not been operated and the illumination mode has not been released, the CPU 113 returns to the process from step S102 again and repeats the operation in the illumination mode described above.

  If it is determined in step S101 that the mode key of the key operation unit 116 is not in the position of the illumination mode, or if it is determined in step S103 that the mode key has been operated and the illumination mode has been canceled, the CPU 113 re-enters AR. In order to start the operation in the mode, first, information on the current position is acquired from the GPS receiver 118 (step S104).

  Next, the CPU 113 acquires azimuth information in the direction in which the projection optical axis of the projection lens unit 107 and the imaging optical axis of the imaging lens unit 108 are directed from the geomagnetic sensor 120 constituting the electronic compass (step S105).

  Further, the CPU 113 obtains the angle information of the elevation angle or the depression angle from the angle between the projection optical axis of the projection lens unit 107 and the imaging optical axis of the imaging lens unit 108 in the horizontal direction based on the detection output of the triaxial acceleration sensor 119 of the flashlight projector 100. Obtained as information representing the posture (step S106).

  Based on these pieces of acquired information, the CPU 113 determines the position in the three-dimensional space where the flashlight projector 100 exists, the direction in which the projection optical axis of the projection lens unit 107 and the imaging optical axis of the imaging lens unit 108 are directed. And posture (vertical angle).

  Next, the CPU 113 executes shooting processing including AF processing (multi-point distance measurement) for almost the entire shooting range by the shooting control unit 111 (step S107), and the motor 112 is driven in a focused state by the AF processing. For example, distance information from the position of the focus lens in the photographing lens unit 108 to the center position of the photographing range is acquired (step S108).

  The CPU 113 adds the acquired current position, orientation, current time, distance to the subject, and the like to the information server described above, and returns information image data together with the terminal ID information of the flashlight projector 100. Therefore, a request is transmitted via the WAN interface 102 and the WAN antenna 101 (step S109).

  On the other hand, when information image data is sent from the information server, the CPU 113 receives it (step S110). At this time, the CPU 113 performs image processing such as contour extraction on the image of the subject obtained in the previous step S107, and projects an image within a predetermined distance range including the center of the shooting range. An area that can be determined to be available is extracted (step S111).

  Next, the CPU 113 optimizes the data of the information image received in step S110 according to the extracted range by appropriately combining expansion or reduction and deformation (step S112). The CPU 113 displays an image of each primary color based on the optimized image data on the micromirror element 104 and simultaneously emits each primary color light by the light source unit 105, thereby forming a color light image based on the information image. Then, projection is performed by the projection lens unit 107 (step S113).

  At this time, the CPU 113 moves the position of the focus lens of the projection lens unit 107 by the motor 117 based on the distance value to the subject acquired in the immediately preceding step S108, and controls the projection image to be in focus.

  When a series of projection processes are executed in this way, the CPU 113 determines whether or not the AR mode has been canceled by operating the mode key in response to an input from the key operation unit 116 (step S114).

  If it is determined that the mode key has not been operated and the AR mode has not been released, the CPU 113 returns to the process from step S104 again and repeats the above-described operation in the AR mode.

  If it is determined in step S114 that the mode key has been operated and the AR mode has been canceled, the CPU 113 shifts again to the operation in the illumination mode from step S102.

The above is the basic processing flow of this embodiment.
Next, a specific use example in the above-described AR mode will be described.
FIG. 3 shows a first usage example. In the drawing, the ground is illuminated by the flashlight projector 100 and information images I11 to I13 are projected onto the ground in the traveling direction. Information image data provided from an information server (not shown) includes, for example, landmarks and various facilities ahead of the traveling direction, such as the name of the nearest railway station and the distance to the station, the timetable corresponding to the station, The time of a train coming to or event information of various facilities can be considered.

  FIG. 4 shows a second usage example. In the figure, the ground is illuminated by the flashlight projector 100 possessed by the user US, and the information images I21 to I23 are projected onto the ground in the traveling direction. At this time, as information image data given from an information server (not shown), for example, guidance information related to the store H21 or the building B22 ahead in the traveling direction can be considered.

  As described above, the flashlight projector 100 calculates the current position information in the three-dimensional space and the accurate current time information via the GPS antenna 121 and transmits them to an information server (not shown). An information image (object information) corresponding to the time can be provided to the user US.

  FIG. 5 shows a third usage example. In the same figure, the flashlight projector 100 possessed by the user US illuminates the wall surface of the building B31, and it is assumed that the building B31 located at the illuminating place is a restaurant building. The state which projects information images I31-I33, such as an advertisement and a discount coupon of a store, is illustrated.

  The flashlight projector 100 acquires distance information from the object illuminated by the user US to the user US by the shooting control unit 111, and uses this distance information and the current position information of the user US obtained by the GPS antenna 121. It transmits to the information server which is not illustrated. Therefore, since the position information of the object such as the building B31 illuminated by the user US can be obtained by adding the distance information to the current position information of the user US, the building B31 is accurately identified. An information image (object information) of the building B31 can be provided to the user US.

  FIG. 6 shows a fourth usage example. In the figure, the flashlight type projector 100 possessed by the user US illuminates the inner wall surface of the tent T41, and there are mountains or the like that are beyond the illuminating direction and are not actually visible due to the weather or time. The state where information images I41 and I42 such as landscape are projected is illustrated. The information images I41 and I42 may include such landscape images themselves and text information such as commentary.

  FIG. 7 shows a fifth usage example. In the same figure, the flashlight projector 100 possessed by the user US illuminates the inner wall surface in the zenith direction of the tent T51, and the weather and the time information based on the current position information and time information ahead of the illuminating direction. An example of a state in which an information image I51 of a starfish sky that can be seen if the atmospheric state is good is projected. The information image I51 includes an image of a low-grade star that is difficult to see with the naked eye, regardless of how the atmospheric condition is originally good, or an image that includes auxiliary lines or character information for representing a constellation. Also good.

  In the above-described embodiment, the example in which the information image data is directly received as the information data from the information server has been described. However, the object image is received as the information data from the information server, and the projected image itself is stored in the flashlight projector 100. Alternatively, the CPU 113 may be used. That is, the object information received from the information server is not limited to image data.

  In the above embodiment, the object information is acquired as information data from the information server. However, the flashlight projector 100 has a simple database so that the object information based on the position related information is obtained. You may make it acquire. The database is preferably stored in a medium such as a memory card so that it can be updated to the latest one at any time.

  In the above embodiment, the example in which the distance to the object is acquired by the AF (automatic focusing) function of the imaging control unit 111 has been described. However, a distance sensor (for example, a laser distance measuring device) is provided separately to the object. The distance may be acquired.

  As described above in detail, according to the present embodiment, it is possible to directly give additional information to the user by using augmented reality technology that is more realistic without limiting the place of use.

  Further, in the above-described embodiment, by detecting the current position and the direction in which the projection lens unit is currently facing, a more appropriate information image can be selected, and unnecessary information is given to the user. The fear can be greatly reduced.

  Furthermore, in the above-described embodiment, by detecting the attitude angle of the flashlight projector at that time by the three-axis acceleration sensor, an appropriate angle can be determined from the vertical direction toward which the projection lens unit faces and the rotation angle along the projection optical axis. The projection content can be selected and the information image can be projected at an angle that is easy to see for the user.

  In addition, in the embodiment described above, a distance acquisition function such as a camera having an AF function is incorporated, and the distance to the projection target surface (object) is acquired, and the projection image is accurately focused according to the distance value. In addition, since the calculation of the accurate position of the projection target is taken into account, more accurate position information of the object to be projected can be acquired.

  Although not described in the above embodiment, the projection angle of view may be variably set by controlling the zoom lens position of the projection lens unit 107 in conjunction with the distance to the projection target.

  For example, when the projection distance is the shortest focusing distance of the projection lens unit 107, the projection angle of view is maximized, and when the projection distance exceeds 10 [m] and reaches infinity, the projected image is displayed. The projection angle of view is changed stepwise so that the angle is minimized and the projection distance between them changes stepwise.

  In this way, by changing the projection angle of view according to the distance, it is possible to effectively use the amount of light emitted from the light source unit 105, and to project a bright and easy-to-view information image.

  In addition, since it has a built-in multi-point distance measurement function such as a camera with an AF function, it can measure multiple points and detect how much the projection target surface is tilted with respect to the optical axis direction of the projection lens unit. A configuration in which (calculation) and trapezoidal correction of the projection image based on the tilt angle may be employed. With such a configuration, it is possible to project an information image that is easy for the user to see even if the information image is projected while being tilted with respect to the projection target surface.

  Furthermore, in the above-described embodiment, it is possible to switch between the illumination mode for projecting a white image and the AR mode for projecting the information image by operating the mode key of the key operation unit 116. The user can easily switch the method of using the flashlight projector 100.

  In the above embodiment, the case where the present invention is applied to a flashlight projector adopting the DLP (registered trademark) system has been described. However, the present invention does not limit the projection system, the apparatus, and the like. The present invention can be similarly applied to devices such as a smart phone and a mobile phone terminal incorporating the above projection unit.

  In the above embodiment, the request is transmitted to the information server via the WAN interface 102 and the WAN antenna 101 with the current position, orientation, current time, distance to the subject, and the like added. The controller 111 may read an identifier, such as a barcode or a two-dimensional code, and transmit the read information to the information server.

  In this case, an image such as a barcode may be transmitted as it is, or decoded information may be transmitted. With this configuration, for example, a PDA (Personal Digital Assistant) used for inventory management or the like in a warehouse or the like can be used.

  Conventional PDAs read only a barcode and provide only information that can be read from the barcode. In addition, information on objects such as luggage and products is obtained by confirming a display screen mounted on the PDA. However, since location information is also used if this embodiment is used, packages are not arranged at one location for each type, but packages of the same type with different manufacturing dates, shipping dates, etc. are arranged in various shelves Even if the package information is registered in the information server for each date of manufacture or shipment, the information on the package can be obtained accurately from the illuminated package position information and barcode information. Not only can the information of the object be directly projected onto the object as image information, and there is no need to check the display screen (moving the line of sight) one by one, so the efficiency of the collection work can be improved. .

  In the above-described embodiment, the example of the portable type (flashlight type projector) has been described as the projection apparatus. However, the present invention can be applied to a larger projection apparatus that projects information on a surrounding building wall surface, for example, for an event. it can.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the embodiment, if an effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
The invention described in claim 1 is a projection device that projects a light image onto an object, and includes position information acquisition means for acquiring position related information related to a position where the object exists, and the position information acquisition means. Object information acquisition means for acquiring object information based on the acquired position-related information, and projection means for forming an optical image corresponding to the object information acquired by the object information acquisition means and projecting it to the outside It was characterized by comprising.

  According to a second aspect of the present invention, in the first aspect of the invention, a transmission unit that transmits a signal requesting the object information based on the position related information acquired by the position information acquisition unit, and the transmission unit Receiving means for receiving the object information signal transmitted in response to the request signal transmitted in step, wherein the object information acquiring means uses the object information signal acquired by the receiving means to receive the object information signal. It is characterized by acquiring information.

  The invention according to claim 3 further comprises photographing means for photographing the direction projected by the projecting means in the invention according to claim 1 or 2, wherein the object information acquiring means includes the position related information, The object information is obtained based on information photographed by the photographing means.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the position information acquisition means determines a position in a three-dimensional space where the apparatus exists and a direction in which the projection means projects an image. It is acquired as the position related information.

  According to a fifth aspect of the present invention, in the invention according to any one of the first to fourth aspects, the position information acquiring unit acquires an attitude angle of the apparatus as the position related information.

  The invention described in claim 6 is the invention described in claim 5, wherein the projection means controls the direction of the optical image to be projected based on the attitude angle of the apparatus acquired by the position information acquisition means. .

  The invention according to claim 7 is the invention according to any one of claims 1 to 6, further comprising distance acquisition means for acquiring a distance to an object in a direction in which the projection means projects an image, The information acquisition means acquires the distance information acquired by the distance acquisition means as the position related information.

  The invention described in claim 8 is the invention described in claim 7, further comprising projection control means for changing the angle of view of the image projected by the projection means according to the distance information acquired by the distance acquisition means. It is characterized by that.

  According to a ninth aspect of the invention, in the seventh or eighth aspect of the invention, trapezoidal correction is performed based on the tilt angle of the projection target surface calculated from the distances to a plurality of points acquired by the distance acquisition means. Then, an optical image is formed and projected to the outside.

  The invention according to claim 10 is the invention according to any one of claims 1 to 9, wherein the projection mode is used to project an entirely white image, and the object acquired by the object information acquisition unit. It further comprises mode control means for switching between information projection modes for projecting light images according to information.

  DESCRIPTION OF SYMBOLS 100 ... Flashlight type projector, 101 ... WAN antenna, 102 ... WAN interface (I / F), 103 ... Projection image drive part, 104 ... Micromirror element, 105 ... Light source part, 106 ... Mirror, 107 ... Projection lens part, DESCRIPTION OF SYMBOLS 108 ... Shooting lens part, 109 ... CMOS image sensor, 110 ... A / D converter, 111 ... Shooting control part, 112 ... Motor (M), 113 ... CPU, 114 ... Main memory, 115 ... Program memory, 116 ... Key Operation unit, 117 ... motor (M), 118 ... GPS receiver, 119 ... 3-axis acceleration sensor, 120 ... geomagnetic sensor, 121 ... GPS antenna, B21, B31 ... building, H21 ... store, I11-I13, I21-I23, I31 to I33, I41, I42, T51 ... Information image, SB ... System bus T41, T51 ... tent, US ... user.

Claims (10)

A projection device that projects a light image onto an object,
Position information acquisition means for acquiring position related information related to the position where the object exists;
Object information acquisition means for acquiring object information based on the position related information acquired by the position information acquisition means;
An image projecting apparatus comprising: a projecting unit that forms an optical image according to the object information acquired by the object information acquiring unit and projects the light image to the outside. Transmitting means for transmitting a signal requesting the object information based on the position related information acquired by the position information acquiring means;
Receiving means for receiving the object information signal transmitted in response to the request signal transmitted by the transmitting means;
The image projection apparatus according to claim 1, wherein the object information acquisition unit acquires the object information based on the object information signal acquired by the reception unit. And further comprising a photographing means for photographing the direction projected by the projection means,
The image projection apparatus according to claim 1, wherein the object information acquisition unit acquires the object information based on information captured by the imaging unit together with the position related information.   The position information acquisition unit acquires the position in a three-dimensional space where the apparatus exists and the direction in which the projection unit projects an image as the position related information. Image projection device.   The image projection apparatus according to claim 1, wherein the position information acquisition unit acquires an attitude angle of the apparatus as the position related information.   6. The image projection apparatus according to claim 5, wherein the projection unit controls the direction of the optical image to be projected based on the attitude angle of the apparatus acquired by the position information acquisition unit. The projection means further comprises distance acquisition means for acquiring a distance to the object in the direction in which the image is projected,
The image projection apparatus according to claim 1, wherein the position information acquisition unit acquires the distance information acquired by the distance acquisition unit as the position related information.   8. The image projection apparatus according to claim 7, further comprising a projection control unit that changes an angle of view of an image projected by the projection unit according to the distance information acquired by the distance acquisition unit.   The optical image is formed and projected to the outside after performing keystone correction based on the tilt angle of the projection target surface calculated by the distance to a plurality of points acquired by the distance acquisition means. Item 9. The image projection device according to Item 7 or 8.   It further comprises mode control means for switching between an illumination mode for projecting a white image on the whole surface using the projection means and an information projection mode for projecting a light image corresponding to the object information acquired by the object information acquisition means. The image projection apparatus according to claim 1, wherein the image projection apparatus is an image projection apparatus.

Images