JP2015111772A - Projection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection device that allows a user to naturally recognize the presence of a projection unit that projects an image onto a specific object upon detection of a specific portion of the body of the user.SOLUTION: A projection device (1) includes: a projection unit (30, 30a, 31) that emits a visible laser beam to project an image onto a first object; movable support parts (12, 13) that mount the projection unit so as to change the projection position of the image projected by the projection unit; depth sensors (20, 25) that acquire, in a space where the projection unit can project the image, depth data indicating the distance to the object in the space; and a control unit (50) that controls the movable support parts, when a specific portion of the body of a user is detected in the space on the basis of the depth data, to change the projection position of the image projected by the projection unit from a first object to a second object.

Description

  The present invention relates to a projection apparatus that projects an image with visible laser light.

  For example, an information input device such as a remote controller is generally used to input information for operating a television, a video, or the like. However, when trying to use it, there is a problem that the place where the remote controller or the like is placed is unknown, and it cannot be used when it is desired to use it.

  In order to solve these problems, an apparatus capable of inputting information without using a device such as a remote controller has been proposed. For example, Patent Document 1 describes an information input device that projects an information input image onto a table or a part of a user's body with visible laser light, detects a user operation on the image, and inputs information. ing.

International Publication No. 2012/173001

  In the apparatus of Patent Document 1, for example, when a user presents a palm in a space where an image can be projected, the palm is detected and an information input image is projected on the palm. Information can be entered. However, when such an information input device is composed of a small projection device, the user is usually unaware of its presence and does not perform an operation that triggers image projection such as pushing out the palm. The information input function may not be used effectively. For this reason, some means is necessary so that the user can naturally recognize that there is such a projection apparatus.

  Therefore, an object of the present invention is to provide a projection device that allows a user to naturally recognize the presence of a projection unit that projects an image onto a specific object when a specific part of the user's body is detected.

  The projection device of the present invention emits visible laser light and projects an image onto a first object, a movable support unit that mounts the projection unit so that the projection position of the image by the projection unit can be changed, In a space in which an image can be projected by the projection unit, a depth sensor that acquires depth data indicating a distance to an object in the space, and when a specific part of the user's body is detected in the space based on the depth data, And a control unit that controls the movable support unit to change the projection position of the image by the projection unit from the first object to the second object.

  In the projection apparatus according to the aspect of the invention, it is preferable that the control unit controls the movable support unit and the projection unit so that an image is projected onto the first object when the specific part is not detected.

  In the projection apparatus of the present invention, it is preferable that the control unit recognizes the surface shape of the first object based on the depth data and corrects the shape of the image projected by the projection unit according to the surface shape.

  In the projection apparatus of the present invention, the depth sensor is mounted on the first detection unit that captures the infrared data of the entire space and acquires depth data, and the movable support unit, and emits the infrared beam at the projection position of the image by the projection unit. A second detection unit that scans two-dimensionally and acquires depth data from reflected light of the infrared beam, and the control unit detects a specific part from the depth data acquired by the first detection unit, It is preferable to recognize the shape of the first object from the depth data acquired by the second detection unit.

  In the projection device of the present invention, it is preferable that the control unit has a clock function, and the projection unit projects a clock image indicating the time required by the clock function onto the first object.

  In the projection device according to the aspect of the invention, it is preferable that the projection unit projects an information input image onto the second object, and the control unit detects a user input operation on the information input image based on the depth data.

  In the projection device of the present invention, the control unit performs setting of the display state of the clock image, setting of the time indicated by the clock image, or setting of an alarm associated with the clock function in accordance with a user input operation on the information input image. Preferably it is done.

  In the projection device according to the aspect of the invention, it is preferable that the control unit holds calendar information, and the projection unit projects a calendar image onto the first object.

  According to the projection device of the present invention, the user can naturally recognize the existence of a projection unit that projects an image onto a specific object when a specific part of the user's body is detected.

1 is an external perspective view showing an overall configuration of a projection apparatus 1. FIG. 1 is a schematic configuration diagram of a projection device 1. FIG. 3 is a diagram illustrating a configuration example of a second detection unit 25. FIG. It is a figure which shows the example of the clock image. It is a figure which shows the example of the image 70 for information inputs. 3 is a functional block diagram of a control unit 50. FIG. It is a flowchart which shows an example of an initial setting process. It is a figure which shows an example of the image based on the imaging data by the infrared camera 22 of the 1st detection part 20. FIG. It is a flowchart which shows an example of a palm detection process. It is a figure which shows the state where the palm area 100 detected and the information input image 70 were projected on it. It is a flowchart which shows an example of an information input detection process. 6 is a diagram for explaining an example in which information input is performed by the right hand 90 on the information input image 70 projected on the palm region 100 of the left hand 80. FIG. It is a flowchart which shows an example of a projection position setting process. 6 is a schematic configuration diagram illustrating another example of a laser projector 30. FIG.

  Hereinafter, the projection apparatus will be described with reference to the drawings. However, it should be understood that the present invention is not limited to the drawings or the embodiments described below. In the description of the drawings, the same components are denoted by the same reference numerals, and redundant descriptions are omitted. For the sake of explanation, the scale of the members is changed as appropriate.

  This projection apparatus normally projects an image having a shape corresponding to the first object (for example, a wall) on the first object. This image is, for example, a clock image that functions as a virtual clock (virtual clock), and displays the current time in the same manner as an actual clock. Then, for example, when the user performs an operation such as putting out the palm in the space where the projection device is installed, the projection device detects the operation based on the depth data acquired by the depth sensor. At this time, when a specific part such as the palm of the user is detected, the projection apparatus changes the projection position of the image from the first object to the second object (for example, the detected palm). An information input image is projected onto the second object.

  The user can operate the projected clock and other operated devices by performing an input operation on the information input image. Thus, for example, when a clock image is projected, the user knows that the projection apparatus is installed in the space in which the user is present. In view of this, the projection apparatus displays a clock image fixedly on a wall or the like, for example, as a trigger for the user to perform an input operation. Although an example in which a clock image is fixedly displayed will be described below, what is fixedly displayed may be an image other than the clock, such as a calendar, and the display content is not limited to a specific one.

  FIG. 1 is an external perspective view showing the overall configuration of the projection apparatus 1. FIG. 2 is a schematic configuration diagram of the projection apparatus 1.

  The projection apparatus 1 includes a pan tilt frame 10, a first detection unit 20, a second detection unit 25, a laser projector 30, a control unit 50, and the like. The projection device 1 is disposed in a space 40 having at least a floor 41, a ceiling 42, and a wall 43. The space 40 may be a completely closed space or an open space. The pan tilt frame 10 is an example of a movable support unit, the first detection unit 20 and the second detection unit 25 are an example of a depth sensor, and the laser projector 30 is an example of a projection unit. In FIG. 1, only the emission part 30a of the laser projector 30 is shown.

  The pan tilt frame 10 includes a base 11, a first rotating unit 12, a second rotating unit 13, and the like. The base 11 is fixed to the ceiling 42. The first rotating unit 12 is rotated in the θ direction by the first motor 15, and the second rotating unit 13 is rotated in the φ direction by the second motor 16. When the first rotating unit 12 rotates in the θ direction, the projection image by the laser projector 30 moves in the direction of arrow A. When the second rotating unit 13 rotates in the φ direction, the projected image moves in the direction of arrow B.

  The laser projector 30 is, for example, an ultra-compact projector having an RGB color laser light source, an RGB laser light fiber, a fiber pigtail module, an RGB fiber combiner, a visible single mode fiber, an emission unit (projection head) 30a, and the like. Since the laser projector 30 projects an image with visible laser light, a focus-free characteristic that a good image can always be formed on the projection surface regardless of the distance between the projection surface and the emitting unit 30a. Have

  Each of the RGB laser light sources is composed of a semiconductor laser (laser diode) and emits visible laser light of a corresponding color. The fiber pigtail module introduces the RGB laser beams emitted from the respective color laser light sources into the RGB laser light fibers. The RGB fiber combiner combines lights from RGB laser light fibers. The visible single mode fiber guides the combined light to the emitting unit 30a.

  The emitting unit 30 a is attached to the second rotating unit 13 of the pan tilt frame 10, and projects an image onto an object in the space 40 by visible laser light guided by a visible single mode fiber. Since the direction of the emitting unit 30a can be arbitrarily changed by the rotation of the first rotating unit 12 and the second rotating unit 13, the projection position of the image can be arbitrarily changed. Thus, the projection apparatus 1 does not project the entire space 40 with a large projector, but moves the emitting unit 30a by the first rotating unit 12 and the second rotating unit 13 to adaptively. Controls the projection position and projects a bright image with minimum output.

  For the emission unit 30a, for example, LCOS (Liquid Crystal on Silicon) is used as an SLM (Spatial Light Modulator). Note that the emission unit 30a may be further downsized by using a spot scanning type emission unit using a MEMS (Micro Electro Mechanical System) mirror or a fiber scanning type emission unit.

  Further, the portions other than the visible single mode fiber and the emitting unit 30a of the laser projector 30 may be housed in the base 11 of the pan tilt frame 10 together with the control unit 50, or a separate control box may be attached to the ceiling 42. It may be stored inside. Alternatively, the entire laser projector 30 may be attached to the second rotating unit 13 of the pan tilt frame 10. Depending on the image to be projected, the laser projector 30 may use a visible laser light source having a wavelength other than a single color or RGB.

  The 1st detection part 20 is being fixed to the base 11 of the pan-tilt mount 10, and has the 1st infrared rays light emission part 21, the infrared camera 22, etc. FIG. The first infrared light emitting unit 21 irradiates the entire space 40 in which an image can be projected by the laser projector 30 with infrared rays. The infrared camera 22 receives and captures infrared reflected light from an object existing in the space 40, and positions coordinate data (x, y) for each pixel of the infrared image and the imaged object corresponding to each pixel. Depth data (r) indicating the distance to the control unit 50 is output.

  The first infrared light emitting unit 21 is a semiconductor laser (laser diode) that emits infrared light. It is preferable to use a laser (eye-safe laser) in a wavelength region of 1400 nm to 2600 nm that does not reach the retina and does not easily damage the eyes. However, in this wavelength region, for example, an InGaAs infrared camera needs to be used and is expensive, so a low-cost Si CMOS or CCD camera may actually be used as the infrared camera 22. In this case, as the first infrared light emitting unit 21, it is preferable to use a semiconductor laser having a wavelength region of 800 nm to 1100 nm, which is sensitive to a Si-based CMOS or CCD camera.

  As shown in FIG. 2, a polarizing plate 23 is disposed on the front surface of the first infrared light emitting unit 21. The polarizing plate 23 emits only linearly polarized light (for example, P-polarized) infrared light having a fixed polarization direction out of the infrared laser light emitted from the first infrared light emitting unit 21. A polarizing plate 24 is also disposed on the front surface of the infrared camera 22. Thereby, the infrared camera 22 receives and captures only the infrared light of the linearly polarized light (for example, P-polarized light) having the same polarization direction as that of the outgoing light among the reflected light from the object.

  The second detection unit 25 is mounted on the second rotation unit 13 of the pan tilt frame 10 together with the emission unit 30a of the laser projector 30, and includes a second infrared light emitting unit 26, an infrared detection unit 27, and the like. The second infrared light emitting unit 26 is a semiconductor laser (laser diode) that emits infrared light, and irradiates the predetermined area including the image projection position by the laser projector 30 with infrared light. The infrared detector 27 has a photodiode as a light receiving element, and receives and detects reflected light from an object in the region. The infrared detection unit 27 has a calculation unit, and the calculation unit determines the position coordinates of the object from the detection signal of the photodiode, the intensity ratio between the detection signal and the emitted light of the infrared laser, the irradiation angle of the infrared laser, and the like. Data is calculated, and depth data indicating the distance to the detected object is calculated using, for example, the TOF (Time of Flight) method. Then, the infrared detector 27 outputs the calculated position coordinate data (x, y) and depth data (r) of the object to the controller 50. The function of the calculation unit of the infrared detection unit 27 may be included in the control unit 50.

  Similarly to the first infrared light emitting unit 21, the second infrared light emitting unit 26 that emits an eye-safe laser is preferably used. However, in the wavelength region longer than 1400 nm, for example, an InGaAs infrared sensor needs to be used and is expensive. In practice, a low-cost Si photodiode may be used as the infrared detector 27. In this case, as the second infrared light emitting unit 26, a semiconductor laser having a wavelength region of 800 nm to 1100 nm that is sensitive to a Si-based photodiode may be used.

  As shown in FIG. 2, a polarizing plate 28 is disposed on the front surface of the second infrared light emitting unit 26. The polarizing plate 28 is a linearly polarized light having a fixed direction (the polarization direction of the infrared laser light emitted from the second infrared light emitting unit 26 is orthogonal to the linear linear polarization direction of the infrared light used in the first detection unit 20). For example, only S-polarized) infrared light is emitted. A polarizing plate 29 is also disposed on the front surface of the infrared detection unit 27. Thereby, the infrared detection unit 27 receives and detects only the infrared light of the linearly polarized light (for example, S-polarized light) having the same polarization direction as that of the outgoing light among the reflected light from the object.

  As described above, the first detection unit 20 and the second detection unit 25 use infrared rays whose linear polarization directions are orthogonal to each other, whereby the infrared rays received by the infrared camera 22 and the infrared rays received by the infrared detection unit 27 are detected. To reduce the mutual interference and improve the S / N ratio. However, in such a polarization multiplexing method, since interference occurs when the depolarized object is irradiated with infrared rays, the first detection unit 20 and the second detection unit 25 irradiate infrared rays having different wavelengths and use filters. Alternatively, a wavelength multiplexing system that receives each infrared ray may be used. Alternatively, the first detection unit 20 and the second detection unit 25 may use a time multiplexing method of irradiating infrared rays at different light emission timings in order to prevent interference.

  The first detection unit 20 cannot follow the movement of an object faster than this because the refresh rate of the infrared camera 22 is about 30 frames per second, but the second detection unit 25 is a second infrared light emitting unit. The object in the projection space irradiated with infrared rays can be detected at a higher speed by the TOF method. Further, since the second detection unit 25 is integrally mounted on the second rotation unit 13 together with the emission unit 30a, the projection space is scanned at a higher speed even if the projection image by the emission unit 30a moves. can do. For this reason, if the 2nd detection part 25 is utilized, it will detect rapidly that a face and eyes approach into projection space, for example, and it will prevent that a visible laser beam is irradiated to a human face and eyes. Is also possible.

  FIG. 3 is a diagram illustrating a configuration example of the second detection unit 25. In the second detection unit 25 shown in FIG. 3, the second infrared light emitting unit 26 and the infrared detection unit 27 have an infrared emission light axis and a light reception optical axis in a housing 252 provided with a transparent window 253 at the bottom. It arrange | positions so that it may mutually orthogonally cross. A polarizing plate 28, a beam splitter 250, and a MEMS mirror 251 serving as a scanning unit are sequentially arranged along the infrared emission optical axis of the second infrared light emitting unit 26. The beam splitter 250 and the MEMS mirror 251 are installed such that the semi-reflecting surface of the beam splitter 250 and the mirror surface at the neutral time of the MEMS mirror 251 form an angle of approximately 5 ° to 45 ° with respect to the infrared outgoing optical axis. . A polarizing plate 29 is disposed between the infrared detector 27 and the beam splitter 250.

  The MEMS mirror 251 is configured such that its mirror surface (not shown) can be rotated in two axial directions of an arrow a direction and an arrow b direction, and by rotating the mirror surface in each direction, The infrared beam shown is scanned two-dimensionally in the direction of arrow c and in the direction perpendicular to it (perpendicular to the paper surface). As a result, the second detection unit 25 performs high-speed raster scanning or Lisa juice can with a minute spot infrared beam on a slightly larger area including the image projection position of the emission unit 30a.

  Instead of the MEMS mirror 251 rotating in the biaxial direction, a combination of two vibrating mirrors such as a MEMS mirror rotating in the uniaxial direction may be used as the scanning unit. If the beam splitter 250 is a polarizing beam splitter, the polarizing plates 28 and 29 can be omitted.

  The control unit 50 includes a microcomputer having a CPU 50a, a RAM 50b, a ROM 50c, an I / O 50d, a communication I / F 50e, and peripheral circuits. The CPU 50a is a central processing unit that performs various calculations and processes. The RAM 50b is a random access memory that temporarily stores input data and data processed by the CPU 50a. The ROM 50c is a read-only memory that stores an operation program executed by the CPU 50a and fixed data. The I / O 50 d is an input / output port for transmitting / receiving data to / from the pan tilt frame 10, the first detection unit 20, the second detection unit 25, and the laser projector 30. The communication I / F 50e is a communication interface for receiving data necessary for the operation of the projection apparatus 1 from the outside such as the Internet. The control unit 50 may further include a nonvolatile RAM (NVRAM), a hard disk device (HDD), and the like.

  The control unit 50 controls operations of the pan tilt frame 10, the first detection unit 20, the second detection unit 25, and the laser projector 30 when the CPU 50a executes a program stored in advance in the ROM 50c. In particular, the control unit 50 outputs the image data to the laser projector 30 to project the clock image 60 onto a first object predetermined in the space 40 or the predetermined time in the space 40. The information input image 70 is projected onto the second object. That is, the control unit 50 controls the pan tilt frame 10 and moves the first rotating unit 12 and the second rotating unit 13 to project an image between the first object and the second object. The position is switched to cause the laser projector 30 to project either the clock image 60 or the information input image 70. Hereinafter, when the clock image 60 is projected, the projection apparatus 1 is said to be in the “clock mode”, and when the information input image 70 is projected, the projection apparatus 1 is said to be in the “input mode”.

  In the example of FIG. 1, the clock image 60 is projected on the window 44 that is an example of the first object, and when the projection position of the image is switched as indicated by the arrow C, the second object is displayed. The information input image 70 is projected on the palm of the user's left hand 80 as an example. Note that the first object and the second object are, for example, a floor, a wall, a board, a table, or a user's arm if the first object and the second object are flat to some extent and have a surface that can be recognized by the user. Other objects such as feet may be used and are not limited to those shown in FIG.

  4A to 4C are diagrams illustrating an example of the clock image 60. FIG. The control unit 50 controls the pan tilt frame 10 and the laser projector 30 to normally project the clock image 60 onto the first object. At that time, the control unit 50 does not paste the texture on the surface of the first object by simple projection mapping, but measures the surface shape of the first object by the second detection unit 25, for example, Adaptively select and project a clock image that matches For this purpose, the control unit 50 stores analog clocks or digital clocks of various designs such as round clocks and square clocks in the ROM 50c in advance.

  FIG. 4A shows a square analog clock image 60 a projected on the square window 44. In the example of FIG. 4A, a window 44 is designated as the first object, and a square clock image is projected in accordance with the square shape.

  FIG. 4B shows a round analog clock 60 b projected on the round table 45. In the example of FIG. 4B, the table 45 is designated as the first object, and a round clock image is projected in accordance with the round shape.

  FIG. 4C is a digital clock 60 c projected on the surface of the cupboard 46. In the example of FIG. 4C, the cupboard 46 is designated as the first object, and a square clock image is projected according to the square shape. Note that it may be possible for the user to select which of the analog clock and the digital clock is projected. Further, as in the example of FIG. 4C, the user may be able to select a part of the surface of the object as the projection position of the clock image 60.

  The clock image 60 is a virtual clock that displays the current time. If the clock is an analog clock, the display changes as the hands of the clock move, and if it is a digital clock, the display of numbers changes. The projection apparatus 1 may always display the clock image 60, or may display the clock image 60 only when the presence of the user is detected by the first detection unit 20, for example. Further, the first target is not limited to a single object, and the projection position of the clock image 60 may be switched between a plurality of objects at regular intervals.

  FIG. 5 is a diagram illustrating an example of the information input image 70. When the user performs a predetermined operation such as putting out a palm in the space 40, the control unit 50 detects the palm based on the depth data acquired by the first detection unit 20, for example. At this time, the projection apparatus 1 shifts from the timepiece mode to the input mode, and projects the information input image 70 onto, for example, the detected palm (second object). When a plurality of users are within the detectable range, the priority of the palm detected first is increased, and the information input image 70 is projected thereon.

  The information input image 70 is an image for inputting display settings of the clock image 60. For example, as shown in FIG. 5, a time setting button 72, an alarm setting button 73, a skin setting button 74, and a projection position setting button are displayed. 75. In addition to this, for example, a projection on / off selection button may be provided on the information input image 70 so that the clock image 60 can be erased or redisplayed by a user operation.

  The time setting button 72 is a button for displaying an input image for setting the time displayed by the clock image 60. The alarm setting button 73 is a button for operating the clock image 60 as a virtual alarm clock. When the alarm setting button 73 is selected, an input image for setting alarm on / off and alarm activation time is displayed. The projection apparatus 1 has a speaker or the like capable of outputting alarm sound, and the control unit 50 activates an alarm when the set alarm activation time is reached, and informs the user of the time by, for example, sound and light.

  The skin setting button 74 is a button for changing the appearance display of the clock image 60. When the skin setting button 74 is selected, an input image for selecting one of the clock designs stored in the ROM 50c or the like is displayed. Thus, the user can change the projected clock image 60 to a different appearance.

  The projection position setting button 75 is a button for shifting the projection apparatus 1 to a mode for setting the first object that is the projection position of the clock image 60. Hereinafter, this mode is referred to as “projection position setting mode”. When the projection position setting button 75 is selected, the control unit 50 detects, for example, an operation in which the user points to the first target object that is the projection destination of the clock image 60, and thereafter the selected first target object. Project a clock image 60.

  As will be described later, when the fingertip position is in any of the regions surrounded by the broken lines shown in FIG. 5, it is determined that information corresponding to each button has been input. The user can input information to the control unit 50 by selecting any button with the finger of the same hand as the palm on which the information input image 70 is projected or the finger of the other hand. As a result, the user can perform various settings of the virtual clock at hand without moving to the place where the watch is installed or using a device such as a remote controller.

  For example, the user selects any setting button and finishes inputting necessary information, or the user selects a return button (not shown) provided in the information input image 70, or the user inputs nothing for a predetermined time. By not performing the operation, the projection apparatus 1 shifts from the input mode or the projection position setting mode to the clock mode. Thereby, the projection apparatus 1 starts or restarts the projection of the clock image 60 onto the first object.

  The information input image 70 is not limited to the display setting of the clock image 60, and may be for inputting information to another device. For example, an air conditioner, a network access device, a personal computer, a television, a radio, or a recording / reproducing device for various recording media such as a CD, a DVD, or a VTR is used as an operated device. Information may be input. Since the user can recognize from the clock image 60 that the projection apparatus 1 is installed in the space 40, the user can perform an operation of projecting the information input image 70 as necessary.

  FIG. 6 is a functional block diagram of the control unit 50. In order to realize the above functions of the projection apparatus 1, the control unit 50 includes, as functional modules, an initial setting processing unit 51, a projection position control unit 52, an object detection unit 53, an input detection unit 54, and a projection position. A setting unit 55, an image adjustment unit 56, a clock setting unit 57, and a clock function unit 58 are included. Each of these units is realized by the CPU 50a in accordance with a program stored in advance in the ROM 50c.

  The initial setting processing unit 51 performs an initial setting process for creating a data table in which control data output to the pan tilt frame 10 and position coordinate data of an image projected by the laser projector 30 are associated with each other. Details of the initial setting process will be described later with reference to FIG.

  The projection position control unit 52 projects the clock image 60 onto the first object designated in advance by the user when the object detection unit 53 has not detected a specific part (for example, palm) of the user's body. The pan tilt base 10 and the laser projector 30 are controlled. At this time, the projection apparatus 1 is in a time mode.

  Further, the projection position control unit 52 controls the pan tilt frame 10 when the object detection unit 53 detects a specific part of the user's body, so that the projection position of the image by the laser projector 30 is determined from the first object. Change to a second object (eg, palm). Note that the second object and the specific part may be the same object.

  When the specific part is detected, the projection apparatus 1 shifts to the input mode. At this time, the projection position control unit 52 calculates the first position from the position coordinate data (x, y) and depth data (r) of the second object acquired by the first detection unit 20 or the second detection unit 25. The spatial coordinates (x, y, z) of the two objects are calculated. Then, the projection position control unit 52 drives and controls the first motor 15 and the second motor 16 of the pan tilt frame 10 with appropriate control data based on the data table created by the initial setting processing unit 51. The 1st rotation part 12 and the 2nd rotation part 13 are rotated. Thereby, the projection position control unit 52 changes the direction of the emitting unit 30a to project the information input image 70 onto the second object. That is, the projection position control unit 52 switches the image projection position between when the projection apparatus 1 is in the clock mode and when in the input mode.

  Further, when the user finishes the input operation on the information input image 70 or the operation of designating the first object and the projection apparatus 1 shifts from the input mode or the projection position setting mode to the clock mode, the projection position control unit 52 rotates the 1st rotation part 12 and the 2nd rotation part 13 similarly to the above, and makes the clock image 60 project on a 1st target object with the laser projector 30. FIG.

  Further, for example, when the specific part and the second object are the same palm, the projection position control unit 52 tracks the palm even when the user moves the palm, and the information input image 70 is always on the palm. Is preferably projected. For this purpose, the projection position control unit 52 controls the pan tilt frame 10 based on the palm depth data acquired by the second detection unit 25, so that the direction of the emitting unit 30a is adjusted in accordance with the movement of the palm. Change.

  The object detection unit 53 detects a user's predetermined action for causing the projection apparatus 1 to project the information input image 70. For this purpose, the object detection unit 53 detects a specific part of the user's body in the space 40 based on, for example, depth data acquired by the first detection unit 20. For example, when the predetermined action is an action of putting out the palm, the object detection unit 53 detects the palm of the user as a specific part of the user's body by the palm detection process of FIG. 9 described later.

  Alternatively, the predetermined operation for projecting the information input image 70 may be other operations such as the user pointing at the second object to be the projection surface of the information input image 70. In this case, the object detection unit 53 detects the user's finger as a specific part of the user's body, for example, based on the depth data acquired by the first detection unit 20 as in the palm detection process.

  When information input image 70 is projected onto a part of the body such as the palm of the user and information is input, the user's face or eyes are projected into the projection space between emitting unit 30a and information input image 70. It becomes easy for a singular object such as Therefore, when the first detection unit 20 detects an object that may be a specific object such as a user's face or eyes in the projection space, the object detection unit 53 acquires from the second detection unit 25. Based on the position coordinate data and the depth data, it may be determined whether or not the object is a singular object. In this case, for example, the object detection unit 53 identifies the contour pattern of the object from the data, and stores the human eye, nose, ear, mouth, facial contour, face, etc. stored in the ROM 50c or the like in advance. By comparing with a pattern showing a characteristic shape, it is determined whether or not it is a singular object. When the object detection unit 53 determines that the detected object is a singular object, the object detection unit 53 outputs a control signal to the laser projector 30 to stop the irradiation of RGB visible laser light from the emission unit 30a.

  Based on the depth data acquired from the first detection unit 20 or the second detection unit 25, the input detection unit 54 performs a user input operation on the information input image 70 by an information input detection process in FIG. To detect. For example, the input detection unit 54 determines whether or not the user's fingertip has entered the projected information input image 70 and specifies the fingertip position.

  Further, the input detection unit 54 determines the type and arrangement position of the input button included in the information input image 70 based on the image data output to the laser projector 30. Further, the input detection unit 54 specifies the position of the information input image 70 in the space 40 based on the control data output to the pan tilt frame 10 and the data table created by the initial setting processing unit 51. Accordingly, the input detection unit 54 specifies the position of each input button in the space 40 based on the image data output to the laser projector 30 and the control data output to the pan tilt frame 10.

  Thereby, the input detection unit 54 determines whether or not the user has touched any input button on the information input image 70 based on the depth difference between the projection surface of the information input image 70 and the fingertip position of the user. to decide. Moreover, the input detection part 54 specifies the content which the user input based on a user's fingertip position and the position of each input button. For example, when the user's fingertip position is within the range of the time setting button 72, the alarm setting button 73, the skin setting button 74, or the projection position setting button 75, the input detection unit 54 sets the information input content to “time”. Specify “setting”, “alarm setting”, “skin setting” or “projection position setting”.

  And the input detection part 54 outputs the signal corresponding to the specified information input content. For example, when the content of the specified information input is “time setting”, “alarm setting”, or “skin setting”, the input detection unit 54 outputs a corresponding control signal to the clock setting unit 57. When the specified information input content is “projection position setting”, the input detection unit 54 outputs a corresponding control signal to the projection position setting unit 55.

  When the projection position setting unit 55 obtains a control signal corresponding to “time setting” from the input detection unit 54, the projection position setting unit 55 determines the first object on which the clock image 60 is projected by the projection position setting process of FIG. Set according to the input operation.

  When the projection position setting unit 55 acquires a control signal corresponding to “time setting” from the input detection unit 54, the projection image from the emission unit 30 a is extracted from the information input image 70, for example, “◯”, “□”, or “ Change to a position designating pattern such as “⇒”. The projection position setting unit 55 detects a direction in which the user points to an object on which the clock image 60 is to be projected in the space 40 based on the depth data acquired by the first detection unit 20. Then, the projection position setting unit 55 controls the pan tilt frame 10 using the data table created by the initial setting processing unit 51, and moves the projection position of the position designation pattern along the direction indicated by the detected user. Let

  At this time, the projection position setting unit 55 acquires the position coordinate data and depth data of the object on which the position designation pattern is projected from the second detection unit 25, and based on these data, projects the position designation pattern. It may be determined whether the position is a specific object such as a human face. In this case, for example, the projection position setting unit 55 identifies the contour pattern of the object from the data, and stores the human eye, nose, ear, mouth, facial contour, face, etc. stored in advance in the ROM 50c or the like. It is determined whether or not the object is a singular object by comparing it with a pattern showing a characteristic shape of When the projection position setting unit 55 determines that the projection position of the position designating pattern is a singular object, the projection position setting unit 55 outputs a control signal to the laser projector 30 to irradiate RGB visible laser light from the emitting unit 30a. Stop.

  Based on the depth data from the second detection unit 25, for example, the projection position setting unit 55 determines that the movement of the user's finger has stopped and the position designating pattern has been projected onto the same object for a predetermined time or longer. The shape of the object is recognized from the depth data obtained by the detection unit 20 or the second detection unit 25, and the recognized object is determined as the first object on which the clock image 60 is projected. Alternatively, an object that is a candidate for the first target object may be registered in advance in the RAM 50b or the like, and the user may select a projection target object using the position designating pattern from among the registered candidates. In addition, the projection position setting unit 55 has a distance, a size, a shape, or the like from the second detection unit 25 (or the emission unit 30a) in advance based on the position coordinate data and the depth data acquired from the second detection unit 25. Only the object within the defined range may be selected by the user as the first object.

  Then, the projection position setting unit 55 determines, for example, the entire first object as the projection position of the clock image 60. Alternatively, the projection position setting unit 55 may set a range in which the depth data acquired by the second detection unit 25 is approximately the same as the projection position of the clock image 60, for example. However, since the projection position of the clock image 60 may be too large when the first object is a wall or the like, the projection position setting unit 55 determines the position designation pattern according to the pointing operation of the user as described above. By controlling the projection position, a range designated by the user by moving the position designation pattern on the first object may be determined as the projection position of the clock image 60. Alternatively, the projection position setting unit 55 projects a frame image indicating the center, upper side, lower side, left side, right side, and the like of the first object onto the first object, and allows the user to select any of them as a position designating pattern. By selecting these, the projection position of the clock image 60 may be determined. Alternatively, the size of the clock image 60 to be displayed may be determined in advance.

  The image adjustment unit 56 creates image data of a clock image that matches the surface shape of the first object determined by the projection position setting unit 55 and outputs the image data to the projection position control unit 52.

  For this reason, the image adjustment unit 56, based on the position coordinate data and depth data acquired by the first detection unit 20 or the second detection unit 25, for the first object determined by the projection position setting unit 55. Recognize the shape of the first object. Then, the image adjustment unit 56 selects one that matches the shape of the first object from the image data of various analog clocks or digital clocks such as round clocks and square clocks that are stored in advance in the ROM 50c or the like. To do. For example, when the shape of the first object is circular or square, the image adjustment unit 56 selects a circular or square analog clock image, respectively. When the shape of the first object is a rod shape, the image adjustment unit 56 selects a digital clock image, for example. When the first object has another shape, the image adjustment unit 56 selects an analog or digital clock image close to the shape based on the width, height, and the like of the first object.

  The image adjusting unit 56 enlarges or reduces the projected clock image 60 according to the area of the first object. Note that the image adjustment unit 56 also enlarges or reduces the projection image of the information input image 70 based on the depth data of the second object, and the information input image 70 just fits on the second object. To control.

  Further, the image adjustment unit 56 corrects the image data of the image projected by the laser projector 30 according to the surface shape of the first object so that an image without distortion is projected onto the first object. . For example, when the surface of the first object is a curved surface, the image adjustment unit 56 corrects the shape of the projection image according to the curvature. For example, when the surface of the first object is not perpendicular to the projection direction from the emitting unit 30a, the image adjusting unit 56 corrects the shape of the projection image according to the projection angle with respect to the surface.

  Note that the image adjustment unit 56 may adjust the projected clock image in accordance with the surface state such as the color density, surface roughness, and reflectance of the first object. For example, when the first object has a dark surface, the image adjustment unit 56 may adjust the image data of the clock image to a light color or a light color. In addition, when the first object has a rough surface, the characters included in the clock image may be adjusted to be larger than when projected onto a smooth surface. In this way, the image adjustment unit 56 can display the clock image clearly. In the case of performing the color adjustment as described above, a color camera is provided in the first detection unit 20 or the second detection unit 25, and the image adjustment unit 56 is a color image captured by the color camera. It is good to use.

  The clock setting unit 57 sets the time indicated by the clock image 60, the alarm associated with the clock image 60, or the display state of the clock image 60 in accordance with a user input operation on the information input image 70. .

  When the control signal corresponding to “time setting” is acquired from the input detection unit 54 according to the user's input operation, the clock setting unit 57 displays an appropriate icon so that an input image for setting the current time is displayed. Alternatively, image data of a pattern such as characters is output to the laser projector 30. When the input detection unit 54 detects a user input operation on the input image, the clock setting unit 57 sets the current time indicated by the clock function unit 58 in accordance with an instruction from the user.

  When the control signal corresponding to “alarm setting” is acquired from the input detection unit 54, the clock setting unit 57 outputs image data corresponding to the input image for setting the alarm on / off or activation time to the laser projector 30. To do. When the input detection unit 54 detects a user input operation on the input image, the clock setting unit 57 turns on or off the alarm clock function by the clock function unit 58 according to an instruction from the user, or an alarm instructed by the user. The start time is output to the clock function unit 58.

  When the control signal corresponding to “skin setting” is acquired from the input detection unit 54, the clock setting unit 57 outputs image data corresponding to the input image for design change of the clock image 60 to the laser projector 30. When the input detection unit 54 detects an input operation of the user with respect to the input image, the clock setting unit 57 corresponds to the clock image corresponding to the one designated by the user from the clock designs stored in the ROM 50c or the like. Are output to the laser projector 30. As a result, the clock setting unit 57 changes the projected clock image 60 to a different appearance.

  The clock function unit 58 has a real-time clock function and records the current time. The clock function unit 58 generates image data, for example, in seconds so that the clock image 60 always displays the current time when the projection apparatus 1 is in the clock mode, and outputs the image data to the laser projector 30. . The clock function unit 58 has an alarm clock function. When the set alarm activation time is reached, the clock function unit 58 activates an alarm and outputs sound from, for example, a speaker provided in the projection apparatus 1, or further, the laser projector 30. Is emitted to inform the user of the time. Note that the clock function unit 58 may automatically correct the current time by connecting to the Internet or receiving a GPS signal, a standard radio wave, or a radio time signal via the communication I / F 50e. .

  FIG. 7 is a flowchart illustrating an example of the initial setting process. FIG. 8 is a diagram illustrating an example of an image based on image data captured by the infrared camera 22 of the first detection unit 20. In the flowchart described below, step is abbreviated as “S”.

  First, the initial setting processing unit 51 acquires depth data of the entire space 40 in which an image can be projected by the laser projector 30 from the first detection unit 20 (S10). Then, the initial setting processing unit 51 stores the position coordinate data and the depth data in the RAM 50b for each pixel of the image captured by the infrared camera 22 of the first detection unit 20 (S11). For example, a point on the floor 41 that is directly below the first detection unit 20 and a point on the floor 41 that is located away from the first detection unit 20 are on the same floor 41 but the first detection unit. There will be a difference in the depth data from 20 and the second detector 25. For this reason, the initial setting processing unit 51 acquires and records position coordinate data and depth data in advance for all the pixels in the space 40.

  Next, the initial setting processing unit 51 outputs image data to the laser projector 30 to project the reference projection image 71 of FIG. 8, and outputs control data to the pan tilt frame 10 to output the first rotating unit 12 and the first rotation unit 12. The reference projection image 71 is moved by rotating the second rotation unit 13 (S12). For example, first, the reference projection image 71 is moved to the center position indicated by reference numeral 71-1. For example, as shown in FIG. 8, the reference projection image 71 includes five points arranged in a circular frame. Note that another image may be used as the reference projection image 71.

  Next, the initial setting processing unit 51 acquires position coordinate data from the first detection unit 20 and the second detection unit 25 (S13). Then, the initial setting processing unit 51 specifies the position of the reference projection image 71 using the five points of the reference projection image 71 (S14), and the control data output to the pan tilt frame 10 and the specified reference projection image. The correspondence with the position coordinate data 71 is stored in the data table on the RAM 50b (S15).

  Thereafter, the initial setting processing unit 51 determines whether or not the reference projection image 71 has moved so as to cover the entire space 40 (S16). If there is an area that has not yet moved (No in S16), the process returns to S12. Thus, the initial setting processing unit 51 repeats the processes of S12 to S15 while sequentially moving the reference projection image 71 as indicated by reference numerals 71-2 to 71-10 in FIG. A data table representing the correspondence between the position coordinate data of the projection image and the control data is completed. Note that the reference projection images 71-2 to 71-10 in FIG. 8 are merely examples, and the amount of movement for moving the reference projection image 71 in order to specify the position can be appropriately determined.

  Then, when the initial setting processing unit 51 determines that all areas of the space 40 have been moved (Yes in S16), the initial setting process in FIG.

  FIG. 9 is a flowchart illustrating an example of palm detection processing. FIG. 10A and FIG. 10B are diagrams showing a state in which the detected palm region 100 and the information input image 70 are projected thereon. 10A and 10B show an example in which the palm region 100 of the user's left hand 80 is detected, but the same applies to the case where the palm of the right hand is detected.

  First, the object detection unit 53 acquires position coordinate data and depth data from the first detection unit 20 (S20). Next, the object detection unit 53 specifies an area where the contour of the object exists based on the position coordinate data acquired in S20 (S21). And the object detection part 53 groups the area | region which has substantially the same depth data among the area | regions where an outline exists based on the depth data acquired by S20 (S22).

  Next, the object detection unit 53 determines whether or not the contour region of the objects grouped in S22 is a portion ahead of the wrist that is the target part by comparing with a pattern stored in advance in the ROM 50c or the like (S23). ). There may be a case where a plurality of groups of contour regions are identified when, for example, the user's feet, face, shoulders, or other objects appear in the infrared image captured by the first detection unit 20. Even in such a case, the object detection unit 53 identifies only the portion ahead of the wrist by performing pattern recognition.

  When it is determined that the contour region is not the target part (No in S23), the object detection unit 53 ends the palm detection process as it is.

  On the other hand, when it is determined that the contour region is the target region (Yes in S23), the object detection unit 53 detects the palm region 100 indicated by a broken-line circle in FIG. 10A (S24). For example, the object detection unit 53 identifies the finger tip position N1 and the wrist positions N2 and N3 from the contour (outer shape) of the identified left hand 80. Then, the object detection unit 53 draws a straight line N4 connecting the finger tip position N1 and the midpoint N5 of the wrist positions N2 and N3, and the distance between the finger tip position N1 and the midpoint N5 on the straight line N4 is calculated. A palm region 100 is defined as a circular region having a center point N6 separated from the midpoint N5 by a quarter and having a radius between the center point N6 and the midpoint N5. In addition, the method of determining the palm area | region 100 is not limited to this, You may employ | adopt another method.

  When the palm region 100 is detected, the object detection unit 53 acquires depth data of the palm region 100 from, for example, the first detection unit 20 (S25) and stores it in the RAM 50b or the like. Then, the object detection unit 53 determines the spatial coordinates (x, y, z) of the center point N6 from the position coordinate data (x, y) and depth data (r) of the center point N6 of the palm region 100 (S26). Thereby, the palm detection process of FIG. 9 is completed.

  Note that the object detection unit 53 executes the processing flow of FIG. 9 at predetermined time intervals (for example, 1 second) until a portion ahead of the wrist is recognized. When the palm is used as the specific part and the second object, when the palm is detected, the projection position control unit 52 uses the data table created by the initial setting processing unit 51 to move the pan tilt frame 10. By controlling, the information input image 70 is projected at a position in the palm region 100 as shown in FIG.

  FIG. 11 is a flowchart illustrating an example of the information input detection process. FIG. 12 is a diagram for explaining an example in which information input is performed with the right hand 90 on the information input image 70 projected on the palm region 100 of the left hand 80. Here, the information input detection process when the information input image 70 is projected on the palm will be described, but the same applies to the case of detecting information input on the projection image on another object.

  First, the input detection unit 54 determines whether or not the palm region 100 that is the target part is detected by, for example, palm detection processing (S30), and proceeds to the following steps only when the target part is detected. . When the target part is detected, the input detection unit 54 acquires the image data output to the laser projector 30 and the control data output to the pan tilt frame 10 (S31). Next, the input detection unit 54 acquires position coordinate data and depth data mainly from the second detection unit 25 (S32). Note that the order of S31 and S32 may be reversed.

  Next, the input detection unit 54 specifies an area where the contour of the object exists based on the position coordinate data acquired in S32 (S33). And the input detection part 54 groups the outline area | region where depth data is substantially the same based on the depth data acquired by S32 (S34). Although there may be a plurality of contour regions grouped in S34, the input detection unit 54 recognizes only an object having a position coordinate (x, y) within the palm region 100 as an approaching object.

  Further, the input detection unit 54 specifies the approach position and fingertip position of the approaching object to the palm area 100 based on the grouped contour areas (S35). For example, the input detection unit 54 specifies the entry positions 01 and 02 of the right hand 90 that is an object entering the palm region 100. Then, the input detection unit 54 specifies the point 05 that overlaps the contour of the right hand 90 at the position farthest from the midpoint 03 on the perpendicular line 04 extended from the midpoint 03 of the entry positions 01 and 02 as the fingertip position. Note that the input detection unit 54 may specify a contour region included in the right hand 90 present at the position farthest from the midpoint 03 of the entry positions 01 and 02 as the fingertip position. These fingertip position specifying methods are examples, and other methods may be adopted.

  Next, the input detection unit 54 determines whether or not the right hand 90 that is an approaching object is performing an information input operation (S36). For example, the input detection unit 54 determines that the fingertip of the right hand 90 is performing an information input operation when the point 05 of the fingertip position is on the palm region 100. The input detection unit 54 determines whether or not the fingertip position point 05 is on the palm area 100, and the difference between the depth data of the palm area 100 and the depth data of the fingertip position point 05 is within a predetermined threshold (for example, within 10 mm). Judgment based on whether or not. In addition, since the depth data of the fingertip position point 05 may fluctuate in a short period due to chattering or the like, the input detection unit 54 keeps the depth difference within a predetermined threshold continuously for a predetermined time (for example, 1 second). In some cases, it may be determined that information has been input.

  If the input detection unit 54 determines that the fingertip position is not intended for the information input operation (No in S36), the information input detection process is terminated. On the other hand, when the input detection unit 54 determines that the fingertip position is intended for an information input operation (Yes in S36), the image data output to the laser projector 30 and the control data output to the pan tilt frame 10 are displayed. Based on the above, the position of each input button included in the information input image 70 on the palm region 100 is specified (S37).

  Next, the input detection unit 54 specifies the information input content based on the fingertip position point 05 specified in S35 and the position of each input button specified in S37 in the palm region 100 (S38). If there is no input button matching the fingertip position point 05, it may be specified that there is no information input content. Thereafter, the input detection unit 54 outputs a signal corresponding to the information input content specified in S38 (S39). Thereby, the information input detection process of FIG. 11 is completed.

  FIG. 13 is a flowchart illustrating an example of the projection position setting process. When the user selects the projection position setting button 75 of the information input image 70, the projection apparatus 1 shifts to the projection position setting mode. At this time, the projection position setting unit 55 sets the first object on which the clock image 60 is projected by the following process.

  First, the projection position setting unit 55 outputs image data to the laser projector 30 and changes the projection image from the emitting unit 30a to a position designating pattern such as “◯”, “□”, or “⇒”. (S40). Thereby, the user can know that the projection apparatus 1 has shifted to the projection position setting mode. For example, the user moves the position specifying pattern by pointing the object to which the clock image 60 is to be projected in the space 40 using the fingertip as a virtual mouse.

  And the projection position setting part 55 detects the direction which a user points based on the depth data which the 1st detection part 20 acquired (S41). Therefore, for example, the projection position setting unit 55 detects the user's finger in the same manner as the palm detection in FIG. 9, and calculates the fingertip from the detected position coordinate data of the two points of the fingertip and the base of the finger and the depth data thereof. And find a straight line through the base of the finger. Then, the projection position setting unit 55 controls the pan tilt frame 10 using the data table created by the initial setting processing unit 51, and the projection position of the position designation pattern along the direction pointed by the user detected in S41. Is moved (S42).

  At this time, the projection position setting unit 55 always determines based on the depth data from the second detection unit 25 whether or not the projection position of the position designating pattern is a specific object such as a human face (S43). . For this purpose, the projection position setting unit 55 acquires the position coordinate data and depth data of the object on which the position specifying pattern is projected from the second detection unit 25. Then, the projection position setting unit 55 specifies the contour region of the object based on the position coordinate data, and groups contour regions having substantially the same depth data based on the depth data. When the obtained contour pattern is similar to the pattern of a specific object stored in advance in the ROM 50c or the like, the projection position setting unit 55 determines that the projection position is a specific object.

  When the projection position setting unit 55 determines that the projection position is a singular object (Yes in S43), the projection position setting unit 55 outputs a control signal to the laser projector 30 to irradiate RGB visible laser light from the emitting unit 30a. It stops (S48), and the projection position setting process ends.

  On the other hand, when no singular object is detected (No in S43), the projection position setting unit 55 stops the operation of the user's finger based on the depth data from the second detection unit 25, for example, and specifies the position. It is determined whether the pattern for use has been projected on the same object for a predetermined time or longer (S44). The projection position setting unit 55 repeats the processes of S41 to S44 until it is determined in S44 that the position specifying pattern has been projected on the same object for a predetermined time or longer.

  When the projection position setting unit 55 determines that the position designating pattern has been projected on the same object for a predetermined time or longer (Yes in S44), the projection position setting unit 55 determines the object as the first object on which the clock image 60 is projected ( S45). This determination method is an example, and the projection position setting unit 55 may determine the first object by another method.

  Then, the projection position setting unit 55 recognizes the shape of the first object from the position coordinate data and the depth data of the first object determined in S45 (S46). Further, the projection position setting unit 55 determines the projection position of the clock image 60 on the first object (S47). In that case, for example, the entire first object may be set as the projection position of the clock image 60. Alternatively, similarly to S41 and S42, by controlling the projection position of the position designation pattern according to the pointing operation of the user, the range designated by the user by moving the position designation pattern on the first object is specified. The projected position of the clock image 60 may be used. Note that the above-described method for determining the projection position is an example, and the projection position setting unit 55 may adopt another method. Thereby, the projection position setting process in FIG. 13 ends.

  FIG. 14 is a schematic configuration diagram illustrating another example of the laser projector 30. As shown in FIG. 14, the second infrared light emitter 26 of the second detector 25 can be shared with the laser projector 30. The laser projector in this case includes a scanning-type emitting unit 31, a single mode fiber 32, a broadband fiber combiner 33, a fiber pictail module 34, and the like. In this configuration, the laser light emitted from the laser light source for each of the R, G, and B colors of visible light and the laser light source for infrared (IR) is introduced into each optical fiber by the fiber pictail module 34. The broadband fiber combiner 33 multiplexes the R, G, B, and IR laser beams guided by the optical fibers. The single mode fiber 32 guides the combined light to the emission part 31 of the scanning method.

  In the emission part 31, the laser light emitted from the single mode fiber 32 is irradiated toward the MEMS mirror 31b by the irradiation optical system 31a, and the reflected light from the MEMS mirror 31b passes through the projection optical system 31c to the projection surface described above. Projected. By vibrating the MEMS mirror 31b with respect to two orthogonal axes, the projected laser beam can be two-dimensionally scanned at high speed. As a result, the second infrared light emitting unit 26 can be shared with the laser projector 30. Further, a beam splitter is disposed between the irradiation optical system 31a and the MEMS mirror 31b in FIG. 14 to separate reflected light from an object irradiated with infrared rays, and through an infrared bandpass filter, an infrared detection unit such as a photodiode. It can also be detected by receiving light.

  As described above, when the projection device 1 is in the clock mode, the projection device 1 projects the clock image 60 having a shape corresponding to the target object onto the first target object, and performs an operation such as the user putting out the palm of the hand, for example. And the projection position is changed from the first object to the second object, and the information input image 70 is projected onto the second object. As described above, the projection device 1 displays the clock image 60 in a fixed manner as an opportunity for the user to perform an input operation using the information input image 70. The clock image 60 allows the user to recognize that the projection apparatus 1 is installed in the space in which the user is present, and therefore, by performing an input operation on the information input image 70, the projected clock, Other operated devices can be operated.

  In the above description, the case where the second object is a palm has been mainly described. However, the second object may be a user's arm or a foot. The projection device 1 projects an information input image in accordance with the shape of the second object, for example, by projecting a wristwatch type remote control in the case of an arm and projecting a foot switch type remote control in the case of a foot. It is good also as remote control display of a different form.

  Further, instead of projecting a clock image onto a first object such as a wall, the projection apparatus 1 may, for example, project a wristwatch image on the arm when the user pushes out the arm, or push out the palm of the user. A clock image may be projected on the palm of the hand.

  In addition, the projection device 1 may display, for example, a calendar or a user's favorite poster image on the first object instead of the clock image. Alternatively, for example, when the projection apparatus 1 is used in a restaurant or the like, a menu image may be fixedly displayed on the first object as a table.

DESCRIPTION OF SYMBOLS 1 Projection apparatus 10 Pan tilt mount 20 1st detection part 25 2nd detection part 30 Laser projector 50 Control part 51 Initial setting process part 52 Projection position control part 53 Object detection part 54 Input detection part 55 Projection position setting part 56 Image Adjustment unit 57 Clock setting unit 58 Clock function unit 60 Clock image 70 Information input image

Claims (8)

A projection unit that emits visible laser light and projects an image onto the first object;
A movable support unit on which the projection unit is mounted so that the projection position of an image by the projection unit can be changed;
A depth sensor that acquires depth data indicating a distance to an object in the space in a space in which an image can be projected by the projection unit;
When a specific part of the user's body is detected in the space based on the depth data, the movable support unit is controlled so that the projection position of the image by the projection unit is changed from the first object to the second object. A control unit to change the object,
A projection apparatus comprising:   The projection device according to claim 1, wherein the control unit controls the movable support unit and the projection unit so that an image is projected onto the first object when the specific part is not detected. .   The said control part recognizes the surface shape of the said 1st target object based on the said depth data, and correct | amends the shape of the image which the said projection part projects according to the said surface shape. Projection device. The depth sensor is mounted on the first detection unit that captures an infrared image of the entire space to acquire the depth data, and the movable support unit, and two-dimensionally transmits the infrared beam at the projection position of the image by the projection unit. And a second detector that acquires the depth data from the reflected light of the infrared beam,
The said control part detects the said specific site | part from the depth data which the said 1st detection part acquired, and recognizes the shape of the said 1st target object from the depth data which the said 2nd detection part acquired. 4. The projection device according to 3. The control unit has a clock function,
The projection device according to claim 1, wherein the projection unit projects a clock image indicating a time required by the clock function onto the first object. The projection unit projects an information input image onto the second object;
The projection device according to claim 5, wherein the control unit detects a user input operation on the information input image based on the depth data.   The control unit performs setting of a display state of the clock image, setting of a time indicated by the clock image, or setting of an alarm associated with the clock function according to a user input operation on the information input image. The projection apparatus according to claim 6. The control unit holds calendar information,
The projection device according to claim 1, wherein the projection unit projects an image of a calendar onto the first object.

Images