JP5494853B2 - projector - Google Patents

Description

  The present invention relates to a projector, and more particularly, to a laser projector that projects an image with laser light.

  Laser projectors are known as projectors that project images with laser light. When using a projector that projects an image at a position away from the projector, such as a laser projector, a pointer that reaches the screen on which the image is projected from the position of the user, or a laser that performs laser irradiation on the screen By using a pointer or the like, the user has pointed to a desired point. In addition, when inputting image data from another information device or the like to the projector, the point desired by the user is indicated via an input device such as a touch panel or a mouse included in the other information device. In addition to this, there are known methods and configurations for inputting information related to points desired by the user to the projector.

  For example, Japanese Patent Laid-Open No. 2000-305706 (Patent Document 1) discloses a data input device having means for detecting an obstacle that temporarily appears in an input area outside the main body of the device and determining data input. It is disclosed. The data input device has means for projecting an image on the input area on the surface. The virtual keyboard is projected on the front of the device or on the surface that is in the folded part of the device. A virtual keyboard image is generated on the surface using laser diodes and diffraction optics, and an infrared transmitter and receiver are used to detect a pointer or finger on the exact area of the virtual keyboard. Done.

  Japanese Unexamined Patent Publication No. 2000-66818 (Patent Document 2) discloses a keyboard terminal for performing key input to an information processing apparatus. The keyboard terminal includes first and second light emitting units that emit light toward each key of the virtual keyboard in which a plurality of keys are virtually arranged, and virtual keys from the first and second light emitting units. A light receiving unit that receives reflected light from an object positioned at a position corresponding to each key of the key, and a finger F is positioned at a position corresponding to any key of the virtual keyboard based on a signal received by the light receiving unit. And key detecting means for performing key input corresponding to the detected key. When a finger is moved to press each key of the virtual keyboard, light from the first and second light emitting parts reflected by the finger is detected, and the detected light is applied to any key of the virtual keyboard. By detecting whether it corresponds, key input using a virtual keyboard is realized.

  Japanese Patent Laid-Open No. 2007-108507 (Patent Document 3) discloses a method in which light projected from a projector device is split by a half mirror or the like, and the split light is applied to a child screen held by a user in the vicinity of the projector device. A projector device is disclosed that includes means for projecting and means for receiving a user operation on the child screen and transmitting a user operation input to a PC or the like via the projector device.

  Japanese Patent Application Laid-Open No. 2006-29579 (Patent Document 4) appears in an input display area that is projected by a projection-type input display device, a projection-type display display device, and a projection-type input display device and displays first information. A portable information device including a first housing having an input determination device for detecting an obstacle to be opened and a second housing connected to the first housing so as to be opened and closed is disclosed. The portable information device includes an input display area for displaying first information projected by the projection type input display device and a display display area for displaying second information projected by the projection type display display device. It has the structure which can be set to arbitrary positions with the opening-and-closing angle of a body and a 2nd housing | casing.

  Japanese Patent Laying-Open No. 2005-38422 (Patent Document 5) discloses a computer device that projects a user input display on a surface from a projector. A user output display is projected onto a surface from the projector of the computer device. This user input display and user output display can be projected from the same projector. The user input display and the user output display may be projected on different surfaces. Also, a single projection image is divided and oriented using a mirror system.

  Japanese Patent Laid-Open No. 8-76923 (Patent Document 6) discloses a display integrated type in a transmissive projector in which an image is displayed on a display area of a display surface and light from a light source is transmitted through the display surface. Use the tablet to detect the coordinate position of the tip of the input pen attached to it, set the processing area in the display area, enable the input pen to point in the processing area, and scatter part of the light from the light source The scattering sheet is arranged immediately below the processing area, and the light from the light source is scattered by the processing area by the scattering sheet so that the processing area can be seen from the operator side position, but the processing area is displayed on the screen. A projection display device to be eliminated is disclosed.

Japanese Patent Application Laid-Open No. 8-328695 (Patent Document 7) discloses an electronic device with a projection display function that enables display screen display and projection display to be switched or simultaneously displayed by a display switching key. By removing the display unit, the display unit can display a projected display without being in the way.
JP 2000-305706 A JP 2000-66818 A JP 2007-108507 A Japanese Patent Laid-Open No. 2006-29579 JP-A-2005-38422 JP-A-8-76923 JP-A-8-328695

  However, in the above prior art, in order to indicate a point desired by the user, a complicated and expensive virtual touch sensor is provided in the projector, or another device, that is, a laser pointer or other information device is prepared separately from the projector. There was a need to do.

  The present invention has been made to solve the above problems, and a main object of the present invention is to provide a projector including a simple virtual touch sensor.

  In order to solve the above-described problem, a projector according to a first aspect of the present invention provides a laser light source that supplies a laser beam according to an input image signal, a scanning unit that scans the laser beam, and an external obstacle. A light receiving sensor for receiving the reflected light of the reflected laser light, and a calculating means for calculating the position information of the external obstacle based on the received reflected light, and the image signal includes a vertical synchronizing signal and a horizontal synchronizing signal. And the light receiving sensor obtains the light receiving height in the vertical direction of the reflected light received, and the calculating means includes the light receiving height in the vertical direction of the reflected light and the vertical synchronization signal of the laser light corresponding to the reflected light. Position information is calculated based on the horizontal synchronization signal.

  A projector according to a second aspect of the present invention includes a laser light source that supplies laser light according to an input image signal, a scanning unit that scans the laser light, and reflected light of the laser light reflected by an external obstacle. Based on the received light sensor, the calculation means for calculating the position information of the external obstacle and the temporal change information of the position based on the received reflected light, and the calculated position information and the temporal change information The image signal includes a vertical synchronizing signal and a horizontal synchronizing signal, and the light receiving sensor obtains a light receiving height in the vertical direction of the received reflected light, and The calculation means calculates the position information based on the light reception height in the vertical direction of the reflected light and the vertical synchronization signal and horizontal synchronization signal of the laser light corresponding to the reflected light.

  A projector according to a third aspect of the present invention includes a laser light source that supplies laser light according to an input image signal, a scanning unit that scans the laser light, and reflected light of the laser light reflected by an external obstacle. And a calculating means for calculating the position information of the external obstacle based on the received reflected light, the image signal includes a vertical synchronization signal, and the light receiving sensor is configured to receive the received reflected light. The light receiving position in the horizontal direction and the vertical direction is acquired, and the calculation means calculates the position information based on the light receiving position in the horizontal direction and the vertical direction of the reflected light and the vertical synchronization signal of the laser light corresponding to the reflected light. To do.

  A projector according to a fourth aspect of the present invention includes a laser light source that supplies laser light according to an input image signal, a scanning unit that scans the laser light, and reflected light of the laser light reflected by an external obstacle. Based on the received light sensor, the calculation means for calculating the position information of the external obstacle and the temporal change information of the position based on the received reflected light, and the calculated position information and the temporal change information A generation means for generating an input command to the projector, the image signal includes a vertical synchronization signal, the light receiving sensor obtains a light receiving position in the horizontal direction and the vertical direction of the received reflected light, and the calculating means includes The position information is calculated based on the light receiving position of the reflected light in the horizontal and vertical directions and the vertical synchronization signal of the laser light corresponding to the reflected light.

  In the projector according to the first or third aspect, preferably, the projector further includes a beam splitter that divides the scanned laser light into a first direction and a second direction and outputs the first laser beam. The beam splitter includes an image signal and a second image signal, and the beam splitter is arranged in a part of the optical path of the scanned laser beam, and only the laser beam corresponding to the first image signal is transmitted in the first direction and the first direction. The output is divided into two directions.

  As described above, according to the present invention, a projector including a simple virtual touch sensor can be realized.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[Usage]
With reference to FIG. 1, a usage mode of the projector according to the present invention will be described. FIG. 1 is a diagram illustrating a state in which a laser projector 100 which is an aspect of a projector is installed. The projector 100 may be, for example, a mobile projector having a portable size, or may be a stationary projector.

  The projector 100 is used by being disposed on a table 120, for example. The projector 100 projects an image 132A for presentation (for display) toward a screen 130 (for example, a vertical wall). In addition, the projector 100 projects an image 122A for reference (input) similar to the presentation image 132A onto the upper surface of the table 120 so that the user of the projector 100 can refer to it. ing. The size of the image 122A is usually smaller than the size of the image 132A.

  The projector 100 according to the present embodiment includes a CCD (Charge Coupled Device) sensor 110, or a condensing lens (free curved surface lens 111) and a one-dimensional CMOS (Complementary Metal Oxide Semiconductor) array sensor 112. More specifically, in the projector according to the present embodiment, the image 122A for reference by the user (for input) includes an image 122F for the user to edit the image or the like.

[Hardware configuration]
Next, a specific configuration of projector 100 that is an example of projector 200 will be described with reference to FIG. FIG. 2 is a block diagram showing a hardware configuration of laser projector 100.

  The projector 100 includes a front-end FPGA (Field Programmable Gate Array) 310, a digital signal processor 320, an operation panel 330, a back-end block 340, an SDRAM (Synchronous Dynamic Random Access Memory) 344, a video RAM 345, 3 A wavelength laser light source 350.

  The front-end FPGA 310 includes a data / gradation converter 314, a timing controller 311, a data controller 312, and a bit data converter 313. The digital signal processor 320 includes a mirror servo block 321 and a converter 322.

  The three-wavelength laser light source 350 includes a laser control circuit 351, 352, 353, a green LD (Laser Diode) 361, a red-blue LD 362, a polarization beam splitter 363, a detector 370, a galvano mirror 372, and an actuator 373. And an optical system. The red-blue LD 362 according to the present embodiment is configured by integrating the red LD and the blue LD, but may be configured separately.

  The operation panel 330 is provided on the surface or side surface of the casing of the projector 100. Operation panel 330 includes, for example, a display device (not shown) that displays operation details and a switch (for example, a plus / minus button) that receives an operation input to projector 100. When the operation panel 330 accepts the operation, the operation panel 330 sends a signal corresponding to the operation to the CPU 341 of the back-end block 340.

  An image signal given from the outside of the projector 100 is input to the video interface 342. In one aspect, projector 100 includes external interface 343. The external interface 343 receives, for example, mounting of the SD card 380. The external interface 343 reads data from the SD card 380, and the data is stored in the SDRAM 344 or the video RAM 345.

  The CPU 341 controls the projection of an image based on a signal input to the projector 100 via the video interface 342 and the external interface 343 based on an operation input given to the operation panel 330. More specifically, the CPU 341 controls display of video based on image data temporarily held in the video RAM 345 by communicating with the timing controller 311 of the front-end FPGA 310.

  In the front-end FPGA 310, the timing controller 311 reads out data held in the video RAM 345 via the data controller 312 based on a command sent from the CPU 341. The data controller 312 sends the read data to the bit data converter 313. The bit data converter 313 sends the data to the data / gradation converter 314 based on a command from the timing controller 311. The bit data converter 313 converts image data given from the outside into data suitable for a format for projection by laser emission.

  The data / gradation converter 314 converts the data output from the bit data converter 313 into gradations of colors for display as three colors of G (green), R (Red), and B (Blue). The converted data is sent to the laser control circuits 351, 352, and 353, respectively.

  On the other hand, the timing controller 311 controls the driving of the biaxial galvanometer mirror 372 with the digital signal processor 320. More specifically, the timing controller 311 sends a command to the mirror servo block 321 to drive the actuator 373. Actuator 373 changes the position and tilt of biaxial galvanometer mirror 372 in accordance with the command. That is, the timing controller 311 sends a signal to the actuator 373 via the mirror servo block 321, and the actuator 373 changes the direction of the galvano mirror 372 based on the signal, whereby the three-wavelength laser light source 350 has three-wavelength laser light. Scan.

  The converter 322 performs A / D (Analog to Digital) conversion on the signal sent from the CCD sensor 110 (or one-dimensional CMOS array sensor 112) based on the signal sent from the timing controller 311 and converts the converted digital signal. Data is sent to the CPU 341. For example, when the CCD sensor 110 captures an image of a subject within the imageable range, the image signal of the subject is sent to the CPU 341. When the setting for displaying an image captured by the CCD sensor 110 is valid, the CPU 341 transmits a command to the timing controller 311 to display an image based on the data.

  The converter 322 transmits a signal sent from the mirror servo block 321 to the CPU 341. For example, the converter 322 generates a signal including a command given to the actuator 373 and the state of the actuator 373, and sends the signal to the CPU 341.

  The laser control circuit 351 controls driving of the green LD 361 based on a signal sent from the data / gradation converter 314. Similarly, the laser control circuits 352 and 353 control each of the red LD and the blue LD in accordance with a command sent from the data / gradation converter 314. Each of the green LD 361 and the red blue LD 362 emits laser light in accordance with the control.

  The polarization beam splitter 363 is disposed on the optical path of the laser light emitted from the green LD 361. The polarization beam splitter 363 transmits the green LD 361. Further, the polarization beam splitter 363 partially transmits the red-blue LD 362 and partially reflects it. The detector 370 is disposed on the optical path of each laser beam emitted from the red / blue LD 362. Each laser beam transmitted through the polarization beam splitter 363 is collected in a certain range via the lens 371 and reflected by the biaxial galvanometer mirror 372. The reflected light is projected outside the projector 100. At this time, the biaxial galvanometer mirror 372 changes its inclination by driving the actuator 373, so that the reflected light is irradiated from the three-wavelength laser light source 350 to the outside while being scanned.

  With reference to FIG. 3, the optical system of the three-wavelength laser light after being reflected by the galvanometer mirror 372 will be described. FIG. 3 is an image diagram showing the optical system of the three-wavelength laser light after being reflected by the galvanometer mirror 372. The three-wavelength laser light irradiated while being scanned by the galvanometer mirror 372 of the three-wavelength laser light source 350 passes through the collimator lens 381 and becomes parallel light. Thereafter, the three-wavelength laser light is modulated by the spatial light modulator 382 and irradiated onto the beam splitter 383.

  The beam splitter 383 is disposed on a part of the optical path of the three-wavelength laser light. As a result, only the laser irradiated to the beam splitter 383 out of the three-wavelength laser light is reflected (refracted) by the beam splitter 383 and projected toward the screen 130. Of the three-wavelength laser light, the laser that passes through the optical path where the beam splitter 383 is not arranged is projected in the direction of the table 120 without being reflected (refracted) by the beam splitter 383.

  That is, the beam splitter 383 is arranged so as to be split by reflecting only a part of the laser that has passed through the spatial light modulator 382. A part of the laser is a laser for displaying the image 132A for presentation. In other words, the CPU 341 controls the front-end FPGA 310, the three-wavelength laser light source 350, and the like so that the beam splitter 383 reflects only a region desired to be irradiated on the screen 130 as the presentation image 132A.

  A magnifying lens 384 for diffusing the three-wavelength laser light and irradiating the screen 130 with the beam splitter 383 in the screen 130 direction is disposed. On the other hand, a magnifying lens 385 for diffusing the three-wavelength laser light to irradiate the table 120 is also arranged on the downstream side of the beam splitter 383 in the table 120 direction. Accordingly, a part of the laser from the three-wavelength laser light source 350 divided by being reflected by the beam splitter 382 passes through the magnifying lens 384. A part of the laser from the three-wavelength laser light source 350 is emitted from the projector 100 to the screen 130.

  On the other hand, the three-wavelength laser light that has passed through the beam splitter 383 passes through the magnifying lens 385 together with the three-wavelength laser light that has not passed through the beam splitter 383, and a mirror or lens (not shown) (for example, in FIGS. 5 and 7). Irradiated to the table 120 or the like via the lens 386). The three-wavelength laser light that has passed through the beam splitter 383 and the three-wavelength laser light that has not passed through the beam splitter 383 display an image 122A for reference by the user. The three-wavelength laser light transmitted through the beam splitter 383 displays an image similar to the image 132A projected on the screen 130.

  On the other hand, the three-wavelength laser light that has not passed through the beam splitter 383 displays an image that does not appear in the presentation image 132A projected on the screen 130, and the user edits the image and the like. The dedicated image 122F is displayed. In the dedicated image 122F for reference by the user, for example, a comment corresponding to the image 132A currently being projected can be entered. Thus, only the user can refer to the dedicated image 122F during the display of the image 132A. That is, even if the user does not remember a comment or the like to be spoken during the display of the image 132A, the presentation can proceed smoothly.

[Function configuration]
With reference to FIG. 4, a functional configuration of projector 200 according to the present invention will be described. FIG. 4 is a block diagram illustrating a configuration of functions included in projector 200. The projector 200 includes a laser light source (361, 362), a scanning unit (372), a beam splitter 383, a light receiving sensor (110, 112), a calculation unit (341-1), and a display control unit (341-2). ) And a generation unit (341-3).

  The laser light source is realized by, for example, a green LD 361 and a red-blue LD 362, and supplies laser light according to an image signal input to the CPU 341.

  The scanning unit is realized by, for example, a galvanometer mirror 372, and scans and irradiates the screen with a three-wavelength laser beam.

  The beam splitter 383 divides the scanned laser light into a first direction and a second direction and outputs the divided laser light. Specifically, the beam splitter 383 is arranged in a part of the optical path of the scanned laser beam, and divides only the laser beam corresponding to the first image signal into the first direction and the second direction. Output.

  The light receiving sensor is realized by the CCD sensor 110 or the one-dimensional CMOS array sensor 112, and the reflected light reflected by the external obstacle 10 out of the first laser light A projected in the first direction. B is received. Specifically, the light receiving sensor is realized by, for example, the CCD sensor 110, and acquires the light receiving position (light receiving direction) in the horizontal direction and the vertical direction of the reflected light B received. Alternatively, the light receiving sensor is realized by, for example, the one-dimensional CMOS array sensor 112, and acquires the light receiving height (vertical component in the light receiving direction) in the vertical direction of the received reflected light B.

  The calculation unit 341-1, the display control unit 341-2, and the generation unit 341-3 are realized by, for example, reading a control program stored in the SDRAM 344 by the CPU 341 and executing the program by the CPU 341. Is.

  The calculation unit 341-1 calculates the position information of the external obstacle 10 based on the reflected light B received by the light receiving sensor. Further, the calculation unit 341-1 calculates the position information of the external obstacle 10 and the temporal change information of the position based on the received reflected light B. Specifically, the calculation unit 341-1 calculates the position where the direction (vector) intersects from the incident direction (incident vector) of the reflected light B and the emission direction (emitted vector) of the three-wavelength laser light A, and the position It is understood that the external obstacle 10 exists. And the calculation part 341-1 calculates the lowest end position of the external obstruction 10, and grasps | ascertains the temporal change (for example, moving direction of the lowest end position, etc.) of the said lowest end position.

  More specifically, the calculation unit 341-1 receives the reflected light B transmitted from the CCD sensor 110 in the horizontal direction and the vertical direction (light receiving direction) and the vertical synchronization signal of the first laser light corresponding to the reflected light B. Based on the above, the position information of the external obstacle 10 is calculated. That is, since the calculation unit 341-1 can determine the height of the outgoing light A by acquiring the vertical synchronization signal, the position corresponding to the height in the path (vector) of the reflected light B is It can be recognized as the surface of the external obstacle 10.

  Alternatively, the calculation unit 341-1 receives light in the vertical direction of the reflected light B transmitted from the one-dimensional CMOS array sensor 112 (vertical component in the light receiving direction) and the vertical of the first laser light corresponding to the reflected light B. Based on the synchronization signal and the horizontal synchronization signal, position information of the external obstacle 10 is calculated. That is, since the calculation unit 341-1 can determine the direction of the outgoing light A by acquiring the vertical synchronizing signal and the horizontal synchronizing signal, the reflected light in the path (vector) of the outgoing light A A position corresponding to the light receiving height of B (a vertical component in the light receiving direction) can be recognized as the surface of the external obstacle 10.

  The display control unit 341-2 is based on the calculated position information, and externally in the second image represented by the second laser light projected in the second direction via the laser light source and the scanning unit. A pointer is displayed at a position corresponding to the position of the obstacle 10.

  The generation unit 341-3 supplies the projector (CPU 342) to the projector (CPU 342) based on the calculated position information of the external obstacle 10 (at the bottom end) and the time-dependent change information of the position of the external obstacle 10 (at the bottom end). Generate input instructions. For example, the generation unit 341-3 lifts the external obstacle 10 from the position information calculated by the calculation unit 341-1 after the external obstacle 10 contacts a part of the dedicated image 122 </ b> F irradiated on the table 120. Recognize that Then, the generation unit 341-1 generates a command corresponding to the operation of the external obstacle 10 based on the recognition result, and passes the command to another application or the like.

[Positioning method]
Hereinafter, the obstacle position specifying process by the projector 100 according to the present embodiment will be described in detail with reference to FIG. The laser light emitted from the three-wavelength laser light source 350 corresponds to one pixel. The actuator 373 and the galvanometer mirror 372 form images on the screen 130 and the table 120 by scanning the laser light in the horizontal direction and the vertical direction at high speed (by scanning the screen).

  A CCD sensor 110 is provided on the rear surface of the lower part of the projector 100. The CCD sensor 110 outputs a signal generated by the light receiving element based on the received reflected light B to the converter 322, and the converter 322 performs A / D conversion on the signal to convert the digital signal to the CPU 341. Output. As a result, the projector 100 causes the external obstacle 10 that has entered the image 122A on the user side, more specifically, on the optical path of the three-wavelength laser light A (first laser light) for forming the image 122A. It is possible to detect the external obstacle 10 that has entered the area.

  FIG. 5 is an image diagram showing laser light A emitted from projector 100 and reflected light B received by CCD sensor 110. FIG. 6 is an image diagram showing the light receiving pixels of the reflected light B received by the CCD sensor 110. As shown in FIGS. 5 and 6, for example, it is assumed that the reflected light B is received from the light receiving pixel 1a by the light receiving pixel 1z. At this time, the CCD sensor 110 performs sensing in synchronization with the three-wavelength laser light for forming the image 132A projected on the screen 130, whereby the three-wavelength laser light A with respect to the reflected light B received by the light-receiving pixel 1a. It is possible to recognize which position in the image 122A corresponds to the laser beam.

  In this way, the CPU 341 calculates the three-wavelength laser light from the light receiving position (incident direction) of the reflected light B obtained by the CCD sensor 110 and the irradiation direction of the three-wavelength laser light A corresponding to the reflected light B. It is possible to calculate the three-dimensional position information of the intersection between A and the reflected light B. Thereby, it is also possible to calculate the height of the lowest point of the external obstacle 10 from the reference plane (for example, the table 120). It is also possible to grasp whether the user has touched the image 122A on which the external obstacle 10 is displayed or whether the pen tip of the external obstacle 10 is located in the air.

  When the CPU 341 can also acquire the horizontal synchronization signal of the three-wavelength laser light A, the horizontal position of the external obstacle 10 can also be calculated, so the CCD sensor 110 is a one-dimensional CMOS array sensor 112. There may be. Hereinafter, a configuration in which the CPU 341 acquires a horizontal synchronization signal and calculates the position and movement (time-dependent change) of the external obstacle 10 based on a signal obtained from the one-dimensional CMOS array sensor 112 will be described.

  FIG. 7 is a schematic diagram of an optical system of a virtual touch panel as an input interface portion in a state where there is no external obstacle. As shown in FIG. 7, the screen on the operator side from the laser projector 100 is scanned with the three-wavelength laser light A in the x direction and the y direction, similarly to the presentation screen, and one image 122A is generated. Each pixel irradiated on the screen for the operator is received by the one-dimensional CMOS array sensor 112 through the free-form surface lens 111.

  FIG. 8 is an image diagram showing a time sequence of detection light received by the one-dimensional CMOS array sensor 112 in a state where there is no external obstacle. As shown in FIG. 8, one of the surfaces stretched in the x direction and the (y + z) direction represents data acquired when one line is scanned in the horizontal direction (x-axis direction). By sequentially reading this data, the CPU 341 acquires image data for one frame via the one-dimensional CMOS array sensor 112 as shown in FIG. In FIG. 8, a dot-displayed area is a range where the reflected light B is obtained as screen image detection data, and the image data for one frame is sequentially obtained for each line as data in the y direction.

  FIG. 9 is a schematic diagram of the optical system of a virtual touch panel as an input interface portion in a state where an external obstacle is positioned on the reference plane. That is, FIG. 9 shows a case where the external obstacle 10 (here, a rod-shaped pen or the like) is inserted on the projection optical path of the three-wavelength laser light A and the external obstacle 10 touches the bottom surface. ing. As shown in FIG. 9, a part of the image projected by the external obstacle 10 is reflected on the external obstacle 10 and received by the one-dimensional CMOS array sensor 112 through the free-form surface lens 111. In this case, FIG. 10 shows an image received by the one-dimensional CMOS array sensor 112.

  FIG. 10 is an image diagram showing a time sequence of detection light received by the one-dimensional CMOS array sensor in a state where the external obstacle is positioned on the reference plane. As shown in FIG. 10, when the y signal scan is still in the beginning (the left portion of the image 122A in FIG. 9), the laser beam A hits the obstacle 10 and is actually reflected on the one-dimensional CMOS array sensor 112. Light is received above the position (when reflected by the reference plane, that is, the table 120). Then, when the scanning progresses sequentially in the y direction and the scanning operation reaches the tip of the rod (external obstacle 10), the reflected light B is detected at the same position as when there is no obstacle 10. Thereafter, since the reflected light B is detected without being affected by the obstacle 10, the light is sequentially received at the reflection positions similar to the states in FIGS.

  With the above configuration, the XY coordinates on the image 122A touched by the external obstacle 10 can be obtained by comparing the detection position of the reflected light B when there is no external obstacle 10.

  FIG. 11 is a schematic diagram of an optical system of a virtual touch panel as an input interface portion in a state where the external obstacle 10 is lifted. That is, in FIG. 11, the external obstacle 10 is inserted on the optical path of the projected three-wavelength laser light A, and the external obstacle 10 is not touching the reference plane (table 120) and is floating in the air. Shows the case. In this case, FIG. 12 shows how the light is received by the one-dimensional CMOS array sensor 112.

  FIG. 12 is an image diagram showing a time sequence of detection light received by the one-dimensional CMOS array sensor in a state where the external obstacle is lifted. As shown in FIG. 12, as in FIG. 10, when the y signal scan is still at the start point, the laser beam A hits the obstacle 10 and the actual position (reference plane) on the one-dimensional CMOS array sensor 112. That is, the light is received above (when reflected by the table 120). However, in this case, since the obstacle 10 floats in the air from the table on which the image 122A is displayed, the detection position of the reflected light B when there is the obstacle 10 and the case where there is no obstacle 10 The difference from the detection position of the reflected light B does not coincide with the position of the y coordinate that is continuously reduced.

  In other words, at a position having a certain y coordinate, the detection position of the reflected light B coincides with the detection position when there is no obstacle 10 by skipping a plurality of pixels. That is, as shown in FIG. 10, when the difference between the detection position of the reflected light B when there is an obstacle 10 and the detection position of the reflected light B when there is no obstacle 10 is sequentially traced, it is linear. Instead of changing, it becomes non-linear (inclination changes) at the tip position of the obstacle 10. From the above, when such a y-axis position is detected, it can be recognized that the external obstacle 10 has not touched the projected portion of the image 122A.

  As described above, the image of the reflected light B acquired by the sensor is compared between the initial case where there is no external obstacle 10 and the current state while observing the timing of horizontal synchronization and vertical synchronization for scanning. It is possible to recognize whether there is an object 10 and whether the obstacle 10 is touching the projection surface.

[Aging information acquisition process]
FIG. 13 is a flowchart showing a processing procedure of the time-dependent change information acquisition processing of the position of the external obstacle 10 based on the position of the external obstacle 10 recognized as described above.

  The CPU 341 always acquires the scanning result of the reflected light B from the CCD sensor 110 (one-dimensional CMOS array sensor 112) via the converter 322. Then, every time scanning for one frame is completed, that is, every time projection of the images 122A and 132A for one frame is completed (in the case of YES in step 101, the step is abbreviated as S below), the CPU 341 externally. The position information of the lowest point of the obstacle 10 is calculated (S102).

  Then, it is determined whether or not the lowest point has reached a reference plane (for example, the table 120 plane) (S103). If it has been reached (YES in S103), the horizontal position is calculated (S104). The CPU 341 passes the horizontal position to the active application (S105), and ends the process for the frame. If not reached (NO in S103), information on whether or not the lowest point has been reached during the previous frame scan is read from the storage unit (eg, SDRAM 344), and the lowest point is reached during the previous frame scan. A determination is made as to whether or not it has been (S106).

  If the lowest point has been reached during the scan of the previous frame (YES in S106), the CPU 341 determines that the touch operation has been input by the external obstacle 10, generates a command for the touch operation, and starts it It passes to the middle application (S107), and the process for the frame is terminated. On the other hand, if the lowest point has not been reached during the scan of the previous frame (NO in S106), the processing for the frame is terminated.

[Usage mode for application]
Hereinafter, a method of using the position information of the external obstacle 10 and the time-dependent change information of the position calculated by the CPU 341 in another application will be described. FIG. 14 shows a specific installation example when the operation screen is output only to the operator screen (dedicated image 122F) by splitting the beam with a prism and providing a slit, for example, an image editing application It is an image figure which shows the state in which the screen of is displayed. As shown in FIG. 14, an image 122F equivalent to the presentation projection screen (image 132B) is projected on the operator's screen (table 120), and the lower part has several functions. It is assumed that the icon (dedicated image 122F) is displayed.

  FIG. 14 is an image diagram showing a function when the round icon of the image 122A (122F) is touched by the external obstacle 10. By touching the reference plane (table 120) of the image 122B with the obstacle 10 like the position s1 of the image 122B, the projector 100 recognizes the touch operation, and the image editing application enters the marker mode. Next, as shown in the figure by tracing the screen from the position s2 to s3 of the image 122B, on the presentation screen, a specific mark (here, a red circle) is placed on the screen on the operator side from s2 to s3. It moves between the position and the same position. Although not shown here as an example, the marker design on the presence clean can be changed by separately preparing and selecting the mark type as an icon in the marker mode.

  FIG. 15 is an image diagram showing a function when the pen icon of the image 122A is touched by the external obstacle 10. By touching the screen surface of the pen icon portion of the image 122A (122F) as at the position t1, the draw mode is set. Next, by tracing the screen from t2 to t3 of the image 122C, a line drawing is drawn on the presentation screen 130 (image 132C) as shown in the figure. Although not shown here as an example, various types of line drawings can be drawn on the presence clean by separately preparing and selecting the pen color and thickness with icons in the draw mode.

  FIG. 16 is an image diagram showing a function when the eraser icon (position u1) of the image 122A is touched by the external obstacle 10. As shown in FIG. 16, the erase mode is set by touching the screen surface of the icon portion of the eraser. Next, by tracing the screen on the operator side from the position u2 to the position u3 in a zigzag manner, as shown in FIG. 16, in the image 132D projected on the presentation screen 130, that portion of the image data can be erased. it can. Although not shown as an example here, it is possible to switch to a mode in which the thickness of the eraser is changed separately in the erase mode or a mode in which only the line drawing drawn in the draw mode is erased.

  FIG. 17 is an image diagram showing a function when the zoom icon of the image 122A (122F) is touched by the external obstacle 10. As shown in FIG. 17, by touching the screen surface of the zoom icon portion of the image 122E, specifically, when the position v1 of the image 122E is touched by the external obstacle 10, the image editing application shifts to the zoom mode. . Next, in the image 122E, by touching the position v2 and the position v3 in order, a square portion having the two points as diagonal points is zoomed up, and the image 132E after being zoomed up on the presentation screen 130 is displayed. Is projected.

  As shown in FIGS. 14 to 17, by clicking the Clear icon at the right end of the icon row of the dedicated image 122F, the image 132A on the presentation screen 130 being edited can be reset.

  As described above, by including the icon image (dedicated image 122F) in the image of only the image 122A, the projection screen can be edited using only the projector 100 without using an input interface such as a remote controller.

[Modification]
Hereinafter, modifications of the embodiment of the present invention will be described. FIG. 18 is a side perspective view of projector 600 showing a modification of the present embodiment. As shown in FIG. 18, projector 600 according to this modification is different from projector 100 according to the above-described embodiment in that the position of an obstacle is specified by infrared rays in addition to three-wavelength laser light A.

  Specifically, the projector 600 includes an infrared light emitting unit 601 and a CCD sensor 602. Similarly to the projector 100 described above, the projector 600 projects a desired image onto a presentation screen 130, for example, and irradiates the image on the table 120 as well. The user designates a position to be designated by positioning the finger of the user or a pen held by the user at a position corresponding to the position to be pointed on the screen 130 in the image 122A of the table 120.

  While the image is projected, the infrared light emitting unit 601 of the projector 600 emits infrared light. When the user's finger or pen is positioned on the image 122A of the table 120, infrared light is applied to the finger or pen. The infrared light reflected by the finger or pen is received by the CCD sensor 602. Based on the information obtained from the received infrared rays, the CPU of the projector 600 calculates the position of an obstacle such as a finger or pen, and displays a specific mark (pointer) on the presentation screen 130, for example.

  Also, characters and illustrations are virtually displayed on the image 122A projected on the table 120 by switching the recognition mode by clicking a specific method, for example, by clicking a specific position on the screen or by transmitting a command with the remote controller. When written, characters and illustrations are displayed as an overlay on the presentation image 132A. Then, such an image may be stored as an image multiplexed in a memory such as an SD card attached to the projector 600, and may be configured to be printed later.

  With such a configuration, in the laser projectors 100 and 600, the user does not need to stand near the screen 130, and illustrations, marks, and the like can be supported on the screen 130. As a result, the laser is in the eyes of the user. It is possible to prevent erroneous incidence.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure showing the state in which the laser projector which is one mode of the projector concerning the present invention was installed. It is a block diagram showing the hardware constitutions of a laser projector. It is an image figure which shows the optical system of the 3 wavelength laser beam after reflecting with a galvanometer mirror. It is a block diagram showing the structure of the function with which a projector is provided. It is an image figure which shows the reflected light received by the laser beam and CCD sensor which are irradiated from a projector. It is an image figure which shows the light reception pixel of the reflected light received by a CCD sensor. It is a schematic diagram of an optical system of a virtual touch panel as an input interface portion in a state where there is no external obstacle. It is an image figure which shows the time sequence of the detection light received with the one-dimensional CMOS array sensor in the state without an external obstruction. It is a schematic diagram of an optical system of a virtual touch panel as an input interface part in a state where an external obstacle is located on a reference plane. It is an image figure which shows the time sequence of the detection light received with the one-dimensional CMOS array sensor in the state where the external obstacle was located in the reference plane. It is a schematic diagram of an optical system of a virtual touch panel as an input interface part in a state where an external obstacle is lifted. It is an image figure which shows the time sequence of the detection light received with the one-dimensional CMOS array sensor in the state where the external obstacle was lifted. It is a flowchart which shows the process sequence of a time-dependent change information acquisition process of the position of an external obstruction. It is an image figure which shows a function when the circle icon of an image is touched with the external obstacle. It is an image figure which shows a function when the pen icon of an image is touched with the external obstacle. It is an image figure which shows a function when the icon of the eraser of an image is touched with the external obstacle. It is an image figure which shows a function when the zoom icon of an image is touched with the external obstacle. It is a side perspective view of the laser projector which shows the modification of embodiment of this invention.

  10 external obstacles, 100 laser projector, 110, 602 CCD sensor, 112 one-dimensional CMOS array sensor, 120 table, 130 screen, 200 projector, 311 timing controller, 312 data controller, 313 bit data converter, 314 gradation converter , 320 Digital signal processor, 321 mirror servo block, 321 mirror servo block, 322 converter, 330 operation panel, 340 back end block, 342 video interface, 343 external interface, 350 wavelength laser light source, 351, 352, 353 laser control circuit , 363 polarization beam splitter, 370 detector, 372 galvanometer mirror, 373 actuator, 381 collimating lens, 382 spatial light modulator, 383 beam splitter, 600 projector, 601 infrared light emitting unit.

Claims (5)

A laser light source for supplying laser light in accordance with an input image signal;
A scanning unit that scans the laser beam;
A light receiving sensor for receiving the reflected light of the laser beam reflected by an external obstacle;
Calculating means for calculating position information of an external obstacle based on the received reflected light;
The image signal includes a vertical synchronization signal and a horizontal synchronization signal,
The light receiving sensor obtains a light receiving height in a vertical direction of reflected light received;
The projector calculates the position information based on a light receiving height in a vertical direction of the reflected light, and a vertical synchronization signal and a horizontal synchronization signal of the laser light corresponding to the reflected light. A projector,
A laser light source for supplying laser light in accordance with an input image signal;
A scanning unit that scans the laser beam;
A light receiving sensor for receiving the reflected light of the laser beam reflected by an external obstacle;
Based on the received reflected light, the calculation means for calculating the position information of the external obstacle and the temporal change information of the position;
Generating means for generating an input command to the projector based on the calculated position information and the temporal change information;
The image signal includes a vertical synchronization signal and a horizontal synchronization signal,
The light receiving sensor obtains a light receiving height in a vertical direction of reflected light received;
The projector calculates the position information based on a light receiving height in a vertical direction of the reflected light, and a vertical synchronization signal and a horizontal synchronization signal of the laser light corresponding to the reflected light. A laser light source for supplying laser light in accordance with an input image signal;
A scanning unit that scans the laser beam;
A light receiving sensor for receiving the reflected light of the laser beam reflected by an external obstacle;
Calculating means for calculating position information of an external obstacle based on the received reflected light;
The image signal includes a vertical synchronization signal,
The light receiving sensor acquires a light receiving position in a horizontal direction and a vertical direction of reflected light received,
The projector calculates the position information based on a light receiving position in a horizontal direction and a vertical direction of the reflected light and a vertical synchronization signal of the laser light corresponding to the reflected light. A projector,
A laser light source for supplying laser light in accordance with an input image signal;
A scanning unit that scans the laser beam;
A light receiving sensor for receiving the reflected light of the laser beam reflected by an external obstacle;
Based on the received reflected light, the calculation means for calculating the position information of the external obstacle and the temporal change information of the position;
Generating means for generating an input command to the projector based on the calculated position information and the temporal change information;
The image signal includes a vertical synchronization signal,
The light receiving sensor acquires a light receiving position in a horizontal direction and a vertical direction of reflected light received,
The projector calculates the position information based on a light receiving position in a horizontal direction and a vertical direction of the reflected light and a vertical synchronization signal of the laser light corresponding to the reflected light. A beam splitter that divides and outputs the scanned laser light in a first direction and a second direction;
The image signal includes a first image signal and a second image signal,
The beam splitter is disposed in a part of the optical path of the scanned laser beam, and outputs only the laser beam corresponding to the first image signal in the first direction and the second direction. The projector according to claim 1 or 3.

Images