JP2016103060A - Image projection device, image projection system, and video supply device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To correctly recognize a double click operation with a pointing device irrespective of the distance between a projection image and the pointing device.SOLUTION: An image projection device 1 includes: a distance estimating part 31 that estimates the distance between a screen 130 and an electronic pen 50; and a double click determination part 32 that sets, when detecting continuous click operations of the electronic pen 50, a displacement allowable value between a first click position and a second click position in recognizing a double click operation according to the distance estimated by the distance estimating part 31, and determines whether the continuous click operations is a double click operation or continuous single click operations on the basis of the displacement allowable value.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an image projection device, an image projection system, and a video supply device.

  Projectors widely known as image projection apparatuses have recently been improved in the resolution and the price of liquid crystal panels with higher resolution, light source lamps with higher efficiency. In addition, compact and lightweight image projectors using DMD (Digital Micro-mirror Device) have become widespread, and these image projectors are widely used not only in offices and schools but also at home.

  2. Description of the Related Art In recent years, in an image projection system in which an image projection apparatus and a video supply apparatus (information processing apparatus) such as a personal computer are connected, a user has applied a projection image projected on a projection surface (screen) from the image projection apparatus. 2. Description of the Related Art An interactive image projection system (also referred to as an interactive system) that enables a pointer operation on a screen and a handwriting input operation of characters and figures using a pointing device such as an attached electronic pen is known. There is also known a pointing device (remote pointing device) that can operate a projected image even at a position away from the screen. In addition, a pointing device that can perform a left-click operation, a right-click operation, a double-click operation, and the like on a projection image of an image input from a video supply device is also known, as with a general mouse.

  In these interactive systems, there is a method in which information for determining position information is included in a projection image and projected, and the position information in the projection image is read by the pointing device to detect the operation position of the pointing device. Are known. In this interactive system, the operation position of the pointing device is transmitted from the pointing device to the video supply device via the image projection device or directly, and is reflected in the operation on the video supply device.

  There is also known a system that includes an imaging device inside or outside the image projection device and detects the operation position of the pointing device based on an image obtained by imaging the projection surface. In this interactive system, a laser pointer or the like is used as a pointing device, and the irradiation position of the laser pointer that is visibly displayed on the projection image is imaged by an imaging device, and this data is directly transmitted through the image projection device or directly. By transmitting to the video supply device, it is reflected in the operation of the video supply device.

  For example, in Patent Document 1, a part of the image on the display screen is irradiated with light, a screen including the irradiation spot is captured with a video camera, a light irradiation position is obtained from the photographed signal, and coordinate position information is pointed to a personal computer. A pointing system for sending information is disclosed.

  However, in a conventional interactive system, when a pointing device having the same function as a mouse is double-clicked at a position away from the projected image, a double-clicking operation with a mouse placed on a plane such as a desk is performed. On the other hand, since the influence of camera shake becomes large, the operation position of the first click and the operation position of the second click of the double-click operation are shifted and may not be recognized as a double-click. In addition, there is a problem that unintentional operation content is obtained by determining that the two independent click operations are performed. This is because the determination of double-clicking is performed based on the same standard regardless of whether the pointing device is operated on or near the screen or at a position away from the screen.

  SUMMARY An advantage of some aspects of the invention is that it provides an image projection apparatus that can correctly recognize a double-click operation by a pointing device regardless of the distance between the projected image and the pointing device.

  In order to achieve such an object, an image projection apparatus according to the present invention includes an image projection apparatus that projects a projection image on a projection surface, a video supply apparatus that supplies projection information to the image projection apparatus, and at least a projection image on the projection image. And a pointing device capable of clicking at the specified position, and a distance estimation method for estimating a distance between the projection surface and the pointing device And a first click position and a second click position when recognizing a double click operation according to the distance estimated by the distance estimation unit when detecting a continuous click operation of the pointing device. Set the allowable deviation value, and based on the allowable deviation value, double click operation or continuous single click operation. And double-click determining unit determines, those having a.

  According to the present invention, it is possible to correctly recognize a double-click operation by a pointing device regardless of the distance between the projected image and the pointing device.

It is a schematic block diagram which shows an example of an image projection system. It is an external appearance perspective view which shows one Embodiment of an image projector. It is a side view of an image projection device, and is a diagram showing a projection state on a projection surface. 2A is a perspective view showing a state in which an exterior cover of the image projection apparatus is removed, and FIG. 3B is an enlarged configuration diagram of a circled portion of FIG. It is sectional drawing of an illumination unit, a projection unit, an image display element unit, and a light source unit. It is a functional block diagram of an image projector. It is a functional block diagram of an electronic pen. It is a functional block diagram of a video supply device. It is a schematic diagram which shows a mode at the time of operating an electronic pen in the position away from the projection image. It is a schematic diagram which shows a mode at the time of operating an electronic pen in the close position of a projection image. It is the schematic (1) which shows a mode that the image projector is projecting a projection image on a screen. It is a flowchart of the double click determination process which an image projection apparatus performs. It is explanatory drawing of the distance estimation process of a screen and an electronic pen, Comprising: (A) A mode that the electronic pen was moved in the short distance of the screen, (B) A mode that the electronic pen was moved in the position away from the screen. It is an example of the distance estimation table of a screen and an electronic pen. It is the schematic (2) which shows a mode that the image projector is projecting a projection image on a screen. It is the schematic (3) which shows a mode that the image projector is projecting a projection image on a screen.

  Hereinafter, a configuration according to the present invention will be described in detail based on the embodiment shown in FIGS.

[First Embodiment]
In the present embodiment, a description will be given of an image projection system in which position information for reading by a pointing device is embedded in a projection image. As this method, for example, a technique called Pointblank of Texas Instruments is known, but position information is embedded in a projection image, the position information is read by a pointing device, and based on the read information, the pointing device Any device that can detect the point position may be used.

(Image projection system)
FIG. 1 is a schematic configuration diagram illustrating an example of an image projection system 100. The image projection system 100 includes an image projection device (projector) 1 and a video supply device 110 that supplies a video signal (also referred to as projection information) to the image projection device 1. The video supply device 110 is connected by a cable 120. The video signal includes an image signal for displaying a still image.

  The image projection device 1 is a projector that generates a video based on a video signal provided by the video supply device 110 and projects it onto a projection surface such as a screen 130. In FIG. 1, a projected image 140 is projected on the screen 130 from the image projector 1.

  The image projection apparatus 1 has an HDMI (High-Definition Multimedia Interface) (registered trademark) terminal, a DisplayPort terminal, a Thunderbolt terminal, a VGA (Video Graphics Array) input terminal, an S-VIDEO terminal, and an RCA terminal as interfaces for inputting video signals. Etc. are provided. The image projection apparatus 1 preferably includes a plurality of image input terminals. A video signal is received from the video supply device 110 via the cable 120 connected to the image input terminal. The cable 120 is a cable conforming to the communication interface, and is, for example, an HDMI cable.

  In addition, the image projection apparatus 1 may receive a video signal from the video supply apparatus 110 by wireless communication based on a wireless communication protocol such as Bluetooth (registered trademark) or WiFi (registered trademark).

  The video supply device 110 is a device that provides an image to be projected by the image projection device 1. The video supply device 110 includes an interface that outputs a video signal, and an image projection device that transmits a video signal forming a display image of the video supply device 110 at a predetermined transfer rate (for example, 30 fps (frame per second) to 60 fps). 1 to send.

  Similarly, the video supply device 110 includes image output terminals such as an HDMI terminal, a DisplayPort terminal, a Thunderbolt terminal, a VGA input terminal, an S-VIDEO terminal, and an RCA terminal as interfaces for outputting video signals. The image can be transmitted to the image projector 1 via the connected cable 120. Further, the video supply device 110 may transmit a video signal to the image projection device 1 by wireless communication.

  As the video supply device 110, for example, an information processing device capable of supplying a video signal such as a notebook PC, a desktop PC, a tablet PC, or a smartphone can be used. In the example shown in FIG. 1, one video supply device 110 is connected to the image projection device 1, but a plurality of video supply devices 110 may be connected to the image projection device 1.

  In addition, the image projection system 100 is an electronic pen 50 that is a pointing device that can perform various operations by operating the projected image 140 from a position on the screen 130 or away from the screen 130 while being held by the user. It has. The electronic pen 50 is connected to the image projection device 1 and the video supply device 110 or the video supply device 110 by wireless communication, and can transmit signals.

(Image projection device)
FIG. 2 is an external perspective view showing an embodiment of the image projector 1. FIG. 3 is a side view of the image projection apparatus 1 and shows a projection state on the screen 130.

  The image projection apparatus 1 includes a lamp as a light source and a large number of electronic boards inside the apparatus, and the internal temperature of the apparatus rises at startup. For this reason, the image projector 1 is provided with an intake port 11 and an exhaust port 12 so that internal components do not exceed the heat-resistant temperature.

  FIG. 4A is a perspective view showing a state in which the exterior cover 2 of the image projector 1 is removed. FIG. 4B is an enlarged configuration diagram of the optical engine 3 and the light source unit 4 indicated by a circled portion in FIG. As shown in FIG. 4, the image projection apparatus 1 includes an optical engine 3 and a light source unit 4. FIG. 5 is a cross-sectional view of the illumination unit 3a (illumination optical system), the projection unit 3b (projection optical system), the image display element unit 10, and the light source unit 4, which are illumination devices. The optical engine 3 includes an illumination unit 3a and a projection unit 3b.

  As shown in FIG. 4, an intake fan 13 and an exhaust fan 14 are provided inside the intake port 11 and the exhaust port 12, respectively, and by discharging outside air sucked from the intake fan 13 from the exhaust fan 14, Air cooling by forced air flow in the apparatus is performed.

  In the image projection apparatus 1, light (white light) from the light source of the light source unit 4 is applied to the illumination unit 3 a of the optical engine 3. In the illumination unit 3a, the irradiated white light is separated into RGB, and then guided to the image display element unit 10 by a lens, a mirror, etc., and an image display element unit 10 that forms an image according to the modulation signal and the image are projected onto the image display element unit 10 3b is enlarged and projected onto the screen 130.

  Various lamps can be used as the lamp 15 that is the light source of the light source unit 4. For example, an arc lamp such as a high-pressure mercury lamp or a xenon lamp can be used. For example, it is preferable to use a high-pressure mercury lamp.

  A fan 16 that cools the light source is provided on one side of the side surface of the light source unit 4. The rotation speed of the fan 16 is controlled so that each part of the light source unit 4 has a temperature within a set rated temperature range. Further, the emission direction of the light from the light source unit 4 and the emission direction of the image light from the projection unit 3b are approximately 90 ° as shown in FIG.

  The illumination unit 3a of the optical engine 3 includes a color wheel 5 (rotational color filter) that splits light emitted from the light source, a light tunnel 6 that guides light emitted from the color wheel 5, a relay lens 7, and a plane mirror. 8 and a concave mirror 9. An image display element unit 10 is provided in the illumination unit 3a.

  In the illumination unit 3a, first, white light, which is emitted light from the light source, is converted into light that repeats RGB colors per unit time by the disk-shaped color wheel 5 and emitted. The color-separated light emitted from the color wheel 5 is guided to the light tunnel 6. The light tunnel 6 is an illumination uniform conversion optical member that makes incident light uniform by being reflected and combined multiple times inside (inner wall).

  Next, the light emitted from the light tunnel 6 is condensed by correcting a longitudinal chromatic aberration of the light by a relay lens 7 formed by combining two lenses. Further, the light emitted from the relay lens 7 is reflected by the flat mirror 8 and the concave mirror 9 and is condensed on the image display element unit 10. The image display element unit 10 has a substantially rectangular mirror surface composed of a plurality of micromirrors, and each micromirror is driven in a time-sharing manner based on image data, so that projection light is formed so as to form a predetermined image. A DMD element 10a is provided as an image display element (light modulation element) that is processed and reflected.

  The image display element unit 10 selects the light output to the projection unit by switching on / off of the micromirror according to the input signal and expresses the gradation. That is, the DMD element 10a reflects the light used by the plurality of micromirrors to the projection lens and reflects the discarded light to the OFF light plate based on the image data in a time division manner. The light used in the image display element unit 10 is reflected to the projection unit 3b, and the image light magnified through the plurality of projection lenses in the projection unit 3b is magnified and projected onto the screen 130.

  FIG. 6 shows a functional block diagram of the image projector 1. The image projection apparatus 1 includes a video input terminal unit 20, a video / audio processing unit 21, an audio output unit 22, a lamp control unit 23, an optical control unit 24, an operation unit 25, an operation reception unit 27, an input / output interface 28, and a wireless communication unit. 29, a main control unit 30, a fan control unit 35, and the like.

  The video input terminal unit 20 is a terminal unit connected to the video supply device 110 with a cable 120, and is an HDMI terminal, a video terminal, an RGB terminal, or the like.

  The video / audio processing unit 21 converts the input video signal into RGB digital video data and transfers it to the main control unit 30. The audio data input from the video input terminal unit 20 and the main control unit 30 is D / A converted and output to the audio output unit 22 such as a speaker.

  The main control unit 30 includes a central processing unit (CPU) that is a main processor, a read only memory (ROM) that stores a control program and the like, and a memory device (eg, SDRAM) that temporarily stores data in each process. (Synchronous Dynamic Random Access Memory, etc.) and NVRAM (Non Volatile RAM), which is a non-volatile memory in which setting information is recorded even when the power is turned off, are connected by a bus. Instead of NVRAM, various nonvolatile memories such as EPROM, EEPROM, and flash memory may be used.

  The main control unit 30 also detects a distance estimation unit 31 that estimates the distance between the screen 130 and the electronic pen 50, and a distance estimated by the distance estimation unit 31 when detecting a continuous click operation with the electronic pen 50. In response to this, a deviation allowable value between the first click position and the second click position when recognizing the double click operation is set, and based on the deviation allowable value, it is a double click operation or a continuous single click. Based on the determination result of the double click determination unit 32 that determines whether the operation is performed and the double click determination unit 32, the mouse information that can be processed by the video supply device 110 is generated, and the mouse information is input to the input / output interface. A mouse information generation unit 33 that transmits the video information to the video supply device 110 via the video supply device 110.

  The main control unit 30 controls the lamp control unit 23 and the optical control unit 24 to display the RGB video data transferred from the video / audio processing unit 21. The lamp control unit 23 controls the lamp 15 as a light source based on the control from the main control unit 30. The optical control unit 24 controls the optical engine 3 and the image display element unit 10 based on the control from the main control unit 30. Further, the fan control unit 35 controls the fan 16 based on the control from the main control unit 30.

  The operation unit 25 receives various operation requests from the user, and is configured by key buttons (main body keys) provided on the outer surface of the image projection apparatus 1. For example, a menu key for displaying a menu screen for performing various settings and selections is provided. The operation request includes an instruction to display an OSD screen such as a menu screen, a request to change the aspect ratio of the projected image, a request to turn off the power of the image projection apparatus 1, a lamp power change request to change the light amount of the lamp 15, Etc. are included. When the operation unit 25 receives the operation request, the operation unit 25 notifies the main control unit 30 of the operation request.

  Further, the remote control 26 as a remote operation means is provided with the same key button as the operation unit 25, and the same operation as the operation unit 25 is possible. The operation request from the remote control 26 is transmitted to the operation reception unit 27 as infrared data, and the operation reception unit 27 notifies the main control unit 30 when receiving a signal from the remote control 26.

  The wireless communication unit 29 receives information such as position information, click information, and acceleration information transmitted from the electronic pen 50 and notifies the main control unit 30 of the information.

  The input / output interface 28 is a communication interface connected to the video supply device 110, and mouse information generated based on position information, click information, and acceleration information from the electronic pen 50 is transmitted from the image projection device 1 to the video supply device. 110. For example, a communication interface such as USB (Universal Serial Bus).

(Electronic pen)
FIG. 7 shows a functional block diagram of the electronic pen 50. The electronic pen 50 includes a first button 51, a second button 52, a pen tip button 53, an operation reception unit 54, an acceleration detection unit 55, a position information detection unit 56, a wireless communication unit 57, and an electronic pen control unit 60. Position designation on the image 140 and various click operations at the designated position are possible.

  The operation reception unit 54 detects that the first button 51, the second button 52, and the pen tip button 53 have been pressed, and notifies the electronic pen control unit 60 of this. The pen tip button 53 can be pressed by pressing the tip of the electronic pen 50 onto the screen 130.

  Here, it is assumed that the first button 51 is assigned to the left button of the mouse, the second button 52 is assigned to the right button of the mouse, and the pen tip button 53 is assigned to the left button of the mouse. It is assumed that it is executed by continuously pressing the pen tip button 53. The number of buttons and the assignment of functions are not particularly limited.

  The acceleration detector 55 detects the acceleration of the electronic pen 50, and is, for example, an acceleration sensor (G sensor).

  The position information detection unit 56 reads position information embedded in the projection image 140, and includes, for example, a light detection sensor that receives light and a light conversion unit that converts the received light into an electrical signal. Yes.

  The wireless communication unit 57 transmits position information, click information, and acceleration information to the image projection device 1 or the video supply device 110.

  The electronic pen control unit 60 includes, for example, a microcontroller, and includes arithmetic circuits such as a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory) and a storage circuit.

  The electronic pen control unit 60 continuously transmits the acceleration information detected by the acceleration detection unit 55 and the position information detected by the position information detection unit 56 at predetermined intervals via the wireless communication unit 57. 1 to send. Further, when the information that one of the buttons is clicked is received from the operation reception unit 54, the click information is transmitted to the image projection device 1 via the wireless communication unit 57.

(Video supply device)
FIG. 8 shows a functional block diagram of the video supply device 110. The video supply device 110 includes an input unit 111 for inputting data, a display unit 112 such as a display, a communication unit 113 for performing data communication, a CPU 114 as a control unit that controls the entire device, and a CPU 114. The RAM 115 is used as a work area, and the storage unit 116 stores various programs for operating the CPU 114.

(Double click operation)
FIG. 9 is a schematic diagram illustrating a state in which the electronic pen 50 is operated at a position away from the projected image 140 on the screen 130. FIG. 10 is a schematic diagram illustrating a state in which the electronic pen 50 is operated at a position close to the projected image 140 on the screen 130.

  In the image projection apparatus 1 and the image supply apparatus 110, usually, a predetermined button (for example, the left button of the mouse) is located at substantially the same position (within a predetermined movement range from the first click position) and within a predetermined short interval. When it is pressed twice, it is recognized that there was a double click operation.

  When a normal mouse is used, the double click operation is an easy operation by pressing the button of the mouse placed on the desk twice in succession. For this reason, the point position hardly shifts between the first and second button clicks.

  On the other hand, in the double click operation in which the first button 51 of the electronic pen 50 is pressed twice in succession with one point on the screen 130 specified at a position away from the projected image 140 as shown in FIG. The point position (the position of the cursor 58) may be shifted due to the hand shake of the user.

  Further, in the configuration in which the electronic pen 50 has the pen tip button 53, when a double-click operation is performed on the screen 130 from the closest position of the projection image 140 as shown in FIG. It becomes an operation of tapping twice. In this case, although not as difficult as shown in FIG. 9, the point position may be shifted as compared with the mouse operation on the desk.

  As described above, in the double click operation, if the point position is shifted in two clicks of the button, the point position is deviated from a range where the double click is detected (displacement allowable value) and is not detected as the double click operation. There is a case.

  On the other hand, for example, it is conceivable to provide a dedicated button on the electronic pen 50 for a double-click operation with a single click, but this leads to an increase in the number of buttons of the electronic pen 50 and the same operation as a mouse. Regardless of the operation, the operation method becomes different, and the uniformity of the operation is lost, which causes a problem on the user interface.

  Also, when setting the tolerance for deviation, if the deviation tolerance is set at the time of operation at a close distance, the above-mentioned problem will not be solved because the tolerance is not sufficient for the operation at a long distance, and the operation at a long distance is not possible. If the tolerance value is set according to the situation, there is a problem that a double-click is mistaken when a click continues at a close position, such as when writing a character at a short distance (for example, when a cloud point is applied to a character). It was.

  Therefore, in the present embodiment, an image projection apparatus (image projection apparatus 1) that projects a projection image (projection image 140) on a projection surface (screen 130), and a video supply apparatus (projection information supplied to the image projection apparatus). Image projection in an image projection system (image projection system 100) including a video supply device 110) and a pointing device (electronic pen 50) capable of specifying a position on at least a projected image and a click operation at the designated position A distance estimation unit (distance estimation unit 31) that estimates a distance between the projection surface and the pointing device, and a distance estimated by the distance estimation unit when a continuous click operation of the pointing device is detected. Accordingly, set the allowable deviation between the first click position and the second click position when recognizing the double click operation, Based on the deviation tolerance, or a double-click operation, those with double-click determining unit determines whether a continuous single-click operation has the (double-click determining unit 32), the. In addition, the code | symbol in embodiment and the example of application are shown in a parenthesis.

(Double click determination process)
FIG. 11 is a schematic diagram illustrating a state in which the image projecting apparatus 1 projects the projected image 140 onto the screen 130 in the image projecting system 100. FIG. 11 also shows data transmitted and received by each device in the image projection system 100.

  In the present embodiment, projection information (video signal) is transmitted from the video supply device 110 to the image projection device 1. When projecting the projection image 140 based on this projection information, the image projection apparatus 1 embeds position information for calculating the point position in the projection image 140 and performs projection. Note that the position information included in the projected image 140 may be added by the video supply device 110.

  The electronic pen 50 continuously transmits the acceleration information detected by the acceleration detection unit 55 and the position information read from the projection image 140 by the position information detection unit 56 from the wireless communication unit 57 to the image projection apparatus 1. ing. When the buttons 51 to 53 are pressed, click information is transmitted to the image projection apparatus 1.

  The image projection device 1 receives acceleration information, position information, and click information from the electronic pen 50 by the wireless communication unit 29 and sends them to the main control unit 30.

  The main control unit 30 calculates the point position based on the position information, and generates mouse information that is information that can be processed by the mouse driver or the like of the video supply device 110 in combination with the click information. Transmit to the video supply device 110. The video supply device 110 displays the cursor 58 of the electronic pen 50 on the projection image 140 based on the mouse information, and reflects the movement of the cursor 58 and various click operations.

  At this time, the main control unit 30 executes a double click determination process described below. This double-click determination process estimates the distance between the screen 130 and the electronic pen 50 based on the amount of change in position information and acceleration information, and is estimated when continuous click information is received from the electronic pen 50 within a predetermined interval. According to the distance between the screen 130 and the electronic pen 50, the allowable value of the deviation amount between the first click and the second click when determining the double click operation is changed.

  Then, based on the set allowable deviation amount, it is determined whether the operation is a double-click operation, and is transmitted to the video supply device 110 as mouse information of either a double-click operation or two single-click operations. Is.

  FIG. 12 is a flowchart of double-click determination processing executed by the image projection apparatus 1 according to this embodiment.

  First, it is detected that there has been a continuous click operation with the first button 51 or the pen tip button 53 of the electronic pen 50 (S101).

  When the first button 51 or the pen tip button 53 of the electronic pen 50 is clicked, the click information is transmitted from the wireless communication unit 57 of the electronic pen 50 to the main control unit 30 via the wireless communication unit 29 of the image projection device 1. The click operation is detected by being sent to. The main control unit 30 detects that this click operation is performed twice within a predetermined interval.

  Next, the image projection apparatus 1 estimates the distance between the screen 130 and the electronic pen 50 (S102). A preferred example of the distance estimation process (S102) between the screen 130 and the electronic pen 50 will be described below.

  The distance between the screen 130 and the electronic pen 50 can be estimated from the change amount of the value (acceleration information) detected by the acceleration detection unit 55 of the electronic pen 50 and the movement amount of the position information.

  FIG. 13 is an explanatory diagram of a distance estimation process between the screen 130 and the electronic pen 50. FIG. 13A shows a state where the electronic pen 50 is moved at a close distance of the screen 130, and FIG. 13B shows a state where the electronic pen 50 is moved at a position away from the screen 130.

  FIG. 13 shows a state in which the electronic pen 50 has been moved from the position indicated by 50a to the position indicated by 50b, and the cursor 58 has moved from the position indicated by 58a to the position indicated by 58b. Further, the movement coordinate distance of the cursor 58 on the projection image 140 is indicated by an arrow A, and the movement distance by which the user actually moves the electronic pen 50 is indicated by an arrow B.

  Here, as shown in FIG. 13B, when the electronic pen 50 is operated away from the projection image 140, the further away from the projection image 140, the smaller the projection image 140 viewed from the electronic pen 50. Even if it is the movement coordinate distance A on the projection image 140, the pen movement distance B for actually moving the pen is shorter than in the case of touching and operating the screen.

  Paying attention to this point, it is possible to estimate how far the electronic pen 50 is from the projected image 140 by comparing the moving coordinate distance on the projected image 140 with the distance that the electronic pen 50 has actually moved. . The movement coordinate distance A is a movement amount of position information detected by the position information detection unit 56, and the pen movement distance B can be calculated based on a change amount of acceleration information detected by the acceleration detection unit 55. .

  That is, it can be said that the distance between the screen 130 and the electronic pen 50 is shorter as the pen movement distance B is larger than the movement coordinate distance A. When the movement coordinate distance A≈pen movement distance B, it can be estimated that the electronic pen 50 is on the screen 130 or at a close distance of the screen 130. Further, it can be estimated that the distance between the screen 130 and the electronic pen 50 becomes longer as the pen movement distance B becomes smaller than the movement coordinate distance A.

  FIG. 14 is an example of a distance estimation table between the screen 130 and the electronic pen 50. This distance estimation table is stored in, for example, a nonvolatile memory of the main control unit 30. A table defining the distance between the screen 130 and the electronic pen 50 corresponding to the correspondence between the movement coordinate distance A and the pen movement distance B as shown in FIG. Based on the pen movement distance B, the distance between the screen 130 and the electronic pen 50 can be estimated.

  The method for estimating the distance between the screen 130 and the electronic pen 50 is not limited to the above-described method. For example, the electronic pen 50 includes an imaging device (an imaging unit such as a CCD camera), and the electronic pen 50 is a screen. The screen 130 may be imaged, the image information may be transmitted, and the distance may be estimated based on the size of the projected image 140 in the image information. In this case, the electronic pen 50 includes an imaging unit instead of the acceleration detection unit 55, and the image projection device 1 estimates the distance based on image information instead of acceleration information.

  Alternatively, the electronic pen 50 may be provided with a distance measuring sensor, and the distance between the electronic pen 50 and the screen 130 may be measured, the distance estimated, and the distance information transmitted. In this case, the electronic pen 50 includes a distance measuring sensor instead of the acceleration detection unit 55, and the image projection apparatus 1 estimates the distance based on the distance information instead of the acceleration information.

  Return to the description of the flowchart. Next, it is determined whether or not the estimated distance between the screen 130 and the electronic pen 50 is equal to or less than a threshold set in advance for the distance (S103). As a result of the determination, if the distance is equal to or less than the threshold value, that is, the distance is short (S103: Y), a deviation allowable value A is set (S104), and if it exceeds the threshold value, that is, the distance is far (S103: N), Is set (S105).

  The deviation allowable value is a value indicating an allowable width of the deviation amount between the point positions of the first click and the second click, and the deviation allowable value A <the deviation allowable value B. That is, when the distance is long, the user's hand shake is taken into consideration, and a large allowable value is set. When the distance is short, a small allowable value is set. As the deviation allowable value A at this time, a predetermined allowable value may be used.

  Next, based on the click information and the position information, it is determined whether or not the deviation amount between the first click position and the second click position is equal to or less than the deviation allowable value set in S104 or S105 (S106).

  As a result of the determination, if the positional deviation amount is equal to or smaller than the set deviation allowable value (S106: Y), it is processed as a double click operation (mouse information for double click operation is generated) (S107), and the positional deviation amount is If the set deviation allowable value is exceeded (S106: N), processing is performed as two single-click operations (mouse information for two single-click operations is generated) (S108).

  In the example of FIG. 12, the distance between the screen 130 and the electronic pen 50 is determined in two patterns using one threshold, but the relationship between the distance information and the corresponding deviation allowable value is defined. Needless to say, the deviation allowable value table may be stored, and the deviation allowable value may be set within a finer range.

  According to the image projecting apparatus 1 according to the present embodiment described above, a double click operation is performed according to the distance between the screen 130 on which the projected image 140 is displayed by the image projecting apparatus 1 and the electronic pen 50 operated by the user. By changing the allowable value of the pointer deviation, the double click operation can be correctly recognized regardless of the distance between the screen 130 and the electronic pen 50.

[Second Embodiment]
Hereinafter, other embodiments of the image projection apparatus and the image projection system according to the present invention will be described. In addition, the description about the same point as the said embodiment is abbreviate | omitted suitably.

  FIG. 15 is a schematic diagram illustrating a state in which the image projection apparatus 1 projects a projection image 140 onto a screen 130 in the image projection system 100 according to the second embodiment.

  The image projection system 100 uses an electronic pen 50 such as a laser pointer as a pointing device, and includes an imaging device 70, and detects an operation position of the pointing device based on an image obtained by imaging the screen 130. Note that the imaging device 70 may be provided inside the image projection device 1.

  In the present embodiment, the electronic pen 50 includes a laser emission unit (irradiation unit) instead of the position information detection unit 56 (FIG. 7), and irradiates the indicated position on the screen 130. Therefore, a pointer 59 (light trail) is displayed at the irradiation position of the projection image 140. Acceleration information and click information are transmitted from the electronic pen 50 to the image projection apparatus 1.

  The imaging device 70 captures the projection image 140 on which the pointer 59 is displayed, and transmits this imaging information to the image projection device 1.

  The image projection apparatus 1 performs a double click determination process (FIG. 12). In the distance estimation process (S102) between the screen 130 and the electronic pen 50, position information is calculated from the position of the pointer 59 in the imaging information, and the screen 130 and the electronic pen 50 are calculated based on the calculated position information and acceleration information. Estimate the distance. Then, mouse information is generated and transmitted to the video supply device 110.

[Third Embodiment]
FIG. 16 is a schematic diagram illustrating a state in which the image projection apparatus 1 projects the projection image 140 onto the screen 130 in the image projection system 100 according to the third embodiment.

  In the first embodiment, acceleration information, position information, and click information are transmitted from the electronic pen 50 to the image projecting device 1, and the image projecting device 1 generates mouse information from these pieces of information and sends them to the video supply device 110. An example of transmission has been described. In the second embodiment, acceleration information and click information are transmitted from the electronic pen 50 to the image projection device 1, and imaging information is transmitted from the imaging device 70. An example in which information is generated and transmitted to the video supply device 110 has been described.

  On the other hand, in the third embodiment, each piece of information necessary for generating mouse information is transmitted from the electronic pen 50 and the imaging device 70 to the video supply device 110 without passing through the image projection device 1. . In other words, the video supply device 110 includes the above-described distance estimation unit 31, double-click determination unit 32, and mouse information generation unit 33, and executes the double-click determination process to generate mouse information. .

  The image projection system 100 uses an electronic pen 50 such as a laser pointer as a pointing device, and includes an imaging device 70, and detects an operation position of the pointing device based on an image obtained by imaging the screen 130.

  Acceleration information and click information are transmitted from the electronic pen 50 to the video supply device 110. Further, the imaging device 70 captures the projection image 140 on which the pointer 59 is displayed, and transmits this imaging information to the video supply device 110.

  The video supply device 110 performs a double click determination process (FIG. 12). In the distance estimation process (S102) between the screen 130 and the electronic pen 50, position information is calculated from the position of the pointer 59 of the imaging information, and the screen 130 and the electronic pen 50 are based on the calculated position information and acceleration information. Estimate distance. Then, mouse information is generated, and various click operations are reflected based on the mouse information.

  In the third embodiment, the method of imaging the irradiation position by the pointing device with the imaging device 70 has been described. However, in the method of embedding the position information for the pointing device to read in the projection image 140, the mouse information is similarly applied. It is needless to say that each piece of information necessary for generating the image data may be transmitted from the electronic pen 50 to the video supply device 110 without passing through the image projection device 1.

  The above-described embodiment is a preferred embodiment of the present invention, but is not limited thereto, and various modifications can be made without departing from the gist of the present invention.

  In the interactive system, in addition to the above-described method of embedding position information for reading by the pointing device in the projected image and the method of imaging the irradiation position by the pointing device in the imaging device, the peripheral portion of the projection surface There is also known an ultrasonic type which detects position information by placing an infrared light emitting element or an infrared laser on the surface, running infrared rays vertically and horizontally, and detecting a blocked position.

  The present invention can be applied to any image projection system that can designate an arbitrary position on the screen by using a pointing device in contact with the screen, from a close distance of the screen, or from a position away from the screen. it can.

  In the above-described embodiment, the image projection apparatus is described by taking a DLP (Digital Light Processing) type projector as an example. However, the image projection apparatus is not limited to this, and is not limited to this, but is an LCD (Liquid Crystal Display) type, LCOS (Liquid crystal on silicon). ) Method or the like. Moreover, although the example which uses an arc lamp as a light source was demonstrated, it is not restricted to this, You may use a laser, LED, etc.

DESCRIPTION OF SYMBOLS 1 Image projector 2 Exterior cover 3 Optical engine 3a Illumination unit 3b Projection knit 4 Light source unit 5 Color wheel 6 Light tunnel 7 Relay lens 8 Plane mirror 9 Concave mirror 10 Image display element unit 10a DMD element 11 Intake port 12 Exhaust port 13 Intake Fan 14 Exhaust fan 15 Lamp 16 Fan 20 Video input terminal unit 21 Video / audio processing unit 22 Audio output unit 23 Lamp control unit 24 Optical control unit 25 Operation unit 26 Remote control unit 27 Operation receiving unit 28 Input / output interface 29 Wireless communication unit 30 Main control Unit 31 distance estimation unit 32 double click determination unit 33 mouse information generation unit 35 fan control unit 50 electronic pen 51 first button 52 second button 53 pen tip button 54 operation reception unit 55 acceleration detection unit 56 position information detection unit 57 wireless communication Part 58 Cursor 59 pointer 60 electronic pen control unit 70 imaging device 100 image projection system 110 video supply device 111 input unit 112 display unit 113 communication unit 114 CPU
115 RAM
116 Recording unit 120 Cable 130 Screen (projection surface)
140 Projected image

JP-A-8-331667

Claims (9)

An image projection device that projects a projection image onto a projection surface;
A video supply device for supplying projection information to the image projection device;
A pointing device capable of specifying at least a position on the projection image and a click operation at the specified position, the image projection apparatus in an image projection system comprising:
A distance estimation unit that estimates a distance between the projection surface and the pointing device;
When a continuous click operation of the pointing device is detected, a deviation allowable value between the first click position and the second click position when recognizing the double click operation according to the distance estimated by the distance estimation unit. And a double-click determination unit that determines whether the operation is a double-click operation or a continuous single-click operation based on the deviation allowable value. The double click determination unit
Comparing the distance estimated by the distance estimation unit with a threshold set for the distance,
When the distance estimated by the distance estimation unit is less than or equal to the threshold value, a deviation allowable value A is set, and when the distance exceeds the threshold value, a deviation allowable value B (where A <B) is set. The image projection apparatus according to claim 1. A deviation tolerance table defining the correspondence between the distance estimated by the distance estimation unit and the deviation tolerance;
The double click determination unit
The image projection apparatus according to claim 1, wherein the deviation allowable value corresponding to the distance estimated by the distance estimation unit is set based on the deviation allowable value table.   A mouse information generation unit configured to generate mouse information that can be processed by the video supply device based on a determination result in the double-click determination unit, and to transmit the mouse information to the video supply device. The image projection device according to claim 1. An image projection device according to any one of claims 1 to 4,
The video supply device;
An image projection system comprising: the pointing device. The pointing device is
A position information detector that detects position information included in the projected image;
An acceleration detector for detecting the acceleration of the pointing device;
A wireless communication unit that transmits the position information detected by the position information detection unit and the acceleration information detected by the acceleration detection unit to the image projection device;
The distance estimation unit of the image projection device includes:
The image projection according to claim 5, wherein a distance between the projection surface and the pointing device is estimated based on the position information and the acceleration information transmitted from the wireless communication unit of the pointing device. system. An imaging device that captures the projection image and transmits imaging information to the image projection device;
The pointing device is
An irradiation unit for irradiating an arbitrary position in the projected image;
An acceleration detector for detecting the acceleration of the pointing device;
A wireless communication unit that transmits acceleration information detected by the acceleration detection unit to the image projection device,
The distance estimation unit of the image projection device includes:
A distance between the projection surface and the pointing device is estimated based on the acceleration information transmitted from the wireless communication unit of the pointing device and the imaging information transmitted from the imaging apparatus. The image projection system according to claim 5. The pointing device is
An imaging unit for imaging the projected image;
A wireless communication unit that transmits imaging information captured by the imaging unit to the image projection device,
The distance estimation unit of the image projection device includes:
The image projection system according to claim 5, wherein a distance between the projection surface and the pointing device is estimated based on the imaging information transmitted from the wireless communication unit of the pointing device. An image projection device that projects a projection image onto a projection surface;
A video supply device for supplying projection information to the image projection device;
A pointing device capable of at least a position designation on the projection image and a click operation at the designated position, and the video supply apparatus in an image projection system comprising:
A distance estimation unit that estimates a distance between the projection surface and the pointing device;
When a continuous click operation of the pointing device is detected, a deviation allowable value between the first click position and the second click position when recognizing the double click operation according to the distance estimated by the distance estimation unit. And a double-click determination unit that determines whether the operation is a double-click operation or a continuous single-click operation based on the deviation allowable value.