JP2019191431A - Image projection device and method for controlling image projection device - Google Patents

Abstract

To provide an image projection device capable of controlling a projection form according to a detection result of an instruction position.SOLUTION: An image projection device 100 projecting an input image comprises: imaging means 120 for imaging a range which includes a projection image projected by the image projection device 100; projection range detection means 162 for detecting a projection range from the picked-up image of the imaging unit 120; and indicated position detection means 161 for detecting a position indicated by indication means from the picked-up image of the imaging unit 120. In the case where an indicated position detected by the indicated position detection means 161 is outside the projection range detected by the projection range detection means 162, a lens shift 113 is controlled based on the indicated position.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image projection apparatus, and more particularly to an image projection apparatus that controls a projection form based on position detection.

  Conventionally, there are many use cases in which an image projection apparatus that projects an input image is connected to a computer and projects an image of the computer. Among them, there is known an image projection apparatus that detects an instruction position by a user in a projection screen and uses it as a pointing operation of a computer.

  For example, Patent Literature 1 discloses a device that converts detected indication positions into coordinates on a projection screen and displays them.

Japanese Patent No. 4272904

  However, in the prior art disclosed in the above-mentioned patent document, a pointing operation can be performed intuitively using an indicator such as a finger or a pen, but when changing the projection form during pointing, an operation panel, a remote controller, etc. Is required separately, and the intuitive operation feeling is impaired.

  Therefore, an object of the present invention is to provide an image projection apparatus that can control the projection form in accordance with the detection result of the designated position.

  In order to achieve the above object, the present invention provides an image projection apparatus that projects an input image, an imaging unit that captures a range including a projection image projected by the image projection apparatus, and a captured image of the imaging unit. Projection range detecting means for detecting a projection range from the image pickup section, and indicated position detecting means for detecting a position indicated by the instruction means from the captured image of the imaging unit, wherein the indicated position detected by the indicated position detection means is the When it is outside the projection range detected by the projection range detection means, the lens shift is controlled based on the indicated position.

  ADVANTAGE OF THE INVENTION According to this invention, the image projection apparatus which enabled control of the projection form according to the detection result of the designated position can be provided.

1 is a diagram illustrating a configuration example of a system of an image projection apparatus that is Embodiment 1 of the present invention. 1 is a block diagram showing a configuration of an image projection apparatus that is Embodiment 1 of the present invention. The figure which shows the example of the detection method of the designated position which is Example 1 of this invention. The figure which shows the example of the detection method of the projection range which is Example 1 of this invention. FIG. 3 is a diagram illustrating an example of a calibration pattern that is Embodiment 1 of the present invention. The screen figure which shows the example of the notification which is Example 1 of this invention. The flowchart which shows the process sequence of the shift control which is Example 1 of this invention. FIG. 5 is a block diagram illustrating a configuration of an image projection apparatus that is Embodiment 2 of the present invention. The figure which shows the example of the detection method of the 3rd area | region which is Example 2 of this invention. The flowchart which shows the process sequence of the shift control which is Example 2 of this invention. The figure which shows the example of the test pattern which is Example 2 of this invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Example 1]
The image projection apparatus according to the first embodiment of the present invention will be described below with reference to FIGS. FIG. 1 shows a configuration example of a system including an image projection apparatus according to the first embodiment of the present invention. This system has a configuration in which a projector 100 as an image projection apparatus and a PC (Personal Computer) 200 are connected via an image signal cable 210 and a communication cable 220. The projector 100 is a device that projects an image on an SC (screen) based on a video signal received from the PC 200 via the video signal cable 210.

  The video signal cable 210 transmits, for example, an analog signal such as an RGB cable, or a digital signal such as a DVI (Digital Visual Interface) cable, an HDMI (registered trademark) (High Definition Multimedia Interface) cable, or a Display Port cable. Including things. Note that the video signal cable 210 does not need to be a wired cable, and may be transmitted using a technique such as WirelessHD or Miracast that transmits a video signal by wireless communication. Further, the projector 100 may be connected to the PC 200 via the communication cable 220 to transmit and receive control data and image data.

  The communication cable 220 may be a wired cable such as a USB cable, a LAN cable (for example, RJ-45), a serial cable (for example, RS-232), or a wireless cable such as Wi-fi or Bluetooth (registered trademark). Communication may be used. The indicator 300 is used to indicate a position with respect to the image projected on the SC. The position indicated by the indicator 300 may be within the projection image or may be outside the projection image. Examples of the indicator 300 include a pointing device that emits infrared light from the tip, another device that emits invisible light and visible light, a simple pen, and a user's finger.

  FIG. 2 shows a block of the image projection apparatus according to the first embodiment of the present invention. A configuration of the projector 100 as the image projection apparatus is shown below. Projection optical system 110, zoom mechanism 111, focus mechanism 112, shift mechanism 113, image display element 114, light source 115, imaging unit 120 as imaging means, control unit 130, imaging control unit 131, zoom control unit 132, focus control unit 133, shift control unit 134, light source control unit 135, image processing unit 140, I / F (interface) 150, captured image analysis unit 160, designated position detection unit 161 as designated position detection means, and projection as projection range detection means A range detection unit 162, an operation unit 170, and a storage unit 180 are provided.

  The I / F 150 has a role as an interface for connecting the projector 100 and an external device. For receiving video signals, for example, receiving analog signals such as VGA terminal, S-Video terminal and D terminal, and digital signals such as HDMI terminal, DVI terminal, DisplayPort terminal, SDI terminal and HDBaseT terminal It has a terminal to do. For example, a USB terminal, a LAN terminal, and a serial terminal are provided to transmit and receive control signals.

  In addition to these terminals, wireless communication may be used for transmission and reception of video signals and control signals. Further, the I / F 150 includes a receiver IC for receiving a video signal input through these terminals, an A / D conversion circuit for converting an analog signal into a digital signal, and the like (none of which are shown). .

  The image processing unit 140 performs image processing on the video signal input from the I / F 150. For example, scaling processing such as resolution conversion, image quality adjustment processing for adjusting brightness, contrast, sharpness, color temperature, gamma, etc., noise removal processing for removing mosquito noise, block noise, keystone correction processing, IP conversion processing, Frame interpolation processing, etc. The image processing unit 140 outputs the video signal subjected to such processing to the image display element 114. In addition, the control signal is output to the control unit 130.

  The light source 115 is composed of a lamp light source such as an ultra-high pressure mercury lamp, a metal halide lamp, a xenon lamp, or a halogen lamp, but a solid light source such as an LED (Light Emitting Diode) or a laser or other light source may be used. Further, the light source 115 includes an actuator or the like (not shown) for driving the light source 115, and switches on and off the light source 115 based on the control of the light source control unit 135. The light from the light source 115 is emitted to the image display element 114 via an integrator optical system, a color separation optical system, or the like (both not shown).

  The image display element 114 is configured by three transmissive or reflective liquid crystal panels of RGB, but may be configured by combining a color wheel DMD (Digital Micromirror Device) or light from the light source 115. Any other configuration may be used as long as it is a mechanism for modulating.

  The image display element 114 includes an image display element driving unit (not shown) for driving the image display element 114 based on the video signal input from the image processing unit 140. The image display element driving unit sets a transmittance or a reflectance for each pixel by applying a driving voltage corresponding to the video signal. The light modulated by the image display element 114 is combined by a color combining optical system or the like (not shown) and emitted to the projection optical system 110.

  The projection optical system 110 includes a zoom mechanism 111, a focus mechanism 112, a shift mechanism 113, and the like. The projection optical system 110 projects the light incident from the image display element 114 onto the SC as an image.

  The zoom mechanism 111 includes a zoom lens, an actuator that drives the zoom lens, an encoder that detects the position of the zoom lens, and the like (all not shown), and drives the zoom lens based on the control of the zoom control unit 132.

  The focus mechanism 112 includes a focus lens, an actuator that drives the focus lens, an encoder that detects the position of the focus lens, and the like (all not shown), and drives the focus lens based on the control of the focus control unit 133.

  The shift mechanism 113 includes a projection lens, an actuator that drives the projection lens, an encoder that detects the position of the projection lens, and the like (none of which are shown), and drives the projection lens based on the control of the shift control unit 134.

  In addition, it is assumed that the driving speeds of the zoom mechanism 111, the focus mechanism 112, and the shift mechanism 113 can be variably switched.

  The control unit 130 includes an imaging control unit 131, a zoom control unit 132, a focus control unit 133, a shift control unit 134, a light source control unit 135, and the like. The operation unit 130 controls each unit of the projector 100 based on, for example, an operation using the operation panel 170 or a remote controller (not shown), a control signal from the PC 200, or the like.

  The imaging control unit 131 captures an imaging range including a projection image by controlling the imaging unit 120. In addition, the image captured by the imaging unit 120 is output to the captured image analysis unit 160.

  The zoom control unit 132 reduces or enlarges the projected image by controlling an actuator, an encoder, and the like (none of which are shown) of the zoom mechanism 111. The focus control unit 133 adjusts the focus of the projected image by controlling an actuator, an encoder, and the like (none of which are shown) of the focus mechanism 112. The projected image is moved in the vertical and horizontal directions by controlling the shift control unit 134 and the actuators and encoders of the shift mechanism 113 (both not shown).

  The light source control unit 135 adjusts the brightness of the projected image by controlling an actuator (not shown) of the light source 115 based on power on or off of the projector 100, a blank function, a mode change, and the like.

  The imaging unit 120 is provided in the projection direction of the projector 100 and has a sufficiently wide range of angle of view that can capture a projected image regardless of the installation environment such as the projection distance and the adjustment state such as zoom and lens shift. . Further, the angle of view of the imaging unit 120 may be adjustable from the operation unit 170 or the like. In this embodiment, the imaging unit 120 is described as being provided inside the projector 100, but may be provided outside such as a USB camera. The image captured by the imaging unit 120 is output to the captured image analysis unit 160.

  The captured image analysis unit 160 includes an instruction position detection unit 161, a projection range detection unit 162, and the like, and analyzes an image captured by the imaging unit 120.

  The designated position detection unit 161 detects the designated position of the indicator 300 illustrated in FIG. 1 from the image captured by the imaging unit 120. A method for detecting the designated position will be described with reference to FIGS. For example, as shown in FIG. 3A, a picked-up image when the indicator 301 is a pointing device that emits infrared light from the tip and the image pickup unit 120 is an infrared camera is shown in FIG. The designated position detection unit 161 identifies a location where infrared light is emitted from the captured image and detects it as the designated position.

  Further, in order to convert the designated position into coordinate data, the right direction of the captured image is defined as the X-axis direction, and the downward direction is defined as the Y-axis direction. According to the above definition, the upper left coordinate is (0, 0), the upper right coordinate is (1, 0), the lower left coordinate is (0, 1), the lower right coordinate is (1, 1), and the coordinates of the indicated position Is represented as (Xn, Yn). The coordinates (Xn, Yn) of the designated position detected by the designated position detection unit 161 are output to the control unit 130. As shown in FIG. 3 (2), the indicator 302 is a simple pen, and includes an invisible light emitting device 303 that uniformly emits invisible light to the projection surface so as to detect the invisible light reflected by the indicator 302. Even in such a configuration, the coordinates of the designated position can be detected in the same manner. Further, the method for detecting the designated position is not limited to the configuration shown in FIG.

The projection range detection unit 162 detects the projection range from the image captured by the imaging unit 120. A method for detecting the projection range will be described with reference to FIG. In order to acquire the projection range as coordinate data, the right direction of the captured image is defined as the X-axis direction and the downward direction is defined as the Y-axis direction. According to the above definition, the upper left coordinates of the projected image are (Xp0, Yp0), the upper right coordinates are (Xp1, Yp1), the lower left coordinates are (Xp2, Yp2), and the lower right coordinates are (Xp3, Yp3). . When the coordinate of the designated position is (Xn, Yn), a method for determining whether the coordinate of the designated position is within or outside the projection range will be described with reference to the following equations (1) to (4). The determination method first calculates (1) to (4). Next, the codes (1) to (4) are compared from the calculation results. From the result, when all the codes are the same, (Xn, Yn) is determined to be within the projection range, and otherwise, it is determined to be outside the projection range.
(Xn−Xp0) × (Yp1−Yp0) − (Xp1−Xp0) × (Yn−Yp0) (1)
(Xn−Xp1) × (Yp2−Yp1) − (Xp2−Xp1) × (Yn−Yp1) (2)
(Xn−Xp2) × (Yp3−Yp2) − (Xp3−Xp2) × (Yn−Yp2) (3)
(Xn−Xp3) × (Yp0−Yp3) − (Xp0−Xp3) × (Yn−Yp3) (4)
When it is determined that (Xn, Yn) is outside the projection range, the projection range detection unit 162 sets the coordinates of the indicated position outside the projection range as (Xm, Ym), and (Xm, Ym) is the projection range. It is determined in which direction of up / down / left / right. The determination process will be described with reference to the following formulas (5) to (8).

First, it is determined whether or not the condition (5) is satisfied. As a result, when the condition is satisfied, it is determined that (Xm, Ym) is in the right direction with respect to the projection range. If the condition is not satisfied, the process proceeds to the condition determination of (6). Until the determination is made in any direction, the condition determinations (6), (7), and (8) are sequentially performed. When the condition is satisfied in (6), it is determined as the left direction, when the condition is satisfied in (7), it is determined as an upward direction, and when the condition is satisfied in (8), it is determined as a downward direction. When none of the conditions is satisfied, it is determined that (Xm, Ym) is within the projection range.
(Xp0> Xm) ∨ (Xp2> Xm) (5)
(Xp1 <Xm) ∨ (Xp3 <Xm) (6)
(Yp0 <Xm) ∨ (Yp1 <Xm) (7)
(Yp2> Xm) ∨ (Yp3> Xm) (8)
The inclusion relationship between the coordinates (Xn, Yn) of the designated position and the projection range detected by the projection range detection unit 162 is output to the control unit 130. When it is determined that (Xn, Yn) is out of the projection range, information about which direction (Xn, Yn) is above, below, left, or right with respect to the projection range is further added and output to the control unit 130. .

  The operation unit 170 is provided in the main body of the projector 100, for example, and includes various buttons and indicators. The operation unit 170 outputs a control signal to the control unit 130 based on an operation by a user or the like, and turns on the indicator according to the signal from the control unit 130. Note that the operation unit 170 may be provided outside the projector 100, or may be a remote controller or the like.

  Next, calibration performed by the control unit 130 will be described. The control unit 130 performs calibration when a calibration execution command is received from the operation panel 170 or the PC 200 or when the control unit 130 determines that calibration is necessary. When calibration is necessary, for example, when the lens shift, zoom, focus, or the like of the projector 100 is operated, when the aspect setting or keystone correction is changed, the setting of the display device such as the PC 200 is changed. Such as the case. When the calibration is performed, the control unit 130 requests the image processing unit 140 to display a test pattern for calibration.

  As the test pattern, for example, a pattern in which the projection range as shown in FIG. 5 is known is preferable. Next, the control unit 130 requests the imaging unit 120 to capture a test pattern. The image captured by the imaging unit 120 is analyzed by the captured image analysis unit 160. The captured image analysis unit 160 detects a projection range, a feature point of the test pattern, and the like from the captured image, and calculates a coordinate conversion matrix for conversion into the four corners or feature point coordinates of the test pattern output by the image processing unit 140. To do.

  In addition, when the relationship between the imaging range and the projection range is inappropriate due to the setting of the angle of view of the imaging unit 120 and the installation conditions such as the projection distance and the projection size of the projector 100, a message as shown in FIG. 6 is notified. To do. For determining whether or not the imaging range is appropriate, the control unit 130 detects the control amounts of the zoom mechanism 111 and the shift mechanism 113, and calculates the projection distance from the relationship between the projected image and the control amount. Based on the projection distance, even when the imaging range is shifted to the extreme end position, the criterion of whether or not it is sufficient to capture the projected image is followed. Note that automatic focus adjustment using a captured image may be performed in accordance with calibration.

  In this embodiment, the description has been given by taking an example of a configuration in which calibration is automatically performed. However, a configuration in which a user sequentially indicates feature points of a test pattern using an indicator may be used.

  The PC 200 is connected to the projector 100 via a video signal cable or a communication cable. Further, the coordinates of the designated position determined by the captured image analysis unit 160 may be converted into coordinates normalized by a coordinate conversion matrix calculated by calibration performed by the control unit 130 and used as mouse coordinates. Good. In the present embodiment, the processing such as the analysis of the designated position, the generation of the coordinate conversion matrix and the normalization of the coordinates has been described as being processed by the projector 100. However, the processing may be performed by the PC 200. .

  Next, the processing of the control unit 130 will be described with reference to the flowchart shown in FIG. First, in S10, the designated position detection unit 161 detects the coordinates of the designated position. If the coordinates of the designated position have failed in S10, the process proceeds to S50. Next, in S20, the projection range determination unit 162 determines whether the coordinates detected in S10 are outside the projection range. The time until the designated position is determined to be detected differs between inside and outside the projection range. Since detection within the projection range is used for the purpose of parallel operations such as pointing, it is necessary to immediately determine the detection.

  However, since the detection determination outside the projection range is used for the purpose of controlling the projector 100 and the like, in order to prevent erroneous detection and erroneous operation, it is determined to be detection when there is detection for a certain period of time in the vicinity coordinates. The detection of the projection range may be performed every time in S20, or may be performed at the time of calibration. If it is determined that the coordinate of the designated position is outside, it is further determined in S30 which position in the vertical and horizontal directions of the projection range the coordinate is. Next, in S40, the shift control unit 134 drives the shift mechanism 113 based on the direction determined in S30. Shifting to the target position is performed by repeating S10 to S40 until the designated position is determined to be inside the projection range. If it is determined that the designated position is inside the projection image, the shift drive is stopped in S50.

  As described above, according to the present embodiment, in the image projection apparatus having an interactive function, the lens shift operation can be performed intuitively without requiring another input means such as an operation panel or a remote controller. Can do. Further, it is possible to make a suitable adjustment to an arbitrary position by directly specifying the designated position.

[Example 2]
An image projection apparatus according to a second embodiment of the present invention will be described with reference to FIGS.
Although the main configuration is the same as that in FIG. 1, the OSD display unit 280 can be used to notify the user of control information. The same parts as those in the first embodiment are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 8 is a block diagram of an image projection apparatus according to the third embodiment of the present invention. Compared to the configuration of the projector 100, the projector 101 as an image projection apparatus is replaced with a control unit 230, a projection range detection unit 162 as a projection range detection unit, and a projection range detection unit 262. An OSD display unit 280 is provided.

  In addition to the function of the projection range detection unit 162, the projection range detection unit 262 includes a region of several pixels outside the projection range so as to border the projection range as the third region, as shown in FIG. Further, a portion within the projection range is a first region, and a portion outside the projection range and not the second region is a third region. In the present embodiment, by providing the third region, it is possible to make a suitable stop determination of shift driving at the time of shift driving, and the indicator 304 enters the projection range by shift driving, and an unintended erroneous operation occurs. Can be prevented.

  For example, an OSD (On Screen Display) display unit 280 superimposes an on-screen image (such as a menu screen, control information, or warning display) on the video signal via the image processing unit 140 in order to notify the user of information. .

  Next, the processing of the control unit 230 will be described with reference to the flowchart shown in FIG. Note that description of the same processing as the flowchart shown in FIG. 7 is omitted.

  In S120, the projection range determination unit 262 determines whether the coordinates detected in S10 are the third region. If it is determined that the region is the third region, the process proceeds to S30, and if not, the process proceeds to S170. In S140, the projection range detection unit 262 calculates the distance between the designated position and the second region, and determines whether or not the result exceeds a predetermined threshold value. A plurality of threshold values may be set.

  In step S150, the OSD display unit 280 notifies the user that the projector 101 has shifted to the shift mode. For example, as shown in FIG. 11, the OSD display unit 280 includes a display method of displaying information regarding shift control in the center and displaying a test pattern in the background. By displaying the control information, it is possible to favorably feedback the operation performed by the indicator 305 to the user. Further, by displaying the test pattern, it is possible to accurately detect the projection range even during the shift driving, thereby improving the accuracy of the shift control.

  In S160, the shift control unit 134 drives the shift mechanism 113 based on the direction determined in S30. Further, the drive is performed such that the greater the distance between the second region determined in S140 and the designated position, the faster the drive speed. Until the designated position is determined to be out of the third region, the shift driving is performed to the target position by repeatedly performing the process.

  Next, in S170, the projection range determination unit 262 determines whether the coordinates detected in S10 are the first region. If it is determined that the region is the first region, the process proceeds to S180. If not, the designated position is determined to be the second region, and the process proceeds to S190. In S180, the information on the designated position determined in S10 is output to an external device such as the PC 200 in order to use it for an operation such as pointing. In S190, the control unit 230 stops the shift drive, and when the OSD or test pattern displayed in the shift mode display process in S150 remains, the display is canceled and the normal display is restored.

  As described above, according to the present embodiment, more accurate lens shift control can be performed by providing the third region for region determination and displaying the notification and the test pattern at the time of control.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary. Moreover, each part structure of the projector 100 shown in FIG. 2 may be comprised using an external apparatus. For example, a digital camera is connected to the image capturing unit 160 via USB, and the captured image analysis unit 160 is configured to use an application of the PC 200. Further, the display of the test pattern may be transmitted from an external device using a video cable and the control signal to the control unit 130 may be transmitted using a communication cable. In addition, the configuration of each part can be arbitrarily changed as long as it follows the gist of the present embodiment.

100 Projector 113 Shift Mechanism 120 Imaging Unit 130 Control Unit 161 Pointed Position Detection Unit 162 Projection Range Detection Unit

Claims (7)

An image projection device for projecting an input image,
Imaging means for capturing a range including a projected image projected by the image projection device;
A projection range detecting means for detecting a projection range from a captured image of the imaging unit;
An instruction position detection unit that detects a position instructed by the instruction unit from a captured image of the imaging unit;
An image projection apparatus that controls lens shift based on the indicated position when the indicated position detected by the indicated position detection means is outside the projection range detected by the projection range detection means. When the indicated position is outside the projection range, the indicated position detection means sets a longer time until the indicated position is determined to be detected than when the indicated position is inside the projection range. Item 2. The image projection device according to Item 1. 3. The image projection apparatus according to claim 1, wherein when the lens shift is controlled based on the designated position, an image capable of confirming a projection range is displayed. The projection range detecting means sets a third region in a certain range that is outside the projection range and closest to the inside, and does not control lens shift when the indicated position is in the third region. Item 4. The image projection device according to any one of Items 1 to 3. After controlling the lens shift based on the indicated position,
The image projection apparatus according to claim 1, wherein the indicated position is calibrated. Control information notification means for notifying control information,
The image projection apparatus according to claim 1, wherein when the lens shift is controlled based on the designated position, the control information is notified by the control information notification unit. A control method for an image projection apparatus that projects an input image,
An imaging step of photographing a range including a projection image projected by the image projection device;
A projection range detecting step for detecting a projection range from a captured image of the imaging unit;
An instruction position detection step for detecting a position instructed by an instruction means from a captured image of the imaging unit,
An image projection apparatus that controls lens shift based on the designated position when the designated position detected by the designated position detection step is outside the projection range detected by the projection range detection step. Control method.