JP2015166922A - Position detection device, and position detection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a position detection device and position detection method with which correction of indication positions can be properly performed irrespective of indicators to be used.SOLUTION: A projector 10 includes an indicator detection part 54 that determines the types of indicators 70 and 80, a coordinate calculation part 55 that detects the indication positions of the indicators 70 and 80, a storage part 110 that stores the reference variation amounts of the indication positions caused by the indicators 70 and 80 for each of the indicators 70 and 80, and a projection control part 31 that acquires the reference variation amount according to the type of the indicator determined by the indicator detection part 54 from the storage part 110, and corrects the indication positions detected by the coordination calculation part 55 on the basis of the acquired reference variation amount.

Description

  The present invention relates to a position detection device and a position detection method.

  An image output from a video output device such as a computer is projected onto the projection surface by the projector, and the projected image is captured by the camera, and the operation instruction performed on the projected image is recognized by the projector. A system has been proposed. For example, Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for photographing a light emission of a light-emitting pen as an indicator with an imaging device and specifying an indication position by the light-emitting pen.

JP 2011-227600 A

When the pointing position of the indicator is specified from the captured image captured by the imaging device, the specified pointing position may fluctuate (blur). Therefore, it is necessary to perform a correction process for correcting the fluctuation of the pointing position. . In particular, when a plurality of pointers having different methods for detecting the indicated position are used in combination, the difference in the detection method may cause the position detection accuracy.
The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide a position detection device and a position detection method that can appropriately correct the indicated position regardless of the indicator used. And

In order to achieve the above object, a position detection apparatus of the present invention relates to a determination unit that determines the type of a pointer, a detection unit that detects a pointing position of the pointer, and a change in a pointing position detected by the detection unit. A storage unit that stores a reference variation amount for each indicator, and a reference variation amount corresponding to the type of the indicator determined by the determination unit is acquired from the storage unit, and an indication position detected by the detection unit is obtained. And a correction unit that corrects based on the acquired reference fluctuation amount.
According to this configuration, it is possible to appropriately correct the indicated position regardless of the indicator used.

Further, the present invention is characterized in that, in the position detection device, the correction unit performs correction to compensate for the change when the change in the designated position is within the range of the reference change amount.
According to this configuration, it is possible to compensate for changes in the designated position.

According to the present invention, in the position detection device, the storage unit stores a plurality of reference fluctuation amounts according to the designated position, and the correction unit is a reference fluctuation amount according to the designated position detected by the detection unit. Is acquired from the storage unit, and the indicated position detected by the detection unit is corrected based on the acquired reference variation amount.
According to this configuration, it is possible to correct the designated position using an appropriate reference variation amount for each designated position.

Further, according to the present invention, in the position detection device, the correction unit adjusts the reference variation amount stored in the storage unit according to an instruction position, and the indication position detected by the detection unit is used as an adjusted reference. The correction is based on the fluctuation amount.
According to this configuration, it is possible to improve the correction accuracy of the indicated position.

In the position detection device, the present invention further includes a calculation unit that calculates the reference variation amount based on a variation in the indicated position detected by the detection unit, and the storage unit is calculated by the calculation unit. The reference variation amount is stored.
According to this configuration, it is possible to calculate the reference variation amount based on the variation in the designated position detected by the detection unit and store the reference variation amount in the storage unit.

Further, the present invention provides the above-described position detection device, comprising: a light emitting unit that emits detection light to a detection region that detects an indication position of the indicator; and a photographing unit that captures the detection region. Detects at least one of an image of light emitted by the first indicator as the indicator and an image of the detection light reflected by the second indicator as the indicator from the photographed image data of the imaging unit And based on the light emission timing of the said 1st indicator and the said light emission part, the indication position of the said 1st indicator and the said 2nd indicator is distinguished and detected, It is characterized by the above-mentioned.
According to this configuration, the identification accuracy between the first indicator and the second indicator can be improved, and the indication position of each indicator can be appropriately corrected regardless of the indicator used.

In the position detection device according to the present invention, the detection unit detects a position of a bright spot in the captured image data when the light emitting unit is turned off as an indication position of the first indicator. And
According to this structure, the precision which distinguishes a 1st indicator and a 2nd indicator can be improved, and the indication position of each indicator can be corrected appropriately irrespective of the indicator to be used. .

The position detection method of the present invention includes a step of determining a type of an indicator, a step of detecting an indication position of the indicator, and a storage unit that stores, for each indicator, a reference variation amount relating to the detected indication position variation. And acquiring a reference variation amount corresponding to the determined type of the indicator and correcting the detected indicated position based on the acquired reference variation amount.
According to this configuration, it is possible to appropriately correct the indicated position regardless of the indicator used.

  According to the present invention, it is possible to appropriately correct the indicated position regardless of the indicator used.

1 is a schematic configuration diagram of a projection system according to an embodiment. It is a functional block diagram of a projection system. It is a sequence diagram which shows the light emission timing of each part. It is explanatory drawing which shows a mode that the indication position of a pointer is detected. It is a figure which shows a mode that the indication position on the inclined screen is detected. It is a figure which shows the difference in the detection position by the difference in an instruction | indication position. (A) is a figure which shows an example of the image for a reference | standard variation | change_quantity calculation, (B) is a figure which shows a mode that the imaging | photography image data was divided into areas. It is a flowchart which shows the calculation procedure of a reference | standard variation | change_quantity. It is a flowchart which shows the procedure which correct | amends an indication position using a reference | standard variation | change_quantity.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a projection system 1 according to an embodiment to which the present invention is applied. The projection system 1 includes a projector 10 installed above a screen SC (projection surface) and a light emitting device 60 (light emitting unit) installed above the screen SC.

  The projector 10 is installed directly above or obliquely above the screen SC and projects an image toward the screen SC obliquely below. Further, the screen SC exemplified in the present embodiment is a flat plate or curtain fixed to a wall surface or standing on a floor surface. The present invention is not limited to this example, and the wall surface can be used as the screen SC. In this case, the projector 10 and the light emitting device 60 may be attached to the upper part of the wall surface used as the screen SC.

The projector 10 is connected to an external image supply device such as a PC (personal computer), a video playback device, and a DVD (Digital Versatile Disk) playback device. The projector 10 projects an image on the screen SC based on the analog image signal or digital image data supplied from the image supply device. The projector 10 may be configured to read out image data stored in a built-in storage unit 110 (FIG. 2) or an externally connected storage medium and display an image on the screen SC based on the image data.
The light emitting device 60 has a light source unit 61 (FIG. 2) made of a solid light source, and diffuses (emits) light emitted from the light source unit 61 along the screen SC. The emission range of the light emitting device 60 is shown in FIG. The light emitting device 60 is installed above the upper end of the screen SC, and emits light downward in the range of the angle θ. The light emitted from the light emitting device 60 forms a light layer along the screen SC. In this embodiment, the angle θ reaches approximately 180 degrees, and a light layer is formed on almost the entire screen SC. The surface of the screen SC and the light layer are preferably close to each other. In this embodiment, the distance between the surface of the screen SC and the light layer is approximately in the range of 10 mm to 1 mm. The light emitted from the light emitting device 60 is light outside the visible region, and is infrared light in this embodiment.

The projection system 1 detects the indicated position by the projector 10 when an instruction operation is performed on the screen SC.
As the indicator used for the instruction operation, a pen-type indicator 70 (first indicator) or an indicator 80 (second indicator) which is a user's finger can be used. Since the distal end portion 71 of the indicator 70 incorporates an operation switch 75 (FIG. 2) that operates when pressed, the operation switch 75 is turned on when the distal end portion 71 is pressed against the wall or the screen SC. become. The indicator 70 is operated so that the user holds the rod-shaped shaft portion 72 in his / her hand and brings the tip portion 71 into contact with the screen SC, and an operation of pressing the tip portion 71 against the screen SC is also performed. The distal end portion 71 includes a transmission / reception unit 74 (FIG. 2) that emits light. The projector 10 detects the position of the distal end portion 71 as the indication position based on the light emitted from the indicator 70. The light emitted from the indicator 70 is light outside the visible region, and is infrared light in this embodiment.

Further, when a position indicating operation is performed with the indicator 80 that is a user's finger, the user brings the finger into contact with the screen SC. In this case, the position where the indicator 80 contacts the screen SC is detected.
That is, when the tip (for example, fingertip) of the indicator 80 contacts the screen SC, the light layer formed by the light emitting device 60 is blocked. At this time, the light emitted from the light emitting device 60 strikes and reflects the indicator 80, and part of the reflected light travels from the indicator 80 toward the projector 10. Since the projector 10 has a function of detecting light from the screen SC side, that is, light from below by the position detection unit 50 described later, the reflected light of the indicator 80 can be detected. The projector 10 detects an instruction operation on the screen SC by the indicator 80 by detecting the reflected light reflected by the indicator 80. Further, the projector 10 detects the indicated position indicated by the indicator 80.
Since the light layer emitted from the light emitting device 60 is close to the screen SC, the position where the light is reflected by the indicator 80 can be regarded as the tip closest to the screen SC or the indication position. For this reason, the indicated position can be specified based on the reflected light of the indicator 80.

The projection system 1 functions as an interactive whiteboard system, detects an operation instruction given by the user with the indicators 70 and 80, and reflects the indicated position on the projection image. Specifically, the projection system 1 performs a process of drawing a graphic or placing a character or a symbol at a designated position, a process of drawing a graphic along the locus of the designated position, a drawn figure, or a placed character or symbol. The process etc. which erase | eliminate are performed. In addition, graphics drawn on the screen SC, arranged characters or symbols can be stored as image data, and can be output to an external device.
Further, the projection system 1 may operate as a pointing device by detecting the designated position, and output the coordinates of the designated position in the projection area of the screen SC on which the projector 10 projects an image. The projection system 1 can also perform a GUI (Graphical User Interface) operation using the coordinates of the designated position.

FIG. 2 is a functional block diagram of each part constituting the projection system 1.
The projector 10 includes an I / F (interface) unit 11 and an image I / F (interface) unit 12 as interfaces connected to external devices. The I / F unit 11 and the image I / F unit 12 may include a connector for wired connection, and may include an interface circuit corresponding to the connector. The I / F unit 11 and the image I / F unit 12 may include a wireless communication interface. Examples of the connector and interface circuit for wired connection include those based on wired LAN, IEEE 1394, USB, and the like. Examples of the wireless communication interface include those that comply with a wireless LAN, Bluetooth (registered trademark), or the like. The image I / F unit 12 may be an image data interface such as an HDMI (registered trademark) interface. The image I / F unit 12 may include an interface through which audio data is input.

The I / F unit 11 is an interface that transmits and receives various data to and from an external device such as a PC. The I / F unit 11 inputs and outputs control data related to image projection, setting data for setting the operation of the projector 10, coordinate data of the designated position detected by the projector 10, and the like. The control unit 30 described later has a function of transmitting / receiving data to / from an external device via the I / F unit 11.
The image I / F unit 12 is an interface through which digital image data is input. The projector 10 of the present embodiment projects an image based on digital image data input via the image I / F unit 12. The projector 10 may have a function of projecting an image based on the analog image signal. In this case, the image I / F unit 12 converts the analog image signal into digital image data and an analog image interface. And an A / D conversion circuit.

The projector 10 includes a projection unit 20 that forms an optical image. The projection unit 20 includes a light source unit 21, a light modulation device 22, and a projection optical system 23. The light source unit 21 includes a light source including a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, or the like. The light source unit 21 may include a reflector and an auxiliary reflector that guide light emitted from the light source to the light modulation device 22. Further, a lens group (not shown) for enhancing the optical characteristics of the projection light, a polarizing plate, or a dimming element that reduces the amount of light emitted from the light source on the path to the light modulation device 22 may be provided. Good.
The light modulation device 22 includes, for example, three transmissive liquid crystal panels corresponding to the three primary colors of RGB, and generates image light by modulating light transmitted through the liquid crystal panel. The light from the light source unit 21 is separated into three color lights of RGB, and each color light enters each corresponding liquid crystal panel. The color light modulated by passing through each liquid crystal panel is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 23.
The projection optical system 23 includes a lens group that guides the image light modulated by the light modulation device 22 toward the screen SC and forms an image on the screen SC. Further, the projection optical system 23 may include a zoom mechanism for enlarging / reducing the projected image on the screen SC and adjusting the focus, and a focus adjusting mechanism for adjusting the focus. When the projector 10 is a short focus type, the projection optical system 23 may include a concave mirror that reflects image light toward the screen SC.

  The projection unit 20 is connected to a light source drive unit 45 that turns on the light source unit 21 according to the control of the control unit 30 and a light modulation device drive unit 46 that operates the light modulation device 22 according to the control of the control unit 30. The light source drive unit 45 may have a function of switching on / off the light source unit 21 and adjusting the light amount of the light source unit 21.

  The projector 10 includes an image processing system that processes an image projected by the projection unit 20. The image processing system includes a control unit 30 that controls the projector 10, a storage unit 110, an operation detection unit 17, an image processing unit 40, a light source driving unit 45, and a light modulation device driving unit 46. In addition, a frame memory 44 is connected to the image processing unit 40, and an attitude sensor 47, an emission device driving unit 48, and a position detection unit 50 are connected to the control unit 30. These units may be included in the image processing system.

The control unit 30 controls each unit of the projector 10 by executing a predetermined control program 111. The storage unit 110 stores the control program 111 executed by the control unit 30 and the data processed by the control unit 30 in a nonvolatile manner. The storage unit 110 stores screen setting screen data 112 for setting the operation of the projector 10 and setting data 113 indicating the contents set using the setting screen data 112.
Further, the storage unit 110 stores a reference fluctuation amount calculation image 114, a first reference fluctuation amount 115, a second reference fluctuation amount 116, first calibration data 117, second calibration data 118, and the like. These data will be described later.

The image processing unit 40 processes the image data input via the image I / F unit 12 under the control of the control unit 30, and outputs an image signal to the light modulation device driving unit 46. The processing executed by the image processing unit 40 includes 3D (stereoscopic) image and 2D (planar) image discrimination processing, resolution conversion processing, frame rate conversion processing, distortion correction processing, digital zoom processing, color tone correction processing, luminance correction processing, and the like. is there. The image processing unit 40 executes processing designated by the control unit 30 and performs processing using parameters input from the control unit 30 as necessary. Of course, it is also possible to execute a combination of a plurality of processes.
The image processing unit 40 is connected to the frame memory 44. The image processing unit 40 expands the image data input from the image input I / F 12 in the frame memory 44, and executes the various processes described above on the expanded image data. The image processing unit 40 reads out the processed image data from the frame memory 44, generates R, G, B image signals corresponding to the image data, and outputs them to the light modulation device driving unit 46.
The light modulation device driving unit 46 is connected to the liquid crystal panel of the light modulation device 22. The light modulator driving unit 46 drives the liquid crystal panel based on the image signal input from the image processing unit 40 and draws an image on each liquid crystal panel.

The operation detection unit 17 is connected to a remote control light receiving unit 18 and an operation panel 19 that function as an input device, and detects an operation via the remote control light reception unit 18 and the operation panel 19.
The remote control light receiving unit 18 receives, by the remote control light receiving unit 18, an infrared signal transmitted in response to a button operation by a remote control (not shown) used by the user of the projector 10. The remote control light receiving unit 18 decodes the infrared signal received from the remote control, generates operation data indicating the operation content on the remote control, and outputs the operation data to the control unit 30.
The operation panel 19 is provided in the exterior housing of the projector 10 and has various switches and indicator lamps. The operation detection unit 17 appropriately turns on and off the indicator lamp of the operation panel 19 according to the operation state and setting state of the projector 10 according to the control of the control unit 30. When the switch of the operation panel 19 is operated, operation data corresponding to the operated switch is output from the operation detection unit 17 to the control unit 30.

  The display unit 16 displays information according to the control of the control unit 30. For example, the display unit 16 displays a selection screen for selecting the indicators 70 and 80 for calculating the reference variation amount.

  The emission device driving unit 48 is connected to the light emission device 60 via the connection unit 49. The connection portion 49 is a connector having a plurality of pins, for example, and the light emitting device 60 is connected to the connection portion 49 via a cable 60a. The emission device driving unit 48 generates a pulse signal according to the control of the control unit 30 and outputs the pulse signal to the light emission device 60 via the connection unit 49. Further, the emission device driving unit 48 supplies power to the light emission device 60 through the connection unit 49.

  As shown in FIG. 1, the light emitting device 60 is configured by housing a light source unit 61 and optical components in a substantially box-shaped case. The light emitting device 60 of the present embodiment includes a solid light source (not shown) that emits infrared light in the light source unit 61. Infrared light emitted from the solid-state light source is diffused by the collimating lens and the Powell lens to form a surface along the screen SC. The light source unit 61 may include a plurality of solid light sources, and a light layer may be formed so as to cover the image projection range of the screen SC by diffusing light emitted from the plurality of solid light sources. The light emitting device 60 may include an adjustment mechanism that adjusts the distance and angle between the light layer emitted from the light source unit 61 and the screen SC.

  The light emitting device 60 turns on the light source unit 61 by the pulse signal and the power source supplied from the emitting device driving unit 48. The emission device driving unit 48 controls the timing at which the light source unit 61 is turned on and off. The control unit 30 controls the emission device driving unit 48 to turn on the light source unit 61 in synchronization with the timing when the imaging unit 51 described later performs imaging.

  The position detection unit 50 detects an operation on the screen SC by the indicators 70 and 80. The position detection unit 50 includes an imaging unit 51, a transmission unit 52, an imaging control unit 53, a pointer detection unit 54, and a coordinate calculation unit 55.

  The imaging unit 51 includes an imaging optical system, an imaging element, an interface circuit, and the like, and images the projection direction of the projection optical system 23. The imaging optical system of the imaging unit 51 is arranged so as to face substantially the same direction as the projection optical system 23, and has an angle of view that covers a range in which the projection optical system 23 projects an image on the screen SC. Examples of the imaging device include a CCD and a CMOS that receive light in the infrared region and the visible light region. The imaging unit 51 may include a filter that blocks a part of the light incident on the imaging element. For example, when receiving infrared light, a filter that mainly transmits infrared light is provided in front of the imaging element. May be arranged. Further, the interface circuit of the imaging unit 51 reads and outputs the detection value of the imaging element.

  The imaging control unit 53 causes the imaging unit 51 to perform imaging and generates captured image data. When the imaging device performs imaging with visible light, an image projected on the screen SC is captured. In addition, the imaging control unit 53 can cause the imaging unit 51 to capture infrared light. In this case, the captured image includes infrared light (infrared signal) emitted from the indicator 70 or reflection reflected by the indicator 80. Light is reflected.

  The indicator detection unit 54 detects the indication positions of the indicators 70 and 80 based on the captured image data that the imaging control unit 53 has captured by the imaging unit 51. The indicator detection unit 54 reflects the image of the infrared light emitted by the indicator 70 and the reflection of the indicator 80 from the captured image data when the imaging control unit 53 causes the imaging unit 51 to perform infrared imaging. At least one of the reflected light image is detected. Further, the indicator detection unit 54 determines whether the detected image is an image of light emitted from the indicator 70 or an image of reflected light of the indicator 80. That is, the indicator detection unit 54 determines whether the operation instruction is issued from the indicator 70 or the indicator 80. A method of discriminating the indicators 70 and 80 by the indicator detection unit 54 will be described later. The indicator detection unit 54 generates type information indicating whether the detected image is an image of the indicator 70 or an image of reflected light of the indicator 80 and passes it to the coordinate calculation unit 55. In addition, the indicator detection unit 54 determines the operation state of the operation switch 75 included in the indicator 70 from the captured image data. The indicator 70 switches the lighting pattern of the indicator 70 according to the operation state of the operation switch 75 provided in the indicator 70. The indicator detection unit 54 determines the lighting pattern of the indicator 70 based on the plurality of captured image data, and determines the operation state of the operation switch 75. The indicator detection unit 54 passes data indicating the determined operation state to the coordinate calculation unit 55.

  The coordinate calculation unit 55 calculates the coordinate value of the indication position of the indicators 70 and 80 in the captured image data based on the position of the image detected by the indicator detection unit 54, and outputs it to the control unit 30. Further, the coordinate calculation unit 55 may calculate the coordinate value of the indication position of the indicators 70 and 80 in the projection image projected by the projection unit 20 and output the calculated coordinate value to the control unit 30. Further, the coordinate calculation unit 55 is configured to display the coordinates of the pointing positions of the indicators 70 and 80 in the image data drawn by the image processing unit 40 in the frame memory 44 and the indicators 70 and 80 in the input image data of the image I / F unit 12. The coordinates of the designated position may be calculated. The coordinate calculation unit 55 outputs the type information input from the indicator detection unit 54 to the control unit 30 together with the calculated coordinate value of the indicated position. In addition, when the data indicating the operation state of the operation switch 75 is input from the indicator detection unit 54, the coordinate calculation unit 55 outputs the data indicating the operation state to the control unit 30.

  The transmission unit 52 transmits an infrared signal to the indicator 70 according to the control of the indicator detection unit 54. The transmission unit 52 has a light source such as an infrared LED, and turns on and off the light source according to the control of the indicator detection unit 54.

Moreover, the indicator 70 is provided with the control part 73, the transmission / reception part 74, the operation switch 75, and the power supply part 76, and these each part is accommodated in the axial part 72 (FIG. 1). The control unit 73 is connected to the transmission / reception unit 74 and the operation switch 75, and detects the state (ON or OFF) of the operation switch 75. The transmission / reception unit 74 includes a light source such as an infrared LED and a light receiving element that receives infrared light. The transmission / reception unit 74 turns on and off the light source according to the control of the control unit 73, and transmits a signal indicating a light receiving state of the light receiving element. To 73.
The power supply unit 76 includes a dry battery or a secondary battery as a power supply, and supplies power to the control unit 73, the transmission / reception unit 74, and the operation switch 75.
The indicator 70 may include a power switch that turns on or off the power supply from the power supply unit 76.

Here, a method of specifying the indicator 70 from the captured image data of the imaging unit 51 by mutual communication between the position detection unit 50 and the indicator 70 will be described.
When detecting the position pointing operation by the pointer 70, the control unit 30 controls the pointer detection unit 54 to transmit a synchronization signal from the transmission unit 52. That is, the indicator detection unit 54 turns on the light source of the transmission unit 52 at a predetermined period in accordance with the control of the control unit 30. The infrared light periodically emitted from the transmission unit 52 functions as a synchronization signal that synchronizes the position detection unit 50 and the indicator 70.
On the other hand, after the supply of power from the power supply unit 76 is started and a predetermined initialization operation is performed, the control unit 73 receives infrared light emitted from the transmission unit 52 of the projector 10 by the transmission / reception unit 74. When the transmission / reception unit 74 receives infrared light periodically generated by the transmission unit 52, the control unit 73 lights the light source of the transmission / reception unit 74 in a preset lighting pattern in synchronization with the timing of the infrared light. (Light emission). This lighting pattern represents data specific to the indicator 70 in which lighting and extinguishing of the light source are associated with ON and OFF of the data. The control unit 73 turns on and off the light source in accordance with the set pattern turn-on time and turn-off time. The control unit 73 repeatedly executes the above pattern while power is supplied from the power supply unit 76.
That is, the position detection unit 50 periodically transmits an infrared signal for synchronization to the indicator 70, and the indicator 70 synchronizes with the infrared signal transmitted by the position detection unit 50 to set the infrared signal set in advance. Send.

The shooting control unit 53 of the position detection unit 50 performs control to match the shooting timing of the imaging unit 51 with the timing when the indicator 70 is turned on. This shooting timing is determined based on the timing when the indicator detection unit 54 turns on the transmission unit 52. The indicator detection unit 54 can specify a pattern in which the indicator 70 is turned on depending on whether or not the image of the light of the indicator 70 is captured in the captured image data of the imaging unit 51.
The pattern in which the indicator 70 is lit may include a pattern unique to each individual indicator 70, or a pattern common to a plurality of indicators 70 and a pattern unique to each individual. In this case, the indicator detection unit 54 can distinguish each image as an image of a different indicator 70 when the captured image data includes images of infrared light emitted from the plurality of indicators 70.

  In addition, the control unit 30 controls the emission device driving unit 48 to synchronize the lighting timing of the light source unit 61 with the imaging timing of the imaging unit 51. When the light source unit 61 turns on the pulse in synchronization with the imaging timing of the imaging unit 51, the reflected light of the indicator 80 appears in the captured image of the imaging unit 51 when the indicator 80 points on the screen SC. If the light source unit 61 is turned on in a pattern that can be distinguished from the lighting timing of the indicator 70, the indicator detection unit 54 determines whether the image shown in the captured image data is the indicator 70 or the indicator 80. it can. The lighting timing of the light source unit 61 will be described later with reference to FIG.

  Further, the control unit 73 included in the indicator 70 switches the pattern for lighting the transmission / reception unit 74 according to the operation state of the operation switch 75. For this reason, the indicator detection unit 54 can determine the operating state of the indicator 70, that is, whether or not the distal end portion 71 is pressed against the screen SC, based on a plurality of captured image data. The indicator detection unit 54 outputs data indicating the operation state of the operation switch 75 to the control unit 30 via the coordinate calculation unit 55.

The attitude sensor 47 is configured by an acceleration sensor, a gyro sensor, or the like, and outputs a detection value to the control unit 30. The attitude sensor 47 is fixed to the main body of the projector 10 so that the installation direction of the projector 10 can be identified.
As shown in FIG. 1, the projector 10 is installed in a suspended state in which it is suspended from a wall surface or a ceiling surface, in an installation state in which projection is performed from below the screen SC, or in a horizontal plane such as the top surface of a desk. Can be used in situations. Depending on the installation state of the projector 10, the light emitting device 60 may not be suitable for use. For example, when the projector 10 and the light emitting device 60 are installed below the screen SC and the projection is performed on the screen SC from below, the user's body may block the emitted light from the light emitting device 60, which is inappropriate. . The attitude sensor 47 is provided in the main body of the projector 10 so that a plurality of installation states assumed as the installation state of the projector 10 can be identified. The attitude sensor 47 is configured using, for example, a biaxial gyro sensor, a monoaxial gyro sensor, an acceleration sensor, or the like. The control unit 30 can automatically determine the installation state of the projector 10 based on the output value of the attitude sensor 47. When the control unit 30 determines that the installation state is inappropriate for the use of the light emitting device 60, for example, the emission device driving unit 48 stops outputting the power supply voltage and the pulse signal.

The control unit 30 reads and executes the control program 111 stored in the storage unit 110, thereby realizing the functions of the projection control unit 31, the detection control unit 32, the emission control unit 33, and the calibration control unit 34, and the projector. 10 parts are controlled.
The projection control unit 31 acquires the content of the operation performed by the user based on the operation data input from the operation detection unit 17. The projection control unit 31 controls the image processing unit 40, the light source driving unit 45, and the light modulation device driving unit 46 according to the operation performed by the user, and projects an image on the screen SC. The projection control unit 31 controls the image processing unit 40 to determine the above-described 3D (stereoscopic) image and 2D (planar) image, resolution conversion processing, frame rate conversion processing, distortion correction processing, digital zoom processing, and tone correction. Processing, brightness correction processing, and the like are executed. Further, the projection control unit 31 controls the light source driving unit 45 in accordance with the processing of the image processing unit 40 and controls the light amount of the light source unit 21.
In addition, the projection control unit 31 corrects the coordinate value of the indicated position detected by the position detection unit 50 using the first reference variation 115 or the second reference variation 116 stored in the storage unit 110.

  The detection control unit 32 controls the position detection unit 50 to execute detection of the pointing positions of the pointers 70 and 80. The detection control unit 32 acquires the coordinate value of the indicated position from the position detection unit 50 and type information indicating the type of the indicators 70 and 80 used by the user for the operation instruction. Further, the detection control unit 32 acquires data indicating the operation state of the operation switch 75 from the position detection unit 50 when an operation instruction by the indicator 70 is performed. The detection control unit 32 executes correction processing for correcting the coordinate value using the acquired coordinate value and type information. Further, the detection control unit 32 executes a preset process based on the coordinate value corrected by the correction process and the data indicating the operation state of the operation switch 75. For example, the image processing unit 40 performs a process of drawing a figure based on the acquired coordinates and projecting the drawn figure superimposed on an input image input to the image I / F unit 12. The detection control unit 32 may output the acquired coordinates to an external device such as a PC connected to the I / F unit 11. In this case, the detection control unit 32 may convert the acquired coordinates into a data format recognized as an input of the coordinate input device in the operating system of the external device connected to the I / F unit 11 and output the converted data. Good. For example, when a PC operating on a Windows (registered trademark) operating system is connected to the I / F unit 11, data processed as input data of HID (Human Interface Device) in the operating system is output. Further, the detection control unit 32 may output data for identifying whether it is the operation position of the indicator 70 or the operation position of the indicator 80 and data indicating the operation state of the operation switch 75 together with the coordinate data. Good.

  Further, the detection control unit 32 controls position detection using the indicator 80. Specifically, the detection control unit 32 determines whether or not the light emitting device 60 can be used based on whether or not the light emitting device 60 is connected. When the light emitting device 60 cannot be used, the detection control unit 32 performs setting so that the light emitting device 60 cannot be used. Here, the detection control unit 32 may notify that the light emitting device 60 cannot be used.

  The emission control unit 33 controls the emission device driving unit 48 to execute or stop the output of the power source and the pulse signal to the light emission device 60 connected to the connection unit 49. The emission control unit 33 controls the detection control unit 32 to stop the power supply of the emission device driving unit 48 and the output of the pulse signal when the light emission device 60 cannot be used or is not used. When the light emitting device 60 is used, the emission control unit 33 outputs the power supply and pulse signal of the emission device driving unit 48.

The calibration control unit 34 performs calibration. Calibration is a process for associating positions of a projected image projected on the screen SC and captured image data captured by the imaging unit 51. The calibration control unit 34 can execute auto calibration and manual calibration as calibration related to the pointing position of the pointer 70 or 80. Auto-calibration is a process of projecting an image for auto-calibration onto the screen SC, photographing it with the imaging unit 51, and generating first calibration data 117 using the photographed image data. A plurality of marks are displayed on the image for auto calibration. The calibration control unit 34 generates first calibration data 117 by associating the mark detected from the captured image data with the projected image drawn in the frame memory 44, that is, the mark of the image for auto calibration. To do.
The calibration control unit 34 projects an image for manual calibration on the screen SC when performing manual calibration. A plurality of marks are also displayed on the image for manual calibration. The calibration control unit 34 detects the operation of the indicator 70 or 80 on the projected image and generates second calibration data 118. That is, the calibration control unit 34 creates the second calibration data 118 by associating the coordinate value of the designated position detected in the captured image data with the coordinate value of the mark on the projected image.

Here, a method of discriminating the indicators 70 and 80 by the indicator detection unit 54 will be described with reference to FIG.
In the projection system 1 of the present embodiment, at least one of an image of light emitted from the indicator 70 and an image of light reflected by the indicator 80 of light output from the light emitting device 60 is captured by the imaging unit 51. The pointing positions of the pointers 70 and 80 are specified. In the projection system of the present embodiment, the indicator 70, the light emitting device 60, and the light emitting device 60 are arranged in a predetermined light emission sequence in order to distinguish between an image of light emitted from the indicator 70 and an image of reflected light from the indicator 80. Lights up. The light emission sequence of the projection system 1 of the present embodiment is composed of four phases from the first phase to the fourth phase, and the first phase to the fourth phase are repeated in order. In the present embodiment, the lengths of the first to fourth phases are set to the same time. In addition, the light emission time of the transmission unit 52 is 1/4 of one phase, the light emission time of the indicator 70 is 1/8 of one phase, and the light emission time of the light emitting device 60 is one phase. This is just an example.

The first phase is a synchronization phase. In the first phase, the transmission unit 52 of the projector 10 emits light and transmits an infrared signal for synchronization. The control part 73 of the indicator 70 detects the infrared signal for a synchronization with the transmission / reception part 74, and recognizes the start timing of a 1st phase.
The second phase is a position detection phase in which the light source unit 61 of the light emitting device 60 and the transmission / reception unit 74 of the indicator 70 are turned on. The projector 10 captures an imaging range by the imaging unit 51 in accordance with the light emission timing of the light emitting device 60 and the indicator 70. For example, when the imaging unit 51 performs shooting at the timing when the indicator 70 emits light in the second phase, light emission of the indicator 70 and detection light reflected by the indicator 80 appear in the captured image. Further, if the imaging unit 51 performs shooting at a timing when the indicator 70 does not emit light, the reflected light of the indicator 80 appears in the captured image.

  The shooting timing and shooting interval of the imaging unit 51 are set in advance, and the number of shootings per phase may be one time or multiple times. When the indicator 70 emits light once per phase as shown in FIG. 3, it is desirable to photograph at least the timing at which the indicator 70 emits light in each phase. Moreover, the adjustment method of the imaging | photography timing of the imaging part 51 and the light emission timing of each part is arbitrary. Generally, since it is often not easy to make the shooting timing and shooting interval of the imaging unit 51 variable, the emission control unit 33 adjusts the timing of light emission of the transmission unit 52 in consideration of the shooting timing of the imaging unit 51. Good.

The third phase is a pointer determination phase. In the third phase, the indicator 70 emits light, while the light emitting device 60 does not emit light. For this reason, the image of the light emitted from the indicator 70 appears in the captured image taken by the imaging unit 51 in the third phase, and the reflected light of the indicator 80 does not appear.
The fourth phase is a position detection phase similar to the second phase, and the light source unit 61 of the light emitting device 60 and the transmission / reception unit 74 of the indicator 70 are turned on.
Therefore, by comparing the captured image of the third phase with the captured images of the second phase and the fourth phase, the detection control unit 32 determines that the image of the light reflected in the captured images of the second phase and the fourth phase is It is possible to distinguish between the light image of the indicator 70 and the reflected light image of the indicator 80. When the time of each phase is sufficiently short, the positions of the images appearing in the captured images of the second, third, and fourth phases are close. For this reason, the light of the indicator 70 and the reflected light of the indicator 80 are easily distinguished.

  Further, when a plurality of indicators 70 are used in the projection system 1, the light emission of each indicator 70 can be identified in the captured image of the imaging unit 51. That is, different light emission timings may be set for each indicator 70 in advance. Specifically, whether or not to emit light in the third phase may be set for each indicator 70. For example, the first indicator 70 indicates “1000” (1 indicates light emission and 0 indicates no light emission) while the first to fourth phases are executed four times. ) And set. In the second indicator 70, the light emission or non-light emission of the third phase while the first to fourth phases are executed four times is set to “1010”. In this case, the first indicator 70 and the second indicator 70 are compared by comparing the four third-phase captured images that are captured while the first to fourth phases are executed four times. Can be identified.

Next, a method for detecting the pointing position of the pointers 70 and 80 will be described with reference to FIG. FIG. 4A shows a state where the pointing position of the pointer 70 is detected, and FIG. 4B shows a state where the pointing position of the pointer 80 is detected.
A shooting direction in which the imaging unit 51 captures the screen SC is indicated by a symbol PA. When detecting the position of the indicator 70, the transmission / reception unit 74 emits infrared light from the light emission position 70 a at the tip of the indicator 70. The light emission position 70a is very close to the contact point 70b where the indicator 70 contacts the screen SC. For this reason, when detecting an image of light emitted from the indicator 70 from the captured image data captured from the imaging direction PA, the position of this image can be regarded as the position of the contact point 70b.

On the other hand, when the indication position of the indicator 80 is detected as shown in FIG. 4B, the reflected light reflected by the indicator 80 is detected. That is, the reflected light image of the detection light L is detected from the captured image data captured from the capturing direction PA. The emission direction of the detection light L is substantially parallel to the screen SC, and the detection light L is separated from the screen SC by a predetermined distance (hereinafter referred to as distance G1). Although the distance G1 varies depending on the mounting position of the light emitting device 60 with respect to the screen SC, it is difficult to make the distance G1 zero due to the structure. For this reason, in the captured image data captured from the capturing direction PA, an image of the reflected light reflected at the reflection position 80a separated from the screen SC by the distance G1 is captured at the tip of the indicator 80. As shown in FIG. 4B, the reflection position 80a is away from the imaging direction PA in an oblique direction. For this reason, the position of the image of the reflected light reflected in the captured image data is the same position as the image in the case where the indicator 70 indicates a more distant position in the capturing direction PA. That is, the reflected light when the indicator 80 contacts the screen SC at the contact point 80b and the light when the indicator 70 contacts the screen SC at the contact point 70b are the same position in the captured image data of the imaging unit 51. It is reflected in. For this reason, the contact point 80b pointed to by the indicator 80 is detected as the contact point 70b away from the imaging unit 51 in the shooting direction PA, and a shift of the distance G2 occurs.
The shift in the distance G2 is caused by the imaging unit 51 taking an image obliquely from a position away from the screen SC. For example, the positional relationship between the shooting direction PA and the indicators 70 and 80 shown in FIGS. 4A and 4B occurs not only in the vertical direction but also in the horizontal direction. In the present embodiment, as shown in FIG. 1, since one imaging unit 51 provided in the main body of the projector 10 located above the screen SC shoots the screen SC in an overhead view, both in the vertical and horizontal directions. A shift of the distance G2 occurs.

Further, as shown in FIG. 5, when the screen SC is installed inclined with respect to the vertical direction, the distance between the detection light L emitted from the light emitting device 60 and the screen SC is the distance from the light emitting device 60. Depending on. That is, since the detection light L that is infrared light has high straightness, the distance between the detection light L and the screen SC may be different depending on the indicated position when the screen SC is installed with an inclination. For this reason, the error of the indicated position detected from the captured image data of the imaging unit 51 differs depending on the position on the screen SC indicated by the indicator 80.
For example, in FIG. 5, when a position 80c on the screen SC is pointed, this position 80c is detected as a position 70c away from the imaging unit 51 in the shooting direction PA, and a shift of the distance G3 occurs. When the position 80d on the screen SC is pointed, the position 80d is detected as a position 70d away from the imaging unit 51 in the shooting direction PA, and a shift of the distance G4 occurs. As shown in FIG. 5, when the distance between the detection light L and the screen SC increases as the distance from the light emitting device 60 increases, the position on the screen SC indicated by the user is clear as compared with the distance G3 and the distance G4. As the distance from the light emitting device 60 increases, the error in the indicated position detected from the captured image data of the imaging unit 51 increases.
Even if the screen SC is not inclined with respect to the vertical direction, the screen SC is pushed by the indicators 70 and 80, and the image is taken by the imaging unit 51 in a state where the screen SC is inclined with respect to the vertical direction. There is a case. In such a case, the screen SC is detected from the position on the screen SC indicated by the indicators 70 and 80 and the captured image data of the imaging unit 51, as in the case where the screen SC is installed inclined with respect to the vertical direction. An error occurs in the indicated position. That is, the indicated position detected from the captured image data of the imaging unit 51 varies.

In addition, there may be a deviation in the indicated position that is detected depending on the operation characteristics of the user and the shooting timing of the imaging unit 51.
For example, when the pointing position is pointed to without pointing the indicator 80 to the screen SC (see FIG. 6A), and when the pointing point 80 is pointed to the screen SC with the pointing position (see FIG. 6B). ))), The position of the indicator 80 to which the detection light L hits is different. For this reason, deviation also occurs in the indicated position detected from the captured image data of the imaging unit 51. 6A and 6B indicates a position on the screen SC that is actually instructed by the user using the indicator 80, and the position b is detected by the captured image data of the imaging unit 51. The upper position is shown.
The same thing occurs depending on the shooting timing of the imaging unit 51. For example, when the imaging timing of the imaging unit 51 is a timing when the indicator 80 shown in FIG. 6A is not in contact with the screen SC, and when the indicator 80 shown in FIG. 6B is in contact with the screen SC. The detected indication position is deviated from the detected timing.

In order to correct such a change in the indicated position, the projector 10 projects, for example, a reference fluctuation amount calculation image 114 shown in FIG. A reference fluctuation amount of the indicated position detected at the position is calculated. The reference variation amount calculation image 114 is an image in which a plurality of predetermined marks (characters A to F in the present embodiment) are displayed. The control unit 30 displays the reference variation amount calculation image 114 on the screen SC, so that the user performs a pressing operation using at least one of the indicator 70 and the indicator 80 at a plurality of mark positions where the marks are displayed. Make it.
After the user inputs an indicator 70 or 80 for giving an instruction using the operation panel 19, the user presses the indicator 70 or 80 for selecting each mark position where the mark is displayed, for example, for 2 seconds. The user's pressing operation is imaged a plurality of times for each mark position by the imaging unit 51. When the indicator 70 is selected, the position detector 50 calculates the coordinate value of the position where the indicator 70 emits light in each captured image captured by the imaging unit 51. Further, when the indicator 80 is selected, the position detector 50 calculates the coordinate value of the position of the reflected light reflected by the indicator 80 in each captured image captured by the imaging unit 51. . The position detection unit 50 outputs a plurality of coordinate values calculated for each mark position to the control unit 30. The detection control unit 32 of the control unit 30 uses the type information of the indicator 70 or 80 input by the user and the plurality of coordinate values acquired for each mark position to calculate the reference fluctuation amount of the coordinate value at each mark position. calculate. The reference variation amount is generated separately for each of the indicator 70 and the indicator 80. The reference variation amount at the mark position is obtained, for example, by comparing the X-coordinate value and the Y-coordinate value of the coordinate values calculated from the captured image data captured a plurality of times. For example, the detection control unit 32 obtains a maximum value and a minimum value of the X coordinate value and the Y coordinate value of a plurality of coordinate values detected at the same mark position, respectively. The X and Y coordinates are the coordinate values of the designated positions of the pointers 70 and 80 in the captured image data calculated by the coordinate calculation unit 55, but may be the coordinate values of the designated positions in the projection image. Further, the X coordinate and the Y coordinate may be coordinate values of the designated position in the image data drawn in the frame memory 44. The detection control unit 32 calculates the difference between the maximum value and the minimum value of the obtained X coordinate value and the difference between the maximum value and the minimum value of the Y coordinate value as the reference fluctuation amount at the corresponding mark position.
In addition, after calculating the reference variation amount, the detection control unit 32 stores the calculated reference variation amount in the storage unit 110. When the indicator 70 is selected, the detection control unit 32 stores the detected reference variation amount of the indicator 70 in the storage unit 110 as the first reference variation amount 115. Further, when the indicator 80 is selected, the detection control unit 32 stores the reference variation amount of the indicator 80 in the storage unit 110 as the second reference variation amount 116. Further, the detection control unit 32 stores the calculated reference fluctuation amount at each mark position in the storage unit 110 as the reference fluctuation amount of the region including the mark. For example, in the reference variation amount calculation image 114 shown in FIG. 7A, six reference variation amounts A to F are obtained. For example, the detection control unit 32 divides the photographed image data into nine as shown in FIG. 7B, and stores the reference variation amount of the mark included in each of the nine divided regions as the reference variation amount of the region. 110 is stored. For example, the detection control unit 32 stores the reference variation amount of the mark position A illustrated in FIG. 7A in the storage unit 110 as the reference variation amount of the first region illustrated in FIG. 7B. Similarly, the detection control unit 32 uses the second region, the third region, and the fourth region shown in FIG. 7B for the reference variation amounts at the mark positions B, C, D, E, and F shown in FIG. It is stored in the storage unit 110 as the reference variation amounts of the area, the fifth area, and the sixth area.
Further, the detection control unit 32 obtains the reference variation amount of the area of the captured image data where no mark exists by interpolation processing using the reference variation amount of the area close to this area. For example, in the example shown in FIG. 7B, no marks are included in the seventh, eighth, and ninth areas that are the central areas of the captured image data. For this reason, the detection control unit 32 obtains an average value of reference fluctuation amounts of the first area and the second area, which are areas close to the seventh area, and uses the obtained average value as a reference fluctuation amount of the seventh area. The data is stored in the storage unit 110. Further, the detection control unit 32 similarly obtains the reference variation amount for the eighth region and the ninth region, and stores the obtained reference variation amount in the storage unit 110.

Next, the reference variation amount calculation procedure will be described with reference to the flowchart shown in FIG. This process may be performed together with manual calibration performed by the calibration control unit 34, or may be performed after performing manual calibration or auto calibration.
First, the projection control unit 31 of the control unit 30 causes the display unit 16 to display a selection screen for selecting the indicators 70 and 80 for calculating the reference variation amount (step S1). When the selection input of the indicators 70 and 80 is received by the operation panel 19 or when the operation input of the remote control is received by the remote control light receiving unit 18 (step S2; YES), the projection control unit 31 displays the reference fluctuation amount calculation image. 114 is projected onto the screen SC (step S3). In the reference fluctuation amount calculation image 114, a plurality of marks for specifying the position indicated by the indicator 70 or 80 are displayed. When the reference variation amount calculation image 114 is projected on the screen SC, the detection control unit 32 of the control unit 30 outputs an instruction to start the shooting to the shooting control unit 53.

  The imaging control unit 53 of the position detection unit 50 causes the imaging unit 51 to capture a detection area that is an area including the screen SC, and inputs captured image data captured by the imaging unit 51 (step S4). The imaging control unit 53 passes the input captured image data to the indicator detection unit 54. The indicator detection unit 54 detects an infrared light image emitted by the indicator 70 or a reflected light image reflected by the indicator 80 from the captured image data captured by the imaging control unit 53. The coordinate calculation unit 55 calculates the coordinate value of the indication position of the indicator 70 or 80 in the captured image data based on the position of the image detected by the indicator detection unit 54, and outputs the calculated coordinate value to the control unit 30. . When the indicator detection unit 54 cannot detect the infrared light image emitted from the indicator 70 or the reflected light image reflected by the indicator 80 from the captured image data, the indicator detection unit 54 notifies the error. Is sent to the coordinate calculation unit 55. The coordinate calculation unit 55 outputs the error notification input from the indicator detection unit 54 to the control unit 30.

The detection control unit 32 of the control unit 30 determines that a contact for 2 seconds or more has been detected when coordinate values are continuously input from the coordinate calculation unit 55 a predetermined number of times (step S5; YES), and the corresponding mark Is changed to “detected” (step S6). Further, the detection control unit 32 instructs the shooting control unit 53 to start shooting when the coordinate value cannot be continuously input a predetermined number of times, such as when an error notification is input from the position detection unit 50. Is output.
Next, the detection control unit 32 calculates a reference variation amount at the mark position where the coordinate value is input (step S7). For example, the detection control unit 32 obtains the maximum value and the minimum value of the X coordinate and the Y coordinate of the coordinate value continuously input from the coordinate calculation unit 55 a predetermined number of times, and calculates the difference between the calculated maximum value and the minimum value, Calculated as the reference fluctuation amount at the corresponding mark position. If the reference fluctuation amount of the coordinate value is ± 5 pixels, it may be determined that there is no fluctuation in the coordinate value. When the detection control unit 32 calculates the reference variation amount at the mark position, the detection control unit 32 associates the calculated reference variation amount at the mark position with the type information of the indicator 70 or 80 that calculated the reference variation amount in the storage unit 110. Store (step S8). The detection control unit 32 stores the calculated reference fluctuation amount at the mark position in the storage unit 110 as the reference fluctuation amount of the region including the mark. For example, in the case of the reference variation amount at the mark position A shown in FIG. 7A, the detection control unit 32 stores the reference variation amount in the first region shown in FIG. 7B in the storage unit 110.
Next, the detection control unit 32 determines whether or not the reference fluctuation amount has been calculated at all mark positions (step S9). If it is determined that the reference fluctuation amounts at all the mark positions have not been calculated (step S9; NO), the detection control unit 32 returns to step S4 and outputs an instruction to start shooting to the shooting control unit 53. If it is determined that the correction values at all the mark positions have been calculated (step S9; YES), the detection control unit 32 calculates a reference variation amount in a region other than the region including the mark by interpolation processing (step S9; YES). Step S10). The detection control unit 32 stores the calculated reference variation amount in the storage unit 110.

Next, details of the process of correcting the coordinate values designated by the indicators 70 and 80 will be described with reference to the flowchart shown in FIG.
For example, when an image based on the image data input via the image I / F 12 is projected onto the screen SC, the imaging control unit 53 causes the imaging unit 51 to image the detection area under the control of the control unit 30. The position detection unit 50 detects the infrared light image emitted from the indicator 70 or the reflected light image reflected by the indicator 80 from the captured image data captured by the imaging unit 51 to indicate the indicator 70 or 80. The coordinate value of the indicated position is calculated. Further, the position detection unit 50 reflects the detected image on the indicator 80 to determine whether the detected image is an infrared light image emitted by the indicator 70 based on the light emission timing of the indicator 70 and the light emitting device 60. It is determined whether the image is reflected light. The position detection unit 50 outputs the detected coordinate value and type information indicating the type of the indicator 70 or 80 used to the control unit 30.
First, the projection control unit 31 determines whether or not the coordinate value (hereinafter referred to as input coordinate value) and the type information of the indicator 70 or 80 used for the operation are input from the position detection unit 50 (step) S11). When the type information and the input coordinate value are input (step S11; YES), the projection control unit 31 determines whether the operation instruction is based on the indicator 70 or the indicator 80 based on the type information. Determination is made (step S12). When determining that the operation is performed by the indicator 70, the projection control unit 31 acquires the first reference variation amount set in the area including the input coordinate value from the storage unit 110 (step S13). Further, when determining that the operation is performed by the indicator 80, the projection control unit 31 of the control unit 30 acquires the second reference variation amount set in the region including the input coordinate value from the storage unit 110 (Step S1). S13). When the projection control unit 31 acquires the first reference variation amount or the second reference variation amount, the projection control unit 31 corrects the input coordinate value input from the position detection unit 50 based on the acquired reference variation amount (step S14). The projection control unit 31 passes the corrected input coordinate value to the image processing unit 40 (step S15). For example, the projection control unit 31 calculates the difference between the previous input coordinate value and the current input coordinate value. Then, the projection control unit 31 determines whether or not the difference between the calculated coordinate values is within the range of the first reference variation amount or the second reference variation amount acquired from the storage unit 110. When the calculated coordinate value difference is within the range of the acquired first reference variation amount or second reference variation amount, the projection control unit 31 determines that there is no change (variation) in the coordinate value, and The input coordinate value is passed to the image processing unit 40 as it is. In other words, the projection control unit 31 performs a correction for correcting a change from the previous input coordinate value (a correction for setting the change to 0) for the current input coordinate value, and passes the correction to the image processing unit 40. In addition, when the difference between the calculated coordinate values is not within the range of the acquired first reference variation amount or second reference variation amount, the projection control unit 31 determines that the coordinate value has changed, and this input coordinate value To the image processing unit 40. The image processing unit 40 draws a figure based on the coordinate value acquired from the projection control unit 31 and superimposes the drawn figure on the input image input to the image I / F unit 12 and projects it.

  As described above, in the present embodiment, when the image of the indicator 70 or 80 is detected from the captured image data of the imaging unit 51, whether the indicator used for the operation by the indicator detection unit 54 is the indicator 70. It is determined whether the indicator 80 is used. Then, the reference variation amount corresponding to the types of the pointers 70 and 80 determined by the pointer detection unit 54 and the pointing position is acquired from the storage unit 110, and the pointing position detected by the coordinate calculation unit 55 is obtained from the projection control unit 31. Correct with. Therefore, an appropriate instruction can be detected regardless of the indicators 70 and 80 to be used. For this reason, it is possible to suppress a decrease in reactivity of operations such as touch, release, and drag by the indicator 70 or 80.

  The projector 10 according to the embodiment to which the present invention is applied includes a pointer detection unit 54, a coordinate calculation unit 55, a storage unit 110, and a projection control unit 31. The indicator detection unit 54 determines the types of the indicators 70 and 80. The coordinate calculation unit 55 detects the indication positions of the indicators 70 and 80. The storage unit 110 stores the reference position reference variation amount by the indicators 70 and 80 for each of the indicators 70 and 80. The projection control unit 31 acquires a reference variation amount corresponding to the type of the indicators 70 and 80 determined by the indicator detection unit 54 from the storage unit 110, and corrects the indication position detected by the coordinate calculation unit 55. Therefore, it is possible to appropriately correct the indicated position regardless of the indicators 70 and 80 to be used.

  In addition, the projection control unit 31 performs correction to compensate for the variation when the variation in the designated position is within the range of the reference variation amount. That is, the projection control unit 31 performs correction (correction to make the change 0) to compensate for the change from the previous input coordinate value. For this reason, it can be detected that there is no change in the indicated position.

  Further, the storage unit 110 stores a plurality of reference fluctuation amounts corresponding to the designated positions. The projection control unit 31 acquires a reference variation amount corresponding to the designated position detected by the coordinate calculating unit 55 from the storage unit 110, and corrects the designated position detected by the coordinate calculating unit 55. Therefore, it is possible to correct the indicated position using an appropriate reference fluctuation amount for each indicated position of the indicators 70 and 80.

  In addition, the projection control unit 31 adjusts the reference variation amount stored in the storage unit 110 according to the designated position, and corrects the designated position detected by the indicator detection unit 54 based on the adjusted reference variation amount. Therefore, the correction accuracy of the designated position can be increased.

  In addition, the detection control unit 32 calculates a reference variation amount based on the variation of the indicated position detected by the indicator detection unit 54 and causes the storage unit 110 to store the calculated reference variation amount. Accordingly, the reference variation amount can be calculated based on the variation of the designated position detected by the indicator detection unit 54 and stored in the storage unit.

  In addition, the projector 10 includes a light emitting device 60 and an imaging unit 51. The light emitting device 60 emits detection light to a detection region that detects the indication positions of the indicators 70 and 80. The imaging unit 51 images the detection area. The indicator detection unit 54 detects at least one of an image of light emitted from the indicator 70 and an image of detection light reflected by the indicator 80 from the captured image data of the imaging unit 51. The indicator detection unit 54 distinguishes and detects the indication positions of the indicator 70 and the indicator 80 based on the light emission timings of the indicator 70 and the light emitting device 60. Therefore, it is possible to appropriately correct the indicated position regardless of the indicators 70 and 80 to be used.

  Further, the indicator detection unit 54 detects the position of the bright spot reflected in the captured image data when the light emitting device 60 is turned off as the indication position of the indicator 70. Therefore, the accuracy of distinguishing the indicator 70 and the indicator 80 can be improved.

The above-described embodiments are merely examples of specific modes to which the present invention is applied, and the present invention is not limited thereto, and the present invention can be applied as different modes. For example, in the above embodiment, the reference variation amount is stored in the storage unit 110 for each indicator 70 and 80 and for each region, and when the coordinate value is corrected, the reference variation corresponding to the indicators 70 and 80 and the region is used. The amount is acquired, but is not limited to this mode. For example, one reference variation amount is stored for each of the indicators 70 and 80, and an adjustment amount (for example, a difference from the reference variation amount) is stored for each region. Then, when correcting the coordinate value, the reference fluctuation amount acquired according to the indicators 70 and 80 is adjusted using the adjustment amount according to the area, and corrected using the adjusted reference fluctuation amount; It is also possible to do.
Moreover, in the said embodiment, when calculating the reference | standard variation | change_quantity, although the difference of the maximum value of coordinate value and the minimum value is made into the reference | standard variation | change_quantity, it is not limited to this. For example, a value obtained by adding a predetermined value to the difference between the maximum value and the minimum value of the coordinate values may be used as the reference fluctuation amount.
In the above-described embodiment, when the reference fluctuation amount is calculated, the indicators 70 and 80 are brought into contact with each mark on the reference fluctuation amount calculation image 114 for a predetermined set time (2 seconds) or longer. The set time is not limited to 2 seconds, and may be shorter or longer.

Further, in the above-described embodiment, the aspect in which the user performs an instruction operation using the indicators 70 and 80 on the screen SC on which an image is projected (displayed) from the front projection type projector 10 has been described. In addition to this, a mode in which an instruction operation is performed on a display screen displayed by a display device other than the projector 10 may be used.
As a display device other than the projector 10, a rear projection (rear projection) type projector, a liquid crystal display, and an organic EL (Electro Luminescence) display can be used. As the display device, a plasma display, a CRT (cathode ray tube) display, a surface-conduction electron-emitter display (SED), or the like can be used.

Further, as the indicator 70, an indicator 70 set so as not to emit light may be used. Further, the indicator is not limited to the pen-type indicator 70 or the indicator 80 that is a user's finger, and a laser pointer, an indicator bar, or the like may be used, and the shape and size thereof are not limited. Further, the mark in the reference variation amount calculation image 114 is not limited to the characters shown in FIG. 7, and may be other characters or figures.
Moreover, in the said embodiment, although the light-projection apparatus 60 was comprised separately from the main body of the projector 10, and illustrated the structure connected with the cable 60a, this invention is not limited to this. For example, the light emitting device 60 may be integrally attached to the main body of the projector 10 or may be configured to be built in the main body of the projector 10. Further, the light emitting device 60 may be supplied with power from the outside and connected to the emitting device driving unit 48 by a wireless communication line.
In the above embodiment, the configuration in which the projector 10 transmits the synchronization signal to the indicator 70 using the infrared signal emitted from the transmission unit 52 to the indicator 70 has been described. However, the synchronization signal is an infrared signal. It is not limited to. For example, a synchronization signal may be transmitted by radio wave communication or ultrasonic wireless communication. This configuration can be realized by providing the projector 10 with a transmission unit that transmits signals by radio wave communication or ultrasonic radio communication, and providing the indicator 70 with a similar reception unit.

  Moreover, in the said embodiment, although the position detection part 50 image | photographed the screen SC by the imaging part 51 and pinpointed the position of the indicator 70, this invention is not limited to this. For example, the imaging unit 51 is not limited to the one provided in the main body of the projector 10 and photographing the projection direction of the projection optical system 23. The imaging unit 51 may be arranged separately from the main body of the projector 10, or the imaging unit 51 may perform imaging from the side or front of the screen SC. Further, a plurality of imaging units 51 may be arranged, and the detection control unit 32 may detect the positions of the indicators 70 and 80 based on the captured image data of the plurality of imaging units 51.

In the above embodiment, the light modulation device 22 that modulates the light emitted from the light source has been described by taking as an example a configuration using three transmissive liquid crystal panels corresponding to RGB colors. Is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a method in which one liquid crystal panel and a color wheel are combined may be used. Alternatively, a system using three digital mirror devices (DMD), a DMD system combining one digital mirror device and a color wheel, or the like may be used. When only one liquid crystal panel or DMD is used as the light modulation device, a member corresponding to a composite optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and DMD, any light modulation device capable of modulating light emitted from the light source can be employed without any problem.
Moreover, each function part of the projection system 1 shown in FIG. 2 shows a functional structure, and a specific mounting form is not particularly limited. That is, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to adopt a configuration in which the functions of a plurality of function units are realized by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, specific detailed configurations of other parts of the projection system 1 can be arbitrarily changed without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Projection system, 10 ... Projector (position detection apparatus), 20 ... Projection part, 21 ... Light source part, 22 ... Light modulation apparatus, 23 ... Projection optical system, 30 ... Control part, 31 ... Projection control part (correction part) , 32 ... detection control unit (calculation unit), 33 ... emission control unit, 39 ... calibration control unit, 40 ... image processing unit, 50 ... position detection unit, 54 ... indicator detection unit (determination unit), 55 ... coordinates Calculation unit (detection unit), 60 ... light emitting device (light emitting unit), 70 ... indicator (first indicator), 80 ... indicator (second indicator), 110 ... storage unit, SC ... screen (detection) region).

Claims (8)

A determination unit for determining the type of the indicator;
A detection unit for detecting an indication position of the indicator;
A storage unit that stores, for each indicator, a reference variation amount related to a change in the indication position detected by the detection unit;
A correction unit that acquires a reference variation amount according to the type of the indicator determined by the determination unit from the storage unit, and corrects the indicated position detected by the detection unit based on the acquired reference variation amount;
A position detection device comprising:   The position detection apparatus according to claim 1, wherein the correction unit performs correction to compensate for the change when the change in the designated position is within the range of the reference change amount. The storage unit stores a plurality of reference fluctuation amounts according to the designated position,
The correction unit acquires a reference variation amount corresponding to the indicated position detected by the detection unit from the storage unit, and corrects the indicated position detected by the detection unit based on the acquired reference variation amount. The position detection device according to claim 1, wherein   The correction unit adjusts the reference variation amount stored in the storage unit according to an indicated position, and corrects the indicated position detected by the detection unit based on the adjusted reference variation amount. The position detection device according to claim 1 or 2. A calculation unit that calculates the reference fluctuation amount based on a change in the indicated position detected by the detection unit;
The position detection device according to claim 1, wherein the storage unit stores the reference variation amount calculated by the calculation unit. A light emitting unit that emits detection light to a detection region that detects an indication position of the indicator;
An imaging unit for imaging the detection area;
The detection unit includes at least one of an image of light emitted by the first indicator as the indicator and an image of the detection light reflected by the second indicator as the indicator from the captured image data of the imaging unit. One of them is detected, and the indication positions of the first indicator and the second indicator are distinguished and detected based on the light emission timings of the first indicator and the light emitting unit. The position detection device according to any one of 1 to 5.   The position detection device according to claim 6, wherein the detection unit detects a position of a bright spot reflected in captured image data when the light emitting unit is turned off as an indication position of the first indicator. Determining the type of indicator;
Detecting an indication position of the indicator;
A reference variation amount corresponding to the determined type of the indicator is acquired from a storage unit that stores, for each indicator, a reference variation amount related to the detected variation in the indication position, and the detected indication position is obtained from the acquired reference variation. Correcting based on the amount;
A position detection method comprising:

Images