JP2012053603A - Information display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect a locus of a pointing device even if imaging by a camera is not possible because the pointing device is shadowed by a person.SOLUTION: An information display system includes a pointing device and a control device 50 that detects a locus of a tip of the pointing device. The pointing device includes a light emitting unit that projects radiation light extending radially having the tip as a center on a predetermined plane. A camera 30 picks up an image of an area including the radiation light on the predetermined plane. A radiation light detection unit 54 detects the radiation light from the picked up image. An estimation unit 56 estimates a position of the tip of the pointing device from the detected radiation light.

Description

  The present invention relates to an information display technique for detecting and displaying a locus of a pointing device.

  A projection display system that can detect the locus of a pointing device on a screen and draw the locus in a projected image has been put into practical use, and is used for, for example, a presentation or a lecture at a school. In this type of system, a camera that captures the entire screen is generally installed, light is emitted from the tip of the pointing device, and this light is detected from the captured image of the camera, so that the locus of the pointing device can be determined. Detected. However, when the operator of the pointing device is positioned between the camera and the screen, there is a problem that the tip of the device cannot be imaged by the camera and the locus cannot be traced.

  In Patent Document 1, an electronic pen provided with an infrared light emitting unit and an ultrasonic wave generating unit is used, and projection is performed based on a difference between an infrared light receiving time at an infrared light receiving unit and an ultrasonic wave receiving time at a plurality of ultrasonic receiving units. A projection display device that calculates the coordinates of an electronic pen on an image is disclosed. According to this, even when the electronic pen is located behind the user as viewed from the projection display device, the coordinates can be calculated.

JP 2007-25295 A

  In the technique described in Patent Document 1, since it is necessary to incorporate ultrasonic transmission / reception devices into the electronic pen and the projection display device, respectively, the configuration becomes complicated and the cost increases.

  The present invention has been made in view of such a situation, and an object of the present invention is to detect the tip of the pointing device with a camera in a system that detects light projected from the pointing device onto the screen and detects the locus of the device. Even in such a case, a technique for specifying the position is to be provided.

  One embodiment of the present invention is an information display system including a pointing device and a control device that detects a trajectory of a distal end portion of the pointing device. The pointing device includes a light emitting unit that emits radiated light that spreads radially around the tip on a predetermined surface. The control device includes an imaging unit that captures an area including the radiated light on a predetermined surface, a detection unit that detects radiated light from the captured image, and the position of the tip of the pointing device from the detected radiated light. An estimation unit.

  Another aspect of the present invention is also an information display system including a pointing device and a control device that detects a locus of the tip of the pointing device. The pointing device includes a first light emitting unit that forms a first irradiation region in the direction of the tip, a second light emitting unit that forms a second irradiation region surrounding the first irradiation region, and the first light emitting unit or the second light emitting unit. A switch for turning on or off one of the light emitting units. The control device detects an imaging unit that images a region including the first irradiation region and the second irradiation region on a predetermined surface, and a detection unit that detects the first irradiation region and the second irradiation region from the captured image. An estimation unit that estimates the position of the tip of the pointing device based on the position or shape of the first irradiation region or the second irradiation region, and the operation of the switch when the first irradiation region or the second irradiation region is detected. A notification unit for notifying the apparatus.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  According to the present invention, in a display system that detects light projected on a screen from a pointing device and detects the trajectory of the device, the position of the pointing device can be specified even when the tip of the pointing device cannot be captured by the camera. become.

1 is a diagram showing an overall configuration of a projection display system according to the present invention. 1 is a diagram illustrating a structure of a pen-type device according to Embodiment 1. FIG. It is a figure which shows the example of the emitted light irradiated on a screen when a pen type device is pressed perpendicularly | vertically with respect to a screen. It is a figure explaining the method of estimating a pen tip position from the shape of the radiated light imaged with the camera. 1 is a diagram showing a configuration of a projection display device according to Embodiment 1. FIG. 6 is a flowchart of a process of drawing on a screen using a pen-type device. It is a figure explaining the method of estimating the inclination of a device with respect to a screen surface using a pen type device. It is a figure explaining the method of detecting rotation of a device using a pen-type device. It is a figure explaining the method of estimating the distance of the device with respect to a screen surface using a pen-type device. It is a figure which shows the pen type device which made the position of a slit asymmetrical. It is a figure which shows the pen-type device which expanded the width | variety of the slit. It is a figure which shows the modification of the slit shape formed in the housing | casing of a pen type device. It is a figure which shows the pen-type device which increased the number of the slits formed in a housing | casing. It is sectional drawing of the pen-type device which concerns on Embodiment 2. FIG. 6 is a diagram showing a configuration of a projection display apparatus according to Embodiment 2. FIG. 6 is a cross-sectional view of a pen-type device according to Embodiment 3. FIG.

Embodiment 1 FIG.
FIG. 1 shows an overall configuration of a projection display system 100 according to Embodiment 1 of the present invention. The projection display system 100 includes a projection display device (also referred to as “projector”) 80, a screen 110 on which an image is projected from the projection display device 80, and a pointing device 120 operated by a user S. The projection display device 80 includes a camera 30 for photographing the screen 110 direction. As an example, the camera 30 is installed such that the optical axis center thereof is parallel to the optical axis center of the projection light projected from the projection display device 80.

  In the first embodiment, the user S performs an operation of writing a line or a character by moving the device 120 in a state where the pen-type pointing device 120 is in contact with the projection surface of the screen 110. The projection display device 80 detects the locus of the distal end portion of the pointing device 120 based on the image captured by the camera 30. Then, an image in which the locus is drawn is created and projected on the screen 110.

  The camera 30 is arranged so that almost the entire screen 110 falls within the viewing angle in order to capture the movement of the pointing device 120 on the projected image. As shown in FIG. 1, it is preferable that the screen 110 and the camera 30 face each other. However, the camera 30 may be disposed at a position separated from the projection display device 80 in the left-right direction, or the projection display device. You may arrange | position in the screen vicinity rather than 80. A plurality of cameras 30 may be used.

  FIG. 2A shows the structure of a pen-type pointing device (hereinafter simply referred to as “pen-type device”) 120 according to the first embodiment. The pen-type device 120 detects an operation performed on the projection surface of the screen while being held by the user in the same manner as a normal pen. In FIG. 2, the solid line indicates the outer shape, and the dotted line indicates the internal structure or the shape on the back side.

  A switch 122 having a hemispherical tip is attached to the tip of the pen-type device 120. Inside the substantially cylindrical casing of the pen-type device 120, a light emitting element 124 such as an LED (Light Emitting Diode) that is supplied with power from a battery (not shown) is provided. When the user presses the tip of the pen-type device 120 against the screen 110, the switch 122 is pressed inward and the light emitting element 124 is lit.

  In the case of the pen-type device 120, a plurality of elongated slits 130 are formed on the tip side of the light emitting element 124. Basically, the slit 130 has an elongated rectangular shape extending in the axial direction of the pen-type device 120, but may have other shapes.

  The central axis of the pen-type device 120, the contact point of the switch 122 with the screen, and the light emission center of the light emitting element 124 are preferably arranged coaxially. In addition, the casing of the pen-type device 120 is not limited to a cylindrical shape, but may have any shape, but the slits 130 formed in the casing of the pen-type device 120 are preferably equidistant from the central axis of the device. .

  FIG. 2B is an end view of the pen-type device 120 as viewed from the distal end side. In this embodiment, three slits 130 are formed at equal intervals in the circumferential direction.

  The length of the slit 130 in the axial direction is such that even when the pen-type device 120 is hidden in the shadow of the user S when viewed from the camera 30, the emitted light on the screen can be captured by the camera out of the shadow of the user. It is preferably selected such that the emitted light extends.

  FIG. 3 shows an example of the shape of light emitted from the device onto the screen when the pen-type device 120 is pressed perpendicularly to the screen. When the switch 122 of the pen-type device 120 is pressed, the light emitting element 124 emits light, and light leaks through the slit 130. As shown in FIG. 3, the light leaking from each slit 130 spreads radially around the tip of the pen-type device (that is, the contact position of the switch 122 with the screen) P, and is elongated and substantially trapezoidal emitted light 132. Form. Since the slit 130 does not extend to the tip of the pen-type device 120, the emitted light 132 appears at a position away from the pen tip position P.

  When the light emitting element 124 is a light emitting element having strong directivity such as an LED, it is preferable to arrange a reflector such as a prism or a mirror in the irradiation direction of the light emitting element 124 so that sufficient light leaks from the slit 130. Note that the illuminance and color of the light emitting element 124 are selected such that the outer shape of at least a part of the emitted light 132 can be recognized in the captured image of the screen in the assumed use environment of the projection display device 80.

  FIG. 4 is a diagram for explaining a method of estimating the pen tip position P from the radiated light imaged by the camera. As described above, since the camera 30 is arranged at a position where the entire screen 110 falls within the viewing angle, the pen-type device 120 is hidden by the shadow of the user S, and the tip of the pen-type device 120 cannot be imaged. Cases arise. Even if the projection display device 80 of the present embodiment cannot capture the tip of the pen, it can estimate the pen tip position P using the elongated radiated light included in the captured image.

  Assume that the pen tip position P is in the shadow of the user S and cannot be observed from the camera 30 as shown in FIG. At this time, the projection display device 80 detects the emitted light 132 from the captured image. Furthermore, two line segments extending in the radial direction around the pen tip position P are detected from among the line segments constituting the outer shape of the emitted light 132. A point that intersects when the two line segments are extended in the captured image is estimated as the pen tip position P. As described above, since the nib position P and the center of the light emitting element 124 are coaxial, the nib position P can also be obtained by obtaining the direction in which the emitted light is emitted.

  If at least two line segments extending in the radial direction are detected among the outer shapes of the three radiated lights 132, the above estimation method can be executed. That is, the intersection of two line segments constituting the outer shape of one emitted light 132 may be used, or one line segment constituting the outer shape of the first emitted light 132 and the second emitted light 132 may be used. You may use the intersection with one line segment which comprises an external shape. Therefore, even if most of the radiated light is hidden in the shadow of the user S, the pen tip position P can be estimated.

  When a plurality of emitted lights 132 are detected in the captured image, the pen tip position P may be estimated by selecting any one of the emitted lights 132, or the pen tip position may be estimated for each emitted light. Also good. In the latter case, an average value of the pen tip position P estimated for each radiation light may be employed.

  FIG. 5 is a diagram showing a configuration of the projection display apparatus 80 according to the first embodiment. The projection display device 80 mainly includes a projection unit 10, a camera 30, and a control device 50. The control device 50 includes a tip detection unit 52, a radiation light detection unit 54, an estimation unit 56, a drawing unit 58, a video signal output unit 60, and an image memory 62.

  The configuration of the control device 50 can be realized in terms of hardware by a CPU, memory, or other LSI of an arbitrary computer, and is realized by a program loaded in the memory in terms of software. Depicts functional blocks realized by. Accordingly, those skilled in the art will understand that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The projection unit 10 projects an image on the screen 110. The projection unit 10 includes a light source 11, an optical modulator 12, and a focus lens 13. As the light source 11, a halogen lamp having a filament-type electrode structure, a metal halide lamp having an electrode structure for generating arc discharge, a xenon short arc lamp, a high-pressure mercury lamp, an LED lamp, or the like can be employed.

  The optical modulator 12 modulates the light incident from the light source 11 in accordance with the video signal set from the video signal output unit 60. For example, a DMD (Digital Micromirror Device) can be employed for the optical modulator 12. The DMD includes a plurality of micromirrors corresponding to the number of pixels, and generates desired video light by controlling the direction of each micromirror according to each pixel signal.

  The focus lens 13 adjusts the focal position of the light incident from the light modulator 12. The image light generated by the light modulator 12 is projected onto the screen 110 via the focus lens 13.

  The camera 30 images the screen 110, the image projected on the screen 110 by the projection unit 10, and the pen-type device 120 as main subjects. The camera 30 includes a solid-state image sensor 31 and a signal processing circuit 32. As the solid-state imaging device 31, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Devices) image sensor, or the like can be adopted. The signal processing circuit 32 performs various signal processing such as A / D conversion and conversion from the RGB format to the YUV format on the signal output from the solid-state imaging device 31 and outputs the signal to the control device 50.

  The tip detection unit 52 detects the tip of the pen device 120 from the captured image obtained from the camera 30. This detection is performed using a known technique such as template matching. Alternatively, a light-emitting element may be incorporated in the switch 122 of the pen-type device 120 so that the switch itself emits light when the tip of the switch 122 is pressed against the screen. In this case, the tip detection unit 52 detects the light emission point of the pen tip from the captured image obtained from the camera 30.

  When the tip of the pen device 120 can be detected from the captured image, the tip detector 52 determines the coordinates of the pen tip position P in the projection video area. This information is transmitted to the drawing unit 58.

  When the tip of the pen-type device 120 cannot be detected from the captured image, the radiated light detection unit 54 detects the substantially trapezoidal radiated light 132 from the captured image. This detection can also be realized using a technique such as template matching.

  The estimation unit 56 specifies the outer shape of the radiation light 132 detected by the radiation light detection unit 54 and further detects at least two line segments extending in the radial direction. Then, the two line segments are extended in the captured image, and the intersection position is estimated as the pen tip position P. The estimation unit 56 further determines the coordinates of the pen tip position P within the projection video area and outputs the coordinates to the drawing unit 58.

  The drawing unit 58 continuously connects the coordinates of the pen tip position P received from the tip detection unit 52 or the estimation unit 56 for each captured image, and specifies the locus of the tip part of the pen-type device 120. Then, an image in which a line having predetermined characteristics (color, thickness, line type, etc.) is drawn on the specified locus is created.

  The image memory 62 holds image data to be projected on the screen 110. This image data is supplied from an external device such as a personal computer (PC) via an external interface (not shown). The video signal output unit 60 combines the video signal based on the image data held in the image memory 62 and the image created by the drawing unit 58 and outputs the synthesized signal to the optical modulator 12. As a result, an image in which a line drawn by the user S is added to the video signal is projected and displayed on the screen 110. The video signal output unit 60 may output only the trajectory image without outputting the video signal from the image memory.

FIG. 6 is a flowchart of a process of drawing a trajectory on the screen with a pen-type device using the projection display system 100.
First, the camera 30 images the projected video area on the screen (S10). The tip detection unit 52 tries to detect the tip of the pen-type device in the captured image (S12). When the pen tip is detected (Y in S12), the tip detector 52 determines the coordinates of the pen tip position in the projection area (S14). When the pen tip cannot be detected (N in S12), the emitted light detection unit 54 tries to detect the emitted light in the captured image (S16). If the emitted light is not detected (N in S16), it is considered that the pen-type device is not in contact with the screen, so the process proceeds to S24 without creating a drawing image. When the radiated light is detected (Y in S16), the estimating unit 56 estimates the coordinates of the pen tip position based on at least two line segments constituting the outer shape of the radiated light (S18).

  The drawing unit 58 creates an image in which the trajectory of the pen-type device is drawn based on the pen tip coordinates determined by the tip detection unit 52 or the estimation unit 56 (S20). The video signal output unit 60 combines the trajectory image with the video signal from the image memory 62 (S22), and the combined image is projected on the screen by the projection unit 10 (S24).

  As described above, according to the first embodiment, the pen tip position of the device is estimated using the radiated light leaking from the plurality of threats formed in the casing of the pen-type device. Since the light leaking from the slit extends radially on the screen, even when the pen tip is hidden from the camera by the user, at least a part of the emitted light is captured by the camera. Therefore, the pen tip position of the pen-type device can be estimated.

  Further, by providing a plurality of slits in the circumferential direction of the pen-type device, it is possible to avoid a situation in which the emitted light cannot be imaged depending on the orientation of the pen-type device and the angle with respect to the screen. Moreover, detection accuracy can be improved by estimating the pen tip position using a plurality of radiated light.

  Hereinafter, modifications of the first embodiment will be described.

  FIG. 7 is a diagram for explaining a method of estimating the tilt of the device with respect to the screen surface using the pen-type device 120. When the pen-type device 120 is tilted and brought into contact with the screen surface as shown in (a), the emitted light 136 decreases in the tilted direction as shown in (b), and the emitted light 134 increases in the opposite direction. Become. Therefore, the estimation unit, based on a comparison between the emitted light formed when the pen-type device is pressed perpendicularly to the screen and the emitted light detected from the captured image, The direction can be estimated. For example, a reference pattern of emitted light corresponding to the angle formed by the pen-type device and the screen is held in the projection display unit, and the angle is determined based on the matching result between the reference pattern and the emitted light detected from the captured image. May be estimated.

  FIG. 8 is a diagram for explaining a method of detecting the rotation of the device using the pen-type device 120. If the estimation unit specifies that the angle of the emitted light 132 has changed from (a) to (b) without changing the pen tip position P by comparing the captured images between the frames by the camera 30, Rotation can be detected.

  FIG. 9 is a diagram for explaining a method of estimating the distance of the device with respect to the screen surface using the pen-type device 120. In this example, it is assumed that the light emitting element 124 inside the device is always lit regardless of the switch 122. As shown to (a), when the pen-type device 120 exists in the position away from the screen surface, the emitted light 132 formed on the screen is also away from the pen tip position P. As shown in (b), when the pen-type device 120 comes into contact with the screen surface, the emitted light 132 formed on the screen approaches the pen tip position P. Therefore, a table or a calculation formula is prepared in advance so that the distance between the pen tip position P in the captured image and the tip of the emitted light 132 corresponds to the distance between the actual screen and the pen-type device. Thus, the estimation unit can estimate the distance between the screen and the pen-type device.

  As described with reference to FIGS. 7 to 9, by obtaining the tilt, rotation, and distance of the pen-type device 120, operations other than drawing of the pen-type device can be used as input to an external device such as a PC. . For example, the approaching action of the pen-type device to the screen surface corresponds to a mouse click operation, the inclination of the pen-type device more than a predetermined angle corresponds to the movement of the selected object in the inclination direction, or the pen-type It is conceivable that the rotation of the device corresponds to the rotation of the selected object.

  FIGS. 10-12 shows the modification of the slit shape formed in the housing | casing of a pen-type device. In each figure, (a) shows an end view of the pen-type device observed from the tip, and (b) shows the shape of the emitted light formed on the screen when the pen-type device is brought into contact with the screen perpendicularly. Is shown.

  FIG. 10A shows a pen-type device 140 in which the position of the slit 130 is asymmetric. In this example, three slits are located on the left side of the center line. Therefore, the emitted light on the screen also extends to the left side of the pen tip position, as shown in FIG. When the user holds the pen-type device 140 with the side without the slit facing the palm, the light leaking from the slit 130 is not easily blocked by the user's hand. Therefore, it becomes easy to detect the emitted light by the camera.

  FIG. 11A shows a pen-type device 150 in which the width of the slit 152 is larger than that in the above-described embodiment. The emitted light formed on the screen by the pen-type device 150 is close to a fan shape as shown in FIG. In this case, the angle formed by the two line segments extending in the radial direction of the emitted light is increased, and it is expected that the detection accuracy of the pen tip position is improved.

  FIG. 12A shows a pen-type device 160 in which the slit 162 is extended to the pen tip. The emitted light formed on the screen by the pen-type device 160 has a three-pronged shape in which the central portions are connected as shown in FIG.

  FIG. 13A shows a pen-type device 170 in which the number of slits formed in the housing is increased. Like the slits in the pen-type device 120 of FIG. 2, the slits 172 are arranged at equal intervals in the circumferential direction, but each slit is divided into two in the axial direction. FIG. 13B shows the shape of the emitted light formed on the screen by the pen-type device 170, and includes two types of emitted lights 176 and 178 having different shapes. By doing so, the amount of information of the radiated light for estimating the pen tip position increases, so that it is expected that the estimation accuracy of the pen tip position and the pen tilt will be improved.

  When two or more users draw on one screen, each user may use a pen-type device having a different slit shape. In this case, since the shapes of the emitted light on the screen surface are different, the pen tip position for each user can be distinguished by the processing on the projection display device side. Therefore, it is possible to project an image drawn with lines having different characteristics (thickness, color, line type, etc.) for each user.

  The shape, position, and number of the slits are not limited to the above, and any one can be appropriately selected as long as the pen tip position can be estimated from the radiated light shape captured by the camera. The shape of the emitted light may not be trapezoidal or fan-shaped as long as it is arranged radially around the tip of the pen-type device. Further, as long as the shape, position, and number of slits are appropriately selected, it is possible to use a device other than the pen type as the pointing device.

  In addition to the slit, an optical element such as a mirror, a prism, or a lens may be used to form the emitted light. Instead of using a slit, a light emitting element may be attached to the side surface of the case of the pen-type device and directly irradiated with radiated light.

Embodiment 2. FIG.
FIG. 14A is a cross-sectional view of a pen-type device 220 used with a projection display apparatus according to another embodiment of the present invention. The pen type device 220 is provided with two light emitting elements 222 and 224. The first light emitting element 222 is disposed at the tip of the device 220 and forms an irradiation region R1 on the screen. The first light emitting element 222 is always lit during use. On the other hand, the second light emitting element 224 is switched on / off by a switch 226 disposed on the side surface of the case of the pen-type device 220. The second light emitting element 224 is disposed behind the first light emitting element 222. Then, as shown in FIG. 14B, an irradiation region R2 is formed surrounding the irradiation region R1 by the first light emitting element 222.

  The first irradiation region R1 is used for detecting the pen tip position of the pen-type device. On the other hand, the second irradiation region R2 is used to determine whether or not the switch 226 is pressed in the pen-type device 220.

  The first light emitting element and the second light emitting element are preferably different in color from the viewpoint of identification. However, even if both are the same color, it is also possible to distinguish both from the luminance difference between the irradiation regions R1 and R2.

  FIG. 15 is a diagram showing a configuration of a projection display apparatus 200 according to Embodiment 2. The projection display apparatus 200 mainly includes a projection unit 10, a camera 30, and a control device 250. The projection unit 10 and the camera 30 have the same functions as those of the projection display device 80 in FIG.

  The control device 250 includes an irradiation area detection unit 72, a click notification unit 74, a drawing unit 58, a video signal output unit 60, and an image memory 62. The functional blocks of the control device 250 can be realized in various forms by hardware only, software only, or a combination thereof.

  The irradiation region detection unit 72 detects irradiation regions R1 and R2 from the image captured by the camera 30. This detection detects a portion corresponding to the color or brightness corresponding to the first and second light emitting elements and the size of the irradiation area formed when the pen-type device is in contact with the screen in the captured image. This can be achieved. When the irradiation area detection unit 72 detects the irradiation area R <b> 1, the coordinates in the projection area are specified as the pen tip position and output to the drawing unit 58.

  The click notification unit 74 notifies an external device such as a PC that the switch 226 has been pressed when the irradiation region detection unit 72 detects the irradiation region R2. Preferably, the switch 226 corresponds to a general mouse right click.

  The drawing unit 58 creates an image in which a line having a predetermined characteristic (color, thickness, line type, etc.) is drawn on the coordinates of the pen tip position P received from the irradiation region detection unit 72.

  The functions of the video signal output unit 60 and the image memory 62 are the same as those of the projection display device 80 of FIG.

  As described above, according to the projection display apparatus according to the second embodiment, two light emitting elements are provided in the pen type device. One is used for detecting the pen tip position. On the other hand, lighting / extinguishing is made to correspond to, for example, a mouse click operation. By detecting an irradiation area formed on the screen by two light emitting elements with a camera, it is possible to simultaneously detect the pen tip position and the right click.

  Further, since the circular irradiation area is formed in the pen tip direction, the distortion of the shape when the pen is tilted is reduced. Therefore, the influence of the tilt of the pen-type device with respect to the screen on the detection of the irradiation area is small, and stable detection is possible.

  Conventionally, in order to transmit a click operation with a pointing device in a projection display device, radio such as Bluetooth is often used. On the other hand, in the projection display apparatus according to the second embodiment, since both the pen tip position and the click operation can be detected with a single camera, the configuration is simplified and the cost is reduced.

  In order to enable stable detection of the click operation, the detection of the click operation, that is, the presence / absence of the irradiation region R2 may be performed only when the irradiation region R1 is detected. In order to prevent erroneous detection of the irradiation region R2, the presence / absence of the irradiation region R2 may be detected only within a predetermined range centered on the irradiation region R1.

Embodiment 3 FIG.
You may use combining the detection of the pen tip position by the radiated light from the slit demonstrated in Embodiment 1, and the detection of the click demonstrated in Embodiment 2. FIG. FIG. 16 is a cross-sectional view showing the configuration of the pen-type device 230 according to such an embodiment.

  As shown in FIG. 16A, the pen-type device 230 is provided with two light emitting elements 232 and 234. The first light emitting element 232 is disposed at the tip of the device 230 and irradiates the irradiation region R1 on the screen. The first light emitting element 232 is turned on / off by a switch 226 disposed on the side surface of the pen device 230. The second light emitting element 234 is disposed behind the first light emitting element 232. The light emitted from the second light emitting element 234 is reflected by a mirror or prism 236 disposed inside the housing, passes through a slit 238 formed on the side surface of the housing, and is lateral to the pen-type device 230. Irradiate light. In this example, it is assumed that four slits 238 are formed at equal intervals in the circumferential direction.

  FIG. 16B shows the shape of an irradiation area formed on the screen by the pen-type device 230. The irradiation region R <b> 1 is irradiated by the first light emitting element 232 only while the switch 226 is pressed. The irradiation region R2 is formed by the second light emitting element 234.

  A click operation can be detected by detecting the presence or absence of the irradiation region R1 from the captured image of the screen by the camera in the same manner as in the second embodiment. Further, similarly to the first embodiment, the irradiation region R2 can be detected, and the coordinates of the pen tip position can be obtained based on the shape thereof.

  In each of the above-described embodiments, a system including a projection display device that displays a projected image on a screen has been described as an example. However, the present invention can also be applied to a system that detects the locus of a pointing device on a screen such as a flat panel display or an electronic blackboard, and displays the locus on the display. In this case, the pointing device can be used as a substitute for a mouse or the like. In addition, the place where the pointing device draws and the display destination of the image of the corresponding locus need not be the same. For example, the locus of the pointing device on one screen may be displayed on another screen or display.

  DESCRIPTION OF SYMBOLS 10 Projection part, 30 Cameras, 50, 250 Control apparatus, 52 Tip detection part, 54 Radiation detection part, 56 Estimation part, 58 Drawing part, 60 Image signal output part, 62 Image memory, 72 Irradiation area detection part, 74 click Notification unit, 80, 200 projection display device, 100 projection display system, 110 screen, 120, 140, 150, 160, 170, 220, 230 pen type device, 122 switch, 124, 222, 224, 232, 234 Light emitting element 130, 152, 162, 172 Slit, 132, 134, 136, 176 Synchrotron radiation, 226 Switch.

Claims (8)

An information display system including a pointing device and a control device that detects a trajectory of the tip of the pointing device,
The pointing device includes a light emitting unit that radiates radiation light that spreads radially around the tip on a predetermined surface;
The controller is
An imaging unit for imaging an area including the emitted light on the predetermined surface;
A detection unit for detecting the emitted light from the captured image;
An estimation unit that estimates the position of the tip of the pointing device from the detected radiation;
An information display system comprising:   In the pointing device, an intersection when at least two line segments extending in the radial direction centering on the tip end portion of the line segments constituting the outer shape of the emitted light coincide with the tip end of the pointing device. The information display system according to claim 1, further comprising a slit that forms the emitted light.   The information display system according to claim 1, wherein the estimation unit detects rotation of the pointing device based on a comparison of the radiated light among a plurality of captured images.   The said estimation part estimates the angle of the said pointing device with respect to the said predetermined surface based on the matching with the external shape of the said radiated light, and the shape pattern memorize | stored previously, The any one of Claim 1 thru | or 3 characterized by the above-mentioned. The information display system described in Crab.   The said estimation part estimates the distance between the said predetermined surface and the front-end | tip part of the said pointing device based on the comparison of the said radiated light between several captured images, The any one of Claim 1 thru | or 4 characterized by the above-mentioned. The information display system described in Crab. An information display system including a pointing device and a control device that detects a trajectory of the tip of the pointing device,
The pointing device includes: a first light emitting unit that forms a first irradiation region in the direction of the tip; a second light emitting unit that forms a second irradiation region surrounding the first irradiation region; and the first light emission. Or a switch for turning on or off either the second light emitting unit,
The controller is
An imaging unit for imaging an area including the first irradiation area and the second irradiation area on a predetermined surface;
A detection unit for detecting the first irradiation region and the second irradiation region from the captured image;
An estimation unit that estimates the position of the tip of the pointing device based on the detected position or shape of the first irradiation region or the second irradiation region;
A notification unit for notifying an operation of the switch to an external device when the first irradiation region or the second irradiation region is detected;
An information display system comprising: A drawing unit that creates an image in which the locus of the tip portion is drawn with reference to the position of the tip portion estimated for a plurality of captured images;
An output unit for outputting the drawn image to an image display device;
The information display system according to claim 1, further comprising:   The control device constitutes a part of a projection display device, and the projection display device is configured to project and display an image output from the output unit on the predetermined plane. 8. The information display system according to 7.

Images