JP2011204059A - Information input system and information input apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately identify the position of information input with an information input apparatus 200.SOLUTION: An information input system 10 is provided in which information handwritten and inputted, with the portable information input apparatus 200, for a projection plane on which an image is projected can be identified with an input information identification apparatus 50, the information input apparatus 200 includes reflection parts 225-227 having predetermined reflection patterns to a plurality of bands of light, and the input information identification apparatus 50 includes an information input position identification part 60 for identifying the positions of the reflection parts 225-227 according to detection data on the plurality of bands of components in reflected light from the projection plane and identifying the position of the information input with the information input apparatus 200 according to the positions of the reflection parts 225-227.

Description

  The present invention relates to an information input system and an information input device, and in particular, information input by handwriting on an image projected onto a projection surface such as a screen by a portable information input device can be specified by the input information specifying device. The present invention relates to a simple information input system and an information input device used for specifying an input position of information handwritten by the information input system.

  Conventionally, it was common to physically write letters and figures on a blackboard or whiteboard using a pen or marker, but recently, a specific input position is indicated using an electronic pen, An interactive whiteboard that displays handwriting on the screen of a display device by detecting the indicated position in real time is known (see, for example, Patent Document 1).

  In addition, a projection surface of the panel (character, picture, figure, graphic image is projected on the panel using a liquid crystal projector connected to a computer, such as SMART BOARD (registered trademark) of Japan Smart Technologies. The coordinate input / detection device (writing surface) placed on the front of the display surface) is input into the computer by handwritten information with a special pen, etc., and the information input by handwriting in the computer and the image data are combined. There is also known a system capable of displaying in real time on a projection surface by a liquid crystal projector.

JP 2009-104667 A

  By the way, the conventional interactive whiteboard includes a type in which an input position detecting mechanism is provided on the whiteboard side and a type in which the electronic pen is built in the electronic pen. However, in the former, since it is necessary to install a dedicated whiteboard having the above-described detection mechanism in a place where the interactive whiteboard is desired to be used, the use place is limited. On the other hand, in the latter case, a precision instrument is mounted on the electronic pen, which not only makes the electronic pen expensive, but also increases the risk of damage and failure by the user.

  On the other hand, there is a device such as SMART Board (registered trademark) exemplified above that detects the pen position by identifying the pen color and the mark attached to the pen. There was a problem such as erroneously detecting the pen position when wearing clothes of the same color as.

  In order to solve the above-described problems, the present invention provides an information input that can specify input information handwritten by a portable information input device with respect to a projection surface on which an image is projected by the input information specifying device. In the system, the information input device includes a reflection unit having a predetermined reflection pattern with respect to a plurality of bands of light, and the input information specifying device includes the plurality of pieces of reflected light from the projection surface side. An information input position specifying unit that specifies a position of the reflecting unit based on a detection result of detecting a wavelength component of a band, and specifies an input position of the information by the information input device based on the position of the reflecting unit; An information input system is provided.

  According to such an information input system, by detecting the reflected light components of a plurality of bands, the reflection unit provided in the information input device can be detected with high accuracy by distinguishing it from the projection surface and other objects behind. Therefore, the input position of information by the information input device can be specified accurately.

  In the information input system, the input information specifying device detects a component of the plurality of bands in the projection unit that projects the image on the projection surface and the reflected light from the projection surface side, and the detection result It is preferable to have a reflected light detection unit that outputs to the information input position specifying unit.

  In the information input system, it is preferable that the reflection unit is provided in the information input device in a pattern indicating the characteristics of the information.

  Thereby, the characteristics (for example, display color, mode (writing mode, erasing mode), etc.) of the information input by handwriting can be specified based on the detected pattern of the reflection part.

  In the information input system, it is preferable that the reflection unit is provided in the information input device in a pattern indicating the input position.

  Thereby, the input position of information can be specified more accurately from the detected position of the reflecting portion.

  In the information input system, the information input device includes a hollow interior and a main body having an exposed window penetrating the interior, and a part of the information input device is disposed in the interior of the main body and a part of the main body from the main body. And a reflection member provided with the reflection portion on the surface, and when the information is input by handwriting, the protruding portion of the reflection member abuts on the projection surface and enters the inside. It is preferable that the reflection portion is exposed through the exposure window by being pushed.

  Thereby, when inputting information by handwriting, it is only necessary to expose the reflecting portion from the exposure window by pressing the protruding portion of the reflecting member against the projection surface and pressing it into the main body portion. Therefore, since it is not necessary to provide an electrical detection mechanism or the like in the information input device for detecting the input position of information, the information input device can be manufactured at a low cost and compared with the case where an electrical detection mechanism is provided. Low risk of user damage and failure.

  In the information input system, the reflection unit includes a first reflection surface and a second reflection surface that are different in the reflection pattern, and the first reflection surface is exposed when the information is not input by handwriting, It is preferable that the second reflecting surface is exposed when the information is input by handwriting.

  Thereby, even in a state where information is not input by handwriting, the position of the information input device can be detected with high accuracy by distinguishing it from the projection surface behind and other objects.

  In the information input system, when the second reflection surface is exposed, the information input position specifying unit specifies the input position based on the position, and the first reflection surface is exposed. If it is, it is preferable to specify the indicated position on the projection surface by the information input device based on the position.

  Thereby, not only can the input position of the information be specified in a state where the information is input by handwriting, but the indicated position on the projection surface by the information input device can be determined from the detected position of the reflecting portion even in the state where the information is not input by handwriting. Can be accurately identified.

  In the information input system, it is preferable that the information input position specifying unit specifies the content of the information input by handwriting by the information input device based on a movement locus of the input position.

  Thereby, it is possible to accurately specify what character or figure is input by handwriting by the information input device from the movement locus of the input position specified by the optical detection of the reflection portion.

  Alternatively, the information input system detects a component of the plurality of bands in the projection unit that projects the image onto the projection surface and reflected light from the projection surface side, and the detection result is You may further provide the projector which has a reflected light detection part output to an information input position specific | specification part.

  In the information input system, the information input position specifying unit may be configured to display the image projected by the projection unit so that the indicated position is highlighted on the projection surface when the indicated position is specified. It is preferable to update the projection data.

  Thereby, it becomes easy to see the designated position on the projection surface by the information input device.

  Moreover, this invention is an information input system which can specify the input information handwritten and input by the information input device which can be carried with respect to the projection surface on which an image is projected by a projector as another form by an input information specific device. The information input device includes a reflection unit having a predetermined reflection pattern with respect to a plurality of bands of light, and the projector projects the image onto the projection surface, and the projection surface. A reflected light detection unit that detects components of the plurality of bands in the reflected light from the side and outputs the detection result to the information input position specifying unit, and the input information specifying device is based on the detection result And an information input position specifying unit for specifying the input position of the information by the information input device based on the position of the reflecting part. To provide information input system.

  According to another aspect of the present invention, there is provided an information input device used for specifying the input position by any of the information input systems described above, wherein a predetermined reflection pattern is applied to a plurality of bands of light. There is provided an information input device characterized by having a reflection part having

1 is a schematic configuration diagram of an information input system 10 according to an embodiment of the present invention. The right side is a side view of the input identification marker 200, and the left side is an end view of the input identification marker 200. 2 is a cross-sectional arrow view showing only the main body 210 as a cross section in the AA cross section shown in FIG. 2, and the left side is an end view of the input identification marker 200. FIG. 4 is a cross-sectional arrow view and an end view similar to FIG. 5 is a flowchart illustrating an example of calibration processing of the information input system 10. It is an example of a calibration image. It is an example of a calibration image. It is an example of the reflection intensity for every zone detected about the 1st reflective surface 226 and the 2nd reflective surface 225 in the calibration process. 4 is a flowchart showing an example of processing for specifying an input position or an indicated position by an input identification marker 200 by the information input system 10. A state is shown in which characters are input by handwriting with the input identification marker 200 on the image projected on the projection surface. The state where the specific position of the image projected on the projection surface is indicated by the input identification marker 200 is shown. An example of the relationship between the shape and pattern of a reflective surface and the kind of input identification marker 200 is shown. It is a front view which shows a mode that a projection image is projected on the projection surface of a screen using the direct projection type projector. It is a side view which shows a mode that a projection image is projected on the projection surface of a screen using the direct projection type projector.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. However, the following embodiment does not limit the invention according to the claims, and all combinations of features in the embodiment are based on the invention. It is not always essential to the solution.

  FIG. 1 is a schematic configuration diagram of an information input system 10 according to an embodiment of the present invention. As shown in FIG. 1, the information input system 10 of this embodiment includes a projector 100, an input identification marker 200, and a personal computer (PC) 50. The input identification marker 200 is an example of an information input device according to the present invention, and the PC 50 is an example of an input information specifying device according to the present invention.

  The projector 100 separates the light emitted from the lamp 110, which is a light source, into three primary color components (red light, blue light, and green light), and is included in the optical unit 111 in accordance with image data supplied from the PC 50. This is a so-called “liquid crystal three-plate projector” in which light of each color is modulated by a liquid crystal light valve (not shown) for each color light, which is a light modulation element, and is synthesized again and projected onto a projection surface such as a screen.

  The projector 100 can be operated by a remote controller 310 provided with a plurality of operation buttons for operating the projector 100. The projector 100 can also be operated by giving various operation signals from the PC 50 via the communication unit 160 described later. Further, the projector 100 may include an operation panel (not shown) provided with operation buttons similar to those of the remote control 310 on the upper surface of the main body.

  The projector 100 includes a lamp 110, an image processing unit 150, an optical unit 111, a liquid crystal panel driving unit 112, an operation receiving unit 113, a power supply unit 114, an I / O bridge unit 115, a storage unit 116, a control unit 117, and a reflected light detection unit. 118, a lamp driving unit 119, a communication unit 160, and the like. Note that the lamp 110, the optical unit 111, the liquid crystal panel driving unit 112, and the lamp driving unit 119 are examples of the projection unit in the present invention, and will be referred to as the projection unit 120 when collectively described below.

  The lamp 110 is, for example, a discharge lamp capable of obtaining high brightness such as a high-pressure mercury lamp, a metal halide lamp, or a halogen lamp. The optical unit 111 includes an integrator optical system that converts white light emitted from the lamp 110 into substantially parallel light having a stable luminance distribution, and red, green, and blue colors that are the three primary colors of light. A separation optical system that separates light components and supplies them to a liquid crystal light valve for each color light, and a combination optical system that recombines each color light modulated according to an image signal for each color light by the liquid crystal light valve (whichever (Not shown). The optical unit 111 projects a full-color image on a screen by projection light enlarged by a projection lens that incorporates full-color, substantially parallel modulated light emitted from the combining optical system.

  Here, the light projected from the optical unit 111 toward the screen may be normal image light corresponding to the projected image, but at least wavelengths of a plurality of bands described later detected by the reflected light detection unit 118. It is preferable that the component is contained. Therefore, in the case where infrared light or the like is detected instead of the later-described mode in which the reflected light detection unit 118 detects the wavelength component in the visible light range, light in the detection band of the reflected light detection unit 118 is projected onto the projector 100. A separate light source may be provided.

  The liquid crystal panel driving unit 112 supplies a driving voltage and the like together with an image signal input from the image processing unit 150 to a liquid crystal light valve (not shown) of the optical unit 111, and projects a projected image on the liquid crystal light valve. The operation reception unit 113 receives an operation signal from the remote controller 310 or the PC 50 and sends a signal indicating the operation content to the control unit 117.

  The power source unit 114 is stabilized by guiding the AC power from the external power source 320 from the plug, and performing transformation, rectification, and smoothing in the built-in AC / DC conversion unit (both not shown). A DC voltage is supplied to each part of the projector 100. The lamp driving unit 119 is supplied with electric power from the power supply unit 114, generates a high voltage to turn on the lamp 110 that is a discharge lamp, and forms a discharge path. And a ballast circuit (not shown) for maintaining a stable lighting state.

  The I / O bridge unit 115 is equipped with a card controller corresponding to PCMCIA (Personal Computer Memory Card International Association) for controlling the wireless LAN card of the communication unit 160.

  The storage unit 116 is configured by, for example, a non-volatile memory capable of rewriting data, such as a flash memory, and a hard disk. The storage unit 116 stores various programs and accompanying data for controlling the operation of the projector 100 such as a startup routine for starting the projector 100, for example. Further, when image data of an image projected on the projection surface of the screen by the projection unit 120 (hereinafter referred to as “projection data”) is supplied from the PC 50, the storage unit 116 receives and stores the projection data.

  The control unit 117 is, for example, a central processing unit capable of performing high-speed arithmetic processing, and a control signal that triggers an operation for each unit of the projector 100 based on a signal from the operation receiving unit 113. And a signal indicating an operation content and an operation result are received from each unit.

  The reflected light detection unit 118 detects reflected light from the projection surface side with respect to the image light projected by the projection unit 120 toward the projection surface. More specifically, the reflected light detection unit 118 detects wavelength components in a plurality of bands, all of which are visible light, among the reflected light with respect to the image light. In this example, the reflected light detection unit 118 detects light in four bands of the 380 nm band, 480 nm band, 600 nm band, and 700 nm band among the reflected light. Here, the “... Nm band” is a band having a certain width from the center wavelength to the long wavelength side and the short wavelength side in this example. For example, “380 nm band light” refers to the center wavelength ( If the width from 380 nm is 20 nm, the light is in the band of 380 nm ± 20 nm. The center wavelength and width of the band are not limited to this example.

  Then, the reflected light detection unit 118 outputs detection data including the detection results of the reflected light for the plurality of bands. The detection data output from the reflected light detection unit 118 is sent to the PC 50 by the communication unit 160. Note that the reflected light detection unit 118 may store the detection data in the storage unit 116. In this example, the reflected light detection unit 118 may be, for example, a multicolor camera in which color filters that transmit light in each band to be detected are arranged in units of CCD pixels.

  The communication unit 160 is a wireless LAN card compatible with any known wireless LAN standard, and transmits / receives various data to / from a PC communication unit 51 (described later) in the PC 50.

  Next, a schematic configuration of the PC 50 will be described. The PC 50 includes a PC communication unit 51, a PC display unit 52, a PC power supply unit 53, a PCI / O bridge unit 54, a PC hard disk 55, a PC control unit 56, a PC storage unit 57, a PC operation unit 58, a PC operation reception unit 59, And an information input position specifying unit 60. In order to distinguish from the component name of the projector 100, “PC” is added to the component parts of the PC 50 other than the information input position specifying unit 60 as described above.

  The PC communication unit 51 transmits and receives various data to and from the communication unit 160 of the projector 100. The PC display unit 52 is a display device such as a CRT or LCD, and displays an image displayed on the projection surface of the screen by the projector 100, for example. The PC display unit 52 may display various commands and icons.

  The PC power supply unit 53 stabilizes the AC power from the external power supply 320 by guiding it from the plug and performing processing such as transformation, rectification, and smoothing by a built-in AC / DC conversion unit (both not shown). The supplied DC voltage is supplied to each part of the PC 50. When the PC 50 has portability such as a notebook PC, the PC power supply unit 53 may include a rechargeable lithium ion battery.

  The PCI / O bridge unit 54 is a south bridge, and various device controllers such as a card controller compatible with PCMCIA for controlling the PC communication unit 51 (wireless LAN card) and an IDE controller for controlling the PC hard disk 55. It is equipped with.

  The PC hard disk 55 is a hard disk, for example, and stores programs such as an OS (Operating System) that is basic software and control software for the projector 100. The PC hard disk 55 may further store a program such as a network browser or various business software used for document creation and presentation.

  The PC control unit 56 is, for example, a central processing unit capable of performing high-speed arithmetic processing, and is a control that triggers an operation for each unit of the PC 50 based on a signal from the PC operation receiving unit 59. Along with sending a signal, a signal indicating the operation content and operation result is received from each unit. The PC control unit 56 executes various programs for controlling the operation of the PC 50 such as a connection program for connecting to the projector 100 and various protocol programs for performing communication by the PC communication unit 51.

  The PC storage unit 57 is configured by a non-volatile memory capable of rewriting data, such as a flash memory. The PC storage unit 57 stores various programs for controlling the operation of the PC 50 such as a program executed by the PC control unit 56, and data associated with the program. These programs and data may be stored in the PC hard disk 55.

  The PC operation unit 58 is a keyboard and a mouse. For example, various operation inputs for starting up and shutting down the PC 50 or displaying materials for presentation are performed. The PC operation reception unit 59 detects an operation input to the PC operation unit 58 and sends a signal indicating the operation content to the PC control unit 56.

  The information input position specifying unit 60 includes a non-volatile memory capable of rewriting data such as a flash memory and an arithmetic processing circuit. The information input position specifying unit 60 receives the detection data detected by the reflected light detection unit 118 of the projector 100 from the projection surface side via the PC communication unit 51 and stores it in the memory. Then, the information input position specifying unit 60 sequentially reads the detection data stored in the memory, and specifies the position of the input identification marker 200 based on the detection data. More specifically, for example, as shown in FIG. 1, when the user presses the tip of the input identification marker 200 against the projection surface of the screen and inputs information such as characters and figures by handwriting, the information input position specifying unit 60. First, based on the detection data detected by the reflected light detection unit 118, the position of a later-described reflection unit in the input identification marker 200 is specified. Then, the input position of the information by the input identification marker 200 (the position indicated by “P” in FIG. 1) is specified based on the specified position of the reflecting portion. The method for specifying the input position by the information input position specifying unit 60 will be described in detail later.

  Next, the configuration of the input identification marker 200 used for handwriting input of information such as characters and figures on the projection surface of the screen on which the image is projected will be described.

  2 is a side view of the input identification marker 200 on the right side and an end view of the input identification marker 200 on the left side. 3 is a cross-sectional arrow view showing only the main body 210 as a cross section in the AA cross section shown in FIG. 2 on the right side, and an end view of the input identification marker 200 on the left side. 4 is a cross-sectional arrow view and an end view similar to FIG. 3, and shows a state in which the protruding portion 221 protruding from the main body 210 of the input identification marker 200 is pushed into the main body 210.

  The input identification marker 200 is an information input device that can be carried with the same size as a whiteboard marker, for example, and as shown in FIGS. And a resilient member 230 that is disposed inside the main body 210 and applies a biasing force to the reflecting member 220.

  The main body 210 has a substantially cylindrical outer shape, and the side surface 213 is provided with a plurality of (six in this example) exposure windows 215 penetrating through the hollow interior. The main body 210 is also provided with an exposure window 216 on the end surface 211 opposite to the end surface 212 on the side from which the protruding portion 221 protrudes.

  The reflecting member 220 has a substantially cylindrical outer shape smaller than the main body part 210, and the side surface abuts on the inner surface of the main body part 210. A projecting portion 221 having a dome-shaped tip is provided at one end of the reflecting member 220, and the projecting portion 221 projects to the outside through a through hole provided in the end surface 212 of the main body 210. Further, a substantially cylindrical protrusion 222 is provided at the other end of the reflecting member 220. The elastic member 230 is a string spring in this example, and is disposed between the reflecting member 220 and the end surface 211 of the main body 210, and a part of the elastic member 230 is wound around the protrusion 222 of the reflecting member 220.

  On the side surface of the reflection member 220, a reflection portion having a predetermined reflection pattern for the light in the plurality of bands is formed. In this example, as shown in FIGS. 3 and 4, the first reflecting surface 226 and the second reflecting surface 225 are alternately formed in a stripe pattern on the side surface of the reflecting member 220. A third reflecting surface 227 is formed at the tip of the protrusion 222 of the reflecting member 220.

  Among these reflecting surfaces, the first reflecting surface 226 and the second reflecting surface 225 are members made of materials having different reflection patterns for the above four bands of light (380 nm band, 480 nm band, 600 nm band, 700 nm band), respectively. It consists of The third reflecting surface 227 is formed of a member made of a material having the same reflection pattern as that of the second reflecting surface 225 for the light in the four bands. In addition, each said reflective surface may be formed by apply | coating the coating material which has said each reflective pattern on the surface of a common resin material, for example.

  The reflection pattern of each reflection surface will be described in more detail. In this example, the first reflection surface 226 absorbs most of the light in the 380 nm band and the 480 nm band among the above four bands, and the 600 nm band and the 700 nm band. Most of the light is reflected. On the other hand, the second reflecting surface 225 and the third reflecting surface 227 reflect most of the light in the 380 nm band and 480 nm band among the above four bands, and absorb most of the light in the 600 nm band and 700 nm band. To do.

  When the protruding portion 221 protruding from the main body 210 is not pressed against the projection surface, that is, when characters or the like are not input by hand with the input identification marker 200 on the projection surface, as shown in FIG. The first reflection surface 226 of the reflection member 220 is exposed from the exposure window 215 provided on the side surface 213. On the other hand, when the protrusion 221 protruding from the main body 210 is pressed against the projection surface, the protrusion 221 is pressed into the main body 210. At this time, the reflecting member 220 moves to the end surface 211 side while sliding inside the main body 210.

  Then, when the tip of the projection 222 of the reflecting member 220 is pushed in until it comes into contact with the inside of the end surface 211 of the main body 210, the second reflecting surface 225 is exposed from the exposure window 215 of the main body 210 as shown in FIG. To do. The third reflecting surface 227 is exposed from the exposure window 216 provided on the end surface 211 of the main body 210.

  Therefore, in a state where the user points to a specific part of the image projected on the projection surface with the input identification marker 200 without pressing the projection 221 against the projection surface, the above four of the reflected lights from the projection surface side. Based on the detection data obtained by detecting the light component in the band by the reflected light detection unit 118 of the projector 100, the position of the first reflection surface 226 having a specific reflection spectrum for these light components as described above is the information input position of the PC 50. It is specified by the specifying unit 60.

  More specifically, the information input position specifying unit 60 extracts a region where the intensity of the reflected light in the 380 nm band and the 480 nm band is below a certain level from the detection range by the reflected light detection unit 118 based on the detection data, Further, a region where the intensity of reflected light in the 600 nm band and 700 nm band is a certain level or higher is extracted from the extracted region. Thereby, the position of the 1st reflective surface 226 on a projection surface is pinpointed. Then, the information input position specifying unit 60 determines the tip position of the protruding portion 221 from the position of the first reflecting surface 226, and specifies the position (indicated position) pointed by the user with the input identification marker 200.

  On the other hand, when the user inputs information such as characters and figures on the projection surface with the input identification marker 200 by pressing the projection 221 against the projection surface and pushing the projection 221, the above-mentioned from the projection surface side. Based on the detection data of the reflected light components of the four bands detected by the reflected light detection unit 118 of the projector 100, the information input position specifying unit 60 determines the positions of the second reflection surface 225 and the third reflection surface 227 in the same manner as described above. Identified.

  More specifically, the information input position specifying unit 60 extracts a region where the intensity of the reflected light in the 380 nm band and the 480 nm band is equal to or higher than a certain level from the detection range by the reflected light detection unit 118 based on the detection data, Further, a region where the intensity of reflected light in the 600 nm band and 700 nm band is below a certain level is extracted from the extracted region. Thereby, the position of the 2nd reflective surface 225 and the 3rd reflective surface 227 on a projection surface is pinpointed. Then, the information input position specifying unit 60 calculates the tip position of the protrusion 221 from the positions of the second reflection surface 225 and the third reflection surface 227, and the position where the user inputs information by handwriting with the input identification marker 200 (input) Position).

  Here, as shown in FIG. 2, each shape of the exposure window 215 is an isosceles triangle having a vertex in the direction of the distal end position of the projecting portion 221. The shape of each reflecting surface exposed through the exposure window 215 and the pattern formed by the reflecting surface exposed from each exposure window 215 are information. The input position specifying unit 60 also functions as a clue when specifying the input position.

  In this example, the information input position specifying unit 60 is provided with the detection data in real time. Therefore, the information input position specifying unit 60 can specify the indicated position or the input position in real time. Further, when it is detected that the information input position specifying unit 60 indicates a specific position on the projection surface without inputting characters by handwriting with the input identification marker 200, that is, the tip position of the projecting portion 221 is detected. When the designated position is specified, the projection data of the image supplied from the PC 50 to the projector 100 is updated so that the designated position is highlighted on the projection surface. Therefore, in the system of this example, the indicated position on the projection surface by the information input device 200 is easy to see.

  In addition, when it is detected that the input identification marker 200 is inputting a character or the like by handwriting, that is, when the tip position of the protruding portion 221 is specified as the input position, the information input position specifying unit 60 is the input position. The projection data of the image supplied from the PC 50 to the projector 100 is updated so that the movement trajectory is displayed on the projection surface. Therefore, in the system of this example, it is possible to display characters, figures and the like input by handwriting on the projection surface.

  Further, the input identification marker 200 used in the system of this example is configured such that when inputting information by handwriting, the protruding portion 221 is pressed against the projection surface and pushed into the main body portion 210, so that the exposure window 215, 216 can be used as the second reflecting surface. It is only necessary to expose 225 and the third reflecting surface 227. Therefore, since it is not necessary to provide an electrical detection mechanism or the like in the input identification marker 200 itself for detecting the input position of information, the input identification marker 200 can be manufactured at a low cost and the electrical detection mechanism is provided. The risk of damage and failure by the user is low.

  As described above, in the information input system 10 according to the present embodiment, the position indicated by the input identification marker 200 on the projection surface on which the image is projected by the projector 100 is provided in the input identification marker 200. Although the system can be specified based on the detection position of each reflection surface, it is necessary to register in advance the reflection patterns possessed by each of the reflection surfaces in actual detection. Moreover, it is necessary to make the coordinate system in the image projected on the projection surface correspond to the detection coordinate system by the reflected light detection unit 118. FIG. 5 is a flowchart illustrating an example of calibration processing for performing these settings.

  In the calibration process of this system, first, image data for calibration is supplied from the PC 50 to the projector 100 and projected from the projector 100 onto the projection surface (step S100). Here, as shown in FIG. 6A, within the detection range 510 of the reflected light detection unit 118, the message “Perform alignment. Touch the center of the mark with the pen without pushing the pen tip.” At the same time, a calibration image 521 with a reference mark 530 displayed at the left corner is projected. Here, a solid image (monochromatic image) in any one of the four bands is projected on the message of the calibration image 521 and the background of the reference mark 530.

  Then, with the tip of the protruding portion 221 of the input identification marker 200 touching the center of the reference mark 530, for example, when the user inputs a command indicating detection start to the PC 50, the reflected light detection unit of the projector 100 is detected. Detection by 118 is started (step S105). Then, the information input position specifying unit 60 of the PC 50 calculates the reflection intensity of the band by the first reflecting surface 226 based on the detection data detected by the reflected light detection unit 118.

  The information input position specifying unit 60 specifies the position of the reference mark 530 based on the detection data detected by the reflected light detection unit 118, and the position of the reference mark 530 in the calibration image 521 is determined by the reflected light detection unit. It stores which position in the detection range 118 corresponds to.

  Next, when the user inputs a command indicating the end of detection to the PC 50, for example, as shown in FIG. 6B, the message displayed on the calibration image 521 is “without moving the pen position. The message changes to "Please press the pen tip into". Here, when the user presses the pen tip (protrusion 221) with the tip of the protrusion 221 of the input identification marker 200 touching the center of the reference mark 530 and inputs a command indicating detection start to the PC 50, Detection by the reflected light detection unit 118 of the projector 100 is started. Then, the information input position specifying unit 60 of the PC 50 calculates the reflection intensity of the band by the second reflecting surface 225 and the third reflecting surface 227 based on the detection data detected by the reflected light detecting unit 118.

  Next, for example, when the user inputs a command indicating the end of detection to the PC 50, new image data for calibration with a different position of the reference mark 530 is supplied from the PC 50 to the projector 100. The light is projected onto the projection surface (step S115). For example, as shown in FIG. 7 (a), the same as the calibration image 521 above, with the message “Perform alignment. Touch the center of the mark with the pen without pushing in the pen tip.” A calibration image 522 on which the mark 530 is displayed is projected. Here, a solid image (monochromatic image) in a band different from the calibration image 521 out of the four bands is projected on the message of the calibration image 522 and the background of the reference mark 530.

  Then, the information input position specifying unit 60 of the PC 50 calculates the reflection intensity of the band by the respective reflecting surfaces of the first reflecting surface 226, the second reflecting surface 225, and the third reflecting surface 227, similarly to step S105. Further, the position of the reference mark 530 is specified, and the position in the detection range of the reflected light detection unit 118 corresponding to the position of the reference mark 530 in the calibration image 522 is stored.

  The above processing is sequentially performed while changing the position of the reference mark 530 in the calibration image. Specifically, in this example, in a state where a calibration image in which the reference marks 530 are arranged at the lower right and lower left of the image is projected, the respective reference marks 530 are each input by the information input position specifying unit 60 in the same manner as described above. Which position in the detection range of the reflected light detection unit 118 corresponds to is stored.

  Further, in the above calibration process, when a calibration image in which the position of the reference mark 530 is changed is projected, the band of the solid image projected as the background of the calibration image is sequentially changed from the four bands. . Then, when the solid image of each band is projected as the background of the calibration image, the information input position specifying unit 60 of the PC 50 performs the first reflection surface 226, the second reflection surface 225, And the reflection intensity of the said band by each reflective surface of the 3rd reflective surface 227 is calculated.

  When the above calibration processing is completed for the calibration images in which the reference marks 530 are arranged at the upper left, upper right, lower right, and lower left (step S110: YES), the information input position specifying unit 60 of the PC 50 displays the first reflecting surface. From the reflection intensities of the four bands detected for the reflection surfaces 226, the second reflection surface 225, and the third reflection surface 227, the reflection pattern of each reflection surface is specified (step S120). Thus, this flow ends.

  FIG. 8 shows an example of the reflection intensity for each band detected for the first reflecting surface 226 and the second reflecting surface 225 in the calibration process. The third reflection surface 227 is omitted from illustration because it has the same reflection pattern as the second reflection surface 225. In FIG. 8, λ1 to λ4 indicate the center wavelengths of the four bands, 380 nm, 480 nm, 600 nm, and 700 nm.

  As shown in FIG. 8, by the calibration process described above, the first reflecting surface 226 has a region in which, for example, the reflection intensity in the 380 nm band and the 480 nm band is smaller than L1, and the reflection intensity in the 600 nm band and 700 nm band is larger than L2. Can be identified by extracting from the detection range of the reflected light detection unit 118. Similarly, the second reflection surface 225 and the third reflection surface 227 are identified by extracting regions where the reflection intensity in the 380 nm band and the 480 nm band is larger than L1 and the reflection intensity in the 600 nm band and 700 nm band is smaller than L2. can do.

  Such an extraction process includes, for example, a level comparator that outputs “H” when the intensity of the analog signal in which the reflection intensity of each band is detected is smaller than the intensity L1, and outputs “L” when the intensity is greater than the intensity L1. A level comparator that outputs “H” when it is greater than the intensity L2, and “L” when it is less than the intensity L2, and an AND that outputs an AND output of output signals from these level comparators as detection data This is possible by providing a circuit in the reflected light detection unit 118.

  Subsequently, an image is projected onto the projection surface of the screen, and an input position where information such as characters and figures is input by handwriting with the input identification marker 200 is specified by the system, or designated by the input identification marker 200. The process flow from specifying the position in the image and reflecting it in the display content of the projected image will be described more specifically.

  FIG. 9 is a flowchart illustrating an example of processing for specifying an input position or a designated position by the input identification marker 200 by the information input system 10. In this flow, first, an image is projected on the projection surface of the screen by the projection unit 120 of the projector 100 (step S200), and the reflected light of the four bands among the reflected light from the projection surface is reflected by the reflected light detection unit 118 of the projector 100. The intensity is detected (step S205).

  Then, the information input position specifying unit 60 of the PC 50 specifies the position of the reflection surface of the input identification marker 200 on the projection surface from the detection data output from the reflected light detection unit 118 (step S210). Here, when one of the second reflection surface 225 and the third reflection surface 227 of the input identification marker 200 is specified by the information input position specification unit 60, the information input position specification unit 60 uses the input identification marker 200 as a character. (Step S215: YES), and the tip position of the input identification marker 200 protruding portion 221 specified from the position of the reflecting surface is specified as the input position (step S215: YES). S220). Then, the information input position specifying unit 60 updates the projection data of the image supplied from the PC 50 to the projector 100 to display the movement locus of the input position on the projection surface.

  FIG. 10 shows a state in which characters are input by handwriting with the input identification marker 200 on the image projected on the projection surface. In this example, when the information input position specifying unit 60 specifies the position indicated by “P” in FIG. 10 as the character input position, for example, the PC 50 projects the projector so that a line is drawn on the movement locus of the position. The projection data of the image supplied to 100 is updated.

  On the other hand, when the first reflective surface 226 of the input identification marker 200 is specified by the information input position specifying unit 60, the information input position specifying unit 60 is instructed by the input identification marker 200 at a specific position in the projection image. The state is determined (step S215: NO), and the tip position of the protruding portion 221 of the input identification marker 200 specified from the position of the reflecting surface is specified as the designated position (step S230). Then, the information input position specifying unit 60 updates the projection data of the image supplied from the PC 50 to the projector 100 and highlights the designated position. The projection data of the image supplied from the PC 50 to the projector 100 is updated so that the designated position is highlighted on the projection surface.

  FIG. 11 shows a state where the input identification marker 200 indicates the specific position of the image projected on the projection surface. In this example, when the information input position specifying unit 60 specifies, for example, a position indicated by “Q” in FIG. 10 as an indicated position, a circular area centered on the indicated position is easily recognized as red or the like. The projection data of the image supplied from the PC 50 to the projector 100 is updated so that it is displayed in color. Note that the highlighting method is not limited to this example, and highlighting may be performed by, for example, blinking the peripheral area of the designated position.

  The information input position specifying unit 60 specifies the tip position of the protruding portion 221 of the input identification marker 200 from the detection data output from the reflected light detecting unit 118 until the reflection pattern of the reflecting surface is not detected. The process is repeated in real time (step S240: NO). Then, when the reflection pattern on the reflection surface of the input identification marker 200 is no longer detected (step S240: YES), this flow ends.

  As described above, according to the information input system 10 according to the present embodiment, the reflection surface provided in the input identification marker 200 is detected from the back projection surface and other objects by detecting the reflected light components of a plurality of bands. Since it can be distinguished and detected with high accuracy, the input position of information by the input identification marker 200 or the indicated position on the projection surface can be accurately specified. Further, in the information input system 10 according to the present embodiment, only the visible light region is used for specifying the input position and the designated position, so that the reflected light with respect to the image light projected by the projector 100 can be used as it is. it can. Therefore, it is not necessary to provide the projector 100 with a light source that emits infrared light.

  In this example, the exposure window 215 of the input identification marker 200 is provided in the shape and arrangement as shown in FIG. 2, but the shape and arrangement of the exposure window 215 in the input identification marker 200 and handwriting input. Character display colors, input modes (writing mode, erasing mode), and the like may be associated. More specifically, for example, as shown in FIG. 12, a plurality of input identification markers 200 in which the shape and arrangement pattern of the exposure window 215, that is, the shape and pattern of the reflection surface exposed through the exposure window 215 are changed, are prepared. Alternatively, the user may use a plurality of input identification markers 200 depending on the display color of characters and the input mode. As a result, the information input position specifying unit 60 specifies the display color or input mode (writing mode, erasing mode) of information handwritten input from the shape and pattern of the specified reflecting surface, and creates a projected image. It can be reflected.

  In this example, since a plurality of exposure windows of the input identification marker 200 are provided not only on the side surface 213 of the main body 210 but also on the end surface 211, for example, one exposure window is closed by the user's hand. Even if it is peeled off, the reflection member 220 can be exposed through another exposure window.

  Further, in the present embodiment, the method of preparing a plurality of input identification markers 200 is exemplified for changing the shape and arrangement pattern of the exposure window 215. However, for example, a plurality of different shapes and arrangement patterns are provided on the main body 210 of the input identification marker 200. A type of exposure window 215 may be provided, and the reflection member 220 may be rotated to change the shape or pattern of the reflection surface.

  In the present embodiment, the projector 100 is exemplified by a mode in which image light is projected from the front onto the projection surface of the screen. However, the projector 100 is installed above the screen as shown in FIGS. 13 and 14, for example. The projector may be a direct projection type projector that projects image light onto the projection surface from above. By projecting image light from above the screen in this way, not only can the presenter standing in front of the screen feel less dazzled, but also target objects such as materials pasted on the projection surface, It can be identified more accurately.

  Further, in this embodiment, the information input system 10 including the liquid crystal three-plate projector 100 that modulates and projects the light from the light source by the liquid crystal light valve that is a light modulation unit is illustrated, but the information input system according to the present invention is other A projector that employs the above method may be used. More specifically, a projector employing a projection system using DMD (Digital Micromirror Device), that is, a so-called DLP (Digital Light Processing) (registered trademark) system may be used. Here, in the DLP method, the light from the lamp that shines in white is collected by the lens and applied to the DMD, and the light when the individual mirrors of the DMD are tilted to the on state is magnified by another lens and projected onto the screen. It is a method to do. Further, in the present embodiment, the information input system 10 including the projector 100 that projects using a discharge lamp as a light source is exemplified, but a projector that projects using an LED light source, a laser light source, or the like may be used as the light source.

  In the present embodiment, the reflected light from the projection surface is detected by the reflected light detection unit 118 of the projector 100, and the input position or designated position on the projection surface by the input identification marker 200 is detected by the information input position specifying unit 60 of the PC 50. Although the method to identify was illustrated, the information input system 10 which concerns on this invention is not limited to the said method. For example, a screen having an image display function may be used in place of the projector 100, and in this case, the reflected light detection unit 118 may be provided in front of or around the periphery of the screen. Further, instead of the system configured by the PC 50 and the projector 100, the projector 100 may include each function of the PC 50.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment.

DESCRIPTION OF SYMBOLS 10 ... Information input system 50 ... Personal computer (PC) 51 ... PC communication part 52 ... PC display part 53 ... PC power supply part 54 ... PC I / O bridge part 55 ... PC hard disk 56 ... PC control , 57 ... PC storage unit, 58 ... PC operation unit, 59 ... PC operation reception unit, 60 ... information input position specifying unit, 100 ... projector, 110 ... lamp, 111 ... optical unit, 112 ... liquid crystal panel drive unit, 113 ... operation accepting unit, 114 ... power supply unit, 115 ... I / O bridge unit, 116 ... storage unit, 117 ... control unit, 118 ... reflected light detection unit, 119 ... lamp driving unit, 120 ... projection unit, 150 ... image processing Part, 160 ... communication part, 200 ... input identification marker, 210 ... main body part, 215, 216 ... exposure window, 220 ... reflecting member, 221 ... projecting part, 225 ... second reflecting surface 226 ... first reflecting surface, 227 ... third reflecting surface, 230 ... elastic member

Claims (10)

An information input system capable of specifying input information handwritten by a portable information input device with respect to a projection surface on which an image is projected, by an input information specifying device,
The information input device includes:
Having a reflection part having a predetermined reflection pattern for a plurality of bands of light;
The input information specifying device includes:
The position of the reflection unit is specified based on the detection result of detecting the wavelength components of the plurality of bands in the reflected light from the projection surface side, and the information input device inputs the information based on the position of the reflection unit An information input system comprising an information input position specifying unit for specifying a position. The input information specifying device includes:
A projection unit that projects the image onto the projection surface;
A reflected light detection unit that detects components of the plurality of bands in the reflected light from the projection surface side and outputs the detection result to the information input position specifying unit;
The information input system according to claim 1, further comprising:   The information input system according to claim 1, wherein the reflection unit is provided in the information input device in a pattern indicating the input information.   4. The information input system according to claim 1, wherein the reflection unit is provided in the information input device in a pattern indicating the input position. 5. The information input device includes:
A body having an interior and an exposed window penetrating the interior;
A reflecting member disposed inside the main body and a part of the main body protruding from the main body, the reflection member being provided on the surface;
Further comprising
When the input information is input by handwriting, the projecting portion of the reflecting member abuts on the projection surface and is pushed into the interior, so that the reflecting portion is exposed through the exposure window. The information input system according to claim 4. The reflection part includes a first reflection surface and a second reflection surface, each of which has a different reflection pattern,
6. The information input system according to claim 5, wherein when the information is not input by handwriting, the first reflecting surface is exposed, and when the information is input by handwriting, the second reflecting surface is exposed.   The information input position specifying unit specifies the input position based on the position when the second reflecting surface is exposed, and the position when the first reflecting surface is exposed. The information input system according to claim 6, wherein a specified position on the projection surface by the information input device is specified based on the information.   8. The information input system according to claim 7, wherein the information input position specifying unit specifies the content of the information input by handwriting by the information input device based on a movement locus of the input position. An information input system that can specify input information handwritten by an information input device that can be carried on a projection surface on which an image is projected by a projector, by an input information specifying device,
The information input device includes:
Having a reflection part having a predetermined reflection pattern for a plurality of bands of light;
The projector is
A projection unit that projects the image onto the projection surface;
A reflected light detection unit that detects the components of the plurality of bands in the reflected light from the projection surface side and outputs the detection result to the information input position specifying unit;
The input information specifying device includes:
An information input comprising: an information input position specifying unit that specifies the position of the reflecting unit based on the detection result, and specifies the input position of the information by the information input device based on the position of the reflecting unit. system. An information input device used for specifying the input position by the information input system according to any one of claims 1 to 9,
An information input device having a reflection part having a predetermined reflection pattern for a plurality of bands of light.

Images