JP2010113598A - Input system, input method, input device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input system not needing a dedicated position detection device for detecting a position of an input device on a display screen, and not needing to calibrate coordinates of the detected position and a display image. <P>SOLUTION: The input system includes: an image generation device generating an image; a display device displaying the image; and the input device capable of being movement-operated, having a tip part capable of coming in contact with the display screen of the display device, a photodetection part detecting incident light onto the tip part, a processing part performing prescribed processing based on a detection result of the photodetection part, and a transmission part communicating with the image generation device. The processing part in the input device performs position detection processing of the tip part while cooperating with image generation processing by the image generation device based on the detection result of the photodetection part. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

 The present invention relates to an input system, an input method, an input device, and a program.

  Conventionally, a personal computer screen is projected using a projector, the movement of a pointing device (a form of input device) such as a pen with respect to the cursor displayed on the projection screen is detected, and the movement of the pen is detected. There is known an input system capable of inputting information by moving a cursor on a projection screen. As another input system, a system using a dedicated plate surface with a motion detection function of a pointing device by a resistive film method, a surface acoustic wave method, a guidance method, or the like is proposed for the screen itself that projects the screen. Yes.

  In this way, the screen itself has a pointing device motion detection function, and this screen has a configuration similar to that of a whiteboard. In many cases, a moving caster is provided, but it is large and heavy, so it is difficult to carry around. The scene to use was limited. On the other hand, input systems that can be made relatively small are disclosed in Patent Documents 1 and 2 below.

  In the input system (electronic blackboard system) disclosed in Patent Document 1 below, a pen is provided with an infrared and ultrasonic wave transmitting unit, while an infrared receiving unit and two ultrasonic waves are provided at a predetermined position on a whiteboard on which a screen is projected. A receiving unit comprising a receiving unit is provided, and after receiving infrared rays transmitted from the pen by the infrared receiving unit, the time for receiving the ultrasonic waves by the two ultrasonic receiving units is measured, and based on the time measurement result and the sound velocity. The distance between the two ultrasonic receivers and the pen is calculated, and the position (coordinates) of the pen is detected from the principle of triangulation.

The input system (projected image storage system) disclosed in Patent Document 2 below is obtained by writing characters with a marker pen on a screen projected on a whiteboard by a projector, and photographing the projected screen and the written characters with a camera. The composite image to be stored is stored.
JP 2005-128611 A JP 2001-312001 A

  In the system disclosed in Patent Document 1, a coordinate detection device including a pen and a reception unit and a projection device such as a projector are separate devices, and thus calibration of detection coordinates and projection image coordinates is required. In Patent Literature 1, as such a coordinate calibration method, a light emitting element is attached to each of the two ultrasonic receiving units, and the light emitting element and a test pattern projected on the whiteboard are photographed by a camera. It describes that the coordinates are automatically calibrated by acquiring the positional relationship between the light emitting element and the projected image based on the photographed image. However, according to this method, it is necessary to provide a dedicated light-emitting element or camera only for calibration, resulting in an increase in apparatus cost.

  Also, as a general calibration method, there is a method of projecting a predetermined calibration pattern from a projector and sequentially pointing a designated place on the projection screen with a pen, but this calibration work is performed before using the system. Must be performed, which imposes a burden on the user. Furthermore, in the system of Patent Document 1, due to restrictions on the resolution of ultrasonic waves, in order to increase the coordinate detection accuracy, the distance interval between the two ultrasonic reception units must be widened, resulting in an increase in the size of the reception unit. There's a problem.

  In the system disclosed in Patent Document 2, the cursor on the personal computer side cannot be controlled. In addition, as a general known technique, the pen tip is provided with a function of emitting infrared light or a specific color, the pen tip is photographed through an optical filter corresponding to the emission wavelength, and the pen tip is based on the photographed image. A method for controlling the cursor by detecting the position of the position is given. However, even if this method is adopted, it is necessary to prepare a dedicated camera, and since the projector and the camera are independent devices, it is necessary to calibrate the positional relationship between the projected image and the captured image.

  The present invention has been made in view of the above-described circumstances, and does not require a dedicated position detection device for detecting the position of the input device on the display screen, and it is necessary to calibrate the coordinates of the display image and the detection position. It is an object of the present invention to provide an input system, an input method, an input device, and a program that are free from problems.

In order to achieve the above object, an input system according to the present invention includes an image generation device that generates an image, a display device that displays the image, a tip portion that can contact a display screen of the display device, and the tip A light detection unit that detects incident light on the unit, a processing unit that performs a predetermined process based on a detection result of the light detection unit, and a transmission unit that communicates with the image generation device An input device, and the processing unit in the input device performs position detection processing of the tip portion in cooperation with image generation processing by the image generation device based on a detection result of the light detection unit. And
According to the input system having such characteristics, the position detection process of the tip of the input device is performed in cooperation with the image generation process by the image generation device based on the detection result of the light detection unit provided in the input device. Therefore, there is no need for a dedicated position detection device for detecting the position of the input device as in the prior art, so there is no need to calibrate the coordinates of the display image and the detection position, improving the usability and maintainability of the system, The overall size can be reduced and the apparatus cost can be reduced.

In the input system described above, the processing unit of the input device may be configured such that, in the position detection process, the tip is positioned on a cursor pattern displayed on the display screen based on a detection result of the light detection unit. And determining the position of the tip by performing a calibration process for exploring the position of the tip while cooperating with the image generation processing by the image generation device. Preferably, the image generation apparatus is instructed to move the cursor pattern to the determined tip position.
When the tip of the input device is brought into contact with the display screen, if the tip is positioned on the cursor pattern, it can be determined that the position of the cursor pattern is the position of the tip without any problem. However, if the tip is not positioned on the cursor pattern, the position of the tip matches the position of the tip by determining the position of the tip through calibration processing in cooperation with the image generation device. Can be made.

In the input system described above, the processing unit of the input device instructs the image generation device to blink the cursor pattern displayed on the display screen in the position detection processing, and the light detection unit It is preferable to determine whether or not the tip portion is located on the cursor pattern by confirming the presence or absence of the blinking based on the detection result.
Thereby, it is possible to easily determine whether or not the tip is positioned on the cursor pattern.

Further, in the input system described above, the processing unit of the input device may perform an initial setting process in which the entire display screen is initially set as a search range in the calibration process, and a search on the display screen for the image generation device. A first division process for instructing the range to be divided into two parts with different brightness, and a first light detection for obtaining a detection result of the light detection unit after the first division process as a first detection result An acquisition process; a second division process for instructing the image generating apparatus to invert the brightness of the two areas displayed in two divisions in the first division process; and the second division process A second light detection acquisition process for acquiring a detection result of the light detection unit later as a second detection result, and two regions divided into two based on the first detection result and the second detection result The region with the higher detection level Is set as a candidate range in which the tip is located, and a search range setting process for resetting the candidate range as a new search range, and after the reset of the search range, a predetermined number of times from the first divided process to the search range The center coordinate of the candidate range finally obtained by repeating a series of processes up to the setting process is determined as the position of the tip, and the cursor pattern is placed at the determined position of the tip with respect to the image generation device. It is preferable to execute a tip position determination process instructing to move.
By performing such calibration processing, the position of the tip can be detected with high accuracy.

Further, in the input system described above, the processing unit of the input device may perform an initial setting process in which the entire display screen is initially set as a search range in the calibration process, and a search on the display screen for the image generation device. A first division process for instructing to display a range divided into a plurality of colors in the vertical direction or the horizontal direction, and a first detection result of the light detection unit after the first division process; A first light detection acquisition process acquired as a result, a second division process that instructs the image generation apparatus to divide and display a plurality of images in a direction different from the first division process, Based on the second light detection acquisition process for acquiring the detection result of the light detection unit after the second division process as a second detection result, and the vertical direction based on the first detection result and the second detection result And the color match in the horizontal direction A search range setting process in which a crossing region of a split region is set as a candidate range in which the tip is located, and the candidate range is reset as a new search range; and after the reset of the search range, the first division The center coordinate of the candidate range that is finally obtained by repeating a series of processing from processing to the search range setting processing is determined as the position of the tip, and the position of the determined tip is determined with respect to the image generation device It is preferable to execute tip position determination processing instructing to move the cursor pattern.
By performing such a calibration process, the position of the tip can be detected with high accuracy, and the position of the tip can be determined in a shorter time than the calibration process described above.

Further, in the input system described above, the input device includes a contact detection unit that detects whether or not the distal end portion has contacted the display screen, and the processing unit detects the position of the distal end portion by the position detection process. If the detection result of the contact detection unit indicates that there is a contact after the position of the cursor pattern coincides with the position of the cursor pattern, a writing process is executed according to the movement of the tip part to detect the contact detection unit When the result indicates no contact, it is preferable to execute a floating process for moving the cursor pattern following the movement of the tip.
After the position of the tip and the position of the cursor pattern are matched by the position detection processing in this way, if the tip is in contact with the display screen, it is assumed that the operator is about to input In addition, when the tip is not in contact, it is assumed that the operator is simply going to move the input device. Therefore, when the tip is in contact with the display screen as described above, Performs a writing process, and when the tip is not in contact, performs a floating process, thereby performing a process according to the operator's intention.

In the input system described above, the cursor pattern includes a central portion to which a dedicated color is assigned and a peripheral portion that includes the central portion and is assigned another color, and the peripheral portion corresponds to an orientation. A pattern in which a plurality of orientation detection regions to which different colors are assigned are formed, wherein the processing unit of the input device is based on a detection result of the light detection unit in the writing process or the floating process. By performing color determination, it is determined in which azimuth detection region in the cursor pattern the tip portion is present, and the direction corresponding to the azimuth detection region in which the tip portion is determined to be present is determined. The image generation apparatus is instructed to move the cursor pattern, while in the case of writing processing, a line is added on the movement locus of the cursor pattern. It is preferable to instruct the memorial service.
By using the cursor pattern having the above configuration, the cursor pattern can be moved and the line can be written in accordance with the movement of the tip of the input device.

In the input system described above, the processing unit of the input device is determined by the color determination process in which color determination is performed based on the detection result of the light detection unit in the writing process or the floating process, and the color determination process. It is determined whether or not the determined color matches the color of the center portion of the cursor pattern, and if they match, a determination process is performed to determine whether or not the detection result of the contact detection unit indicates the presence of contact. When it is determined that the center determination process to be re-executed and the center determination process do not match, the tip portion has an orientation detection area of the same color as the color determined by the color determination process It is preferable to execute a direction search process for searching as a direction detection region.
Thereby, it is possible to know the moving direction of the tip of the input device with high accuracy, and to accurately follow the cursor pattern and write a line.

In the input system described above, the input device includes an acceleration detection unit that detects an acceleration generated by the input device, and the processing unit of the input device performs acceleration of the acceleration detection unit in the writing process or the floating process. Based on the detection result, it is determined whether or not the input device has moved at such a speed as to move the tip from the cursor pattern. If not, color determination based on the detection result of the light detection unit is performed. When it is determined that the tip has moved at such a speed that the tip portion is removed from the cursor pattern, it is preferable to repeat the position detection process from the beginning.
In this way, when the input device moves at a speed at which the tip part is removed from the cursor pattern, it is difficult to follow the cursor pattern. The system can be used. In this case, since the cursor pattern stops, it is possible to prevent the cursor pattern from moving to an unintended position.

In the input system described above, the color of each azimuth detection area at the center and the periphery of the cursor pattern is expressed by any combination of red, green, and blue, and the brightness of each of red, green, and blue The length is preferably set by a 2-bit code.
Thereby, it is possible to easily and reliably detect the position of the input device and follow the cursor pattern.

In the input system described above, it is preferable to employ a gray code as a code setting method for each direction detection area in the cursor pattern.
As a result, even when the leading end of the input device is located across two azimuth detection areas in the cursor pattern and an unstable code is obtained, codes other than the adjacent azimuth detection areas are detected. Therefore, the movement direction of the cursor pattern is not completely different from that intended by the operator, and movement in an unintended direction can be avoided.

Further, in the input system described above, the processing unit of the input device may include a code set for each azimuth detection region at the center and the periphery of the cursor pattern at the beginning of the position detection process. It is preferable to execute a threshold setting process for setting a code determination threshold for determination based on the detection result.
By setting such a code determination threshold, it is possible to accurately determine a code corresponding to the color of each area of the cursor pattern from the detection result of the light detection unit.

In the input system described above, the processing unit of the input device may include a black display process for instructing the image generation apparatus to display a display screen in black in the threshold setting process, and the light after the black display. A black level acquisition process for acquiring each detection result corresponding to red, green, and blue of the detection unit as a black detection result; and a white display process for instructing the image generation device to display the display screen in white. , After the white display, white level acquisition processing for acquiring detection results corresponding to red, green, and blue of the light detection unit as white detection results, and red, green based on the black detection results and white detection results It is preferable to execute setting processing for setting the code determination threshold value corresponding to blue.
By performing such a threshold setting process, a more accurate code determination threshold can be obtained.

Further, in the input system described above, a plurality of projection display devices are provided as the display device, and each projection type display device simultaneously displays a screen in the same projection area from each direction, or is selectively provided. It is preferable to display the screen only.
With such a configuration, it is possible to reduce the influence of shadows generated when the input device is operated by hand, and to improve work efficiency.

In addition, the input method according to the present invention displays an image generated by the image generation device on the display device, and is incident on a tip portion provided on the input device capable of moving operation and touching the display screen of the display device. The position of the tip portion is detected in cooperation with image generation processing by the image generation device based on a light detection result.
According to the input method having such a feature, there is no need for a dedicated position detecting device for detecting the position of the input device as in the prior art, and therefore it is not necessary to calibrate the coordinates of the display image and the detected position, and the system Can improve usability and maintainability, reduce the overall system size, and reduce device costs.

Further, the input device according to the present invention includes a tip portion that can contact the display screen of the display device, a light detection portion that detects incident light on the tip portion, and a predetermined result based on a detection result of the light detection portion. A processing unit that performs processing, and a transmission unit that performs communication with the image generation device, and the processing unit cooperates with the image generation processing by the image generation device based on the detection result of the light detection unit. A tip position detection process is performed.
According to the input device having such a feature, there is no need for a dedicated position detection device as in the prior art, so it is not necessary to calibrate the coordinates of the display image and the detection position, improving the usability and maintainability of the input system, The entire system can be reduced in size and the apparatus cost can be reduced.

Further, the program according to the present invention is based on the detection result of the light detection unit that detects the incident light on the tip provided in the input device, and the position of the tip is cooperated with the image generation processing by the image generation device. A detection function is realized by a computer.
According to the program having such features, there is no need for a dedicated position detection device as in the prior art, so that it is not necessary to calibrate the coordinates of the display image and the detection position, and the input system is improved in usability and maintainability. The overall size can be reduced and the apparatus cost can be reduced.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[First Embodiment]
First, a first embodiment of an input system according to the present invention will be described. FIG. 1 is a schematic configuration diagram of an input system according to the first embodiment. As shown in FIG. 1, this input system is schematically configured from a projector (display device) 10, a pen (input device) 20, a computer (image generation device) 30, and a communication cable 40. Moreover, in FIG. 1, the code | symbol DK is a working desk and the code | symbol K is an operator.

 The projector 10 is installed at a predetermined height on the work desk DK, and an image corresponding to a video signal input from the computer 20 connected via the communication cable 40 is provided on the upper surface of the work desk DK. Projected on the screen. The pen 20 is a pointing device that is operated by the hand of the worker K on the screen (projection screen W) projected onto the work desk DK by the projector 10, and is predetermined based on various information obtained in accordance with the operation. And a function of wirelessly transmitting the processing result to the computer 30 as a transmission signal.

 The computer 30 is a PC (Personal Computer) disposed at a predetermined position on the work desk DK, and includes a wireless communication card 31 for receiving a transmission signal transmitted from the pen 20. The computer 30 generates a video signal representing an image to be displayed and outputs it to the projector 10, while grasping the position of the pen 20 based on the signal received from the pen 20 via the wireless communication card 31. The position of the cursor displayed on the projection screen W is controlled according to the position. The computer 30 includes a CPU (Central Processing Unit) (not shown), a hard disk, and the like, and executes various programs such as the above-described cursor position control by executing a program stored in the hard disk by the CPU. Is going.

 FIG. 2 is a schematic configuration diagram of the pen 20. As shown in FIG. 2, the pen 20 includes a tip portion 21 corresponding to a pen tip, a processing circuit (processing portion) 22 disposed inside a cylindrical member integrally joined to the tip portion 21, and motion detection. Unit (acceleration detection unit) 23, transmission unit 24, and power supply unit 25.

 FIG. 3 is a detailed view of the tip 21. In FIG. 3, the pen tip member 100 is made of a transparent resin, and a fine optical scattering structure is formed on the surface of the tip 100 a, and the light irradiated from the outside is the surface of the tip 100 a. As a result, the pen tip member 100 functions as a light guide member and transmits light to the opposite side. On the side surface excluding the tip 100a of the nib member 100, a paint part 100b is provided so that light from the outside does not enter.

 The end of the pen tip member 100 opposite to the tip 100a has a transparent flat shape, and the color sensor 101 is bonded to the end so that the light receiving surface and the end face each other. The color sensor 101 includes a color filter corresponding to each color of R (red), G (green), and B (blue), and three photodiodes provided corresponding to each color filter. It is configured to output a signal corresponding to the brightness of each color R, G, B of the external light incident through the member 100. This output signal is output to a pre-circuit 200 provided at the distal end portion 21 described later (see FIG. 4).

 In addition, a contact 102 is provided on the surface opposite to the light receiving surface of the color sensor 101, a spring 104 is provided between the grip member 103 of the pen tip member 100, and the grip member 103. A contact 105 is provided on the side facing the contact 102. Accordingly, when a force parallel to the axial direction is applied to the tip of the nib member 100, the nib member 100 slides in the axial direction, the spring 104 is compressed, and the contact 102 of the color sensor 101 and the gripping member 103 are compressed. The contact 105 comes into contact (electrically connected). Such contacts 102 and 105 are connected to the processing circuit 22 as a switch (contact detection unit) 203 described later (see FIG. 4).

 An electrode 106 is provided near the center of the nib member 100 so as to surround the peripheral surface, and an electrode 107 is provided at the tip of the gripping member 103 so as to surround the opening. Further, a support portion 108 is provided inside the opening of the gripping member 103 so as to surround the pen tip member 100, and the pen tip member 100 is supported with a slight gap. When a force parallel to the axial direction is applied to the tip of the nib member 100, the nib member 100 slides in the axial direction as described above, but the force is applied in a direction orthogonal to the axial direction. In this case, the electrodes 106 and 107 are in contact with each other with the support portion 108 as a fulcrum. Such electrodes 106 and 107 are connected to the processing circuit 22 as a switch (contact detection unit) 204 described later (see FIG. 4).

 When the operator K holds the pen 20 in his hand and performs a character writing operation or a predetermined instruction operation on the projection screen W, the tip 100a of the pen tip member 100 of the pen 20 contacts the screen surface. A so-called pen touch can be detected when a force in an oblique direction is applied to the member 100 and the contacts 102 and 105 contact, the electrodes 106 and 107 contact, or both contact.

 FIG. 4 is a circuit block diagram of the signal processing system of the pen 20. As shown in FIG. 4, the pre-circuit 200 provided at the tip 21 includes color filters 110R, 110G, and 110B corresponding to R (red), G (green), and B (blue) colors, A color sensor 101 including three photodiodes 111R, 111G, and 111B provided corresponding to the color filter, operational amplifiers 201R, 201G, and 201B corresponding to each color, negative feedback resistors 202R, 202G, and 202B, and contacts The switch 203 includes 102 and 105, and the switch 204 includes electrodes 106 and 107. The color sensor 101, the operational amplifiers 201R, 201G, and 201B, and the negative feedback resistors 202R, 202G, and 202B correspond to the light detection unit in the present invention.

 The output of the photodiode 111R is connected to the inverting input terminal of the operational amplifier 201R, and the operational amplifier 201R outputs a voltage corresponding to the brightness of the red light received by the photodiode 111R to the A / D converter 210R of the processing circuit 22. . The output of the photodiode 111G is connected to the inverting input terminal of the operational amplifier 201G, and the operational amplifier 201G outputs a voltage corresponding to the brightness of the green light received by the photodiode 111G to the A / D converter 210G of the processing circuit 22. . The output of the photodiode 111B is connected to the inverting input terminal of the operational amplifier 201B, and the operational amplifier 201B outputs a voltage corresponding to the brightness of the blue light received by the photodiode 111B to the A / D converter 210B of the processing circuit 22. . Both ends of the switch 203 (that is, the contacts 102 and 105) and both ends of the switch 204 (that is, the electrodes 106 and 107) are connected to the interface circuit 211 of the processing circuit 22.

 The processing circuit 22 includes A / D converters 210R, 210G, and 210B corresponding to each color, an interface circuit 211, a CPU 212, a RAM (Random Access Memory) 213, a ROM (Read Only Memory) 214, and a bus 215. Has been.

 The A / D converter 210R converts the output voltage of the operational amplifier 201R into digital data (red brightness data) and outputs the digital data to the interface circuit 211. The A / D converter 210G converts the output voltage of the operational amplifier 201G into digital data (green brightness data) and outputs the digital data to the interface circuit 211. The A / D converter 210B converts the output voltage of the operational amplifier 201B into digital data (blue brightness data) and outputs the digital data to the interface circuit 211.

 The interface circuit 211 receives brightness data of each color input from the A / D converters 210R, 210G, and 210B, data indicating the on / off states of the switches 203 and 204, and X input from the motion detection unit 23 described later. The axis acceleration data and the Y axis acceleration data are output to the CPU 212 via the bus 215.

 The CPU 212 is connected to the interface circuit 211, the RAM 213, the ROM 214, and the interface circuit 230 of the transmission unit 24 described later via the bus 215. The CPU 212 executes predetermined processing based on various data obtained from the interface circuit 211 by executing a program stored in the ROM 214, and uses the processing result as transmission data. Send to.

 The RAM 213 is a working memory used as a temporary storage destination of data when the CPU 212 performs various arithmetic processes. The ROM 214 is a non-volatile memory that stores in advance a program executed by the CPU 212 and other data necessary for arithmetic processing.

 The motion detection unit 23 includes an X acceleration sensor 220, a Y acceleration sensor 221, an A / D converter 222, and an A / D converter 223. Here, an X axis and a Y axis that are orthogonal to each other in a plane perpendicular to the longitudinal direction of the pen 20 are assumed. The X acceleration sensor 220 detects the acceleration generated in the X-axis direction and outputs an acceleration signal indicating the detection result to the A / D converter 222. The Y acceleration sensor 221 detects the acceleration generated in the Y-axis direction, and outputs an acceleration signal indicating the detection result to the A / D converter 223.

The A / D converter 222 converts the acceleration signal input from the X acceleration sensor 220 into digital data (X-axis acceleration data) and outputs the digital data to the interface circuit 211. The A / D converter 223 converts the acceleration signal input from the Y acceleration sensor 221 into digital data (Y-axis acceleration data) and outputs the digital data to the interface circuit 211.
By such a motion detection unit 23, it is possible to detect acceleration caused by movement of the pen 20.

The transmission unit 24 includes an interface circuit 230, a modulation circuit 231, an amplification circuit 232, and an antenna 233. The interface circuit 230 outputs the transmission data input from the processing circuit 22 to the modulation circuit 231. The modulation circuit 231 generates a transmission signal in the RF frequency band by performing a modulation process on transmission data input from the interface circuit 230 and outputs the transmission signal to the amplification circuit 232. The amplifier circuit 232 amplifies the transmission signal input from the modulation circuit 231 and transmits the amplified transmission signal to the computer 30 (wireless communication card 31) via the antenna 233.
Although not shown in FIG. 4, the power supply unit 25 supplies a power supply voltage to the pre-circuit 200, the processing circuit 22, the motion detection unit 23, and the transmission unit 24.

 In the pen 20 configured as described above, the presence or absence of a pen touch, the brightness of each color light at the current pen tip position, and the acceleration in the X-axis and Y-axis directions are used as information according to the operation by the operator K. As a result, processing based on various information is performed, and the processing result is transmitted to the computer 30.

 Next, a cursor pattern projected from the projector 10 as a cursor of the computer 30 will be described with reference to FIG. The cursor in this embodiment is generally different in pattern from a cursor operated with a mouse or a keyboard, but is the same in that it plays a role as a pointer.

 FIG. 5A shows an example of the cursor pattern CP in the present embodiment. As shown in FIG. 5, the cursor pattern CP includes a circular center portion CP1 and a concentric peripheral portion CP2 including the central portion CP1, and the peripheral portion CP2 corresponds to an orientation from the center point. A plurality (16 in this embodiment) of azimuth detection areas DS1 to DS16 are formed. Here, assuming an XY coordinate system as shown in the figure and assuming that the counterclockwise direction is a positive direction, for example, the direction detection region DS1 is 0/8 × π (rad) = 0 (rad) with respect to the X axis. The azimuth detection area DS2 corresponds to an azimuth of 1/8 × π (rad).

 Similarly, the direction detection area DS3 is 2/8 × π (rad), the direction detection area DS4 is 3/8 × π (rad), the direction detection area DS5 is 4/8 × π (rad), the direction detection area DS6 is 5/8 × π (rad), the direction detection region DS7 is 6/8 × π (rad), the direction detection region DS8 is 7/8 × π (rad), and the direction detection region DS9 is 8/8 × π ( rad), the direction detection region DS10 is 9/8 × π (rad), the direction detection region DS11 is 10/8 × π (rad), the direction detection region DS12 is 11/8 × π (rad), and the direction detection region DS13 is 12/8 × π (rad), the direction detection region DS14 is 13/8 × π (rad), the direction detection region DS15 is 14/8 × π (rad), and the direction detection region DS16 is 15/8 × π (rad) It corresponds to the direction.

 FIG. 5B shows a code indicating the level (brightness) of each color R, G, B assigned to each of the orientation detection regions DS1 to DS16 in the central portion CP1 of the cursor pattern CP and the peripheral portion CP2. . As shown in this figure, the level for each color is indicated by 2 bits, and four levels of “00”, “01”, “10”, and “11” can be expressed. Here, “00” corresponds to black display (no projection light), and “11” corresponds to the maximum brightness. In the central portion CP1, G (green) is set to “11”, and R (red) and B (blue) are set to “00”. In each of the azimuth detection areas DS1 to DS16, only G is fixed at “01”, but different codes are sequentially set for R and B. As a code setting method, a gray code is adopted, and setting is performed so that only one bit changes in an adjacent portion.

 Next, the operation of the input system configured as described above will be described. Here, it is assumed that a predetermined image including the cursor pattern CP described above is displayed on the display screen W. FIG. 6 is a flowchart showing the operation (position detection process) of the pen 20. The operation shown in this figure is realized by the CPU 212 in the pen 20 executing a program stored in the ROM 214.

 First, in step S1, the CPU 212 of the pen 20 determines whether or not a pen touch has been performed based on data indicating the on / off states of the switches 203 and 204 (whether or not the pen tip member 100 has touched the display screen W). In the case of “Yes” (when pen touch is performed), the signal level correction process (threshold setting process) in step S2 is performed.

 FIG. 7 is a flowchart showing the signal level correction process. As shown in FIG. 7, in the signal level correction process, first, the CPU 212 instructs the computer 30 to display the entire display screen W1 in black via the transmission unit 24 (step S21: black display process). . The CPU 212 stores the red brightness data obtained through the interface circuit 211 at this time as Vrb, the green brightness data as Vgb, and the blue brightness data as Vbb in the RAM 213 (step S22: black level acquisition process). These values of Vrb, Vgb, and Vbb indicate brightness that is unnecessary when pen position is detected such as light reflected from the projector 10 and light reflected from the surroundings.

 Subsequently, the CPU 212 instructs the computer 30 via the transmitting unit 24 to display the entire display screen W1 in white (step S23: white display processing), and the red brightness obtained through the interface circuit 211 at this time. Is stored in the RAM 213 as Vrp, green brightness data as Vgp, and blue brightness data as Vbp (step S24: white level acquisition processing). These values of Vrp, Vgp, and Vbp indicate the maximum brightness when the pen position is detected. That is, the brightness for each color detected by the pen 20 is included in the range of Vrb to Vrp for red, Vgb to Vgp for green, and Vbb to Vbp for blue.

 Subsequently, as shown in FIG. 8, the CPU 212 determines the codes “00” to “11” assigned to the direction detection areas DS1 to DS16 of the cursor pattern CP from the detection level of each color (value of brightness data of each color). Is set and stored in the RAM 213 (step S25: setting process).

Here, as described with reference to FIG. 5, each color in each of the azimuth detection areas DS1 to DS16 is set by four stages of codes, so three code determination thresholds are set as shown in FIG. Specifically, since the detection level corresponding to the light output is almost linear, the code determination threshold value may be determined by equally dividing the detection level. For example, focusing on R (red), the three code determination thresholds Vrt1, Vrt2, and Vrt3 are expressed by the following equations (1) to (3).
Vrt1 = Vrb + (Vrp−Vrb) / 4 (1)
Vrt2 = Vrb + (Vrp-Vrb) /4.2 (2)
Vrt3 = Vrb + (Vrp-Vrb) /4.3 (3)
Similarly, the code determination threshold can be obtained for G (green) and B (blue).
When the gradation characteristics are processed nonlinearly inside the projector 10, the relationship between the light output and the detection level is also nonlinear, but each code determination threshold is determined in consideration of the respective characteristics. It ’s fine.

 When the signal level correction process as described above is completed, the CPU 212 performs an initial position detection process in step S3 shown in FIG. FIG. 9 is a flowchart showing the initial position detection process. As shown in this figure, in the initial position detection process, first, the CPU 212 instructs the computer 30 via the transmission unit 24 to blink and display the central portion CP1 of the cursor pattern CP with the maximum brightness of green. (Step S31).

 Then, the CPU 212 uses the green code determination threshold value Vgt3 corresponding to the code “11” determined as described above for the green brightness data (green detection level) Vg obtained through the interface circuit 211 at this time as a reference. It is determined whether or not blinking of the central portion CP1 is detected by confirming whether or not the change is repeated (step S32). In this step S32, if “Yes”, that is, if the tip position of the pen 20 coincides with the position of the central portion CP1 of the cursor pattern CP, the CPU 212 ends the initial position detection process and returns to FIG. In the case of “No”, that is, when the tip of the pen 20 exists at a position different from the cursor pattern CP, the calibration process of step S33 is performed.

 In this calibration process, when the tip 100a of the pen 20 is pen-touched on the projection screen W at a position away from the cursor pattern CP, the position of the tip 100a is searched and the center portion CP1 of the cursor pattern CP is moved to the tip 100a. It is a process for moving to position. FIG. 10 is a flowchart showing the calibration process. FIG. 11 shows how the display screen W changes during the calibration process. Hereinafter, the calibration process will be described with reference to FIGS. 10 and 11.

As shown in FIG. 10, in the calibration process, first, the CPU 212 sets the resolution for searching for the pen tip position as the Nth power of 2, and transmits the set value to the computer 30 via the transmission unit 24. (Step T1). Here, the value of N is determined from the relationship between the size of the projection screen W and the size of the central portion CP1 of the cursor pattern CP. For example, if the diagonal of the projection screen W is 40 inches and the diameter of the central portion CP1 is 5 mm, 40 × 25.4 / 5 = 203.2, and therefore 2 ⁷ <203.2 <2 ⁸ Therefore, N = 8 is set. Since the value of N is a known value in advance, it may be stored in advance in the hard disk of the computer 30 or the like.

 Subsequently, the CPU 212 sets the entire projection screen W as the search range (step T2: initial setting process). Hereinafter, on the projection screen W, an area for checking the presence of the tip 100a of the pen 20 is defined as a search range, and when the tip 100a exists in the search range, the range is defined as a candidate range.

 Then, the CPU 212 instructs the computer 30 to display the entire search range, that is, the entire projection screen W, in the white area and the black area in the horizontal direction (step T3: first division process). As a result, the computer 30 controls the projector 10 so that the search range, that is, the entire projection screen W, is divided into the white area and the black area in the horizontal direction as shown in FIG. To do.

 Next, the CPU 212 uses any one or any combination of the red brightness data Vr, the green brightness data Vg, the blue brightness data Vb obtained through the interface circuit 211 at this time, and the brightness at the current position of the tip 100a. Data V1 (step T4: first light detection acquisition process).

 Then, the CPU 212 instructs the computer 30 to invert and display the white area and the black area in the search range (step T5: second division process). As a result, the computer 30 controls the projector 10 so as to invert and display the white area and the black area in the search range, as shown in FIG. The CPU 212 uses any one or any combination of the red brightness data Vr, the green brightness data Vg, the blue brightness data Vb obtained through the interface circuit 211 at this time, or the brightness data V2 at the current position of the tip 100a. (Step T6: second light detection acquisition process).

 Here, the CPU 212 compares the brightness data V1 acquired in step T4 with the brightness data V2 acquired in step T6, and estimates that the tip 100a of the pen 20 exists in the higher brightness (that is, the white area). Therefore, the area with higher brightness is set as a candidate range (step T7), and the current candidate range is reset as a new search range, and the computer 30 is instructed (step T8). That is, as shown in FIG. 11, if the tip 100a of the pen 20 is present in the lower right portion of the projection screen W, the white area shown in FIG. 11A is reset as a new search range. Steps T7 and T8 correspond to the search range setting process in the present invention.

 Thereafter, the processes in steps T3 to T8 described above are repeated N times. For example, FIGS. 11C and 11D show changes in the display screen W in the processes of steps T3 to T8 in the second round, and FIGS. 11E and 11F show the third round. FIG. 11G and FIG. 11H show changes in the display screen W in the processes of steps T3 to T8 in the fourth round. This is a representation of the situation.

 By repeating the processes in steps T3 to T8 in this manner, the search range is gradually narrowed toward the position of the tip 100a of the pen 20, and after being repeated N times, the center coordinates of the candidate range are almost equal. The value indicates the position coordinate of the tip 100a. Therefore, the CPU 212 determines the center coordinates of the last candidate range obtained by repeating the processes of steps T3 to T8 N times as the initial coordinates of the tip 100a (hereinafter referred to as pen nib initial coordinates) and instructs the computer 30. (Step T9). Thereby, the computer 30 moves the cursor pattern CP to the center coordinates (that is, the pen tip initial coordinates) of the last candidate range (step T10). Steps T9 and T10 correspond to the tip position determination process in the present invention.

 By the calibration process described above, the position of the tip 100a of the pen 20 and the position of the center portion CP1 of the cursor pattern CP can be matched. The operation on the computer 30 side during the calibration process is realized by a CPU built in the computer 30 executing a program stored in the hard disk.

 When the calibration process is finished, the CPU 212 proceeds to the process of step S4 shown in FIG. In step S4 of FIG. 6, the CPU 212 determines whether or not the pen touch is continued based on the data indicating the on / off states of the switches 203 and 204 (the pen tip member 100 continues to contact the display screen W). In the case of “Yes”, that is, when it is estimated that the writing input is performed with the pen 20 kept in contact, the writing process of step S5 is performed, while in the case of “No”, that is, When it is estimated that only the movement of the pen 20 is performed without performing the writing input, the process proceeds to the floating process in step S8.

 FIG. 12 is a flowchart showing the writing process. In this writing process, first, the CPU 212 resets an out-of-pattern flag indicating that the tip 100a of the pen 20 is located at a place other than the cursor pattern CP to “0” (step S51). That is, when the out-of-pattern flag is “0”, it indicates that the tip 100a of the pen 20 matches the position of the cursor pattern CP.

 Subsequently, the CPU 212 acquires X-axis acceleration data and Y-axis acceleration data via the interface circuit 211 (step S52), and determines whether the X-axis acceleration data and the Y-axis acceleration data are greater than a predetermined threshold value. (Step S53). In step S53, the CPU 212 determines “Yes”, that is, if the X-axis acceleration data and the Y-axis acceleration data are larger than the threshold value (or one of the X-axis acceleration data and the Y-axis acceleration data may be larger than the threshold value). Then, the out-of-pattern flag is set to “1” to end the writing process, and the process proceeds to step S6 in FIG. 6 (step S58).

 As described above, when the X-axis acceleration data and the Y-axis acceleration data are larger than the threshold value, or when one of the X-axis acceleration data and the Y-axis acceleration data is larger than the threshold value, the moving speed of the pen 20 is very fast. Since there is a possibility that the tip 100a may deviate from the cursor pattern CP, after setting the non-pattern flag to “1” as described above, the process proceeds from step S1 to step S6 in FIG. Here, the process of step S6 returns to the process of step S1 if the out-of-pattern flag is “1”, and moves to step S7 if it is “0”.

 On the other hand, if “No” in step S53, the CPU 212 acquires the red brightness data Vr, the green brightness data Vg, and the blue brightness data Vb via the interface circuit 211, and stores each color stored in the RAM 214. The brightness data of each color is converted into a code (step S54: color determination process).

 Then, the CPU 212 confirms whether or not the tip 100a of the pen 20 is located inside the center portion CP1 of the cursor pattern CP, and the code corresponding to G (green) obtained in step S54 is “11”. Is determined (step S55: center portion determination processing). In this step S55, in the case of “Yes”, that is, in the case where the code corresponding to G (green) is “11”, as shown in FIG. 13A, the tip 100a of the pen 20 is centered CP1 of the cursor pattern CP. Therefore, the writing process is terminated, and the process proceeds to step S6 in FIG. Note that since the out-of-pattern flag at this time remains “0”, the process proceeds to step S7 after step S6 in FIG.

 On the other hand, in the above step S55, in the case of “No”, it is considered that the tip 100a of the pen 20 is located in any one of the direction detection areas DS1 to DS16 in the peripheral portion CP2 of the cursor pattern CP. Therefore, in the case of “No” in step S55, the CPU 212 determines in which of the direction detection areas DS1 to DS16 the tip 100a of the pen 20 is located from the code corresponding to R (red) and B (blue). By confirming, the moving direction of the cursor pattern CP is determined (step S56: direction searching process). For example, when the code corresponding to R (red) is “00” and the code corresponding to B (blue) is “11”, as shown in FIG. 13B, the tip 100a of the pen 20 is in the direction detection region DS3. Therefore, the moving direction of the cursor pattern CP is determined to be 2/8 × π (rad).

 Then, the CPU 212 instructs the computer 30 to move the cursor pattern CP toward the moving direction determined as described above (step S57). Thereby, the computer 30 starts to move the cursor pattern CP on the projection screen W.

 When the writing process as described above is completed, the CPU 212 proceeds to the process of step S6 shown in FIG. When the process proceeds from step S57 to step S6 of the writing process, the out-of-pattern flag remains “0”, and thus the process proceeds to step S7 after step S6 in FIG. In step S7, the CPU 212 determines whether or not the pen touch is continued based on the data indicating the on / off states of the switches 203 and 204. If “Yes”, that is, the writing input is continuing. In that case, the process returns to the process of step S5, and the processes of steps S51 to S57 shown in FIG. 12 are repeated.

 Thus, until it is determined in step S55 in FIG. 12 that the position of the tip 100a of the pen 20 matches the position of the center portion CP1 of the cursor pattern CP, that is, until the state of FIG. The cursor pattern CP moves in the direction of 2/8 × π (rad). As a result, as shown in FIG. 13D, the cursor pattern CP is on the locus between the movement start point P1 and the movement end point P2 of the cursor pattern CP. You can draw a line.

 On the other hand, in the case of “No” in step S7, that is, when it is estimated that only the movement of the pen 20 is performed without writing input, the CPU 212 proceeds to the floating process of step S8. In the floating process in step S8, the same process as in step S5 described above is performed. Moreover, the process of step S9 is the same as that of step S6, and the process of step S10 is the same as that of step S7.

 In other words, when the process proceeds to step S8, the pen touch is released after the line writing is completed in steps S5 to S7 or after the initial position detection process in step S3, and the tip 100a of the pen 20 is projected. Since it can be presumed that the screen has floated from the screen W and has moved to the next writing start position, the same processing as in steps S5 to S7 is performed in steps S8 to S10, whereby the cursor pattern CP is moved to the tip of the pen 20. It can be moved following the movement of 100a. If the movement speed of the pen 20 is fast and deviates from the cursor pattern CP, it is detected that the acceleration of the pen 20 is larger than the threshold value in step S53 in FIG. Then, it is sufficient to start again from the process of step S1.

  As described above, according to the input system in the present embodiment, a dedicated position detection device for detecting the position of the pen 20 as in the prior art is not required, and therefore the coordinates of the display image and the detection position are calibrated. This eliminates the need to improve the usability and maintainability of the system, reduce the size of the entire system, and reduce the device cost.

  Further, since the 0-dimensional sensor is used for the pen 20, it can be used without being aware of the direction of the pen 20. In addition, since the gray code is adopted as the code setting method for each direction detection area in the cursor pattern CP, the tip 100a of the pen 20 is located across the two direction detection areas in the cursor pattern, and the code is unstable. Even when the code is obtained, the code other than the adjacent azimuth detection area is not detected. Therefore, the moving direction of the cursor pattern CP is not completely different from that intended by the operator K and is not intended. Moving in the direction can be avoided. Further, when the pen 20 has an acceleration sensor built-in and the movement of the pen 20 is fast and the cursor pattern CP cannot follow, the cursor pattern CP moves to an unintended position by stopping the movement of the cursor pattern CP. Can be prevented.

[Second Embodiment]
Next, an input system according to the second embodiment will be described. The input system according to the second embodiment is different from the first embodiment only in the code determination threshold setting method and the content of the calibration process. Therefore, the code determination threshold in the second embodiment will be described below. Description will be made by focusing on the setting method and the calibration process.

(1) Code Determination Threshold Setting Method In the first embodiment, each color in each direction detection region DS1 to DS16 of the cursor pattern CP is set by four stages of codes, so that as shown in FIG. Three code determination thresholds were determined. Since these code determination threshold values are necessary for the writing process and the floating process shown in FIG. 6, it is necessary to determine them similarly in the second embodiment. In addition, in the second embodiment, a code determination threshold dedicated to calibration processing (hereinafter referred to as a calibration code determination threshold) is determined.

Specifically, as shown in FIG. 14, each color is set by a 1-bit code, that is, a two-stage code of “0” and “1”, and one calibrated code determination threshold value is determined for each color. . In this case, since it is only necessary to determine whether each color is at a detection level (brightness) of “0” or “1”, the dedicated code determination threshold Vrct for R (red), G (green), and B (blue) is used. , Vgct and Vbct are represented by the following formulas (4) to (6).
Vrct = Vrb + (Vrp−Vrb) / 2 (4)
Vgct = Vgb + (Vgp−Vgb) / 2 (5)
Vbct = Vbb + (Vbp-Vbb) / 2 (6)

(2) Calibration Process FIG. 15 is a flowchart showing the calibration process in the second embodiment. FIG. 16 shows how the display screen W changes during the calibration process. FIG. 17 shows the codes (1-bit codes) of the respective colors assigned to the eight areas Wa to Wh displayed on the projection screen W in FIG.

As shown in FIG. 15, first, the CPU 212 sets the resolution for searching for the pen tip position as 8 to the Mth power, and transmits the set value M to the computer 30 via the transmission unit 24 (step U1). . Here, the value of M is determined from the relationship between the size of the projection screen W and the size of the central portion CP1 of the cursor pattern CP. For example, a diagonal of 40 inches projection screen W, the diameter of the central portion CP1 is assumed to be 5 mm, for a 40 × 25.4 / 5 = ^203.2, is 8 2 <203.2 ^{<8 3} Therefore, M = 3 is set. Since the value of M is a known value in advance, it may be stored in advance in the hard disk of the computer 30 or the like.

 Subsequently, the CPU 212 sets the entire projection screen W as the search range (step U2). In the following, as in the first embodiment, in the projection screen W, an area for checking the presence of the tip 100a of the pen 20 is defined as a search range, and when the tip 100a exists in the search range, the range is set as a candidate range. It is defined as

 Then, the CPU 212 instructs the computer 30 to display the entire search range, that is, the entire projection screen W, in the vertical direction, divided into eight areas Wa to Wh (step U3). When the computer 30 receives an instruction from the pen 20 as described above, as shown in FIG. 16A, the search range, that is, the entire projection screen W is vertically divided into eight areas Wa to Wh. The projector 10 is controlled so as to be displayed. Here, the colors of the areas Wa to Wh are colors corresponding to the codes shown in FIG.

 Next, the CPU 212 acquires red brightness data Vr, green brightness data Vg, and blue brightness data Vb obtained through the interface circuit 211 at this time as brightness data of each color at the current position of the tip 100a ( Step U4). Then, the CPU 212 instructs the computer 30 to display the entire search range, that is, the entire projection screen W, divided into eight areas Wa to Wh in the horizontal direction (step U5).

 When the computer 30 receives the above instruction, as shown in FIG. 16B, the projector 10 is displayed so that the entire search range, that is, the entire projection screen W is divided into eight areas Wa to Wh in the horizontal direction. To control. The CPU 212 acquires the red brightness data Vr, green brightness data Vg, and blue brightness data Vb obtained through the interface circuit 211 at this time as brightness data of each color at the current position of the tip 100a (step U6). .

 Here, the CPU 212 performs code conversion on the brightness data (detection level) of each color acquired in steps U4 and U6 based on the calibrated code determination thresholds Vrct, Vgct, and Vbct. That is, the code is “0” if the detection level is lower than the caribbean dedicated code determination threshold, and the code is “1” if it is higher. Then, the CPU 212 determines the areas where the code corresponding to the detection level of each color acquired in step U4 and the code corresponding to the detection level of each color acquired in step U6 coincide with each other based on the table of FIG. Search from within.

 As described above, when an area where the code obtained by vertical division and the code obtained by horizontal division coincide is found, the tip of the pen 20 is located in an area where the area intersects in the case of vertical division and horizontal division. 100a is presumed to exist. Therefore, the CPU 212 sets such an intersection area as a candidate range (step U7), sets the current candidate range as a new search range, and instructs the computer 30 (step U8). That is, as shown in FIGS. 16 (a) and 16 (b), assuming that the tip 100a of the pen 20 is present in the region Wg, as shown in FIG. 16 (c), the intersecting region of the region Wg is newly explored. Reset as a range.

 Thereafter, the processes in steps U3 to U8 described above are repeated M times. For example, FIGS. 16C and 16D show changes in the display screen W in the process of steps U3 to U8 in the second round. By repeating the processing of steps U3 to U8 in this way, the search range is gradually narrowed toward the position of the tip 100a of the pen 20, and after being repeated M times, the center coordinates of the candidate range are almost equal. The value indicates the position coordinate of the tip 100a.

 Therefore, the CPU 212 instructs the computer 30 to set the center coordinates of the last candidate range obtained by repeating the processes in steps U3 to U8 M times as the initial coordinates (pen nib initial coordinates) of the tip 100a (step U9). ). Thereby, the computer 30 moves the cursor pattern CP to the center coordinates (that is, the pen tip initial coordinates) of the last candidate range (step U10).

 By the calibration process of the second embodiment described above, the position of the tip 100a of the pen 20 and the position of the center portion CP1 of the cursor pattern CP can be matched. The operation on the computer 30 side during the calibration process is realized by a CPU built in the computer 30 executing a program stored in the hard disk.

 According to the input system in the second embodiment as described above, the calibration processing time can be shortened as compared with the first embodiment, and the operation speed of the entire system can be improved.

[Third Embodiment]
Next, an input system in the third embodiment will be described. FIG. 18 is a schematic configuration diagram of an input system according to the third embodiment. In FIG. 18, the same components as those in FIG. 1 (first embodiment) are denoted by the same reference numerals, and description thereof is omitted. As shown in FIG. 18, in the input system according to the third embodiment, a projector 50 and a signal distribution switching device 60 are added. The projector 50 is connected to the signal distribution switching device 60 via a communication cable 61. 10 is connected to a signal distribution switcher 60 via a communication cable 62, and the computer 30 is connected to the signal distribution switcher 60 via a communication cable 63.

  The projector 50 is installed so that an image can be projected in the same projection area from a direction different from that of the projector 10, and the video signal of the computer 30 is supplied to the projector 10 and the projector 50 by the signal distribution switching unit 60 and simultaneously projected. A configuration in which the screen W is displayed or the video signal is selectively supplied to one of the projector 10 and the projector 50 by the signal distribution switching unit 60, so that the projection screen W can be displayed only by one of the projectors. It has become.

  FIG. 19 shows a state of the projection screen W viewed from the worker K. A shadow 71 is generated on the projection screen from the projector 10 by the hand of the pen 20 and the operator K. Similarly, a shadow 72 is generated on the projection screen from the projector 50 by the hand of the pen 20 and the operator K. Thus, when the operator K operates the pen 20 with the right hand, the shadow 71 is unlikely to hinder the work, but the shadow 72 hinders the work. Depending on the position of the projection screen W, the projection screen from the projector 50 may be preferable.

  Thus, since a preferable projector changes with work conditions, the operation efficiency can be improved by operating the signal distribution switching unit 60 and switching to a projection screen from a preferable projector. Further, by always projecting from two projectors at the same time, it is possible to make a situation in which a shadow is hardly generated.

As mentioned above, although 1st-3rd embodiment of this invention was described, this invention is not limited to these, The following modifications can be considered.
(1) In the above embodiment, an input system using a projector (projection display device) as a display device has been illustrated. However, a flat panel display such as a liquid crystal display may be used as the display device. That is, in this case, the pen 20 is brought into contact with the display screen of the flat panel display.

(2) In the above embodiment, the case where the communication between the pen 20 and the computer 30 is wireless communication is exemplified, but the communication may be performed by connecting with a cable or the like. Moreover, although the pen 20 is illustrated as an input device, it is not always necessary to have a pen shape, and any shape can be used as long as it can be easily operated by the operator K and can be provided with a tip that can contact the display screen. Goods are also acceptable.

(3) In the above embodiment, the center portion CP1 and the peripheral portion CP2 of the cursor pattern CP are both circular, but any shape may be used as long as the tip 100a of the pen 20 can be detected. Further, although the number of the azimuth detection areas of the peripheral portion CP2 is 16, the number of the azimuth detection areas may be increased if more accurate movement azimuth detection of the tip 100a is desired.

(4) In the calibration process of the first embodiment, the search range is divided into two parts, white and black. If there is a clear difference in the brightness of the two areas, the search area is divided into two parts with colors other than white and black. May be. Further, the direction of dividing into two may be either the horizontal direction or the vertical direction. On the other hand, in the calibration process of the second embodiment, the search range is divided into eight. However, if it is desired to detect the initial position of the tip 100a of the pen 20 with higher accuracy, the number of divisions may be increased.

(5) In the third embodiment, the case where two projectors are provided is illustrated, but a plurality of projectors may be further provided.

1 is a schematic configuration diagram of an input system according to a first embodiment of the present invention. It is a composition schematic diagram of pen 20 in a 1st embodiment. 3 is a detailed explanatory diagram of a tip portion 21 in a pen 20. FIG. 2 is a circuit block diagram of a signal processing system in a pen 20. FIG. It is detailed explanatory drawing of cursor pattern CP in this input system. 4 is a first flowchart regarding the operation of the pen 20. 5 is a second flowchart regarding the operation of the pen 20. It is detailed explanatory drawing regarding a code determination threshold value. 10 is a third flowchart regarding the operation of the pen 20. 10 is a fourth flowchart regarding the operation of the pen 20. FIG. 6 is a first explanatory diagram regarding the operation of the pen 20. 10 is a fifth flowchart regarding the operation of the pen 20; FIG. 9 is a second explanatory diagram regarding the operation of the pen 20. It is a detailed explanatory view regarding the code determination threshold in the second embodiment. It is a flowchart which shows the calibration process in 2nd Embodiment. It is the 1st explanatory view about operation of pen 20 in a 2nd embodiment. It is the 2nd explanatory view about operation of pen 20 in a 2nd embodiment. It is a structure schematic of the display system in 3rd Embodiment. It is supplementary explanatory drawing regarding the display system in 3rd Embodiment.

Explanation of symbols

 DESCRIPTION OF SYMBOLS 10, 50 ... Projector (display device), 20 ... Pen (input device), 30 ... Computer, 40 ... Communication cable, 21 ... Tip part, 22 ... Processing circuit (processing part), 23 ... Motion detection part (acceleration detection part) ), 24 ... Transmitter, 25 ... Power supply, CP ... Cursor pattern, CP1 ... Center, CP2 ... Peripheral, DS1 to DS16 ... Direction detection area, DK ... Work desk, K ... Worker

Claims (17)

An image generating device for generating an image;
A display device for displaying the image;
A tip portion that can contact the display screen of the display device, a light detection portion that detects light incident on the tip portion, a processing portion that performs predetermined processing based on a detection result of the light detection portion, and the image A transmission unit that communicates with the generation device, and an input device capable of moving operation,
Consisting of
The input system, wherein the processing unit in the input device performs position detection processing of the tip portion in cooperation with image generation processing by the image generation device based on a detection result of the light detection unit.   In the position detection process, the processing unit of the input device determines whether or not the tip is positioned on the cursor pattern displayed on the display screen based on the detection result of the light detection unit, In the case of negative, by performing a calibration process for exploring the position of the tip part in cooperation with the image generation process by the image generation apparatus, the position of the tip part is determined, and the image generation apparatus The input system according to claim 1, wherein an instruction is given to move the cursor pattern to the determined position of the tip.   The processing unit of the input device instructs the image generation device to blink the cursor pattern displayed on the display screen in the position detection process, and the blinking based on the detection result of the light detection unit. The input system according to claim 2, wherein it is determined whether or not the tip portion is positioned on the cursor pattern by confirming presence or absence. The processing unit of the input device, in the calibration process,
An initial setting process that initially sets the entire display screen as the search range;
A first division process for instructing the image generation apparatus to divide the search range on the display screen into two parts with different brightness;
A first light detection acquisition process for acquiring, as a first detection result, a detection result of the light detection unit after the first division process;
A second division process instructing the image generation apparatus to invert the brightness of the two areas displayed in two divisions in the first division process;
A second light detection acquisition process for acquiring a detection result of the light detection unit after the second division process as a second detection result;
Based on the first detection result and the second detection result, of the two areas divided into two, the area with the higher detection level is set as a candidate area where the tip is located, and the candidate area is newly searched. An exploration range setting process to be reset as a range;
After resetting the search range, a series of processing from the first division process to the search range setting process is repeated a predetermined number of times, and finally the center coordinates of the candidate range obtained are determined as the position of the tip portion. Tip position determination processing for instructing the image generation apparatus to move the cursor pattern to the determined position of the tip portion;
The input system according to claim 2, wherein the input system is executed. The processing unit of the input device, in the calibration process,
An initial setting process that initially sets the entire display screen as the search range;
A first division process for instructing the image generation device to display the search range on the display screen in different colors in the vertical direction or in the horizontal direction;
A first light detection acquisition process for acquiring, as a first detection result, a detection result of the light detection unit after the first division process;
A second division process for instructing the image generating apparatus to display a plurality of divisions in a direction different from the first division process;
A second light detection acquisition process for acquiring a detection result of the light detection unit after the second division process as a second detection result;
Based on the first detection result and the second detection result, an intersection region of divided regions whose colors match in the vertical direction and the horizontal direction is set as a candidate range where the tip is located, and the candidate range is newly searched. An exploration range setting process to be reset as a range;
After resetting the search range, a series of processing from the first division process to the search range setting process is repeated a predetermined number of times, and finally the center coordinates of the candidate range obtained are determined as the position of the tip portion. Tip position determination processing for instructing the image generation apparatus to move the cursor pattern to the determined position of the tip portion;
The input system according to claim 2, wherein the input system is executed. The input device includes a contact detection unit that detects whether or not the tip portion contacts the display screen.
The processing unit moves the tip when the detection result of the contact detection unit indicates that there is a contact after the position of the tip matches the position of the cursor pattern by the position detection process. When the detection result of the contact detection unit indicates that there is no contact, a floating process for moving the cursor pattern following the movement of the tip is executed. The input system according to any one of claims 2 to 5. The cursor pattern includes a central portion to which a dedicated color is assigned and a peripheral portion that includes the central portion and is assigned another color, and the peripheral portion is divided according to the direction and assigned different colors. A pattern in which a plurality of orientation detection areas are formed,
In the writing process or the floating process, the processing unit of the input device performs a color determination based on the detection result of the light detection unit, so that the azimuth detection region in the cursor pattern is present in any direction detection region. And instructing the image generation apparatus to move the cursor pattern toward the direction corresponding to the direction detection area where it is determined that the tip portion is present. The input system according to claim 6, further instructing to draw a line on the movement trace of the cursor pattern. The processing unit of the input device, in the writing process or the floating process,
Color determination processing for performing color determination based on the detection result of the light detection unit;
It is determined whether or not the color determined by the color determination process matches the color of the center portion of the cursor pattern. If they match, does the detection result of the contact detection unit indicate presence of contact? A center determination process for re-execution of the determination process;
An orientation search process for searching for an orientation detection area having the same color as the color determined by the color determination process as an orientation detection area in which the tip portion exists when it is determined in the center determination process that they do not match When,
The input system according to claim 7, wherein: The input device includes an acceleration detection unit that detects acceleration generated in the input device;
The processing unit of the input device, in the writing process or the floating process,
Based on the acceleration detection result of the acceleration detection unit, it is determined whether or not the input device has moved at such a speed that the tip portion is removed from the cursor pattern. If not, the detection result of the light detection unit is determined. 9. The position detection process according to claim 7 or 8, wherein the position detection process is restarted from the beginning when it is determined that the tip portion has moved at such a speed that the tip portion is deviated from the cursor pattern while performing color determination based on the color pattern. Input system.   The color of each azimuth detection area in the center part and the peripheral part of the cursor pattern is expressed by an arbitrary combination of red, green, and blue, and the brightness of each of red, green, and blue is set by a 2-bit code. The input system according to any one of claims 7 to 9, wherein the input system is configured.   The input system according to claim 10, wherein a gray code is adopted as a code setting method for each direction detection area in the cursor pattern.   The processing unit of the input device determines a code set for each azimuth detection area at the center and the periphery of the cursor pattern based on the detection result of the light detection unit at the beginning of the position detection process. The input system according to claim 10 or 11, wherein a threshold value setting process for setting a code determination threshold value is executed. The processing unit of the input device, in the threshold setting process,
Black display processing for instructing the image generation device to display the display screen in black;
Black level acquisition processing for acquiring each detection result corresponding to red, green, and blue of the light detection unit after the black display as a black detection result;
White display processing for instructing the image generation device to display a display screen in white;
A white level acquisition process for acquiring each detection result corresponding to red, green, and blue of the light detection unit as a white detection result after the white display;
A setting process for setting the code determination threshold corresponding to red, green, and blue based on the black detection result and the white detection result;
The input system according to claim 12, wherein: A plurality of projection type display devices as the display device,
The screen is simultaneously displayed in the same projection area from each direction by each projection display device, or the screen is selectively displayed only by a certain projection display device. The input system described in the section. The image generated by the image generation device is displayed on the display device,
The position of the tip portion in cooperation with the image generation processing by the image generation device based on the detection result of the incident light on the tip portion provided on the input device capable of moving operation and touching the display screen of the display device An input method characterized by performing detection. A tip that can contact the display screen of the display device;
A light detection unit for detecting light incident on the tip;
A processing unit that performs predetermined processing based on a detection result of the light detection unit;
A transmission unit that communicates with the image generation device,
The input unit, wherein the processing unit performs position detection processing of the tip portion in cooperation with image generation processing by the image generation device based on a detection result of the light detection unit.   Based on the detection result of the light detection unit that detects light incident on the tip provided in the input device, the computer can realize the position detection function of the tip while cooperating with the image generation processing by the image generation device. A featured program.

Images