JP5257486B2 - Computer apparatus, input system, and program - Google Patents

Description

  The present invention relates to a technique using a coding pattern readable by an electronic pen.

  In recent years, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. Anotopen is used with dedicated paper on which a predetermined dot pattern is printed. In addition to the usual ink cartridge for writing characters, etc., the anotopen has a small camera for capturing the dot pattern printed on the dedicated paper and the position coordinates on the dedicated paper from the captured dot pattern. A processor for calculating and a data communication unit for transmitting the calculated position coordinates and the like to an external device are mounted. When the user writes characters on the special paper with an anotopen or puts a check mark on the image designed on the special paper, the small camera captures the dot pattern printed on the special paper as the pen moves. The entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen by the data communication unit to a nearby terminal device such as a personal computer or a mobile phone (for example, see Patent Document 1).

  Patent Documents 2 and 3 disclose a system in which a dot pattern is stacked on an optical touch panel, and input using an electronic pen and touch panel input using a finger are possible. Non-Patent Document 1 has a configuration in which a liquid crystal is inserted and an electromagnetic induction type tablet is arranged at the bottom and a resistive film type touch panel is arranged at the top, allowing both input with an electronic pen and input with a finger. A touch panel is disclosed.

Japanese translation of PCT publication No. 2003-511761 US Patent Application Publication No. 2010/1962 US Patent Application Publication No. 2010/1963 Kenji Koshiishi et al., “Touch Panel”, first edition, Industrial Research Co., Ltd., March 15, 2010, P36-37, 50-63, 78-80

  In a display device in which a touch panel is stacked and input by an electronic pen and touch panel input by a finger can be performed, depending on the detection principle of the touch panel, the pen tip of the electronic pen contacts the display during input by the electronic pen. There is a possibility that the touch panel erroneously detects input. SUMMARY OF THE INVENTION Accordingly, it is a main object of the present invention to provide a computer apparatus, an input system, and a program thereof that can appropriately detect both an input with an electronic pen and an input with a touch panel.

A computer apparatus according to the present invention includes a display device in which a touch panel that detects a touch operation by a user and a coding pattern layer on which a coding pattern that can be read by an electronic pen is stacked, and the touch panel. Processing means for performing input processing by touch operation and processing for input based on information related to the coded pattern received from the electronic pen , and the processing means detects a predetermined time after detecting input to the touch panel. During the width, it is determined whether or not information related to the coding pattern has been received from the electronic pen that has not received information related to the coding pattern, and if it is determined that the information has been received, No input processing is performed .

In this configuration, the computer device has a display device in which a touch panel and a coded pattern layer are stacked, and when there is input from the electronic pen, the coded pattern layer causes the electronic pen to read the coded pattern. To receive information about the coding pattern from the electronic pen. Further, when there is an input with a finger, the computer device detects the input with a touch panel .

Further, in the computer device , the processing unit receives information on the coding pattern from the electronic pen that has not received information on the coding pattern for a predetermined time width after detecting input to the touch panel. It is determined whether or not the information has been received, and when it is determined that the information has been received, the input process to the touch panel is not performed. The predetermined time width is determined, for example, by obtaining in advance an experiment or the like a time difference (time lag) until an input is detected when an input with an electronic pen and an input with a touch panel are performed simultaneously. With this configuration, the computer device has a time lag between the input by the electronic pen and the input by the touch panel, and even when the input by the electronic pen is detected with a delay, the electronic pen It is possible to prevent erroneous input of the touch panel due to contact with the display device.

The input system according to the present invention includes an electronic pen that reads an encoded pattern and generates information related to the encoded pattern, and an encoded pattern layer in which an encoded pattern that can be read by the electronic pen is formed . A computer comprising: a touch panel for detecting a touch operation by a user; a computer device capable of communicating with the electronic pen and the touch panel; and a projector for projecting a display screen based on an image signal transmitted from the computer device to the touch panel. The apparatus includes a processing unit that performs an input process by touch operation on the touch panel and performs an input process based on information on the coded pattern received from the electronic pen, and the processing unit performs input to the touch panel. After detecting It is determined whether or not information related to the coding pattern has been received from the electronic pen that has not received information related to the coding pattern. If it is determined that the information has been received, input processing to the touch panel is performed. Not .

With this configuration , the input system can prevent erroneous input on the touch panel due to the electronic pen abutting on the display device during input with the electronic pen.

A program according to the present invention includes a display device in which a touch panel that detects a touch operation by a user and a coding pattern layer on which a coding pattern that can be read by an electronic pen is stacked , and the touch panel, coding pattern layer is a program that is installed executed by a computer apparatus to which the display of the display device is transparent so configured so as to be seen, performs processing of the input by the touch operation to the touch panel, the The computer device is caused to function as a processing unit that performs an input process based on information about the coding pattern received from an electronic pen , and the processing unit detects the input to the touch panel and then performs the coding for a predetermined time width. The electronic pen that has not received information about the pattern Determines whether it has received the information about al the encoded pattern, if it is determined that it has received the information, characterized in that it does not perform the processing of the input to the touch panel.

According to another aspect of the program of the present invention, an electronic pen that reads an encoded pattern and generates information related to the encoded pattern and an encoded pattern layer on which the encoded pattern that can be read by the electronic pen is formed are stacked. A touch panel that detects a touch operation by a user, a computer device that can communicate with the electronic pen and the touch panel, and a projector that projects a display screen based on an image signal transmitted from the computer device onto the touch panel. A program that is mounted on and executed by the computer device of the input system, and that performs input processing by touch operation on the touch panel and performs input processing based on information related to the coding pattern received from the electronic pen As a processing means, Made to function over data device, the processing means, after detecting the input to the touch panel, for a predetermined time width, receives the information about the coded pattern from the electronic pen is not received information about the coding pattern If it is determined whether or not the information has been received, input processing to the touch panel is not performed .

  The computer apparatus according to the present invention can be configured by installing and functioning these programs in the computer apparatus.

  According to the present invention, the computer device does not perform input processing on the touch panel while receiving information on the coding pattern from the electronic pen, so the electronic pen is placed on the display device during input by the electronic pen. It is possible to prevent erroneous input of the touch panel due to the contact. At the same time, the computer device can prevent erroneous input due to the side portion of the hand holding the electronic pen being in contact with the display device during input with the electronic pen.

It is a system configuration figure of the input system in a 1st embodiment. It is the schematic which shows the structure of a display apparatus. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a flowchart which shows the processing flow in 1st Embodiment. It is a system configuration figure of an input system concerning modification 1 of a 1st embodiment. It is a system configuration figure of the input system in a 2nd embodiment. It is the figure shown about the restriction | limiting range set in 2nd Embodiment. It is a flowchart which shows the processing flow in 2nd Embodiment. It is a figure for demonstrating the specific example of the process of the flowchart of FIG.

  Hereinafter, a first embodiment and a second embodiment, which are embodiments of the present invention, will be described in order with reference to the drawings.

<First Embodiment>
First, a first embodiment according to the present invention will be described.

[Configuration of input system]
FIG. 1 shows a configuration of an input system according to the first embodiment. As shown in FIG. 1, the input system includes an electronic pen 1 used by a user, a computer device 2 that receives and processes information from the electronic pen 1 and the display device 3, and a display device 3 connected to the computer device 2. And comprising. As will be described later, the input system performs predetermined processing in accordance with input based on the electronic pen 1 (also referred to as “electronic pen input”) and input based on the touch panel 34 (also referred to as “touch panel input”). .

(Display device)
FIG. 2 shows a configuration of the display device 3 according to the first embodiment. As shown in FIG. 2, the display device 3 has a multilayer structure, and in order from the upper layer, a dot pattern overlayer (dot pattern forming layer) (also simply referred to as “DOL”) 30, a touch panel 34, and a display panel 35.

  The DOL 30 is disposed on the uppermost layer of the display device 3. The DOL 30 is an ink containing a material (titanium oxide, cholesteric liquid crystal, infrared reflective pigment, etc.) that reflects infrared rays so that it can be read by the electronic pen 1 on a base film 33 that is a transparent resin substrate such as polyethylene terephthalate. Thus, a dot pattern (coded pattern) 32 is printed, and the layer structure is further protected by a protective layer 31 such as a transparent EB cured resin. Here, the dot pattern 32 is printed with a material that reflects infrared rays. Even when visible light of various colors is emitted from the display panel 35 below the DOL 30, the dot pattern 32 is printed with good contrast by the electronic pen 1. This is because it is desirable to recognize 32. The DOL 30 is an example of the “coded pattern layer” in the present invention.

  A touch panel 34 is bonded to the back surface of the DOL 30. The touch panel 34 detects a contact position on the DOL 30. The touch panel 34 is, for example, a resistive touch panel, an ultrasonic touch panel, an optical touch panel, a capacitive touch panel, or the like.

  The configuration of the display device 3 to which the present invention is applicable is not limited to the configuration of FIG. Instead, the display device 3 is provided with an infrared reflecting layer between the dot pattern 32 and the base film 33 or between the base film 33 and the touch panel 34, and the dot pattern 32 absorbs infrared rays. The structure printed with the ink containing carbon may be sufficient.

(Dot pattern)
Next, the dot pattern (coded pattern) 32 will be described with reference to FIGS. The dot pattern is based on the system of Anoto. FIG. 3 is a diagram for explaining the relationship between the dots of the dot pattern 32 and the values to which the dots are converted. As shown in FIG. 3, each dot of the dot pattern 32 is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the DOL 30 are determined by the combination of the information thus associated.

  FIG. 4A shows an arrangement of a certain dot pattern 32. As shown in FIG. 4A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained no matter where 6 × 6 dots are taken on DOL 30. . The dot pattern 32 formed by these 36 dots holds the position coordinates (for example, the position on the DOL 30 where the dot pattern 32 is located). FIG. 4B is a diagram in which each dot shown in FIG. 4A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of the dot pattern 32.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 5 is a schematic view showing the structure of the electronic pen 1. As shown in FIG. 5, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real-time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 on the DOL 30 and enters a stroke (handwritten stroke). Here, the pen tip portion 103 of the electronic pen 1 that first contacts the DOL 30 is referred to as pen-down, and the pen tip portion 103 leaving the contacted (contacted) state is referred to as pen-up. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying power to each component in the electronic pen 1, and is configured to turn on / off the power of the electronic pen 1 itself by, for example, detaching a cap (not shown) of the electronic pen 1. You may let them. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen point unit 103 when the user writes or taps a character or mark on the DOL 30 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when a user writes a character or the like on the DOL 30 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated. Then, the communication unit 111 associates pen-down information detected by the pressure sensor 107 with identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later, and transmits the information to the computer apparatus 2 as entry information. To do. When the user finishes entering one stroke and releases the electronic pen 1 from the DOL 30, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 with the pen ID, and transmits it to the computer apparatus 2 as entry information.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the DOL 30. The region is slightly deviated from the position where the pen tip 103 contacts the DOL 30. The CMOS camera 106 is provided with an infrared filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 images a dot pattern 32 in an area illuminated by the LED 105, and image data of the dot pattern 32 is captured. Is supplied to the processor 108. Here, since the ink material of dots reflects infrared rays, the infrared rays irradiated by the LED 105 are reflected by the dots. Therefore, the dot portion has a relatively large amount of infrared reflection, and the portion other than the dot has a relatively small amount of infrared reflection. By photographing with the CMOS camera 106, a dot area and other areas can be distinguished by providing a threshold value based on the difference in the amount of reflected infrared light. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 4A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The processor 108 performs X and Y coordinates (hereinafter simply referred to as “coordinate data”) in the DOL 30 of the stroke (handwriting) to be entered by the user from the dot pattern 32 of the image data supplied by the CMOS camera 106 during the user's entry. Or, it is also called “coordinate information”). That is, the processor 108 converts the image data of the dot pattern 32 as shown in FIG. 4A supplied by the CMOS camera 106 into the data array shown in FIG. Convert to Y coordinate bit value and calculate X, Y coordinate data from the data array by a predetermined calculation method. The processor 108 has a rotation correction processing function for correcting the arrangement of dots caused by the inclination of the electronic pen 1 facing the dot pattern. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. Since the 6 × 6 dot pattern 32 in the DOL 30 does not overlap in the DOL 30, when the user enters characters or the like with the electronic pen 1, the processor determines which position in the DOL 30 the entered position corresponds to. It can be specified by coordinate calculation by 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, time information (time stamp), writing pressure data, and X and Y coordinate data, and transmits them to the computer apparatus 2 as entry information. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark). Here, one or a plurality of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the computer device 2 is stored as stroke information by the computer device 2. In other words, one stroke is made up of one or a plurality of X, Y coordinates (coordinate points), and the computer apparatus 2 can use one or a plurality of pieces constituting one stroke based on the pen-down information and the pen-up information. Recognize coordinate attribute information. As described above, a set of coordinate attribute information generated by the electronic pen 1 when the user enters one stroke is referred to as “stroke information”. The pen tip 103 is made of a material such as plastic or stainless steel. The pen tip portion 103 does not have ink, and transmits pen pressure to the pressure sensor 107 via the pen portion 104.

  The electronic pen 1 may be used as a ballpoint pen by loading an ink cartridge in the pen unit 104. In addition, the electronic pen 1 transmits entry information to the computer apparatus 2 by wireless transmission. However, the electronic pen 1 is not limited thereto, and may be connected to the computer apparatus 2 by wire and transmit entry information to the computer apparatus 2 by wire transmission. .

  In addition, preferably, when the CMOS camera 106 recognizes the dot pattern 32, the electronic pen 1 determines whether the dot pattern 32 is formed of an infrared reflecting material or an infrared absorbing material, and the determination is made. The dot pattern 32 reading program may be switched based on the above. Specifically, the electronic pen 1 first performs a binarization process on the image captured by the CMOS camera 106 using a predetermined threshold, and the infrared reflection region and the infrared absorption from the binarized image. The area is discriminated, and the magnitude relation between the area of the infrared reflection area and the area of the infrared absorption area is compared. The electronic pen 1 performs a negative / positive inversion process on the binarized image when the infrared absorption area is larger than the infrared reflection area, and performs a negative / positive inversion process when the negative / positive inversion process is performed. The dot pattern 32 is recognized based on the obtained image, and when the negative / positive inversion process is not performed, the dot pattern 32 is recognized based on the binarized image. Accordingly, it is possible to appropriately recognize both the dot pattern 32 printed with the infrared absorbing ink and the dot pattern 32 printed with the infrared reflective ink.

(Computer device)
Next, the computer apparatus 2 will be described again with reference to FIG. The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a mouse and a keyboard. The computer device 2 may be configured by a PC (personal computer) including the display device 3 as a display unit, a tablet PC such as iPad (registered trademark), a PDA (Personal Data Assistance), or the like. As shown in FIG. 1, the computer device 2 functionally includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, and a storage unit 25. The computer apparatus 2 performs predetermined processing based on the entry information received from the electronic pen 1 and the input information received from the touch panel 34 (also referred to as “touch panel input information”).

  The receiving means 22 is constituted by an antenna receiving circuit or the like, receives entry information from the electronic pen 1 and transmits it to the processing means 24. Further, the computer apparatus 2 converts a coordinate system (also referred to as “DOL coordinate system”) related to the dot pattern 32 formed on the DOL 30 into a coordinate system (also referred to as “display coordinate system”) related to the display panel 35. And a calibration processing function for obtaining a second coordinate conversion function for converting a coordinate system (also referred to as “touch panel coordinate system”) applied to the touch panel 34 to a display coordinate system. ing. Furthermore, when the computer apparatus 2 receives the data of the DOL coordinate system using the first coordinate conversion function obtained by the calibration process, the computer apparatus 2 converts the data into the data of the display coordinate system and draws a stroke. When touch panel coordinate system data is received using a function for performing a predetermined process and the second coordinate conversion function, the data is converted into display coordinate system data, and predetermined processes such as icon selection are performed. It has a function.

  The processing means 24 is constituted by a processor such as a CPU and controls the entire computer apparatus 2. Specifically, the processing unit 24 transmits the image signal generated by the computer apparatus 2 to the display panel 35 and displays an image corresponding to the image signal. The processing unit 24 stores the first coordinate conversion function and the second coordinate conversion function obtained by the calibration processing function in the storage unit 25.

  When the computer device 2 receives the entry information from the electronic pen 1, the first coordinate conversion means 241 of the processing means 24 converts the coordinate data included in the entry information, which is DOL coordinate system data, into a first coordinate conversion function. To convert to display coordinate system data. Then, the processing means 24 recognizes that the position written by the electronic pen 1 is the dot pattern 32 of the DOL 30 based on the converted coordinate data. The processing unit 24 stores the converted coordinate data in the storage unit 25, displays a stroke based on the converted coordinate data or the like on the display panel 35, or displays a folder or application at a position corresponding to the stroke. If the icon is displayed, processing such as selection of the icon is performed.

  When the computer apparatus 2 receives touch panel input information from the touch panel 34, the second coordinate conversion unit 242 of the processing unit 24 uses the second coordinate conversion function to convert the coordinate data of the touch panel coordinate system indicated by the touch panel input information, using the second coordinate conversion function. Convert to display coordinate system data. Then, when an icon such as a folder or an application is displayed on the coordinate data after conversion in the image being displayed on the display panel 35, the processing means 24 performs processing such as selection of the icon.

  The touch panel function switching unit 243 of the processing unit 24 turns off the input function of the touch panel 34 while the computer apparatus 2 receives the entry information from the electronic pen 1. In this case, the touch panel function switching unit 243 may transmit a control signal to the touch panel 34 so that the touch panel 34 is in a stopped state while receiving the entry information from the electronic pen 1, or during this period. The touch panel input information transmitted from the touch panel 34 may be discarded without being processed by the processing means 24. On the other hand, when the computer apparatus 2 has not received entry information from the electronic pen 1, the touch panel function switching unit 243 turns on the input function of the touch panel 34.

  The storage unit 25 is configured by a memory such as a ROM or a RAM. The storage means 25 stores the first coordinate conversion function and the second coordinate conversion function. In addition, the storage unit 25 stores the entry information received from the electronic pen 1 for each pen ID or the predetermined data generated by the execution of the program according to the processing instruction of the processing unit 24.

[Processing flow]
Next, a processing flow based on touch panel input detection in the input system of the first embodiment will be described. The processing flow shown in FIG. 6 is repeatedly executed every time the computer apparatus 2 receives touch panel input information from the touch panel 34.

  When the touch panel 34 detects a contact on the DOL 30, the touch panel 34 transmits touch panel input information to the computer apparatus 2. Thereby, the processing means 24 of the computer apparatus 2 detects that there was a touch panel input (step S101).

  Next, the processing means 24 determines whether or not entry information is received from the electronic pen 1 (step S102). Accordingly, the processing unit 24 determines whether or not the detection of the touch panel input in step S101 is based on the contact on the DOL 30 of the electronic pen 1 during the electronic pen input. Note that when the electronic pen 1 is downed, the touch panel input detection timing is earlier than the timing at which the computer apparatus 2 receives the entry information due to the time for the electronic pen 1 to generate the entry information. . Therefore, the processing means 24 determines whether or not entry information is received from the electronic pen 1 for a predetermined time width corresponding to the above-described timing difference (time lag) after the execution of step S101.

  If it is determined that the entry information is received (step S102; Yes), the processing unit 24 causes the storage unit 25 to store the entry information for each pen ID (step S103). Next, the processing means 24 determines whether or not the input function of the touch panel 34 has already been turned off (step S104). When it is determined that the input function of the touch panel 34 is on (step S104; No), the input function of the touch panel 34 is turned off (step S105). On the other hand, when it is determined that the input function of the touch panel 34 has already been turned off (step S104; Yes), the processing unit 24 does not perform the process of step S105, and advances the process to step S106 while maintaining the off state. .

  Next, the processing means 24 converts the coordinate information of the DOL coordinate system included in the received entry information into the coordinate information of the display coordinate system using the first coordinate conversion function stored in the storage means 25 (step S106). Then, the processing means 24 performs electronic pen input processing (step S107). For example, based on the converted coordinate information, the processing unit 24 draws the stroke that has been entered on the image that is currently displayed by the display panel 35, and updates the display on the display panel 35. The image is updated and stored in the storage means 25.

  Next, the processing means 24 determines whether or not entry information has been received from the electronic pen 1 (step S108). If it is determined that the entry information has been received (step S108; Yes), the processing unit 24 continues the process of step S103 and performs the process based on the entry information. On the other hand, when it is determined that the entry information has not been received (step S108; No), the processing unit 24 turns the input function of the touch panel 34 back on (step S109). And the process means 24 complete | finishes the process of a flowchart.

  On the other hand, if it is determined in step S102 that the entry information has not been received (step S102; No), the processing unit 24 detects that the detected touch panel input is a contact on the DOL 30 of the electronic pen 1 during the electronic pen input. It is determined that there is no erroneous input based on this, and touch panel input processing is performed (step S110). Specifically, the processing unit 24 converts the coordinate data of the touch panel coordinate system indicated by the touch panel input information received from the touch panel 34 into the data of the display coordinate system using the second coordinate conversion function. Then, when an icon such as a folder is displayed on the coordinate data after conversion in the image currently displayed on the display panel 35, the processing means 24 performs processing such as selection of the folder.

[Operational effects of the input system of the first embodiment]
According to the input system of the first embodiment, the computer apparatus 2 turns off the input function of the touch panel 34 while receiving entry information from the electronic pen 1. Thereby, the computer apparatus 2 prevents erroneous detection of touch panel input due to the pen tip of the electronic pen 1 coming into contact with the DOL 30 during input by the electronic pen 1, and unintentionally a finger or electronic Even if the side portion of the hand holding the pen 1 contacts the DOL 30, erroneous detection of touch panel input can be prevented. Further, the computer device 2 switches the input function of the touch panel 34 on and off based on whether or not the entry information of the electronic pen 1 is received. Thereby, the input system can prevent erroneous input of the touch panel input while minimizing the period during which the touch panel input is turned off.

[Modification of First Embodiment]
Next, a modification of the first embodiment will be described. The following modifications may be applied in any combination to the first embodiment described above.

(Modification 1)
In FIG. 1 and FIG. 2, the DOL 30 and the touch panel 34 are stacked on the display panel 35. However, the configuration of the input system to which the present invention is applicable is not limited to this.

  FIG. 7 is a system configuration diagram of an input system according to Modification 1 of the first embodiment. As shown in FIG. 7, the input system according to the first modification of the first embodiment includes a projector 4 that projects the same image as the display screen of the display of the computer device 2 onto the DOL 30. Further, the DOL 30 and the touch panel 34 are stacked and disposed at a position away from the display of the computer apparatus 2. The touch panel 34 is connected to the computer device 2 and transmits touch panel input information to the computer device 2. Although the projector 4 shown in FIG. 7 is a front projector, it may be a rear projector. In addition, an imaging diffusion layer for imaging and diffusing the projected light may be adopted as a layer constituting the DOL 30 or the touch panel 34, or an imaging diffusion layer may be laminated separately from the DOL 30 and the touch panel 34.

  As described above, even when the DOL 30 and the touch panel 34 are not stacked on the display, the processing unit 24 of the computer apparatus 2 stores the coordinate information of the DOL coordinate system included in the entry information received from the electronic pen 1. Using the first coordinate conversion function stored by the means 25, the coordinate information of the display coordinate system is converted. Further, the processing unit 24 converts the coordinate information of the touch panel coordinate system indicated by the touch panel input information received from the touch panel 34 into the coordinate information of the display coordinate system using the second coordinate conversion function stored by the entry unit 25. . The processing unit 24 limits the input function of the touch panel 34 while receiving entry information from the electronic pen 1.

  Also with this configuration, the input system preferably accepts the electronic pen input and the touch panel input by the user's finger, and the touch panel resulting from the electronic pen 1 coming into contact with the DOL 30 during the input by the electronic pen 1. It is possible to prevent erroneous detection of input.

(Modification 2)
In the first embodiment, the Anoto coding pattern (dot pattern) is used. However, any coding pattern indicating position coordinates may be used, and the Anoto coding is not limited.

Second Embodiment
Next, a second embodiment will be described. FIG. 8 is a system configuration diagram of an input system according to the second embodiment. In the second embodiment, the processing unit 24 is different from the first embodiment in that the processing unit 24 includes a touch panel function limiting unit 244 that limits the period and range of invalidating the touch panel input instead of the touch panel function switching unit 243. In addition, about the part similar to 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted suitably.

  The touch panel function restriction unit 244 of the processing unit 24 is within a predetermined range from the pen tip position (also referred to as “electronic pen input position”) of the electronic pen 1 while the computer apparatus 2 receives the entry information from the electronic pen 1. The input function of the touch panel 34 is turned off. Then, when the electronic pen input position changes, the processing unit 24 determines a range in which the input function of the touch panel 34 is turned off based on the changed electronic pen input position. Hereinafter, a range in which the input function of the touch panel 34 is turned off based on the electronic pen input position is also referred to as a “restricted range Wr”.

  Specific processing of the touch panel function limiting unit 244 will be further described with reference to FIG. FIG. 9 is an example of a display screen of the display device 3 in the second embodiment.

  In FIG. 9, the user touches the pen tip portion 103 of the electronic pen 1 on the DOL 30. In this case, the processing unit 24 converts the coordinate data included in the entry information received from the electronic pen 1 into coordinate data in the display coordinate system using the first coordinate conversion function, and the position of the coordinate data is converted to the electronic pen. Determine the input position. Then, the processing unit 24 determines a circular area having a radius R centered on the electronic pen input position as the limit range Wr, turns off the input function of the touch panel 34 in the limit range Wr, and sets the area outside the limit range Wr. The input function of the touch panel 34 is turned on. Specifically, while the entry information is received from the electronic pen 1, the processing unit 24 uses the touch panel coordinate system coordinate data included in the touch panel input information transmitted from the touch panel 34 to be converted by the second coordinate conversion unit 242. When the second coordinate conversion function is used to convert to display coordinate system data, it is determined whether or not the converted coordinate data is included in the limited range Wr. If it is determined that the coordinate data is included in the limited range Wr, the processing unit 24 discards the coordinate data without performing touch panel input processing. On the other hand, when it is determined that the coordinate data is not included in the restriction range Wr, the processing unit 24 performs touch panel input processing. When entry information is generated by a plurality of electronic pens 1 at the same time, the limit range Wr is obtained in parallel for each electronic pen 1. That is, a plurality of limit ranges Wr are defined on the touch panel 34. The radius R described above is set to 10 to 15 cm, for example. Specifically, when performing input with the electronic pen 1 on the DOL 30, the maximum distance from the electronic pen input position to a position where the side portion of the hand holding the electronic pen 1 may contact on the DOL 30 Is determined in advance through experiments or the like, and the radius R is determined as the maximum distance.

  Further, when the electronic pen input position changes, the processing unit 24 newly sets a limit range Wr based on the changed electronic pen input position, and turns off the input function of the touch panel 34 in the range. Therefore, while the stroke is drawn by the electronic pen 1, the limit range Wr also moves as the electronic pen input position moves. Further, when receiving the entry information from the plurality of electronic pens 1, the processing unit 24 provides a limit range Wr corresponding to each electronic pen 1. Specifically, in this case, the processing unit 24 specifies each electronic pen input position based on the entry information of each electronic pen 1 and determines the limit range Wr based on the electronic pen input position. In this case, the limited range Wr is an area on the DOL 30 that is a combination of circular areas with a radius R centered on each electronic pen input position.

[Processing flow]
Next, a processing flow based on touch panel input detection in the input system of the second embodiment will be described. The processing flow shown in FIG. 10 is repeatedly executed every time the computer apparatus 2 receives touch panel input information from the touch panel 34. In addition, when a plurality of touch panel input detections based on contact of the electronic pen 1 are generated in parallel by the entry information generated by the plurality of electronic pens 1 at the same time, the processing flow shown in FIG. Run in parallel.

  When the touch panel 34 detects contact on the DOL 30, the touch panel input information is transmitted to the computer apparatus 2. Thereby, the processing means 24 of the computer apparatus 2 detects that there was a touch panel input (step S201).

  Next, the processing unit 24 converts the coordinate information of the touch panel coordinate system indicated by the received touch panel input information into the coordinate information of the display coordinate system using the second coordinate conversion function stored in the storage unit 25 (step) S202). Then, the processing unit 24 determines whether or not the converted coordinate information is within the limit range Wr (step S203), and determines that the converted coordinate information is within the limit range Wr (step S203; Yes). ), The touch panel input process is not performed, and the process of the flowchart is terminated.

  On the other hand, when it determines with the coordinate information after conversion not being in the restriction | limiting range Wr (step S203; No), the process means 24 determines whether entry information was received from the new electronic pen 1 (step S204). That is, the processing unit 24 determines whether or not entry information has been received from a new electronic pen 1 separately from the electronic pen 1 corresponding to the limit range Wr determined immediately before. Accordingly, the processing unit 24 determines whether or not the detection of the touch panel input in step S201 is based on the contact on the DOL 30 of the electronic pen 1 during the electronic pen input. Here, for example, the processing unit 24 may determine whether or not the entry information is received from the new electronic pen 1 based on the pen ID included in the entry information, and whether or not the entry information includes pen-down information. It may be determined whether entry information has been received from the new electronic pen 1 based on the above.

  Further, when the electronic pen 1 is downed, the touch panel input detection timing is earlier than the timing at which the input information is received due to the time for the electronic pen 1 to generate the input information. Therefore, the processing means 24 determines whether or not entry information has been received from the new electronic pen 1 in step S204 within a predetermined time width considering the time lag of the above timing after execution of step S201.

  If it is determined that the entry information is received from the new electronic pen 1 (step S204; Yes), the processing unit 24 causes the storage unit 25 to store the entry information for each pen ID (step S205). . Next, the processing means 24 converts the coordinate information of the DOL coordinate system included in the received entry information into the coordinate information of the display coordinate system using the first coordinate conversion function stored in the storage means 25 (step S206). Then, the processing means 24 determines the electronic pen input position based on the converted coordinate information, and turns off the input function of the touch panel 34 within a predetermined range from the electronic pen input position (step S207). Specifically, the processing means 24 defines a circular area having a radius R centered on the electronic pen input position as the limit range Wr. Then, the processing unit 24 performs electronic pen input processing (step S208).

  Next, the processing means 24 determines whether or not entry information is continuously received from the same electronic pen 1 as the electronic pen 1 subjected to the electronic pen input process in step S208 (step S209). If it is determined that entry information has been received from the same electronic pen 1 (step S209; Yes), the processing unit 24 proceeds to step S205 and performs processing based on the entry information.

  On the other hand, when it is determined that the entry information has not been received from the same electronic pen 1 (step S209; No), the processing unit 24 uses the electronic pen of the electronic pen 1 that has been the target of a series of electronic pen input processes. The restriction on the input function of the touch panel 34 based on the input position is released (step S210). And the process means 24 complete | finishes the process of a flowchart. If there is another electronic pen 1 that has received the entry information, the processing means 24 continues to execute the processing flow shown in FIG. 10 to start from the electronic pen input position of the other electronic pen 1. The input function of the touch panel 34 in the circular area with the radius R is turned off.

  On the other hand, when it is determined in step S204 that entry information has not been received from the new electronic pen 1 (step S204; No), the processing unit 24 detects that the detected touch panel input is the electronic pen 1 that is being input. It is determined that there is no erroneous input based on contact on the DOL 30, and touch panel input processing is performed (step S211). Specifically, the processing unit 24 converts the coordinate data of the touch panel coordinate system indicated by the touch panel input information received from the touch panel 34 into the data of the display coordinate system using the second coordinate conversion function. Then, when an icon such as a folder is displayed on the coordinate data after conversion in the image currently displayed on the display panel 35, the processing means 24 performs processing such as selection of the folder.

[Concrete example]
Next, a specific example of the process shown in the flowchart of FIG. 10 will be described in more detail with reference to FIG. FIG. 11 is a schematic diagram when a plurality of users (Mr. A, Mr. B, Mr. C, and Ms. D) perform input on the display device 3 in the second embodiment. In the following, it is assumed that Mr. A uses the electronic pen 1A with the pen ID “pen01”, Mr. B uses the electronic pen 1B with the pen ID “pen02”, and inputs sequentially from Mr. A. It is assumed that the limit range Wr is not provided.

  First, Mr. A holds the electronic pen 1 </ b> A and performs pen-down on the DOL 30 to perform writing. Thereby, the computer apparatus 2 detects touch panel input by the touch panel 34 (refer step S201), and receives the entry information produced | generated by pen down from the electronic pen 1A. Since the computer apparatus 2 does not yet have the restriction range Wr, the coordinate information (see step S202) converted from the touch panel coordinate system to the display coordinate system is not within the restriction range Wr (see step S203; No). It is determined that the entry information has been received from the new electronic pen 1 (see step S204), and the coordinate information of the DOL coordinate system included in the received entry information is converted into the coordinate information of the display coordinate system using the first coordinate transformation function. (Refer to step S206), the electronic pen input position of the electronic pen 1A is determined based on the converted coordinate information, and the range of the radius R from the electronic pen input position is determined as the limited range Wra as the limited range Wr (step S207). reference). And the computer apparatus 2 performs the electronic pen input process of the electronic pen 1A (refer step S208). When the electronic pen input position changes, the computer apparatus 2 updates the limit range Wr based on the changed electronic pen input position.

  Next, Mr. B holds the electronic pen 1B and performs writing on the DOL 30 by pen-downing at a position separated from the electronic pen input position of the electronic pen 1A by a distance R or more. Thereby, the computer apparatus 2 detects a touch panel input with the touch panel 34 (refer step S201), and receives the entry information produced | generated with pen down from the electronic pen 1B. And the computer apparatus 2 is based on the touch panel input information received from the touch panel 34, the position which detected the touch panel input is outside the limit range Wr (step S203; refer to No), and the entry information from the new electronic pen 1 is input. It is determined that it has been received (see step S204; Yes), the electronic pen input position of the electronic pen 1B is determined based on the received entry information, and the range of radius R from the electronic pen input position is added to the limit range Wr as the limit range Wrb. (See step S207). And the computer apparatus 2 performs the electronic pen input process of the electronic pen 1B (refer step S208).

  Next, Mr. C brings his finger into contact with a position other than the limit range Wr on the DOL 30. Thereby, the computer apparatus 2 detects a touch panel input by the touch panel 34 (refer step S201). Thereafter, the computer device 2 does not have the detected position within the limit range Wr (step S203; see No), and has not received the entry information from the new electronic pen 1 (step S204; see No). Input processing is performed (see step S211).

  Furthermore, Mr. D brings his finger into contact with the position on the DOL 30 and within the limited range Wra (Wr). Thereby, the computer apparatus 2 detects a touch panel input by the touch panel 34 (refer step S201). However, the computer apparatus 2 determines that the detected position is within the limited range Wra (Wr) (see step S203) and does not perform touch panel input processing.

[Operational effects of the input system of the second embodiment]
According to the input system of the second embodiment, the computer device 2 turns off the input function of the touch panel 34 in a predetermined range from the electronic pen input position while the input with the electronic pen 1 is being performed. Thereby, the input system can prevent erroneous input to the touch panel 34 due to the electronic pen 1 abutting on the DOL 30 during input by the electronic pen 1. Furthermore, the input system can prevent an erroneous input due to an unintended contact of the side portion of the hand holding the electronic pen 1 with the DOL 30 during the input with the electronic pen 1.

  Further, the computer device 2 turns off the input function of the touch panel 34 only within a predetermined range based on the electronic pen input position, thereby causing an error caused by the electronic pen 1 abutting on the DOL 30 during the electronic pen input. It is possible to effectively process an intended touch panel input by a finger of one hand or a finger of another user while preventing the input. Therefore, 2nd Embodiment is applied suitably also when the display apparatus 3 has a large sized screen and a touch panel input is performed by several people.

[Modification of Second Embodiment]
Next, a modification of the second embodiment will be described. In the second embodiment, the modification example of the first embodiment and the modification examples described below can be applied in any combination.

(Modification 3)
In the description of FIG. 9, the processing unit 24 sets the circular area having the radius R from the electronic pen input position as the limited range Wr, but the method of setting the limited range Wr is not limited to this. Instead of this, for example, the processing means 24 may determine an area of a predetermined shape other than an ellipse or other circles as the limit range Wr based on the electronic pen input position. At this time, it is preferable that the area opposite to the dominant hand of the user who uses the electronic pen 1 is not limited. The dominant hand of the user may be stored in the storage unit 25 in association with the pen ID of the electronic pen 1 used in advance, or the electronic pen 1 is provided with an angle sensor or the distortion of the dot pattern 32 taken by the electronic pen 1. The tilt of the electronic pen 1 may be obtained from the shape, and the tilt information may be included in the entry information.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 3 ... Display apparatus 4 ... Projector 21 ... Input means 22 ... Reception means 24 ... Processing means 25 ... Storage means 30 ... DOL
34 ... Touch panel 35 ... Display panel

Claims (4)

A display device in which a touch panel that detects a touch operation by a user and a coding pattern layer on which a coding pattern that can be read by an electronic pen is formed are stacked ;
Processing means for performing input processing by touch operation on the touch panel and performing input processing by information on the coding pattern received from the electronic pen ;
The processing means determines whether or not information on the coding pattern has been received from the electronic pen that has not received information on the coding pattern for a predetermined time width after detecting input to the touch panel, If it is determined that the information has been received , the computer device does not perform input processing on the touch panel . An electronic pen that reads the coding pattern and generates information about the coding pattern;
A touch panel for detecting a touch operation by a user, in which a coding pattern layer in which a coding pattern readable by the electronic pen is formed is laminated,
A computer device capable of communicating with the electronic pen and the touch panel;
A projector that projects a display screen based on an image signal transmitted from the computer device onto the touch panel;
The computer device includes:
A processing unit that performs an input process by a touch operation on the touch panel and performs an input process by information on the coding pattern received from the electronic pen ,
The processing means determines whether or not information on the coding pattern has been received from the electronic pen that has not received information on the coding pattern for a predetermined time width after detecting input to the touch panel, If it is determined that the information has been received , the input system does not perform input processing on the touch panel . A touch panel that detects a touch operation by a user and a display device in which a coding pattern layer on which a coding pattern that can be read by an electronic pen is formed are stacked , and the touch panel and the coding pattern layer include: A program installed and executed in a computer device configured to be transparent so that the display on the display device can be visually recognized,
In addition to performing input processing by touch operation on the touch panel, the computer apparatus functions as processing means for performing input processing according to information on the coding pattern received from the electronic pen ,
The processing means determines whether or not information on the coding pattern has been received from the electronic pen that has not received information on the coding pattern for a predetermined time width after detecting input to the touch panel, When it is determined that the information has been received , a program for not performing input processing on the touch panel . An electronic pen that reads the coding pattern and generates information about the coding pattern;
A touch panel for detecting a touch operation by a user, in which a coding pattern layer in which a coding pattern readable by the electronic pen is formed is laminated,
A computer device capable of communicating with the electronic pen and the touch panel;
A projector that projects a display screen based on an image signal transmitted from the computer device onto the touch panel, and is installed in and executed by the computer device of the input system,
In addition to performing input processing by touch operation on the touch panel, the computer apparatus functions as processing means for performing input processing according to information on the coding pattern received from the electronic pen ,
The processing means determines whether or not information on the coding pattern has been received from the electronic pen that has not received information on the coding pattern for a predetermined time width after detecting input to the touch panel, When it is determined that the information has been received , a program for not performing input processing on the touch panel .

Images