JP2011013872A - Information processing system and program thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system and a program thereof, for achieving high-accuracy positioning in calibration with position coordinates on a display screen in the display means of a computer device.SOLUTION: An information processing system 10 is provided with: a screen 4 on which a coded pattern showing position coordinates is formed; a reading means 1 for reading the coded pattern; a computer device 2 for receiving information on the coded pattern transmitted from the reading device 1, and for performing processing corresponding to the information; and a projector 3 for receiving an image signal from the computer device 2, and for projecting an image on the screen 4. The image of a mark for calibration is projected on the screen 4, and the position coordinates of a pen-up after the contact of an electronic pen 1 on the mark for calibration are determined from the information received by the reception means, and the position coordinates of the pen-up are used for calibration.

Description

  The present invention relates to an information processing system capable of inputting information using a coded pattern indicating position coordinates, and in particular, alignment (calibration) between the position coordinates of a coded pattern and the position coordinates of a display screen of a computer device. ) Regarding processing.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto pen” developed by Swedish company Anoto is known as a representative example. Anotopen is used together with special paper on which a dot pattern indicating a position coordinate patterned by a predetermined algorithm is printed. Anotopen has a small camera for imaging the dot pattern printed on the dedicated paper at the pen tip, a processor for calculating the position coordinates on the dedicated paper from the captured dot pattern, and the calculated position coordinates etc. It is equipped with a data communication unit that transmits to. When the user writes characters etc. on the special paper with an anoto pen or puts a check mark on the image designed on the special paper, the small camera captures the dot pattern printed on the special paper as the pen moves. The entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen to a nearby personal computer, a mobile phone or other terminal device by the data communication unit (see, for example, Patent Document 1).

  In addition, using such an electronic pen, a computer, a projector, and a screen, when the screen is filled in or scanned with the electronic pen, the computer performs a predetermined process accordingly and projects the computer display screen onto the screen with the projector. The system which performs is proposed (for example, patent documents 2-5). The electronic pen reads the dot pattern formed on the screen, and the computer analyzes the position coordinates based on the information transmitted from the electronic pen and performs processing according to the position coordinates. Even if an electronic pen without ink is used, if you trace the screen with an electronic pen, you can project an image with lines drawn from the projector, control the image, and operate software. It is supposed to be possible.

  Also, the computer screen is projected on the whiteboard by the projector, and the coordinates entered with the markers on the whiteboard are read with the coordinate reader using ultrasonic or infrared rays and sent to the computer, so that the user clicks on the computer screen. In a system capable of calibrating, it is also proposed to calibrate the coordinates of the whiteboard and the coordinates of the personal computer screen by first projecting a calibration point by a projector and instructing the point with a marker (patent) Reference 6).

  In addition, it has been proposed that a transparent sheet on which a dot pattern is printed is pasted on a computer display and handwritten on the transparent sheet with an electronic pen so that the dot pattern can be read with the electronic pen and handwritten on the computer. (For example, Patent Document 7). Furthermore, in order to calibrate the position coordinates in the computer display and the position coordinates in the dot pattern of the transparent sheet attached to the display, it is also proposed to read the dot pattern near the four corners of the display with an electronic pen. (Patent Document 8).

Japanese translation of PCT publication No. 2003-511761 JP 2008-152755 A JP 2002-149331 A JP 2008-155421 A Special table 2003-508831 gazette JP 2007-233999 A JP 2003-256122 A JP 2008-165384 A

  However, if the calibration process is not executed after the position coordinates on the screen or transparent sheet on which the dot pattern is formed and the position coordinates on the display screen of the display unit of the computer device are accurately associated, Even if you write on the screen or transparent sheet with a reading tool such as an electronic pen after processing, the handwriting written on the screen or transparent sheet is not aligned with the stroke that is drawn on the screen or transparent sheet by the computer device. End up.

  Therefore, the present invention provides high accuracy when performing calibration processing between the position coordinates of the screen or transparent sheet on which the coding pattern indicating the position coordinates is formed and the position coordinates on the display screen in the display means of the computer device. It is an object of the present invention to provide an information processing system and its program that can be aligned.

An information processing system according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and information on the coding pattern transmitted from the reading unit, An information processing system comprising a computer device that performs processing according to the information, and a projector that receives an image signal from the computer device and projects an image on the screen,
The computer device includes a receiving unit that receives information about the coding pattern transmitted from the electronic pen, and displays an image of a calibration mark on the screen, and the electronic pen makes contact with the calibration mark. The position coordinate of the pen-up after is calculated | required from the information received by the said receiving means, The process means which uses the position coordinate in the said pen-up for a calibration process is provided, It is characterized by the above-mentioned.

  According to this information processing system, when the coded pattern formed on the screen is read by the electronic pen, the electronic pen transmits information related to the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a screen, and receives information related to a coding pattern from an electronic pen. In such an information processing system, when an image of a calibration mark is displayed on the screen, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinate of the pen-up is obtained. The position coordinates in the pen-up are used for the calibration process. Therefore, after the user touches the calibration mark with the electronic pen, even if the pen tip deviates from the mark position, the pen tip is moved so that it matches the mark as much as possible before pen-up. Therefore, highly accurate calibration processing can be performed.

Alternatively, the information processing system according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and information related to the coding pattern transmitted from the reading unit. An information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to a display screen of a display unit of the computer device, and the computer device receives information related to a coding pattern transmitted from the electronic pen, and calibration for the transparent sheet. An image of the mark is projected from the display screen, and the position coordinate of the pen-up after contact with the calibration mark by the electronic pen is obtained from the information received by the receiving means, and the position coordinate in the pen-up is determined. And processing means used for calibration processing.

  According to this information processing system, when the coded pattern formed on the transparent sheet is read by the electronic pen, the electronic pen transmits information on the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a transparent sheet, and receives information related to a coding pattern from the electronic pen. In such an information processing system, when an image of a calibration mark is projected on the transparent sheet, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinates of the pen-up are obtained. The position coordinates in the pen-up are obtained and used for the calibration process. Therefore, the user can perform calibration processing with high accuracy by penning up the calibration mark after touching it with the electronic pen.

  In the information processing system, the processing means may be configured to have means for urging pen-up of the electronic pen at a reference point of the calibration mark when the image of the calibration mark is displayed. With this configuration, it is possible to perform pen-up on the calibration mark more easily.

  Further, in the information processing system, when the processing unit recognizes contact with the screen by the electronic pen two or more times within a predetermined range from the calibration mark, any one of the electronic It is preferable that the pen-up position coordinates of the contact with the pen are used for the calibration process. With this configuration, even when a writing error occurs with the electronic pen, it is possible to determine and store any of the acquired coordinates as the set coordinates, and perform a calibration process based on the determined coordinates.

Further, the program according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and information on the coding pattern transmitted from the reading unit, A program executed by the computer apparatus in an information processing system comprising: a computer apparatus that performs processing according to the information; and a projector that receives an image signal from the computer apparatus and projects an image on the screen. ,
After receiving information related to the coding pattern transmitted from the electronic pen by the receiving means, causing the image of the calibration mark to be projected on the projector on the screen, and after contacting the calibration mark with the electronic pen The position coordinate of the pen-up is obtained from the information received by the receiving means, and the position coordinate of the pen-up is used for the calibration process.

Alternatively, the program according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and information on the coding pattern transmitted from the reading unit. A program executed by the computer apparatus in an information processing system including a computer apparatus that performs processing according to the information,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. The position coordinate of the pen-up after the contact with the calibration mark by the electronic pen is obtained from the information received by the receiving means, and the position coordinate in the pen-up is used for calibration processing. It is made to use.

  The program may be configured to prompt the pen up of the electronic pen at the reference point of the calibration mark when the image of the calibration mark is displayed.

  Further, when the program recognizes contact with the screen by the electronic pen at least twice within a predetermined range from the calibration mark, the pen up of contact with the electronic pen at any one time is performed. The position coordinates may be used for the calibration process.

  By installing the program in a computer device, the computer device can be realized and an information processing system can be configured.

  According to the present invention, highly accurate calibration processing is performed between the position coordinates of a screen or a transparent sheet on which a coding pattern indicating position coordinates is formed and the position coordinates on the display screen of the display unit of the computer device. be able to.

It is a system configuration figure of the information processing system in a 1st embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a flowchart of the calibration starting process in 1st Embodiment. It is a flowchart of the calibration process in 1st Embodiment. It is a figure which shows the image of the mark for a calibration projected on the screen in 1st Embodiment. It is explanatory drawing which shows the mode of a pen-up. It is a figure which shows the position coordinate of the display reference point on the display screen of a computer apparatus. It is a figure shown about the same recognition range as the position coordinate of the recognition reference point on a screen. It is a figure which shows the stroke drawing in the screen after a calibration process. It is a flowchart of the calibration process in the modification of 1st Embodiment. It is a system configuration figure of the information processing system in the 2nd embodiment. It is an image which shows the mark for a calibration projected on the transparent sheet in 2nd Embodiment.

  Hereinafter, a preferred information processing system of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
[System configuration of information processing system]
FIG. 1 is a system configuration diagram of an information processing system 10 in the first embodiment. As shown in FIG. 1, an information processing system 10 according to the first embodiment includes an electronic pen 1 used by a user, a computer device 2 that receives and processes entry information from the electronic pen 1, and a computer device 2. The projector 3 is configured to project a display (display means) 26 onto the screen 4.

[screen]
First, the screen 4 will be described. The screen 4 has a sheet 402 having a dot pattern (coded pattern), which will be described later, formed on the entire surface by printing on the front surface of a magnet board (white board) 401 that is hard enough to apply sufficient pressure to the electronic pen 1 from above. They are pressed with a magnet, or pasted with glue, adhesive or adhesive. A wall surface of a room may be used instead of the magnet plate 401. Further, instead of the paper 402, a plastic sheet on which a dot pattern is printed may be used, or the dot pattern may be directly formed on a magnet plate (white board) 401. When the user writes a character or the like on the screen 4 with the electronic pen 1, the electronic pen 1 reads the dot pattern printed on the paper 402 locally and continuously along the movement locus of the pen tip portion. The coordinates of the local position are calculated, and the electronic data (entry information) is transmitted to the computer device 2. On the other hand, the projector 3 receives the image signal from the computer apparatus 2 and projects the same image as the image displayed on the display unit 26 onto the screen 4 in the area 403.

  An instruction sheet 5 on which a dot pattern is printed is pasted on the screen 4 as an input setting area (calibration instruction area) for performing calibration processing on the outside of the sheet 402. The instruction sheet 5 is not indispensable in the configuration of the screen 4 in advance and may be a seal or the like so that the user can arbitrarily attach it to the screen 4 or a notebook on hand later. Further, a part of the dot pattern area on the paper 402 may be defined as an input setting area for performing the calibration process.

  The input setting area represented by the instruction sheet 5 includes position coordinates defined by a dot pattern (coded pattern) on the sheet 402 of the screen 4 and position coordinates on the display screen (display) in the display unit 26 of the computer apparatus 2. This is an area for causing the computer apparatus 2 to execute the calibration process. Of course, a dot pattern is also printed in this input setting area. The instruction sheet 5 is provided outside the area 403 where an image is projected on the screen 4 by the projector 3 so as not to be mistaken for the entry (coordinate input) on the display screen of the computer apparatus 2. Then, the user can arbitrarily start the calibration process by instructing the instruction sheet 5 with the electronic pen 1.

  When the calibration process is executed in the computer apparatus 2, a coordinate input area 403 in which position coordinates corresponding to the display screen of the computer apparatus 2 can be accurately input on the screen 4 by the electronic pen 1 is defined. Definition information is stored in the storage means 25 of the computer apparatus 2.

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) printed on the sheet 402 of the screen 4 and the instruction sheet 5 will be described. FIG. 2 is a diagram illustrating the relationship between the dots of the dot pattern printed on the paper 402 and the values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. In other words, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical line and horizontal line). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the screen 4 are determined by the combination of information thus associated. This dot pattern is printed with an ink containing carbon that absorbs infrared rays.

  FIG. 3A shows an arrangement of dot patterns at a certain position. As shown in FIG. 3A, 6 × 6 dots are arranged within a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken on the screen 4. Yes. The dot pattern formed by these 36 dots holds relative position coordinates on the paper 402 and a dot pattern address (coded pattern address). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 1 will be described. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 against the sheet 402 of the screen 4 or the instruction sheet 5, and enters a stroke such as a character. Or tapping (tapping the screen 4 with the pen tip 103). Here, the first contact of the pen tip 103 of the electronic pen 1 with the paper 402 or the like is called pen-down, and the removal of the pen tip 103 from the contacted (contacted) state is called pen-up. . A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes. Since the electronic pen 1 is used for tapping or writing characters on the screen 4 projected by the projector 3, the pen unit 104 does not have to be filled with ink.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen tip unit 103 when the user writes or taps a character or mark on the screen 4 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor. To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when a user writes a character or the like on the screen 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated. Further, when the user finishes entering one stroke and moves the electronic pen 1 away from the screen 4, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the screen 4. The region is slightly shifted from the position where the pen tip portion 103 contacts the screen 4. The CMOS camera 106 captures a dot pattern in the area illuminated by the LED 105 and supplies image data of the dot pattern to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, by photographing with the CMOS camera 106, by setting a threshold value based on the difference in the amount of reflected infrared light, it is possible to distinguish the dot region containing carbon from the other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  The processor 108 performs X and Y coordinates (simply “position coordinates”, “position coordinates” on the screen 4 of the stroke (handwriting) to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 during the user entry. (Also called “coordinate data”) and dot pattern addresses (coded pattern addresses) unique to the screen 4 are continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 3 (b). The data is converted into a Y coordinate bit value, and X, Y coordinate data and a dot pattern address are calculated from the data array by a predetermined calculation method. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, the writing pressure data, the dot pattern address, and the X and Y coordinate data. Since the 6 × 6 dot pattern on the screen 4 does not overlap in the screen 4, when the user enters characters or the like with the electronic pen 1, it indicates which position on the screen 4 the entered position corresponds to. It can be specified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates a pen ID (electronic pen identification information), time information (time stamp), writing pressure data, dot pattern address, and X, Y coordinate data, and enters computer information as entry information. 2 to send. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark).

[Computer device]
Next, the computer apparatus 2 will be described. The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as ROM and RAM, a display, a personal computer including a mouse and a keyboard, and the like. . FIG. 5 is a functional block diagram of the computer apparatus 2. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, a storage unit 25, a display unit 26, and a transmission unit 27. Then, the computer device 2 performs a predetermined process based on the entry information received from the electronic pen 1.

  The receiving unit 22 includes an antenna, a receiving circuit, and the like, and receives entry information from the electronic pen 1 and transmits it to the processing unit 24. The transmission unit 27 transmits an image signal used for displaying an image on the display unit 26 to the projector 3 according to an instruction from the processing unit 24. A data transmission method to the projector 3 is a wireless method even if a wired method is used. There may be. The display means 26 is constituted by a display or the like, and displays the contents instructed by the processing means 24.

  The storage means 25 is configured by a memory such as a hard disk, ROM, or RAM. The storage means 25 stores a program for calibrating the position coordinates in the dot pattern (coded pattern) on the screen 4 and the position coordinates on the display screen in the display means 26 of the computer device 2. . With respect to this program, the storage means 25 stores position coordinates such as display reference points and recognition reference points displayed during the calibration process, images of calibration marks, and the like. Further, the storage means 25 also stores a program for processing entry information generated by handwriting on the screen 4 with the electronic pen 1.

  The processing means 24 is constituted by a processor such as a CPU, and based on the entry information received from the electronic pen 1 by the receiving means 22, displays the entry contents in various forms on the display means 26, or causes the storage means 25 to display it. A stored program for performing calibration processing is activated to perform calibration processing. The processing unit 24 causes the transmission unit 27 to transmit the image signal for causing the projector 3 to project the same image as the image displayed on the display unit 26 in synchronization with the projector 3.

  The projector 3 projects an image similar to the image displayed on the display unit 26 onto the area 403 of the screen 4 based on the image signal received from the transmission unit 27 of the computer apparatus 2.

<Calibration startup process flow>
Next, calibration start processing in the information processing system 10 will be described with reference to FIG.

  FIG. 6 is a flowchart of the calibration activation process. First, the user performs writing or tapping on the paper 402 of the screen 4 using the electronic pen 1. Then, the electronic pen 1 detects contact with the paper 402 when the pressure sensor 107 detects a writing pressure equal to or higher than a predetermined value, and images a dot pattern along the handwriting with the camera 106 while irradiating infrared rays with the LED 105. Then, the processor 108 continuously calculates the position coordinates along the handwriting from the image data of the captured dot pattern, and the position coordinates, the current time transmitted by the real-time clock 110, the writing pressure data (hereinafter referred to as “stroke”). Information ”) and the pen ID are immediately and sequentially transmitted to the computer apparatus 2 as entry information (step S101).

  In the computer apparatus 2, when the receiving means 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry information is stored in the storage means 25 (step S201). Then, the processing unit 24 checks whether or not a coordinate conversion function for performing the calibration process is defined (step S202). When the processing unit 24 recognizes that the coordinate conversion function is not defined (step S202: No), the processing unit 24 starts the calibration process (step S205). Therefore, if the user tries to write on the screen 4 with the electronic pen 1 when the calibration process is not executed, the calibration process is started.

  On the other hand, when the processing unit 24 recognizes that the coordinate conversion function is defined (step S202: Yes), the instruction sheet 5 (input setting area) is transferred from the electronic pen 1 by the electronic pen 1 based on the entry information transmitted from the electronic pen 1. It is determined whether or not an instruction has been issued (step S203). When the processing unit 24 recognizes that the instruction sheet 5 (input setting area) has been instructed (step S203: Yes), the processing unit 24 starts the calibration process (step S205), and the instruction sheet 5 (input setting area) indicates If not recognized (step S203: No), the position coordinates based on the dot pattern on the screen 4 of the received entry information are converted to the position coordinates on the display 201 using a coordinate conversion function, and a stroke is drawn. (Step S204).

<Calibration process>
Next, regarding the calibration process performed when it is recognized in step S202 in FIG. 6 that the coordinate transformation function is not defined, or when it is recognized in step S203 that the instruction sheet 5 (input setting area) is instructed, This will be described with reference to FIGS.

  FIG. 7 is a flowchart of the calibration process. FIG. 8 is an image showing calibration marks projected on the screen 4.

  When the processing unit 24 starts the calibration process, the processing unit 24 displays the first calibration mark 601 on the display screen 201 of the display unit 26 and, as shown in FIG. The first calibration mark 601 is projected, and the user is prompted to perform pen-up at the reference point (center of the concentric circle) of the first calibration mark 601 with the electronic pen 1 (step S301). For example, as shown in FIG. 8, the processing means 24 displays an instruction message such as “Please raise when the pen tip touches the center of the target” or output a similar voice instruction.

  Subsequently, as shown in FIG. 9, the user uses the electronic pen 1 to move the pen tip to the position (center of the concentric circle) where the first calibration mark 601 is projected in the pen-down state, and then the pen up. To do. Then, the electronic pen 1 generates stroke information, associates it with the pen ID, and transmits it as entry information to the computer device 2 (step S401). As described above, when the electronic pen 1 transmits the entry information to the computer device 2, in the computer device 2, the receiving unit 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, and receives the entry information. It memorize | stores in the memory | storage means 25 (step S302). When the receiving means 22 receives the entry information from the electronic pen 1, the processing means 24 extracts the pen-up position coordinates from the entry information and is directed to the position where the first calibration mark 601 is projected. The first recognition reference point on the sheet 402 is stored in the storage means 25 (step S303).

  Further, the processing unit 24 displays the second calibration mark 602 on the display screen 201 of the display unit 26 and causes the projector 3 to project the second calibration mark 602 on the screen 4 ( 8), the user is prompted to perform a pen touch and a subsequent pen-up at the position where the second calibration mark 602 is projected by the electronic pen 1 (step S304).

  Subsequently, the user uses the electronic pen 1 to raise the pen after the pen tip comes into contact with the position (the center of the concentric circle) where the second calibration mark 602 is projected, as shown in FIG. Then, the electronic pen 1 generates stroke information, associates it with the pen ID, and transmits it as entry information to the computer device 2 (step S402). As described above, when the electronic pen 1 transmits the entry information to the computer device 2, in the computer device 2, the receiving unit 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, and receives the entry information. It memorize | stores in the memory | storage means 25 (step S305).

  The processing unit 24 extracts the pen-up position coordinates from the received entry information, and determines whether or not the pen-up position coordinates are outside the same recognition range of the first recognition reference point (step S306). Here, the same recognition range is a range in which the user can recognize that the same calibration mark has been pen-touched twice or more without being conscious of it, and is displayed on the paper 402 according to the size of the screen 4 or the like. A numerical range (for example, several centimeters) on the printed dot pattern coordinates may be set. When the processing unit 24 determines that the pen-up position coordinate is within the same recognition range of the first recognition reference point (step S306: No), the pen-up position coordinate is adopted as the second recognition reference point. However, if it is determined that the position coordinates of the pen-up are outside the same recognition range of the first recognition reference point (step S306: Yes), the processing unit 24 performs the pen-up. Is stored in the storage unit 25 as the second recognition reference point on the sheet 402 instructed to the position where the second calibration mark 602 is projected (step S307).

  The processing unit 24 then calculates the coordinate values of the first and second recognition reference points on the paper 402 by the dot pattern calculation (the coordinates at the center point of the concentric circles of the projected first and second calibration marks 601 and 602). Value) and the coordinate values at the first and second display reference points that are the center points of the concentric circles of the first and second calibration marks 601 and 602 on the display screen 201 of the display means 26. A coordinate conversion function for calculating the position coordinates on the display screen 201 in the computer apparatus 2 is obtained from the position coordinates on the computer 402, defined, and stored in the storage means 25 (step S308). At the same time, as a result of the calibration process, the processing means 24 determines a coordinate input area 403 on which the position coordinates can be accurately input on the screen 4 by the electronic pen 1 corresponding to the display screen 201, and defines the coordinate area. And stored in the storage means 25.

  Here, a method of obtaining the calculation formula for calibration will be described with reference to FIGS.

FIG. 10 is a diagram showing the position coordinates of the first and second display reference points on the display screen 201 of the computer apparatus 2. As shown in FIG. 10, on the display screen 201 of the display means (display) 26 of the computer apparatus 2, the X axis is the right direction, the Y axis is the downward direction, and the following coordinates are as follows.
Upper left point: Coordinate 202 (Xamin, Yamin),
Lower right corner point: coordinates 203 (Xamax, Yamax),
First display reference point: coordinates 204 (Xa1, Ya1),
Second display reference point: coordinates 205 (Xa2, Ya2),
However, Xamin ≤ Xa1 <Xa2 ≤ Xamax,
Yamin ≤ Ya1 <Ya2 ≤ Yamax,

FIG. 11 is a diagram showing the position coordinates of the first and second recognition reference points on the sheet 402 of the screen 4. As the first and second recognition reference points, the first and second display reference points on the display screen 201 of the computer apparatus 2 are projected on the screen 4 and the dot pattern (coded pattern) indicated by the electronic pen 1 is analyzed. The position coordinates based on As shown in FIG. 11, in the coordinate input area 403 projected onto the screen 4 by the projector 3, the X axis is set to the right direction, the Y axis is set to the downward direction, and the following coordinates are set as follows.
Upper left corner point: coordinates 404 (Xb0, Yb0),
Upper left point of coordinate input area 403: coordinates 405 (Xbmin, Ybmin),
Lower right corner point of coordinate input area 403: coordinates 406 (Xbmax, Ybmax),
First recognition reference point: coordinates 407 (Xb1, Yb1),
Second recognition reference point: coordinates 408 (Xb2, Yb2),
However, Xb0 ≦ Xbmin <Xb1 <Xb2 ≦ Xbmax,
Yb0 ≤ Ybmin <Yb1 <Yb2 ≤ Ybmax,

Then, the coordinates 204 (Xa 1, Ya 1) of the first display reference point and the coordinates 205 (Xa 2, Ya 2) of the second display reference point in the display area 201 of the computer device 2 are the first in the dot pattern on the paper 402 of the screen 4. The coordinates correspond to the coordinates 407 (Xb1, Yb1) of the first recognition reference point and the coordinates 408 (Xb2, Yb2) of the second recognition reference point, respectively. Then, the upper left end point coordinates 405 (Xbmin, Ybmin) and the lower right end point coordinates 406 (Xbmax, Ybmax) defining the coordinate input area 403 projected on the screen 4 (each vertex of the diagonal in the rectangular coordinate input area 403) Can be expressed as:

[Formula 1] Xbmin = Xb1− (Xa1−Xamin) × (Xb2−Xb1) / (Xa2−Xa1)
[Formula 2] Ybmin = Yb1− (Ya1−Yamin) × (Yb2−Yb1) / (Ya2−Ya1)

[Formula 3] Xbmax = Xb2 + (Xamax−Xa2) × (Xb2−Xb1) / (Xa2−Xa1)
[Formula 4] Ybmax = Yb2 + (Yamax−Ya2) × (Yb2−Yb1) / (Ya2−Ya1)

The coordinate input area 403 in step S204 of FIG. 6 can be defined from a rectangular area having the coordinate value as the vertical angle point.

Then, from the position coordinates (Xbn, Ybn) defined by the dot pattern on the paper 402 of the screen 4, the position coordinates (Xan, Yan) on the display screen 201 in the display means 26 of the computer apparatus 2 are expressed by the following equations. Can be sought.

[Formula 5] Xan = Xamin + [Xbn− (Xbmin−Xb0)] × (Xa2−Xa1) / (Xb2−Xb1)
[Formula 6] Yan = Yamin + [Ybn− (Ybmin−Yb0)] × (Ya2−Ya1) / (Yb2−Yb1)

Therefore, the processing means 24 converts the position coordinates (Xbn, Ybn) on the screen 4 to the position coordinates (Xan, Yan) on the display screen 201 of the computer apparatus 2 by the above formula, and performs various processes. Go. Note that a predetermined coefficient for correcting distortion may be applied to the term of the arithmetic expression depending on the angle of the projector 3 with respect to the screen 4.

  After the calibration process, the user writes characters or the like using the electronic pen 1 in the coordinate input area 403 that is defined on the screen 4 so that the position coordinates can be accurately input corresponding to the display screen 201. Then, the electronic pen 1 generates stroke information corresponding to the stroke of the handwriting, and transmits entry information associated with the pen ID to the computer device 2 (step S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 24 stores the entry information in the storage means 25 (step S201), and determines that a coordinate conversion function is defined (step S202: Yes), it is determined that the received entry information is not information in the instruction sheet 5 (input setting area) (No in step S203). Further, the processing means 24 uses the position transformation (Xbn, Ybn) included in the stroke information of the acquired entry information as the position on the display screen 201 of the computer device 2 using the coordinate transformation function obtained by the calibration process. Convert to coordinates (Xan, Yan) to draw strokes and perform various processes.

  That is, as shown in FIG. 12, when the user enters a character or the like with the electronic pen 1 in the coordinate input area 403 of the screen 4, the computer device 2 draws a stroke line segment corresponding to the handwriting, and the screen 4 The line segment of the stroke is projected by the projector 3 without deviating from the above handwriting. Further, since the position coordinates on the screen 4 and the position coordinates on the display screen 201 of the display unit 26 of the computer apparatus 2 are calibrated by the coordinate conversion by the coordinate conversion function by the calibration process, the coordinate input of the screen 4 is performed. By using the electronic pen 1 to select a menu or icon projected in the area 403, the application can be operated or started.

<Operational effect of the first embodiment>
In the information processing system 10 according to the first embodiment, when the calibration process is executed by the processing unit 24, the coordinate input surface and the coordinate with higher accuracy are recognized by recognizing the pen-up coordinate of the electronic pen 1 as a reference. Definition of relative position coordinates with respect to the display surface (definition of coordinate conversion function) can be realized. Further, by determining whether or not the coordinates acquired as the reference point when executing the calibration process are included in the coordinates within the same recognition range of the coordinates already stored as the reference point, the user's continuous This makes it possible to prevent erroneous settings due to simple writing operations and to perform resetting immediately, improving convenience.

[Modification]
The first embodiment may be configured as follows.

  In the first embodiment, in step S306, the processing unit 24 determines that the pen-up position coordinate is within the same recognition range 7 of the first recognition reference point (see FIG. 11, where the first recognition reference point is the center point). If it is determined that it is within a circle having a predetermined radius, the calibration process is ended. However, as shown in FIG. 13, the computer apparatus 2 determines that the first calibration mark 601 has been reset. (Step S306: No), the newly acquired pen-up position coordinates may be updated and stored as the first recognition reference point (Step S309). The computer device 2 determines whether or not the coordinates within the same range have been acquired in step S306, thereby performing a writing malfunction that causes the electronic pen 1 to contact the screen continuously when the second recognition reference point is designated. Even in this case, the acquired pen-up position coordinates can be determined as the coordinates for resetting the first recognition reference point, and can be updated and stored as the coordinates of the first recognition reference point. Then, if the process returns from step S309 to step S304, the second calibration mark is displayed (step S304), and the second recognition reference point can be obtained (step S307).

  In addition, when pen touch with the electronic pen 1 is performed a plurality of times for the same recognition range of the first recognition reference point, in addition to the above modification, the position coordinates in pen up of any one pen touch are first recognized. You may make it employ | adopt as a reference point.

Second Embodiment
Next, the information processing system 100 in the second embodiment will be described. In the description of the second embodiment, the configuration different from the first embodiment will be mainly described. In the second embodiment, the same reference numerals as those in the first embodiment are the same as those in the first embodiment unless otherwise specified.

  FIG. 14 is a system configuration diagram of the information processing system 100 according to the second embodiment. In the first embodiment, the information processing system 10 is configured by using the projector 3. However, in the second embodiment, as shown in FIG. 14, the information processing system 100 has dots that can be read by the electronic pen 1. A pattern (coded pattern) is printed on the transparent sheet 8, and the transparent sheet 8 is pasted on the display screen 201 of the computer apparatus 2. Further, an instruction sheet 5 on which a dot pattern is printed is pasted on the operation surface of the computer apparatus 2 as an input setting area for calibration processing. The instruction sheet 5 may be a sticker or the like so that the user can arbitrarily attach it to the computer apparatus 2 or a notebook on hand. Further, a dot pattern in a partial region of the transparent sheet 8 may be defined as an input setting area for calibration processing.

  With this configuration, when performing calibration processing, the electronic pen 1 can be operated by entering strokes, tapping, etc., on the display screen 201 as shown in FIG. In the second embodiment, the calibration process is performed in the same manner as in the first embodiment.

  In this case, a dot pattern is printed on the transparent sheet 8 with ink having a characteristic of selectively reflecting infrared rays. In the electronic pen 1, the processor 108 has a strong infrared reflection from image data captured by the CMOS camera 106. A determination may be made by setting a threshold value so that the partial area is recognized as a dot. The threshold value is set so that the infrared rays transmitted through the transparent sheet 8 from the display can be distinguished from the infrared rays reflected by the dots.

<Operational effects of the second embodiment>
In the information processing system 100 according to the second embodiment, the same effect as the upper processing system 10 according to the first embodiment is obtained, and a transparent sheet on which a dot pattern (coded pattern) that can be read by the electronic pen 1 is printed. Since 8 is pasted on the display screen 201 of the computer apparatus 2, the user can perform an operation at hand by tapping the computer apparatus 2.

[Modification]
Also in the second embodiment, a modified configuration similar to that of the first embodiment can be employed.

  In the first and second embodiments, the calibration process is performed based on the position coordinates of two points. However, the calibration process may be performed based on the position coordinates of three or more points. In the first embodiment, a front-type projector has been described as an example of the projector 3, but the projector 3 can also be applied to a rear projector. Further, the dot pattern (coded pattern) is not limited to the Anoto method.

  In the first and second embodiments, the electronic pen 1 does not have an ink cartridge. However, it is possible to write characters or the like directly on the paper 402 with the electronic pen 1 using the pen unit 104 as an ink cartridge. You may do it. In this case, in the computer device 2, the stroke drawn with the electronic pen 1 is displayed on the display unit 26, but an image signal that is not projected by the projector 3 may be output from the computer device 2 to the projector 3. Further, in order to make it easy to recognize dots from the image data captured by the CMOS camera 106 of the electronic pen 1, an infrared transmission filter is provided on the opening of the electronic pen 1 so that only the infrared light is irradiated to the CMOS camera 106. You may provide near 102.

  This information processing system can be used in school classes, company conference rooms, lectures, presentations, and the like.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 21 ... Input means 22 ... Receiving means 24 ... Processing means 25 ... Memory | storage means 26 ... Display means 27 ... Transmission means 201 ... Display screen 202 ... The upper left point coordinate of a display screen 203 ... Right of a display screen Lower end point coordinates 204 ... first display reference point coordinates 205 ... second display reference point coordinates 3 ... projector 4 ... screen 401 ... magnet board (white board)
402: Paper 403 ... Image projection area / coordinate input area 404 ... Upper left end point coordinates 405 ... Upper left end point coordinates of the coordinate input area 406 ... Lower right end point coordinates of the coordinate input area 407 ... First recognition reference point coordinates 408 ... Second recognition Reference point coordinates 5 ... Instruction sheet (input setting area)
601 ... First calibration mark 602 ... Second calibration mark 7 ... Identical recognition range 8 ... Transparent sheet 10,100 ... Information processing system

The information processing system according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information related to the coding pattern transmitted from the electronic pen , An information processing system comprising: a computer device that performs processing according to the information; and a projector that receives an image signal from the computer device and projects an image on the screen.
The computer apparatus includes a receiving unit that receives information about the coding pattern transmitted from the electronic pen, and displays an image of a calibration mark on the screen so that the electronic pen at the reference point of the calibration mark is displayed . encourage pen-up, the position coordinates of the pen-up after the contact to the calibration mark by the electronic pen, determined from information received by said receiving means, using the position coordinates of the pen-up calibration processing process Means.

According to this information processing system, when the coded pattern formed on the screen is read by the electronic pen, the electronic pen transmits information related to the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a screen, and receives information related to a coding pattern from an electronic pen. In such an information processing system, when an image of a calibration mark is displayed on the screen, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinate of the pen-up is obtained. The position coordinates in the pen-up are used for the calibration process. Therefore, after the user touches the calibration mark with the electronic pen, even if the pen tip deviates from the mark position, the pen tip is moved so that it matches the mark as much as possible before pen-up. Therefore, highly accurate calibration processing can be performed. When the calibration mark image is displayed, the pen up of the electronic pen is urged at the reference point of the calibration mark, so that it is easier to understand and the pen up of the calibration mark is performed. Can do.
Alternatively, the information processing system according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. An information processing system comprising: a computer device that performs processing according to the information; and a projector that receives an image signal from the computer device and projects an image on the screen.
The computer apparatus includes a receiving unit that receives information related to the coding pattern transmitted from the electronic pen, and causes the projector to display an image of a calibration mark on the screen, and to the calibration mark using the electronic pen. The position coordinates of the pen-up after the contact of is obtained from the information received by the receiving means, and the processing means using the position coordinates in the pen-up for calibration processing,
When the processing means recognizes contact with the screen by the electronic pen two or more times within a predetermined range from the calibration mark, the processing means performs pen-up of contact with the electronic pen once. The position coordinates are used for the calibration process or the calibration process is not performed.
According to this information processing system, when the coded pattern formed on the screen is read by the electronic pen, the electronic pen transmits information related to the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a screen, and receives information related to a coding pattern from an electronic pen. In such an information processing system, when an image of a calibration mark is displayed on the screen, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinate of the pen-up is obtained. The position coordinates in the pen-up are used for the calibration process. Therefore, after the user touches the calibration mark with the electronic pen, even if the pen tip deviates from the mark position, the pen tip is moved so that it matches the mark as much as possible before pen-up. Therefore, highly accurate calibration processing can be performed. Further, when the contact between the calibration pen and the screen by the electronic pen is recognized two times or more within a predetermined range, the pen-up position coordinate of the contact by the electronic pen is used for the calibration process. If the calibration process is not performed, a more accurate calibration process can be performed or an erroneous calibration can be avoided.

Alternatively, the information processing system according to the present invention receives information relating to the coding pattern transmitted from the transparent sheet on which the coding pattern indicating the position coordinates is formed, the electronic pen that reads the coding pattern, and the electronic pen. An information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to a display screen of a display unit of the computer device, and the computer device receives information related to a coding pattern transmitted from the electronic pen, and calibration for the transparent sheet. An image of the mark is projected from the display screen to prompt the pen up of the electronic pen at the reference point of the calibration mark, and the position coordinate of the pen up after contact with the calibration mark by the electronic pen is obtained. And a processing unit which is obtained from the information received by the receiving unit and uses the position coordinates in the pen-up for the calibration process.

According to this information processing system, when the coded pattern formed on the transparent sheet is read by the electronic pen, the electronic pen transmits information on the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a transparent sheet, and receives information related to a coding pattern from the electronic pen. In such an information processing system, when an image of a calibration mark is projected on the transparent sheet, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinates of the pen-up are obtained. The position coordinates in the pen-up are obtained and used for the calibration process. Therefore, the user can perform calibration processing with high accuracy by penning up the calibration mark after touching it with the electronic pen. When the calibration mark image is displayed, the pen up of the electronic pen is urged at the reference point of the calibration mark, so that it is easier to understand and the pen up of the calibration mark is performed. Can do.
Alternatively, the information processing system according to the present invention receives information relating to the coding pattern transmitted from the transparent sheet on which the coding pattern indicating the position coordinates is formed, the electronic pen that reads the coding pattern, and the electronic pen. An information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to a display screen of a display unit of the computer device, and the computer device receives information related to a coding pattern transmitted from the electronic pen, and calibration for the transparent sheet. An image of the mark is projected from the display screen, and the position coordinate of the pen-up after contact with the calibration mark by the electronic pen is obtained from the information received by the receiving means, and the position coordinate in the pen-up is determined. Processing means used for calibration processing,
When the processing means recognizes contact with the screen by the electronic pen two or more times within a predetermined range from the calibration mark, the processing means performs pen-up of contact with the electronic pen once. The position coordinates are used for the calibration process or the calibration process is not performed.
According to this information processing system, when the coded pattern formed on the transparent sheet is read by the electronic pen, the electronic pen transmits information on the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a transparent sheet, and receives information related to a coding pattern from the electronic pen. In such an information processing system, when an image of a calibration mark is projected on the transparent sheet, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinates of the pen-up are obtained. The position coordinates in the pen-up are obtained and used for the calibration process. Therefore, the user can perform calibration processing with high accuracy by penning up the calibration mark after touching it with the electronic pen. Further, when the contact between the calibration pen and the screen by the electronic pen is recognized two times or more within a predetermined range, the pen-up position coordinate of the contact by the electronic pen is used for the calibration process. If the calibration process is not performed, a more accurate calibration process can be performed or an erroneous calibration can be avoided.

In the information processing system, when the processing unit recognizes the contact by the electronic pen two or more times within a predetermined range from the calibration mark, the processing unit newly contacts the electronic pen. The pen-up position coordinates may be used for the calibration process. With this configuration, calibration processing can be performed more accurately using newly acquired position coordinates.

Furthermore, in the information processing system, the electronic pen reads a coded pattern at a predetermined interval from a pen down to a pen up, and transmits information on the coded pattern for each reading. May be configured to obtain the position coordinates of the pen-up from the information related to the coding pattern transmitted from the electronic pen.
In the information processing system, the processing unit may be configured to start the calibration process when a coordinate conversion function by the calibration process is not defined or when an instruction for the calibration process is recognized.

Further, the program according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen , A program executed by the computer apparatus in an information processing system comprising: a computer apparatus that performs processing according to the information; and a projector that receives an image signal from the computer apparatus and projects an image on the screen. ,
The information on the coding pattern transmitted from the electronic pen is received by the receiving means, and the image of the calibration mark is displayed on the projector on the screen, and the pen of the electronic pen at the reference point of the calibration mark is displayed . encourage up, the position coordinates of the pen-up after the contact to the calibration mark by the electronic pen, determined from information received by said receiving means, to use the position coordinates of the pen-up in the calibration process It is characterized by doing.
Alternatively, the program according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen, A program executed by the computer apparatus in an information processing system comprising: a computer apparatus that performs processing according to the information; and a projector that receives an image signal from the computer apparatus and projects an image on the screen. ,
After receiving information related to the coding pattern transmitted from the electronic pen by the receiving means, causing the image of the calibration mark to be projected on the projector on the screen, and after contacting the calibration mark with the electronic pen Is obtained from the information received by the receiving means, and the position coordinate in the pen-up is used for calibration processing, and the calibration is performed at least twice within a predetermined range from the calibration mark. When the contact of the electronic pen with the screen is recognized, the pen-up position coordinates of the contact with the electronic pen are used for the calibration process or the calibration process is not performed. It is characterized by.

Alternatively, the program according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. A program executed by the computer apparatus in an information processing system including a computer apparatus that performs processing according to the information,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. Projecting from the display screen to prompt pen-up of the electronic pen at the reference point of the calibration mark, and the position coordinates of the pen-up after contacting the calibration mark by the electronic pen are received by the receiving means The position coordinate in the pen-up is used for the calibration process.
Alternatively, the program according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. A program executed by the computer device in an information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. Projecting from the display screen, the position coordinates of the pen-up after contact with the calibration mark by the electronic pen are obtained from the information received by the receiving means, and the position coordinates in the pen-up are used for calibration processing. When the touch of the electronic pen with the screen is recognized within the predetermined range from the calibration mark, the touch-up of the electronic pen with any one time is performed. Use the position coordinates for the calibration process or Characterized by processing not to perform Shon process.

When the program recognizes the contact by the electronic pen two or more times within a predetermined range from the calibration mark, the program calibrates the newly acquired position coordinate of the pen-up of the contact by the electronic pen. It may be configured to be used for processing.

Further, the electronic pen reads the coded pattern at a predetermined interval from the pen down to the pen up, and transmits information on the coded pattern for each reading. The position coordinates of the pen-up may be obtained from the information regarding the coding pattern transmitted from the pen.
In the above program, the processing means may be configured to start the calibration process when a coordinate conversion function by the calibration process is not defined or when an instruction for the calibration process is recognized.

The information processing system according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information related to the coding pattern transmitted from the electronic pen, An information processing system comprising: a computer device that performs processing according to the information; and a projector that receives an image signal from the computer device and projects an image on the screen.
The computer apparatus includes a receiving unit that receives information about the coding pattern transmitted from the electronic pen, and displays an image of a calibration mark on the screen so that the electronic pen at the reference point of the calibration mark is displayed. Processing that prompts pen-up, obtains the position coordinate of the pen-up after contact with the calibration mark by the electronic pen from the information received by the receiving means, and uses the position coordinate in the pen-up for the calibration process and means,
When the processing means recognizes contact with the screen by the electronic pen two or more times within the same recognition range from a specific calibration mark, the touching pen with any one of the electronic pens is used. The up position coordinates are used in the calibration process as the position coordinates corresponding to the specific calibration mark, or the calibration process is not performed .

According to this information processing system, when the coded pattern formed on the screen is read by the electronic pen, the electronic pen transmits information related to the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a screen, and receives information related to a coding pattern from an electronic pen. In such an information processing system, when an image of a calibration mark is displayed on the screen, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinate of the pen-up is obtained. The position coordinates in the pen-up are used for the calibration process. Therefore, after the user touches the calibration mark with the electronic pen, even if the pen tip deviates from the mark position, the pen tip is moved so that it matches the mark as much as possible before pen-up. Therefore, highly accurate calibration processing can be performed. When the calibration mark image is displayed, the pen up of the electronic pen is urged at the reference point of the calibration mark, so that it is easier to understand and the pen up of the calibration mark is performed. Can do. Further, when the contact between the calibration mark and the screen by the electronic pen is recognized two or more times within the same recognition range, the position coordinate of the pen-up of the contact by any one electronic pen is determined as the specific mark. By using the position coordinates corresponding to the calibration marks in the calibration process or not performing the calibration process, it is possible to perform a more accurate calibration process or to avoid erroneous calibration.
Alternatively, the information processing system according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. An information processing system comprising: a computer device that performs processing according to the information; and a projector that receives an image signal from the computer device and projects an image on the screen.
The computer apparatus includes a receiving unit that receives information related to the coding pattern transmitted from the electronic pen, and causes the projector to display an image of a calibration mark on the screen, and to the calibration mark using the electronic pen. The position coordinates of the pen-up after the contact of is obtained from the information received by the receiving means, and the processing means using the position coordinates in the pen-up for calibration processing,
When the processing means recognizes contact with the screen by the electronic pen two or more times within the same recognition range from a specific calibration mark, the touching pen with any one of the electronic pens is used. The up position coordinates are used in the calibration process as the position coordinates corresponding to the specific calibration mark, or the calibration process is not performed.
According to this information processing system, when the coded pattern formed on the screen is read by the electronic pen, the electronic pen transmits information related to the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a screen, and receives information related to a coding pattern from an electronic pen. In such an information processing system, when an image of a calibration mark is displayed on the screen, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinate of the pen-up is obtained. The position coordinates in the pen-up are used for the calibration process. Therefore, after the user touches the calibration mark with the electronic pen, even if the pen tip deviates from the mark position, the pen tip is moved so that it matches the mark as much as possible before pen-up. Therefore, highly accurate calibration processing can be performed. Further, when the contact between the calibration mark and the screen by the electronic pen is recognized two or more times within the same recognition range, the position coordinate of the pen-up of the contact by any one electronic pen is determined as the specific mark. By using the position coordinates corresponding to the calibration marks in the calibration process or not performing the calibration process, it is possible to perform a more accurate calibration process or to avoid erroneous calibration.

Alternatively, the information processing system according to the present invention receives information relating to the coding pattern transmitted from the transparent sheet on which the coding pattern indicating the position coordinates is formed, the electronic pen that reads the coding pattern, and the electronic pen. An information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to a display screen of a display unit of the computer device, and the computer device receives information related to a coding pattern transmitted from the electronic pen, and calibration for the transparent sheet. An image of the mark is projected from the display screen to prompt the pen up of the electronic pen at the reference point of the calibration mark, and the position coordinate of the pen up after contact with the calibration mark by the electronic pen is obtained. A processing means for obtaining from the information received by the receiving means, and using the position coordinates in the pen-up for the calibration process ,
When the processing means recognizes contact with the transparent sheet by the electronic pen two or more times within a same recognition range from a specific calibration mark, the processing means performs any one contact with the electronic pen. The pen-up position coordinates are used in the calibration process as the position coordinates corresponding to the specific calibration mark, or the calibration process is not performed .

According to this information processing system, when the coded pattern formed on the transparent sheet is read by the electronic pen, the electronic pen transmits information on the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a transparent sheet, and receives information related to a coding pattern from the electronic pen. In such an information processing system, when an image of a calibration mark is projected on the transparent sheet, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinates of the pen-up are obtained. The position coordinates in the pen-up are obtained and used for the calibration process. Therefore, the user can perform calibration processing with high accuracy by penning up the calibration mark after touching it with the electronic pen. When the calibration mark image is displayed, the pen up of the electronic pen is urged at the reference point of the calibration mark, so that it is easier to understand and the pen up of the calibration mark is performed. Can do. Furthermore, when the contact of the electronic pen with the transparent sheet is recognized two or more times within the same recognition range from the calibration mark, the position coordinate of the pen-up of the contact with the electronic pen once is specified. By using the position coordinates corresponding to the calibration mark in the calibration process or not performing the calibration process, more accurate calibration process can be performed or erroneous calibration can be avoided.
Alternatively, the information processing system according to the present invention receives information relating to the coding pattern transmitted from the transparent sheet on which the coding pattern indicating the position coordinates is formed, the electronic pen that reads the coding pattern, and the electronic pen. An information processing system including a computer device that performs processing according to the information,
The transparent sheet is affixed to a display screen of a display unit of the computer device, and the computer device receives information related to a coding pattern transmitted from the electronic pen, and calibration for the transparent sheet. An image of the mark is projected from the display screen, and the position coordinate of the pen-up after contact with the calibration mark by the electronic pen is obtained from the information received by the receiving means, and the position coordinate in the pen-up is determined. Processing means used for calibration processing,
When the processing means recognizes contact with the transparent sheet by the electronic pen two or more times within a same recognition range from a specific calibration mark, the processing means performs any one contact with the electronic pen. The pen-up position coordinates are used in the calibration process as the position coordinates corresponding to the specific calibration mark, or the calibration process is not performed.
According to this information processing system, when the coded pattern formed on the transparent sheet is read by the electronic pen, the electronic pen transmits information on the coded pattern to the computer device. The computer device transmits an image signal to a projector that projects an image on a transparent sheet, and receives information related to a coding pattern from the electronic pen. In such an information processing system, when an image of a calibration mark is projected on the transparent sheet, when the user brings the electronic pen into contact with the calibration mark and performs pen-up, the position coordinates of the pen-up are obtained. The position coordinates in the pen-up are obtained and used for the calibration process. Therefore, the user can perform calibration processing with high accuracy by penning up the calibration mark after touching it with the electronic pen. Furthermore, when the contact of the electronic pen with the transparent sheet is recognized two or more times within the same recognition range from the calibration mark, the position coordinate of the pen-up of the contact with the electronic pen once is specified. By using the position coordinates corresponding to the calibration mark in the calibration process or not performing the calibration process, more accurate calibration process can be performed or erroneous calibration can be avoided.

Further, the program according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen, A program executed by the computer apparatus in an information processing system comprising: a computer apparatus that performs processing according to the information; and a projector that receives an image signal from the computer apparatus and projects an image on the screen. ,
The information on the coding pattern transmitted from the electronic pen is received by the receiving means, and the image of the calibration mark is displayed on the projector on the screen, and the pen of the electronic pen at the reference point of the calibration mark is displayed. encourage up, the position coordinates of the pen-up after the contact to the calibration mark by the electronic pen, determined from information received by said receiving means, in which use of the position coordinates in the pen-up in the calibration process If the contact of the electronic pen with the screen is recognized twice or more within the same recognition range from a specific calibration mark, the pen-up of the contact with the electronic pen is performed once. The position coordinate is the specific calibration. Or used in the calibration process as the position coordinates corresponding to the use marks, characterized by processing not to perform the calibration process.
Alternatively, the program according to the present invention receives a screen on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen, A program executed by the computer apparatus in an information processing system comprising: a computer apparatus that performs processing according to the information; and a projector that receives an image signal from the computer apparatus and projects an image on the screen. ,
After receiving information related to the coding pattern transmitted from the electronic pen by the receiving means, causing the image of the calibration mark to be projected on the projector on the screen, and after contacting the calibration mark with the electronic pen Is obtained from the information received by the receiving means, and the position coordinate in the pen-up is used for the calibration process, and is twice or more within the same recognition range from a specific calibration mark. When the contact of the electronic pen with the screen is recognized, the position coordinate of the pen-up contact of any one of the electronic pens is calibrated as the position coordinate corresponding to the specific calibration mark. Use for calibration processing or calibre Characterized by processing not to perform Deployment process.

Alternatively, the program according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. A program executed by the computer apparatus in an information processing system including a computer apparatus that performs processing according to the information,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. Projecting from the display screen to prompt pen-up of the electronic pen at the reference point of the calibration mark, and the position coordinates of the pen-up after contacting the calibration mark by the electronic pen are received by the receiving means The position coordinate in the pen-up is used for the calibration process, and is applied to the transparent sheet by the electronic pen twice or more within the same recognition range from the specific calibration mark. If the contact is recognized, any one of the above The position coordinates of the contact of the pen-up by the child pen, or used in the calibration process as a position coordinate corresponding to the mark for a particular calibration, which comprises treating not to perform the calibration process.
Alternatively, the program according to the present invention receives a transparent sheet on which a coding pattern indicating position coordinates is formed, an electronic pen that reads the coding pattern, and information on the coding pattern transmitted from the electronic pen. A program executed by the computer apparatus in an information processing system including a computer apparatus that performs processing according to the information,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. Projecting from the display screen, the position coordinates of the pen-up after contact with the calibration mark by the electronic pen are obtained from the information received by the receiving means, and the position coordinates in the pen-up are used for calibration processing. be those used, if it recognizes the contact to the transparent sheet by two or more of the electronic pen in the same purview of marks for a specific calibration, contact by the electronic pen of any one the position coordinates of the pen-up, the specific calibration mer Or used in the calibration process as the position coordinates corresponding to, characterized by processing not to perform the calibration process.

Claims (8)

A screen on which a coding pattern indicating position coordinates is formed;
Reading means for reading the coded pattern;
A computer device that receives information on the coding pattern transmitted from the reading unit and performs processing according to the information;
An information processing system comprising: a projector that receives an image signal from the computer device and projects an image on the screen;
The computer device includes:
Receiving means for receiving information on the coding pattern transmitted from the electronic pen;
An image of a calibration mark is projected on the projector on the screen, and a pen-up position coordinate after the electronic pen is brought into contact with the calibration mark is obtained from the information received by the receiving means, and the pen An information processing system comprising processing means for using position coordinates in the up for calibration processing. A transparent sheet on which a coded pattern indicating position coordinates is formed;
Reading means for reading the coded pattern;
An information processing system comprising: a computer device that receives information related to the coding pattern transmitted from the reading unit and performs processing according to the information;
The transparent sheet is affixed to the display screen of the display means of the computer device,
The computer device includes:
Receiving means for receiving information on the coding pattern transmitted from the electronic pen;
The image of the calibration mark is projected from the display screen on the transparent sheet, and the position coordinates of the pen-up after the contact with the calibration mark by the electronic pen are obtained from the information received by the receiving means, An information processing system comprising: processing means that uses position coordinates in the pen-up for calibration processing.   3. The apparatus according to claim 1, wherein the processing unit includes a unit that urges pen-up of the electronic pen at a reference point of the calibration mark when an image of the calibration mark is displayed. 4. Information processing system.   When the processing means recognizes contact with the screen by the electronic pen two or more times within a predetermined range from the calibration mark, the processing means performs pen-up of contact with the electronic pen once. The information processing system according to claim 1, wherein position coordinates are used for calibration processing. A screen on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and a computer that receives information on the coding pattern transmitted from the reading unit and performs processing according to the information A program executed by the computer apparatus in an information processing system including an apparatus and a projector that receives an image signal from the computer apparatus and projects an image on the screen;
After receiving information related to the coding pattern transmitted from the electronic pen by the receiving means, causing the image of the calibration mark to be projected on the projector on the screen, and after contacting the calibration mark with the electronic pen The position coordinate of the pen-up in is obtained from the information received by the receiving means, and the position coordinate in the pen-up is used for the calibration process. A transparent sheet on which a coding pattern indicating position coordinates is formed, a reading unit that reads the coding pattern, and information related to the coding pattern transmitted from the reading unit is received, and processing according to the information is performed. A program executed by the computer device in an information processing system comprising the computer device,
The transparent sheet is affixed to the display screen of the display means of the computer device, and receives information related to the coding pattern transmitted from the electronic pen by the receiving means, and also displays an image of a calibration mark on the transparent sheet. Projecting from the display screen, the position coordinates of the pen-up after contact with the calibration mark by the electronic pen are obtained from the information received by the receiving means, and the position coordinates in the pen-up are used for calibration processing. A program characterized by being used.   The information processing system according to claim 5 or 6, wherein when the image of the calibration mark is projected, the pen up of the electronic pen is urged at a reference point of the calibration mark.   When recognizing the contact of the electronic pen with the screen two or more times within a predetermined range from the calibration mark, the position coordinates of the pen-up contact of any one of the electronic pens are calibrated. The program according to any one of claims 5 to 7, wherein the program is used for a processing process.

Images