JP2011081698A - Information processing system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing system for properly recognizing a boundary between sheets when a plurality of sheets with different coded patterns formed thereon are adjacently arranged. <P>SOLUTION: The information processing system includes: a plurality of sheets 4 which have different coded patterns indicating the position coordinates of coordinate areas and are adjacently arranged; an electronic pen 1 provided with a read means for reading the coded patterns; and a computer device 2 for receiving information on the coded patterns transmitted from the read information and performing processing corresponding to the information. The computer device 2 includes a boundary calculation means for determining the boundary between the sheets 4 on the basis of the information on the coded patterns received by a reception means when the operation of a stroke across the boundary between the sheets 4 is performed with the electronic pen 1. Thus, the boundary between the sheets 4 is properly determined. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing system capable of inputting information using a coding pattern indicating position coordinates.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto pen” developed by Swedish company Anoto is known as a representative example. Anotopen is used together with a dedicated sheet on which a dot pattern indicating position coordinates patterned by a predetermined algorithm is printed (see, for example, Patent Document 1).

  In addition, when such an electronic pen, a computer, a projector, and a screen are used to fill in or scan the screen with the electronic pen, the computer performs a predetermined process accordingly, and the computer display screen is displayed on the screen by the projector. The present applicant has proposed a system for projecting the image (for example, Patent Document 2). Here, a calibration process for matching the coordinate system of the dot pattern formed on the screen with the coordinate system on the display screen of the computer device is also proposed. Further, in a similar system, it has been proposed to attach a screen on which a dot pattern is formed to a wall surface with a hook or the like (Patent Document 3).

Japanese translation of PCT publication No. 2003-511761 Utility Model Registration No. 3151886 JP 2002-149331 A

  In recent years, there has been a growing need for conferences and presentations using such a system using an electronic pen. Therefore, the present invention provides an information processing system that can appropriately determine a boundary line between sheets when a plurality of sheets each having a different coding pattern are adjacently arranged.

  In one aspect of the present invention, an information processing system is an electronic system in which coded patterns indicating the position coordinates of different coordinate areas are formed, a plurality of sheets arranged adjacent to each other, and reading means for reading the coded patterns And a computer device that receives information related to the coding pattern transmitted from the reading unit and performs processing according to the information. The computer device transmits the coding pattern transmitted from the electronic pen. Receiving means for receiving information on the boundary between the sheets based on information on the coding pattern received by the receiving means when the electronic pen performs a stroke operation across the boundary between the sheets Boundary line calculating means for obtaining a line.

  The information processing system receives a plurality of sheets on which coded patterns indicating the position coordinates of different coordinate regions are formed, an electronic pen that reads the coded pattern, and information on the coded pattern from the electronic pen, and And a computer device that performs processing according to information. In this case, the plurality of sheets are arranged adjacent to each other. Here, “adjacent arrangement” means a case where the sheets are arranged so as to overlap each other and a case where the sheets are arranged so as to meet each other without overlapping. In the computer device, the boundary line calculation means obtains the boundary line between the sheets based on the information regarding the coding pattern received when the stroke operation across the boundary line between the sheets is performed by the electronic pen. Here, “the operation of the stroke across the boundary line” means that the stroke that crosses the boundary line between sheets is drawn with the electronic pen, in other words, the stroke that crosses the boundary line between the sheets is drawn with the electronic pen. Say.

  According to the information processing system, when a plurality of sheets each having a different coding pattern are arranged adjacent to each other, it is possible to appropriately obtain a boundary line between the sheets.

  In one aspect of the information processing system, the boundary line calculation means obtains a joining relationship at the boundary line between the sheets. Thereby, even if the stroke which straddles a boundary line is drawn with the electronic pen from the joining relationship between sheets, a continuous stroke can be recognized.

  In one aspect of the information processing system, the computer apparatus further includes a storage unit that stores a management table in which a coordinate area of the coding pattern is associated with each sheet, and the boundary line calculation unit includes the storage unit The boundary line is obtained by referring to the management table stored in the means. As a result, the boundary line can be accurately obtained.

  In another aspect of the information processing system, the boundary line calculation unit may determine a boundary point where the stroke and the boundary line intersect based on the information regarding the coding pattern received by the reception unit and the management table. Boundary coordinates are obtained, and the boundary line is obtained based on the boundary coordinates. The boundary line calculation means obtains the boundary coordinates on the plurality of boundary lines when an operation of a stroke across the plurality of boundary lines is performed. Thereby, a plurality of boundary lines can be appropriately obtained by obtaining and assembling the boundary coordinates necessary for recognizing all of the plurality of boundary lines.

  In another aspect of the information processing system, the computer device further includes an instruction unit that issues an instruction to the user to perform a stroke operation across a boundary line between the sheets.

  In another aspect of the information processing system, the boundary line calculation means obtains and stores the recognized boundary line as data of at least a linear function. This makes it possible to appropriately perform subsequent processing using the recognized boundary line.

  In another aspect of the information processing system, identification information is formed so as to be visible for each of the plurality of sheets. Thereby, the user can easily understand the identification information of the coding pattern of each sheet when pasting a plurality of sheets.

  In another aspect of the present invention, a coded pattern indicating the position coordinate of each different coordinate area is formed, used with a plurality of adjacent sheets, and transmitted from an electronic pen having reading means for reading the coded pattern. The program executed on the computer device that receives the information related to the coded pattern and performs processing according to the information includes receiving means for receiving the information related to the coded pattern transmitted from the electronic pen, the electronic The computer as boundary line calculation means for obtaining a boundary line between the sheets based on information on the coding pattern received by the receiving means when a stroke operation across the boundary line between the sheets is performed by a pen Make the device work.

  In one aspect of the program, the boundary line calculation means obtains a joining relationship at the boundary line between the sheets.

  In one aspect of the program, the computer apparatus is further caused to function as a storage unit that stores a management table in which a coordinate area of the coding pattern is associated with each sheet, and the boundary line calculation unit is stored in the storage unit. The boundary line is obtained by referring to the stored management table.

  In another aspect of the program, the boundary line calculation unit may include boundary coordinates of a boundary point where the stroke and the boundary line intersect based on the information regarding the coding pattern received by the reception unit and the management table. And the boundary line is determined based on the boundary coordinates. The boundary line calculation means obtains the boundary coordinates on the plurality of boundary lines when an operation of a stroke across the plurality of boundary lines is performed.

  In another aspect of the program, the computer apparatus is further caused to function as an instruction unit that issues an instruction to the user to perform a stroke operation across a boundary line between the sheets.

  In another aspect of the program, the boundary calculation means obtains and stores the recognized boundary as at least linear function data.

  By installing and executing these programs on the computer device, the above-described computer device can be realized.

  According to the present invention, when a plurality of sheets each having a different coding pattern are arranged adjacent to each other, it is possible to appropriately obtain a boundary line between the sheets.

It is a system configuration figure of the information processing system in a 1st embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a conceptual diagram which shows the data structure of a management table. It is a figure for demonstrating the boundary line recognition in 1st Embodiment. It is a flowchart of the boundary line recognition process in 1st Embodiment. It is a figure for demonstrating boundary line recognition in 2nd Embodiment. It is a flowchart of the boundary line recognition process in 2nd Embodiment. It is a system configuration figure of an information processing system in a modification.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
[System configuration of information processing system]
FIG. 1 is a system configuration diagram of an information processing system according to the first embodiment. In the information processing system according to the first embodiment, an electronic pen 1 used by a user, a computer device 2 that receives and processes entry information from the electronic pen 1, and different dot patterns (coded patterns) are printed. The plurality of sheets 4 </ b> A to 4 </ b> D and a projector 5 that projects the same image as the display image of the computer apparatus 2 onto the sheet 4 in synchronization.

  As shown in FIG. 1, the sheet 4A and the sheet 4B are attached to the wall surface 3A, the sheet 4C is attached to the wall surface 3B, and the sheet 4D is attached to the wall surface 3C. Further, the sheets 4A and 4B are arranged adjacent to each other. Specifically, the sheets 4A and 4B are arranged so as to overlap each other. Or it arrange | positions so that sheet | seat 4A, 4B may match | pause, without overlapping.

  In the example shown in FIG. 1, the image is projected by the projector 5 toward the sheets 4A and 4B attached to the wall surface 3A. However, the orientation of the projector 5 is changed to any one of the sheets 4A to 4D. On the other hand, an image may be projected.

[Sheet]
First, the sheet 4 will be described. A dot pattern indicating the position coordinates of different coordinate areas is printed on the sheets 4A to 4D, and each sheet 4A to 4D is attached to each wall surface such as a room or a partition board. Each sheet 4 may be attached to the wall surface with an adhesive or the like, or may be used as a wall surface by printing a dot pattern on a wall panel. Resin etc. can be used for the material of sheet | seat 4 itself.

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) printed on the sheet 4 will be described. FIG. 2 is a diagram illustrating the relationship between the dots of the dot pattern printed on the sheet 4 and the values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. In other words, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical line and horizontal line). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the sheet 4 are determined by the combination of information thus associated. This dot pattern is printed with an ink containing carbon that absorbs infrared rays.

  FIG. 3A shows an arrangement of dot patterns at a certain position. As shown in FIG. 3 (a), 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained no matter which part of the sheet 4 is taken 6 × 6 dots. Yes. The dot pattern formed by these 36 dots holds relative position coordinates on the sheet 4. FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 1 will be described. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The pen unit 104 is filled with ink that can be erased by wiping with a cloth or the like, and a stroke can be written on the sheet 4 by the pen point unit 103. The user brings the pen tip portion 103 of the electronic pen 1 into contact with the sheet 4 and enters a stroke such as characters or taps (tapping the sheet 4 with the pen tip portion 103). Here, the first contact of the pen tip 103 of the electronic pen 1 with the sheet 4 or the like is called pen-down, and the removal of the pen tip 103 from the contacted (contacted) state is called pen-up. . A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen tip unit 103 when the user writes or taps a character or mark on the sheet 4 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor. To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes a character or the like on the sheet 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure exceeding a predetermined value, the processor 108 It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated. When the user finishes entering one stroke and releases the electronic pen 1 from the sheet 4, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 irradiates infrared rays toward the vicinity of the pen tip portion 103 on the sheet 4. The region is slightly deviated from the position where the pen tip 103 contacts the sheet 4. The CMOS camera 106 captures a dot pattern in the area irradiated by the LED 105 and supplies image data of the dot pattern to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, by photographing with the CMOS camera 106, by setting a threshold value based on the difference in the amount of reflected infrared light, it is possible to distinguish the dot region containing carbon from the other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  The processor 108 performs X, Y coordinates (simply “position coordinates”, “position coordinates” on the sheet 4 of the stroke (handwriting) to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 during the user entry. (Also called “coordinate data”) and dot pattern addresses (coded pattern addresses) unique to the sheet 4 are continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 3 (b). The data is converted into a Y coordinate bit value, and X, Y coordinate data and a dot pattern address are calculated from the data array by a predetermined calculation method. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, the pen pressure data, the dot pattern address, and the X and Y coordinate data. Information including such position coordinates, time information transmitted by the real-time clock 110, and writing pressure data is hereinafter referred to as “stroke information”.

  Since the 6 × 6 dot pattern on the sheet 4 does not overlap in the sheet 4, when the user enters characters or the like with the electronic pen 1, it indicates which position on the sheet 4 the entered position corresponds to. It can be specified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. The communication unit 111 then generates X, Y coordinate data, dot pattern address, time information (time stamp), and writing pressure data (that is, stroke information) generated by the electronic pen 1 from one pen down to pen up. And pen ID (electronic pen identification information) are associated with each other and transmitted to the computer apparatus 2 as entry information. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark).

  In the information processing system, the stroke is projected by the projector 5 according to the movement locus (handwriting) of the pen tip portion 103 of the electronic pen 1 relative to the sheet 4 by the stroke drawing process of the computer apparatus 2. If it is, the pen unit 104 of the electronic pen 1 may have a structure in which ink is not filled.

[Computer device]
Next, the computer apparatus 2 will be described. The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as ROM and RAM, a display, a personal computer including a mouse and a keyboard, and the like. . FIG. 5 is a functional block diagram of the computer apparatus 2. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, a storage unit 25, a display unit 26, and a transmission unit 27. Then, the computer device 2 performs a predetermined process based on the entry information received from the electronic pen 1.

  The receiving unit 22 includes an antenna, a receiving circuit, and the like, and receives entry information from the electronic pen 1 and transmits it to the processing unit 24. The transmission unit 27 outputs an image signal used for displaying an image on the display unit 26 to the projector 5 according to an instruction from the processing unit 24. A data transmission method to the projector 5 is a wireless method even if a wired method is used. There may be. The display means 26 is constituted by a display or the like, and displays the contents instructed by the processing means 24.

  The storage means 25 is configured by a memory such as a hard disk, ROM, or RAM. The storage means 25 stores a management table in which the respective wall surfaces 3A to 3C are associated with dot pattern addresses and dot pattern coordinate areas printed on the sheets 4A to 4D attached thereto.

  FIG. 6 is a conceptual diagram showing the data structure of the management table. As shown in the figure, the coordinate area of the dot pattern printed on each of the sheets 4A to 4D is represented by a corner position (xn, yn), a height Hn, and a width Wn. By determining the angular position, height, and width, the position coordinates included in this coordinate area can be specified. With this management table, the entry information transmitted from the electronic pen 1 can be identified on which sheet 4 of which wall 3 is entered. The storage unit 25 stores the entry information transmitted from the electronic pen 1. Further, the storage means 25 also stores a program for processing entry information.

  The processing means 24 is constituted by a processor such as a CPU. When the receiving information received from the electronic pen 1 by the receiving means 22 is received, the processing means 24 is entered by the electronic pen 1 with reference to the management table stored in the storage means 25. The sheet 4 is identified, and various processes are performed according to the program stored in the storage unit 25. Specifically, the processing unit 24 performs processing for obtaining a boundary line between adjacent sheets 4.

  The processing unit 24 causes the transmission unit 27 to output an image signal for causing the projector 5 to project the same image as the image displayed on the display unit 26 in synchronization. Further, the processing unit 24 has a function of executing a calibration process, and a coordinate conversion function for converting the coordinate system of the dot pattern on the sheet 4 to the coordinate system on the display screen of the display unit 26 of the computer device 2. And the coordinate conversion function is stored in the storage means 25.

[Basic principles of boundary calculation]
Next, the basic principle of boundary line calculation in the first embodiment will be described. In the first embodiment, when the processing unit 24 of the computer apparatus 2 performs an operation of a stroke that crosses the boundary line between the sheets 4 with the electronic pen 1 (in other words, an operation of a stroke that crosses the boundary line), Based on the entry information received from the pen 1, a boundary line between the sheets 4 is obtained. Specifically, the processing means 24 issues an instruction to the user (hereinafter also referred to as “boundary line crossing instruction”) to perform a stroke operation that crosses (crosses) the boundary line between the sheets 4. The stroke information when the boundary line is crossed is acquired from the electronic pen 1. Then, the processing unit 24 refers to the management table in which the dot pattern coordinate area is associated with each sheet 4 and calculates the boundary line of the sheet 4 based on the acquired stroke information. For example, the processing unit 24 acquires two or more strokes that exceed the boundary line, and coordinates of two or more points at which the respective strokes and the boundary line intersect (the points are referred to as “boundary points”). The boundary line is calculated based on the obtained boundary coordinates.

  FIG. 7 is a diagram for specifically explaining the boundary line calculation in the first embodiment. As shown in FIG. 7, sheets 4A and 4B on which different dot patterns are printed are bonded to the wall surface 3A so as to overlap each other.

  It is assumed that the user has operated the stroke 8 exceeding the boundary line 7 of the sheets 4A and 4B by the processing means 24 giving an instruction to exceed the first boundary line. In this case, the processing unit 24 receives stroke information and the like from the electronic pen 1, and based on the stroke information and the management table stored in the storage unit 25, the boundary point 8a where the stroke 8 and the boundary line 7 intersect. Find the boundary coordinates of. Specifically, the processing unit 24 refers to the management table to continuously identify which of the sheets 4A and 4B the coordinate data included in the stroke information is included, and the sheet including the coordinate data. Is recognized as a boundary point 8a. In other words, the processing means 24 recognizes the point when the coordinate data value changes discontinuously from the state where the coordinate data value changes continuously as the boundary point 8a. Then, the processing unit 24 obtains the coordinates of the boundary point 8a on the sheet 4A and the coordinates of the boundary point 8a on the sheet 4B as boundary coordinates.

  In addition, it is assumed that the user has performed an operation of drawing a stroke 9 exceeding the boundary line 7 of the sheets 4A and 4B by the processing means 24 giving an instruction to cross the second boundary line. In this case, the processing unit 24 receives stroke information from the electronic pen 1 and based on the stroke information and the management table stored in the storage unit 25, the boundary of the boundary point 9a where the stroke 9 and the boundary line 7 intersect. Find the coordinates. Specifically, the processing unit 24 recognizes the boundary point 9a when the sheet including the coordinate data is switched from the sheet 4A to the sheet 4B by the above-described procedure, and the coordinates of the boundary point 9a in the sheet 4A are determined. The coordinates of the boundary point 9a on the sheet 4B are obtained as boundary coordinates.

  Thereafter, the processing means 24 calculates the boundary line 7 based on the boundary coordinates of the boundary points 8a and 9a. Specifically, the processing unit 24 calculates a straight line obtained by connecting the boundary point 8 a and the boundary point 9 a as the boundary line 7. At this time, for example, the processing unit 24 obtains an expression of a linear function of the boundary line 7 from the two boundary coordinates, and stores the data of the two boundary coordinates and the data of the linear function in association with each other. That is, assuming that the boundary line in each sheet 4 is “Y = aX + b”, the coefficients a and b are obtained from the two boundary coordinates. Therefore, the boundary point 8a and the boundary point 9a must be at different positions. Further, the processing unit 24 obtains the position of the sheets 4A and 4B on the straight line of such a linear function, for example, obtains the range on which the sheets 4A and 4B are located, Can also be memorized. As an example, the coordinates of the end portions of the sheets 4A and 4B positioned on the straight line of the linear function can be stored.

  The timing for obtaining the boundary coordinates from the stroke is not limited to obtaining the boundary coordinates from the stroke immediately after the user operates the stroke beyond the boundary line. That is, the present invention is not limited to obtaining the boundary coordinates included in the stroke each time a stroke beyond the boundary line is operated. In another example, the boundary coordinates can be collectively obtained from each stroke after the user completes the operation of the stroke exceeding the boundary line a plurality of times.

  7 illustrates the case where the sheets 4A and 4B are laminated so as to overlap each other, but the above description also applies to the case where the sheets 4A and 4B are stuck together without overlapping. The boundary line 7 can be calculated by a method similar to the above method. Further, although a vertical line is shown as the boundary line 7 in FIG. 7, the boundary line is not limited to a vertical line, and a boundary line such as a horizontal line or an oblique line can be calculated by the same method.

[Boundary calculation processing flow]
Next, with reference to FIG. 8, the boundary line calculation process in the information processing system in the first embodiment will be described. FIG. 8 is a flowchart of the boundary line calculation process in the first embodiment. In this processing flow, after the operation of strokes exceeding two boundary lines is completed, boundary coordinates and boundary lines are obtained collectively from the strokes.

  First, in the computer apparatus 2, the processing means 24 instructs the user to cross the first boundary line (step S201). For example, the processing unit 24 issues the instruction using an image and / or sound.

  Next, the user uses the electronic pen 1 to enter a stroke on the sheet 4 so as to cross the boundary line between the sheets 4 (see FIG. 7: stroke 8). Then, the electronic pen 1 detects contact with the sheet 4 when the pressure sensor 107 detects a writing pressure of a predetermined value or more, and images a dot pattern along the handwriting by the camera 106 while irradiating infrared rays with the LED 105. Then, the processor 108 continuously calculates the X and Y coordinates along the handwriting from the image data of the captured dot pattern, the position coordinates, the time information transmitted by the real-time clock 110, and the pen pressure data (that is, , Stroke information) and the pen ID are associated with each other and transmitted to the computer apparatus 2 immediately and sequentially as entry information (step S101).

  Next, in the computer apparatus 2, when the receiving means 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry information is stored in the storage means 25 as information indicating the first boundary point ( Step S202). Then, the processing unit 24 instructs the user to cross the second boundary line (step S203). For example, the processing unit 24 issues the instruction using an image and / or sound.

  Next, the user uses the electronic pen 1 to enter a stroke on the sheet 4 so as to cross the boundary line between the sheets 4 (see FIG. 7: stroke 9). Then, the electronic pen 1 generates stroke information according to the procedure described in step S101, associates the stroke information with the pen ID, and immediately and sequentially transmits the information as entry information to the computer apparatus 2 (step S102). ).

  Next, in the computer apparatus 2, when the receiving means 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry information is stored in the storage means 25 as information indicating the second boundary point ( Step S204).

  Then, the processing means 24 obtains two boundary coordinates from the entry information stored in step S202 and the entry information stored in step S204, and determines the distance between the two sheets 4 from the boundary coordinates of the two sheets 4 at the two places. Is obtained (step S205). Specifically, the processing means 24 recognizes two boundary points based on such entry information and the management table stored in the storage means 25 and obtains the boundary coordinates of each sheet 4 to obtain the boundary coordinates. Further, the boundary line of each sheet 4 is obtained by a linear function from each of the two boundary coordinates, and the joining relationship between the sheets 4 is obtained. Then, the process ends. After the boundary line is obtained in this way, the computer apparatus 2 performs various processes such as a calibration process and a stroke recognition process based on the obtained boundary line.

[Operational effects of the information processing system of the first embodiment]
According to the information processing system of the first embodiment, when sheets 4 on which different dot patterns are formed are arranged adjacent to each other, such a boundary line between the sheets 4 can be appropriately obtained. Accordingly, it is possible to appropriately perform subsequent calibration processing, stroke recognition processing, and the like, using the obtained boundary line and joint relationship. In particular, the computer device 2 can recognize a continuous stroke even if a stroke across the boundary line is drawn by the electronic pen 1 based on the determined relationship between the boundary line and the sheet 4.

<Modification>
In the first embodiment, two boundary points are recognized by two different strokes that are separated from each other. However, one “◯” -shaped or “U” -shaped stroke is bounded by the electronic pen 1. You may make it recognize two boundary points by the computer apparatus 2 by drawing so that it may straddle in two places of a line.

Second Embodiment
Next, an information processing system in the second embodiment will be described. In the description of the second embodiment, the configuration different from the first embodiment will be mainly described. In the second embodiment, the same reference numerals as those in the first embodiment and those not particularly mentioned are the same as those in the first embodiment.

  In the first embodiment described above, the configuration for calculating the boundary line between the sheets when two sheets are arranged adjacent to each other is shown. However, in the second embodiment, three or more sheets are arranged adjacent to each other. The boundary line between sheets is calculated for the case where the sheet is present. In other words, in the second embodiment, calculation is performed for two or more boundary lines. In the second embodiment, when a stroke operation that exceeds a plurality of boundary lines is performed at a time, a plurality of boundary coordinates are obtained from the stroke. That is, in the second embodiment, a stroke that exceeds a plurality of boundary lines at one time is allowed, and when a plurality of boundary coordinates are included in one stroke, all boundary coordinates are obtained (note that When only one boundary coordinate is included in one stroke, one boundary coordinate is obtained). As described above, in the second embodiment, a plurality of boundary lines are obtained by obtaining and assembling boundary coordinates necessary for calculating all of the plurality of boundary lines from the strokes performed for exceeding the boundary lines. The operation for obtaining is performed.

  FIG. 9 is a diagram for specifically explaining the boundary line calculation in the second embodiment. As shown in FIG. 9, sheets 4E, 4F, 4G, and 4H on which different dot patterns are printed are arranged adjacent to each other, and the user issues strokes 16 and 17 when the computer apparatus 2 issues an instruction to exceed the boundary line. Suppose you have gone. The stroke 16 is a stroke exceeding the boundary line 11 of the sheets 4E and 4F. The stroke 17 is a stroke that exceeds the boundary line 12 of the sheets 4G and 4H, the boundary line 13 of the sheets 4E and 4G, the boundary line 11 of the sheets 4E and 4F, and the boundary line 14 of the sheets 4F and 4H. That is, the stroke 17 is a stroke that exceeds the four boundary lines 11 to 14.

  In the computer apparatus 2, the processing unit 24 obtains the boundary coordinates of one boundary point 16 a based on the stroke information corresponding to the stroke 16, and the four boundary points 17 a to 17 d based on the stroke information corresponding to the stroke 17. Find boundary coordinates. In this case, by referring to the management table, the processing unit 24 continuously specifies which of the sheets 4E to 4H the coordinate data included in the stroke information is included, and the sheet including the coordinate data is switched. Recognize a point as a boundary point. In other words, the processing means 24 recognizes a point when the value of the coordinate data changes discontinuously from the state where the value of the coordinate data changes continuously as a boundary point.

  Then, the processing unit 24 obtains the coordinates of the boundary point 16a on the sheet 4E and the coordinates of the boundary point 16a on the sheet 4F as boundary coordinates. The processing unit 24 obtains the coordinates of the boundary point 17a on the sheet 4G and the coordinates of the boundary point 17a on the sheet 4H as boundary coordinates, and obtains the coordinates of the boundary point 17b on the sheet 4E and the coordinates of the boundary point 17b on the sheet 4G. As boundary coordinates, the coordinates of the boundary point 17c on the sheet 4E and the coordinates of the boundary point 17c on the sheet 4F are determined as boundary coordinates, and the coordinates of the boundary point 17d on the sheet 4F and the coordinates of the boundary point 17d on the sheet 4H are boundary coordinates. Asking.

  Thereafter, the processing unit 24 calculates the boundary lines 11 to 14 based on the boundary coordinates of the boundary points 16a and 17a to 17d. In order to calculate one boundary line, two or more boundary points on the boundary line are required. Therefore, in order to calculate the boundary lines 12, 13, and 14, in addition to the boundary points 17a, 17b, and 17d, The boundary coordinates of the boundary points located on the boundary lines 12, 13, and 14 are required. That is, the user needs to separately perform a stroke operation that exceeds the boundary lines 12, 13, and 14.

  FIG. 9 shows a case where a stroke operation exceeding four boundary lines 11 to 14 is performed at one time. However, a stroke operation exceeding two boundary lines at one time and three boundaries at one time are illustrated. Even when an operation of a stroke exceeding the line is performed, the boundary line can be calculated by obtaining boundary coordinates by the same method as described above. Also, even when a stroke operation is performed such that one boundary line is exceeded several times at a time, the boundary line can be calculated by obtaining boundary coordinates by the same method.

[Boundary calculation processing flow]
Next, with reference to FIG. 10, the boundary line calculation process in the information processing system in the second embodiment will be described. FIG. 10 is a flowchart of boundary line calculation processing in the second embodiment. In this processing flow, after the operation of strokes exceeding two boundary lines is completed for all boundary lines, boundary coordinates and boundary lines are obtained collectively from the strokes.

  First, in the computer apparatus 2, the processing means 24 issues an instruction to cross the boundary line to the user (step S401). For example, the processing unit 24 issues the instruction using an image and / or sound.

  Next, the user uses the electronic pen 1 to enter a stroke on the sheet 4 so as to cross the boundary line between the sheets 4. Then, the electronic pen 1 detects contact with the sheet 4 when the pressure sensor 107 detects a writing pressure of a predetermined value or more, and images a dot pattern along the handwriting by the camera 106 while irradiating infrared rays with the LED 105. Then, the processor 108 continuously calculates the X and Y coordinates along the handwriting from the image data of the captured dot pattern, the position coordinates, the time information transmitted by the real-time clock 110, and the pen pressure data (that is, , Stroke information) and the pen ID are associated with each other and transmitted to the computer apparatus 2 immediately and sequentially as entry information (step S301-1).

  Next, in the computer apparatus 2, when the receiving unit 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry unit 22 stores the entry information in the storage unit 25 (step S402-1).

  Thereafter, the user repeatedly performs stroke entry beyond the boundary line with the electronic pen 1 as necessary to calculate all the boundary lines. The electronic pen 1 generates stroke information each time a stroke operation beyond the boundary line is performed, associates the stroke information with the pen ID, and transmits the stroke information to the computer device 2 as entry information (step S301-). 2-S301-n). In the computer apparatus 2, every time the receiving means 22 receives the entry information from the electronic pen 1, the entry information is stored in the storage means 25 (steps S402-2 to S402-n).

  In addition, when there are not enough stroke operations necessary to calculate all the boundary lines, specifically when the boundary coordinates required to calculate all the boundary lines are insufficient The computer apparatus 2 can transmit the fact to the user. For example, when there is a boundary line for which two boundary coordinates are not obtained, the processing unit 24 of the computer apparatus 2 instructs the user to perform a stroke operation that exceeds the boundary line.

  Next, in the computer apparatus 2, the processing means 24 recognizes the boundary coordinates of the boundary point from each stroke (step S403). Specifically, the processing unit 24 calculates the boundary coordinates of the boundary points included in each stroke based on the entry information stored in steps S402-1 to S402-n and the management table stored in the storage unit 25. Ask. Note that when the user completes stroke entry beyond all necessary boundaries, information to that effect may be keyed into the computer device 2. Here, it is not limited to obtaining the boundary coordinates after the user completes the operation of the stroke exceeding the boundary line a plurality of times. In another example, each time the user operates a stroke beyond the boundary line, the boundary coordinates included in the stroke can be obtained.

  Next, the processing unit 24 obtains a boundary line between the sheets 4 based on the boundary coordinates recognized in step S403 (step S404). That is, the processing unit 24 recognizes two boundary points between adjacent sheets 4 based on the entry information and the management table stored in the storage unit 25 and obtains the boundary coordinates of each sheet 4. The boundary line between adjacent sheets 4 is obtained by a linear function from the obtained two boundary coordinates, and the joining relationship between the sheets 4 is obtained. Then, the process ends. After the boundary line is obtained in this way, the computer apparatus 2 performs various processes such as a calibration process and a stroke recognition process based on the obtained boundary line.

[Operational effects of the information processing system of the second embodiment]
According to the information processing system of the second embodiment, a plurality of boundary coordinates necessary for calculating all of the plurality of boundary lines are obtained from each stroke performed for crossing the boundary line, and are assembled. The boundary line can be calculated appropriately. Accordingly, it is possible to appropriately perform subsequent calibration processing, stroke recognition processing, and the like using the calculated boundary line and joint relationship. In particular, the computer device 2 can recognize a continuous stroke even if a stroke across the boundary line is drawn by the electronic pen 1 based on the determined relationship between the boundary line and the sheet 4.

<Modification>
FIG. 11 is a system configuration diagram of an information processing system according to a modification. In addition, about the structure which has attached | subjected the same code | symbol as 1st Embodiment, it shall be the structure similar to 1st Embodiment (refer FIG. 1).

  As indicated by reference numerals 4Aa, 4Ba, 4Ca, and 4Da in FIG. 11, identification information “01”, “02”, “03”, and “04” unique to the sheet is printed on each of the sheets 4A to 4D. This identification information is printed with ink having no infrared absorption characteristic so as not to obstruct the reading of the dot pattern by the electronic pen 1. In the management table stored in the storage unit 25, the identification information is registered in association with the coordinate area of the dot pattern on each of the wall surfaces 3A to 3C.

  According to the information processing system in the modification, the user can easily understand the dot pattern identification information of each sheet 4 when the plurality of sheets 4 are pasted.

  The present invention is not limited to application to an information processing system configured with the projector 5, and can be similarly applied to an information processing system configured without the projector 5. Further, the place where the sheet 4 is pasted is not limited to the wall surface 3. In addition to the wall surface 3, for example, the sheet 4 may be attached on a desk or the like. Moreover, although the shape of the sheet | seat 4 was a rectangle, not only this but another shape may be sufficient. In this case, the boundary coordinates may be acquired by entering a stroke beyond the boundary line with an electronic pen 1 at an appropriate position so that the boundary line can be calculated according to the shape.

  Furthermore, in the above-described embodiment, the Anoto dot pattern (coding pattern) is used. However, the present invention is not limited to this.

  This information processing system can be used in school classes, company conference rooms, lectures, presentations, and the like.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 21 ... Input means 22 ... Reception means 24 ... Processing means 25 ... Storage means 26 ... Display means 27 ... Transmission means 3 ... Wall surface 4 ... Sheet 5 ... Projector 7,11-14 ... Boundary line

Claims (15)

A coding pattern indicating the position coordinates of different coordinate areas is formed, and a plurality of sheets arranged adjacent to each other,
An electronic pen having reading means for reading the coded pattern;
A computer device that receives information on the coding pattern transmitted from the reading unit and performs processing according to the information;
The computer device includes:
Receiving means for receiving information on the coding pattern transmitted from the electronic pen;
Boundary line calculating means for obtaining a boundary line between the sheets based on information on the coding pattern received by the receiving means when an operation of a stroke across the boundary line between the sheets is performed by the electronic pen; An information processing system comprising:   The information processing system according to claim 1, wherein the boundary line calculation unit obtains a joining relationship at a boundary line between the sheets. The computer apparatus further includes a storage unit that stores a management table in which a coordinate area of the coding pattern is associated with each sheet,
The information processing system according to claim 1, wherein the boundary line calculation unit obtains the boundary line with reference to the management table stored in the storage unit.   The boundary calculation unit obtains boundary coordinates of a boundary point where the stroke and the boundary line intersect based on the information regarding the coding pattern received by the receiving unit and the management table, and based on the boundary coordinates The information processing system according to claim 3, wherein the boundary line is obtained.   The information processing system according to claim 4, wherein the boundary line calculation unit obtains the boundary coordinates on the plurality of boundary lines when an operation of a stroke across the plurality of boundary lines is performed.   The said computer apparatus is further provided with the instruction | indication means which instruct | indicates with respect to a user to perform the operation of the stroke which straddles the boundary line between the said sheets, The Claim 1 thru | or 5 characterized by the above-mentioned. Information processing system.   The information processing system according to claim 1, wherein the boundary line calculation unit obtains and stores the recognized boundary line as data of at least a linear function.   8. The information processing system according to claim 1, wherein the identification information is formed so as to be visible for each of the plurality of sheets. Coded patterns indicating the position coordinates of different coordinate areas are formed, and used with a plurality of adjacently arranged sheets. Information on the coded patterns transmitted from an electronic pen having reading means for reading the coded patterns. A program that is received and executed on a computer device that performs processing according to the information,
Receiving means for receiving information on the coding pattern transmitted from the electronic pen;
Boundary line calculating means for obtaining a boundary line between the sheets based on information on the coding pattern received by the receiving means when a stroke operation across the boundary line between the sheets is performed by the electronic pen. A program for causing the computer apparatus to function.   The program according to claim 9, wherein the boundary line calculation unit obtains a joining relationship at a boundary line between the sheets. Further causing the computer device to function as a storage unit that stores a management table in which a coordinate area of the coding pattern is associated with each sheet,
The program according to claim 9 or 10, wherein the boundary line calculation unit obtains the boundary line with reference to the management table stored in the storage unit.   The boundary calculation unit obtains boundary coordinates of a boundary point where the stroke and the boundary line intersect based on the information regarding the coding pattern received by the receiving unit and the management table, and based on the boundary coordinates The program according to claim 11, wherein the boundary line is obtained.   The program according to claim 12, wherein the boundary line calculation unit obtains the boundary coordinates on the plurality of boundary lines when an operation of a stroke across the plurality of boundary lines is performed.   14. The computer device according to claim 9, further causing the computer apparatus to function as an instruction unit that issues an instruction to a user to perform a stroke operation across a boundary line between the sheets. program.   The program according to any one of claims 9 to 14, wherein the boundary line calculation means obtains and stores the recognized boundary line as data of at least a linear function.

Images