JP3154685U - Information processing system - Google Patents

Abstract

The present invention provides a system in which wall surfaces are effectively used by forming a coding pattern that can be read with an electronic pen on a plurality of wall surfaces in a room. A sheet printed with a dot pattern indicating the position coordinates of different coordinate areas is attached to each wall surface of a room. An electronic pen 1 that reads the dot pattern and calculates position coordinates, and a computer device 2 that receives input information transmitted from the electronic pen 1 and performs processing according to the information are provided. In such an information processing system, the computer apparatus 2 stores in the storage means a management table in which the wall surface 3 is associated with the coordinate area of the dot pattern attached thereto, and the processing means refers to the management table. Thus, the input sheet 4 of the wall surface 3 is identified from the input information transmitted from the electronic pen 1. [Selection] Figure 1

Description

  The present invention relates to an information processing system capable of inputting information using a coding pattern indicating position coordinates, and more particularly to a system in which a coding pattern is formed on a wall surface.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto pen” developed by Swedish company Anoto is known as a representative example. Anotopen is used together with a special sheet on which a dot pattern indicating position coordinates patterned by a predetermined algorithm is printed (see, for example, Patent Document 1).

  In addition, using such an electronic pen, a computer, a projector, and a screen, when the screen is filled in or scanned with the electronic pen, the computer performs a predetermined process accordingly and projects the computer display screen onto the screen with the projector. The present applicant has proposed a system that performs the above (for example, Patent Document 2). Here, a calibration process for matching the coordinate system of the dot pattern formed on the screen with the coordinate system on the display screen of the computer device is also proposed. In addition, in a similar system, it has also been proposed to attach a screen on which a dot pattern is formed to a wall surface with a hook or the like (Patent Document 3).

Japanese translation of PCT publication No. 2003-511761 Utility Model Registration No. 3151886 JP 2002-149331 A

  In recent years, there has been a growing need for conferences and presentations using such a system using an electronic pen. Therefore, the present invention aims to provide a system that effectively utilizes wall surfaces by forming a coding pattern that can be read with an electronic pen on a plurality of wall surfaces such as rooms and partition boards used in meetings and presentations. And

An information processing system according to the present invention is a sheet attached to a wall surface, on which a coding pattern indicating a position coordinate of a different coordinate area is formed for each wall surface, a reading unit that reads the coding pattern, and a transmission from the reading unit A computer device that receives information on the encoded pattern and performs processing according to the information,
The computer device is a management table in which receiving means for receiving information on a coding pattern transmitted from the electronic pen is associated with a wall surface and a coordinate area of a coding pattern formed on a sheet attached to the wall surface. And a processing unit for referring to the management table stored in the storage unit and for identifying a sheet filled with an electronic pen from information on the coding pattern received by the receiving unit. It is characterized by.

  According to the present invention, the storage means stores a management table in which each wall surface is associated with the coordinate area of the coding pattern formed on the sheet attached to each wall. By using the table, it is possible to identify which wall sheet is filled with the information transmitted from the electronic pen.

  Furthermore, in the information processing system, the position coordinates indicated by the coding pattern formed on the adjacent wall surface may be configured to be continuous at the boundary between the wall surfaces. With this configuration, it is possible to fill in with the electronic pen up to the boundary of the wall surface, and the wall surface can be used effectively.

  Further, in the information processing system, identification information may be formed on the sheet for each wall surface. With this configuration, the identification information of the coding pattern attached to each wall surface is easily understood by the user.

  According to the present invention, the processing unit of the computer apparatus refers to the management table stored in the storage unit, and the information transmitted from the electronic pen is written on which sheet attached to the wall surface. The system can be configured using the wall surface effectively.

It is a system configuration figure of the information processing system in a 1st embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a conceptual diagram which shows the data structure of a management table. It is a flowchart of the sheet identification process in 1st Embodiment. It is a system configuration figure of the information processing system in a 2nd embodiment. It is a flowchart of the sheet identification process in 2nd Embodiment. It is a system configuration figure of an information processing system in a 3rd embodiment. It is a system configuration figure of the information processing system in a 4th embodiment.

  Hereinafter, a preferred information processing system of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
[System configuration of information processing system]
FIG. 1 is a system configuration diagram of an information processing system according to the first embodiment. As shown in FIG. 1, the information processing system according to the first embodiment includes an electronic pen 1 used by a user, a computer device 2 that receives and processes entry information from the electronic pen 1, and a dot pattern (coding). Pattern) is printed and sheets 4A to 4C attached to the respective wall surfaces 3A to 3C of the room.

[Sheet]
First, the sheet 4 will be described. A dot pattern indicating the position coordinates of different coordinate areas is printed on the sheets 4A to 4C, and each sheet 4A to 4C is attached to each wall surface such as a room or a partition board. Each sheet 4 may be attached to the wall surface with an adhesive or the like, or may be used as a wall surface by printing a dot pattern on a wall panel. Resin etc. can be used for the material of sheet | seat 4 itself.

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) printed on the sheet 4 will be described. FIG. 2 is a diagram illustrating the relationship between the dots of the dot pattern printed on the sheet 4 and the values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. In other words, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical line and horizontal line). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the sheet 4 are determined by the combination of information thus associated. This dot pattern is printed with an ink containing carbon that absorbs infrared rays.

  FIG. 3A shows an arrangement of dot patterns at a certain position. As shown in FIG. 3 (a), 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained no matter which part of the sheet 4 is taken 6 × 6 dots. Yes. The dot pattern formed by these 36 dots holds relative position coordinates on the sheet 4. FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 1 will be described. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real-time clock 110, an antenna, and the like, and a battery 112 are provided. The pen unit 104 is filled with ink that can be erased by wiping with a cloth or the like, and a stroke can be written on the sheet 4 by the pen point unit 103. The user brings the pen tip portion 103 of the electronic pen 1 into contact with the sheet 4 and enters a stroke such as characters or taps (tapping the sheet 4 with the pen tip portion 103). Here, the first contact of the pen tip 103 of the electronic pen 1 with the sheet 402 or the like is called pen-down, and the removal of the pen tip 103 from the contacted (contacted) state is called pen-up. . A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen tip unit 103 when the user writes or taps a character or mark on the sheet 4 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor. To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes a character or the like on the sheet 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure exceeding a predetermined value, the processor 108 It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated. When the user finishes entering one stroke and releases the electronic pen 1 from the sheet 4, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 irradiates infrared rays toward the vicinity of the pen tip portion 103 on the sheet 4. The region is slightly deviated from the position where the pen tip 103 contacts the sheet 4. The CMOS camera 106 captures a dot pattern in the area irradiated by the LED 105 and supplies image data of the dot pattern to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, by photographing with the CMOS camera 106, by setting a threshold value based on the difference in the amount of reflected infrared light, it is possible to distinguish the dot region containing carbon from the other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  The processor 108 performs X, Y coordinates (simply “position coordinates”, “position coordinates” on the sheet 4 of the stroke (handwriting) to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 during the user entry. (Also called “coordinate data”) and dot pattern addresses (coded pattern addresses) unique to the sheet 4 are continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 3 (b). The data is converted into a Y coordinate bit value, and X, Y coordinate data and a dot pattern address are calculated from the data array by a predetermined calculation method. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, the writing pressure data, the dot pattern address, and the X and Y coordinate data. Since the 6 × 6 dot pattern on the sheet 4 does not overlap in the sheet 4, when the user enters characters or the like with the electronic pen 1, it indicates which position on the sheet 4 the entered position corresponds to. It can be specified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. The communication unit 111 then generates X, Y coordinate data, dot pattern address, time information (time stamp), writing pressure data (hereinafter, “stroke information”) generated by the electronic pen 1 from one pen down to pen up. ) And a pen ID (electronic pen identification information) are associated with each other and transmitted to the computer apparatus 2 as entry information. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark).

[Computer device]
Next, the computer apparatus 2 will be described. The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as ROM and RAM, a display, a personal computer including a mouse and a keyboard, and the like. . FIG. 5 is a functional block diagram of the computer apparatus 2. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, a storage unit 25, a display unit 26, and a transmission unit 27. Then, the computer device 2 performs a predetermined process based on the entry information received from the electronic pen 1.

  The receiving unit 22 includes an antenna, a receiving circuit, and the like, and receives entry information from the electronic pen 1 and transmits it to the processing unit 24. The transmission unit 27 outputs an image signal used for displaying an image on the display unit 26 to a projector 6 (described later) or the like according to an instruction from the processing unit 24. A data transmission method to the projector 6 is a wired type. May be wireless. The display means 26 is constituted by a display or the like, and displays the contents instructed by the processing means 24.

  The storage means 25 is configured by a memory such as a hard disk, ROM, or RAM. The storage means 25 stores a management table in which the respective wall surfaces 3A to 3C are associated with dot pattern addresses and dot pattern coordinate areas printed on the sheets 4A to 4C attached thereto. FIG. 6 is a conceptual diagram showing the data structure of the management table. As shown in the figure, the coordinate area of the dot pattern printed on each of the sheets 4A to 4C is represented by a corner position (xn, yn), a height Hn, and a width Wn. By determining the angular position, height, and width, the position coordinates included in this coordinate area can be specified. With this management table, the entry information transmitted from the electronic pen 1 can be identified on which sheet 4 of which wall 3 is entered. The storage unit 25 stores the entry information transmitted from the electronic pen 1. Further, the storage means 25 also stores a program for processing entry information.

  The processing means 24 is constituted by a processor such as a CPU. When the receiving information received from the electronic pen 1 by the receiving means 22 is received, the processing means 24 is entered by the electronic pen 1 with reference to the management table stored in the storage means 25. The sheet 4 is identified, and various processes are performed according to the program stored in the storage unit 25. The processing unit 24 causes the transmission unit 27 to output an image signal for causing the projector 6 to project the same image as the image displayed on the display unit 26 in synchronization.

<Sheet identification processing flow>
Next, a sheet identification process in the information processing system will be described with reference to FIG.

  FIG. 7 is a flowchart of the sheet identification process. First, the user performs writing or tapping on the sheet 4 of the wall surface 3 using the electronic pen 1. Then, the electronic pen 1 detects contact with the sheet 4 when the pressure sensor 107 detects a writing pressure of a predetermined value or more, and images a dot pattern along the handwriting by the camera 106 while irradiating infrared rays with the LED 105. Then, the processor 108 continuously calculates the X and Y coordinates along the handwriting from the image data of the captured dot pattern, the position coordinates, the time information transmitted by the real-time clock 110, the writing pressure data (hereinafter, In association with the “stroke information”) and the pen ID, it is immediately and sequentially transmitted to the computer apparatus 2 as entry information (step S101).

  In the computer apparatus 2, when the receiving means 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry information is stored in the storage means 25 (step S201). Then, the processing means 24 refers to the management table stored in the storage means 25 and identifies which wall surface 3 is filled in from the coordinate data included in the stroke information of the entry information. (Step S202). Subsequently, the processing unit 24 stores the stroke information in the storage unit 25 in the specified file for the sheet 4 and performs processing such as drawing the stroke on the display unit 26 (step S203).

<Operational effect of the first embodiment>
As described above, according to the information processing system of the first embodiment, the storage unit 25 corresponds to the coordinate areas of the dot patterns printed on the respective wall surfaces 3A to 3C and the sheets 4A to 4C attached thereto. Since the attached management table is stored, the processing means 24 identifies which wall surface 3 is attached to the sheet 4 attached to the entry information transmitted from the electronic pen 1 by using this management table. it can.

Second Embodiment
Next, an information processing system in the second embodiment will be described. In the description of the second embodiment, the configuration different from the first embodiment will be mainly described. In the second embodiment, the same reference numerals as those in the first embodiment are the same as those in the first embodiment unless otherwise specified.

  FIG. 8 is a system configuration diagram of the information processing system in the second embodiment. In the second embodiment, as shown in FIG. 8, in the information processing system, the projector 6 is connected to the transmission unit 27 of the computer apparatus 2, and the same image as the display unit 26 is synchronized, and the projector 6 4 is projected. The processing unit 24 of the computer apparatus 2 has a function of executing a calibration process, and converts the dot pattern coordinate system on the sheet 4 into the coordinate system on the display screen of the display unit 26 of the computer apparatus 2. The coordinate conversion function is obtained, and the coordinate conversion function is stored in the storage means 25. In the example shown in FIG. 8, the image is projected by the projector 6 toward the sheet 4 </ b> A attached to the wall surface 3 </ b> A, but the image of any of the sheets 4 </ b> A to 4 </ b> C is changed by changing the orientation of the projector 6. May be projected. However, each time the orientation of the projector 6 is changed, calibration processing is performed and the coordinate conversion function is updated.

  Here, in the information processing system of the second embodiment, the stroke is projected by the projector 6 in accordance with the movement locus (handwriting) of the pen tip portion 103 of the electronic pen 1 with respect to the sheet 4. The pen unit 104 is not filled with ink, and the pen unit 104 may not have a structure in which ink is directly applied to the sheet 4.

<Sheet identification processing flow>
Next, a sheet identification process in the information processing system will be described with reference to FIG.

  FIG. 9 is a flowchart of sheet identification processing in the second embodiment. The user fills in or taps on the sheet 4 of the wall surface 3 using the electronic pen 1. The electronic pen 1 detects contact with the sheet 4 when the pressure sensor 107 detects a writing pressure equal to or higher than a predetermined value, images a dot pattern along the handwriting with the camera 106 while irradiating infrared rays with the LED 105, The processor 108 continuously calculates the X and Y coordinates along the handwriting from the image data of the captured dot pattern, the position coordinates, the time information transmitted by the real-time clock 110, the stroke information including the writing pressure data, In association with the pen ID, it is immediately and sequentially transmitted to the computer apparatus 2 as entry information (step S301).

  In the computer apparatus 2, when the receiving unit 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the entry unit 22 stores the entry information in the storage unit 25 (step S401). Then, the processing means 24 refers to the management table stored in the storage means 25 and identifies which wall surface 3 is filled in from the coordinate data included in the stroke information of the entry information. (Step S402). Then, the processing unit 24 converts the coordinate data included in the stroke information into coordinate values on the display screen of the display unit 26 using the coordinate conversion function stored in the storage unit 25 (step S403). Subsequently, the processing unit 24 stores the stroke information after the coordinate conversion in the specified file for the sheet 4 in the storage unit 25 (step S404), and performs processing such as drawing the stroke on the display unit 26. An image signal for projecting an image similar to the image displayed on the display unit 26 onto the sheet 4 on the wall surface 3 is sequentially transmitted to the projector 6 via the transmission unit 27 (step S405).

  The projector 6 projects an image onto the sheet 4 every time an image signal is received from the transmission unit 27 (step S501). At this time, since the coordinate system of the dot pattern on the sheet 4 and the coordinate system on the display screen of the display unit 26 of the computer apparatus 2 are associated by a coordinate conversion function, the pen tip portion of the electronic pen 1 with respect to the sheet 4 According to the movement trajectory (handwriting) 103, the stroke is projected by the projector 6 almost in real time. Note that transmission of an image signal from the computer apparatus 2 to the projector 6 is always performed even if the computer apparatus 2 does not receive entry information from the electronic pen 1.

  In the information processing system of the second embodiment, the computer device 2 displays a document such as a meeting created by a general-purpose application for document creation or presentation on the display means 26, and a sheet by the projector 6 4 and may be written on the document image projected onto the sheet 4 by the electronic pen 1. In this case, the processing means 24 is identified in step 404 by associating the stroke information after the coordinate conversion with the image data of the material projected when the stroke information was generated or the data for identifying the material. It may be stored in a file for sheet 4.

<Operational effects of the second embodiment>
In the information processing system according to the second embodiment, the same effects as the information processing system according to the first embodiment are achieved, and the coordinate system of the dot pattern of the sheet 4 corresponds to the coordinate system of the display screen of the display means 26. Therefore, the stroke is projected by the projector 6 in accordance with the entry by the user using the electronic pen 1 on the sheet 4.

<Third Embodiment>
Next, an information processing system in the third embodiment will be described. In 1st, 2nd embodiment, although divided | segmented sheet | seat 4A-4C was attached for every wall surface 3, in 3rd Embodiment instead, by the dot pattern formed in adjacent wall surfaces 3 mutually. The position coordinates shown are assumed to be continuous at the boundary of the wall surface.

  FIG. 10 is a diagram illustrating an information processing system according to the third embodiment. As shown in FIG. 10, a sheet 4 on which a single dot pattern is printed is attached to the wall surfaces 3A to 3C. At this time, the sheet | seat 4 is divided into each sheet | seat 4A-4C by the boundary of wall surface 3A-3C. In addition, as for the sheet | seat 4, it is desirable to extend over the whole surface of each wall surface 3A-3C. By doing in this way, the dot pattern of a different coordinate area | region will be formed for every wall surface 3. FIG. Here, in the management table stored in the storage unit 25, the wall surface 3, the sheet 4, the dot pattern address, and the coordinate area of the dot pattern are registered in association with each other so that the section for each sheet 4 can be understood. In order to recognize the section of the sheet 4, information on the section of the adjacent sheet 4 is stored in the storage unit 25 by tracing the section line on the section line by drawing the line with the electronic pen 1 on the section section of the sheet 4. The coordinate data on the lane line is stored in the storage unit 25, or the dot pattern of at least two points on the lane line is read by the electronic pen 1 and the processing unit 24 recognizes the lane line. It may be generated and stored in the storage means 25.

<Operational effect of the third embodiment>
In the information processing system according to the third embodiment, the same effect as the information processing system according to the first and second embodiments is obtained, and the position coordinates indicated by the dot pattern formed on the adjacent wall surface are the wall surface 3. Therefore, it is possible to fill in with the electronic pen 1 up to the boundary of the wall surface 3, and the wall surface 3 can be used effectively.

<Fourth embodiment>
Next, an information processing system according to the fourth embodiment will be described. Identification information is printed on each of the sheets 4A to 4C in the first to third embodiments.

  FIG. 11 is a diagram illustrating an information processing system according to the fourth embodiment. As shown in FIG. 11, unique identification information “01” “02” “03” (8-9) is printed on each of the sheets 4A-4C. This identification information is printed with ink having no infrared absorption characteristic so as not to obstruct the reading of the dot pattern by the electronic pen 1. In the management table stored in the storage unit 25, the identification information is registered in association with the coordinate area of the dot pattern on each of the wall surfaces 3A to 3C.

<Operational effect of the fourth embodiment>
In the information processing system according to the fourth embodiment, the same effects as those of the information processing system according to the first to third embodiments can be obtained, and the identification information of the dot pattern attached to each wall surface 3 can be easily understood by the user. Become.

[Modification]
The present invention is not limited to the above embodiment. For example, in each of the above embodiments, an Anoto dot pattern (coding pattern) is used. However, the present invention is not limited to this.

  This information processing system can be used in school classes, company conference rooms, lectures, presentations, and the like.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 21 ... Input means 22 ... Reception means 24 ... Processing means 25 ... Storage means 26 ... Display means 27 ... Transmission means 201 ... Display screen 4 ... Sheet 6 ... Projector

Claims (3)

A sheet attached to a wall surface and formed with a coding pattern indicating the position coordinates of different coordinate areas for each wall surface;
Reading means for reading the coded pattern;
A computer device that receives information about the coding pattern transmitted from the reading unit and performs processing according to the information;
The computer device includes:
Receiving means for receiving information on the coding pattern transmitted from the electronic pen;
Storage means for storing a management table in which a wall surface and a coordinate area of a coding pattern formed on a sheet attached to the wall surface are associated with each other;
An information processing system comprising: processing means for referring to the management table stored in the storage means and identifying a sheet filled with an electronic pen from information on the coding pattern received by the receiving means .   The information processing system according to claim 1, wherein position coordinates indicated by a coding pattern formed on an adjacent wall surface are continuous at a boundary of the wall surface.   The information processing system according to claim 1, wherein identification information is formed for each wall surface on the sheet.