JP2009193366A - Electronic pen, terminal device, and program for use with the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic pen for adding voice information with an optional capacity to an optional position on a medium for the electronic pen, and to provide a terminal device and the program for use with the same. <P>SOLUTION: A first user writes a message through the use of the electronic pen 80a and inputs voice, at the optional position of a slip 31a. Various kinds of servers obtain area definition information file corresponding to the slip 31a, page address and coordinate data of a message area with the message written thereon, stroke data corresponding to an entry to the message area, and voice data input to the entry to the message area from the electronic pen 80a, and then, store/manage them. A second user taps the optional position of the slip 31a through the use of the electronic pen 80b. Thus, the electronic pen 80b obtains the voice data corresponding to the page address and coordinate data of the slip from a voice server 95, and then, outputs the voice. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a technique for processing entry information entered on an electronic pen medium or the like with an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known (see Patent Document 1). Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an annotation pen, or puts a check mark on the image designed on the special paper, the small camera displays the dot pattern printed on the special paper as the pen moves. Entry information such as characters and images detected and written by the user is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a method for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 2).

In Patent Document 3, using such an electronic pen, a picture or character handwritten on a dedicated writing medium is used as image information, and a user at a remote location uses the predetermined terminal device to obtain the image information. An image distribution system capable of seeing an image corresponding to is disclosed. However, Patent Document 3 only describes image information using an electronic pen, and does not describe anything about remote users viewing on a predetermined terminal device based on information other than image information. .
Japanese translation of PCT publication No. 2003-511761 JP 2004-153612 A JP 2007-18185 A

  SUMMARY An advantage of some aspects of the invention is that it provides an electronic pen, a terminal device, and a program used therefor, which can add audio information of an arbitrary capacity at an arbitrary position on a medium for an electronic pen.

  An electronic pen according to the present invention is an electronic pen that processes information written on an electronic pen medium on which a coding pattern that can be recognized by the electronic pen is printed, and identifies a predetermined page on the coding pattern Information storage means for storing definition information in which a page address to be mapped and coordinate data on a coding pattern of a predetermined area are associated with each other, and entry information for acquiring entry information corresponding to the entry contents on the electronic pen medium An acquisition unit; an area recognition unit that recognizes the area by referring to the definition information based on a page address and coordinate data included in the entry information; and an area recognition unit that recognizes the area based on the entry information. Tap determination means for determining whether or not an area has been tapped, and area definition based on the determination result by the tap determination means Characterized in that it comprises a file acquisition means for acquiring a broadcast file, the.

  According to this configuration, when the user fills in and / or taps the electronic pen medium with the electronic pen, the electronic pen enters the electronic pen medium and / or taps corresponding to the tap by the filling information acquisition unit. Get information. Tapping is to tap the electronic pen medium with the electronic pen. Then, the area recognizing unit refers to the definition information stored in the information storage unit based on the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit, and fills and / or taps with the electronic pen. Recognizes the user area where the Further, the tap determination unit determines whether or not the entry and / or tap in the user area recognized by the area recognition unit is a tap based on the entry information. The file acquisition unit acquires the area definition information file based on the determination result by the tap determination unit. The area definition information file is user area definition information for each page, that is, information indicating the relationship between the user area and the position coordinates on the dot pattern of the user area. When the area associated with the acquisition of the area definition information file is tapped with the electronic pen, the file acquisition unit acquires an empty area definition information file. That is, the electronic pen can easily acquire an empty area definition information file in which a corresponding user area is not defined simply by tapping a predetermined area.

  The electronic pen further includes start / end point specifying means for specifying a data start point and a data end point based on the entry information, and the tap determination means is based on the data start point and the data end point. It is preferable to determine whether or not the area recognized by the area recognizing means is tapped based on time and / or distance.

  According to the electronic pen thus configured, first, the start / end point specifying means specifies the data start point and the data end point based on the entry information. The tap determination unit determines whether the area recognized by the area recognition unit is tapped based on the time and / or distance based on the data start point and the data end point specified by the start / end point specification unit. According to this, the tap determination means determines whether or not the stroke written by the user is a tap based on the time and / or distance based on the data start point and the data end point, and distinguishes them from characters and symbols. Is possible.

  In the electronic pen, based on the entry information, destination area setting means for setting an area in which a destination is entered on the coded pattern as a destination area, stroke data entered in the destination area, and the destination area It further comprises destination information transmission means for transmitting destination information including coordinate data and a page address. According to this, the stroke data entered in the destination area, the coordinate data indicating the destination area, and the page address can be stored as destination information in a predetermined server or the like. Therefore, it is possible to easily recognize the corresponding destination information based on the coordinate data and the page address included in the entry information acquired by the entry and / or tap by the electronic pen.

  In the electronic pen, based on the entry information, message area setting means for setting an area where a message is entered on the coded pattern area as a message area, stroke data entered in the message area, and the message area Stroke information transmitting means for transmitting stroke information including coordinate data indicating a page address and a page address is further provided. According to this, the stroke data entered in the message area, the coordinate data indicating the message area, and the page address can be stored as message information in a predetermined server or the like. Accordingly, an arbitrary position on the electronic pen medium and a message written at the position can be stored and managed in association with each other.

  In the electronic pen, the electronic pen includes a voice input unit, voice input means for inputting voice by the voice input unit during entry into the message area, voice data input by the voice input unit, and Voice information transmitting means for transmitting voice information including coordinate data indicating a message area and a page address is further provided. According to this, the voice data input during the entry into the message area can be stored in a predetermined server or the like as voice information associated with the coordinate data indicating the message area and the page address. Therefore, it is possible to store and manage an arbitrary position on the electronic pen medium and voice data input at the position in association with each other.

  The electronic pen further includes an area definition information file acquired by the file acquisition unit, and a completed file information transmission unit that transmits completed file information including coordinate data and a page address indicating the message area. It is characterized by. According to this, the message area and the coordinate data indicating the message area can be written in the area definition information file. That is, the area definition information file, the coordinate data indicating the message area, and the page address can be associated with each other and stored in a predetermined server or the like.

  In the electronic pen, the electronic pen includes a voice output unit, and transmits a page address and coordinate data included in the entry information acquired by the entry information acquisition unit, and corresponds to the page address and the coordinate data. Voice data acquisition means for acquiring voice data to be performed, and voice output means for outputting a voice based on the voice data acquired by the voice data acquisition means from the voice output unit.

  In the electronic pen thus configured, the voice data acquisition unit acquires voice data corresponding to the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit. Then, the sound output means outputs sound based on the sound data acquired by the sound data acquisition means from the sound output unit. According to this, when the electronic pen performs writing and / or tapping on an arbitrary position on the electronic pen medium, the electronic pen can acquire sound data corresponding to the position and output sound.

  In another aspect of the present invention, there is provided an electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed, the key acquisition means for acquiring a key value, Entry information obtaining means for obtaining entry information corresponding to entry contents on the electronic pen medium, and message area setting means for setting an area where a message is entered on the coding pattern as a message area based on the entry information A key value acquired by the key acquisition means, stroke data entered in the message area, a page address for identifying a page that can be placed on the coding pattern in which the message area is provided, and the message area Stroke information transmitting means for transmitting stroke information including coordinate data to be indicated. The features.

  According to this configuration, the electronic pen first acquires a key value. Further, when the user fills in and / or taps the electronic pen medium with the electronic pen, the electronic pen acquires the filling information corresponding to the filling and / or tapping on the electronic pen medium by the filling information acquisition unit. . Then, the message area setting means sets the area where the message is entered on the coded pattern as the message area based on the entry information obtained by the entry information obtaining means. Further, the stroke information transmission means transmits stroke information including the key value acquired by the key acquisition means, the stroke data entered in the message area, and the page address and coordinate data indicating the message area. That is, the predetermined server can store and manage the key value, the stroke data written in the message area, and the page address and coordinate data indicating the message area in association with each other.

  In the electronic pen, the electronic pen includes a voice input unit, a voice input unit that inputs voice by the voice input unit during filling in the message area, a key value acquired by the key acquisition unit, Voice information transmitting means for transmitting voice information including voice data input by the voice input means, coordinate data indicating the message area, and a page address is further provided. According to this, the voice data input while filling in the message area is stored in a predetermined server or the like as voice information associated with the coordinate data indicating the message area, the page address, and the key value. be able to. Accordingly, the key value, an arbitrary position on the electronic pen medium, and the voice data input at the position can be stored and managed in association with each other.

  In the electronic pen, the electronic pen is communicably connected to a completed file server, and stroke information acquisition means for acquiring the stroke information corresponding to the key value acquired by the key value acquisition means, and the stroke Based on the stroke information acquired by the information acquisition means, a file creation means for creating a new area definition information file, an area definition information file created by the file creation means, coordinate data and a page address indicating the message area, And a completed file information transmitting means for transmitting the completed file information including the information to the completed file server.

  According to this configuration, the electronic pen first acquires one or more pieces of stroke information corresponding to the key value acquired by the key value acquiring unit, and generates a new area definition information file by the file generating unit. Then, the completed file information transmission means transmits the completed file information including the new area definition information file created by the file creation means, the coordinate data indicating the message area, and the page address to the entered file server. According to this, the completed file server, the area definition information that associates the new area definition information file created based on the area definition information file with the matching key value, the coordinate data indicating the message area, and the page address. File information can be stored and managed.

  In the electronic pen, the completed file server is created based on the completed file information, stores a correspondence table in which coordinate data indicating the message area and a page address are associated with each other, and the electronic pen includes: Extracted by referring to the correspondence table based on the page address and the coordinate data, and transmitting means for transmitting a page address and coordinate data included in the entry information acquired by the entry information acquisition means, comprising an audio output unit Voice data acquisition means for acquiring the voice data obtained, and voice output means for outputting voice based on the voice data acquired by the voice data acquisition means by the voice output unit.

  According to this configuration, the voice data acquisition unit of the electronic pen first stores the correspondence table stored in the completed file server based on the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit. Corresponding audio data is acquired by referring to it. In other words, even an electronic pen medium to which a plurality of audio data is added can be handled based on the page address and coordinate data by tapping and / or entering any position of the electronic pen medium with the electronic pen. By referring to the table, audio data corresponding to the position can be acquired. The sound output means outputs sound based on the sound data acquired by the sound data acquisition means by the sound output unit. According to this, even if the electronic pen medium is added with a plurality of audio data, the electronic pen can easily output audio data corresponding to an arbitrary position by entering and / or tapping.

  The program according to the present invention is a program executed by an electronic pen that processes information entered on an electronic pen medium on which a coded pattern that can be recognized by the electronic pen is printed, Information storage means for storing definition information that associates a page address for identifying a predetermined page with the coordinate data on a coding pattern of a predetermined area, and entry information corresponding to the content entered in the electronic pen medium Entry information obtaining means for obtaining the area, area recognition means for recognizing the area by referring to the definition information based on a page address and coordinate data included in the entry information, and the area recognition means based on the entry information Tap determination means for determining whether or not the area recognized by the user has been tapped, determination by the tap determination means Based on the result, the file acquiring unit that acquires area definition information file, as is characterized in that to function the electronic pen.

  Alternatively, a program according to another invention is a program executed by an electronic pen that processes information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed, and obtains a key value Key acquisition means, entry information acquisition means for acquiring entry information corresponding to entry contents on the electronic pen medium, and an area where a message is entered on the coded pattern is set as a message area based on the entry information A message area setting means, a key value acquired by the key acquisition means, stroke data written in the message area, a page address for identifying a page that can be placed on the coding pattern provided with the message area, Sending stroke information including coordinate data indicating the message area Characterized in that to function the electronic pen stroke information transmission means, as.

  A terminal device according to the present invention is a terminal device that processes information entered in an electronic pen medium on which a coding pattern recognizable by an electronic pen is printed, and identifies a predetermined page on the coding pattern Information storage means for storing definition information in which a page address to be associated and coordinate data on a coding pattern of a predetermined area are associated with each other, and entry information corresponding to entry contents from the electronic pen to the electronic pen medium Entry information acquisition means for acquiring, area recognition means for recognizing the area by referring to the definition information based on page address and coordinate data included in the entry information, and the area based on the entry information A tap determination unit that determines whether or not the area recognized by the recognition unit is tapped, and a determination result by the tap determination unit. There are, characterized in that it comprises a file acquisition means for acquiring area definition information file, a.

  According to this configuration, when the user fills in and / or taps the electronic pen medium with the electronic pen, the terminal device causes the terminal device to fill in the electronic pen medium and / or the tap corresponding to the tap. Get information. Tapping is to tap the electronic pen medium with the electronic pen. Then, the area recognizing unit refers to the definition information stored in the information storage unit based on the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit, and fills and / or taps with the electronic pen. Recognize the area where is done. Furthermore, the tap determination unit determines whether or not the entry and / or tap of the area recognized by the area recognition unit is a tap based on the entry information. The file acquisition unit acquires the area definition information file based on the determination result by the tap determination unit. That is, when the area associated with the acquisition of the area definition information file is tapped with the electronic pen, the file acquisition unit acquires the area definition information file. According to this, the terminal device can easily acquire an area definition information file in which a corresponding user area is not defined simply by tapping a predetermined area with the electronic pen.

  The terminal device further includes start / end point specifying means for specifying a data start point and a data end point based on the entry information, wherein the tap determination means is based on the data start point and the data end point. It is preferable to determine whether or not the area recognized by the area recognizing means is tapped based on time and / or distance.

  According to the terminal device configured as described above, first, the start / end point specifying means specifies the data start point and the data end point based on the entry information. The tap determination unit determines whether the area recognized by the area recognition unit is tapped based on the time and / or distance based on the data start point and the data end point specified by the start / end point specification unit. According to this, the tap determination means determines whether or not the stroke written by the user is a tap based on the time and / or distance based on the data start point and the data end point, and distinguishes them from characters and symbols. Is possible.

  In the terminal device, based on the entry information, destination area setting means for setting an area in which a destination is entered on the coded pattern as a destination area, stroke data entered in the destination area, and the destination area It further comprises destination information transmission means for transmitting destination information including coordinate data and a page address. According to this, the stroke data entered in the destination area, the coordinate data indicating the destination area, and the page address can be stored as destination information in a predetermined server or the like. Therefore, the terminal device can easily recognize the corresponding destination information based on the coordinate data and the page address included in the entry information acquired by the entry and / or tap by the electronic pen.

  In the terminal device, based on the entry information, message area setting means for setting an area where a message is entered on the coded pattern area as a message area, stroke data entered in the message area, and the message area Stroke information transmitting means for transmitting stroke information including coordinate data indicating a page address and a page address is further provided. According to this, the stroke data entered in the message area, the coordinate data indicating the message area, and the page address can be stored as message information in a predetermined server or the like. Therefore, the terminal device can store and manage an arbitrary position on the electronic pen medium and a message written at the position in association with each other.

  In the terminal device, the terminal device includes a voice input unit, voice input means for inputting voice by the voice input unit during entry into the message area, voice data input by the voice input means, and the message Voice information transmitting means for transmitting voice information including coordinate data indicating an area and a page address is further provided. According to this, the voice data input during the entry into the message area can be stored in a predetermined server or the like as voice information associated with the coordinate data indicating the message area and the page address. Therefore, it is possible to store and manage an arbitrary position on the electronic pen medium and voice data input at the position in association with each other.

  The terminal device further includes an entered file information transmission unit that transmits the area definition information file acquired by the file acquisition unit, and completed file information including coordinate data and a page address indicating the message area. It is characterized by. According to this, the area definition information file, the coordinate data indicating the message area, and the page address can be associated with each other and stored in a predetermined server or the like.

  In the terminal device, the terminal device includes a voice output unit, and corresponds to the page address and the coordinate data, a transmission unit that transmits a page address and coordinate data included in the entry information acquired by the entry information acquisition unit. Voice data acquisition means for acquiring voice data; and voice output means for outputting voice based on the voice data acquired by the voice data acquisition means from the voice output unit.

  In the terminal device configured as described above, the voice data acquisition unit acquires the voice data corresponding to the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit. Then, the sound output means outputs sound based on the sound data acquired by the sound data acquisition means from the sound output unit. According to this, when the terminal device performs writing and / or tapping on an arbitrary position on the electronic pen medium with the electronic pen, the terminal device can acquire the sound data corresponding to the position and output the sound.

  In another aspect of the present invention, there is provided a terminal device for processing information written on an electronic pen medium on which a coded pattern recognizable by an electronic pen is printed, the key acquisition means for acquiring a key value, An entry information obtaining means for obtaining entry information corresponding to the entry contents on the electronic pen medium from the electronic pen, and an area where the message is entered on the coding pattern is set as a message area based on the entry information. A message area setting means, a key value acquired by the key acquisition means, stroke data written in the message area, a page address for identifying a page that can be placed on the coding pattern in which the message area is provided, Stroke information transmitter for transmitting stroke information including coordinate data indicating the message area Characterized in that it comprises a and.

  According to this configuration, the terminal device first acquires a key value. Further, when the user fills in and / or taps the electronic pen medium with the electronic pen, the terminal information is entered by the filling information acquisition means, and the terminal device fills in the electronic pen medium and / or tap information corresponding to the tap. To get. Then, the message area setting means sets the area where the message is entered on the coded pattern as the message area based on the entry information obtained by the entry information obtaining means. Further, the stroke information transmission means transmits stroke information including the key value acquired by the key acquisition means, the stroke data entered in the message area, and the page address and coordinate data indicating the message area. That is, the predetermined server can store and manage the key value, the stroke data written in the message area, and the page address and coordinate data indicating the message area in association with each other.

  In the terminal device, the terminal device includes a voice input unit, a voice input unit that inputs voice by the voice input unit during filling in the message area, a key value acquired by the key acquisition unit, and the voice Voice information transmitting means for transmitting voice information including voice data input by the input means and coordinate data indicating the message area and a page address is further provided. According to this, the voice data input while filling in the message area is stored in a predetermined server or the like as voice information associated with the coordinate data indicating the message area, the page address, and the key value. be able to. Accordingly, the key value, an arbitrary position on the electronic pen medium, and the voice data input at the position can be stored and managed in association with each other.

  In the electronic pen, the terminal device is communicably connected to a completed file server, and stroke information acquisition means for acquiring the stroke information corresponding to the key value acquired by the key value acquisition means, and the stroke Based on the stroke information acquired by the information acquisition means, a file creation means for creating a new area definition information file, an area definition information file created by the file creation means, coordinate data and a page address indicating the message area, And a completed file information transmitting means for transmitting the completed file information including the information to the completed file server.

  According to this configuration, the terminal device first acquires one or more pieces of stroke information corresponding to the key value acquired by the key value acquisition unit, and generates a new area definition information file by the file generation unit. Then, the completed file information transmission means transmits the completed file information including the new area definition information file created by the file creation means, the coordinate data indicating the message area, and the page address to the entered file server. According to this, the completed file server, the area definition information that associates the new area definition information file created based on the area definition information file with the matching key value, the coordinate data indicating the message area, and the page address. File information can be stored and managed.

  In the terminal device, the filled-in file server stores a correspondence table created based on the filled-in file information and associating coordinate data indicating the message area and a page address. An output unit, which is extracted by referring to the correspondence table based on the page address and the coordinate data, and a transmission means for transmitting the page address and the coordinate data included in the entry information obtained by the entry information obtaining means. Voice data acquisition means for acquiring the voice data, and voice output means for outputting voice based on the voice data acquired by the voice data acquisition means by the voice output unit.

  According to this configuration, the voice data acquisition unit of the terminal device first stores the completed file server based on the page address and the coordinate data included in the entry information acquired by the entry information acquisition unit from the electronic pen. By referring to the correspondence table, corresponding audio data is acquired. In other words, even an electronic pen medium to which a plurality of audio data is added can be handled based on the page address and coordinate data by tapping and / or entering any position of the electronic pen medium with the electronic pen. By referring to the table, audio data corresponding to the position can be acquired. The sound output means outputs sound based on the sound data acquired by the sound data acquisition means by the sound output unit. According to this, even if the electronic pen medium is added with a plurality of audio data, the electronic pen can easily output audio data corresponding to an arbitrary position by entering and / or tapping.

  The program according to the present invention is a program executed by a computer that processes information written on an electronic pen medium on which a coding pattern recognizable by the electronic pen is printed, and the program is recorded on the coding pattern. Information storage means for storing definition information in which a page address for identifying a predetermined page is associated with coordinate data on a coding pattern of a predetermined area, and contents to be entered from the electronic pen into the electronic pen medium Entry information acquisition means for acquiring entry information corresponding to the area, area recognition means for recognizing the area by referring to the definition information based on a page address and coordinate data included in the entry information, and the entry information Tap determining means for determining whether the area recognized by the area recognizing means is tapped based on Based on the determination result by the tap judging unit, and characterized by causing the computer to function as a file acquiring means for acquiring the area definition information file.

  Alternatively, a program according to another invention is a program executed by a computer that processes information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed, and acquires a key value. A message is entered on the coded pattern based on the entry information, a key obtaining means, entry information obtaining means for obtaining entry information corresponding to the entry contents of the electronic pen medium from the electronic pen, and the entry information. Message area setting means for setting an area as a message area, a key value acquired by the key acquisition means, stroke data entered in the message area, and a page that can be placed on the coding pattern provided with the message area A page address for identifying the message and coordinate data indicating the message area. And characterized by causing the computer to function as the stroke information transmitting means for transmitting a no-stroke information.

  According to the electronic pen, the terminal device, and the program used for the electronic pen according to the present invention, the voice information of an arbitrary capacity can be placed at an arbitrary position on the electronic pen medium according to the entry contents of the electronic pen with respect to the electronic pen medium. Can be added. In addition, the entry contents for the electronic pen medium can be freely edited.

  Preferred embodiments of the present invention will be described below with reference to the drawings.

  As shown in FIGS. 1 and 2, the information processing system according to the present embodiment includes an electronic pen 80, a dedicated paper (electronic pen medium) 20, a terminal device 85, a pen owner server 91, and a file server 92. A destination server 93, a stroke server 94, a voice server 95, a completed file server 96, and a key distribution server 97. The terminal device 85, the pen owner server 91, the file server 92, the destination server 93, the stroke server 94, the voice server 95, the completed file server 96, and the key distribution server 97 are communicably connected via the network 2. . A preferred example of the network 2 is the Internet. Here, FIG. 1 is a diagram schematically showing a usage pattern of the electronic pen 80, and FIG. 2 is a block diagram showing a configuration of the electronic pen 80.

  A dot pattern (coded pattern) is printed on the dedicated paper 20. The electronic pen 80 includes a pen tip portion 17 similar to a normal ink pen. When a user writes characters on the dedicated paper 20 by the pen tip portion 17 in the same manner as a normal ink pen, the electronic pen 80 The dot pattern printed on the dedicated paper 20 is read locally and continuously along the movement trajectory of the pen tip portion 17, and the coordinates of the local position on the dedicated paper 20 are calculated. Based on the coordinate data and the like, Predetermined processing is executed, such as storing input characters or performing processing according to the tap. Hereinafter, each configuration will be described in detail.

  The terminal device 85 includes, as hardware, an antenna device capable of data communication with the electronic pen 80, a processor such as a CPU, a memory such as ROM and RAM, a speaker, a display, and the like, a PC, a mobile phone, or It is a mobile terminal.

  Further, the pen owner server 91, the file server 92, the destination server 93, the stroke server 94, the voice server 95, the completed file server 96, and the key distribution server 97 are antennas capable of data communication with the terminal device 85 and each server. The server includes a device, a processor such as a CPU, a memory such as a ROM and a RAM, a speaker, and a display.

[Special paper]
First, the dedicated paper 20 will be described. The dedicated paper 20 is a paper in which a dot pattern is printed on a sheet of paper, and further, designs, items such as ruled lines and entry frames, words, words, illustrations, and the like are printed thereon. The dot pattern is printed with ink containing carbon that absorbs infrared rays. In addition, the design and the like are printed with ordinary ink that does not contain carbon. The dot pattern and the design may be printed on the paper at the same time, or either one may be printed first.

  FIG. 3 shows an example of the dedicated paper 20 on which a design or the like is printed. FIG. 3A shows an example of the form 31 and FIG. 3B shows an example of the service selection palette 32. In the form 31, a predetermined message is entered with the electronic pen 80. As shown in FIG. 3A, a billing process for charging an area definition information file in which a corresponding user area is not defined is previously performed. It has a billing box 41 associated with it. The area definition information file is user area definition information for each page, that is, information indicating the relationship between the user area and the position coordinates on the dot pattern of the user area. Therefore, the area definition information file in which the user area is not defined is an empty file in which no definition is made. The service selection palette 32 is used by the user to select a service by filling a check mark with the electronic pen 80. As shown in FIG. 3B, "paper is mailed", "mailed" , “Contribution”, “Diary”, and “Album” are printed, and each box has a box associated with each service. Different forms of dot patterns are printed on the form 31 and the service selection palette 32, and page addresses for identifying predetermined pages on the dot patterns are assigned.

  In the present embodiment, a page address “10.30.65.2” is assigned to the form 31 as shown in FIG. 3A, and the service selection palette 32 is assigned to the form 31 as shown in FIG. The page address “10.30.20.1” is assigned.

  When the user who fills in the message purchases the form 31, he / she taps the request button 41 to request the area definition information file using the electronic pen 80 without being aware of the dot pattern (the pen tip of the electronic pen 80). Tap the dedicated paper (electronic pen medium 20) of the unit 17). In addition, the user selects a service to be used, and enters a check mark in a box corresponding to the service in the service selection palette 32. Then, the user uses the electronic pen 80 to enter a predetermined message or message destination in the form 31.

  In addition, the user who has received the form 31 in which the message has been written uses the electronic pen 80 to tap an arbitrary position on the form 31.

[Dot pattern]
Next, the dot pattern will be described. FIG. 4 is a diagram illustrating the relationship between the dots of the dot pattern printed on the dedicated paper 20 and the values to which the dots are converted. As shown in FIG. 4, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the dedicated paper 20 are determined by the combination of information thus associated.

  FIG. 5A shows an arrangement of a certain dot pattern. As shown in FIG. 5A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken on the dedicated paper. Yes. A dot pattern formed by these 36 dots holds position coordinates (for example, on which position the dot pattern is located on the dedicated paper). FIG. 5B is a diagram in which each dot shown in FIG. 5A is converted into a value associated with the regularity shown in FIG. 5 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 80 that captures a dot pattern image.

[Electronic pen]
Next, the electronic pen 80 will be described. As shown in FIG. 2, the electronic pen 80 includes a processor 11, a memory 12, a data communication unit 13, a battery 14, an LED 15, a camera 16, a pressure sensor 18, a speaker (audio output unit) 19, and a clock 22. . The electronic pen 80 has an ink cartridge (not shown) as a component similar to a normal ink pen.

  The LED 15 is attached in the vicinity of the pen tip of the electronic pen 80, and illuminates infrared rays toward the vicinity of the pen tip portion 17 (region 15a) on the dedicated paper 20 (see FIG. 1). The region 15 a is slightly shifted from the position where the pen tip portion 17 contacts the dedicated paper 20. The camera 16 captures a dot pattern in the area 15 a illuminated by the LED 15 and supplies image data of the dot pattern to the processor 11. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 15 are absorbed by the carbon contained in the dots at the dot portions. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, the area of the dot containing carbon and the other area can be distinguished from the difference in the amount of reflected infrared light by photographing with the camera 16. Even if a ruled line, a frame, or the like is printed in the photographing region, the dot pattern can be recognized because the ink of the ruled line, the frame, etc. does not contain carbon. Note that the imaging area of the camera 16 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 5A, and the imaging of the camera 16 is performed about 50 to 100 times per second.

  The battery 14 is for supplying electric power to each component in the electronic pen 80. For example, the power of the electronic pen 80 itself is turned on / off by detaching a cap (not shown) of the electronic pen 80. May be. The clock 22 transmits the current time (time stamp) and supplies it to the processor 11. The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters or the like on the dedicated paper 20 with the electronic pen 80, that is, the writing pressure, and supplies the detected pressure to the processor 11.

  The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when a user writes characters or the like on the dedicated paper 20 with the electronic pen 80, the pen pressure is applied to the pen tip portion 17, and when the pressure sensor 18 detects a writing pressure higher than a predetermined value, the processor 11. Determines that the user has started entry and activates the LED 15 and the camera 16.

  While the user inputs, the processor 11 uses the dot pattern of the image data supplied by the camera 16 to determine the X and Y coordinates (simply “coordinate data”) on the dedicated paper 20 of the stroke to be entered by the user. Is called continuously. That is, the processor 11 converts the image data of the dot pattern as shown in FIG. 5A supplied by the camera 16 into the data array shown in FIG. 5B, and further converts the X coordinate bit value · Y The coordinate bit value is converted, and X, Y coordinate data is calculated from the data array by a predetermined calculation method. The processor 11 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data and the X, Y coordinate data, and acquires these information as entry information. . Further, the processor 11 executes a predetermined process based on the entry information. Here, since the 6 × 6 dot pattern in one sheet of dedicated paper (electronic pen medium) 20 does not overlap in the dedicated paper 20, the user enters necessary information with the electronic pen 80. When the user taps or taps, the user area of the dedicated paper 20 corresponding to the entry or tap can be specified from the coordinate data.

  The memory 12 stores entry information in time series by the processor 11. Although details will be described later, definition information is stored in advance. The capacity of the memory 12 can be, for example, about 1 Mbyte to 2 Gbyte.

  The speaker (sound output unit) 19 reproduces and outputs sound data corresponding to the tap on the dedicated paper 20 according to an output instruction from the processor 11.

  The microphone (voice input unit) 23 inputs voice generated by the user at the time of filling in the dedicated paper 20 as voice data in response to an input instruction from the processor 11.

  The data communication unit 13 transmits / receives data to / from a terminal device 85 in the vicinity. Transmission by the data communication unit 13 is preferably performed by wireless transmission using Bluetooth (registered trademark). Note that data transmission from the data communication unit 13 to the terminal device 85 may be performed by other methods such as wired transmission using a USB cable or data transmission by contact with a terminal.

  Here, functions of the electronic pen 80 and various servers will be described with reference to FIG. FIG. 6 is a functional block diagram showing main configurations of the electronic pen 80 and various servers.

  First, functions of the electronic pen 80 will be described. The electronic pen 80 performs a predetermined process by executing the dedicated application 50 based on the entry information such as the acquired X and Y coordinate data.

  As shown in FIG. 6, the electronic pen 80 functionally includes an information storage unit 101, entry information acquisition unit 102, area recognition unit 103, start / end point identification unit 104, tap determination unit 105, area setting unit 106, A file creation unit 107, a voice input unit 108, a voice output unit 109, and a data communication unit 110 are provided. The information storage unit 101 is physically configured by a memory 12 such as a ROM or a RAM, and the entry information acquisition unit 102 is configured by a camera 16, a clock 22, a processor 11, and the like. The voice input means 108 is constituted by the microphone 23, the processor 11, etc., and the voice output means 109 is constituted by the speaker 19, the processor 11, etc. The area recognition unit 103, the start / end point identification unit 104, the tap determination unit 105, the area setting unit 106, and the file creation unit 107 are incorporated in a processor such as a CPU.

  The area setting unit 106 includes a destination area setting unit and a message area setting unit. Further, the data communication unit 110 includes a file acquisition unit, destination information transmission unit, stroke information transmission unit, voice information transmission unit, completed file information transmission unit, coordinate data transmission unit, voice data acquisition unit, and key acquisition unit. ing.

  The information storage unit 101 is a memory 12 that stores definition information. As shown in FIG. 7, the definition information is information in which a page address, an area ID, coordinate data indicating the position coordinates of the area on the dot pattern, and service contents are associated with each other. That is, the information storage unit 101 stores definition information in which page addresses, area IDs, coordinate data, and service contents are associated with each other. In association with the page address “10.30.65.2”, an area ID “A01”, coordinate data “(x11, y11), H11, W11”, and service content “file request” are stored. Further, an area ID “A02”, coordinate data “(x12, y12), H12, W12”, and service content “mail paper” are stored in association with the page address “10.30.20.1”. . As shown in FIG. 8, the data (xn, yn), Hn, and Wn constituting the coordinate data of each area are respectively the coordinates of the vertex V (xn, yn) of each area on the dot pattern, and the Y-axis direction. This means height and width in the X-axis direction.

  The document 31 is printed with the dot pattern identified by the page address “10.30.65.2”, and the area ID “A01” indicated by the coordinate data “(x11, y11), H11, W11” is charged. Box 41 is represented. Therefore, in the definition information, the area ID “A01”, the coordinate data “(x11, y11), H11, W11” and the service content “file request” are stored in association with the page address “10.30.65.2”. Has been. On the other hand, what is printed with the dot pattern identified by the page address “10.30.20.1” is the service selection palette 32, and the area “A02” indicated by the coordinate data “(x12, y12), H12, W12”. "Represents a box associated with the service" mail paper ". Therefore, in the definition information, the area ID “A02”, the coordinate data “(x12, y12), H12, W12” and the service content “mail paper” are associated with the page address “10.30.20.1”. It is remembered.

  Furthermore, the information storage unit 101 stores the entry information acquired by the entry information acquisition unit 102 in time series.

  The entry information acquisition unit 102 is a unit that acquires entry information corresponding to the entry contents on the dedicated paper (electronic pen medium) 20 by the electronic pen 80. The entry information acquisition means 102 converts the dot pattern image data as shown in FIG. 5 (a) supplied by the camera 16 to the data array shown in FIG. 5 (b) while being entered by the user. Further, the data is converted into an X coordinate bit value / Y coordinate bit value, the X and Y coordinate data are associated from the data array by a predetermined calculation method, and these pieces of information are acquired as entry information. The entry information includes information acquired when a tap (light tap on the dedicated paper 20 of the pen tip portion 17 of the electronic pen 80), characters, symbols, patterns, and the like are entered. The entry information acquisition means 102 is means for acquiring entry information corresponding to messages, check marks, and taps entered in the form 31 and the service selection palette 32.

  The area recognizing unit 103 refers to the definition information (see FIG. 7) stored in the information storage unit 101 based on the page address and the coordinate data included in the entry information, thereby identifying the user area where the tap or entry has been performed. recognize. In other words, in order to execute the process based on the tap or entry, the user area where the tap or entry has been performed is recognized, and the service content associated with the user area is specified.

  The start / end point specifying unit 104 specifies the data start point and the data end point of the stroke included in the entry information acquired by the entry information acquisition unit 101 and transmits them to the tap determination unit 105. Specifically, the start / end point specifying unit 104 specifies the coordinate data indicating the position coordinates of the data start point and the data end point and the entry time. The tap determination unit 105 determines whether the stroke entered by the user is a tap based on the time at the data start point and the data end point specified by the start / end point specification unit 104 and / or the movement distance between the two points. Determine whether or not.

  Specifically, there are three methods for determining whether or not the stroke entered on the dedicated paper (electronic pen medium) 20 by the user is a tap. As a first method, the tap determination unit 105 calculates the difference between the entry time of the data end point and the entry time of the data start point, and the difference is less than a predetermined time (for example, 0.2 seconds). In some cases, it is determined that the stroke is a tap. As another second method, the tap determination unit 105 calculates a movement distance (length of a written line) between the data start point and the data end point based on the coordinate data, and the movement distance is calculated in advance. You may make it determine with a stroke being a tap when it is less than the predetermined distance set. Alternatively, as a third method, conditions may be attached to both the time and the moving distance at the data start point and the data end point to determine whether or not the stroke is a tap.

  The area setting unit 106 includes a destination area setting unit and a message area setting unit. Based on the entry information acquired by the entry information acquisition unit 102, the area stroke setting unit 106 fills the form 31 on the form 31 on the dot pattern. The position information is calculated and set as a user area. Specifically, the area setting means 106 includes an entry stroke for the form 31 based on the maximum and minimum values of the X position and the maximum and minimum values of the Y position from the X and Y information included in the entry information. An area ID is calculated, an area ID is assigned as coordinate data of the user area, and is associated with the entry information. As shown in FIG. 8, the data (xn, yn), Hn, and Wn constituting the coordinate data are the coordinates of the vertex V (xn, yn) of each area on the dot pattern, the height in the Y-axis direction (Height, respectively) ), The width in the X-axis direction. The destination area setting means sets the area in which the destination is entered with the electronic pen 80 on the dot pattern as the destination area. The message area setting means sets an area where a message is entered with the electronic pen 80 on the dot pattern as a message area.

  The file creation unit 107 creates a new area definition information file obtained by combining a plurality of area definition information files into one based on a key value described later.

  The voice input unit 108 acquires voice data input by the voice input unit (microphone) 23 during the entry into the message area set by the message area setting unit.

  The audio output unit 109 causes the audio output unit (speaker) 19 to reproduce and output the audio data acquired by the audio data acquisition unit described later.

  The data communication unit 110 includes a file acquisition unit, a destination information transmission unit, a stroke information transmission unit, a voice information transmission unit, a completed file information transmission unit, a coordinate data transmission unit, a voice data acquisition unit, and a key acquisition unit. Data transmission / reception with the terminal device 85 is performed. The data communication unit 110 may be used to download a dedicated application 50 or the like to be installed in the electronic pen 80.

  When the area recognition unit 103 and the tap determination unit 105 determine that the billing box 41 has been tapped, the file acquisition unit transmits a predetermined signal, and the file server 92 receives an empty space in which the corresponding user area is not defined. Get the area definition information file. Note that the user area is not defined in the empty area definition information file, but the page address information is included.

  The destination information transmission means sends destination information including the pen ID and the entry information entered in the destination area set by the destination area setting means to the destination server 93 based on the entry information acquired by the entry information acquisition means 102. Send. The destination information includes at least stroke data written in the destination area, coordinate data indicating the destination area, and a page address.

  The stroke information transmitting means sends stroke information including the pen ID and the entry information entered in the message area set by the message area setting means to the stroke server 94 based on the entry information obtained by the entry information obtaining means 102. Send. The stroke information includes at least stroke data entered in the message area, coordinate data indicating the message area, and page address.

  The voice information transmitting means includes voice information including a pen ID, time information indicating the entry time in the message area, coordinate data and page address indicating the message area, and voice data acquired by the voice input means 108. Transmit to the voice server 95.

  The filled-in file information transmitting means includes filled-in file information including a pen ID, an empty area definition information file obtained by the file obtaining means, coordinate data indicating a message area set by the message area setting means, and a page address. , And sent to the completed file server 96. In other words, the message area and the coordinate data indicating the message area are written in the empty area definition information file here.

  The coordinate data transmission unit transmits the page address and coordinate data included in the entry information acquired by the entry information acquisition unit 102 to the completed file server 96.

  The voice data acquisition unit acquires the voice data corresponding to the page address and the coordinate data transmitted from the coordinate data transmission unit from the voice server 95.

  The key acquisition unit acquires a key value from the key distribution server 97.

  Next, functions of various servers will be described.

  The pen owner server 91 functionally includes an information storage unit 111 and a data communication unit 112. The data communication unit 112 acquires pen owner information such as the pen ID and the name, age, and address of the pen owner through the terminal device 85. The information storage unit 111 stores pen owner information in association with the pen ID. In addition, the data communication unit 112 transmits pen owner information to the terminal device 85 and various servers as necessary. The pen owner server 91 performs a predetermined process by executing the dedicated application 51.

  Functionally, the file server 92 includes an information storage unit 121 and a data communication unit 122. The information storage unit 121 stores an empty area definition information file in which a corresponding user area is not defined. When the data communication unit 122 acquires a predetermined signal from the electronic pen 80 via the terminal device 85, the data communication unit 122 transmits an empty area definition information file stored in the information storage unit 121 to the electronic pen 80. The file server 92 performs a predetermined process by executing the dedicated application 52.

  The destination server 93 functionally includes an information storage unit 131 and a data communication unit 132. The data communication unit 132 acquires destination information including the pen ID and entry information entered in the destination area from the electronic pen 80 via the terminal device 85. The information storage unit 131 stores the stroke data entered in the destination area in association with the pen ID, the page address included in the entry information, and the coordinate data. At this time, the information storage means 131 may store the stroke data included in the entry information, or store the character string recognized by executing the character recognition process by HWR, OCR, etc. based on the entry information. Also good. Further, the data communication unit 112 transmits stroke data and a character string written in the destination area as necessary to the terminal device 85 and various servers. It is assumed that the destination server 93 is preinstalled with a character recognition engine that can execute character recognition processing by HWR, OCR, or the like. The destination server 93 performs a predetermined process by executing the dedicated application 53.

  The stroke server 94 functionally includes an information storage unit 141 and a data communication unit 142. The data communication unit 142 acquires stroke information including the pen ID and entry information entered in the message area from the electronic pen 80 via the terminal device 85. The information storage unit 141 stores the stroke data entered in the message area in association with the pen ID, time information included in the entry information, writing pressure data, page address, and coordinate data. Further, the data communication unit 142 transmits the stroke data entered in the message area to the terminal device 85 and various servers as necessary. The stroke server 94 performs a predetermined process by executing the dedicated application 54.

  The voice server 95 functionally includes an information storage unit 151 and a data communication unit 152. The data communication unit 152 receives voice information including the pen ID, time information indicating the entry time in the message area, page address and coordinate data indicating the message area, and voice data from the electronic pen 80 via the terminal device 85. Get information. The information storage unit 151 stores voice data in association with the pen ID, time information, page address, and coordinate data. In addition, the data communication unit 152 transmits audio data to the terminal device 85 and various servers as necessary. The voice server 95 performs a predetermined process by executing the dedicated application 55.

  The filled-in file server 96 functionally includes an information storage unit 161 and a data communication unit 162. The data communication unit 162 acquires completed file information including a pen ID, coordinate data and page address indicating a message area, and an area definition information file from the electronic pen 80 via the terminal device 85. The information storage unit 161 stores an area definition information file in association with the pen ID, coordinate data, and page address. The coordinate data and page address are written in the area definition information file. In addition, the data communication unit 162 transmits an area definition information file to the terminal device 85 and various servers as necessary. The completed file server 96 performs a predetermined process by executing the dedicated application 56.

  Functionally, the key distribution server 97 includes an information storage unit 171 and a data communication unit 172. The data communication unit 172 acquires information about the key distributor, such as the destination, the entry deadline, and the pen ID of the key distributor through the terminal device 85. The information storage unit 171 stores a key value that can be identified in association with the destination, the entry deadline, and the pen ID of the key distributor. In addition, the data communication unit 172 transmits the key value to the electronic pen 80 indicated by the key distributor's pen ID via the terminal device 85. The key distribution server 97 performs a predetermined process by executing the dedicated application 57.

  The electronic pen 80 and various servers are configured with the above-described units by installing a dedicated application.

[Dedicated application]
Next, the dedicated application will be described with reference to FIG. FIG. 9 shows a module configuration of the dedicated application.

  First, the dedicated application 50 installed in the electronic pen 80 will be described. The dedicated application 50 executes predetermined processing based on entry information that is digital data corresponding to the contents entered on the dedicated paper 20 by the electronic pen 80, and is installed in the electronic pen 80 in advance by downloading or the like. Yes. The dedicated application 50 is associated with the dedicated paper 20 in principle. That is, if the type of the dedicated paper 20 is different, the dedicated application 50 that processes the data written in each dedicated paper 20 differs depending on the type. However, the correspondence between the dedicated paper 20 and the dedicated application is not necessarily one-to-one, and data may be processed by associating one dedicated application with a plurality of types of dedicated paper 20. Further, data may be processed by associating a single type of dedicated paper 20 with a plurality of dedicated applications.

  As shown in FIG. 9, the dedicated application 50 includes an information storage module 201, an entry information acquisition module 202, an area recognition module 203, a start / end point identification module 204, a tap determination module 205, an area setting module 206, a file creation module 207, The audio input module 208, the audio output module 209, and the data communication module 210 are included.

  The information storage module 201 is a module for storing the definition information shown in FIG. Further, the information storage module 201 causes the information storage means 101 to store the entry information acquired by the entry information acquisition module 202 in time series.

  The entry information acquisition module 202 has a function of acquiring entry information (including tap information) corresponding to entry by the electronic pen 80 on the dedicated paper (electronic pen medium) 20 using the entry information acquisition means 102. It is. The entry information acquisition module 202 acquires entry information corresponding to a message entered in the form 31 and a check mark entered in the service selection palette 32.

  The area recognition module 203 refers to the definition information (see FIG. 7) stored in the information storage unit 101 based on the page address and coordinate data included in the entry information acquired by the execution of the entry information acquisition module 202. This is a module for recognizing the user area where the entry has been made. The area recognition module 203 has a function of temporarily storing the recognized information in the information storage unit 101 and transmitting the information to the start / end point specifying unit 104, and causes the electronic pen 80 to configure the area recognition unit 103.

  The start / end point identification module 204 identifies the coordinate data and the entry time of the stroke data start point and the data end point included in the entry information acquired by the execution of the entry information acquisition module 202 and transmits them to the tap determination means 105. This is a module that configures the start / end point specifying means 104 in the electronic pen 80.

  The tap determination module 205 determines the stroke entered in the form 31 by the user based on the time at the data start point and the data end point specified by the execution of the start / end point specification module 204 and / or the movement distance between the two points. This is a module that has a function of determining whether or not is a tap, and causes the electronic pen 80 to configure the tap determination means 105.

  Based on the entry information stored in the information storage means 101, the area setting module 206 calculates an area including the entry stroke on the form 31 by the user as coordinate data of the user area, and assigns an area ID. This module has a function of associating with the entry information and configures the electronic pen 80 as a destination area setting unit and a message area setting unit.

  The file creation module 207 has a function of creating a new area definition information file obtained by combining a plurality of area definition information files into one based on the key value acquired by the data communication unit 110. This module constitutes the creation means 107.

  The voice input module 208 has a function of acquiring voice data input by the voice input unit (microphone) 23 during entry into the message area set by the message area setting means. Is a module that configures

  The audio output module 209 has a function of causing the audio output unit (speaker) 19 to reproduce and output the audio data acquired by the audio data acquisition unit, and causes the electronic pen 80 to configure the audio output unit 109.

  The data communication module 210 has a function of transmitting and receiving data to and from the terminal device 85. The electronic pen 80 has a file acquisition unit, destination information transmission unit, stroke information transmission unit, voice information transmission unit, completed file information transmission unit, This module constitutes coordinate data transmission means, sound data acquisition means, and key acquisition means.

  Next, dedicated applications installed on various servers will be described.

  The dedicated application 51 installed in the pen owner server 91 has an information storage module 211 and a data communication module 212. The information storage module 211 has a function of storing pen owner information in association with the pen ID, and is a module that causes the pen owner server 91 to configure the information storage unit 111. The data communication module 212 has a function of acquiring pen owner information through the terminal device 85, and is a module that causes the pen owner server 91 to configure the data communication means 112.

  The dedicated application 52 installed in the file server 92 includes an information storage module 221 and a data communication module 222. The information storage module 221 has a function of storing an area definition information file in which a corresponding user area is not defined, and is a module that causes the file server 92 to configure the information storage unit 121. The data communication module 222 has a function of transmitting an area definition information file stored in the information storage unit 121 to the electronic pen 80 when a predetermined signal is acquired from the electronic pen 80 via the terminal device 85. This is a module for configuring the data communication means 122 in the file server 91.

  The dedicated application 53 installed in the destination server 93 includes an information storage module 231 and a data communication module 232. The information storage module 231 has a function of storing stroke data entered in the destination area in association with the page ID and coordinate data included in the entry information acquired by the pen ID and the data communication unit 132, and information is stored in the destination server 93. This module constitutes the storage unit 131. The data communication module 232 has a function of acquiring destination information including the pen ID and entry information entered in the destination area from the electronic pen 80 via the terminal device 85, and fills in the destination area as necessary. This is a module that has a function of transmitting the stroke data and character string that have been sent to the terminal device 85 and various servers, and causes the destination server 93 to configure the data communication means 132.

  The dedicated application 54 installed in the stroke server 94 has an information storage module 241 and a data communication module 242. The information storage module 241 has a function of storing stroke data written in the message area in association with the pen ID, time information, writing pressure data, page address, and coordinate data included in the entry information acquired by the data communication unit 142. And a module that causes the stroke server 94 to configure the information storage unit 142. The data communication module 212 has a function of acquiring stroke information including the pen ID and entry information entered in the message area from the electronic pen 80 via the terminal device 85, and fills in the message area as necessary. This module has a function of transmitting the stroke data to the terminal device 85 and various servers, and causes the stroke server 94 to configure the data communication means 142.

  The dedicated application 55 installed in the voice server 95 has an information storage module 251 and a data communication module 252. The information storage module 251 has a function of storing voice data in association with the pen ID, time information, page address, and coordinate data based on the voice information acquired by the data communication unit 152, and the information storage unit 151 is stored in the voice server 95. Is a module that configures The data communication module 252 receives audio from the electronic pen 80 via the terminal device 85, including pen ID, time information indicating the entry time in the message area, page address and coordinate data indicating the message area, and audio data. In addition to having a function of acquiring information, the module has a function of transmitting voice data to the terminal device 85 and various servers as necessary, and causes the voice server 95 to configure the data communication means 152.

  The dedicated application 56 installed in the completed file server 96 includes an information storage module 261 and a data communication module 262. The information storage module 261 has a function of storing an area definition information file in association with the pen ID, coordinate data, and page address based on the completed file information acquired by the data communication unit 162, and stores information in the completed file server 96. This module constitutes the storage means 161. The data communication module 262 has a function of acquiring completed file information including a pen ID, coordinate data and page address indicating a message area, and an area definition information file from the electronic pen 80 via the terminal device 85. The module has a function of transmitting the area definition information file to the terminal device 85 and various servers as necessary, and makes the completed file server 96 configure the data communication means 162.

  The dedicated application 57 installed in the key distribution server 97 includes an information storage module 271 and a data communication module 272. The information storage module 271 has a function of storing a key value that can be identified in association with the destination, the entry deadline, and the pen ID of the key distributor based on the information acquired by the data communication unit 172. This module constitutes the information storage unit 171. The data communication module 272 has a function of acquiring information related to the key distributor such as the destination, the entry deadline, and the key distributor's pen ID through the terminal device 85, and the electronic information indicated by the key distributor's pen ID via the terminal device 85. This module has a function of transmitting the key value to the pen 80, and causes the key distribution server 97 to configure the data communication unit 172.

[Processing flow by this information processing system]
First, a file acquisition processing flow performed by the information processing system of this embodiment will be described with reference to FIGS. FIG. 10 is a diagram for explaining registration of pen owner information, and FIG. 11 is a diagram for explaining acquisition of an area definition information file. FIG. 12 is a flowchart of the file acquisition process.

  As shown in FIG. 10, the user who purchased the electronic pen 80 uses the terminal device 85 to send pen owner information such as the pen ID and the name, age, and address of the pen owner to the pen owner server 91. To do. The pen owner server 91 acquires information from the terminal device 85 by the data communication unit 112 and stores the pen owner information in the information storage unit 111 in association with the pen ID, thereby registering the pen owner information.

  A user who uses the service purchases a form 31 and a service selection palette 32 on which a dot pattern is printed. In this embodiment, the service for exchanging handwritten messages between users is such that the user “Taro Tanaka” sends a handwritten message to the user “Jiro Shimizu”.

  As shown in FIG. 11, Taro Tanaka purchases the form 31a with the page address “10.30.65.2” and the service selection palette 32a with the page address “10.30.20.1”. Then, Taro Tanaka taps the billing box 41 provided on the form 31a with the pen tip portion 17 of the electronic pen 80a. Then, the electronic pen 80a acquires the coordinate data, page address, time information, and writing pressure data corresponding to the tap on the form 31a as the entry information by the entry information acquisition unit 102, and stores it in the information storage unit 101 and the area. This is transmitted to the recognition means 103 (step S1). Subsequently, the area recognizing unit 103 refers to the definition information stored in the information storage unit 101 based on the page address and the coordinate data included in the entry information, so that the corresponding user area (area ID “A01”, Service content “file request”) is recognized (step S2). When the area recognition unit 103 determines that the recognized user area is the billing box 41 with the area ID “A01” and the service content “file request” (step S3; Yes), the recognized information is temporarily stored in the information storage unit 101. The information is stored and transmitted to the start / end point specifying means 104. On the other hand, if the area recognition unit 103 determines that the recognized user area is not the billing box 41 (step S3; No), the file acquisition process ends.

  The start / end point identification unit 104 identifies the coordinate data and the entry time at each of the stroke data start point and data end point included in the entry information acquired by the entry information acquisition unit 102, and transmits them to the tap determination unit 105. (Step S4). Subsequently, the tap determination unit 105 determines whether the tap to the user area, that is, the billing box 41 recognized by the area recognition unit 103 based on the time at the data start point and the data end point and / or the movement distance between the two points. It is determined whether or not it has been performed (step S5). If it is determined by the tap determination means 105 that the billing box 41 has not been tapped (step S5; No), the file acquisition process is terminated. On the other hand, when it is determined by the tap determination means 105 that the billing box 41 has been tapped (step S5; Yes), the data communication means 110 transmits a predetermined signal for requesting the area definition information file to the file server 92. (Step S6). When the file server 92 acquires the signal, the file server 92 extracts an empty area definition information file (10.32.6.5.02.pad) in which the corresponding user area is not defined from the information storage unit 121, and the data communication unit 122. To the electronic pen 80 (step S7). The electronic pen 80 acquires an empty area definition information file by the file acquisition unit, and completes the file acquisition process (step S8).

  Next, a service specifying process flow performed by the information processing system of this embodiment will be described with reference to FIGS. 11 and 13. FIG. 13 is a flowchart of the service specifying process.

  As shown in FIG. 11, Taro Tanaka uses the pen tip 17 of the electronic pen 80a to put a check mark on a box corresponding to the service he / she wants to use from among boxes provided on the service selection palette 32a. . Then, the electronic pen 80a acquires the coordinate data, page address, time information and writing pressure data corresponding to the entry on the service selection palette 32a as the entry information by the entry information obtaining unit 102 and stores it in the information storage unit 101. At the same time, it is transmitted to the area recognition means 103 (step S11). Subsequently, the area recognizing unit 103 refers to the definition information stored in the information storage unit 101 based on the page address and the coordinate data included in the entry information, so that the corresponding user area (area ID “A02”, The service content “mail paper” is recognized (step S12). In this way, the area recognizing unit 103 specifies the service content “mail paper” used by Taro Tanaka, and completes the service specifying process (step S13).

  Next, a registration processing flow performed by the information processing system of this embodiment will be described with reference to FIGS. 14 and 15. FIG. 14 is a diagram for explaining registration of destination information, stroke information, audio information, and area definition information files. FIG. 15 is a flowchart of the registration process.

  As shown in FIG. 14, Taro Tanaka enters the address “Jiro Shimizu” and the message “Congratulations on marriage, happiness” on the form 31a using the pen tip portion 17 of the electronic pen 80a. In addition, when writing a message, the voice “microphones” seem to have been quarreled, but the voice input unit (microphone) 23 of the electronic pen 80a is blown. Then, the electronic pen 80a acquires the coordinate data, page address, time information, and writing pressure data corresponding to the entry on the form 31a as the entry information by the entry information acquisition unit 102, and stores it in the information storage unit 101 and the area. This is transmitted to the setting means 106 (step S20). Further, the electronic pen 80a acquires, as voice data, the voice that is blown when the message is entered by the voice input means 108, stores it in the information storage means 101, and transmits it to the voice information transmission means (step S21).

  The destination area setting means of the area setting means 106 is based on the entry information corresponding to the entry on the form 31a stored in the information storage means 101, and the position information on the form 31a of the entry stroke corresponding to the entry on the destination. Is calculated, the coordinate data “(xn, yn), Hn, Wn” of the area including the entry stroke is calculated, an area ID is assigned as the user area, and the area ID is associated with the entry information and transmitted to the destination information transmitting means. To do. That is, a destination area is set. Further, the message area setting means calculates the position information on the form 31a of the entry stroke corresponding to the entry of the message, calculates the coordinate data of the area including the entry stroke, and assigns the area ID as the user area. The information is associated with the entry information and transmitted to the stroke information transmitting means. That is, a message area is set (step S22).

  The destination information transmitting means, based on the entry information acquired by the entry information acquisition means 102, receives destination information including a pen ID, page address and coordinate data indicating the destination area, and entry information entered in the destination area. It transmits to the destination server 93 (step S23). As shown in FIG. 14, the destination server 93 acquires the destination information by the data communication unit 132, and based on the destination information, the information storage unit 131 associates the destination ID with the pen ID, the page address indicating the destination area, and the coordinate data. The stroke data entered in the area is stored. That is, the destination server 93 registers the destination information in the information storage means 131 (step S24).

  Stroke information transmission means, based on the entry information acquired by the entry information acquisition means 102, stroke information including a pen ID, page address and coordinate data indicating a message area, and entry information entered in the message area, It transmits to the stroke server 94 (step S25). As shown in FIG. 14, the stroke server 94 obtains stroke information by the data communication means 142, and based on the stroke information, the information storage means 141 uses the pen ID, time information included in the entry information, writing pressure data, message area. The stroke data entered in the message area is stored in association with the page address indicating the coordinate data and the coordinate data. That is, the stroke server 94 registers the stroke information in the information storage unit 141 (step S26).

  The voice information transmitting means is based on the entry information acquired by the entry information acquisition means 102, the pen ID, the time information indicating the entry time in the message area, the coordinate data and page address indicating the message area, and the voice input. Voice information including the voice data acquired by the means 108 is transmitted to the voice server 95 (step S27). As shown in FIG. 14, the voice server 95 acquires voice information by the data communication means 152, and based on the voice information, the information storage means 151 associates the voice data with the pen ID, time information, page address and coordinate data. Remember. That is, the voice server 95 registers the voice information in the information storage unit 151 (step S28).

  The completed file information transmission means indicates the pen ID, the empty area definition information file (10.32.66.52.pad) acquired by the file acquisition means, and the message area set by the message area setting means. Filled file information including coordinate data and page address is transmitted to the filled file server 96 (step S29). Here, the message area and the coordinate data indicating the message area are written into an empty area definition information file. As shown in FIG. 14, the filled-in file server 96 acquires filled-in file information by the data communication unit 162 and associates it with the pen ID, coordinate data, and page address by the information storage unit 161 based on the filled-in file information. Store the area definition information file. That is, the completed file information transmission unit registers the area definition information file in the information storage unit 161 (step S30). The coordinate data and page address are written in the area definition information file. This completes the registration process.

  Subsequently, a first output processing flow performed by the information processing system of the present embodiment will be described with reference to FIGS. 16 and 17. FIG. 16 is a diagram for explaining output processing in a paper mail service. FIG. 17 is a flowchart of the first output process.

  In the service specifying process, when the area recognizing unit 103 recognizes the user area corresponding to the service content “mail paper”, the form 31a entered by Taro Tanaka is sent to the destination included in the destination information as shown in FIG. Mailed.

  As shown in FIG. 16, Jiro Shimizu, who is the destination, taps the form 31a that has been mailed by the pen tip portion 17 of the electronic pen 80b that he / she owns. Then, the electronic pen 80b acquires the coordinate data, page address, time information, and writing pressure data corresponding to the tap on the form 31a as the entry information by the entry information acquisition unit 102 and stores it in the information storage unit 101 (step). S31). Subsequently, the coordinate data transmission unit of the data communication unit 110 transmits the page address and the coordinate data included in the entry information to the voice server 95 (step S32).

  The data communication unit 152 of the voice server 95 acquires a page address and coordinate data from the coordinate data transmission unit of the electronic pen 80b (step S33). The voice server 95 extracts the corresponding voice data from the information storage unit 151 based on the page address and the coordinate data acquired by the data communication unit 152 (step S34). Then, the data communication unit 152 transmits the extracted voice data to the electronic pen 80b (step S35).

  The voice data acquisition means of the electronic pen 80b acquires voice data from the data communication means 152 of the voice server 95 (step S36). The audio output unit 109 outputs audio based on the audio data acquired by the audio data acquisition unit (step S37). That is, the voice corresponding to the specific user area of the form 31a tapped by Jiro Shimizu, the destination, is output. Thereby, the first audio output process is completed.

  Further, a second output processing flow performed by the information processing system of the present embodiment will be described with reference to FIGS. FIG. 18 is a diagram for explaining output processing in a service that transmits by mail. FIG. 19 is a flowchart of the second output process.

  In the service specifying process, when the area recognizing unit 103 recognizes the user area corresponding to the service content “send by mail”, the mail server refers to the stroke information registered in the stroke server 94 based on the completed file server 96. (Step S41). Further, the mail server refers to the voice information registered in the voice server 95 based on the completed file server 96 (step S42). Further, the mail server refers to the destination information registered in the destination server 93 based on the completed file server 96 (step S43). Then, the mail server transmits the stroke information and the voice information based on the destination information to the terminal device 85b owned by Jiro Shimizu as the destination as shown in FIG. 18 (step S44).

  Jiro Shimizu receives the mail at the terminal device 85b owned by himself and opens it (step S45). The terminal device 85b outputs an image and sound based on the stroke information and sound information received by mail (step S46). Thereby, the second audio output process is completed.

  Here, a key distribution processing flow performed by the information processing system of this embodiment will be described with reference to FIGS. FIG. 20 is a diagram for explaining key distribution in the service content “contribution”. FIG. 21 is a flowchart of the key distribution process. In the present embodiment, the service for exchanging handwritten messages by multiple users as contributions is based on the contributions of handwritten messages by users “Taro Tanaka”, “Yuko Yoshino” and “Murao Shibata”. It shall be sent to “Jiro Shimizu”.

  First, as shown in FIG. 20, Taro Tanaka uses the terminal device 85 a to fill in the contribution (July 25th, 2007), the address (Jiro Shimizu), the writer (Taro Tanaka, Yuko Yoshino, Shibata Village) Enter information about male. Here, the entry person is a key distributor to whom a key value described later is distributed. In other words, the terminal device 85a acquires information on the deadline for writing, the destination, and the writer (step S51). Then, the terminal device 85a transmits the information regarding the deadline for writing, the destination, and the writer to the key distribution server 97 (step S52).

  The data communication unit 172 of the key distribution server 97 acquires information related to the entry deadline, the destination, and the entry person from the terminal device 85a. Subsequently, the data communication unit 172 acquires a pen ID corresponding to the key distributor from the pen owner server 91 based on the acquired information on the writer. Further, the information storage unit 171 stores a key value that can be identified in association with the entry deadline, the destination, and the pen ID of the key distributor. That is, the entry deadline, destination, and key distributor's pen ID are registered in the information storage means 171 (step S53). Then, the data communication unit 172 transmits the key value to the electronic pen 80 indicated by the key distributor's pen ID via the terminal device 85. Specifically, in the example of FIG. 20, the data communication unit 172 transmits the key value “xcx123” to the electronic pen 80a of Taro Tanaka who has the pen ID “13425” via the terminal device 85a. Similarly, the data communication unit 172 transmits the key value “xcx123” to the electronic pen 80c of Yuko Yoshino who has the pen ID “12346” via the terminal device 85c. Further, the data communication unit 172 transmits the key value “xcx123” to the electronic pen 80d of Shibata Murao who has the pen ID “12347” via the terminal device 85d. That is, the data communication unit 172 distributes the key value to the key distributor (step S54). The key distribution process is completed when the electronic pens 80a, 80c, and 80d acquire the key value (step S55).

  Next, a registration processing (contribution) flow performed by the information processing system according to the present embodiment will be described with reference to FIG. 20 and FIGS. FIG. 22 is a diagram illustrating registration of stroke information and audio information in the service content “contribution”, and FIG. 23 is a diagram illustrating registration of a combined file. FIG. 24 is a flowchart of the registration process (contribution).

  The key distributor purchases the service selection palette 32 having the form 31 and the page address “10.30.20.1”, respectively. Then, the key distributor taps the billing box 41 provided on the form 31 with the pen tip portion 17 of his / her electronic pen 80. Thereby, the above-described file acquisition process is executed. Further, the key distributor enters a check mark in “Contribution” from among boxes provided on the service selection palette 32. Thereby, the above-described service specifying process is executed. The details of the file acquisition process and the service specifying process are the same as described above, and are omitted for convenience.

  Subsequently, the key distributor writes a message in the form 31 by using the pen tip portion 17 of his / her own electronic pen 80. In addition, when writing a message, a voice is blown toward the voice input unit (microphone) 23 of the electronic pen 80. Specifically, as shown in FIG. 20, Taro Tanaka enters the message “Happy” on the form 31a of the page address “10.32.6.052” with the pen tip portion 17 of the electronic pen 80a. Also, when writing a message, the voice “Congratulations on your marriage. I found a good Danna” is spoken to the voice input unit (microphone) 23 of the electronic pen 80a. As shown in FIG. 20, Yuko Yoshino and Murao Shibata also fill in a message and give a voice.

  Then, the electronic pen 80 acquires the coordinate data, page address, time information and writing pressure data corresponding to the entry on the form 31 as the entry information by the entry information acquisition unit 102 and stores it in the information storage unit 101 and the area. This is transmitted to the setting means 106 (step S60). In addition, the electronic pen 80 acquires, as voice data, the voice that is blown when the message is written by the voice input unit 108, stores the voice data in the information storage unit 101, and transmits the voice data to the voice information transmission unit (step S61).

  The message area setting means of the area setting means 106 is based on the entry information corresponding to the entry on the form 31 stored in the information storage means 101, and the position information on the form 31 of the entry stroke corresponding to the entry of the message. Is calculated, the coordinate data of the area including the entry stroke is calculated, an area ID is given as a user area, and is associated with the entry information and transmitted to the stroke information transmitting means. That is, a message area is set (step S62).

  Stroke information transmission means, based on the entry information acquired by the entry information acquisition means 102, stroke information including a pen ID, page address and coordinate data indicating a message area, and entry information entered in the message area, It transmits to the stroke server 94 (step S63). As shown in FIG. 22A, the stroke server 94 obtains stroke information by the data communication means 142, and based on the stroke information, the information storage means 141 uses the key value, pen ID, time information included in the entry information, Stroke data entered in the message area is stored in association with the pen pressure data, the page address indicating the message area, and the coordinate data. That is, the stroke server 94 registers the stroke information in the information storage unit 141 (step S64).

  The voice information transmitting means is based on the entry information acquired by the entry information acquisition means 102, the pen ID, the time information indicating the entry time in the message area, the coordinate data and page address indicating the message area, and the voice input. The voice information including the voice data acquired by the means 108 is transmitted to the voice server 95 (step S65). As shown in FIG. 22B, the voice server 95 acquires voice information by the data communication means 152, and based on the voice information, the information storage means 151 uses the key value, pen ID, time information, page address, and coordinate data. Audio data is stored in association with That is, the voice server 95 registers the voice information in the information storage unit 151 (step S66).

  The completed file information transmission means includes the key value, the pen ID, the empty area definition information file acquired by the file acquisition means, the coordinate data indicating the message area set by the message area setting means, and the page address. The filled-in file information included is transmitted to the filled-in file server 96 (step S68). Specifically, the completed file information transmitting means of the electronic pen 80a used by Taro Tanaka has a key value “xcx123”, a pen ID “13425”, an area definition information file (10.32.65.02.pad), The completed file information including the coordinate data indicating the message area and the page address is transmitted to the completed file server 96. Also, the filled file information transmission means of the electronic pen 80c used by Yuko Yoshino includes a key value “xcx123”, a pen ID “12346”, an area definition information file (10.30.12.32.pad), Filled file information including coordinate data indicating the message area and page address is transmitted to the filled file server 96. The filled file information transmission means of the electronic pen 80d used by Shibata Murao includes a key value “xcx123”, a pen ID “12347”, an area definition information file (10.30.32.02.pad), The completed file information including the coordinate data indicating the message area and the page address is transmitted to the completed file server 96.

  As shown in FIG. 23, the filled-in file server 96 obtains filled-in file information by the data communication unit 162, and the key value, pen ID, coordinate data, and page address by the information storage unit 161 based on the filled-in file information. The area definition information file is stored in association with. That is, the completed file information transmission unit registers the area definition information file in the information storage unit 161 (step S69).

  As shown in FIG. 23, the file creation means 107 of the electronic pen 80 refers to the completed file server 92 by the area definition information file generation application, and creates one area definition information file with the same key value “xcx123”. A combined file (10.12.12.13.pad) combined with is created (step S70). At this time, the area definition information file generation application creates a combined file after automatically defining the user area (message area) so that the strokes of Taro Tanaka, Yuko Yoshino, and Murao Shibata are not covered. Subsequently, the file creation means 107 prints the contribution form 33 as shown in the figure by referring to the stroke information of the stroke server 96 based on the combined file (step S71). The completed area definition information file transmission means transmits combined file information including the key value “xcx123” and the combined file to the completed file server 96 (step S72).

  As shown in FIG. 23, the completed file server 96 acquires the combined file information by the data communication unit 162, and stores the area definition information file in association with the key value by the information storage unit 161 based on the combined file information. That is, the completed file information transmission unit registers the combined file in the information storage unit 161 (step S73). This completes the registration process (contribution).

  Next, the contribution output processing flow performed by the information processing system of this embodiment will be described with reference to FIGS. FIG. 25 is a diagram for explaining a contribution output process for outputting sound when the contribution form 33 acquired by mail is tapped with the electronic pen 80. FIG. 26 is a flowchart of the contribution output process.

  The contribution form 33 printed by the file creation means 107 by the printer in the registration process (contribution) is sent by mail to a destination specified by referring to the information storage means 171 of the key distribution server 97.

  As shown in FIG. 25, Jiro Shimizu, who is the destination, taps the contributed form 33 that has been mailed by the pen tip portion 17 of the electronic pen 80b that he / she owns. Then, the electronic pen 80b acquires the coordinate data, page address, time information, and writing pressure data corresponding to the tap on the contribution form 33 as the entry information by the entry information acquisition means 102 and stores it in the information storage means 101 ( Step S81). Subsequently, the coordinate data transmission means of the data communication means 110 transmits the page address and coordinate data included in the entry information to the entered file server 96 (step S82). Specifically, as shown in the figure, Jiro Shimizu taps the area corresponding to the message “Congratulations Shibata” on the contribution form 33 with the electronic pen 80b. Then, the electronic pen 80b acquires coordinate data “(x3, y3), H3, W3”, page address “10.12.12.13”, and the like corresponding to the tap on the contribution form 33 as entry information. The data is stored in the storage unit 101 and transmitted to the file server 96 with entry.

  The data communication unit 162 of the completed file server 96 acquires a page address and coordinate data from the coordinate data transmission unit of the electronic pen 80b (step S83). The filled-in file server 96 refers to the correspondence table stored in the information storage unit 161 as shown in FIG. 25 based on the page address and the coordinate data acquired by the data communication unit 162, so that the corresponding page address is obtained. Specify (step S84). Specifically, the filled-in file server 96 uses the page address “10.12.12.13” acquired by the data communication unit 162, as shown in the correspondence table “10.12.12.13.pad”. Refer to Furthermore, the completed file server 96 identifies the corresponding page address “10.30.32.02” by referring to the correspondence table based on the page address “(x3, y3), H3, W3”. To do. Then, the data communication unit 162 of the completed file server 96 transmits the specified page address to the voice server 95.

  The data communication unit 152 of the voice server 95 acquires the page address from the completed file server 96. The voice server 95 extracts the corresponding voice data from the information storage unit 151 based on the page address acquired by the data communication unit 152 (step S85). Specifically, as shown in FIG. 25, the voice server 95 congratulates the corresponding voice data “Congratulations on marriage” from the information storage unit 151 based on the page address “10.30.32.02” acquired by the data communication unit 152. I'm going to have a wedding here too. " Then, the data communication unit 152 transmits the extracted voice data to the electronic pen 80b (step S86).

  The voice data acquisition means of the electronic pen 80b acquires voice data from the data communication means 152 of the voice server 95 (step S87). The audio output unit 109 outputs audio based on the audio data acquired by the audio data acquisition unit (step S88). That is, the voice corresponding to the specific user area of the contribution form 33 tapped by Jiro Shimizu, the destination, is output. Thereby, the contribution output process is completed.

  Thus, the user can add audio information of an arbitrary capacity to an arbitrary position on the form. In addition, messages within an arbitrary period can be freely edited.

  Specifically, as shown in FIG. 27, using the electronic pen 80 and a mobile phone, a gift is delivered to the bride and groom along with a gift on the wedding day, and a voice message from the bride and groom is heard on the mobile phone. A service that can be used is also possible.

[Effects of this information processing system]
According to this information processing system, voice information of an arbitrary capacity is added to an arbitrary position on the dedicated paper 20 in association with a character string written on the dedicated paper (electronic pen medium) 20 with the electronic pen 80. can do. According to this, a handwritten message with voice information can be easily exchanged via mail or mail.

  The present invention is not limited to the above-described embodiment. For example, as shown in FIG. 28, a bidirectional letter to which voice information is added can be exchanged. It is possible to add not only audio information but also map information and image information. Therefore, it can be used as a communication tool for grandfathers and grandchildren.

  Furthermore, as shown in FIG. 29, a letter exchange for a specific period (for example, from April 1, 2005 to March 31, 2006) is prepared as a booklet and sent to both the grandfather and grandchild. be able to. According to this, it becomes possible to hear the voice added to the previous letter. Moreover, if it is created every year along with the growth of grandchildren, it will become a growth diary.

  In the above embodiment, the clock 22 of the electronic pen 80 transmits the current time (see FIG. 2). However, the clock 22 is in a communication connection state after the communication connection with the terminal device 85 is established. In the meantime, the entry time starting from 0 and elapses during the entry of the stroke may be transmitted. In this case, the processor 11 acquires the elapsed time (entry time) transmitted by the clock 22 as time information during stroke entry, and associates the time information, pen pressure data, and X, Y coordinate data, The data communication unit 13 is transmitted to the terminal device 85 as entry information.

  Further, property information (pen information or pen owner information) regarding the pen itself or its owner may be held in the electronic pen 80 so that it can be referred to from the terminal device 85, or property information. May be transmitted to the terminal device 85 together with the entry information. The pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, free memory capacity, and the like. Pen owner information includes nationality, language, time zone, email address, name, address, fax / phone number, mobile phone number, and the like.

  In the above embodiment, the dot is ink containing carbon that absorbs infrared rays, and the LED 15 of the electronic pen 80 is an LED that irradiates infrared rays. However, it is not limited to this. For example, the dot is ink that emits light of a predetermined wavelength by light of a predetermined wavelength, the LED 15 of the electronic pen 80 is irradiated with light that emits the ink of the dot, and the region of the wavelength that the ink of the dot is emitted by the camera 16 is set. By detecting, the dot pattern may be read by the electronic pen 80. If the dot pattern can be read by the camera 16, the ink type of the dot, the irradiation light of the LED 15, etc. are limited to those shown in the above embodiment. I can't. In addition, as long as the position coordinates on the dedicated paper 20 can be specified, another coded pattern such as a two-dimensional code pattern may be used instead of the dot pattern.

  In addition, the dot pattern is normally assigned for each use of the paper, but when the dedicated paper 20 is printed in large quantities by a commercial printing machine, the same dot pattern is printed on the same type of electronic pen medium. Will be. In this case, in order to distinguish the electronic pen medium of the same type one by one, the electronic pen medium may be provided with an identification information entry field for entering identification information for identifying each medium. In the electronic pen 80, if the identification information entered in the identification information entry field is identified by character recognition based on the acquired entry information and stored in association with the entry information, the same kind of electronic pen medium can be obtained. One by one can be distinguished. In addition, the pen ID may be stored in association with the entry information together with the identification information. Thereby, the electronic pen 80 can identify each electronic pen medium based on the stored identification information or the identification information and the pen ID. On the other hand, when printing with a printer, it is also possible to assign a different dot pattern to each sheet of paper and print the dedicated paper 20. In this case, since the dot pattern printed on each dedicated paper 20 is different for each dedicated paper 20, the dedicated paper 20 can be identified and distinguished one by one by the dot pattern.

[Modification]
In the above embodiment, the electronic pen 80 includes the memory 12, the speaker 19, the microphone 23, and the like, and executes the units 101 to 110 shown in FIG. 6, but the present invention is not limited to this. Instead, the electronic pen 10 transmits the acquired entry information to the terminal device 25A immediately and sequentially by the data communication unit 13, and the terminal device 25A having a memory, a speaker, a microphone, and the like is used for each unit 101 shown in FIG. To 110 may be executed.

  Here, the information processing system of this modification will be described with reference to FIG. FIG. 30 is a block diagram showing a configuration of the electronic pen 10A. The electronic pen 10A includes a pen tip portion 17 similar to a normal ink pen. When a user writes characters on the dedicated paper 20 with the pen tip portion 17 in the same manner as a normal ink pen, the electronic pen 10A The dot pattern printed on the dedicated paper 20 is read locally and continuously along the movement trajectory of the pen tip portion 17, the coordinates of the local position on the dedicated paper 20 are calculated, and the coordinate data and the like are used as the terminal device 25A. Send to. The electronic pen 10A is used in the vicinity of the terminal device 25A so that data can be reliably transmitted to the terminal device 25A. Based on the received coordinate data and the like, the terminal device 25A performs predetermined processing such as character recognition of the entered character or processing corresponding to the tap. Specifically, the terminal device 25A executes the units 101 to 110 executed by the electronic pen 80 in the above embodiment. Thereby, also in the information processing system of this modification, the effect similar to the said embodiment can be acquired.

  The difference between this modification and the above embodiment is the configuration of the electronic pen 10A. Therefore, the configuration of the dedicated paper (electronic pen medium) 20 and the dot pattern, each unit executed by the terminal device 25A, etc. The description of the same parts as the embodiment is omitted for convenience.

  Here, the electronic pen 10A will be described. As shown in FIG. 2, the electronic pen 10A includes a processor 11, a data communication unit 13, a battery 14, an LED 15, a camera 16, a pressure sensor 18, and a clock 22 therein. The electronic pen 10A includes an ink cartridge (not shown) as a component similar to a normal ink pen.

  The battery 14 is for supplying power to each component in the electronic pen 10A. For example, the power of the electronic pen 10A itself is turned on / off by attaching / detaching a cap (not shown) of the electronic pen 10A. May be. The clock 22 transmits the current time (time stamp) and supplies it to the processor 11. The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters or the like on the dedicated paper 20 with the electronic pen 10 </ b> A, that is, the writing pressure, and supplies the pressure to the processor 11.

  The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when a user writes a character or the like on the medicine record book 26 with the electronic pen 10A, a pen pressure is applied to the pen tip portion 17, and when the pressure sensor 18 detects a pen pressure greater than a predetermined value, the processor 11 determines that the user has started to fill in the dedicated paper 20 and activates the LED 15 and the camera 16.

  The LED 15 is attached in the vicinity of the pen tip of the electronic pen 10A, and irradiates infrared rays toward the vicinity of the pen tip portion 17 (region 15a) on the medicine record book 26 (see FIG. 1). The region 15 a is slightly shifted from the position where the pen tip portion 17 contacts the dedicated paper 20. The camera 16 captures a dot pattern in the area 15 a illuminated by the LED 15 and supplies image data of the dot pattern to the processor 11. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 15 are absorbed by the carbon contained in the dots at the dot portions. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, the area of the dot containing carbon and the other area can be distinguished from the difference in the amount of reflected infrared light by photographing with the camera 16. Even if a ruled line, a frame, or the like is printed in the photographing region, the dot pattern can be recognized because the ink of the ruled line, the frame, etc. does not contain carbon. Note that the imaging area of the camera 16 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 6A, and the imaging of the camera 16 is performed about 50 to 100 times per second.

  While the user fills in the dedicated paper 20, the processor 11 uses the X and Y coordinates on the dedicated paper 20 of the stroke corresponding to the user's fill from the dot pattern of the image data supplied by the camera 16. (Simply called “coordinate data”) is continuously calculated. That is, the processor 11 converts the image data of the dot pattern as shown in FIG. 6A supplied by the camera 16 into the data array shown in FIG. 6B, and further converts the X coordinate bit value · Y The coordinate bit value is converted, X and Y coordinate data is calculated from the data array by a predetermined calculation method, and a dot pattern address (coded pattern address) that is a unique identifier for each page of the medicine record book 26 is calculated. calculate. The processor 11 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data, the dot pattern address, and the X and Y coordinate data, and fills in these information. As information, the data communication unit 13 is transmitted to the terminal device 25A. Here, since the 6 × 6 dot pattern in one sheet of dedicated paper (electronic pen medium) 20 does not overlap in the dedicated paper 20, the user can use the electronic pen 10A to select any of the dedicated paper 20 If necessary items are entered or tapped in the area, it can be identified from the coordinate data to which area of the dedicated paper 20 the entry or tap corresponds.

  The data communication unit 13 wirelessly transmits predetermined data in the memory 12 supplied by the processor 11 to a nearby terminal device 25A. Transmission by the data communication unit 13 is preferably performed by wireless transmission using Bluetooth (registered trademark). Note that data transmission from the data communication unit 13 to the terminal device 25A may be performed by other methods such as wired transmission using a USB cable or data transmission by contact with a terminal. Transmission of entry information to the terminal device 25A by the data communication unit 13 is performed immediately and sequentially.

  The terminal device 25A is a PC, a mobile phone, or a mobile terminal that includes an antenna device capable of data communication with the electronic pen 10A, a processor such as a CPU, a memory such as a ROM or a RAM, a speaker, and a display as hardware. is there. The terminal device 25A performs a predetermined process by executing a dedicated application based on entry information such as X and Y data acquired from the electronic pen 10A. The dedicated application included in the terminal device 25A and each means executed by the terminal device 25A are the same as those in the above embodiment, and thus the description thereof is omitted for the sake of convenience.

  In addition, this invention is not restricted to the said modification. In the above modification, the electronic pen 10A including the clock 22 is used as shown in FIG. 30, but the electronic pen 10B not including the clock 22 as shown in FIG. 31 may be used. In this case, the processor 11 acquires writing pressure data, dot pattern addresses, and X and Y coordinate data while the user performs an entry using the electronic pen 10B, and the data communication unit uses these data as entry information. 13 to the terminal device 25B (25). Instead, the terminal device 25B is provided with a clock for transmitting the current time, and the entry information acquisition means 31 acquires the entry information transmitted from the electronic pen 10B immediately and sequentially, and transmits it from the clock at the time of acquisition. The obtained current time is stored as the acquisition time in the information storage means 30 in association with the entry information. That is, the terminal device 25B stores the entry information and the acquisition time of the entry information in association with each other.

  Further, property information (pen information or pen owner information) regarding the pen itself or its owner may be held in the electronic pen 10 so that it can be referred to from the terminal device 25, or property information. May be transmitted to the terminal device 25 together with the entry information. Pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, and the like. Pen owner information includes nationality, language, time zone, email address, name, address, fax / phone number, mobile phone number, and the like.

  Further, in the above embodiment, the dots are ink containing carbon that absorbs infrared rays, and the LEDs 15 of the electronic pen 10 are LEDs that irradiate infrared rays. However, it is not limited to this. For example, the dot is ink that emits light of a predetermined wavelength by light of a predetermined wavelength, the LED 15 of the electronic pen 10 is irradiated with light that causes the ink of the dot to emit light, and the region of the wavelength that the ink of the dot is emitted by the camera 16 is set. By detecting the dot pattern, the electronic pen 10 may read the dot pattern. If the dot pattern can be read by the camera 16, the ink type of the dot and the irradiation light of the LED 15 are limited to those shown in the above embodiment. I can't. Further, as long as the position coordinates on the dedicated paper (electronic pen medium) 20 can be specified, another coded pattern such as a two-dimensional code pattern may be used instead of the dot pattern.

  According to this information processing system, voice information of an arbitrary capacity is added to an arbitrary position on the dedicated paper 20 in association with a character string written on the dedicated paper (electronic pen medium) 20 with the electronic pen 10A. can do. According to this, a handwritten message with voice information can be easily exchanged via mail or mail.

  INDUSTRIAL APPLICABILITY The present invention can be used in various fields as an electronic pen capable of providing a service capable of adding voice information to handwritten messages and exchanging them.

It is a figure which shows the usage pattern of an electronic pen typically. It is a block diagram which shows the structure of the electronic pen in embodiment. It is an example of the medium for electronic pens in embodiment. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is a functional block diagram which shows the main structures of an electronic pen. It is a figure which shows the data structure of definition information typically. It is a figure explaining coordinate data. It is a module block diagram of a dedicated application in the embodiment. It is a figure explaining registration of pen owner information. It is a figure explaining acquisition of an area definition information file. It is a flowchart of a file acquisition process. It is a flowchart of a service specific process. It is a figure explaining registration of destination information, stroke information, voice information, and an area definition information file. It is a flowchart of a registration process. It is a figure explaining the output process in the service mailed by paper. It is a flowchart of a 1st output process. It is a figure explaining the output process in the service transmitted with mail. It is a flowchart of the 2nd output processing. It is a figure explaining distribution of the key in service contents "contribution". It is a flowchart of a key distribution process. It is a figure explaining registration of stroke information and voice information in service contents "contribution". It is a figure explaining registration of a joint file. It is a flowchart of a registration process (contribution). It is a figure explaining the contribution output process which outputs an audio | voice based on an contribution form. It is a flowchart of a contribution output process. It is a figure explaining the wedding contribution service. It is a figure explaining the communication tool of grandfather and grandchild. It is a figure explaining memorial album service. It is a block diagram which shows the structure of the electronic pen in a modification (with a clock). It is a block diagram which shows the structure of the electronic pen in a modification (no clock).

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Processor, 12 ... Memory, 13 ... Data communication unit, 14 ... Battery, 15 ... LED, 16 ... Camera, 18 ... Pressure sensor, 19 ... Speaker, 20 ... Dedicated paper (medium for electronic pens), 22 ... Clock, DESCRIPTION OF SYMBOLS 23 ... Microphone, 50 ... Dedicated application, 80 ... Electronic pen, 85 ... Terminal device, 101 ... Information storage means, 102 ... Entry information acquisition means, 103 ... Area recognition means, 104 ... Start / end point specifying means, 105 ... Tap determination Means 106, area setting means 107, file creation means 108, voice input means 109, voice output means 110, data communication means

Claims (26)

An electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a page address for identifying a predetermined page on the coding pattern is associated with coordinate data on the coding pattern of a predetermined area;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area by referring to the definition information based on page address and coordinate data included in the entry information;
Tap determining means for determining whether the area recognized by the area recognizing means is tapped based on the entry information;
An electronic pen comprising: a file acquisition unit that acquires an area definition information file based on a determination result by the tap determination unit. A start / end point specifying means for specifying a data start point and a data end point based on the entry information;
The tap determination unit determines whether the area recognized by the area recognition unit is tapped based on a time and / or distance based on the data start point and the data end point. The electronic pen described. Based on the entry information, a destination area setting means for setting an area in which the destination is entered on the coded pattern as a destination area;
The destination information transmitting means for transmitting destination information including stroke data entered in the destination area, coordinate data indicating the destination area, and a page address, further comprising: Electronic pen. Based on the entry information, message area setting means for setting an area where a message is entered on the coded pattern area as a message area;
The stroke information transmitting means for transmitting stroke information including stroke data written in the message area, coordinate data indicating the message area, and a page address, further comprising: An electronic pen according to claim 1. The electronic pen includes a voice input unit,
Voice input means for inputting voice by the voice input unit during filling in the message area;
5. The voice information transmitting means for transmitting voice information including voice data inputted by the voice input means, coordinate data indicating the message area, and a page address, further comprising: An electronic pen according to claim 1.   The file definition means further comprises: an area definition information file acquired by the file acquisition means; and a completed file information transmission means for transmitting completed file information including coordinate data and a page address indicating the message area. Item 6. The electronic pen according to any one of Items 1 to 5. The electronic pen includes a voice output unit,
Transmitting means for transmitting the page address and coordinate data included in the entry information acquired by the entry information acquisition means;
Audio data acquisition means for acquiring audio data corresponding to the page address and the coordinate data;
The electronic pen according to claim 6, further comprising a voice output unit that outputs a voice based on the voice data acquired by the voice data acquisition unit from the voice output unit. An electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
A key acquisition means for acquiring a key value;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Based on the entry information, a message area setting means for setting an area where a message is entered on the coding pattern as a message area;
The key value acquired by the key acquisition means, the stroke data entered in the message area, the page address for identifying the page that can be placed on the coding pattern provided with the message area, and the coordinates indicating the message area An electronic pen comprising: stroke information transmitting means for transmitting stroke information including data. The electronic pen includes a voice input unit,
Voice input means for inputting voice by the voice input unit during filling in the message area;
Voice information transmitting means for transmitting voice information including the key value acquired by the key acquisition means, the voice data input by the voice input means, and the coordinate data and page address indicating the message area; The electronic pen according to claim 8. The electronic pen is communicably connected to a completed file server,
Stroke information acquisition means for acquiring the stroke information corresponding to the key value acquired by the key value acquisition means;
Based on the stroke information acquired by the stroke information acquisition means, a file creation means for creating a new area definition information file;
An entry definition information file created by the file creation means; and filled file information transmission means for sending filled file information including coordinate data and a page address indicating the message area to the filled file server. The electronic pen according to claim 8 or 9, wherein The filled-in file server is created based on the filled-in file information and stores a correspondence table in which coordinate data indicating the message area and a page address are associated with each other.
The electronic pen includes a voice output unit,
Transmitting means for transmitting the page address and coordinate data included in the entry information acquired by the entry information acquisition means;
Audio data acquisition means for acquiring audio data extracted by referring to the correspondence table based on the page address and the coordinate data;
The electronic pen according to claim 10, further comprising voice output means for outputting voice based on voice data acquired by the voice data acquisition means by the voice output unit. A program executed by an electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a page address for identifying a predetermined page on the coding pattern is associated with coordinate data on the coding pattern of a predetermined area;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area by referring to the definition information based on a page address and coordinate data included in the entry information;
Tap determining means for determining whether the area recognized by the area recognizing means is tapped based on the entry information;
A program for causing the electronic pen to function as a file acquisition unit that acquires an area definition information file based on a determination result by the tap determination unit. A program executed by an electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
A key acquisition means for acquiring a key value;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
A message area setting means for setting, in the message area, an area where a message is written on the coding pattern based on the entry information;
The key value acquired by the key acquisition means, the stroke data entered in the message area, the page address for identifying the page that can be placed on the coding pattern provided with the message area, and the coordinates indicating the message area A program for causing the electronic pen to function as stroke information transmitting means for transmitting stroke information including data. A terminal device for processing information written on an electronic pen medium on which a coded pattern recognizable by an electronic pen is printed,
Information storage means for storing definition information in which a page address for identifying a predetermined page on the coding pattern is associated with coordinate data on the coding pattern of a predetermined area;
From the electronic pen, entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area by referring to the definition information based on page address and coordinate data included in the entry information;
Tap determining means for determining whether the area recognized by the area recognizing means is tapped based on the entry information;
A terminal device comprising: a file acquisition unit that acquires an area definition information file based on a determination result by the tap determination unit. A start / end point specifying means for specifying a data start point and a data end point based on the entry information;
The tap determination unit determines whether the area recognized by the area recognition unit is tapped based on time and / or distance based on the data start point and the data end point. The terminal device described. Based on the entry information, a destination area setting means for setting an area in which the destination is entered on the coded pattern as a destination area;
16. The destination information transmitting means for transmitting destination information including stroke data entered in the destination area, coordinate data indicating the destination area, and a page address, further comprising: Terminal equipment. Based on the entry information, message area setting means for setting an area where a message is entered on the coded pattern area as a message area;
The stroke information transmitting means for transmitting stroke information including stroke data written in the message area, coordinate data indicating the message area, and a page address, further comprising: The terminal device according to claim 1. The terminal device includes a voice input unit,
Voice input means for inputting voice by the voice input unit during filling in the message area;
18. The voice information transmitting means for transmitting voice information including voice data inputted by the voice input means, coordinate data indicating the message area, and a page address, further comprising: The terminal device according to claim 1.   The file definition means further comprises: an area definition information file acquired by the file acquisition means; and a completed file information transmission means for transmitting completed file information including coordinate data and a page address indicating the message area. Item 19. The terminal device according to any one of Items 14 to 18. The terminal device includes an audio output unit,
Transmitting means for transmitting the page address and coordinate data included in the entry information acquired by the entry information acquisition means;
Audio data acquisition means for acquiring audio data corresponding to the page address and the coordinate data;
The terminal device according to claim 19, further comprising: an audio output unit that outputs audio based on the audio data acquired by the audio data acquisition unit from the audio output unit. A terminal device for processing information written on an electronic pen medium on which a coded pattern recognizable by an electronic pen is printed,
A key acquisition means for acquiring a key value;
From the electronic pen, entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Based on the entry information, a message area setting means for setting an area where a message is entered on the coding pattern as a message area;
The key value acquired by the key acquisition means, the stroke data entered in the message area, the page address for identifying the page that can be placed on the coding pattern provided with the message area, and the coordinates indicating the message area And a stroke information transmitting means for transmitting stroke information including data. The terminal device includes a voice input unit,
Voice input means for inputting voice by the voice input unit during filling in the message area;
Voice information transmitting means for transmitting voice information including the key value acquired by the key acquisition means, the voice data input by the voice input means, and the coordinate data and page address indicating the message area; The terminal device according to claim 21. The terminal device is communicably connected to the completed file server;
Stroke information acquisition means for acquiring the stroke information corresponding to the key value acquired by the key value acquisition means;
Based on the stroke information acquired by the stroke information acquisition means, a file creation means for creating a new area definition information file;
An entry definition information file created by the file creation means; and filled file information transmission means for sending filled file information including coordinate data and a page address indicating the message area to the filled file server. The terminal device according to claim 21 or 22, wherein The filled-in file server is created based on the filled-in file information and stores a correspondence table in which coordinate data indicating the message area and a page address are associated with each other.
The terminal device includes an audio output unit,
Transmitting means for transmitting the page address and coordinate data included in the entry information acquired by the entry information acquisition means;
Audio data acquisition means for acquiring audio data extracted by referring to the correspondence table based on the page address and the coordinate data;
The terminal device according to claim 23, further comprising: an audio output unit that outputs audio based on the audio data acquired by the audio data acquisition unit by the audio output unit. A program executed by a computer for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a page address for identifying a predetermined page on the coding pattern is associated with coordinate data on the coding pattern of a predetermined area;
From the electronic pen, entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area by referring to the definition information based on page address and coordinate data included in the entry information;
Tap determining means for determining whether the area recognized by the area recognizing means is tapped based on the entry information;
A program that causes the computer to function as a file acquisition unit that acquires an area definition information file based on a determination result by the tap determination unit. A program executed by a computer for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
A key acquisition means for acquiring a key value;
From the electronic pen, entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Based on the entry information, a message area setting means for setting an area where a message is entered on the coding pattern as a message area;
The key value acquired by the key acquisition means, the stroke data entered in the message area, the page address for identifying the page that can be placed on the coding pattern provided with the message area, and the coordinates indicating the message area A program for causing the computer to function as stroke information transmitting means for transmitting stroke information including data.

Images