JP4962338B2 - Electronic pen and program - Google Patents

Description

  The present invention relates to a technique for processing entry information entered on an electronic pen medium by an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known (see Patent Document 1). Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an annotation pen, or puts a check mark on the image designed on the special paper, the small camera displays the dot pattern printed on the special paper as the pen moves. Entry information such as characters and images detected and written by the user is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a method for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 2).

  On the other hand, in an IC memory voice recording / playback apparatus capable of recording voice, a technique has been proposed in which the recorded voice is cued by recording a mark indicating a break of voice data in advance (Patent Document 3). See).

  Patent Document 4 describes a method that enables search by handwritten annotation content, writing time, and search by a writer by digitizing handwritten notes and annotations including their attribute information. .

  Patent Document 5 describes a method of associating the content handwritten by a user on a medium such as paper with various types of information such as audio information, image information, and moving image information using handwriting time and provision time.

Japanese translation of PCT publication No. 2003-511761 JP 2004-153612 A JP-A-5-334893 JP 2006-31492 A JP 2007-133550 A

  In the electronic pen, the user area is automatically assigned to the outer frame of the stroke written by the user. Then, audio data, image data, and the like can be associated with the user area. However, when associating the recorded voice information with a recorder such as that disclosed in Patent Document 3, the user assigns a file name manually or based on the recorded time, and cues based on the file name.

  Therefore, the present invention provides an electronic pen that can refer to recorded voice information on an electronic pen entry medium, and can shorten the reference time and improve operability, and a program used therefor. Objective.

An electronic pen according to the present invention is an electronic pen that processes information entered in an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed, and includes a voice recording unit that records voice, and entry information acquisition means for acquiring entry information corresponding to the entry content of the electronic pen writing tablet, for the voice recording unit, based on the entry information, recording the entry start time to the electronic pen writing tablet A voice recording means for instructing to end recording when a predetermined end determination time has elapsed from the end time of entry to the electronic pen entry medium, and corresponding to the entry contents based on the entry information Corresponding user area defining means for automatically defining a user area to be performed, the user area, and coordinate data indicating a position coordinate of the user area on the coding pattern User area definition information storage means for storing the user area definition information, and association information storage means for storing association information in which the user area and the voice information recorded by the voice recording means are associated with each other. It is characterized by that.

The electronic pen configured as described above acquires entry information, which is digital data corresponding to the contents entered in the entry medium for the electronic pen on which a recognizable dot pattern is printed, and processes based on the entry information. Can be executed. In the present invention, the entry information includes not only digital data corresponding to the contents entered on the electronic pen entry medium but also digital data corresponding to taps on the electronic pen entry medium. Tapping is to tap an electronic pen entry medium with the electronic pen. For example, the user enters an arbitrary character string on the electronic pen entry medium. Here, the character string is a collection of one or more characters such as numbers, hiragana, katakana, Greek characters, JIS1, and JIS2. At this time, the electronic pen acquires coordinate information, time information, writing pressure information, and the like corresponding to the entered character string as entry information. The coordinate information is X , Y coordinate data indicating the position coordinates of the character string on the dot pattern printed on the electronic pen entry medium. The time information is information indicating the time entered with the electronic pen or the time when a predetermined area is tapped. The writing pressure information is writing pressure data obtained from the pressure sensor 18. The electronic pen defines a user area based on coordinate information included in the acquired entry information. Specifically, a rectangular frame is recognized so as to touch the outside of the entry content, the rectangular area is registered as a user area, and an area ID is assigned. The electronic pen stores user area definition information in which a user area to which a user area ID is assigned and coordinate data indicating the position coordinates of the user area are associated with each other. The electronic pen starts recording at the entry start time on the electronic pen entry medium based on the entry information to the voice recording unit, and a predetermined end determination time elapses from the entry end time on the entry medium for the electronic pen. Instructing the recording to end. The electronic pen stores the voice information recorded by the voice recording unit in association with the defined user area.

An electronic pen according to the present invention is an electronic pen that processes information entered in an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed, and includes a voice recording unit that records voice, An entry information acquisition means for obtaining entry information corresponding to the entry contents on the electronic pen entry medium, and recording to the voice recording unit based on the entry information at the entry start time on the entry medium for the electronic pen Voice recording means for instructing to end recording when the entry information acquisition means detects specific stroke information included in the entry information, and corresponds to the entry contents based on the entry information User area defining means for automatically defining a user area to be performed, the user area, and coordinate data indicating position coordinates of the user area on the coding pattern; User area definition information storage means for storing associated user area definition information, association information storage means for storing association information in which the user area and voice information recorded by the voice recording means are associated, It is characterized by providing.
The electronic pen configured as described above acquires entry information, which is digital data corresponding to the contents entered in the entry medium for the electronic pen on which a recognizable dot pattern is printed, and processes based on the entry information. Can be executed. The electronic pen defines a user area based on coordinate information included in the acquired entry information. The electronic pen stores user area definition information in which a user area to which a user area ID is assigned and coordinate data indicating the position coordinates of the user area are associated with each other. The electronic pen starts recording at the entry start time for the electronic pen entry medium based on the entry information to the voice recording unit, and the entry information acquisition means detects specific stroke information included in the entry information. Sometimes it tells you to stop recording. The electronic pen stores the voice information recorded by the voice recording unit in association with the defined user area.

An electronic pen according to the present invention is an electronic pen that processes information entered in an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed, and includes a voice recording unit that records voice, An entry information acquisition means for obtaining entry information corresponding to the entry contents on the electronic pen entry medium, and recording to the voice recording unit based on the entry information at the entry start time on the entry medium for the electronic pen Voice recording means for instructing to end recording after a predetermined time has elapsed since the entry information acquisition means detects specific stroke information included in the entry information, and the entry based on the entry information User area defining means for automatically defining a user area corresponding to the content, the user area, and a position indicating a position coordinate of the user area on the coding pattern User area definition information storage means for storing user area definition information in association with data, and association information storage for storing association information in which the user area and voice information recorded by the voice recording means are associated with each other And means.
The electronic pen configured as described above acquires entry information, which is digital data corresponding to the contents entered in the entry medium for the electronic pen on which a recognizable dot pattern is printed, and processes based on the entry information. Can be executed. The electronic pen defines a user area based on coordinate information included in the acquired entry information. The electronic pen stores user area definition information in which a user area to which a user area ID is assigned and coordinate data indicating the position coordinates of the user area are associated with each other. The electronic pen starts recording at the entry start time on the electronic pen entry medium based on the entry information, and the entry information acquisition means detects the specific stroke information included in the entry information. Instructing the recording to end after a predetermined time. The electronic pen stores the voice information recorded by the voice recording unit in association with the defined user area.

Furthermore, the electronic pen is tapped by referring to the user area definition information based on the voice output unit that outputs voice and the tap information corresponding to the tap to the user area included in the entry information. User area specifying means for specifying a user area; and voice output means for outputting the voice information stored in association with the user area specified by the user area specifying means from the voice output unit. The person can confirm the voice information associated with the contents entered by the person. For example, when referring to the voice associated with the character string entered by the user, the character string is tapped. As a result, the user area defined in the character string is tapped. At this time, the electronic pen acquires coordinate information, time information, and the like corresponding to the tap as entry information (tap information). The electronic pen identifies the tapped user area by referring to the user area definition information based on the coordinate information included in the acquired tap information. The electronic pen refers to the association information and outputs audio information stored in association with the identified user area from the audio output unit. Thereby, the user can confirm the voice information associated with the entered character string.

  Furthermore, the electronic pen includes a start / end point specifying unit that specifies a stroke start point and a stroke end point of the tap based on the tap information, and the user area specifying unit includes the stroke start point and the stroke end point. The user area including both the stroke start point and the stroke end point can be identified by referring to the user area definition information based on the coordinate data.

The program according to the present invention is caused to function as the electronic pen.

  By executing the program, the electronic pen described above can be realized. Moreover, each aspect of the electronic pen described above can be realized in the same manner.

  According to the electronic pen and the program used therefor according to the present invention, the recorded voice information can be referred to on the electronic pen entry medium, and the reference time can be shortened and the operability can be improved.

  Preferred embodiments of the present invention will be described below with reference to the drawings.

  As shown in FIGS. 1 and 2, the information processing system according to the present embodiment includes an electronic pen 10, a dedicated paper (electronic pen medium) 20, and a terminal device 25. Here, FIG. 1 is a diagram schematically illustrating a usage pattern of the electronic pen 10, and FIG. 2 is a block diagram illustrating a configuration of the electronic pen 10. A dot pattern (coded pattern) is printed on the dedicated paper 20. The electronic pen 10 includes a pen tip portion 17 similar to a normal ink pen. When a user writes characters on the dedicated paper 20 by the pen tip portion 17 in the same manner as a normal ink pen, the electronic pen 10 The dot pattern printed on the dedicated paper 20 is read locally and continuously along the movement trajectory of the pen tip portion 17, and the coordinates of the local position on the dedicated paper 20 are calculated. Based on the coordinate data and the like, Predetermined processing is executed, such as storing input characters or performing processing according to the tap. Hereinafter, each configuration will be described in detail.

  The terminal device 25 includes, as hardware, an antenna device capable of data communication with the electronic pen 10, a processor such as a CPU, a memory such as a ROM and a RAM, a speaker, a display, and the like, a PC, a mobile phone, or the like. It is a mobile terminal.

[Dedicated paper]
First, the dedicated paper 20 will be described. The dedicated paper 20 is a paper in which a dot pattern is printed on a sheet of paper, and further, designs, items such as ruled lines and entry frames, words, words, illustrations, and the like are printed thereon. The dot pattern is printed with ink containing carbon that absorbs infrared rays. In addition, the design and the like are printed with ordinary ink that does not contain carbon. The dot pattern and the design may be printed on the paper at the same time, or either one may be printed first.

  The dot pattern is printed on almost the entire surface of the entry form, and a frame line or the like is printed thereon with a normal ink not containing carbon. The user fills in using the electronic pen 10 without being aware of the dot pattern.

  As described above, by printing a predetermined design on the dedicated paper on which the dot pattern is printed, an entry sheet using the dedicated paper can be generated. When the user fills in the entry form using the electronic pen 10, the electronic data is automatically acquired.

[Dot pattern]
Next, the dot pattern will be described. FIG. 3 is a diagram illustrating the relationship between the dots of the dot pattern printed on the dedicated paper 20 and the values to which the dots are converted. As shown in FIG. 3, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left and right are shifted from the reference position of the grid (intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the dedicated paper 20 are determined by the combination of information thus associated.

  FIG. 4A shows an arrangement of a certain dot pattern. As shown in FIG. 4A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken from any part of the dedicated paper. Yes. A dot pattern formed by these 36 dots holds position coordinates (for example, on which position the dot pattern is located on the dedicated paper). FIG. 4B is a diagram in which each dot shown in FIG. 4A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 10 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 10 will be described. As shown in FIG. 2, the electronic pen 10 includes a processor 11, a memory 12, a data communication unit 13, a battery 14, an LED 15, a camera 16, a recorder 17, a pressure sensor 18, a speaker (audio output unit) 19, and a clock. 22. The electronic pen 10 includes an ink cartridge (not shown) as a component similar to a normal ink pen.

  The LED 15 is attached in the vicinity of the pen tip of the electronic pen 10 and illuminates infrared rays toward the vicinity (region 15) of the pen tip portion 17 on the dedicated paper 20 (see FIG. 1). The region 15 is slightly deviated from the position where the pen tip portion 17 contacts the dedicated paper 20. The camera 16 captures a dot pattern in the area 15 illuminated by the LED 15 and supplies image data of the dot pattern to the processor 11. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 15 are absorbed by the carbon contained in the dots at the dot portions. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, the area of the dot containing carbon and the other area can be distinguished from the difference in the amount of reflected infrared light by photographing with the camera 16. Even if a ruled line, a frame, or the like is printed in the photographing region, the dot pattern can be recognized because the ink of the ruled line, the frame, etc. does not contain carbon. Note that the imaging area of the camera 16 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 4A, and the imaging of the camera 16 is performed about 50 to 100 times per second.

  The battery 14 is for supplying power to each component in the electronic pen 10, and is configured to turn on / off the power of the electronic pen 10 itself by, for example, detaching a cap (not shown) of the electronic pen 10. May be. The clock 22 transmits the current time (time stamp) and supplies it to the processor 11. The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters on the dedicated paper 20 with the electronic pen 10, that is, the writing pressure, and supplies the detected pressure to the processor 11.

  The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when a user writes characters or the like on the dedicated paper 20 with the electronic pen 10, writing pressure is applied to the pen tip portion 17, and when the pressure sensor 18 detects a writing pressure exceeding a predetermined value, the processor 11. Determines that the user has started entry and activates the LED 15 and the camera 16.

  While the user inputs, the processor 11 uses the dot pattern of the image data supplied by the camera 16 to determine the X and Y coordinates (simply “coordinate data”) on the dedicated paper 20 of the stroke to be entered by the user. Is called continuously. That is, the processor 11 converts the image data of the dot pattern as shown in FIG. 4A supplied by the camera 16 into the data array shown in FIG. 4B, and further converts the X coordinate bit value · Y The coordinate bit value is converted, and X, Y coordinate data is calculated from the data array by a predetermined calculation method. The processor 11 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data and the X, Y coordinate data, and acquires these information as entry information. . Further, the processor 11 executes a predetermined process based on the entry information. Here, since the 6 × 6 dot pattern in one sheet of dedicated paper (electronic pen medium) 20 does not overlap in the dedicated paper 20, the user needs to use the electronic pen 10 in the user area. Can be specified from the coordinate data to which user area of the dedicated paper 20 the entry or tap corresponds to.

  The memory 12 stores a user area and coordinate data indicating the position coordinates of the user area on the dot pattern in association with each other. In addition, a user area defined by a user area defining unit, which will be described later, and voice information recorded by the voice recording unit 33 are stored in association with each other.

  The data communication unit 13 records the result of the predetermined processing performed by the processor 11 on the terminal device 25 in the vicinity and displays it or executes the predetermined processing in the memory 12 supplied by the processor 11. Is wirelessly transmitted to the terminal device 25. Transmission by the data communication unit 13 is preferably performed by wireless transmission using Bluetooth (registered trademark). Note that data transmission from the data communication unit 13 to the terminal device 25 may be performed by other methods such as wired transmission using a USB cable and data transmission by contact with a terminal.

  Here, functions of the electronic pen 10 will be described with reference to FIG. FIG. 5 is a functional block diagram showing the main configuration of the electronic pen 10. The electronic pen 10 performs a predetermined process by executing a dedicated application based on the entry information such as the acquired X and Y coordinate data.

  As shown in FIG. 5, the electronic pen 10 includes an information storage means 31, an entry information acquisition means 32, a voice recording means 33, a user area definition means 34, a start / end point specification means 35, a user area specification means 36, a voice output means. 37, an audio recording unit 38, and an audio output unit 39. Physically, the information storage means 31 is constituted by a memory such as a ROM or a RAM, the entry information acquisition means 32 is constituted by a data communication unit, a processor or the like, the voice recording unit 38 is a recorder or the like, and a voice output unit 39. Is composed of a speaker or the like. The user area defining means 34, the start / end point specifying means 35, the user area specifying means 36, and the audio output means 37 are incorporated in a processor such as a CPU.

  The information storage unit 31 is a memory that stores the user area and coordinate data indicating the position coordinates of the user area on the dot pattern in association with each other. That is, as shown in FIG. 6, the information storage means 31 stores user area definition information in which a user area ID is associated with coordinate data representing a position coordinate area of the user area. Coordinate data “(x1, y1), H1, W1” is stored in association with area ID “A01”, and coordinate data “(x2, y2), H2, W2” is stored in association with area ID “A02”. Has been. The data (xn, yn), Hn, and Wn constituting the coordinate data of each user area are the coordinates of the vertex V (xn, yn) of the user area on the dot pattern and the Y-axis direction as shown in FIG. Means the height and the width in the X-axis direction. That is, the information storage unit 31 functions as a user area definition information storage unit in the present invention. Further, as will be described below, the information storage unit 31 also functions as an association information storage unit.

  The entry information acquisition unit 32 is a unit that acquires entry information corresponding to the entry contents of the dedicated paper (electronic pen entry medium) 20 by the electronic pen 10. The entry information includes information acquired when entering taps, characters, symbols, designs, and the like. In particular, entry information acquired by tapping is referred to as tap information.

  The voice recording means 33 outputs a recording start instruction to the voice recording unit 38 at the entry start time on the electronic pen entry medium based on the time information and the writing pressure information included in the entry information, and starts recording the voice. The voice recording means 33 outputs a recording end instruction to the voice recording unit 38 when a predetermined time Z (hereinafter referred to as “end determination time”) has elapsed from the end time of entry to the electronic pen entry medium. This completes the recording of the voice. That is, the recording end time is the time after the end determination time Z has elapsed from the entry end time. Therefore, the voice information recorded by the voice recording unit 33 is voice information having the entry start time as a start point and the time after the end determination time Z has elapsed from the entry end time.

  Note that the predetermined end determination time Z is set to a non-entry time that is long enough to determine that entry by the user has ended. For example, when entering a character string consisting of a plurality of characters and assuming that the time required for starting the entry of the next character after entering one character is generally about 0.5 to 1 second, The time Z is set to a sufficiently longer time (for example, 3 seconds).

  The voice recording means 33 ends the voice recording by outputting a recording end instruction to the voice recording section 38 when the entry information acquisition means 32 detects specific stroke information included in the entry information. It is good as well. In this case, the voice information recorded by the voice recording unit 33 is voice information having the entry start time as the start point and the entry end time (the time when the specific stroke information is detected) as the end point. Alternatively, in order to prevent the sound from being interrupted, the recording end time may be set after a predetermined time α has elapsed from the time when the specific stroke information is detected. In this case, the voice information is voice information whose starting point is the entry start time and whose end point is the time after the elapse of the predetermined time α from the time when the specific stroke information is detected.

  The user area definition unit 34 automatically defines a user area corresponding to the entry content based on the coordinate information included in the entry information acquired by the entry information acquisition unit 32. Specifically, a rectangular frame is recognized so as to touch the outside of the entry content, the rectangular area is registered as a user area, and an area ID is assigned. The coordinate data and area ID registered as the user area are stored in the information storage unit 31 as user area definition information.

  The electronic pen 10 stores the user area defined by the user area definition unit 34 and the voice information recorded by the voice recording unit 33 in association with each other in the information storage unit 31.

  The start / end point specifying means 35 specifies the stroke start point and the stroke end point included in the entry information acquired by the entry information acquisition means 32. Specifically, the start / end point specifying means 35 specifies the coordinate data indicating the position coordinates of the stroke start point and the stroke end point, and the entry time.

  The user area specifying unit 36 refers to the user area definition information (see FIG. 6) stored by the information storage unit 31 based on the coordinate data included in the input information (tap information) acquired by the input information acquisition unit 32. Thus, the corresponding user area is specified. At this time, the user area specifying unit 36 may specify only the user area including both the stroke start point and the stroke end point of one stroke. With such a setting, if either the stroke start point or stroke end point of the stroke entered by the user in the entry form is outside the range of the user area, the user tries to tap the user area. It can be determined that it is not intended. The user area specifying means 36 is filled in the user area by the user based on the time at the stroke start point and the stroke end point specified by the start / end point specifying means 35 and / or the movement distance between the two points. It is determined whether or not the stroke is a tap. The user area specifying unit 36 specifies the user area tapped by the electronic pen 10 based on the entry information and the user area definition information.

  The voice output unit 37 causes the voice output unit 39 to output the voice information stored in the information storage unit 31 in association with the user area specified by the user area specifying unit.

  The electronic pen 10 includes the above-described units by installing a dedicated application.

[Dedicated application]
Next, the dedicated application 50 will be described with reference to FIG. FIG. 9 shows a module configuration of the dedicated application 50. The dedicated application 50 executes predetermined processing based on entry information that is digital data corresponding to the contents entered on the dedicated paper 20 by the electronic pen 10, and is installed in the electronic pen 10 in advance by downloading or the like. Yes.

  The dedicated application is associated with the dedicated paper 20 in principle. That is, if the type of the dedicated paper 20 is different, the dedicated application for processing the data written in each dedicated paper 20 is different depending on the type. However, the correspondence between the dedicated paper 20 and the dedicated application is not necessarily one-to-one, and data may be processed by associating one dedicated application with a plurality of types of dedicated paper 20. Further, data may be processed by associating a single type of dedicated paper 20 with a plurality of dedicated applications.

  As shown in FIG. 9, the dedicated application 50 includes an information storage module 101, an entry information acquisition module 102, a voice recording module 103, a user area definition module 104, a start / end point identification module 105, a user area identification module 106, and a voice output module. 107.

  As shown in FIG. 6, the information storage module 101 is a module that stores the user area and coordinate data indicating the position coordinates of the user area on the dot pattern in association with each other as shown in FIG. In addition, the information storage module 101 associates information stored in the information storage means 31 with the user area defined by the user area definition means 34 and the voice information recorded by the voice recording means 33 as shown in FIG. It has a function of storing in the storage means 31.

  The entry information acquisition module 102 has a function of acquiring entry information (including tap information) corresponding to entry with the electronic pen 10 on the dedicated paper 20 using the entry information acquisition unit 32.

  The voice recording module 103 has a function of recording voice corresponding to the entry with the electronic pen 10 using the voice recording means 33.

  The user area definition module 104 has a function of automatically defining a user area corresponding to the entry content based on the coordinate information included in the entry information acquired by the execution of the entry information acquisition module 102.

  The start / end point specifying module 105 has a function of specifying the coordinate data and the entry time for each stroke start point and stroke end point of the stroke included in the entry information (tap information).

  The user area specifying module 106 has a function of specifying the user area corresponding to the tap information by referring to the user area definition information shown in FIG. 6 based on the coordinate data included in the entry information (tap information). At this time, the user area specifying module 106 specifies the user area tapped by the electronic pen 10 based on the tap information, and specifies the user area including both the stroke start point and the stroke end point. It is good to do so.

  The voice output module 107 has a function of outputting the voice information stored in the information storage unit 31 by the information storage module 101 from the voice output unit in association with the user area specified by the execution of the user area specifying module 106. .

[Voice information matching processing flow by this information processing system]
Next, a processing flow performed by the information processing system according to the present embodiment will be described with reference to FIGS. FIG. 10 is a diagram showing a usage pattern of the electronic pen 10 on the entry form in the present embodiment. FIG. 11 is a flowchart of voice information association processing in the electronic pen 10.

  The user uses the electronic pen 10 to make an arbitrary entry on the entry form. For example, when the entry form is used as a health care book for childcare, the character string “May 10 vaccination” is entered in the entry form as shown in FIG. Then, the electronic pen 10 acquires coordinate information, time information, writing pressure information, and the like corresponding to the entry as entry information. The entry information acquisition means 32 of the electronic pen 10 acquires the entry start time from the acquired time information and writing pressure information (step S1). When the voice recording means 32 acquires the entry start time, it issues a recording start instruction to the voice recording unit 38 (step S2). The voice recording unit 38 receives a recording start instruction and starts recording (step S3).

  The voice recording means 32 determines whether or not to end recording by determining whether or not there is next read data (step S4). If the voice recording means 32 determines that there is next read data (step S4; Yes), recording is continued. On the other hand, when it is determined by the voice recording means 32 that there is no next read data (step S4; No), the time from the time when the voice recording means 32 determines that there is no next read data, that is, the elapsed time from the entry end time. Time is counted (step S5). The voice recording means 32 sets “T” as the elapsed time from the entry end time, and determines whether or not the elapsed time T is greater than the end determination time Z set by the application (step S6).

  When it is determined that the elapsed time T is smaller than the end determination time Z (step S6; No), recording is continued. When it is determined that the elapsed time T is greater than the end determination time Z (step S6; Yes), the user area defining unit 34 defines a user area corresponding to the entry content based on the coordinate information included in the entry information. (Step S7). Specifically, a rectangular frame is recognized so as to touch the outside of the entry “May 10 Vaccination”, the rectangular area is registered as a user area, and an area ID is assigned (FIG. 6,). (Refer FIG.10 (b)).

  The voice recording unit 32 sets the time after the end determination time Z from the entry end time as the recording end time (step S8), and issues a recording end instruction to the voice recording unit 38 (step S9). The voice recording unit 38 receives the recording end instruction and ends the recording. The electronic pen 10 associates the user area defined by the user area definition unit 34 with the voice information recorded by the voice recording unit 33 and stores it in the information storage unit 31 (step S10).

[Operational effects of this information processing system]
According to this information processing system, when the user wants to refer to the voice information corresponding to the content entered in the entry form with the electronic pen 10, if the user taps the user area corresponding to the entry content on the entry form, The recorded voice information can be referred to, and the reference time can be shortened and the operability can be improved (see FIG. 10C).

  The embodiment described above can be modified as follows.

  For example, the information storage unit 31 stores the user area definition information (see FIG. 6) and the correspondence between the user area and the voice information (see FIG. 8) separately. The recorded voice information may be stored in association with each other, and the data structure of these information can be arbitrarily set.

  The present invention is not limited to the above embodiment.

  In the above-described embodiment, the recording information having the entry start time by the electronic pen 10 as the start point and the end time after the predetermined end determination time Z from the entry end time is acquired and stored in association with the user area. Is done. However, in practice, the end determination time Z after completion of entry is a period in which entry with the electronic pen 10 is not performed. Therefore, in an application intended to acquire a voice while the user is filling in with the electronic pen 10, only the voice during the entry by the user may be recorded and stored. Specifically, in step S10 in FIG. 11, the voice recording means 33 deletes the voice information in the period corresponding to the end determination time Z from the recording information obtained as described above, and starts entry by the user. It is good also as storing the audio | voice information only for the period from time to entry completion time.

  In the above embodiment, the entry start time by the electronic pen 10 is set as the recording start point, and the time after the predetermined end determination time Z has elapsed from the entry end time is set as the recording end point. However, the entry start time is recorded. The time at which specific stroke information is detected may be used as the start point, and the recording end point may be used. Specifically, in step S8 in FIG. 11, the voice recording unit 33 may set the recording end time to the time when specific stroke information such as a period or a phrase is detected. Alternatively, the entry start time may be set as the recording start point, and the time after a predetermined time α elapses from the time when the specific stroke information is detected may be set as the recording end point.

  In the above embodiment, the clock 22 of the electronic pen 10 transmits the current time (see FIG. 2). However, the clock 22 transmits the entry time starting from 0 and elapses during the entry of the stroke. It is good as well. In this case, the processor 11 acquires the elapsed time (entry time) transmitted by the clock 22 as time information during stroke entry, and associates the time information, pen pressure data, and X, Y coordinate data, Obtained as entry information.

  Further, property information (pen information or pen owner information) regarding the pen itself or its owner may be held in the electronic pen 10 so that it can be referred to from the terminal device 25, or property information. May be transmitted to the terminal device 25 together with the entry information. Pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, and the like. Pen owner information includes nationality, language, time zone, email address, name, address, fax / phone number, mobile phone number, and the like.

  In the above embodiment, the dot is ink containing carbon that absorbs infrared rays, and the LED 15 of the electronic pen 10 is an LED that irradiates infrared rays. However, it is not limited to this. For example, the dot is ink that emits light of a predetermined wavelength by light of a predetermined wavelength, the LED 15 of the electronic pen 10 is irradiated with light that emits ink of the dot, and the region of the wavelength that the ink of the dot emits light by the camera 16 is set. By detecting the dot pattern, the electronic pen 10 may read the dot pattern. If the dot pattern can be read by the camera 16, the ink type of the dot and the irradiation light of the LED 15 are limited to those shown in the above embodiment. I can't. In addition, as long as the position coordinates on the dedicated paper 20 can be specified, another coded pattern such as a two-dimensional code pattern may be used instead of the dot pattern.

  In addition, the dot pattern is normally assigned for each use of the paper, but when the dedicated paper 20 is printed in large quantities by a commercial printing machine, the same dot pattern is printed on the same type of electronic pen medium. Will be. In this case, in order to distinguish the electronic pen medium of the same type one by one, the electronic pen medium may be provided with an identification information entry field for entering identification information for identifying each medium. In the electronic pen 10, if the identification information entered in the identification information entry field is identified by character recognition based on the acquired entry information and stored in association with the entry information, the same kind of electronic pen medium can be obtained. One by one can be distinguished. In addition, the pen ID may be stored in association with the entry information together with the identification information. Thereby, the electronic pen 10 can identify each electronic pen medium based on the stored identification information or the identification information and the pen ID. On the other hand, when printing with a printer, it is also possible to assign a different dot pattern to each sheet of paper and print the dedicated paper 20. In this case, since the dot pattern printed on each dedicated paper 20 is different for each dedicated paper 20, the dedicated paper 20 can be identified and distinguished one by one by the dot pattern.

  INDUSTRIAL APPLICABILITY The present invention is applicable to an application that automatically defines a user area and associates with recorded sound information when referring to the associated sound information with a pen tap. For example, it can be applied to a childcare health management book, minutes, hospital records, records up to childbirth, etc.

It is a figure which shows the usage pattern of an electronic pen typically. It is a block diagram which shows the structure of an electronic pen. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. (A) is a diagram schematically showing a dot pattern, and (b) is a diagram showing information corresponding to the dot pattern. It is a functional block diagram of an electronic pen. It is a figure which shows typically the data structure of user area definition information. It is a figure explaining coordinate data. It is a figure which shows typically matching with a user area and audio | voice data. It is a module block diagram of a dedicated application. It is a figure which shows the example of the usage condition of an electronic pen in the entry to an entry form. It is a flowchart of an audio | voice information matching process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Processor, 12 ... Memory, 13 ... Data communication unit, 14 ... Battery, 15 ... LED, 16 ... Camera, 17 ... Recorder, 18 ... Pressure sensor, 19 ... Speaker, 20 ... Dedicated paper (medium for electronic pens), 22 ... Clock, 25, 25A, 25B ... Terminal device, 31 ... Information storage means, 32 ... Entry information acquisition means, 33 ... Voice recording means, 34 ... User area definition means, 35 ... Start / end point specifying means, 36 ... User Area specifying means, 37 ... sound output means, 38 ... sound recording unit, 39 ... sound output unit, 50 ... dedicated application

Claims (6)

An electronic pen for processing information written on an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed,
An audio recording unit for recording audio;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen entry medium;
For the sound recording unit, based on said entered information, elapsed the recording to fill the start time of the electronic pen writing tablet starts, a predetermined end determination time from the entry end time to the electronic pen writing tablet Voice recording means for instructing to end the recording,
User area defining means for automatically defining a user area corresponding to the entry content based on the entry information;
User area definition information storage means for storing user area definition information in which the user area is associated with coordinate data indicating position coordinates of the user area on the coding pattern;
An electronic pen comprising: association information storage means for storing association information in which the user area and the voice information recorded by the voice recording means are associated with each other. An electronic pen for processing information written on an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed,
An audio recording unit for recording audio;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen entry medium;
Based on the entry information, the voice recording unit starts recording at the entry start time on the electronic pen entry medium, and the entry information acquisition means detects specific stroke information included in the entry information. Voice recording means for instructing to end the recording,
User area defining means for automatically defining a user area corresponding to the entry content based on the entry information;
User area definition information storage means for storing user area definition information in which the user area is associated with coordinate data indicating position coordinates of the user area on the coding pattern;
An electronic pen comprising: association information storage means for storing association information in which the user area and the voice information recorded by the voice recording means are associated with each other. An electronic pen for processing information written on an electronic pen entry medium on which a coded pattern recognizable by the electronic pen is printed,
An audio recording unit for recording audio;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen entry medium;
Based on the entry information, the voice recording unit starts recording at the entry start time on the electronic pen entry medium, and the entry information acquisition means detects specific stroke information included in the entry information. Voice recording means for instructing to end recording after a predetermined time,
User area defining means for automatically defining a user area corresponding to the entry content based on the entry information;
User area definition information storage means for storing user area definition information in which the user area is associated with coordinate data indicating position coordinates of the user area on the coding pattern;
An electronic pen comprising: association information storage means for storing association information in which the user area and the voice information recorded by the voice recording means are associated with each other. An audio output unit for outputting audio;
User area specifying means for specifying the tapped user area by referring to the user area definition information based on tap information corresponding to the tap to the user area included in the entry information;
From the sound output unit, of the preceding claims 1-3, characterized in that it comprises a sound output means for outputting the voice information stored in correspondence with the user area specified by the user area specifying means The electronic pen as described in any one . Based on the tap information, further comprising a start / end point specifying means for specifying a stroke start point and a stroke end point of the tap,
The user area specifying means refers to the user area definition information based on the coordinate data of the stroke start point and the stroke end point, thereby determining a user area including both the stroke start point and the stroke end point. The electronic pen according to claim 4 , wherein the electronic pen is specified. A program for causing the electronic pen according to any one of claims 1 to 5 to function.

Images