JP2016081218A - Written information management device, written information management system, and pr - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a written information management device, a written information management system, and a program in which, when written with an electronic pen on a recording medium consisting of a plurality of pages to which predetermined identification information and predetermined position coordinates are added, page breaks in written contents are recognized and set by a user.SOLUTION: Provided is a written information management device having: dividing means for dividing, on the basis of written information including the position coordinates of a pen tip of an electronic pen that are acquired when written with the electronic pen on a recording medium composed of a plurality of pages to which predetermined identification information and predetermined position coordinates are added and including time information at which the position coordinates are acquired and on set time interval, the content written by the electronic pen into a plurality of stroke groups including a plurality of strokes each entered continuously in time; display means for displaying the plurality of stroke groups in time sequence; and page break means for setting a page break between groups of the plurality of stroke groups displayed in time sequence.SELECTED DRAWING: Figure 14

Description

  The present invention relates to a writing information management device, a writing information management system, and a program.

  Patent Document 1 includes a receiving unit that receives designation of a specific electronic writing instrument used for writing on a medium and digitization of the contents of the writing, and a designation of the specific electronic writing instrument received by the receiving unit. Obtaining means for acquiring writing information obtained by digitizing the contents of writing on a plurality of different media made by the specific electronic writing instrument, a plurality of the writing information, and a time when writing is performed by the specific electronic writing instrument; A writing information management device comprising: generating means for generating display information for displaying a plurality of the writing information obtained centrally by the acquiring means based on (Refer to claims 1 to 3 of Patent Document 1).

  In Patent Literature 2, in an online handwritten sentence recognition method for recognizing a sentence input by handwriting, a first step of creating handwritten data as a stroke data sequence arranged in the order of input, and the first step, While maintaining the order of stroke data belonging to the same handwritten data, the order of the created handwritten data is determined according to the positional relationship between the strokes belonging to different handwritten data. And an on-line handwritten text recognition method including a second step of making one stroke data string (see claims 1 and 2 of Patent Document 2).

  Japanese Patent Application Laid-Open No. 2003-228561 discloses a specific identification for the special paper in a system that uses special paper on which a dot pattern is printed and an electronic pen that reads the dot pattern and digitizes the content written on the special paper. Based on the means for printing the mark and the digitized data of the check mark graphic written in the identification mark part, it is identified to which special paper the digitized data of the contents written in the special paper is written There is disclosed a special paper management device characterized in that it has means (see claim 1 of Patent Document 3).

  Patent Document 4 discloses entry information for acquiring entry information entered in an electronic pen form in a processing device that processes information entered in an electronic pen form printed with a dot pattern recognizable by the electronic pen. An acquisition means, a blank time specifying means for specifying a blank time of a predetermined time or more based on an entry time included in the entry information, and a blank presence / absence for determining whether or not the blank time specifying means has specified a blank time A first data specifying means for specifying the entry information acquired by the entry information acquiring means as one data when the determining means and the blank presence / absence determining means determine that the blank time cannot be specified; and the blank presence / absence determining means Divides the entry information based on the blank time and the entry information divided by the division means when it is determined that the blank time has been identified. One of the second data specifying means for specifying the data, the processing device characterized by comprising a disclosed (see claim 1 of Patent Document 4).

  Patent Document 5 prints an electronic pen that reads an encoded pattern and generates entry information according to the encoded pattern, and an encoded pattern that can be read by the electronic pen. An electronic pen system comprising: an entry form for filling strokes; and a terminal device that receives the entry information from the electronic pen and performs processing according to the entry information, the terminal device being A cutout time zone setting means for setting a cutout time zone for cutting out a handwritten stroke to be displayed in the handwritten strokes entered on the entry form a plurality of times, and a cutout set multiple times by the cutout time zone setting means Displays handwritten strokes written in the cutout time zone set at the selected time in the time zone A stroke display means, an electronic pen system comprising: a disclosed that (see claim 1 of Patent Document 5).

JP 2008-181339 A JP-A-11-282916 JP 2004-088676 A JP 2007-188167 A JP 2013-025682 A

  Conventionally, when writing on a multi-page recording medium with an electronic pen, different identification information and different position coordinates are added to each page to distinguish each of the multi-page recording media (Patent Documents 1 to 3). Further, based on the time information included in the writing information, each of the recording media of a plurality of pages is distinguished from the blank time between strokes (Patent Document 4). There is also an electronic pen system that cuts out and displays a handwritten stroke described in a predetermined time zone (Patent Document 5).

  It is an object of the present invention to allow a user to recognize and set a page break of written contents when writing with a digital pen on a recording medium of a plurality of pages to which predetermined identification information and predetermined position coordinates are added. It is to provide an information management device, a writing information management system, and a program.

  According to the first aspect of the present invention, the position coordinates of the pen tip of the electronic pen acquired when writing with a digital pen on a recording medium of a plurality of pages to which predetermined identification information and predetermined position coordinates are added. And based on writing information including time information when the position coordinates are acquired and a set time interval, the writing content of the electronic pen includes a plurality of strokes, each of which is described continuously in time. Dividing means for dividing into a plurality of stroke groups, display means for displaying the plurality of stroke groups in time series, and a page break is set between the groups of the plurality of stroke groups displayed in time series. And a page information management device.

  According to a second aspect of the present invention, the time interval from the pen-up in which the pen tip does not contact the recording medium to the pen-down in which the pen tip contacts the recording medium is set as the set time interval. The writing information management apparatus according to claim 1, wherein the writing content is divided into a plurality of stroke groups so as to be included in different stroke groups when exceeding.

  In the invention according to claim 3, the time interval required for the dividing means to write the next sentence or clause is set as the set time interval, and the written content is divided into a plurality of times for each set time interval. The writing information management device according to claim 1, wherein the writing information management device is divided into stroke groups.

  The invention according to claim 4 further comprises setting change means for changing the setting of the set time interval for at least one stroke group selected from the plurality of stroke groups, wherein the dividing means is selected by The writing content of the selected stroke group is divided into a plurality of stroke groups based on the written information of the stroke group and the reset time interval, and the display means divides the plurality of stroke groups after the division. The writing information management device according to any one of claims 1 to 3, wherein the writing information management device displays the information in time series.

  The invention according to claim 5, wherein the dividing unit divides the written content into a plurality of stroke groups so that the number of strokes included in each stroke group is equal to or less than a predetermined threshold value. It is a writing information management device given in any 1 paragraph to Claim 4.

  The invention according to claim 6 writes on each of the plurality of pages of the recording medium to which the predetermined identification information and the predetermined position coordinates are added, and the position coordinates of the pen tip, Based on the electronic pen that transmits the writing information including the time information when the position coordinates are acquired to the outside, the writing information received from the electronic pen and the set time interval, each writing content of the electronic pen Dividing means for dividing into a plurality of stroke groups including a plurality of strokes described in succession, display means for displaying the plurality of stroke groups in time series, and the plurality of stroke groups displayed in time series A writing information management system including a page break means for setting a page break between the groups.

  According to the seventh aspect of the present invention, the pen tip of the electronic pen acquired when the computer is written with the electronic pen on a plurality of pages of recording medium to which predetermined identification information and predetermined position coordinates are added. Based on the writing information including the time coordinates when the position coordinates and the position coordinates are acquired, and the set time interval, the writing contents of the electronic pen are each written in a plurality of times. Dividing means for dividing into a plurality of stroke groups including strokes, display means for displaying the plurality of stroke groups in time series, and a page break between the groups of the plurality of stroke groups displayed in time series This is a program that functions as a page breaker to be set.

  According to the first, sixth, and seventh aspects of the present invention, when writing with a digital pen on a multi-page recording medium to which predetermined identification information and predetermined position coordinates are added, the user Recognizes and sets the page break of the written content.

  According to the second aspect of the present invention, the written content is divided into a plurality of stroke groups based on the time during which writing is not performed.

  According to the third aspect of the present invention, the written content is divided into a plurality of stroke groups based on the time required to write a sentence or a phrase.

  According to the fourth aspect of the present invention, an error in time-series connection of written contents is corrected by the user.

  According to the fifth aspect of the present invention, the number of strokes included in each stroke group can be limited.

It is the schematic which shows an example of a structure of the writing information management system which concerns on embodiment of this invention. (A) is the schematic which shows an example of the design of the recording medium in which the code image which shows identification information and a position coordinate was formed. (B) is the elements on larger scale which expand and show a part of code picture. It is the schematic which shows an example of the code pattern which comprises a code image. It is the schematic which shows an example of the unit pattern which comprises a code pattern. It is the schematic which shows an example of a structure of an electronic pen. It is a block diagram which shows an example of the electrical structure of a writing information management apparatus. (A) is a schematic diagram which shows an example of the content of writing with an electronic pen. (B) to (H) are schematic views showing a part of the written content shown in (A) in units of strokes. It is a graph which shows the specific example of the writing information managed with a writing information management apparatus. (A) And (B) is a schematic diagram which shows an example of the content of writing written in the different recording medium. (C) is a schematic diagram which shows the example of a display by the position coordinate of the writing content shown to (A) and (B). It is a schematic diagram which shows an example of the time interval to set. It is a schematic diagram which shows an example of the display screen at the time of writing display. It is a schematic diagram which shows an example of the display screen at the time of writing selection. It is a schematic diagram which shows an example of the display screen at the time of a page break. It is a flowchart which shows an example of the procedure of a written content display process. It is a flowchart which shows an example of the procedure of a writing content division | segmentation process. It is a flowchart which shows an example of the procedure of an error correction process. It is a flowchart which shows an example of the procedure of a page break process. It is a schematic diagram which shows another example of the time interval to set. It is a flowchart which shows another example of the procedure of a written content display process.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

<Writing information management system>
First, an example of the writing information management system according to the present embodiment will be described.
FIG. 1 is a schematic diagram showing an example of the configuration of a writing information management system 10 according to an embodiment of the present invention. As shown in FIG. 1, the writing information management system 10 includes a recording medium 20, an electronic pen 30, and a writing information management device 40. The recording medium 20 is a recording medium on which a code image indicating identification information and position coordinates is formed in advance. Each of the identification information and the position coordinates is added to the recording medium 20. Although only one recording medium 20 is shown in FIG. 1, in the present embodiment, it is assumed that writing is performed with the same electronic pen 30 on a plurality of pages of recording medium 20 on which the same code image is formed in advance. And

  The electronic pen 30 is a writing instrument that writes on the recording medium 20 using ink. The electronic pen 30 is a pen-type image reading device that captures an image of the recording medium 20 around the pen tip during writing and acquires writing information from the captured image. Here, the “writing information” includes the position coordinates of the pen tip and time information when the position coordinates are acquired. Further, the “writing information” may include identification information for identifying the recording medium 20 and pen tip information indicating a contact state between the pen tip and the recording medium 20. The electronic pen 30 acquires writing information when writing on the recording medium 20 as described above, and transmits the acquired writing information to the writing information management device 40 via a wired or wireless communication line (not shown). .

  The writing information management device 40 is an information processing device such as a computer used by a user and a peripheral device. In the present embodiment, the writing information management device 40 executes “writing content display processing” based on the writing information received from the electronic pen 30. That is, the writing information management device 40 divides the writing content of the electronic pen into a plurality of stroke groups based on the received writing information and the set time interval. Each of the plurality of stroke groups includes a plurality of strokes described consecutively in time. A plurality of stroke groups are displayed in time series, and a page break means for setting a page break between the groups of the plurality of stroke groups displayed in time series is given to the user. Specific processing will be described later.

<Recording medium on which code image is formed>
Next, the recording medium will be described.
FIG. 2A is a schematic diagram illustrating an example of a design of a recording medium on which a code image indicating identification information and position coordinates is formed. FIG. 2B is a partially enlarged view showing a part of the code image in an enlarged manner. As schematically shown by using dots in FIG. 2A, a code image indicating identification information and position coordinates is formed on the recording medium 20. Further, the recording medium 20 is provided with a message 22 for the user, an entry field 24 using an electronic pen, and the like. The code image may be formed on the entire surface of the recording medium 20, or may be formed only on a specific area of the recording medium 20, such as an information recording area. Further, the code image may be formed on both the front and back surfaces of the recording medium 20.

  The code image is mainly formed using an image forming material having absorption in the infrared region, for example, a black image forming material such as carbon black, or an infrared absorber. As the infrared absorbing material, a material having a light absorption peak in an infrared region from a wavelength of 750 nm to a wavelength of 1000 nm is used. The black code image is visually recognized by the naked eye under natural light or white light. An infrared image formed by an infrared absorber is difficult to visually recognize under natural light or white light, and is read by detecting infrared rays reflected by irradiating infrared rays. In the present embodiment, it is assumed that the code image is formed using an infrared absorber. On the other hand, the message 22 and the entry field 24 are formed using an image forming material having absorption in the visible region, and are visually recognized by natural eyes or white light.

Here, the “code image” used in the present embodiment will be described.
The “code image” is a pattern image obtained by encoding (coding) information, and the original information is decoded (decoded) from the pattern image according to a predetermined rule. In the present embodiment, a dot code pattern in which a plurality of dots are two-dimensionally arranged is used as the code pattern. Here, the “dot” is a portion on which the image forming material is placed, and is represented by a black square (■) in FIG.

  FIG. 2B is a partially enlarged view showing a part of the code image in an enlarged manner. As shown in FIG. 2B, the code image formed on the portion 20A of the recording medium 20 includes a plurality of code patterns 26 arranged two-dimensionally. Each of the plurality of code patterns 26 includes a plurality of unit patterns 28 arranged in a two-dimensional manner.

  The code pattern 26 is a reading unit for decoding each of the identification information and the position coordinates. For example, a QR code (registered trademark) corresponds to one QR code (registered trademark). Identification information and position coordinates are decoded for each code pattern 26. The unit pattern 28 is the minimum unit constituting the code pattern 26 and expresses 1-bit or multiple-bit information. In the present embodiment, the code pattern 26 includes a plurality of unit patterns 28. Each of the plurality of unit patterns 28 is read, and information corresponding to the code pattern 26 is decoded.

  FIG. 4 is a schematic diagram showing an example of the unit pattern 28 constituting the code pattern. As shown in FIG. 4, the unit pattern 28 is divided into a dot arrangement area where dots are arranged and a non-arrangement area where dots are not arranged. In this example, the size of one dot is “2 pixels × 2 pixels”. The black area 28A indicates that dots are arranged in the dot arrangement area. The gray area 28B indicates that no dot is arranged in the dot arrangement area. The white area 28C indicates a non-arranged area where no dot is arranged.

In the unit pattern 28 shown in FIG. 4, there are nine dot arrangement areas, and dots are arranged in two places selected from the nine places. Since there are 36 combinations (= ₉ C ₂ ) for selecting two locations out of nine locations, there are 36 types of unit patterns 28. For example, by using 32 types of unit patterns 28 among them, 5-bit information is expressed.

  FIG. 3 is a schematic diagram showing an example of the code pattern 26 constituting the code image. As shown in FIG. 3, the code pattern 26 has a plurality of unit patterns 28 arranged in a predetermined layout. Here, the position where the unit pattern 28 is arranged is referred to as a “unit block”. In this example, 25 (= 5 × 5) unit blocks are arranged, and any unit pattern 28 is arranged in each unit block. In this example, four types of unit patterns 28 are used as a synchronization code 26A for detecting image rotation. The remaining 32 types of unit patterns 28 are used as an X position code 26B representing the X coordinate, a Y position code 26C representing the Y coordinate, and an identification code 26D representing the identification information.

  In the layout shown in FIG. 3, the synchronization code 26 </ b> A is disposed in the upper left unit block of the code pattern 26. In four unit blocks arranged on the right side of the synchronization code 26A, an X position code 26B representing the X coordinate is arranged. In four unit blocks arranged below the synchronization code 26A, a Y position code 26C representing the Y coordinate is arranged. In addition, an identification code 26D is arranged in 16 (= 4 × 4) unit blocks in an area surrounded by the X position code 26B and the Y position code 26C. FIG. 4 shows an example of the layout of the unit pattern 28. Each of the synchronization code 26A, the X position code 26B, the Y position code 26C, and the identification code 26D is one of 32 types of unit patterns 28. Is replaced by

Here, the decoding principle in units of code patterns will be briefly described.
A frame having the same size as the code pattern 26 is superimposed on the dot array read from the code image. The frame has a plurality of openings having the same size as the unit block. The plurality of openings are arranged in the same layout as the unit block. While moving the frame with respect to the dot arrangement, the position of the frame is adjusted so that the number of dots in each opening is two. Thereby, a dot array corresponding to one code pattern 26 is detected.

  When a dot array corresponding to the code pattern 26 is detected, the synchronization code 26A is detected from the detected dot array to determine the rotation of the image. The dot array is rotated according to the determination result, and the dot array is set in the correct orientation. As a result, a regular dot arrangement in which the unit patterns 28 are arranged in the same layout as the code pattern 26 is acquired. Next, the unit pattern 28 corresponding to each of the X position code 26B, the Y position code 26C, and the identification code 26D is detected from the acquired regular dot array, and the identification information and the position coordinates are decoded.

  When the decoding process for one code pattern 26 is completed, the frame is moved with respect to the dot array, the dot array corresponding to the next code pattern 26 is detected, and the above procedure is repeated to identify the next code pattern 26 Decode information and position coordinates. Thereby, the identification information and the position coordinates are decoded for each code pattern 26. The frame moves according to the order in which the code pattern 26 is read. In the present embodiment, the moving direction of the frame is the moving direction of the pen tip of the electronic pen 30.

<Electronic pen>
Next, the configuration of the electronic pen will be described.
FIG. 5 is a schematic diagram showing an example of the configuration of the electronic pen. As shown in FIG. 5, the electronic pen 30 includes a pen tip 31, a pressure detection unit 32, an infrared irradiation unit 33, an image reading unit 34, a storage unit 35, a communication unit 36, a power source 37, a time measurement unit 38, and a control unit 39. I have. These parts are held by a holding mechanism (not shown) and housed in a cylindrical casing. Each of the infrared irradiation unit 33, the image reading unit 34, the storage unit 35, the communication unit 36, and the power source 37 is connected to the control unit 39 and controlled by the control unit 39. Each of the pressure detection unit 32 and the time measurement unit 38 is also connected to the control unit 39 and outputs a detection result and a measurement result to the control unit 39.

  The pen tip 31 is a cylindrical ink container such as a ballpoint pen refill. The pen tip 31 contains ink that is an image forming material having absorption in the visible region. The pen tip 31 is held in the housing by a holding mechanism (not shown) so that the tip portion becomes the pen tip 30 </ b> A of the electronic pen 30. When writing with the electronic pen 30, ink is supplied onto the recording medium 20 from the pen tip 30 </ b> A.

  The pressure detection unit 32 includes a pressure sensor that detects increase / decrease in pressure applied to the pen tip 30A. The pressure detector 32 detects the contact state between the pen tip and the recording medium from the pressure detected by the pressure sensor. The pressure increases above the upper threshold by “pen down” when the pen tip 30A contacts the recording medium 20, and the pressure decreases below the lower threshold by “pen up” when the pen tip 30A moves away from the recording medium 20. The pressure detection unit 32 outputs pen tip information indicating pen-down or pen-up to the control unit 39 as a detection result.

  The infrared irradiation unit 33 irradiates the recording medium 20 around the pen tip 30A with infrared rays. The infrared irradiation unit 33 is connected to the control unit 39 via a drive unit (not shown), and is driven and controlled by the control unit 39. As the infrared irradiation unit 33, a light emitting element that emits light in the infrared region, such as an infrared LED (Light Emitting Diode), is used.

  The image reading unit 34 detects infrared rays reflected from the recording medium 20 around the pen tip 30A, and reads a code image from the recording medium 20 around the pen tip 30A. The image reading unit 34 reads the code image to generate an analog image signal, converts the analog signal into a digital signal, and outputs the digital image signal to the control unit 39. As the image reading unit 34, an image sensor having sensitivity in the infrared region such as an infrared CMOS (Complementary Metal Oxide Semiconductor) image sensor is used.

  The storage unit 35 is a storage device such as a hard disk. The storage unit 35 stores pen identification information for identifying the electronic pen 30 in advance. The storage unit 35 stores the writing information acquired by the control unit 39. As described above, in the present embodiment, the writing information includes identification information, nib information, position coordinates, and time information.

  The communication unit 36 is an interface for communicating with an external device via a wired or wireless communication line. In the present embodiment, the communication unit 36 mainly functions as a transmission unit that transmits the acquired writing information to the writing information management device 40. The power source 37 is a battery power source for driving the electronic pen 30. The time measuring unit 38 is a time measuring unit that holds the current time. The time measurement unit 38 outputs the current time when the position coordinates are acquired to the control unit 39 as a measurement result.

  The control unit 39 is configured as a computer (micro processor) that controls the entire electronic pen and performs various calculations. That is, the control unit 39 includes a CPU (Central Processing Unit), a ROM (Read Only Memory) storing various programs, a RAM (Random Access Memory) used as a work area when executing the programs, and various information. A nonvolatile memory for storage and an input / output interface (I / O) are provided. Each of the CPU, ROM, RAM, nonvolatile memory, and I / O is connected via a bus.

  From a functional viewpoint, the control unit 39 includes an image processing unit 39A that processes the read code image, and an information processing unit 39B that performs information processing based on a processing result by the image processing unit 39A. Hereinafter, the process executed by the control unit 39 will be specifically described as the operation of the electronic pen 30. When pen-down is detected by the pressure detection unit 32, the infrared irradiation unit 33 irradiates the recording medium 20 around the pen tip 30A with infrared light.

  The image reading unit 34 reads the code image by detecting infrared rays reflected from the recording medium 20. The image processing unit 39A performs image processing such as noise removal processing and generates a dot array from the code image. The information processing unit 39B acquires identification information and position coordinates from the generated dot array based on the above decoding principle. The information processing unit 39B acquires the current time from the time measurement unit 38 every time the position coordinates are acquired. Thereby, the time information when the position coordinates are acquired is acquired.

  When pen-up is detected by the pressure detection unit 32, irradiation of infrared light from the infrared irradiation unit 33 is stopped, and reading of the code image by the image reading unit 34 is stopped. The information processing unit 39B acquires the current time from the time measurement unit 38 every time it detects pen down or pen up. Thereby, time information when pen-down or pen-up is detected is acquired.

  The control unit 39 sequentially stores the acquired writing information in the storage unit 35. Then, when transmission is instructed by a switch or the like (not shown), or when a predetermined time has passed since the first pen-down, the writing information stored in the storage unit 35 is written via the communication unit 36 at a predetermined timing. The information is transmitted to the information management device 40. In the present embodiment, writing information acquired when writing with a digital pen on a recording medium of a plurality of pages is transmitted to the writing information management apparatus 40 via the communication unit 36.

  The configuration of the electronic pen 30 described in the above embodiment is an example, and there are various modifications.

<Writing information management device>
Next, the configuration of the writing information management device will be described.
FIG. 6 is a block diagram illustrating an example of an electrical configuration of the writing information management apparatus. As illustrated in FIG. 6, the writing information management device 40 includes a control unit 41, a display unit 42, an operation unit 43, a communication unit 44, and a storage unit 45. The configuration of the writing information management device 40 is merely an example, and unnecessary functional units may be deleted, new functional units may be added, and the configuration and arrangement of each unit may be changed.

  The control unit 41 is configured as a computer that controls the entire apparatus and performs various calculations. That is, the control unit 41 includes a CPU 41A, a ROM 41B that stores various programs, a RAM 41C that is used as a work area when the programs are executed, a nonvolatile memory 41D that stores various information, and an I / O 41E. Each of the CPU 41A, ROM 41B, RAM 41C, nonvolatile memory 41D, and I / O 41E is connected to each other via a bus 41F.

  The display unit 42, the operation unit 43, the communication unit 44, and the storage unit 45 are connected to the I / O 41 E of the control unit 41. The control unit 41 exchanges information with the display unit 42, the operation unit 43, the communication unit 44, and the storage unit 45, and controls these units.

  The display unit 42 is an image display unit that displays an operation screen or the like to the user, such as a display. The operation unit 43 is an operation unit that receives user operations such as a mouse and a keyboard. The communication unit 44 is an interface for communicating with an external device via a wired or wireless communication line. The storage unit 45 is a storage device such as a hard disk. The storage unit 45 stores writing information acquired from the electronic pen, writing information after a “writing content display process” to be described later is executed by the writing information management device 40, and the like.

  In the present embodiment, a case where the control program for executing the “writing content display process” is stored in the ROM 41B in advance will be described. However, the control program may be stored in another storage device. Further, the control program may be acquired from the outside via the communication unit 44. Also, various drives may be provided, and a control program recorded on an information recording medium such as a CD-ROM may be acquired via the various drives.

<Writing contents and writing information>
Next, writing contents and writing information will be described.
FIG. 7A is a schematic diagram illustrating an example of writing content with an electronic pen. The written content is an image of a sentence written with the electronic pen 30. A sentence is the largest unit, and is broken down into sentences, phrases, words, and characters. “Sentences” are separated by a period “.”. A section obtained by shortly dividing the meaning of this sentence is called a “sentence”, and a word having a meaning and a minimum unit is called a “word”. A word is composed of one or more “characters”.

Writing content 50 ₁ shown in FIG. 7 (A) "is I am fine. You are cold Is (.)", Including the two that statement. FIG. 7B to FIG. 7H are schematic diagrams showing a part of the written contents shown in FIG. 7A in units of strokes. The written content written with one stroke by the electronic pen 30 is called a stroke. The stroke is a trajectory of the pen tip 30A, and is a concatenation of temporally continuous position coordinates acquired from the pen down to the next pen up. A character is composed of one or more “strokes”. In the illustrated example, the word “I” is composed of a plurality of strokes shown in FIGS. 7B to 7H.

  FIG. 8 is a chart showing a specific example of writing information managed by the writing information management apparatus. As described above, each of the pen tip information, the position coordinates, and the time information acquired from the electronic pen 30 is used to identify the pen identification information and ( Recording medium) Stored in association with identification information. That is, the writing information here includes pen identification information, (recording medium) identification information, pen tip information, position coordinates, and time information.

Specific example shown in FIG. 8 is an electronic pen pen identification information "003", the recording medium identification information "1001001", when writing only the first character of the writing contents 50 ₁ shown in FIG. 7 (A) Written information. Acquisition of position coordinates and time information is started together with the pen-down “D”. For example, a plurality of position coordinates are acquired while one stroke is written, such as 100 times per second. At the same time, time information when the position coordinates are acquired is acquired. The connection of temporally continuous position coordinates from the pen-down “D” to the pen-up “U” is a stroke. As shown in FIG. 8, “stroke information” representing a stroke image may be added to the writing information.

<Display of written contents and page break>
(Overview)
“Display of written contents and page break” executed in the present embodiment will be described.
FIG. 9A and FIG. 9B are schematic diagrams showing an example of written contents written on different recording media. Here, writing is performed in the order of page numbers on a recording medium of a plurality of pages using the same electronic pen. The same code image is formed on a multi-page recording medium. In the illustrated example, the first page of the recording medium 20 ₁ of the message column 24 _1, "I'm fine. You are cold Is (.)" Notes content 50 ₁ that is entered. The second page of the recording medium 20 _second message column 24 _2, "We are influenza epidemic (.)" Notes content 50 ₂ that are entered.

FIG. 9C is a schematic diagram illustrating a display example of the writing content shown in FIGS. 9A and 9B by position coordinates. Since the written content 50 ₁ and the written content 50 ₂ are written on a recording medium on which the same code image is formed, if displayed according to the position coordinates without distinguishing the time, the written content 50 ₁ and the written content overlap 52 of the contents 50 ₂ is displayed. In this, the writing contents 50 ₁ for the first page of the recording medium 20 _1, the distinction between the notes content 50 ₂ of the second page on the recording medium 20 ₂ does not attach.

  In this embodiment, the writing information acquired when writing with a digital pen on a recording medium of a plurality of pages on which the same code image is formed is acquired, and the writing content of the electronic pen is divided into a plurality of stroke groups. Multiple stroke groups are displayed in time series. The written content of the electronic pen is divided into a plurality of stroke groups based on the set time interval. In the present embodiment, as shown in FIG. 10, an upper limit threshold value Δt (Max) is set for the time interval Δt from pen-up to the next pen-down. Then, the writing content of the electronic pen is divided between strokes in which the time interval Δt exceeds the upper limit threshold value Δt (Max).

  When writing on a multi-page recording medium with an electronic pen, it is considered that the time interval Δt from pen-up to the next pen-down increases when a page breaks. In the same page, it is considered that a sentence, a clause, a word, a character, etc., become larger at a sentence break. On the other hand, writing by the user is highly uncertain, and it is expected that the time interval Δt will increase due to the appearance of difficult kanji characters and lack of concentration.

  In the present embodiment, a page break means for displaying a plurality of stroke groups in time series and setting a page break between the groups of the plurality of stroke groups displayed in time series is provided to the user. Thereby, when writing with a digital pen on a recording medium of a plurality of pages on which the same code image is formed, the page break of the written content is recognized and set by the user.

  11 to 13 are schematic diagrams showing examples of display screens. As shown in the figure, the display screen 60 is provided with a writing content display unit 70, a condition setting unit for setting various conditions, a selection unit for selecting various operations, and an instruction unit for instructing execution or cancellation of various operations. Yes. The condition setting unit includes a pen ID input unit 61 to which pen identification information is input, a paper ID input unit 62 to which recording medium identification information is input, and a time setting unit in which an upper limit threshold value Δt (Max) of the time interval Δt is set. 63, and a selection unit time setting unit 64 in which an upper limit threshold value Δt (Max) of the time interval Δt is set for the selection unit described later.

  In the illustrated example, the pen ID input unit 61 and the paper ID input unit 62 are entry columns for character strings (including numbers) such as “xxxxxx”. The time setting unit 63 and the selection unit time setting unit 64 are selection fields for displaying options such as “1 second, 5 seconds, 10 seconds” in a pull-down format. These are merely examples, and each of the condition setting units only needs to be able to set a target condition, and may be either an entry column or a selection column.

  As the selection unit, a writing display 65 for selecting display of writing contents, a page break 66 for selecting page breaks, and a writing selection 67 for selecting a part of the displayed writing contents are provided. As the instruction unit, there are provided an application 68 for instructing execution of an operation under a set condition and a stop 69 for instructing to stop the operation.

  A plurality of stroke sequences of written contents are divided between strokes in which the time interval Δt exceeds the upper limit threshold value Δt (Max). In the written content display unit 70, each of the plurality of stroke groups is divided into a plurality of blocks 80 and displayed in time series. In the illustrated example, the writing content display unit 70 is provided with a scroll bar 72. By moving the scroll unit 74, all of the plurality of stroke groups are displayed.

(Writing display)
Here, the writing display will be described. FIG. 11 is a schematic diagram illustrating an example of a display screen during writing display. As shown in FIG. 11, for example, the time setting unit 63 sets the upper threshold value Δt (Max) of the time interval Δt to “1 second”, selects the display of the written content by the writing display 65, and sets by the application 68. Directs execution of an action under specified conditions. In accordance with this instruction, the written content is divided into strokes having a time interval Δt exceeding 1 second, and is displayed in time series in blocks 80. For example, the written content “I am fine. Are you cold?” Is “I”, “Ha”, “I am fine”, “Su.”, “You are wind” ”)” Is divided into a plurality of stroke groups close to a phrase unit.

The plurality of blocks 80 (block 80 ₁ to block 80 ₅ ) are arranged in the order of subscript numbers from top to bottom so as to represent a time series. Block 80 ₁ "I" is in, "it is" is to block 80 _2, the block 80 ₃ "cheerful", in block 80 ₄ is "be.", "You are the wind" is assigned to the block 80 ₅ Thus, each of the plurality of stroke groups is displayed in time series. Note that by scrolling, assigned to the next block 80 ₆ "Do you wicked (.)" Is displayed.

(Writing selection)
Next, writing selection will be described. FIG. 12 is a schematic diagram illustrating an example of a display screen when writing is selected. As shown in FIG. 12, for example, when the upper threshold Δt (Max) of the time interval Δt is set to “10 seconds”, the written content for two pages “I am fine. Are you cold? "I'm fine", "I'm fine.""Is the wind?""Is it evil? (.) Influenza" or "It's prevalent (.)" Divided into stroke groups. The block 80 ₁ "I'm fine.", Is to block 80 ₂ "is your wind", the block 80 ₃ "Does it wicked (.) Is flu", is to block 80 ₄ has been "epidemic (.) ”Is assigned, and each of the plurality of stroke groups is displayed in time series.

In this example, since it took time to move to the writing of the letter "evil" cold, "Are you wicked (.) Influenza" is a single stroke group, according to the position coordinates in block 80 ₃ "Influenza is ... evil?" Is displayed in the wrong order. Here, in the selecting a portion of the writing contents displayed by writing selection 67 selects the block ₈₀₃ by a cursor 76. Then, the selection unit time setting unit 64 changes the upper threshold value Δt (Max) of the time interval Δt to “5 seconds”, and instructs execution of the operation under the conditions set by the application 68. This instruction, writing the contents of block 80 ₃ is divided between the stroke time interval Δt exceeds 5 seconds.

In this example, because it took longer than 5 seconds to move from the first page of the recording medium in the writing of the second page of the recording medium, writing the contents of the block 80 ₃ "Do you wicked (.) Influenza" is, "evil Is it divided into different stroke groups such as “?” Or “flu”. And, "Do you wicked (.)" In as shown in FIG. 13, the block 80 ₂ "You are the wind", block 80 _3, the block 80 ₄ "flu", is to block 80 ₅ ""It is popular (.)" Is assigned, and each of the divided stroke groups is displayed in time series.

(Page break)
Next, page breaks will be described. FIG. 13 is a schematic diagram showing an example of a display screen at the time of page break. As shown in FIG. 13, the page break is selected by the page break 66, the page break line 78 is moved by the cursor 76 to set the position of the page break, and the operation under the conditions set by the application 68 is executed. Instruct. This instruction, a stroke group "Do you wicked (.)" In block _803, between the stroke group of "flu" block 80 _4, page delimiter is set. In other words, the written content for two pages "I am fine. Are you cold? (?) Is influenza prevalent (.)" Is written on the first page "I am fine. You are cold "(.)" And the written content on page 2 "Influenza is prevalent (.)".

The page break means is not limited to the setting of the page break position described above. For example, a stroke group "Do you wicked (.)" In block ₈₀₃ by the cursor 76, may be selected as the stroke group at the end of the page. By strokes of block ₈₀₃ is selected as the stroke group of end page, page break is made between the stroke group of strokes and blocks 80 _fourth blocks 80 _3.

<Writing content display processing>
Next, a specific procedure of the “written content display process” will be described. The control program of “writing content display processing” is read from the ROM 41B by the CPU 41A of the control unit 41 of the writing information management apparatus 40 and executed using the RAM 41C as a work area. The control program of “written content display processing” is started when the display of written content is selected by the user's operation and the execution of the operation under the set conditions is instructed.

  FIG. 14 is a flowchart illustrating an example of a procedure of “written content display processing”. As shown in FIG. 14, first, in step 100, writing information for the recording medium 20 of a plurality of pages acquired from the electronic pen 30 and stored in advance in the storage unit 45 is acquired. Next, in step 102, a “written content dividing process” for dividing the written content into a plurality of stroke groups is executed. Next, in step 104, the divided writing contents are displayed in time series on the display unit 42 as a processing result of the “writing contents dividing process”. Each of the plurality of stroke groups is assigned to a block and displayed in time series. The “written content dividing process” will be described later.

  Next, in step 106, an “error correction process” for correcting an error in the displayed written content is executed. The “error correction process” may be executed based on a user's indication or may be executed based on a predetermined criterion. For example, the number of strokes included in each of a plurality of stroke groups is obtained, and when there is a stroke group in which the number of strokes obtained is greater than a predetermined threshold value, it is assumed that there is an error in the written content, and “error correction processing” is performed. May be executed. The “error correction process” will be described later.

  In the present embodiment, in the “writing content dividing process”, the occurrence of a stroke group in which the number of strokes is larger than a predetermined threshold value is avoided, so the “error correction process” is executed based on the indication of the user. The

  Next, in step 108, a “page break process” is executed to set a page break for the contents written on the recording medium of a plurality of pages. The written content for a multi-page recording medium is divided into pages. Next, in step 110, it is determined whether or not there is an instruction for finalization after the data is saved. If there is no confirmation instruction, the presence / absence of the confirmation instruction is repeatedly determined. On the other hand, if there is a confirmation instruction, the process proceeds to step 112, where the written content after processing is stored, and the processing ends. The “page break process” will be described later.

(Writing content division processing)
Here, the “written content dividing process” will be described in detail.
FIG. 15 is a flowchart showing an example of the procedure of “writing content division processing”. As shown in FIG. 15, first, in step 200, a time interval Δt _n between the nth stroke and the (n + 1) th stroke is calculated. n starts from 1. That is, first, a time interval Δt ₁ (= t ₂ −t ₁ ) between the pen-up time t _{1 of the first} stroke and the pen-down time t ₂ of the second stroke is calculated (see FIG. 10). ).

Next, in step 202, it is determined whether or not the time interval Δt _n is equal to or less than the upper limit threshold value Δt (Max). If the time interval Δt _n is less than or _equal to the upper threshold Δt (Max), the process proceeds to step 204. On the other hand, when the time interval Δt _n exceeds the upper limit threshold value Δt (Max), the process proceeds to step 208. In step 208, the nth stroke and the (n + 1) th stroke are divided into different stroke groups, and the process proceeds to step 210. On the other hand, if the time interval Δt _n is less than or _equal to the upper threshold Δt (Max), the process proceeds to step 204.

  In step 204, when the (n + 1) th stroke is included in the same stroke group as the nth stroke, the number of strokes included in the stroke group is obtained, and it is determined whether the obtained stroke number is equal to or less than a predetermined threshold value. . If the number of strokes is less than or equal to a predetermined threshold, the process proceeds to step 206. In step 206, the (n + 1) th stroke is integrated into the same stroke group as the nth stroke, and the process proceeds to step 210. On the other hand, if the number of strokes exceeds a predetermined threshold, the process proceeds to step 208. In step 208, the nth stroke and the (n + 1) th stroke are divided into different stroke groups, and the process proceeds to step 210.

  In step 210, it is determined whether there is a next stroke. If there is a next stroke, the process returns to step 200 and the procedure from step 200 to step 210 is repeated. If there is no next stroke, the process proceeds to step 212. In step 212, the writing contents divided into a plurality of stroke groups are stored, and the process is terminated.

  As described above, by integrating and dividing the nth stroke and the (n + 1) th stroke until there is no next stroke, the writing contents on the recording medium of a plurality of pages can be continuously recorded in time. It is divided into a plurality of described stroke groups.

(Error correction processing)
Here, the “error correction process” will be described in detail.
FIG. 16 is a flowchart illustrating an example of the procedure of “error correction processing”. As shown in FIG. 16, first, in step 300, it is determined whether or not a writing selection for selecting a part of the displayed writing content has been performed. If writing selection has been performed, the process proceeds to step 302. On the other hand, when the writing selection is not performed, the process is terminated. Next, in step 302, it is determined whether or not the upper limit threshold value Δt (Max) of the time interval Δt is set for the selection unit.

  If the upper limit threshold value Δt (Max) is set, the process proceeds to step 304. On the other hand, if the upper limit threshold value Δt (Max) is not set, the determination in step 302 is repeated. In step 304, the written content of the selection unit is subdivided into a plurality of stroke groups based on the reset upper limit threshold value Δt (Max) of the time interval Δt. Next, in step 306, the subdivided writing contents are displayed in time series on the display unit 42, and the process is terminated.

(Page break processing)
Here, the “page break process” will be described in detail.
FIG. 17 is a flowchart showing an example of the procedure of the “page break process”. As shown in FIG. 17, first, in step 400, it is determined whether or not a page break is selected. If page break is selected, the process proceeds to step 402. On the other hand, if no page break is selected, the process proceeds to step 404. In step 404, when the time interval Δt exceeds the upper limit threshold value Δtp (Max) set in advance for page breaks, page breaks that move to the next recording medium are performed, and the routine is terminated.

  Next, in step 402, the divided writing contents are displayed in time series on the display unit 42 and a page break line 78 is displayed on the display unit 42. The user moves the page break line 78 with the cursor 76, sets the position of the page break, and instructs execution of the page break.

  Next, in step 406, it is determined whether or not there is an instruction to execute page breaks. If there is no page break execution instruction, the determination is repeated at step 406. On the other hand, if there is an instruction to execute page breaks, the process proceeds to step 408. Next, in step 408, in accordance with a page break execution instruction, the page is moved to the next recording medium at the set position, and the routine is terminated.

<Another example of the time interval to be set>
In the above embodiment, as shown in FIG. 10, the upper limit threshold value Δt (Max) is set for the time interval Δt from pen-up to the next pen-down. Then, the writing content of the electronic pen is divided between strokes in which the time interval Δt exceeds the upper limit threshold value Δt (Max). However, the set time interval is not limited to the time interval from pen-up to the next pen-down.

  When writing on a multi-page recording medium with an electronic pen, it is considered that it takes a certain time to describe a sentence, a phrase, a word, a character, or the like included in the sentence. Therefore, as shown in FIG. 18, by setting the time interval Δt required for writing a sentence or a phrase, it is possible to divide the stroke into a plurality of stroke groups representing the sentence or the phrase. For example, the time interval Δt can be a time interval ranging from 1 second to 100 seconds, such as 10 seconds.

  Even in this case, by providing the user with page break means for displaying a plurality of stroke groups in time series and setting a page break between the groups of the plurality of stroke groups displayed in time series, When writing with a digital pen on a recording medium of a plurality of pages on which the same code image is formed, page breaks are recognized and set by the user.

  When the time interval Δt required for writing a sentence or a phrase is set, the above “writing content dividing process” is not necessary. FIG. 19 is a flowchart showing another example of the procedure of the written content display process. In place of the “written content dividing process” in step 102 in FIG. 14, in step 600 after step 100, the written content is divided into a plurality of stroke groups for each time interval Δt required to write a sentence or a phrase. To do. Other than that, the procedure is the same as that shown in FIG.

  The configurations of the writing information management device, the writing information management system, and the program described in the above embodiment are examples, and it goes without saying that the configurations may be changed without departing from the gist of the present invention. .

For example, in the above embodiment, an example of a dot code using a specific unit pattern called “ ₉ C ₂ pattern” has been described. However, the size of the unit pattern, the arrangement of dots, the number of dots to be selected, etc. , May be changed as appropriate. Also, dot codes of different systems such as QR code (registered trademark), Anoto code, glyph code, etc. may be used.

  In the Anoto code, a virtual lattice frame is arranged, and a dot is arranged in any one of four regions divided by intersections of the lattice. As a result, four types of patterns can be expressed, and two bits can be expressed (Japanese Patent Publication No. 2003-511762). In the glyph code, one bit is expressed by right and left diagonal lines called glyphs (Japanese Patent Laid-Open No. 9-185669). Each of the right diagonal line and the left diagonal straight line is composed of a plurality of dots.

10 Written information management system 20, 20 ₁ , 20 ₂ Recording medium 22, 22 ₁ , 22 ₂ Message 24, 24 ₁ , 24 ₂ entry column 26 Code pattern 26A Synchronization code 26B Position code 26C Position code 26D Identification code 28 Unit pattern 28A Black region 28B Gray region 28C White region 30 Electronic pen 30A Pen tip 31 Pen tip 32 Pressure detection unit 33 Infrared irradiation unit 34 Image reading unit 35 Storage unit 36 Communication unit 37 Power supply 38 Time measurement unit 39 Control unit 39A Image processing unit 39B Information processing Unit 40 writing information management device 41 control unit 41D nonvolatile memory 42 display unit 43 operation unit 44 communication unit 45 storage unit 50 ₁ , 50 ₂ writing content 52 writing content overlap 60 display screen 61 pen ID input unit 62 paper ID input unit 63 Time setting unit 64 Selection unit Time setting unit 65 Written display 6 7 Written selection 68 Application 69 Cancel 70 Written content display section 72 Scroll bar 74 Scroll section 76 Cursor 78 Lines 80, 80 ₁ , 80 ₂ , 80 ₃ , 80 ₄ , 80 ₅ , 80 ₆ blocks

Claims (7)

Time when the position coordinates and position coordinates of the pen tip of the electronic pen acquired when writing with a digital pen on a recording medium of a plurality of pages to which predetermined identification information and predetermined position coordinates are added are acquired. Dividing means for dividing the writing content of the electronic pen into a plurality of stroke groups each including a plurality of strokes described successively in time based on writing information including information and a set time interval When,
Display means for displaying the plurality of stroke groups in time series;
Page break means for setting a page break between the groups of the plurality of stroke groups displayed in time series,
Written information management device.   When the time interval from the pen-up in which the pen tip does not contact the recording medium to the pen-down in which the pen tip contacts the recording medium exceeds the set time interval, the dividing unit has different stroke groups. The writing information management apparatus according to claim 1, wherein the writing content is divided into a plurality of stroke groups so as to be included.   2. The dividing means divides the written content into a plurality of stroke groups at each set time interval, with the time interval required for writing the next sentence or clause as the set time interval. Written information management device described in 1. Setting change means for changing the setting of the set time interval for at least one stroke group selected from the plurality of stroke groups;
The dividing means divides the writing content of the selected stroke group into a plurality of stroke groups based on the writing information of the selected stroke group and the reset time interval,
The display means displays a plurality of divided stroke groups in time series.
The writing information management device according to any one of claims 1 to 3.   5. The method according to claim 1, wherein the dividing unit divides the writing content into a plurality of stroke groups so that the number of strokes included in each stroke group is equal to or less than a predetermined threshold value. Written information management device described in 1. A plurality of pages of recording media to which predetermined identification information and predetermined position coordinates are added; and
An electronic pen that writes to each of the recording media of the plurality of pages and transmits writing information including time information when the position coordinates of the pen tip and the position coordinates are acquired to the outside;
Dividing means for dividing the writing content of the electronic pen into a plurality of stroke groups each including a plurality of strokes described successively in time based on writing information received from the electronic pen and a set time interval Written information management comprising: display means for displaying the plurality of stroke groups in time series; and page break means for setting a page break between the groups of the plurality of stroke groups displayed in time series Equipment,
Written information management system with Computer
Time when the position coordinates and position coordinates of the pen tip of the electronic pen acquired when writing with a digital pen on a recording medium of a plurality of pages to which predetermined identification information and predetermined position coordinates are added are acquired. Dividing means for dividing the writing content of the electronic pen into a plurality of stroke groups each including a plurality of strokes described successively in time based on writing information including information and a set time interval When,
Display means for displaying the plurality of stroke groups in time series;
Page break means for setting a page break between the groups of the plurality of stroke groups displayed in time series,
Program to make it work.