JP6468151B2 - Writing processing program and electronic writing apparatus - Google Patents

Description

  The present invention relates to a writing processing program and an electronic writing device for processing writing trajectory data by user writing.

  2. Description of the Related Art Conventionally, a technique for processing writing trajectory data by user writing is known (see, for example, Patent Document 1). This conventional electronic writing device (reading device) is based on a plurality of position information (coordinate information) of a writing tool when a user writes on a writing medium (paper medium) using a writing tool (electronic pen). Writing trajectory data (line drawing data) for the writing medium is generated and transmitted to the operation terminal (PC). The operation terminal can convert the writing trajectory data received from the electronic writing device into text data by character recognition (OCR processing).

Japanese Patent Application Laid-Open No. 2015-111366

  In the above prior art, when a user describes characters and figures mixed on a writing medium, unnecessary text data (so-called garbage data) is generated due to erroneous recognition of the figure as a character, Since the character recognition rate of character data may be reduced, the recognition accuracy for the entire writing trajectory data is not so good.

  An object of the present invention is to provide a writing processing program and an electronic writing apparatus that can improve the recognition accuracy for the entire writing trajectory data.

To achieve the above object, the present first invention, the operation means, display means, arithmetic means, and, of the writing instrument with respect to the writing medium having an inner writing area of the margin area and the margin area of the outer peripheral portion information can be sent and received communication means to the electronic writing device that transmits the stroke data comprising a plurality of position information of the writing instrument due to the movement, with respect to the arithmetic unit of the operation terminal including a said transmitted from the electronic writing device A trajectory data acquisition procedure for receiving and acquiring stroke data via the communication means, and a character recognition area and a figure recognition area drawn in at least the margin area among the stroke data acquired in the trajectory data acquisition procedure Based on the identification result in the area classification identification procedure and the area classification identification procedure for identifying the area classification instruction related to the area classification, the writing area Among them, an area setting procedure for setting the character recognition region and the figure recognition area respectively, based on the setting result in the area setting procedure, text data by character recognition the stroke data drawn in the character recognition area of the And converting the stroke data drawn in the graphic recognition area into an image data by executing image recognition, and the margin area is formed on one side in the short direction of the writing medium. The area classification identification procedure includes the margin area on the one side and the margin area on the other side crossing the writing area in the short direction of the writing medium with the margin area on the one side as a starting end. And a separation line detection procedure for detecting at least one region separation line, and a previous one included in the margin area and detected by the separation line detection procedure. Among the plurality of partial margin regions divided by the region dividing line, including drawn in at least one, and area designation detecting step of detecting a region designation instruction, the.

  The writing processing program according to the first invention of the present application can recognize and recognize characters and figures written on the writing medium by processing the writing trajectory data.

  That is, first, when the writing processing program according to the first aspect of the present invention is executed by the calculation means, the writing locus data for the writing medium is acquired in the locus data acquisition procedure. At this time, a margin area is provided in advance on the outer periphery of the writing medium, and the inside of the margin area is a writing area. When writing on the writing medium, the user gives a predetermined area division instruction to the margin area (or both the margin area and the writing area), and the area division instruction is identified in the area division identification procedure. The Based on the identification result, an area setting procedure sets which part of the writing area is a character recognition area and which part is a graphic recognition area. Based on the setting result, in the data conversion procedure, the writing trajectory data drawn in the character recognition area is converted into text data by character recognition using an appropriate method, and the writing trajectory data drawn in the figure recognition area. The image is recognized and converted into image data by an appropriate method.

  As a result of the above, even if the user writes characters and figures in the writing medium in a mixed manner, the area division instruction is added to the margin area (or both the margin area and the writing area). By simply performing simple operations together, it is possible to distinguish between characters and graphics and perform appropriate processing. As a result, it is possible to prevent unnecessary text data (so-called garbage data) from being misrecognized as characters, and to reduce the character recognition rate of the original character data. Can be improved.

In order to achieve the above object, the second invention of the present application includes an operation means, a display means, a calculation means, and a writing instrument for a writing medium comprising a margin area on the outer peripheral portion and a writing area inside the margin area. Is transmitted from the electronic writing device to the computing means of the operation terminal including communication means capable of transmitting and receiving information to and from the electronic writing device that transmits stroke data including a plurality of position information of the writing instrument accompanying movement of the writing tool. A trajectory data acquisition procedure for receiving and acquiring the stroke data via the communication means, and a character recognition area and a figure recognition drawn in at least the margin area among the stroke data acquired in the trajectory data acquisition procedure Based on the identification result in the area classification identification procedure and the area classification identification procedure for identifying the area classification instruction related to the area classification with the area, Among the writing areas, an area setting procedure for setting each of the character recognition area and the figure recognition area, and character recognition of the stroke data drawn in the character recognition area based on the setting result in the area setting procedure. And converting the stroke data drawn in the graphic recognition area into image data by performing image recognition, and performing the area segment identification procedure in the longitudinal direction of the writing medium. A separation line detection procedure for detecting at least one area separation line that traverses the writing area or traverses the writing area in a short direction of the writing medium, and included in the margin area, Detecting an area designation instruction drawn in at least one of a plurality of partial margin areas divided by the area separation line detected by the separation line detection procedure In the region setting procedure, the region designation instruction drawn in the partial margin region among a plurality of partial writing regions included in the writing region and divided by the region separation line. The figure recognition area is set in the area corresponding to, and the other is set as the character recognition area, or the character recognition area is set in the area corresponding to the area designation instruction drawn in the partial margin area. Others are set in the figure recognition area.
In order to achieve the above object, the third invention of the present application includes an operation means, a display means, a calculation means, and a writing instrument for a writing medium comprising a margin area on the outer periphery and a writing area inside the margin area. Is transmitted from the electronic writing device to the computing means of the operation terminal including communication means capable of transmitting and receiving information to and from the electronic writing device that transmits stroke data including a plurality of position information of the writing instrument accompanying movement of the writing tool. A trajectory data acquisition procedure for receiving and acquiring the stroke data via the communication means, and a character recognition area and a figure recognition drawn in at least the margin area among the stroke data acquired in the trajectory data acquisition procedure Based on the identification result in the area classification identification procedure and the area classification identification procedure for identifying the area classification instruction related to the area classification with the area, Among the writing areas, an area setting procedure for setting each of the character recognition area and the figure recognition area, and character recognition of the stroke data drawn in the character recognition area based on the setting result in the area setting procedure. And converting the stroke data drawn in the graphic recognition area into image data by performing image recognition, and in the area classification identification procedure, the short direction of the writing medium is executed. A range in the longitudinal direction of the writing medium is specified in the margin area on at least one side of the writing medium, or in a lateral direction of the writing medium in the margin area on at least one side in the longitudinal direction of the writing medium. At least one range designation instruction that designates the range of the writing area is identified. The graphic recognition area is set in an area corresponding to the range designation instruction drawn in the margin area and the others are set in the character recognition area, or the range designation instruction drawn in the margin area is set. The character recognition area is set in the corresponding area, and the other areas are set in the graphic recognition area.
In order to achieve the above object, the fourth invention of the present application is an operation means, a display means, a calculation means, and a writing instrument for a writing medium comprising a margin area on the outer peripheral portion and a writing area inside the margin area. Is transmitted from the electronic writing device to the computing means of the operation terminal including communication means capable of transmitting and receiving information to and from the electronic writing device that transmits stroke data including a plurality of position information of the writing instrument accompanying movement of the writing tool. A trajectory data acquisition procedure for receiving and acquiring the stroke data via the communication means, and a character recognition area and a figure recognition drawn in at least the margin area among the stroke data acquired in the trajectory data acquisition procedure Based on the identification result in the area classification identification procedure and the area classification identification procedure for identifying the area classification instruction related to the area classification with the area, Among the writing areas, an area setting procedure for setting each of the character recognition area and the figure recognition area, and character recognition of the stroke data drawn in the character recognition area based on the setting result in the area setting procedure. And converting the stroke data drawn in the graphic recognition area into image data by performing image recognition, and in the area classification identification procedure, the short direction of the writing medium is executed. A first range designation instruction for designating a range in the longitudinal direction of the writing medium in the margin area on at least one side of the writing medium, and in the margin area on at least one side in the longitudinal direction of the writing medium. A second range designation instruction for designating a range in the short direction, and in the region setting procedure, The graphic recognition area is set in an overlapping area between an area corresponding to the range specified by the first range specifying instruction and an area corresponding to the range specified by the second range specifying instruction, and the rest is the character recognition area Or the character recognition area is set in the overlap area and the rest is set in the graphic recognition area.
In order to achieve the above object, the fifth invention of the present application is directed to a plurality of positions of the writing tool as the writing tool moves with respect to a writing medium having a margin area on the outer periphery and a writing area inside the margin area. Stroke data generation means for generating stroke data including information, and region classification between a character recognition area and a graphic recognition area drawn in at least the margin area among the stroke data generated by the stroke data generation means An area classification identifying means for identifying an area classification instruction related to the area; an area setting means for setting the character recognition area and the graphic recognition area of the writing area based on the identification result by the area classification identifying means; and Based on the setting result of the area setting means, the stroke data drawn in the character recognition area is character-recognized. Text with data reduction, have a, a data reduction unit for the image data by being image recognition the stroke data drawn into the figure recognition region, the marginal region, one of the lateral direction of the object writing medium The region classification identifying means crosses the writing region in the short direction of the writing medium with the margin region on the one side as a starting end, and is provided on each of the other side and the other side. Separation line detection means for detecting at least one area separation line that terminates in a margin area, and a plurality of portions that are included in the margin area and that are divided by the area separation lines detected by the separation line detection means And an area designation detecting means for detecting an area designation instruction drawn in at least one of the margin areas .

  According to the present invention, it is possible to improve the recognition accuracy for the entire writing trajectory data.

It is a system configuration figure showing a schematic structure of a handwriting input system of one embodiment of the present invention. It is a block diagram showing the electric constitution of an electronic writing apparatus. It is explanatory drawing for demonstrating stroke data. It is a block diagram showing the electric constitution of an operation terminal. It is a top view showing an example of a paper medium. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is a flowchart showing the control procedure which CPU of an electronic writing device performs. It is a flowchart showing the control procedure which CPU of an operating terminal performs. FIG. 10 is a plan view illustrating an example of a paper medium in a modified example in which margin areas are provided on the upper side and the lower side in addition to the left side and the right side of the outer periphery of the paper medium. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is a flowchart showing the control procedure which CPU of an operating terminal performs. FIG. 10 is an explanatory diagram for explaining a flow until a character and a graphic described on a paper medium are distinguished and recognized in a modified example (part 1) in which a range designation instruction is performed in a margin area. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is a flowchart showing the control procedure which CPU of an operating terminal performs. FIG. 10 is an explanatory diagram for explaining a flow until a character and a graphic described on a paper medium are distinguished and recognized in a modification (part 2) in which a range designation instruction is given in a margin area. It is explanatory drawing for demonstrating the flow until it distinguishes and recognizes the character and figure which were described in the paper medium. It is a flowchart showing the control procedure which CPU of an operating terminal performs. It is a flowchart showing the control procedure which CPU of an electronic writing apparatus performs in the modification which performs all the processes in an electronic writing apparatus.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<System outline configuration>
First, the schematic configuration of the handwriting input system of the present embodiment will be described with reference to FIG. In the following description, the upper side, lower side, right side, left side, near side, and depth side of the paper surface of FIG. 1 are defined as the upper side, lower side, right side, left side, near side, and depth side of the electronic writing device, respectively. To explain.

  As shown in FIG. 1, the handwriting input system 1 includes an electronic writing device 2, an electronic pen 3 (corresponding to a writing instrument), and an operation terminal 4. The electronic writing device 2 and the operation terminal 4 are connected so that information can be transmitted and received by wireless or wired communication.

<Electronic writing device>
The electronic writing device 2 has a thin rectangular parallelepiped shape that is long in the vertical direction in plan view. A small display unit 21 capable of displaying various information is provided at the upper right part of the electronic writing apparatus 2. On the left side of the display unit 21, an input unit 22 is provided for the user to operate the electronic writing apparatus 2. Below these display unit 21 and input unit 22, a concave-shaped mounting unit 24 is provided so as to occupy most of the front side of the electronic writing apparatus 2. The placement unit 24 is provided with a coordinate detection unit 25 so as to be in the same range as the placement unit 24. The coordinate detection unit 25 detects coordinate data (corresponding to position information) representing the position of the electronic pen 3 by coordinates (for example, a coordinate having the upper left portion of the placement unit 24 as an origin (0, 0)). A paper medium 70 (corresponding to a writing medium; see FIG. 5 described later) is placed on the placement unit 24. At this time, the placement unit 24 holds the paper medium 70 in a posture in which the upper left corner of the paper medium 70 matches the origin.

<Electronic pen>
The electronic pen 3 is a so-called electromagnetic induction pen, and includes a metal core 37, a detection switch 33, a button battery 34, a coil 35, a substrate 36, Is provided. The core 37 includes a pen tip 31 that protrudes to the outside and an ink storage portion 32. Ink is stored in the ink storage portion 32, and the ink is supplied to the pen tip 31. Thereby, the user can describe desired characters and figures on the paper medium 70 using the electronic pen 3 so as to be visible. In the following description, in the electronic pen 3, the direction in which the pen tip 31 is provided is referred to as the front end direction, and the direction opposite to the front end direction is referred to as the rear end direction.

  The substrate 36 is provided in the rear end direction of the core 37. The detection switch 33 is mounted on the tip of the substrate 36. The detection switch 33 is electrically connected to the coil 35 via a wiring on the substrate 36. The coil 35 is wound around the core 37 at the tip end inside the electronic pen 3. The battery 34 is provided in the rear end direction of the substrate 36. The battery 34 is connected to the substrate 36. The negative electrode of the battery 34 is electrically connected to the coil 35 via a wiring on the substrate 36, and the positive electrode is electrically connected to the detection switch 33 via a wiring on the substrate 36. Yes.

  Here, the core 37 is always urged in the distal direction by an elastic member (not shown). The core 37 slightly retracts into the electronic pen 3 against the urging force of the elastic member due to the pressing force during writing on the paper medium 70. By this retreat, the rear end portion of the lead 37 presses the detection switch 33, and the detection switch 33 is turned on. Thereby, the battery 34 and the coil 35 are electrically connected, current flows from the battery 34 toward the coil 35, and a current flows through the coil 35, thereby generating a magnetic field.

<Detection of electronic pen coordinate data>
The coordinate detection unit 25 detects the magnetic field generated from the coil 35 of the electronic pen 3 as described above based on electromagnetic induction. Since this detection is sufficient by a known method, detailed description is omitted. Based on the detection result of the coordinate detection unit 25, the CPU 201 of the electronic writing device 2 (see FIG. 2 described later) is an electronic device accompanying the movement of the electronic pen 3 during writing on the paper medium 70 on the placement unit 24. A plurality of discrete and time-dependent coordinate data of the pen 3 are acquired at a constant interval (for example, an interval of 10 [ms]). In the present embodiment, a coordinate system is used in which the upper left coordinate (X, Y) of the placement unit 24 is the origin (0, 0), the right direction is the X axis, and the lower direction is the Y axis. That is, the value of the X coordinate represents the position in the left-right direction on the placement unit 24, and the value of the Y coordinate represents the position in the vertical direction on the placement unit 24.

  Based on the plurality of coordinate data acquired as described above, the CPU 201 generates stroke data (details will be described later) as writing trajectory data representing the writing trajectory for the paper medium 70 using the electronic pen 3 of the user. And transmitted to the operation terminal 4 by communication.

<Operation terminal>
The operation terminal 4 can be implemented by, for example, a high-function mobile phone (smart phone or feature phone), a tablet computer, a notebook computer, a desktop computer, or the like. Alternatively, the operation terminal 4 may be implemented as an operation terminal dedicated to the electronic writing device 2.

<Electrical configuration of electronic writing device>
Next, the electrical configuration of the electronic writing apparatus 2 will be described with reference to FIG.

  As shown in FIG. 2, the electronic writing apparatus 2 includes a CPU 201, a ROM 202, a RAM 203 that temporarily stores various data, a flash memory 204, a drive that drives the input unit 22, and the display unit 21. A circuit 206, a drive circuit 209 that drives the coordinate detection unit 25, and a communication control unit 207 that controls transmission / reception of information with the operation terminal 4 are provided.

  The CPU 201 is electrically connected to the ROM 202, RAM 203, flash memory 204, input unit 22, drive circuits 206 and 209, and communication control unit 207.

  The ROM 202 includes a program storage area 2021 and an image data storage area 2023. The program storage area 2021 stores various programs (including programs for causing the CPU 201 to execute each procedure of the flowchart shown in FIG. 9 described later) executed by the CPU 201 to control the electronic writing apparatus 2. . In the image data storage area 2023, image data corresponding to the format information of the paper medium 70 is stored.

  The flash memory 204 includes a coordinate data storage area 2041. In the coordinate data storage area 2041, a plurality of the coordinate data acquired by the CPU 201 based on the detection result of the coordinate detection unit 25 is sequentially stored.

  The RAM 203 temporarily stores the stroke data generated by the CPU 201 based on a plurality of coordinate data stored in the coordinate data storage area 2041.

  The CPU 201 transmits the stroke data stored in the RAM 203 to the operation terminal 4 via the communication control unit 207.

<Stroke data>
Next, the stroke data will be described with reference to FIG.

  In FIG. 3, the stroke data is a pen position data sequence including a plurality of coordinate data of the electronic pen 3 that moves when writing on the paper medium 70. FIGS. 3A and 3B show examples of two stroke data “a” and “b” respectively corresponding to two characters “a” and “b”.

  As shown in FIGS. 3A and 3B, the stroke data “a” is the writing trajectory data of a single stroke from the beginning of writing to the end of writing of the character “a”, and the pen position along the time series. 11 coordinate data (X1, Y1), (X2, Y2),..., (X11, Y11) corresponding to the numbers T1, T2,. The stroke data “b” is writing trajectory data of a single stroke from the beginning of writing of the character “b” to the end of writing, and the pen position numbers T12, T13,. Corresponding 10 coordinate data (X12, Y12), (X13, Y13),... (X21, Y21) are included.

<Electrical configuration of operation terminal>
Next, the electrical configuration of the operation terminal 4 will be described with reference to FIG.

  As shown in FIG. 4, the operation terminal 4 includes a CPU 401 (corresponding to a calculation unit), a ROM 402, a RAM 403 that temporarily stores various data, a nonvolatile memory 404, and an operation unit 405 (in the operation unit). Equivalent), a display unit 406 (corresponding to display means) capable of displaying various information, and a communication control unit 407 (corresponding to communication means) for controlling transmission / reception of information with the electronic writing apparatus 2.

  The CPU 401 is electrically connected to the ROM 402, RAM 403, memory 404, operation unit 405, display unit 406, and communication control unit 407.

  The ROM 402 stores various programs that are executed by the CPU 401 to control the operation terminal 4.

  The memory 404 stores various programs executed by the CPU 401 to control the operation terminal 4 (including a writing process program for causing the CPU 401 to execute each procedure of a flowchart shown in FIG. 10 and the like described later). . At this time, even if the read writing processing program is installed in the memory 404 by reading the writing processing program stored in the storage medium (not shown) by the medium reading unit (not shown) of the operation terminal 4. Good. Alternatively, the CPU 401 receives a writing process program from an external device (not shown) connected to the operation terminal 4 so as to be able to transmit and receive information via the communication control unit 407, and the received writing process program is stored in the memory 404. May be installed. The writing process program may be stored in the ROM 402 in advance.

  The CPU 401 receives the stroke data transmitted from the electronic writing device 2 via the communication control unit 407. The RAM 403 sequentially stores stroke data received by the CPU 401. Note that the stroke data received by the CPU 401 may be stored in the memory 404.

<Features of this embodiment>
The feature of this embodiment is that the character and the graphic described on the paper medium 70 are distinguished and recognized by processing the stroke data. Details will be described below.

<Paper media>
FIG. 5 shows an example of the paper medium 70 used in this embodiment.

  As shown in FIG. 5, the paper medium 70 used in the present embodiment has an X-axis direction (a horizontal direction is a short direction (horizontal), and a Y-axis direction (vertical direction) is a long direction (vertical). The paper medium 70 may have a horizontally long rectangular shape, a square shape, etc. Further, a horizontal ruled line, a vertical ruled line, a grid, etc. are printed on the paper medium 70. May be.

  The paper medium 70 is provided with a left margin area 71 in the outer periphery, a right margin area 72 in the outer periphery, and a writing area 75 inside the margin areas 71 and 72. In the drawing, alternate long and short dash lines are shown at the boundary between the margin area 71 and the writing area 75 and at the boundary between the margin area 72 and the writing area 75, respectively. Note that a line may be printed at the boundary, or the margin areas 71 and 72 and the writing area 75 may be printed in different colors. The margin areas 71 and 72 and the writing area 75 are respectively associated with a predetermined coordinate value range for the coordinate detection unit 25.

  In addition, a check field C is printed on the paper medium 70. In this example, the check column C is printed near the lower end of the margin area 72. The check column C is associated with a predetermined coordinate value range for the coordinate detection unit 25.

<Flow for distinguishing and recognizing characters and figures on paper media>
Hereinafter, an example of a flow until a character and a graphic described on the paper medium 70 are distinguished and recognized will be described with reference to FIGS.

  First, with the paper medium 70 placed on the placement section 24, the user writes characters and figures in the writing area 75 with the electronic pen 3 as shown in FIG. In the example shown in FIG. 6, in the writing area 75, the letter “A” is written on the upper part, and the flowchart (including an elliptical box, a rectangular box, and a triangular box) is displayed below it. Sh1 is written and the letter Te2 of “ABC” is written on the lower side.

  Then, as shown in FIG. 7, the user intends to separate the paper medium 70 into a character area and a graphic area, and uses the electronic pen 3 to set a writing area 75 in the X-axis direction of the paper medium 70. A horizontal separation line SL (corresponding to the region separation line) that crosses (that is, one of the margin regions 71 and 72 has a start end and the other end) is written. That is, the user writes the horizontal separation line SL1 in a portion below the character Te1 of the paper medium 70 and above the graphic Sh1, and below the graphic Sh1 of the paper medium 70 and the above. A horizontal separation line SL2 is written in a portion above the character Te2.

  Thereafter, the user intends to designate a graphic area, and uses the electronic pen 3 to place the margin area 71, 72 between the horizontal separation line SL1 and the horizontal separation line SL2 in the left margin area 71. , A check mark 80 (corresponding to an area designation instruction) is written. The horizontal separation line SL and the check mark 80 correspond to an area division instruction relating to an area division between a character recognition area and a graphic recognition area. The area designation instruction is not limited to the check mark 80, but may be another mark or a character. Further, the area designation instruction is not limited to the case of writing in the left margin area 71 out of the margin areas 71 and 72, and may be written in the right margin area 72, or in both the margin areas 71 and 72. May be.

  Then, the user writes a check mark 81 in the check field C with the electronic pen 3. Then, in the electronic writing apparatus 2, all the stroke data corresponding to the writing content on the paper medium 70 (hereinafter referred to as “stroke data group” as appropriate) is generated and transmitted to the operation terminal 4. As a result, the operation terminal 4 receives and stores a stroke data group corresponding to the written content on the paper medium 70.

  FIG. 8 shows a stroke data group corresponding to the contents written on the paper medium 70 in the state shown in FIG. In FIG. 8, a broken line is shown at a position corresponding to the periphery of the paper medium 70.

  As shown in FIG. 8, the stroke data group corresponding to the written content on the paper medium 70 in the state shown in FIG. 7 includes stroke data corresponding to the characters Te1 and Te2 and stroke data corresponding to the graphic Sh1. And stroke data corresponding to the horizontal separation lines SL1 and SL2 and stroke data corresponding to the check mark 80, respectively.

When such a stroke data group is received at the operation terminal 4, the known separation processing is performed on the stroke data group, so that the horizontal separation lines SL1 and SL2 drawn on the paper medium 70 are displayed. Detected. As a result, the horizontal separation line region SE1 is set on the paper medium 70. That is, in the paper medium 70, the area between the uppermost position and the lowermost position of the horizontal separation line SL1 is set as the horizontal separation line area SE1. In the drawing, alternate long and short dash lines are respectively shown at the uppermost position and the lowermost position of the horizontal separation line SL1. In the paper medium 70, an area between the uppermost position and the lowermost position of the horizontal separation line SL2 is set as the horizontal separation line area SE2. In the drawing, alternate long and short dash lines are respectively shown at the uppermost position and the lowermost position of the horizontal separation line SL2.

  The left margin area 71 of the margin areas 71 and 72 is divided into a plurality of partial margin areas 710. That is, the margin area 71 includes a partial margin area 710a above the horizontal separation line area SE1, and a partial margin area 710b below the horizontal separation line area SE1 and above the horizontal separation line area SE2. And a partial margin region 710c below the horizontal separation line region SE2. The writing area 75 is divided into a plurality of partial writing areas 750. That is, the writing area 75 includes a partial writing area 750a above the horizontal separation line area SE1, and a partial writing area 750b below the horizontal separation line area SE1 and above the horizontal separation line area SE2. And a partial writing area 750c below the horizontal separation line area SE2.

  Thereafter, the check mark 80 drawn in the partial margin area 710b is detected by performing known appropriate identification processing on the received stroke data group. Thereby, of the partial writing areas 750a to 750c included in the writing area 75, the area corresponding to the check mark 80 drawn in the partial margin area 710b, that is, the partial writing area 750b located on the right side of the partial margin area 710b. In addition, the figure recognition area is set, and the others are set as the character recognition area.

  Then, the stroke data of each of the characters Te1 and Te2 drawn in the character recognition area is converted into text data by being character-recognized by a known appropriate technique, and stored. Further, the stroke data of the figure Sh1 drawn in the figure recognition area is image-recognized by an appropriate known method to be converted into image data and stored.

<Control procedure>
Next, control procedures executed in the electronic writing device 2 and the operation terminal 4 in order to realize the above method will be described with reference to FIGS. 9 and 10.

<Control procedure on the electronic writing device>
Hereinafter, the control procedure executed by the CPU 201 of the electronic writing device 2 will be described with reference to FIG.

  In FIG. 9, the process of this flowchart is started when the power supply of the electronic writing apparatus 2 is turned on, for example.

  First, in step S <b> 10, the CPU 201 acquires coordinate data of the electronic pen 3 based on the detection result of the coordinate detection unit 25 when the user writes on the paper medium 70 with the electronic pen 3. The acquired coordinate data is sequentially stored in the coordinate data storage area 2041.

  Thereafter, in step S20, the CPU 201 determines whether or not the check mark 81 is written in the check column C. Until the check mark 81 is written in the check column C, the determination in step S20 is not satisfied (S20: NO), and the process returns to step S10 and the same procedure is repeated. When the check mark 81 is written in the check column C, the determination in step S20 is satisfied (S20: YES), and the process proceeds to step S30.

  In step S30, the CPU 201 generates a stroke data group corresponding to the contents written on the paper medium 70 based on the plurality of coordinate data stored in the coordinate data storage area 2041 in step S10. The generated stroke data group is temporarily stored in the RAM 203.

  In step S40, the CPU 201 transmits the stroke data group stored in the RAM 203 in step S30 to the operation terminal 4 via the communication control unit 207. Thus, the process of this flowchart is completed.

<Control procedure on the operation terminal>
Hereinafter, a control procedure executed by the CPU 401 of the operation terminal 4 based on the writing processing program will be described with reference to FIG.

  In FIG. 10, the processing of this flowchart is started when the power of the operation terminal 4 is turned on, for example.

  First, in step S <b> 110, the CPU 401 receives the stroke data group transmitted from the electronic writing apparatus 2 in step S <b> 40 of FIG. 10 via the communication control unit 407. This step S110 corresponds to the trajectory data acquisition procedure described in each claim. The received stroke data group is temporarily stored in the RAM 403.

  Thereafter, in step S120, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, so that at least one horizontal separation line SL drawn on the paper medium 70 is obtained. Is detected.

  In step S122, the CPU 401 sets at least one horizontal separation line region SE in the paper medium 70 based on the detection result in step S120.

  Thereafter, in step S124, the CPU 401 divides the margin area 71 into a plurality of partial margin areas 710 based on the setting result in step S122.

  In step S126, the CPU 401 divides the writing area 75 into a plurality of partial writing areas 750 based on the setting result in step S122.

  Thereafter, in step S130, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, so that at least one of the plurality of partial margin areas 710 divided in step S124. A check mark 80 drawn in one is detected.

  In step S140, the CPU 401 sets the partial writing area 750 located on the right side of the partial margin area 710 in which the check mark 80 is detected in step S130 among the plurality of partial writing areas 750 divided in step S126. Set the figure recognition area and set the others as the character recognition area. This step S140 corresponds to the area setting procedure described in each claim.

  Thereafter, in step S150, based on the setting result in step S140, the CPU 401 selects stroke data corresponding to the written content drawn in the character recognition area from the stroke data group stored in the RAM 403 in step S110. Text data is generated by recognizing characters by a known appropriate method. The generated text data is stored in the memory 404.

  In step S160, the CPU 401, based on the setting result in step S140, out of the stroke data group stored in the RAM 403 in step S110, stroke data corresponding to the written content drawn in the graphic recognition area. Image data is obtained by recognizing the image by a known appropriate method. The generated image data is stored in the memory 404. Thus, the process shown in this flowchart is completed.

  Steps S120 and S130 correspond to the region classification identification procedure described in each claim, of which step S120 corresponds to the separation line detection procedure and step S130 corresponds to the region designation detection procedure. The steps S150 and S160 correspond to the data conversion procedure described in each claim.

<Effect of this embodiment>
As described above, in the present embodiment, writing trajectory data (stroke data in the above example) for the paper medium 70 is acquired. At this time, the paper medium 70 is provided with margin areas 71 and 72 in the outer peripheral portion in advance, and the inside of the margin areas 71 and 72 is a writing area 75. At the time of writing on the paper medium 70, the user gives a predetermined area division instruction (writing of the horizontal separation line SL and the check mark 80 in the above example) to both the margin areas 71 and 72 and the writing area 75. The area segment indication is identified. Based on the identification result, which part of the writing area 75 is a character recognition area and which part is a graphic recognition area is set. Based on the setting result, the writing trajectory data drawn in the character recognition area is converted into text data by character recognition using an appropriate technique, and the writing trajectory data drawn in the figure recognition area is appropriately changed. The image is recognized and converted into image data.

  As a result of the above, even when the user describes characters and figures mixed in the paper medium 70, it is easy to add the region classification instruction to both the margin regions 71 and 72 and the writing region 75. By simply performing a simple operation, it is possible to distinguish between characters and figures and perform appropriate processing. As a result, it is possible to prevent unnecessary text data (so-called garbage data) from being misrecognized as characters, and to reduce the character recognition rate of the original character data. Can be improved.

  In the present embodiment, in particular, the stroke data transmitted from the electronic writing device 2 is received, and the region classification instruction (writing of the horizontal separation line SL and the check mark 80 in the above example) in the stroke data is identified. . Then, based on the identification result, which part of the writing area 75 is the character recognition area and which part is the graphic recognition area is set, respectively, and drawn on the character recognition area based on the setting result. The stroke data is recognized and converted into text data, and the stroke data drawn in the graphic recognition area is recognized and converted into image data. Thereby, the said recognition accuracy about stroke data can be improved.

  In this embodiment, in particular, the horizontal separation line SL is detected, and a check mark 80 drawn in at least one of the plurality of partial margin areas 710 divided by the detected horizontal separation line SL is detected. To do. As a result, the user can easily specify the graphic area by writing the check mark 80 in the margin area 71 after writing the horizontal separation line SL.

  In the present embodiment, in particular, among the plurality of partial writing areas 750 divided by the horizontal separation line SL, a graphic recognition area is set in an area corresponding to the check mark 80 drawn in the partial margin area 710, and the others are set. Set to the character recognition area. Accordingly, by writing the check mark 80 in the margin area 71 after writing the horizontal separation line SL, it is possible to specify that the step area in the writing area 75 is a graphic area.

  In the above description, the user writes a check mark 80 for designating the margin area 71 as a graphic area, and the CPU 401 corresponds to the check mark 80 drawn in the margin area 71 among the plurality of partial writing areas 750. The figure recognition area is set as the area and the other areas are set as the character recognition area. However, the present invention is not limited to this, and the user writes a check mark 80 for designating the margin area 71 as a character area. In the partial writing area 750, a character recognition area may be set in an area corresponding to the check mark 80 drawn in the margin area 71, and the other area may be set as a graphic recognition area.

<Modifications>
The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit and technical idea of the present invention. Hereinafter, such modifications will be described.

(1) When margin areas are provided on the upper and lower sides in addition to the left and right sides of the outer periphery of the paper medium <Paper medium>
FIG. 11 shows an example of a paper medium used in this modification.

  As shown in FIG. 11, a paper medium 70 </ b> A (corresponding to a writing medium) used in this modification has the same shape as the paper medium 70.

  The paper medium 70A includes the left margin region 71 in the outer peripheral portion, the right margin region 72 in the outer peripheral portion, the upper margin region 73 in the outer peripheral portion, and the lower margin region in the outer peripheral portion. 74 and a writing area 76 inside the margin areas 71 to 74 are provided. In the drawing, the boundary between the margin area 71 and the writing area 76, the boundary between the margin area 72 and the writing area 76, the boundary between the margin area 73 and the writing area 76, and the boundary between the margin area 74 and the writing area 76 are shown. , Each shows a one-dot chain line. The margin areas 71 to 74 and the writing area 76 are respectively associated with predetermined coordinate value ranges for the coordinate detection unit 25.

  In the paper medium 70 </ b> A, the check column C is printed near the lower end of the margin area 72 (near the right end of the margin area 74).

<Flow for distinguishing and recognizing characters and figures on paper media>
Hereinafter, with reference to FIGS. 12 and 13, an example of a flow until a character and a graphic described on the paper medium 70 </ b> A are distinguished and recognized will be described.

  First, with the paper medium 70 </ b> A placed on the placement unit 24, the user writes characters and figures in the writing area 76 with the electronic pen 3 as shown in FIG. 12. In the example shown in FIG. 12, in the writing area 76, the character Te1 is written in the upper left portion, the figure Sh1 is written in the middle right portion, and the character Te2 is written in the lower left portion.

  Then, the user intends to separate the paper medium 70A into a character area and a graphic area, and uses the electronic pen 3 to cross the writing area 76 in the X-axis direction of the paper medium 70A. And a vertical separation line LL that crosses the writing area 76 in the Y-axis direction of the paper medium 70A (that is, the marginal areas 73 and 74 have a start end located at one end and a termination end located at the other). The horizontal separation line SL and the vertical separation line LL correspond to the region separation lines described in the claims. Of these, the horizontal separation line SL corresponds to the first region separation line, and the vertical separation line LL corresponds to the second region separation line. . That is, the user writes the horizontal separation line SL1 below the character Te1 of the paper medium 70A and above the graphic Sh1, and below the graphic Sh1 of the paper medium 70A and the above. A horizontal separation line SL2 is written in a portion above the character Te2, and a vertical separation line LL is written in a portion on the right side of the characters Te1 and Te2 and on the left side of the graphic Sh1 of the paper medium 70A.

Thereafter, the user intends to designate a graphic area, and uses the electronic pen 3 to place the margin area 71, 72 between the horizontal separation line SL1 and the horizontal separation line SL2 in the left margin area 71. Then, the check mark 80 is written, and the check mark 80 is written in a portion of the margin areas 73 and 74 on the right side of the vertical separation line LL of the upper margin area 73. The horizontal separation line SL, the vertical separation line LL, and these check marks 80 correspond to region division instructions. Incidentally, instead of writing the check mark 80 is the region designation instruction to the left of the margin region 71 of the margins regions 71 and 72, may be written to the right of the margin area 72, also of the margin areas 71, 72 You may write on both. Similarly, margins rather than writing a check mark 80 is the region designation instruction above the margin area 73 in the region 73 and 74, may be written in the margin area 74 of the lower and the margin area 73, 74 may be written on both.

  Then, the user writes the check mark 81 in the check field C with the electronic pen 3. Then, in the electronic writing device 2, a stroke data group corresponding to the writing content on the paper medium 70 </ b> A is generated and transmitted to the operation terminal 4. Thereby, in the operation terminal 4, the stroke data group corresponding to the written content to the paper medium 70A is received and preserve | saved.

  FIG. 13 shows a stroke data group corresponding to the contents written on the paper medium 70A in the state shown in FIG. In FIG. 13, a broken line is shown at a position corresponding to the periphery of the paper medium 70A.

  As shown in FIG. 13, the stroke data group corresponding to the contents written on the paper medium 70A in the state shown in FIG. 12 includes stroke data corresponding to the characters Te1 and Te2, and stroke data corresponding to the graphic Sh1. And stroke data corresponding to the horizontal separation lines SL1 and SL2, stroke data corresponding to the vertical separation line LL, and stroke data corresponding to the two check marks 80, respectively.

  When such a stroke data group is received at the operation terminal 4, a known appropriate identification process is performed on the stroke data group, so that the horizontal separation lines SL1 and SL2 drawn on the paper medium 70A and A vertical separation line LL is detected. As a result, the horizontal separation line region SE and the vertical separation line region LE are set on the paper medium 70A. That is, an area between the uppermost position and the lowermost position of the horizontal separation line SL1 in the paper medium 70A is set as the horizontal separation line area SE1. In the drawing, alternate long and short dash lines are respectively shown at the uppermost position and the lowermost position of the horizontal separation line SL1. Further, in the paper medium 70A, an area between the uppermost position and the lowermost position of the horizontal separation line SL2 is set as the horizontal separation line area SE2. In the drawing, alternate long and short dash lines are respectively shown at the uppermost position and the lowermost position of the horizontal separation line SL2. In the paper medium 70A, a region between the leftmost position and the rightmost position of the vertical separation line LL is set as the vertical separation line region LE. In the drawing, alternate long and short dash lines are shown at the leftmost position and the rightmost position of the vertical separation line LL, respectively.

  The left margin area 71 of the margin areas 71 and 72 is divided into a plurality of partial margin areas 710 (corresponding to first partial margin areas). That is, the margin area 71 includes a partial margin area 710a above the horizontal separation line area SE1, and a partial margin area 710b below the horizontal separation line area SE1 and above the horizontal separation line area SE2. And a partial margin region 710c below the horizontal separation line region SE2. Further, the upper margin area 73 of the margin areas 73 and 74 is divided into a plurality of partial margin areas 730 (corresponding to the second partial margin area). That is, the margin area 73 is divided into a partial margin area 730a on the left side of the vertical separation line area LE and a partial margin area 730b on the right side of the vertical separation line area LE. The writing area 76 is divided into a plurality of partial writing areas 760. That is, the writing area 76 is above the horizontal separation line area SE1 and to the left of the vertical separation line area LE, and above the horizontal separation line area SE1 and the vertical separation line area. A partial writing area 760b on the right side of LE, a partial writing area 760c on the lower side of the horizontal separation line area SE1, on the upper side of the horizontal separation line area SE2 and on the left side of the vertical separation line area LE; A partial writing area 760d below the horizontal separation line area SE1, above the horizontal separation line area SE2 and to the right of the vertical separation line area LE, and below the horizontal separation line area SE2. And a partial writing area 760e on the left side of the vertical separation line area LE, a partial writing area 760f on the lower side of the horizontal separation line area SE2 and on the right side of the vertical separation line area LE, It is classified.

  Thereafter, a known appropriate identification process is performed on the received stroke data group, so that the check mark 80 drawn in the partial margin area 710b and the check mark drawn in the partial margin area 730b. 80 are detected. Thereby, of the partial writing areas 760a to 750f included in the writing area 76, the area corresponding to the check mark 80 drawn in the partial margin areas 710b and 730b, that is, the right side of the partial margin area 710b and the partial margin area A graphic recognition area is set in the partial writing area 760d positioned below 730b, and the other area is set as the character recognition area.

  Then, the stroke data of each of the characters Te1 and Te2 drawn in the character recognition area is converted into text data by being character-recognized by a known appropriate technique, and stored. Further, the stroke data of the figure Sh1 drawn in the figure recognition area is image-recognized by an appropriate known method to be converted into image data and stored.

<Control procedure on the electronic writing device>
Next, a control procedure executed by the CPU 401 of the operation terminal 4 based on the writing process program in order to realize the above method will be described with reference to FIG.

  In FIG. 14, step S110 is the same as FIG. In subsequent step S120A, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, thereby at least one horizontal separation line SL drawn on the paper medium 70A. And at least one vertical separation line LL.

  In step S122A, the CPU 401 sets at least one horizontal separation line region SE and at least one vertical separation line region LE on the paper medium 70A based on the detection result in step S120A.

  Thereafter, in step S124A, the CPU 401 divides the margin area 71 into a plurality of partial margin areas 710 and divides the margin area 73 into a plurality of partial margin areas 730 based on the setting result in step S122A.

  In step S126A, the CPU 401 divides the writing area 76 into a plurality of partial writing areas 760 based on the setting result in step S122A.

  After that, in step S130A, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, so that at least one of the plurality of partial margin areas 710 divided in step S124A. The check mark 80 drawn in one and the check mark 80 drawn in at least one of the plurality of partial margin areas 730 divided in step S124A are detected.

  In step S140A, the CPU 401 checks the right side of the partial margin area 710 in which the check mark 80 is detected in step S130A among the plurality of partial writing areas 760 divided in step S126A and the check mark in step S130A. The figure recognition area is set in the partial writing area 750 positioned below the partial margin area 730 in which 80 is detected, and the rest is set as the character recognition area. This step S140A corresponds to the region setting procedure described in each claim.

  Subsequent steps S150 and S160 are the same as those in FIG.

  The above steps S120A and S130A correspond to the region classification identification procedure described in each claim, of which step S120A corresponds to the separation line detection procedure and step S130A corresponds to the region designation detection procedure.

<Effect of this modification>
Also in this modification, the same effect as the above embodiment is obtained. Further, in the present modification, the horizontal separation line SL and the vertical separation line LL are detected and drawn in at least one of the plurality of partial margin regions 710 divided by the detected horizontal separation line SL. The check mark 80 and the check mark 80 drawn in at least one of the plurality of partial margin areas 730 divided by the detected vertical separation line LL are detected. A graphic recognition area is set in an area corresponding to the check mark 80 drawn in the partial margin areas 710 and 730 among the plurality of partial writing areas 760 divided by the horizontal separation line SL and the vertical separation line LL. Is set as the character recognition area. Thus, after writing the horizontal separation line SL and the vertical separation line LL, by writing the check mark 80 in the margin areas 71 and 73, even in a limited partial area of the writing area 76, An area can be designated.

  In the above description, the user writes a check mark 80 for designating the margin areas 71 and 73 as a graphic area, and the CPU 401 checks the check marks drawn in the margin areas 71 and 73 among the plurality of partial writing areas 760. The figure recognition area is set in the area corresponding to 80 and the others are set as the character recognition area. However, the present invention is not limited to this, and a check mark 80 for the user to designate as a character area in the margin areas 71 and 73 is written. Then, the CPU 401 may set the character recognition area in the area corresponding to the check mark 80 drawn in the margin areas 71 and 73 among the plurality of partial writing areas 760 and set the other areas as the graphic recognition area.

(2) When providing margin areas only on the upper and lower sides of the outer periphery of the paper medium In the above embodiment, margin areas 71 and 72 are provided only on the left and right sides of the outer periphery of the paper medium 70. In the modified example 1), the margin areas 71, 72, 73, 74 are provided on the left side, the right side, the upper side, and the lower side of the outer peripheral portion of the paper medium 70A, but the present invention is not limited to this. That is, the margin areas 73 and 74 may be provided only on the upper and lower sides of the outer periphery of the paper medium.

  In this case, the CPU 401 detects at least one horizontal separation line LL drawn on the paper medium in step S120 of FIG. 10, and in step S122, based on the detection result, at least one vertical segment on the paper medium. A separation line LE is set, and in step S124, the margin area 73 is divided into a plurality of partial margin areas 730 based on the setting result. In step S126, the writing area is converted into a plurality of partial writing areas. In step S130, a check mark 80 drawn in at least one of the plurality of divided partial margin areas 730 is detected, and in step S140, the check mark 80 is extracted from the plurality of divided partial writing areas. A graphic recognition area is set in the partial writing area located below the partial margin area 730 where the check mark 80 is detected. It may be set otherwise the character recognition region.

  In this case, the same effect as the above embodiment is obtained.

  In the above, the user writes a check mark 80 for designating the margin area 73 as a graphic area, and the CPU 401 corresponds to the check mark 80 drawn in the margin area 73 among the plurality of partial writing areas. However, the present invention is not limited to this, and the user writes a check mark 80 for designating the margin area 73 as a character area. Of the partial writing area, the character recognition area may be set in the area corresponding to the check mark 80 drawn in the margin area 73, and the other area may be set as the graphic recognition area.

(3) When specifying a range in the margin area (part 1)
In this modification, the paper medium 70 (see FIG. 5) is used.

<Flow for distinguishing and recognizing characters and figures on paper media>
Hereinafter, with reference to FIGS. 15 and 16, an example of a flow until a character and a graphic described on the paper medium 70 are distinguished and recognized will be described.

  First, with the paper medium 70 placed on the placement section 24, the user writes characters and figures in the writing area 75 with the electronic pen 3 as shown in FIG. In the example shown in FIG. 15, in the writing area 75, the character Te1 is written on the upper part, the figure Sh1 is written on the lower side, and the character Te2 is written on the lower side.

  Then, the user intends to designate the range of the graphic area by using the electronic pen 3 to the left margin area 71 of the margin areas 71 and 72 in the Y axis direction range of the paper medium 70 ( That is, a right open parenthesis mark 82 (corresponding to a range designation instruction and an area division instruction) for designating a vertical range) is written. The range designation instruction is not limited to the parenthesis mark, but may be another mark. Further, the range designation instruction is not limited to writing in the left margin area 71 of the margin areas 71 and 72, and may be written in the right margin area 72, or written in both the margin areas 71 and 72. May be. That is, the user writes the right opening parenthesis mark 82 over the vertical range including the position corresponding to the lower end from the position corresponding to the upper end of the graphic Sh1 written in the writing area 75 in the margin area 71. .

  Then, the user writes the check mark 81 in the check field C with the electronic pen 3. Then, in the electronic writing device 2, a stroke data group corresponding to the writing content on the paper medium 70 is generated and transmitted to the operation terminal 4. As a result, the operation terminal 4 receives and stores a stroke data group corresponding to the written content on the paper medium 70.

  FIG. 16 shows a stroke data group corresponding to the contents written on the paper medium 70 in the state shown in FIG. In FIG. 15, a broken line is shown at a position corresponding to the periphery of the paper medium 70.

  As shown in FIG. 16, the stroke data group corresponding to the written contents on the paper medium 70 in the state shown in FIG. 15 includes stroke data corresponding to the characters Te1 and Te2 and stroke data corresponding to the graphic Sh1. And stroke data corresponding to the right opening parenthesis mark 82.

  When such a stroke data group is received at the operation terminal 4, the right open parenthesis mark 82 drawn in the margin area 71 is identified by performing known appropriate identification processing on the stroke data group. Is done. Thus, in the writing area 75, the area 7500 (in the drawing, the one-dot chain lines are shown at the upper end position and the lower end position of the area 7500 corresponding to the vertical range specified by the right opening parenthesis mark 82 drawn in the margin area 71. The figure recognition area is set, and the others are set as the character recognition area.

  Then, the stroke data of each of the characters Te1 and Te2 drawn in the character recognition area is converted into text data by being character-recognized by a known appropriate technique, and stored. Further, the stroke data of the figure Sh1 drawn in the figure recognition area is image-recognized by an appropriate known method to be converted into image data and stored.

<Control procedure on the electronic writing device>
Next, a control procedure executed by the CPU 401 of the operation terminal 4 based on the writing processing program in order to realize the above method will be described with reference to FIG.

  In FIG. 17, step S110 is the same as FIG. In subsequent step S125, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, so that at least one right-open bracket mark 82 drawn in the margin area 71 is obtained. Identify Note that this step S125 corresponds to a region classification identification procedure described in each claim.

  In step S140B, the CPU 401 sets a figure recognition area in the area 7500 corresponding to the vertical range specified by the right opening parenthesis mark 82 identified in step S125 in the writing area 75, and the other areas. Set to the character recognition area. This step S140B corresponds to the region setting procedure described in each claim.

  Subsequent steps S150 and S160 are the same as those in FIG.

<Effect of this modification>
Also in this modification, the same effect as the above embodiment is obtained. In the present modification, a right-open bracket mark 82 is identified in the margin area 71. As a result, it can be easily specified that it is a graphic area with little effort.

  Further, in this modification, a graphic recognition area is set in the area 7500 corresponding to the vertical range specified by the right opening bracket mark 82 drawn in the margin area 71 in the writing area 75, and the rest is the character recognition area. Set to. As a result, it is possible to specify that the step area of the paper medium 70 is a graphic area simply by writing the right opening bracket mark 82 in the margin area 71 on one side.

  In the above description, the user writes a right opening parenthesis mark 82 for designating the range of the graphic area in the margin area 71, and the CPU 401 sets a graphic recognition area in the area 7500 in the writing area 75 and the others. The character recognition area is set, but the present invention is not limited to this, and the user writes a right opening parenthesis mark 82 for designating the range of the character area in the margin area 71, and the CPU 401 writes the area 7500 in the writing area 75. A character recognition area may be set, and the rest may be set as a figure recognition area.

(4) When specifying a range in the margin area (part 2)
In this modification, the paper medium 70A (see FIG. 11) is used.

<Flow for distinguishing and recognizing characters and figures on paper media>
Hereinafter, with reference to FIGS. 18 and 19, an example of a flow until a character and a graphic described on the paper medium 70 </ b> A are distinguished and recognized will be described.

  First, with the paper medium 70 </ b> A placed on the placement section 24, the user writes characters and figures in the writing area 76 with the electronic pen 3 as shown in FIG. 18. In the example shown in FIG. 18, in the writing area 75, the character Te1 is written in the upper left portion, the graphic Sh1 is written in the middle right portion, and the character Te2 is written in the lower left portion.

  Then, the user intends to designate the range of the graphic area by using the electronic pen 3 to the left margin area 71 of the margin areas 71 and 72 in the Y axis direction range of the paper medium 70 ( That is, the right opening bracket mark 82 that designates the range in the vertical direction is written, and the range in the X-axis direction of the paper medium 70 (that is, the range in the horizontal direction) is written in the upper margin region 73 of the margin regions 73 and 74. Write the specified lower opening parenthesis mark 83. The right open parenthesis mark 82 and the lower open parenthesis mark 83 correspond to the range designation instruction and the region division instruction described in each claim. Of these, the right open parenthesis mark 82 is the first range designation instruction, and the lower open parenthesis mark 83 is This corresponds to a second range designation instruction. The range designation instruction is not limited to the parenthesis mark, but may be another mark. Further, the range designation instruction is not limited to writing in the left margin area 71 of the margin areas 71 and 72, and may be written in the right margin area 72, or written in both the margin areas 71 and 72. May be. Similarly, the range designation instruction is not limited to writing in the upper margin area 73 out of the margin areas 73 and 74, and may be written in the lower margin area 74. May be written. That is, the user writes the right opening parenthesis mark 82 over the vertical range including the position corresponding to the lower end from the position corresponding to the upper end of the graphic Sh1 written in the writing area 76 in the margin area 71. In the margin area 73, a lower opening parenthesis mark 83 is written over a horizontal range including a position corresponding to the right end from a position corresponding to the left end of the figure Sh1 written in the writing area 76.

  Then, the user writes the check mark 81 in the check field C with the electronic pen 3. Then, in the electronic writing device 2, a stroke data group corresponding to the writing content on the paper medium 70 </ b> A is generated and transmitted to the operation terminal 4. Thereby, in the operation terminal 4, the stroke data group corresponding to the written content to the paper medium 70A is received and preserve | saved.

  FIG. 19 shows a stroke data group corresponding to the contents written on the paper medium 70A in the state shown in FIG. In FIG. 19, a broken line is shown at a position corresponding to the periphery of the paper medium 70A.

  As shown in FIG. 19, the stroke data group corresponding to the written contents on the paper medium 70A in the state shown in FIG. 15 includes the stroke data corresponding to the characters Te1 and Te2, and the stroke data corresponding to the graphic Sh1. And stroke data corresponding to the right opening parenthesis mark 82 and stroke data corresponding to the lower opening parenthesis mark 83.

  When the operation terminal 4 receives such a stroke data group, the known right identification process is performed on the stroke data group, so that the right-open bracket mark 82 drawn in the margin area 71, The lower opening bracket mark 83 drawn in the margin area 73 is identified. Thereby, in the writing area 76, the area 7600a corresponding to the vertical range specified by the right opening parenthesis mark 82 drawn in the margin area 71 (in the figure, the dashed lines are shown at the upper end position and the lower end position of the area 7600a). And a region 7600b corresponding to the horizontal range specified by the lower opening parenthesis mark 83 drawn in the margin region 73 (in the drawing, dashed lines are shown at the left end position and the right end position of the region 7600b). ) And the overlapping area 7600c, and the figure recognition area is set as the character recognition area.

  Then, the stroke data of each of the characters Te1 and Te2 drawn in the character recognition area is converted into text data by being character-recognized by a known appropriate technique, and stored. Further, the stroke data of the figure Sh1 drawn in the figure recognition area is image-recognized by an appropriate known method to be converted into image data and stored.

<Control procedure on the electronic writing device>
Next, a control procedure executed by the CPU 401 of the operation terminal 4 based on the writing process program in order to realize the method will be described with reference to FIG.

  In FIG. 20, step S110 is the same as in FIG. In subsequent step S125C, the CPU 401 performs known appropriate identification processing on the stroke data group stored in the RAM 403 in step S110, so that at least one right-open bracket mark 82 drawn in the margin area 71 is obtained. And at least one lower opening parenthesis mark 83 drawn in the margin area 73 is identified. In addition, this step S125C corresponds to the area division identification procedure described in each claim.

  In step S140C, the CPU 401, in the writing area 76, corresponds to the area 7500a corresponding to the vertical range specified by the right opening bracket mark 82 identified in step S125, and the downward opening identified in step S125. A graphic recognition area is set in the overlapping area 7500c of the area 7500b corresponding to the left-right direction range specified by the parenthesis mark 83, and the rest is set as the character recognition area. This step S140C corresponds to the region setting procedure described in each claim.

  Subsequent steps S150 and S160 are the same as those in FIG.

<Effect of this modification>
Also in this modification, the same effect as the above embodiment is obtained. Further, according to the present modification, the right open parenthesis mark 82 and the lower open parenthesis mark 83 are simply written in the left and upper margin areas 71 and 73, respectively, and a limited partial area of the paper medium 70A is written. In contrast, it can be specified that the area is a graphic area.

  In the above description, the user writes the right open parenthesis mark 82 and the lower open parenthesis mark 83 for designating the range of the graphic area in the margin areas 71 and 73, and the CPU 401 writes the overlap area 7600 c in the writing area 75. Although the figure recognition area is set and the rest is set as the character recognition area, the present invention is not limited to this. The right open parenthesis mark 82 and the lower open parenthesis mark for the user to specify the range of the character area in the margin areas 71 and 73 are not limited thereto. 83 may be written, and the CPU 401 may set a character recognition area in the overlapping area 7600c in the writing area 75 and set the rest as a graphic recognition area.

(5) When specifying a range in the margin area (part 3)
Similarly to the modification (2), a paper medium in which margin regions 73 and 74 are provided only on the upper side and the lower side of the outer peripheral portion may be used.

  In this case, the CPU 401 identifies at least one lower opening parenthesis mark 83 drawn in the margin area 73 in step S125 of FIG. 16, and in step S140B, the identified lower opening parenthesis in the writing area 75 is identified. What is necessary is just to set a figure recognition area in the area | region corresponding to the range of the left-right direction designated with the mark 83, and to set the other as a character recognition area.

  In this case, the same effect as the above embodiment is obtained.

  In the above description, the user writes a lower opening parenthesis mark 83 for designating the range of the graphic area in the margin area 73, and the CPU 401 writes the lower opening parenthesis mark 83 drawn in the margin area 73 in the writing area 75. The figure recognition area is set in the area corresponding to the range in the left and right direction specified in the above and the other is set as the character recognition area. However, the present invention is not limited to this, and the user can specify the character area range in the margin area 73. The lower opening parenthesis mark 83 is written, and the CPU 401 sets the character recognition area in the writing area 75 corresponding to the left and right range specified by the lower opening parenthesis mark 83 drawn in the margin area 73. May be set in the figure recognition area.

(6) When all processes are executed in the electronic writing apparatus In the above embodiment, the electronic writing apparatus 2 executes up to generation of stroke data, and the subsequent processes are executed in the operation terminal 4. However, the present invention is not limited thereto. Instead, all processing may be executed in the electronic writing apparatus 2.

  Hereinafter, a control procedure executed by the CPU 201 of the electronic writing device 2 in this modification will be described with reference to FIG.

  In FIG. 21, steps S10, S20, and S30 are the same as those in FIG. Note that step S30 functions as stroke data generation means described in each claim. In subsequent step S50, the CPU 201 performs at least one known identification process on the stroke data group stored in the RAM 203 in step S30, so that at least one horizontal separation line SL drawn on the paper medium 70 is obtained. Is detected.

  In step S52, the CPU 201 sets at least one horizontal separation line region SE in the paper medium 70 based on the detection result in step S50.

  Thereafter, in step S54, the CPU 201 divides the margin area 71 into a plurality of partial margin areas 710 based on the setting result in step S52.

  In step S56, the CPU 201 divides the writing area 75 into a plurality of partial writing areas 750 based on the setting result in step S52.

  Thereafter, in step S60, the CPU 201 performs known appropriate identification processing on the stroke data group stored in the RAM 203 in step S30, so that at least one of the plurality of partial margin areas 710 divided in step S54. A check mark 80 drawn in one is detected.

  In step S70, the CPU 201 sets the partial writing area 750 positioned on the right side of the partial margin area 710 in which the check mark 80 is detected in step S60 among the plurality of partial writing areas 750 divided in step S126. Set the figure recognition area and set the others as the character recognition area. In addition, this step S70 functions as a region setting means described in each claim.

  Thereafter, in step S80, based on the setting result in step S70, the CPU 201 selects stroke data corresponding to the written content drawn in the character recognition area from the stroke data group stored in the RAM 203 in step S30. Text data is generated by recognizing characters by a known appropriate method. The generated text data is stored in the flash memory 204.

  In step S90, based on the setting result in step S70, the CPU 201 extracts stroke data corresponding to the written content drawn in the graphic recognition area from the stroke data group stored in the RAM 203 in step S30. Image data is obtained by recognizing the image by a known appropriate method. The generated image data is stored in the flash memory 204. Thus, the process shown in this flowchart is completed.

  Note that the above steps S50 and S60 constitute area classification identifying means described in each claim. Further, the above steps S80 and S90 constitute data converting means described in each claim.

  Also in this modification, the same effect as the above embodiment is obtained.

  In addition, also about the method of the modification of said (1)-(5), it is possible to perform all the processes in the electronic writing apparatus 2. FIG.

(7) Other method of acquiring coordinate data In the above, the movement of the electronic pen 3 due to the user's writing operation is detected by detecting the magnetic field from the electronic pen 3 by the coordinate detection unit 25. However, the present invention is not limited to this. Absent. That is, a method of detecting the movement of the tip of the electronic pen 3 during the user's writing operation using ultrasonic waves, infrared rays, or camera imaging results may be used. Further, a known pressure sensitive means is provided on the placement unit 24 of the electronic writing apparatus 2, and the pressure sensing means detects the force with which the tip of the electronic pen 3 presses the paper medium 70 or the like during the user's writing operation. The movement of the tip of the electronic pen 3 may be detected. In this case, a general-purpose pen such as a normal ballpoint pen can be used as the writing instrument instead of the electronic pen 3 including the coil 35 for generating the magnetic field as described above.

(8) When camera imaging data of paper medium is acquired as writing trajectory data In other words, after the user performs writing on an appropriate paper medium using an appropriate writing tool, the paper medium is imaged with the camera, and the operation terminal 4 The image data of the paper medium is acquired as writing trajectory data for the paper medium, and at least the area classification instruction (such as the check mark 80) drawn in the margin area is identified among the image data, and the identification result On the basis of the writing area of the paper medium, each of the character recognition area and the figure recognition area is set, and based on the setting result, the imaging data drawn in the character recognition area is character-recognized and converted into text data. The imaging data drawn in the figure recognition area can be recognized as an image data.

(9) Others In the above description, when there are descriptions such as “vertical”, “parallel”, and “plane”, the descriptions are not strict. That is, the terms “vertical”, “parallel”, “plane”, etc., allow tolerances and errors in design and mean “substantially vertical”, “substantially parallel”, “substantially plane”, etc. It is.

  In addition, in the above description, when there are descriptions such as “same”, “equal”, “different”, etc., in terms of external dimensions and sizes, the descriptions are not strict. That is, the terms “same”, “equal”, “different”, etc. mean that “tolerance and error in design and manufacturing are allowed”, “substantially identical”, “substantially equal”, “substantially different”, It is. However, if there is a description of a value that becomes a predetermined judgment criterion or a value that becomes a delimiter, such as a threshold value or a reference value, for example, “same”, “equal”, “different”, etc. It is different and has a strict meaning.

  In addition, the arrows shown in FIGS. 1, 2, and 4 show an example of the signal flow, and do not limit the signal flow direction.

  Further, the flowcharts shown in FIG. 9 and FIG. 10 are not intended to limit the present invention to the illustrated procedure, and the addition / deletion of the procedure, the change of the order, etc. are made without departing from the spirit and technical idea of the invention. May be.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

2 Electronic writing device 3 Electronic pen (writing instrument)
4 Operation terminal 70 Paper medium (written medium)
70A Paper medium (written medium)
71 Margin area 72 Margin area 73 Margin area 74 Margin area 75 Written area 76 Written area 80 Check mark (area designation instruction)
82 Right opening parenthesis mark (first range specification instruction, range specification instruction, area specification instruction)
83 Opening parenthesis mark (second range specification instruction, range specification instruction, area specification instruction)
401 CPU (calculation means)
405 Operation unit (operation means)
406 Display section (display means)
407 Communication control unit (communication means)
710 Partial margin area (corresponding to the first partial margin area)
730 Partial margin area (corresponding to the second partial margin area)
750 Partial writing region 760 Partial writing region SL Horizontal separation line (first region separation line, region separation line)
LL Vertical separation line (second region separation line, region separation line)

Claims (6)

Operating means, display means, arithmetic means, and the stroke data including a plurality of position information of the writing instrument with the movement of the writing instrument with respect to the writing medium having an inner writing area of the margin area and the margin area of the outer peripheral portion Communication means capable of transmitting and receiving information to and from the electronic writing device, for the operation means of the operating terminal,
Trajectory data acquisition procedure for receiving and acquiring the stroke data transmitted from the electronic writing device via the communication means ;
An area classification identification procedure for identifying an area classification instruction related to an area classification of a character recognition area and a graphic recognition area drawn in at least the margin area of the stroke data acquired in the trajectory data acquisition procedure;
Based on the identification result in the area classification identification procedure, among the writing areas, an area setting procedure for setting the character recognition area and the graphic recognition area, respectively.
Based on the setting result in the area setting procedure, the stroke data drawn in the character recognition area is character-recognized into text data, and the stroke data drawn in the figure recognition area is image-recognized. Data conversion procedure to convert to data,
A writing processing program for execution,
The margin area is
Provided on one side and the other side of the short side direction of the writing medium,
The region classification identification procedure includes:
A separation line that detects at least one region separation line that starts from the margin region on the one side and traverses the writing region in the lateral direction of the writing medium and ends the margin region on the other side Detection procedure;
An area designation detection procedure for detecting an area designation instruction drawn in at least one of a plurality of partial margin areas included in the margin area and divided by the area separation line detected by the separation line detection procedure When,
Writing processing program characterized <br/> contain. Stroke data including a plurality of position information of the writing tool associated with the movement of the writing tool with respect to the writing medium provided with an operating means, a display means, a computing means, and a margin area on the outer periphery and a writing area inside the margin area. Communication means capable of transmitting / receiving information to / from the electronic writing device to transmit, for the calculation means of the operation terminal,
Trajectory data acquisition procedure for receiving and acquiring the stroke data transmitted from the electronic writing device via the communication means;
An area classification identification procedure for identifying an area classification instruction related to an area classification of a character recognition area and a graphic recognition area drawn in at least the margin area of the stroke data acquired in the trajectory data acquisition procedure;
Based on the identification result in the area classification identification procedure, among the writing areas, an area setting procedure for setting the character recognition area and the graphic recognition area, respectively.
Based on the setting result in the area setting procedure, the stroke data drawn in the character recognition area is character-recognized into text data, and the stroke data drawn in the figure recognition area is image-recognized. Data conversion procedure to convert to data,
A writing processing program for executing
The region classification identification procedure includes:
A separation line detection procedure for detecting at least one region separation line that vertically traverses the writing area in the longitudinal direction of the writing medium, or crosses the writing area in the short direction of the writing medium;
An area designation detection procedure for detecting an area designation instruction drawn in at least one of a plurality of partial margin areas included in the margin area and divided by the area separation line detected by the separation line detection procedure When,
Including
In the region setting procedure,
Among the plurality of partial writing areas included in the writing area and divided by the area separation line, the graphic recognition area is set in an area corresponding to the area designation instruction drawn in the partial margin area, and the rest Set as the character recognition area, or set the character recognition area in the area corresponding to the area designation instruction drawn in the partial margin area and set the other as the graphic recognition area
A writing processing program characterized by that. In the writing processing program according to claim 2 ,
In the separation line detection procedure,
Detecting at least one first region separation line that crosses the writing region in the short direction and at least one second region separation line that longitudinally cuts the writing region in the longitudinal direction;
In the region designation detection procedure,
In the margin region, the region designation instruction drawn in at least one of the plurality of first partial margin regions divided by the first region separation line and a plurality of regions divided by the second region separation line Detecting the region designation instruction described in at least one of the second partial margin regions;
In the region setting procedure,
The area designation instruction drawn in the first and second partial margin areas among the plurality of partial writing areas included in the writing area and divided by the first area separation line and the second area separation line The graphic recognition area is set in the area corresponding to, and the other is set as the character recognition area, or the character is set in the area corresponding to the area designation instruction drawn in the first and second partial margin areas. A writing processing program, characterized in that a recognition area is set and the others are set in the figure recognition area. Stroke data including a plurality of position information of the writing tool associated with the movement of the writing tool with respect to the writing medium provided with an operating means, a display means, a computing means, and a margin area on the outer periphery and a writing area inside the margin area. Communication means capable of transmitting / receiving information to / from the electronic writing device to transmit, for the calculation means of the operation terminal,
Trajectory data acquisition procedure for receiving and acquiring the stroke data transmitted from the electronic writing device via the communication means;
An area classification identification procedure for identifying an area classification instruction related to an area classification of a character recognition area and a graphic recognition area drawn in at least the margin area of the stroke data acquired in the trajectory data acquisition procedure;
Based on the identification result in the area classification identification procedure, among the writing areas, an area setting procedure for setting the character recognition area and the graphic recognition area, respectively.
Based on the setting result in the area setting procedure, the stroke data drawn in the character recognition area is character-recognized into text data, and the stroke data drawn in the figure recognition area is image-recognized. Data conversion procedure to convert to data,
A writing processing program for executing
In the region classification identification procedure,
A range in the longitudinal direction of the writing medium is specified in the margin area on at least one side in the short direction of the writing medium, or the margin area on at least one side in the longitudinal direction of the writing medium Identify at least one range designation instruction that designates a range in the short direction of the writing medium,
In the region setting procedure,
Among the writing areas, the figure recognition area is set in an area corresponding to the range designation instruction drawn in the margin area, and the other is set as the character recognition area, or is drawn in the margin area A writing processing program, wherein the character recognition area is set in an area corresponding to the range designation instruction, and the rest is set in the graphic recognition area. Stroke data including a plurality of position information of the writing tool associated with the movement of the writing tool with respect to the writing medium provided with an operating means, a display means, a computing means, and a margin area on the outer periphery and a writing area inside the margin area. Communication means capable of transmitting / receiving information to / from the electronic writing device to transmit, for the calculation means of the operation terminal,
Trajectory data acquisition procedure for receiving and acquiring the stroke data transmitted from the electronic writing device via the communication means;
An area classification identification procedure for identifying an area classification instruction related to an area classification of a character recognition area and a graphic recognition area drawn in at least the margin area of the stroke data acquired in the trajectory data acquisition procedure;
Based on the identification result in the area classification identification procedure, among the writing areas, an area setting procedure for setting the character recognition area and the graphic recognition area, respectively.
Based on the setting result in the area setting procedure, the stroke data drawn in the character recognition area is character-recognized into text data, and the stroke data drawn in the figure recognition area is image-recognized. Data conversion procedure to convert to data,
A writing processing program for executing
In the region classification identification procedure,
A first range designation instruction for designating a range in the longitudinal direction of the writing medium in the margin area on at least one side in the short direction of the writing medium; and the at least one side in the longitudinal direction of the writing medium. A second range designation instruction for designating a range in a short direction of the writing medium in a margin area;
In the region setting procedure,
Among the writing areas, the graphic recognition area is set in an overlapping area between an area corresponding to the range designated by the first range designation instruction and an area corresponding to the range designated by the second range designation instruction. Is set as the character recognition area, or the character recognition area is set as the overlap area and the other is set as the graphic recognition area. Stroke data generating means for generating stroke data including a plurality of positional information of the writing tool in accordance with movement of the writing tool with respect to a writing medium provided with a margin area on the outer periphery and a writing area inside the margin area;
An area classification identifying means for identifying an area classification instruction relating to an area classification of a character recognition area and a graphic recognition area drawn in at least the margin area of the stroke data generated by the stroke data generation means;
Based on the identification result by the area classification identifying means, area setting means for setting the character recognition area and the graphic recognition area respectively in the writing area;
Based on the setting result of the area setting means, the stroke data drawn in the character recognition area is character-recognized and converted into text data, and the stroke data drawn in the figure recognition area is image-recognized to obtain image data. Data conversion means,
I have a,
The margin area is
Provided on one side and the other side of the short side direction of the writing medium,
The region segment identification means includes
A separation line that detects at least one region separation line that starts from the margin region on the one side and traverses the writing region in the lateral direction of the writing medium and ends the margin region on the other side Detection means;
Area designation detection means for detecting an area designation instruction drawn in at least one of a plurality of partial margin areas included in the margin area and divided by the area separation line detected by the separation line detection means When,
Electronic writing device according to claim <br/> contain.

Images