JP2015215823A - Writing data processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a writing data processor capable of outputting writing data according to arrangement which is used during writing.SOLUTION: A CPU of a writing data processor acquires first coordinate data which indicates position information of a writing instrument which is adjacent to a reading device, executes handwritten character recognition processing to a first stroke data file including the first coordinate data as a recognition object, and acquires a first recognition result R1. The CPU converts the first coordinate data into second coordinate data (S52). The CPU executes handwritten character recognition processing to a second stroke data file including the second coordinate data as a recognition object (S55), and calculates a second recognition result R2 (S56). The CUP selects one of the first stroke data file and the second stroke data file on the basis of the first recognition result R1 and the second recognition result R2, and creates output information, according to the selected stroke data file (S61).

Description

  The present invention relates to a writing data processing apparatus that digitizes a movement trajectory of a writing instrument based on an operation of writing on a paper medium.

  2. Description of the Related Art Conventionally, there is known a writing data processing apparatus that can digitize a movement locus of a writing instrument as a handwriting based on the operation of the writing instrument when writing on a paper medium placed on a pedestal. Patent Document 1 specifies a plurality of coordinate data indicating the position of a pen tip when written with a pen in a free input area of a paper medium, and graphic data indicating a handwriting based on the plurality of specified coordinate data A writing data processing apparatus for creating

JP 2005-301860 A

  The paper medium may be standardized into a rectangle of a predetermined size having a short side and a long side. In addition, the paper medium can be written by a user, such as graph paper or plain paper without a ruled line, with the rectangular short side facing up and arranged vertically or with the long side facing up. There is something. When a paper medium that can be either vertically long or horizontally long is used as described above, the user may use the writing data processing apparatus in a vertically long position or in a horizontally long position. The handwritten data processing device described in Patent Document 1 cannot determine whether the writing data processing apparatus is used in a vertically long arrangement or a horizontally long arrangement. Therefore, there is a possibility that writing data corresponding to the arrangement is not created.

  An object of this invention is to provide the writing data processing apparatus which can output the writing data according to the arrangement | positioning used at the time of writing.

  The writing data processing device of the present invention is a writing data processing device that recognizes a handwritten character based on information indicating a handwritten character string represented by a plurality of coordinate data electronically input via a detection device. Acquires a plurality of first coordinate data indicating a plurality of position information of a writing instrument close to any position of a detection area on which a paper medium is placed in a detection device as coordinate data based on a predetermined first coordinate system Converting means for converting the plurality of first coordinate data acquired by the acquiring means into a plurality of second coordinate data based on a second coordinate system different from the first coordinate system; Recognizing a plurality of handwritten characters by using each of the plurality of first coordinate data acquired by the acquisition unit and the plurality of second coordinate data converted by the conversion unit as recognition targets A character recognition unit that executes a handwritten character recognition process, a first recognition result corresponding to the plurality of first coordinate data and the plurality of the plurality of first coordinate data based on a result of the handwritten character recognition process performed by the character recognition unit Based on the first recognition result and the second recognition result calculated by the calculation means for calculating the second recognition result corresponding to the second coordinate data, the plurality of first coordinate data or the Selection means for selecting a plurality of second coordinate data, and output information capable of displaying a line drawing based on the coordinate data according to the plurality of first coordinate data or the plurality of second coordinate data selected by the selection means Creating means for generating the output information, and output control means for outputting the output information created by the creating means.

  The writing data processing apparatus according to the present invention acquires a plurality of first coordinate data based on the first coordinate system. Also, the plurality of first coordinate data is converted into a plurality of second coordinate data with the second coordinate system as a reference. Handwritten character recognition processing is executed for each of the plurality of first coordinate data and the plurality of second coordinate data. Based on the first recognition result and the second recognition result obtained by the handwriting recognition process, the selection unit selects a plurality of first coordinate data or a plurality of second coordinate data. The output control means controls output of the output information created according to the selected first coordinate data or second coordinate data. Therefore, the writing data processing device according to the present invention outputs information corresponding to an input criterion with respect to information indicating a handwritten character string input to the detection device based on either the first coordinate system or the second coordinate system. Information can be automatically created and output.

It is a figure which shows the outline | summary of the handwriting input system. 3 is a block diagram showing an electrical configuration of a reading device 2, a smartphone 19, and a server 8. FIG. FIG. 6 is a diagram illustrating a sheet 123 mounted on a reading device 2. FIG. 6 is a diagram illustrating a sheet 123 mounted on a reading device 2. It is a flowchart of a 1st main process. It is a flowchart of the 2nd main process. It is a flowchart of the 2nd main process. It is explanatory drawing for demonstrating conversion from 1st coordinate data to 2nd coordinate data.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The outline of the handwriting input system 1 according to the present embodiment will be described with reference to FIG. In the following description, the upper left side, lower right side, upper side, lower side, upper right side, and lower left side in FIG. 1 are respectively defined as the left side, right side, front side, rear side, upper side, and lower side of the reader 2. explain.

  As shown in FIG. 1, the handwriting input system 1 mainly includes a reading device 2, an electronic pen 3, and a smartphone 19. The reading device 2 is a thin and light handwriting input device. In the handwriting input system 1, the user writes a dot or a line drawing on the paper 111 of the paper medium 100 attached to the reading device 2 using the electronic pen 3. Below, the case where a line drawing is written is demonstrated. The line drawing includes characters, numerical values, symbols, figures, and the like. The reading device 2 acquires the position of the electronic pen 3 in the writing process. The reading device 2 creates a stroke data file based on the acquired position. The reading device 2 can transmit the created stroke data file to the smartphone 19. When the smartphone 19 receives the stroke data file, the smartphone 19 displays an image corresponding to the received stroke data file on the display 192. Thus, the user can visually recognize a line drawing having the same shape as the line drawing written on the paper 111 with the electronic pen 3 via the display 192. The smartphone 19 can be connected to the server 8 illustrated in FIG. 2 via wireless or wired communication, and can transmit various data including image data to the server 8.

  The reading device 2 has a rectangular thin plate shape. The reading device 2 includes three LEDs 5 at the upper end. The LED 5 can notify the user of the state of the reading device 2. A paper medium 100 is detachably mounted on the front surface of the reading device 2. The paper medium 100 has a booklet shape in which a plurality of sheets 111 are bound at the upper edge. An example of the paper medium 100 that can be loaded into the reading device 2 is A5 size report paper. The format indicating the layout or the like of symbols preprinted on the paper 111 is different for each type of the paper medium 100. The paper medium 100 is mounted on the reading device 2 so as to be placed on the front surface of the reading device 2. In the present embodiment, the paper medium 100 is mounted in a state where the paper medium 100 is positioned on the reading device 2 by a double-sided tape, an adhesive resin film, or the like. The user can write a line drawing on the paper 111 of the paper medium 100 using the electronic pen 3.

  The electronic pen 3 is a known electromagnetic induction electronic pen, and mainly includes a cylindrical body 30, a core body 31, a coil 32, capacitors 33 and 35, a substrate 34, and an ink storage unit 36. The cylindrical body 30 has a cylindrical shape, and accommodates a part of the core body 31, the coil 32, the capacitors 33 and 35, the substrate 34, and the ink storage portion 36 therein. The core body 31 is provided at the tip of the electronic pen 3. The core body 31 is urged toward the distal end side of the electronic pen 3 by an elastic member (not shown). The distal end portion of the core body 31 protrudes outside the cylindrical body 30. The rear end side of the core 31 is connected to an ink storage portion 36 that stores ink. The ink storage unit 36 supplies ink to the core body 31. When the user writes on the paper 111 using the electronic pen 3, a line drawing is formed on the paper 111 with ink.

  The coil 32 is held between the core body 31 and the capacitor 33 while being wound around the ink storage portion 36. The capacitor 33 is fixed inside the electronic pen 3 by the substrate 34. A capacitor 35 is mounted on the substrate 34. The capacitors 33 and 35 are connected in parallel to the coil 32 and constitute a known resonance (tuning) circuit.

  The smartphone 19 includes a touch panel 191 and a display 192. The touch panel 191 is used for inputting various instructions. The display 192 can display an image corresponding to the image file. A general-purpose PC or a tablet PC may be used instead of the smartphone 19.

  The electrical configuration of the handwriting input system 1 will be described with reference to FIG. First, the electrical configuration of the reading device 2 and the outline of the principle by which the reading device 2 detects coordinate data will be described. The reading device 2 includes a sensor board 7, a main board 20, a sensor control board 28, an input unit 25, and three LEDs 5. The sensor substrate 7 is provided in the reading device 2. The input unit 25 and the three LEDs 5 are provided in the reading device 2.

  The main board 20 includes a CPU 21, a RAM 22, a flash ROM 23, and a wireless communication unit 24. The RAM 22, the flash ROM 23, and the wireless communication unit 24 are electrically connected to the CPU 21. The CPU 21 controls the reading device 2. The RAM 22 temporarily stores various data such as calculation data. The flash ROM 23 stores a first main program that the CPU 21 executes to control the reading device 2. The flash ROM 23 stores a plurality of layout data for each format of the paper 111. The wireless communication unit 24 is a controller for executing short-range wireless communication with an external electronic device. The input unit 25 and the three LEDs 5 are electrically connected to the CPU 21. The input unit 25 is a switch for inputting an instruction to the reading device 2. The colors of the three LEDs 5 are yellow, green, and red.

  A large number of elongated loop coils are arranged on the sensor substrate 7 in each of the vertical direction and the horizontal direction. The sensor board 7 is electrically connected to the ASIC 28A of the sensor control board 28. The ASIC 28 </ b> A detects coordinate data indicating the position of the electronic pen 3 when a writing operation by the electronic pen 3 is performed on the sensor substrate 7. The ASIC 28A is connected to the CPU 21.

  The principle by which coordinate data is detected when a writing operation with the electronic pen 3 is performed on the sensor substrate 7 will be schematically described. The CPU 21 controls the ASIC 28 </ b> A to flow a specific frequency current (excitation current) through the loop coil of the sensor substrate 7 one by one. As a result, a magnetic field is generated from the loop coil of the sensor substrate 7. In this state, for example, when the user performs an operation of writing a line drawing on the paper 111 of the paper medium 100 attached to the reading device 2 using the electronic pen 3, the electronic pen 3 comes close to the sensor substrate 7. Therefore, the resonance circuit of the electronic pen 3 resonates by electromagnetic induction and generates an induction magnetic field.

  Next, the CPU 21 controls the ASIC 28 </ b> A to stop the generation of the magnetic field from the loop coil of the sensor substrate 7. The loop coil of the sensor substrate 7 receives an induced magnetic field generated from the resonance circuit of the electronic pen 3. The CPU 21 controls the ASIC 28A to detect a signal current (received current) flowing through the loop coil of the sensor substrate 7L. The ASIC 28A executes this operation one by one for all the loop coils and detects the received current, whereby coordinate data indicating the position of the electronic pen 3 is detected.

  In a state in which an operation of writing a line drawing on the paper 111 using the electronic pen 3 is performed, writing pressure is applied to the core 31. The inductance of the coil 32 changes according to the writing pressure applied to the core body 31. Accordingly, the resonance frequency of the resonance circuit of the electronic pen 3 changes according to the writing pressure applied to the core body 31. The CPU 21 detects a change in the resonance frequency (phase change) and specifies the writing pressure applied to the electronic pen 3. That is, the CPU 21 can determine whether or not a line drawing is written on the paper 111 of the paper medium 100 with the specified writing pressure.

  Next, the electrical configuration of the smartphone 19 will be described. The smartphone 19 mainly includes a CPU 41, a RAM 42, a flash ROM 43, a wireless communication unit 44, an input circuit 45, an output circuit 46, a touch panel 191, and a display 192. The CPU 41 controls the smartphone 19. The CPU 41 is electrically connected to the RAM 42, the flash ROM 43, the wireless communication unit 44, the input circuit 45, and the output circuit 46.

  The RAM 42 stores various temporary data. The wireless communication unit 44 is a controller for executing short-range wireless communication with an external electronic device. The input circuit 45 performs control to send an instruction from the touch panel 191 to the CPU 41. The output circuit 46 performs control for displaying an image on the display 192 in accordance with an instruction from the CPU 41. The flash ROM 43 stores a second main program executed by the CPU 41 and the like. The smartphone 19 includes a medium reading device (for example, a memory card slot) (not shown). The smartphone 19 can read a program stored in a storage medium (for example, a memory card) with a medium reader and install it in the flash ROM 43. Further, the program may be received from an external device (not shown) connected to the smartphone 19 or a network and installed in the flash ROM 43.

  Next, the electrical configuration of the server 8 will be described. The server 8 may be a general-purpose server. The server 8 includes a CPU 81 that controls the server 8. The CPU 81 is electrically connected to the ROM 82, RAM 83, HDD 84, and communication unit 85. The ROM 82 is a read-only storage device that stores programs such as BIOS executed by the CPU 81. The RAM 83 is a readable / writable storage device that temporarily stores data. The HDD 84 is a storage device in which an OS, a program, and the like are installed. The communication unit 86 is a controller for executing wired communication or wireless communication with an external electronic device. Although not shown, the server 8 is also connected to input devices such as a mouse and a keyboard.

  With reference to FIG. 3, a sheet 123 that is an example of the sheet 111 of the paper medium 100 will be described. The left side, right side, upper side, and lower side of FIG. 3 are defined as the left side, right side, upper side, and lower side of the sheet 111, respectively. FIG. 3 shows a sheet of paper 123 for one page of the paper medium 100.

  As shown in FIG. 3, the paper 123 is a memo paper for writing a memo. The sheet 123 has an entry area 123A and a check box 123B. In the entry area 123A, grid ruled lines that are a combination of a plurality of ruled lines extending in the left-right direction and a plurality of ruled lines extending in the up-down direction are printed. The entry area 123A is an area for the user to write a memo. The check box 123B is printed at the lower right of the entry area 123A. The shape of the check box 123B is a rectangular single line. The check box 123B indicates an area where the user writes a line drawing in order to confirm the line drawing written in the entry area 123A.

  An outline of processing when the CPU 21 of the reading device 2 creates a stroke data file based on the line drawing written on the paper 123 will be described. While the writing pressure is applied to the electronic pen 3, the CPU 21 of the reading device 2 repeatedly acquires coordinate data indicating the position of the electronic pen 3 through the ASIC 28A at a constant period. The CPU 21 associates time data indicating the time at which the coordinate data is acquired with each of the acquired plurality of coordinate data, and stores them in the first area of the RAM 22. The plurality of coordinate data and the plurality of time data stored in the first area of the RAM 22 at the time when the application of the writing pressure to the electronic pen 3 is completed is one of the line drawings written on the paper 123 by the electronic pen 3. Indicates the position of the line segment. Hereinafter, a plurality of coordinate data indicating the position of one line segment and a plurality of time data associated with each of the plurality of coordinate data are collectively referred to as line segment data. Hereinafter, the paper 123 will be described as an example.

  Based on the line segment data stored in the first area of the RAM 22, the CPU 21 determines which of the entry area 123 </ b> A and the check box 123 </ b> B of the sheet 123 has the line drawing written. When the CPU 21 determines that the line drawing has been written in the entry area 123A, the CPU 21 stores the line segment data stored in the first area of the RAM 22 in the second area of the RAM 22 and clears the first area of the RAM 22. Each time the user writes one line segment in the entry area 123 </ b> A using the electronic pen 3, the line segment data is sequentially stored in the second area of the RAM 22.

  When the CPU 21 determines that a line drawing has been written in the check box 123B, the CPU 21 creates a stroke data file including at least one line segment data stored in the second area of the RAM 22. The stroke data file includes at least one line segment data acquired after a line drawing is written in the check box 123B until a line drawing is next written in the check box 123B. The CPU 21 stores the created stroke data file in the flash ROM 23.

  An outline of processing when the CPU 41 of the smartphone 19 acquires a stroke data file from the reading device 2 and creates an image file will be described. The CPU 41 of the smartphone 19 transmits a data request command (described later) for requesting transmission of a stroke data file to the reading device 2. When the CPU 21 of the reading device 2 receives a data request command from the smartphone 19, the CPU 21 transmits the stroke data file stored in the flash ROM 23 to the smartphone 19. The CPU 41 of the smartphone 19 receives the stroke data file transmitted from the reading device 2 and stores it in the RAM 42.

  The CPU 41 extracts at least one line segment data included in the stroke data file stored in the RAM 42 one by one. The CPU 41 connects the plurality of positions indicated by the plurality of coordinate data corresponding to the extracted line segment data with straight lines in the order of the times indicated by the associated plurality of time data. The CPU 41 combines the line segments obtained one by one for each line segment data, and identifies it as a line drawing. The CPU 41 creates an image file of an image including only the vicinity of the specified line drawing. The image file is a data file indicating a line drawing as a digital image. Examples of digital images include vector images and raster images. Examples of the image file include a JPEG file, a GIF file, a PNG file, and a BMP file. The CPU 41 displays an image on the display 192 based on the created image file.

  Further, the CPU 41 executes handwritten character recognition processing for recognizing a plurality of handwritten characters using the stroke data file stored in the RAM 42 as a recognition target. A well-known method can be adopted for the handwritten character recognition process. For example, it is possible to use a structure analysis method that performs identification by paying attention to the positional relationship and connection relationship of line segment data extracted from the stroke data file, the locus (stroke order) of the line segment data, and the like. Further, a pattern matching method for comparing a stroke data file and a model image called a template can be used. The handwritten character recognition process may employ a part of the methods including these examples, or may combine a plurality of methods including other methods. In addition, for a plurality of character candidates recognized by handwritten character recognition processing, context processing that optimizes a character string that is a recognition result in consideration of certainty as a language such as a connection relationship (context) between character information May also be performed. In this case, since the most probable character candidate is selected in consideration of the whole sentence of the handwritten character string, the accuracy of the recognition result can be improved.

  With reference to FIG. 3 and FIG. 4, a description will be given with a specific example in which a user writes a handwritten character string (hereinafter referred to as a handwritten character string) using the reading device 2. The sheet 123 of this embodiment is a graph paper of a predetermined size having a short side and a long side, and the user enters a handwritten character string on the sheet 123 regardless of whether the sheet 123 is used in a portrait or landscape direction. Can do. As shown in FIG. 3, the handwritten character string “I wrote the text with the paper vertically long” in the entry area 123 </ b> A of the paper 123 attached to the reading device 2 (see the dotted frame 124). Suppose that it was written. An example in which the user writes the handwritten character string indicated by the dotted frame 124 on the paper 123 with the paper 123 on the reading device 2 in a state where the short side is arranged on the upper side (hereinafter referred to as a vertically long arrangement). is there. In this case, the CPU 21 of the reading device 2 stores the created stroke data file in the flash ROM 23. The stroke data file created by the reading device 2 is a first coordinate system (x1-y1 coordinate system) (x1-y1 coordinate system) in which the horizontal axis is the x1 coordinate and the vertical axis is the y1 coordinate when the paper 123 is arranged vertically. 3)) as a reference. The origin P1 of the first coordinate system is the upper left position of the reading device 2. A stroke data file including a plurality of first coordinate data is defined as a first stroke data file. Further, the CPU 41 of the smartphone 19 receives the first stroke data file transmitted from the reading device 2 and stores it in the RAM 42. CPU41 performs a handwritten character recognition process by making the 1st stroke data file shown by the 1st coordinate data based on the handwritten character string shown in the dotted line frame 124 into recognition object.

  Next, the CPU 41 converts the first coordinate data included in the first stroke data file into second coordinate data based on the second coordinate system (x2-y2 coordinate system) (see FIG. 3). The second coordinate system is a coordinate system in which the horizontal axis is x2 coordinate and the vertical axis is y2 coordinate when P2 is the origin in the case where the paper 123 is arranged horizontally. The landscape orientation means a state in which the paper 123 on the reading device 2 is arranged with the long side on the upper side. And CPU41 performs a handwritten character recognition process by making the 2nd stroke data file shown by the 2nd coordinate data based on the handwritten character string shown in the dotted line frame 124 into recognition object. The CPU 41 outputs information corresponding to either the first coordinate data or the second coordinate data based on the recognition result when the first coordinate system is used as a reference and the recognition result when the second coordinate system is used as a reference. Create In the case of FIG. 3, the recognition result based on the first coordinate system has a higher character recognition rate than the recognition result based on the second coordinate system. In this case, the CPU 41 creates output information that can display a line drawing based on the first coordinate data in the first coordinate system.

  On the other hand, as shown in FIG. 4, the handwritten character string “I wrote the sentence with the paper horizontally long” in the entry area 123 </ b> A of the paper 123 attached to the reading device 2 (see the dotted line frame 125). ) Is written. This is an example in which the user writes the handwritten character string indicated by the dotted frame 125 on the sheet 123 in a horizontally long layout on the sheet 123 on the reading device 2. In this case, the CPU 41 of the smartphone 19 has the first stroke data indicated by the first coordinate data based on the handwritten character string shown in the dotted line frame 125 based on the first coordinate system (x1-y1 coordinate system) (see FIG. 4). The handwritten character recognition process is executed with the file as a recognition target. Next, the CPU 41 converts the first coordinate data included in the first stroke data file into second coordinate data based on the second coordinate system (x2-y2 coordinate system) (see FIG. 4). And CPU41 of the smart phone 19 performs a handwritten character recognition process by making the 2nd stroke data file shown by the 2nd coordinate data based on the handwritten character string shown in the dotted line frame 125 into recognition object. The CPU 41 outputs information corresponding to either the first coordinate data or the second coordinate data based on the recognition result when the first coordinate system is used as a reference and the recognition result when the second coordinate system is used as a reference. Create In the case of FIG. 4, the recognition result based on the second coordinate system has a higher character recognition rate than the recognition result based on the first coordinate system. In this case, the CPU 41 creates output information that can display a line drawing based on the second coordinate data in the second coordinate system. In this way, the smartphone 19 can output data for displaying a line drawing corresponding to the arrangement of the paper 123 used at the time of writing. Details will be described below.

  The first main process executed by the CPU 21 of the reading device 2 will be described with reference to FIG. The CPU 21 starts the first main process by operating based on a program stored in the flash ROM 23 when the power of the reading device 2 is turned on.

  First, the CPU 21 executes the following initialization process (S10). The CPU 21 clears the data stored in the RAM 22. The CPU 21 starts control of the ASIC 28A. As a result, the CPU 21 can determine whether or not a line drawing is written on the paper 111 of the paper medium 100 attached to the reading device 2 using the electronic pen 3. In addition, when the CPU 21 determines that the line drawing is being written using the electronic pen 3, the CPU 21 can acquire the first coordinate data indicating the position of the electronic pen 3 in the first coordinate system.

  The CPU 21 specifies the format of the paper 111 of the paper medium 100 mounted on the reading device 2 by a known method (S11). Hereinafter, the case where the sheet 123 (see FIG. 3) is loaded in the reading device 2 and the format of the sheet 123 is specified will be described as an example. The CPU 21 is information corresponding to the specified format, and is based on data (hereinafter referred to as layout data) that can specify the positions of the entry area 123A and the check box 123B of the paper 123. Is identified, that is, the area corresponding to the check box 123B in the front surface of the reading device 2. Hereinafter, the area on the front surface of the reading device 2 corresponding to the rectangular area constituting the check box 123B is referred to as a check area.

  The CPU 21 determines whether a line drawing is written on the paper 123 based on the writing pressure applied to the electronic pen 3 (S17). When the CPU 21 determines that the line drawing is written on the paper 123 (S17: YES), the CPU 21 acquires the first coordinate data. The CPU 21 further acquires time data indicating the time when the acquired first coordinate data is detected (S24). The CPU 21 associates the acquired first coordinate data and time data and stores them in the first area of the RAM 22 (S24). The CPU 21 repeats the process of storing the acquired first coordinate data and time data in the first area of the RAM 22 until the writing of one line segment by the electronic pen 3 is completed. When writing of the line segment by the electronic pen 3 is completed, a plurality of first coordinate data and a plurality of time data corresponding to one line segment are stored in the first area of the RAM 22 as line segment data.

  The CPU 21 determines whether or not a line drawing has been written in the check box 123B based on at least one line segment data stored in the first area of the RAM 22 in S24 (S25). Specifically, the CPU 21 determines that a line drawing has been written in the check box 123B when at least one of the plurality of first coordinate data of the acquired at least one line segment data indicates a position in the check area. (S25: YES). On the other hand, when all of the plurality of first coordinate data indicate positions outside the check area, the CPU 21 determines that no line drawing is written in the check box 123B (S25: NO).

  If the CPU 21 determines that a line drawing is not written in the check box 123B (S25: NO), it determines that a line drawing is written in the entry area 123A. The CPU 21 stores at least one line segment data stored in the first area of the RAM 22 by the process of S24 in the second area of the RAM 22 (S29). The CPU 21 deletes at least one line segment data stored in the second area of the RAM 22 from the first area of the RAM 22 (S30). CPU21 returns a process to S17.

  On the other hand, if the CPU 21 determines that a line drawing has been written in the check box 123B (S25: YES), the CPU 21 creates a first stroke data file including at least one line segment data stored in the second area of the RAM 22 (S27). ). The CPU 21 stores the created first stroke data file in the flash ROM 23 (S27). The CPU 21 deletes at least one line segment data included in the created first stroke data file from the second area of the RAM 22 (S28). CPU21 returns a process to S17.

  When the CPU 21 determines in the process of S17 that the line drawing is not written on the sheet 123 (S17: NO), the CPU 21 receives the data request command wirelessly transmitted from the smartphone 19 via the wireless communication unit 24. It is determined whether or not (S19). When determining that the data request command has not been received (S19: NO), the CPU 21 returns the process to S17. When the CPU 21 determines that the data request command has been received (S19: YES), the first stroke data file stored in the flash ROM 23 by the process of S27 is wirelessly transmitted to the smartphone 19 via the wireless communication unit 24 (S21). ). The CPU 21 deletes the first stroke data file transmitted to the smartphone 19 from the flash ROM 23 (S22). CPU21 returns a process to S17.

  The CPU 21 functions as an example of a processor that executes the first main process by developing a program stored in the flash ROM 23 on the RAM 22. Instead of the CPU 21, a microcomputer, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or the like may be used as a processor. The first main process may be distributed by a plurality of electronic devices (that is, a plurality of CPUs). For example, a part of the first main process may be executed by the CPU 41 of the smartphone 19.

  With reference to FIG. 6 and FIG. 7, the 2nd main process performed by CPU41 of the smart phone 19 is demonstrated. The CPU 41 starts the second main process by operating based on a program stored in the flash ROM 43 when an application activation operation for wireless connection with the reading device 2 is performed via the touch panel 191. .

  First, the CPU 41 executes the following initialization process (S41). The CPU 41 clears the data stored in the RAM 42. The CPU 41 transmits and receives an ID and the like to and from the reading device 2 in order to start wireless communication with the reading device 2. Next, the CPU 41 causes the display 192 to display a button for requesting acquisition of the first stroke data file stored in the reading device 2 used by the user via the touch panel 191. The CPU 41 monitors input operations detected via the touch panel 191.

  If the CPU 41 determines that an operation for selecting the above button has been detected (S42: YES), the CPU 41 acquires the first stroke data file from the reading device 2 as follows. The CPU 41 wirelessly transmits a data request command for requesting acquisition of the first stroke data file to the reading device 2 via the wireless communication unit 44 (S43). The CPU 41 receives the first stroke data file wirelessly transmitted from the reading device 2 in response to the transmitted data request command via the wireless communication unit 44 (S44). The CPU 41 stores the received first stroke data file in the RAM 42 (S45).

  Next, the CPU 41 executes handwritten character recognition processing using the first stroke data file as a recognition target (S46). The CPU 41 calculates a first recognition result R1 recognized by performing handwritten character recognition processing on the first stroke data file (S47). Various methods can be employed to calculate the first recognition result R1. In this embodiment, the character recognition rate in the whole handwritten character string based on the first stroke data file is calculated as the first recognition result R1. The character recognition rate is a numerical value representing the reliability indicating the certainty of the character recognition result, and is represented by a numerical value of 0 to 100 in this embodiment. The maximum value (100) of the character recognition rate is when it is determined that the character is clearly recognized correctly. The minimum value (0) of the character recognition rate is when it is determined that the character cannot be recognized as a character. CPU41 performs the cut-out process which cuts out one character at a time from the handwritten character string based on a 1st stroke data file as pre-processing of character recognition. The CPU 41 calculates a character recognition rate for each character cut out by the cut-out process. The CPU 41 averages the calculated character recognition rate values, and calculates the character recognition rate in the entire handwritten character string based on the first stroke data file as the first recognition result R1. The CPU 41 stores the first recognition result R1 calculated in S47 in the RAM 42 (S48). CPU41 transfers a process to S51 (refer FIG. 7).

  As shown in FIG. 7, the CPU 41 acquires a plurality of first coordinate data included in the first stroke data file stored in the RAM 42 (S51). The CPU 41 converts the first coordinate data acquired by the process of S51 into second coordinate data based on the second coordinate system (S52). The CPU 41 creates a second stroke data file including the converted second coordinate data (S53). The CPU 41 stores the second stroke data file created by the process of S53 in the RAM 42 (S54).

Here, the conversion of the first coordinate data into the second coordinate data performed by the CPU 41 in S52 will be described with reference to FIG. Both the first coordinate system and the second coordinate system are two-dimensional coordinate systems on the same plane. The second coordinate system is orthogonal to the first coordinate system. Specifically, the second coordinate system is obtained by rotating the first coordinate system 90 degrees counterclockwise around the origin P1 and then changing the origin position to P2 shown in FIG. In this case, when the first coordinate data is (x1, y1) and the second coordinate data is (x2, y2), the first coordinate data and the second coordinate data are set to W as the width of the reading device 2. The relationship is as follows.
(X2, y2) = (y1, W−x1)

A specific example will be described. It is assumed that the line data including the first coordinate data corresponding to the line segment C1 by the start point A1 and the end point B1 is included in the first stroke data file stored by the process of S45 (see FIG. 6). It is assumed that the CPU 41 acquires the first coordinate data A1 (x1, y1) = (10, 20) of the start point A1 in the process of S51 (see FIG. 7). In this case, the CPU 41 inputs A1 (10, 20) to the above relational expression in the conversion process of S52, and calculates the first coordinate data A1 (x2, y2) as follows.
A2 (x2, y2) = (y1, W−x1)
= (20, W-10)

  The CPU 41 converts all the first coordinate data from the start point A1 to the end point B1 included in the line segment data corresponding to the line segment C1 into the second coordinate data from the start point A2 to the end point B2 by the above calculation. . Thereafter, in the process of S53, the CPU 41 creates a second stroke data file corresponding to the line segment C2 with the start point A2 and the end point B2. Note that the above relational expression used for the conversion from the first coordinate data to the second coordinate data in S52 is an example, and the conversion from the first coordinate data to the second coordinate data may be performed by other methods. . Further, in the process of S52, the CPU 41 may calculate the first coordinate system by converting the coordinate data corresponding to the coordinate system rotated 90 degrees clockwise around the origin P1 from the first coordinate data. .

  Returning to the description of FIG. CPU41 performs a handwritten character recognition process by making the 2nd stroke data file memorize | stored by the process of S54 into recognition object (S55). CPU41 calculates the character recognition rate recognized by performing the handwritten character recognition process about the 2nd stroke data file as 2nd recognition result R2 (S56). The CPU 41 stores the second recognition result R2 calculated by the process of S57 in the RAM 42 (S57).

  Next, the CPU 41 determines whether or not the value indicated by the first recognition result R1 stored in the RAM 42 is equal to or greater than the second recognition result R2 (S58). When the value indicated by the first recognition result R1 is equal to or greater than the second recognition result R2 (S58: YES), the CPU 41 selects the first stroke data file stored in the RAM 42 by the process of S45 (see FIG. 6) (S59). ). When the value indicated by the first recognition result R1 is smaller than the second recognition result R2 (S58: NO), the CPU 41 selects the second stroke data file stored in the RAM 42 by the process of S54 (S60).

  The CPU 41 identifies the written character string based on either the first stroke data file or the second stroke data file selected by the process of S59 or the process of S60. The CPU 41 creates an image file of an image indicating the specified character string as output information (S61). The CPU 41 stores the created image file in the flash ROM 43.

  The CPU 41 controls the output of the image file stored in the flash ROM 43 (S62). In the present embodiment, the CPU 41 controls the output circuit 46 to display and output an image file on the display 192 (S62). Further, the CPU 41 can also transmit and output the image file stored in the flash ROM 43 to the server 8 in response to an input operation on the touch panel 191 (S62). Thereafter, the CPU 41 returns the processing to the determination of S42 (see FIG. 6).

  The CPU 41 functions as an example of a processor that executes the second main process by developing a program stored in the flash ROM 43 on the RAM 42. Instead of the CPU 41, a microcomputer, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or the like may be used as a processor. The second main process may be distributed by a plurality of electronic devices (that is, a plurality of CPUs). For example, a part of the second main process may be executed by the CPU 21 of the reading device 2.

  As described above, the CPU 41 of the smartphone 19 acquires a first stroke data file including a plurality of first coordinate data based on the first coordinate system (S44). The CPU 41 acquires a plurality of first coordinate data included in the first stroke data stored in the RAM 42 (S51). The CPU 41 converts the first coordinate data acquired by the process of S51 into second coordinate data based on the second coordinate system (S52). CPU41 performs a handwritten character recognition process by making a 1st stroke data file into recognition object (S46), and calculates 1st recognition result R1 (S47). Further, the CPU 41 executes a handwritten character recognition process using the second stroke data file stored in the process of S54 as a recognition target (S55), and calculates it as a second recognition result R2 (S57). The CPU 41 selects either the first stroke data file or the second stroke data file based on the first recognition result R1 and the second recognition result R2. The CPU 41 creates output information such as an image file based on the selected first stroke data file or second stroke data file (S61), and controls output of the created output information (S62). Therefore, the CPU 41 automatically creates output information corresponding to the input criterion for information indicating the handwritten character string input to the reading device 2 with reference to either the first coordinate system or the second coordinate system. Can be output.

  The information indicating the handwritten character string input to the reading device 2 is based on either the first coordinate system in which the reading device 2 is arranged vertically or the second coordinate system in which the reading device 2 is arranged in a landscape orientation orthogonal to the portrait orientation. Is assumed to be input. The CPU 41 of the smartphone 19 can automatically output output information based on either the first coordinate system or the second coordinate system orthogonal to each other according to the input standard.

  The first recognition result R1 recognized by performing the handwritten character recognition process on the first stroke data file is different from the second recognition result R2 recognized by performing the handwritten character recognition process on the second stroke data file. It is assumed that The CPU 41 of the smartphone 19 can automatically create and output output information corresponding to the input standard based on the character recognition rate represented by the first recognition result R1 and the second recognition result R2.

  CPU41 of the smart phone 19 can memorize | store output information, such as an image file according to an input reference, for example in the server 8 on a network. In addition, the CPU 41 of the smartphone 19 can display output information such as an image file according to the input standard on the display 192.

  In the present embodiment, the reading device 2 is an example of the “detection device” in the present invention. The CPU 41 that performs the process of S44 is an example of the “acquiring unit” in the present invention. The CPU 41 that performs the process of S52 is an example of the “conversion unit” in the present invention. The CPU 41 that performs the processes of S46 and S55 is an example of the “character recognition unit” in the present invention. The CPU 41 that performs the processing of S47 and S56 is an example of the “calculation means” in the present invention. The CPU 41 that performs the processing from S58 to S60 is an example of the “selection unit” in the present invention. The CPU 41 that performs the process of S61 is an example of the “creating unit” in the present invention. The CPU 41 that performs the process of S62 is an example of the “output control means” in the present invention.

  In addition, this invention is not limited to said embodiment, A various change is possible. For example, in the above embodiment, the CPU 41 displays and outputs the image file stored in the flash ROM 43 on the display 192 (S62). The output destination of the image file is not limited to the display 192, and may be a display device, a printer, or the like connected to the output circuit 46 from the outside of the smartphone 19. Further, the handwriting input system 1 does not necessarily include the server 8. The CPU 41 of the smartphone 19 may output output information such as an image file to an external server such as a storage device of a storage service on the cloud.

  In the above embodiment, in the process of S61, an image file of an image showing a character string based on either the first stroke data file or the second stroke data file selected by the process of S59 or S60 is created as output information. Is done. The output information created in the process of S61 is not limited to an image file, but may be information that can display a line drawing based on either the first stroke data file or the second stroke data file. Therefore, for example, the CPU 41 selects one of the first stroke data file and the second stroke data file before the creation of the image file selected by the process of S59 or S60 to the server 8 or the like in the process of S61. You may output as output information. In addition, the CPU 41 may output, for example, data obtained by converting a character recognition result of a handwritten character string obtained by handwritten character recognition processing into a text together with the created output information.

  In the above embodiment, the second coordinate system is obtained by rotating the first coordinate system 90 degrees counterclockwise around the origin P1, and then changing the origin position to P2 shown in FIG. The second coordinate system may be rotated 90 degrees clockwise around any point on the first coordinate system. Further, as the second coordinate system, the coordinates after conversion are both for the coordinate system rotated 90 degrees counterclockwise around the origin P1 and the coordinate system rotated 90 degrees clockwise around the origin P1. Data may be calculated. The angle at the time of conversion is not limited to the above example, and coordinate data after conversion may be calculated for a coordinate system rotated clockwise by 180 degrees. Further, the angle at the time of conversion may be an angle other than these.

1 Handwriting input system 2 Reading device 19 Smartphone 21 CPU
22 RAM
41 CPU
42 RAM
43 ROM

Claims (5)

In a writing data processing device for recognizing handwritten characters based on information indicating a handwritten character string represented by a plurality of coordinate data input electronically via a detection device,
In the detection device, a plurality of first coordinate data indicating a plurality of pieces of position information of a writing instrument close to any position of a detection region on which the paper medium is placed as coordinate data based on a predetermined first coordinate system. Acquisition means for acquiring;
Conversion means for converting the plurality of first coordinate data acquired by the acquisition means into a plurality of second coordinate data based on a second coordinate system different from the first coordinate system;
A handwritten character recognition process for recognizing a plurality of handwritten characters is performed using each of the plurality of first coordinate data acquired by the acquiring unit and the plurality of second coordinate data converted by the converting unit as recognition targets. Character recognition means;
Based on the result of the handwritten character recognition process executed by the character recognition means, a first recognition result corresponding to the plurality of first coordinate data and a second recognition result corresponding to the plurality of second coordinate data are calculated. Calculating means for
Selection means for selecting the plurality of first coordinate data or the plurality of second coordinate data based on the first recognition result and the second recognition result calculated by the calculation means;
Creating means for creating output information capable of displaying a line drawing based on coordinate data in accordance with the plurality of first coordinate data or the plurality of second coordinate data selected by the selection means;
And an output control means for outputting the output information created by the creating means. The first coordinate system is a two-dimensional orthogonal coordinate system;
2. The writing data processing according to claim 1, wherein the second coordinate system is a two-dimensional orthogonal coordinate system that is coplanar with the first coordinate system and orthogonal to the first coordinate system. apparatus. The calculation means is configured to determine the first recognition result and the plurality of second second characters that are character recognition rates corresponding to the plurality of first coordinate data based on the result of the handwritten character recognition processing executed by the character recognition means. Calculating the second recognition result which is a character recognition rate corresponding to the coordinate data;
The selection means selects the plurality of first coordinate data when a recognition result having a higher character recognition rate of the first recognition result and the second recognition result is higher than the second recognition result. The handwritten data processing apparatus according to claim 1, wherein when the second recognition result is higher than the first recognition result, the plurality of second coordinate data are selected.   4. The handwritten data processing apparatus according to claim 1, wherein the output control means stores the output information in a storage means capable of storing information.   5. The writing data processing apparatus according to claim 1, wherein the output control means displays the output information created by the creating means on a display means capable of displaying image data.

Images