JP2007188159A - Processor, program, and form for electronic pen - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a graphic analysis system for elaborating and imaging a graphic entered by freehand on a grid form on which grids are preliminarily printed. <P>SOLUTION: In a graphic analysis system 100, a user enters a graphic on a gird form 3. A server 5 groups strokes included in the entry information acquired from an electronic pen 10 based on time information. Also, the server 5 extracts a segment having predetermined length from the strokes, and extracts vectors in each fixed time from the segment. Then, the server 5 integrally specifies the moving direction of the segment based on the moving directions of a plurality of vectors, and specifies branch points existing in the grouped strokes. Then, the server 5 specifies the corresponding graphic based on the specified branch points. Then, the server 5 generates elaborated data by elaborating the data of the grouped strokes into the specified graphic based on time series. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for imaging information entered in a form for an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known. Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an anotopen or checks an image that is designed on the special paper, the small camera detects the dot pattern on the special paper as the pen moves, and the user Entry information (also referred to as “stroke data”) such as written characters and images is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a technique for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 1).

  In the system as described above, when the user enters a figure on the dedicated paper using the anotopen, the figure can be acquired as image data. In this case, the system images the trajectory data entered on the dedicated paper as it is and stores it as an image. In such a system, since input can be performed roughly using an electronic pen and dedicated paper, the imaged data becomes freehand data. For this reason, it is usually necessary to refine the freehand data to some extent.

JP 2004-153612 A

  The present invention has been made in view of the above points, and provides a graphic analysis system capable of creating an image after refining a graphic written freehand on a grid paper preprinted with a grid. This is the issue.

  In one aspect of the present invention, in a processing device for processing information entered in an electronic pen form on which a dot pattern recognizable by the electronic pen is printed, one or more entered in the electronic pen form Included in the entry information, entry information obtaining means for obtaining strokes as entry information, grouping means for grouping one or more strokes corresponding to one figure based on time information included in the entry information, A line segment extracting unit for extracting a line segment of a predetermined length from the stroke, a vector extracting unit for extracting a vector within a predetermined time from the line segment based on the time information, and a moving direction of the vector Based on the movement direction specifying means for specifying the movement direction of the line segment based on the movement direction of the line segment, the branches in the grouped strokes Branch point specifying means for specifying, figure specifying means for specifying the figure based on the branch point, position information on the dot pattern of the branch point, grouped stroke data, and time information, And refined data generating means for generating refined data refined to the specified figure.

  In the processing apparatus configured as described above, the user enters a figure on the electronic pen form using the electronic pen. Here, the figure is assumed to be any of a straight line, a triangle, a square, a rectangle, a rhombus, or a circle. The electronic pen reads the dot pattern on the form with the movement of the electronic pen, and acquires the entry contents entered by the user, that is, the data relating to the stroke relating to the figure and the position coordinates on the dot pattern. The position information is position coordinates (coordinate data) on the dot pattern. Furthermore, the electronic pen transmits data relating to strokes and position coordinates as entry information to the processing device. Here, the stroke is a trajectory written with a single stroke. The processing device first extracts time information related to the entry time from the entry information acquired from the electronic pen. Further, the processing device groups strokes included in the entry information based on the time information. Specifically, the strokes corresponding to one figure are grouped together based on the time series. According to this, even if the figure is composed of a plurality of strokes, the stroke corresponding to one figure can be easily recognized and processed by performing appropriate grouping based on the time series. . In addition, when there is one stroke corresponding to one figure, there is no plurality of strokes to be grouped, but this is called grouping.

  Further, the processing device extracts a line segment having a predetermined length from the stroke included in the entry information. Further, the processing device extracts a vector at a certain time from the line segment. Then, the processing device comprehensively specifies the movement direction of the line segment based on the movement directions of the plurality of vectors. Based on the movement direction of the specified line segment, the processing device specifies a branch point existing in the grouped stroke. Specifically, based on the moving direction of the line segment, it is analyzed whether each point on the stroke is moving in the same direction while extracting the shortest distance point. And when a change is seen in the movement of the X-axis direction and / or the Y-axis direction, the point of the shortest distance of the point which started moving to a different direction is specified as a branch point. Further, the processing device specifies a figure corresponding to the grouped strokes based on the specified branch point. Then, the processing device generates refined data that is image data by refining the grouped stroke data so as to become the specified figure based on the time series. The generated refined data can be subjected to arbitrary processing such as storage and transmission. According to this, it is possible to automatically arrange and form an image of a figure entered freehand on the electronic pen form.

  In one aspect of the processing device, the processing device includes start point specifying means for specifying a start point in a grouped stroke based on the time information and the position information included in the entry information; End point specifying means for specifying end points in the grouped strokes based on the time information and the position information included in the entry information, and the refined data generating means includes the branch point Based on the position information of the start point and the end point and the time information, the refined data refined to the specified figure is generated.

  The processing device configured as described above specifies a start point and an end point in the grouped strokes based on the time information and the position information. Specifically, for example, based on the time series, the point entered at the earliest time among the grouped strokes is identified as the start point, and the point entered at the latest time is identified as the end point. It is possible. In the case of a graphic other than a straight line, the start point and the end point often coincide with each other. Therefore, it is conceivable to specify extremely close points as the start point and end point based on the position information. The processing device generates the refined data by connecting the start point, the end point, and the branch point thus identified with a straight line based on a time series.

  In another aspect of the processing apparatus, the processing apparatus further includes a branch point number calculating unit that calculates the number of branch points in the grouped stroke, and the graphic specifying unit determines the number of branch points in the grouped stroke. Based on this, the figure is identified. According to this, the processing device can automatically specify a figure based on the number of branch points in the stroke and generate refined data that is image data refined to the figure.

  In another aspect of the processing device, the graphic specifying means specifies the graphic as a straight line when the number of branch points in the grouped stroke is 0, and the refined data generating means Generates refined data refined into a straight line based on the position information of the start point and the end point when the number of branch points in the grouped stroke is zero. According to this, when there is no branch point in the grouped stroke, the processing device specifies that the corresponding graphic is a straight line. Therefore, the refined data can be easily generated by connecting the start point and the end point with a straight line.

  In another aspect of the processing apparatus, the graphic specifying means specifies the graphic as a triangle when the number of branch points in the grouped stroke is 2, and the refined data generating means Is refined into a triangle based on the position information and time information of the start point, the end point and the branch point when the number of branch points in the grouped stroke is two Generate data. According to this, when there are two branch points in the grouped stroke, the processing device specifies that the corresponding figure is a triangle. Therefore, the refined data can be easily generated by connecting the start point or the end point and the two branch points with a straight line in time series.

  In another aspect of the processing apparatus, the form is composed of a horizontal line parallel to the X axis and a vertical line parallel to the Y axis, and has a grid area in which a figure is written by the electronic pen, The processing apparatus determines whether the moving direction of the line segment based on the position information of the start point, the end point, and the branch point and the time information is parallel to either the X axis or the Y axis. An axis determination means, and the figure specifying means determines that the figure is a square when the number of branch points in the grouped strokes is 3 and the axis determination means is determined to be parallel. Or when the refined data generating means determines that the number of branch points in the grouped strokes is 3 and the axis determining means is parallel, Start point, end point and previous The position information of the branch point, based on said time information to generate a refined data refined to square or rectangular.

  In the processing apparatus configured as described above, the electronic pen form has a grid area in which vertical lines and horizontal lines are arranged in a grid pattern. The user uses the electronic pen to enter a predetermined figure in the grid area of the electronic pen form. According to this, it is possible to easily enter a figure freehand using the vertical and horizontal lines as a guide.

  Further, according to this, the processing device determines whether all line segments connecting the start point, the end point, and the branch point are parallel to either the X axis or the Y axis based on the time series. To do. Then, the processing device specifies the movement direction of the line segment between the start point, the end point, and the branch point based on the time series. In other words, the processing device specifies the movement direction of the line segment corresponding to the side of the graphic entered by the user. Specifically, the fact that the number of branch points is three may be a square / rectangle or a rhombus as a figure to be entered by the user. Therefore, the processing device specifies that the graphic corresponding to the grouped stroke is a square / rectangular shape that all the line segments are parallel to either the X axis or the Y axis. Therefore, the processing device has a start point when there are three branch points in the grouped stroke and the movement direction of all the line segments corresponding to the sides of the figure is parallel to the X axis or the Y axis. Alternatively, the refined data can be easily generated by connecting the end point and the three branch points with a straight line in time series.

  In another aspect of the processing apparatus, when the figure specifying unit determines that the number of branch points in the grouped strokes is three and the axis determining unit is not parallel, When the figure is identified as a rhombus and the refined data generating means determines that the number of branch points in the grouped stroke is 3 and the axis determining means is not parallel, Based on the position information of the start point, the end point, and the branch point, and the time information, refined data refined into a rhombus is generated. According to this, when there are three branch points in the grouped stroke and the line segment corresponding to the side of the figure is not parallel to the X axis or the Y axis, the processing device automatically The figure corresponding to the grouped strokes can be specified as a rhombus. Therefore, the refined data can be easily generated by connecting the start point or the end point and the three branch points with a straight line in time series.

  In another aspect of the processing device, the graphic specifying means specifies the graphic as a circle when the number of branch points in the grouped stroke is 3 or more, and the processing device Further comprising diameter calculation means for calculating the diameter of the circle based on the position information of the start point, the end point, and the branch point, and the time information, the refined data generation means includes the grouped strokes Refinement refined into a circle based on the position information of the start point, the end point, and the branch point, the time information, and the calculated diameter when the number of branch points in the center is 4 or more Generate data. According to this, when there are four or more branch points in the grouped stroke, the processing device can automatically specify that the figure corresponding to the grouped stroke is a circle. it can. Further, the processing device calculates the diameter of the circle based on the position coordinates of the start point, end point, and branch point. Then, the processing device can easily generate refined data by drawing an arc based on the calculated diameter, the start point or the end point, and the branch point.

  In another aspect of the processing device, the processing device includes a specific area determination unit that determines whether the appearance frequency of the grouped strokes is high or low in the specific area for determining a circle and a diamond. Further, the figure specifying means determines that the number of branch points in the grouped strokes is 3, the axis determining means determines that they are not parallel, and the specific area determining means determines that the stroke appearance frequency is When it is determined that the figure is low, the figure is identified as a rhombus, and the refined data generation means is configured such that the number of branch points in the grouped stroke is 3, and the axis determination means is not parallel. And when the specific region determination means determines that the appearance frequency of the stroke is low, based on the position information of the start point, the end point, and the branch point, and the time information. Generating a refined data refined to form. According to this, even if the number of branch points in the grouped stroke is 3, it can be easily specified that the corresponding figure is a rhombus based on the appearance frequency in the specific area. Therefore, it is possible to generate image data refined into an accurate figure.

  In another aspect of the processing apparatus, the graphic specifying means determines that the number of branch points in the grouped stroke is 3, the axis determining means is not parallel, and the specific area determining When the means determines that the appearance frequency of the stroke is high, the figure is identified as a circle, and the refined data generation means has three branch points in the grouped strokes, and the axis When it is determined that the determination unit is not parallel and the specific region determination unit determines that the appearance frequency of the stroke is high, the position information of the start point, the end point, and the branch point, and the time information Based on the calculated diameter, refined data refined into a circle is generated. According to this, even if the number of branch points in the grouped stroke is 3, it can be easily specified that the corresponding figure is a circle based on the appearance frequency in the specific region. Therefore, it is possible to generate image data refined into an accurate figure.

  In another aspect of the processing device, the form has a selection area in which a check mark is written by the electronic pen to select the type of the graphic, and the processing device has the selection area. Further comprising a figure type specifying means for specifying the type of the selected figure based on the entry information entered in the information, wherein the figure specifying means is based on the type of the selected figure and the branch point. Identify the shape. According to this, refined data can be generated based on the type of figure selected by the user. Therefore, the figure recognition rate can be improved.

  In another aspect of the present invention, there is provided a program executed by a computer for processing information entered in an electronic pen form on which a dot pattern recognizable by the electronic pen is printed, and is entered into the electronic pen form. Entry information obtaining means for obtaining one or more strokes as entry information, grouping means for grouping one or more strokes corresponding to one figure based on time information included in the entry information, Line segment extraction means for extracting a line segment of a predetermined length from the stroke included in the entry information, Vector extraction means for extracting a vector within a predetermined time from the line segment based on the time information, Movement of the vector Based on the direction, the moving direction specifying means for specifying the moving direction of the line segment, grouped based on the moving direction of the line segment Branch point specifying means for specifying a branch point in the trooke, figure specifying means for specifying the figure based on the branch point, position information on the dot pattern of the branch point, grouped stroke data, Based on the time information, the computer is caused to function as refined data generating means for generating refined data refined to the specified figure.

  By executing the above program by a computer, the above-described processing device can be realized. Moreover, each aspect of the processing apparatus described above can be realized in the same manner.

  In still another aspect of the present invention, the electronic pen form is filled in by an electronic pen including an ink pen unit and a reading unit that optically reads a dot pattern, and the electronic pen form is a horizontal line parallel to the X axis. And a grid area that is composed of vertical lines parallel to the Y axis and in which a graphic is written by the electronic pen, and a selection area in which a check mark is written by the electronic pen in order to select the type of the graphic .

  According to this, the electronic pen form has a grid area where a figure is entered and a selection area where the type of figure is selected. Therefore, the processing device and the server can specify the figure selected by the user based on the entry information entered in the selection area. Then, the processing device or the like generates refined data that is refined image data based on the entry information entered in the grid area in consideration of the specified figure. Therefore, it is possible to improve the recognition rate of the figure by the selection area and to generate accurate refined data.

  According to the present invention, it is possible to make an image after refining a figure that has been entered freehand on a graph paper on which a grid is printed in advance.

  Preferred embodiments of the present invention will be described below with reference to the drawings. First, an outline of an electronic pen used as an input device in the system of the present invention will be described.

[Electronic pen]
FIG. 1 is a diagram schematically showing how the electronic pen is used, and FIG. 2 is a functional block diagram showing the structure of the electronic pen. As shown in FIG. 1, the electronic pen 10 is used in combination with a dedicated paper 20 on which a dot pattern is printed. The electronic pen 10 includes a pen tip portion 17 similar to a normal ink pen, and a user writes characters on the dedicated paper 20 in the same manner as a normal ink pen.

  As shown in FIG. 2, the electronic pen 10 includes a processor 11, a memory 12, a data communication unit 13, a battery 14, an LED 15, a camera 16, and a pressure sensor 18 therein. The electronic pen 10 includes an ink cartridge (not shown) as a component similar to a normal ink pen.

  The electronic pen 10 does not convert the locus of the ink drawn on the dedicated paper 20 by the pen tip unit 17 but converts the locus coordinates of the movement of the electronic pen 10 on the dedicated paper 20 into data. While the LED 15 illuminates the vicinity of the pen tip 17 on the dedicated paper 20, the camera 16 reads the dot pattern printed on the dedicated paper 20 and converts it into data. That is, the electronic pen 10 can acquire, as image data or vector data, a stroke generated when the user moves the electronic pen 10 on the dedicated paper 20.

  The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters on the dedicated paper with the electronic pen 10, that is, the writing pressure, and supplies the detected pressure to the processor 11. The processor 11 switches on / off the LED 15 and the camera 16 based on the writing pressure data provided from the pressure sensor 18. That is, when the user writes characters or the like on the dedicated paper 20 with the electronic pen 10, writing pressure is applied to the pen tip portion 17. Therefore, when the writing pressure exceeding the predetermined value is detected, it is determined that the user has started the description, and the LED 15 and the camera 16 are operated.

  The camera 16 reads the dot pattern on the dedicated paper 20 and supplies the pattern data to the processor 11. The processor 11 calculates X / Y coordinates on the dedicated paper 20 from the supplied dot pattern.

  The processor 11 acquires the writing pressure array data and the X / Y coordinate data while the description of the user is performed, and stores them in the memory 12 in association with the time stamp (time information). Therefore, data corresponding to the description content of the user is stored in the memory 12 in time series. The capacity of the memory 12 can be about 1 Mbyte, for example.

  All the acquired data is held in the memory 12 until a transmission instruction is given by the user. When the user gives a transmission instruction, the data communication unit 13 transmits the data in the memory 12 to the terminal device 25 within a predetermined distance from the electronic pen 10. Basically, once a transmission instruction is given, the electronic pen 10 transmits all data stored in the memory 12 to the terminal device 25, and thus the memory 12 is cleared. Therefore, when it is desired to transmit the same information to the terminal device 25 again after transmission, the user needs to write the description on the dedicated paper 20 again. In this case, the user can trace characters written on the dedicated paper 20 with an ink pen.

  The electronic pen 10 itself does not include a function button such as a transmission button, and a transmission instruction and other instructions are made by a user checking the dedicated box provided at a predetermined position on the dedicated paper 20 with the electronic pen 10. Executed. A transmission instruction is associated with the position coordinates of the dedicated box in advance, and when the processor 11 receives the position coordinates of the dedicated box, the processor 11 supplies the data in the memory 12 to the data communication unit 13 and transmits it to the terminal device 25. To do. The electronic pen 10 can indicate completion of data transmission by vibration of the electronic pen.

  The battery 14 is for supplying power to each element in the electronic pen 10, and the electronic pen 10 itself can be turned on / off by a cap (not shown) of the electronic pen, for example.

  As described above, the electronic pen 10 has a function of acquiring coordinate data and writing pressure data corresponding to characters and the like described on the dedicated paper 20 by the user and transmitting them to the nearby terminal device 25. Since the pen tip portion 17 is a normal ink pen, the content described on the dedicated paper 20 remains as an original original. That is, at the same time as describing the original paper, its contents can be digitized in the form of coordinate data in real time.

  According to the standard function of the electronic pen 10, data obtained by the electronic pen 10 is in principle in the form of coordinate data or vector data, and is not text data. However, as a standard function, the electronic pen 10 has a function of converting text into alphanumeric characters by describing it in a dedicated area provided on the dedicated paper 20.

  Also, the electronic pen 10 can hold property information (pen information and pen owner information) regarding the pen itself and its owner, and can be referenced from the application. As the pen information, a battery level, a pen ID, a pen manufacturer number, a pen software version, a subscription provider ID, and the like can be held. The pen owner information can hold nationality, language, time zone, email address, free memory capacity, name, address, fax / phone number, mobile phone number, and the like.

  In the data communication unit 13 in the above example, the electronic pen 10 is connected to the terminal device 25 by various methods such as wireless transmission using Bluetooth (registered trademark), wired transmission using a USB cable, and data transmission by contact with a terminal. It is conceivable to perform data transmission.

  Next, a method for acquiring X / Y coordinate data of contents described by the user with the electronic pen will be described. As described above, a predetermined dot pattern is printed on the dedicated paper 20. The camera 16 of the electronic pen 10 does not read the locus of ink described on the dedicated paper 20 by the user, but reads the dot pattern on the dedicated paper 20. Actually, as shown in FIG. 1, the illumination area by the LED 15 and the shooting area of the camera 16 (located in the illumination area) are deviated from the position where the pen tip portion 17 contacts the dedicated paper 20.

  The dot pattern is printed with a special ink containing carbon, and the camera 16 can recognize only the pattern with the special ink. Even if a ruled line or a frame is printed on the dedicated paper with an ink other than the dedicated ink (not including carbon), the electronic pen does not recognize them. Therefore, when creating forms such as various application forms using dedicated paper, input frames, ruled lines, cautions, etc. are printed with ink other than dedicated ink.

  In the dot pattern, the position of each dot is associated with data, as illustrated in FIG. In the example of FIG. 3, the 2-bit information 0 to 3 is displayed by shifting the dot position vertically and horizontally from the reference position of the lattice (intersection of the vertical and horizontal lines). The position coordinates on the dedicated paper are determined by the combination of information expressed in this way. As illustrated in FIG. 4A, 36 dots are arranged in a grid within a range of 2 mm in length and width, and the data array (FIG. 4B) indicated by these dots is displayed on the dedicated paper. Are associated with the position coordinates. Therefore, when the camera 16 of the electronic pen 10 captures a dot pattern as shown in FIG. 4A, the processor 11 changes the data array shown in FIG. 4B based on the dot pattern data input from the camera 16. The position coordinates on the dedicated paper (that is, where the dot pattern is located on the dedicated paper) corresponding to the acquired position are calculated in real time. The minimum unit for recognizing a dot pattern is 2 mm × 2 mm, and the camera 16 takes about 100 shots per second.

  Next, the dedicated paper will be described. An example of the structure of the dedicated paper is shown in FIG. As shown in the figure, the dedicated paper 20 has a dot pattern 32 printed on a mount 30 and a design 34 such as a ruled line printed thereon. The mount 30 is usually paper, and the dot pattern 32 is printed with dedicated ink containing carbon as described above. Also, the design 34 is printed with normal ink or the like. The dot pattern and the design may be printed at the same time, or one of them may be printed first.

  An example of the design 34 is shown in FIG. FIG. 6 shows an example of a certain application form 36 in which a plurality of entry fields 38 and a transmission box 39 are printed. Although it is not clearly shown in FIG. 6 and will be described in detail later, a dot pattern is actually printed on the entire surface of the application form 36, and an entry box 38 and a transmission box 39 are formed on the entire surface using ordinary ink. It is printed. The user may fill out the necessary items in the entry fields 38 of the application form 36 using the electronic pen 10 in the same manner as a conventional application form without being aware of the dot pattern.

  The area on the dedicated paper 20 can be roughly divided into two types. One is an entry area, in which the content described by the electronic pen 10 is handled as information as it is. In the example of FIG. 6, a plurality of entry fields 38 correspond to this. The other is a functional element. When a corresponding area is checked with the electronic pen 10, actions, instructions, and the like defined for the area are executed in advance. The transmission box 39 in the example of FIG. 6 corresponds to this.

  The transmission box 39 is used when giving an instruction to transmit data stored in the electronic pen 10 to the nearby terminal device 25 as described above. When the user checks the transmission box 39 with the electronic pen 10, the electronic pen 10 reads the dot pattern in the transmission box. The pattern is associated with a transmission instruction, and the processor 11 in the electronic pen 10 issues a command to transmit data stored in the memory 12 to the data communication unit 13.

  The assignment of dot patterns is usually performed for each application (paper type). That is, the dot patterns in a certain application form do not overlap in one sheet, but the same dot pattern is printed on the same application form. Therefore, when the user inputs necessary items with the electronic pen 10, it can be specified from the coordinate data on the application form which item of the application form the input item is for.

  As described above, by printing a predetermined design on the dedicated paper on which the dot pattern is printed, various application forms using the dedicated paper can be created. If the user uses the electronic pen 10 and fills in necessary items in a normal manner, the electronic data is automatically acquired.

  In the above example, the dot pattern is printed on the dedicated paper with carbon-containing ink. However, it is also possible to print the dot pattern on ordinary paper using a printer and carbon-containing ink. Furthermore, the design on the dedicated paper can also be formed by a printer instead of printing. When dot patterns are formed on paper by a printer, different dot patterns can be formed on each sheet. Therefore, each of the sheets can be identified and distinguished by the difference in the formed dot pattern.

  In the present specification, the term “print” is a concept including not only normal printing but also printing by a printer.

  Next, transmission processing of data acquired by the electronic pen will be described with reference to FIG. The data acquired by the electronic pen 10 is mainly data of items input by the user, but usually does not include information on where the service server that is the transmission destination of the data is. Instead, information specifying the application or service related to the dedicated paper is included in the dot pattern on the dedicated paper, and the information is acquired from the dedicated paper during the user's input operation. Therefore, the terminal device 25 that has received the entry information from the electronic pen 10 first makes an inquiry to the inquiry server 26 to which service server 27 the data input to the dedicated paper should be transmitted. The inquiry server 26 has information on a corresponding service server for each dedicated paper, and in response to an inquiry from the terminal device 25, information (such as a URL) of the service server 27 that performs a service related to the dedicated paper. Answer to the terminal device 25. Then, the terminal device 25 transmits the entry information acquired from the electronic pen to the service server 27.

  In the above example, the terminal device 25, the inquiry server 26, and the service server 27 are separately configured. However, some or all of them may be configured as one device. The server described later in this embodiment also serves as the inquiry server 26 and the service server 27. In this embodiment, it is assumed that the entry information includes stroke data and time information.

[Figure analysis system]
Next, the graphic analysis system of the present invention will be described. FIG. 7 shows a schematic configuration of the graphic analysis system 100. A processing system 100 shown in FIG. 7 is a system that creates image data refined into a specific figure based on information entered in an electronic pen form that is a dedicated paper by the electronic pen 10. Specifically, the electronic pen form is a graph paper 3 and has a grid area composed of a horizontal line parallel to the X axis and a vertical line parallel to the Y axis. The grid area may be a part or all of the grid paper 3. The user roughly fills a grid area on the grid paper 3 with any of a straight line, a triangle, a square, or a circle freehand. The server 5 identifies the graphic entered by the user based on the information entered on the grid paper 3 and creates image data (hereinafter also referred to as “refined data”) refined to the identified graphic. . In the present embodiment, for convenience, straight lines are also included in the figure.

  As shown in FIG. 7, the graphic analysis system 100 is configured by connecting a terminal device 25 and a server 5 through a network 2. Here, one suitable example of the network 2 is the Internet. The terminal device 25 is a terminal capable of transmitting and receiving data via a network such as a personal computer (hereinafter referred to as “PC”) used by a user or a mobile phone.

  Here, with reference to FIG. 8 and FIG. 9, the outline of the graphic analysis method by this system is described. FIG. 8 is an example of a grid area that the grid paper 3 has. On the other hand, FIG. 9 is an example showing data entered freehand in the grid area and data refined based on the entry information.

  The user uses the electronic pen 10 to draw a figure roughly in a free-hand manner in a grid area provided on the grid paper 3 that is a form for the electronic pen. In addition, the figure to fill in shall be either a straight line, a triangle, a square, or a circle. As shown in FIG. 8, the grid area provided on the grid paper 3 is a grid-like area composed of horizontal lines parallel to the X axis and vertical lines parallel to the Y axis. According to the scale of such a grid, the user can easily fill in a figure even if he is freehand.

  Note that the graph paper 3 has the above-mentioned transmission box 39 in addition to the grid area.

  In this embodiment, the figure that the user fills in the grid area freehand with the electronic pen 10 is a straight line 60a, a triangle 61a, a square, a rectangle 62a, a rhombus 63a, and a circle 64a as shown in FIG. is there. The electronic pen 10 acquires entry information corresponding to the entered content, temporarily stores it in a memory in the electronic pen 10, and then transmits the entry information to the terminal device 25. The terminal device 25 transmits the acquired entry information to the server 5 via the network 2.

  The server 5 extracts time information related to the entry time from the entry information, and groups one or more strokes corresponding to one figure based on the time information. Here, the stroke is a trajectory written with a single stroke. Since the rectangle and the rhombus may be entered in a plurality of strokes, the server 5 performs grouping based on the time information. Specifically, it is conceivable to group strokes entered within a predetermined time. In addition, when there is one stroke corresponding to one figure, there is no plurality of strokes to be grouped, but this is called grouping.

  Then, the server 5 specifies the start point and the end point based on the position coordinates on the dot pattern included in the entry information. Specifically, the start point and end point of each grouped stroke are analyzed, and the closest point on each grid paper 3 is set as the start point and end point for graphic analysis. Note that the specification of the start point and the end point is not limited to this, and based on the time information, the point that is written earliest in time series is the start point, and the point that is written latest in time series is It may be specified as an end point. Moreover, it is good also as specifying based on a position coordinate and time information.

  The server 5 extracts a line segment having a predetermined length from each stroke. Further, as will be described in detail later, the server 5 extracts a vector having a certain time or certain frequency from the line segment in order to take into account the fluctuation of the stroke. And the server 5 specifies the moving direction of a line segment based on the moving direction of a vector.

  Although details will be described later, the server 5 analyzes whether or not the points on the stroke are moving in the same direction based on the moving direction of the line segment. Then, when there is a change in the movement in the X-axis direction and / or the Y-axis direction, the server 5 identifies the shortest distance point on the grid paper 3 as the branch point. Furthermore, the server 5 calculates the number of branch points.

  Then, based on the time information, the calculated number of branch points, the movement direction of the line segment, and the determination based on the specific area, the server 5 determines that the figure written on the graph paper 3 is a straight line, triangle, square / rectangle, rhombus, or circle. Identify which one. Then, the server 5 generates refined data refined to the specified figure based on the branch point, start point, and end point in the grouped stroke. This refined data is image data and is stored in the server 5 or transmitted to the terminal device 25. The terminal device 25 can also output the acquired refined data on the screen. That is, the terminal device 25 can refine the stroke data that is roughly written by freehand as shown in FIG. 9A and display it as shown in FIG. 9B.

  As described above, the server 5 according to the present invention can automatically generate refined image data by adjusting the appearance of a figure that is entered freehand in accordance with the scale of the graph paper 3.

[Shape]
Here, with reference to FIG. 10 to FIG. 14, the figure entered in the grid area and the refined figure will be described in detail. 10 to 14 show examples of straight lines, triangles, squares / rectangles, rhombuses, and circles in the grid area, and examples of refined figures.

  First, a straight line will be described with reference to FIG. The user uses the electronic pen 10 to enter a straight line 60a in the grid area freehand as shown in FIG. At this time, the two end points of the straight line, that is, the start point 80 and the end point 81 shown in FIG. 10B must be located at the intersection where the vertical line and the horizontal line that constitute the grid area intersect. In other words, the user enters the straight line 60a so that the start point 80 and the end point 81 overlap the intersection of the grid areas. Note that the straight line 60a does not have to be parallel to the vertical line (Y axis) or the horizontal line (X axis) constituting the grid area.

  When there is no branch point in the grouped stroke, the server 5 specifies that the figure corresponding to the grouped stroke is a straight line. In other words, the server 5 specifies that the figure corresponding to the grouped strokes is a straight line when the moving directions of the line segments in the grouped strokes are all the same one direction. Furthermore, the server 5 creates image data refined into a straight line by connecting the specified start point and end point. That is, as shown in FIG. 10C, image data of a straight line 60b connecting the start point 80 and the end point 81 is generated.

  Next, a triangle will be described with reference to FIG. The user uses the electronic pen 10 to enter the triangle 61a freehand in the grid area as shown in FIG. At this time, the three vertices of the triangle 61a must be located on the intersection. In principle, when the triangle 61a is entered, the start point 82 and the end point 83 must be entered so as to coincide as shown in FIG. 11B. In other words, the user enters the triangle 61a so that the start point 82 (end point 83), the branch point 84, and the branch point 85, which are the three vertices of the triangle 61a, overlap the intersection of the grid area.

  Note that the sides of the triangle 61a do not have to be parallel to the vertical line (Y axis) or the horizontal line (X axis) constituting the grid area. The sides of the triangle 61a are line segments that connect the start point 82 (end point 83), the branch point 84, and the branch point 85 in time series. Details of the moving direction of the line segment will be described later.

  When there are two branch points in the grouped stroke, the server 5 specifies that the figure corresponding to the grouped stroke is a triangle. Further, the server 5 creates image data refined into a triangle by connecting the specified start point 82 (end point 83), branch point 84, and branch point 85 with a straight line. That is, as shown in FIG. 11C, image data of a triangle 61b connecting the start point 82 (end point 83), the branch point 84, and the branch point 85 is generated.

  Next, a square / rectangular shape will be described with reference to FIG. The user uses the electronic pen 10 to enter a square / rectangular 62a freehand in the grid area as shown in FIG. At this time, the four vertices of the rectangle 62a must be located on the intersection. In principle, when the rectangle 62a is to be entered, the start point 86 and the end point 87 must be entered so as to coincide as shown in FIG. Further, the side of the rectangle 62a must be parallel to either the vertical line (Y axis) or the horizontal line (X axis) constituting the grid area. The sides of the rectangle 62a are line segments connecting the start point 86 (end point 87), the branch point 88, the branch point 89, and the branch point 90, respectively.

  The server 5 has three branch points in the grouped strokes, and the lines connecting the start point 86 (end point 87), the branch point 88, the branch point 89, and the branch point 90 are vertical lines. When it is parallel to the (Y axis) or horizontal line (X axis), the figure corresponding to the grouped stroke is specified as a rectangle. Further, the server 5 refines the image into a rectangular shape by connecting the specified start point 86 (end point 87), branch point 88, branch point 89, and branch point 90 with a straight line in time series. Generate data. That is, as shown in FIG. 12C, image data of a rectangle 62b connecting the start point 86 (end point 87), the branch point 88, the branch point 89, and the branch point 90 is generated.

  In FIG. 12, a rectangle is described, but a square is the same except that the lengths of all sides are the same.

  Next, the rhombus will be described with reference to FIG. The user uses the electronic pen 10 to fill the grid area with a rhombus 63a as shown in FIG. 13A. At this time, the four vertices of the rhombus 63a must be located on the intersection. In principle, when the rhombus 63a is entered, as shown in FIG. 13B, the start point 91 and the end point 92 must be entered so as to coincide with each other. The sides of the rhombus 63a do not have to be parallel to the vertical line (Y axis) or the horizontal line (X axis) constituting the grid area. The sides of the rhombus 63a are line segments connecting the start point 91 (end point 92), the branch point 93, the branch point 94, and the branch point 95, respectively.

  The server 5 has three branch points in the grouped strokes, and the line segments connecting the start point 91 (end point 92), the branch point 93, the branch point 94, and the branch point 95 are vertical lines. If it is not parallel to the (Y axis) or horizontal line (X axis), the figure corresponding to the grouped stroke is specified as a rhombus. Furthermore, the server 5 connects the start point 91 (end point 92), the branch point 93, the branch point 94, and the branch point 95 with a straight line along the time series, thereby refining the image data into a rhombus. Is generated. That is, as shown in FIG. 13C, image data of a diamond 63b connecting the start point 91 (end point 92), the branch point 93, the branch point 94, and the branch point 95 is generated.

  Next, a circle will be described with reference to FIG. The user uses the electronic pen 10 to enter a circle 64a freehand in the grid area as shown in FIG. At this time, the diameter of the circle 64a must be one scale unit (for example, 1 cm or 2 cm). Further, the circle 64a must be in contact with the vertical line or horizontal line constituting the grid area at four points. In principle, when the circle 64a is entered, the start point 96 and the end point 97 are entered so as to coincide as shown in FIG. 14 (b). Further, four or more points constituting the rhombus 63a are entered so as to touch the vertical line and / or the horizontal line.

  When there are four or more branch points in the grouped stroke, the server 5 specifies that the figure corresponding to the grouped stroke is a circle. Further, the server 5 calculates the diameter of the circle and connects the start point 96 (end point 97), the branch point 98, the branch point 99, the branch point 121, and the branch point 122 with an arc based on the diameter. Generate image data refined into a circle. That is, as shown in 14 (c), image data of a circle 64b connecting the start point 96 (end point 97), the branch point 98, the branch point 99, the branch point 121, and the branch point 122 is generated.

  In principle, the user needs to follow the rules described above when entering a figure, but if there is a slight deviation, the server 5 determines the position coordinates of the start point, end point, and branch point as fluctuations in the stroke. It is good also as correcting.

[Specific area]
Next, the specific area will be described with reference to FIG. The specific region is a region for determining whether the shape is a rhombus or a circle when there are three branch points in the grouped stroke. Specifically, the hatched area shown in FIGS. 15A and 15B is the specific area.

  As shown in FIG. 15A, when the appearance frequency of the stroke on the specific area is low, the server 5 specifies that the graphic corresponding to the grouped stroke is a rhombus. On the other hand, as shown in FIG. 15B, when the appearance frequency of the stroke on the specific area is high, the server 5 specifies that the figure corresponding to the grouped stroke is a circle.

  Thus, when there are three branch points in the grouped strokes, the server 5 determines whether the corresponding figure is a rhombus or a circle based on the appearance frequency of the stroke on the specific area. is doing.

[Specify the direction of movement]
Next, with reference to FIG. 16, the specification of the moving direction in consideration of stroke fluctuation will be described in detail. As described above, the server 5 extracts a line segment having a predetermined length from the stroke as shown in FIG. Further, as shown in the figure, the server 5 extracts a vector having a certain time or certain frequency from the line segment. The moving direction of the extracted vector can be specified based on the position coordinates of the stroke and the time information included in the entry information. Then, the server 5 identifies the most moving direction among the moving directions of the vectors as the moving direction of the line segment. That is, the server 5 identifies the moving direction of the line segment by combining the moving directions of the vectors. Specifically, in the example of FIG. 16, since there are the most vectors that are directed downward, the movement direction of the line segments is specified as the Y-axis minus direction as a whole.

  As described above, the server 5 can appropriately specify the moving direction of the line segment in each stroke in consideration of the fluctuation, even if the stroke is a rough handwritten stroke by the user.

[Identify branch point]
Next, with reference to FIG. 17, the specification of the branch point will be described in detail.

  It is assumed that the user uses the electronic pen 10 and enters a rectangle with one stroke, starting from the top left vertex as shown in FIG. 17A. In this case, the server 5 analyzes that each point is moving in the same direction while extracting the shortest distance point on the grid area based on the moving direction of the line segment in the stroke, and the movement is changed. If it is seen, the point with the shortest distance of the point that starts moving in a different direction is identified as the branch point. When fluctuation is taken into consideration, the intersection on the grid area closest to the shortest distance point is identified as a branch point. Specifically, as illustrated in FIG. 17B, the moving direction of the line segment 131 is specified as being directly below in consideration of the above-described fluctuation. That is, the moving direction of the line segment 131 is the zero direction on the X axis and the negative direction on the Y axis. Here, the movement in the 0 direction indicates that the movement is not performed. On the other hand, the moving direction of the line segment 132 is specified as moving to the right in consideration of the above-described fluctuation. That is, the movement direction of the line segment 132 is a plus direction on the X axis and a zero direction on the Y axis.

  The server 5 analyzes the movement direction of the points in the stroke by comparing the movement directions of the line segment 131 and the line segment 132 based on the time series based on the time information included in the entry information. In the example described above, it is clear that the movement direction of the line segment 131 and the line segment 132 is changed on both the X axis and the Y axis. Therefore, the point 133 where the moving direction of the line segment has changed greatly becomes a branch point. At this time, if the point 133 is not on the intersection of the grid areas, the server 5 identifies the intersection closest to the point 133 as a branch point.

  In this way, the server 5 specifies the branch point where the stroke moving direction changes greatly by calculating the stroke moving direction and approximate value line.

  FIG. 17 shows an example in which rectangular branch points are specified, but the same applies to the case where branch points of other figures (triangles, squares, rhombuses, and circles) are specified.

  The branch point is specified until the start point and the end point in the grouped strokes coincide. That is, the process is performed until the point being analyzed reaches the end point.

  Further, the server 5 may identify the figure as a straight line based on the position coordinates and the time information when the start point and the end point are not in the error range but at completely different positions.

[server]
Next, the server 5 will be described in detail. FIG. 18 shows an internal configuration of the server 5 in the graphic analysis system 100 in particular. As illustrated, the server 5 includes a graphic analysis program 101, an entry information acquisition function 102, a grouping function 103, a start point end point specifying function 104, a vector extraction function 105, a moving direction specifying function 106, a branch point specifying function 107, Branch point determination function 108, straight line identification function 109, triangle identification function 110, axis determination function 111, square / rectangular identification function 112, specific area determination function 113, rhombus identification function 114, circle identification function 115, refined data generation function 116 And a refined data transmission function 117. Each function is realized by the CPU included in the server 5 executing a program prepared in advance.

  The graphic analysis program 101 is a program that specifies a graphic based on information entered in the grid area freehand using the electronic pen 10 and generates refined data refined based on the graphic. .

  The entry information acquisition function 102 is a function for acquiring entry information entered in the grid area of the graph paper 3 by the user using the electronic pen 10 by executing the graphic analysis program 101.

  The grouping function 103 is a function for grouping one or more strokes corresponding to one figure based on time information included in the entry information acquired by the entry information acquisition function 102.

  The start point / end point specifying function 104 specifies the start point and end point in the grouped stroke based on the position coordinates on the dot pattern and time information included in the entry information acquired by the entry information acquisition function 102. It is a function.

  The vector extraction function 105 is a function for extracting a line segment from the entry information and extracting a vector from the line segment at regular time intervals or constant frequency.

  The moving direction specifying function 106 is a function for specifying the moving direction of the line segment based on the moving direction of the vector.

  The branch point specifying function 107 is a function for specifying all branch points in the grouped strokes based on the moving direction of the line segment specified by the moving direction specifying function 106. The branch point specifying function 107 is a function for calculating the number of branch points in the grouped strokes.

  The branch point number determining function 108 is a function for determining the number of branch points in the grouped strokes calculated by the branch point specifying function 107.

  The straight line specifying function 109 is a function for specifying that the figure corresponding to the grouped stroke is a straight line when the branch point number determining function 108 determines that the number of branch points in the grouped stroke is zero. It is.

  The triangle specifying function 110 is a function for specifying that the figure corresponding to the grouped stroke is a triangle when the branch point number determining function 108 determines that the number of branch points in the grouped stroke is two. It is.

  The axis determination function 111 determines whether the line segment connecting the branch points is parallel to the X axis or the Y axis when the branch point number determination function 108 determines that the number of branch points in the grouped stroke is three. This is a function for determining whether or not. Specifically, when the figure corresponding to the grouped stroke is a square or a rectangle, two movement directions among the line segments connecting the branch points are parallel to the X axis, and the other two movement directions are Y. Should be parallel to the axis. Therefore, the axis determination function 111 is a function for determining whether all line segments are parallel to either the X axis or the Y axis based on the movement direction of the line segments connecting the branch points.

  The square / rectangular determination function 112 corresponds to the grouped strokes when the axis determination function 111 determines that the moving direction of the line segment connecting the branch points is parallel to either the X axis or the Y axis. This is a function for specifying that the figure is a square or a rectangle.

  The specific area determination function 113 determines that the branch point number determination function 108 determines that the number of branch points in the grouped stroke is 3, and the axis determination function 111 determines whether the moving direction of the line segment connecting the branch points is the X axis or Y axis. This is a function for determining whether the appearance frequency of a stroke on a specific area is high or low when it is determined that the axis is not parallel to any of the axes. Specifically, a certain appearance frequency is set in advance, and it is determined whether or not the appearance frequency of the grouped strokes is higher than the certain appearance frequency.

  The rhombus specifying function 114 is a function for specifying that the figure corresponding to the grouped stroke is a rhombus when the specific area determining function 113 determines that the appearance frequency on the specific area is low.

  The circle determination function 115 is a function for specifying a figure corresponding to a grouped stroke as a circle when the specific region determination function 113 determines that the appearance frequency on the specific region is high. The circle determination function 115 determines that the figure corresponding to the grouped stroke is a circle when the branch point number determination function 108 determines that the number of branch points in the grouped stroke is four or more. It is a function to identify.

  The refined data generation function 116 is a function that creates refined data refined to the identified figure based on the position coordinates on the dot pattern of the identified start point, end point, and branch point.

  The refined data transmission function 117 is a function for sending the refined data generated by the refined data generation function 116 to the terminal device 25 through the network 2.

[Figure analysis processing]
Next, a graphic analysis process executed by the graphic analysis system 100 will be described. 19 and 20 are flowcharts of the graphic analysis process.

  First, the user uses the electronic pen 10 to enter an arbitrary figure in the grid area of the graph paper 3. At this time, the user enters a straight line, a triangle, a square / rectangle, a rhombus, or a circle as a figure according to the above-described rule that the vertex is on the intersection. When the entry of the figure is completed, the user transmits the entry information to the server 5 via the terminal device 25 by filling a check mark in the transmission box 39 of the grid sheet 3.

  The server 5 acquires entry information from the electronic pen 10 via the terminal device 25 (step S1). Then, the server 5 groups one or more strokes corresponding to one graphic based on the time information included in the entry information (step S2). Furthermore, the server 5 specifies the start point and the end point in the grouped stroke based on the position coordinates on the dot pattern and the time information included in the entry information (step S3).

  Next, the server 5 extracts a line segment having a predetermined length from the grouped strokes. At this time, the server 5 extracts a line segment from the identified start point. Furthermore, the server 5 extracts a vector for every certain time or every certain frequency from the line segment (step S4). Then, the server 5 identifies the moving direction of the line segment by combining the moving directions of the vectors (step S5).

  The server 5 determines whether or not each point on the stroke is moving in the same direction while extracting the shortest distance point based on the moving direction of the line segment. That is, it is determined whether or not the moving direction has changed (step S6). If not changed (step S6; No), the server 5 proceeds to step S8. On the other hand, if it has changed (step S6; Yes), the server 5 determines that a branch has occurred, and identifies a point that has started moving in a different direction as a branch point (step S7). Then, the server 5 determines whether or not the determined point is an end point (step S8). This is because the movement direction of the line segment and the branch point can be specified by starting from the start point and ending at the end point, so that all the grouped strokes can be confirmed. Therefore, when it determines with the determined point not being an end point (step S8; No), the server 5 repeats the process of step S4 thru | or S8. On the other hand, when it determines with the determined point being an end point (step S8; Yes), the server 5 progresses to step S9.

  Then, the server 5 determines how many branch points are in the grouped stroke (step S9). When there is no branch point, that is, when the number of branch points is 0 (step S9; 0), the server 5 specifies that the figure corresponding to the grouped stroke is a straight line (step S10). On the other hand, when the number of branch points is 2 (step S9; 2), the server 5 specifies that the figure corresponding to the grouped stroke is a triangle (step S11), and proceeds to step S19. When the number of branch points is 3 or more (step S9; 3 or more), the server 5 further determines whether or not the number of branch points is 3 (step S12). Although not described in the flowchart shown in FIG. 21 for convenience, when the number of branch points is 1, the server 5 cannot identify the graphic corresponding to the grouped stroke, and thus ends the graphic analysis process.

  When the number of branch points is 3 or more (step S12; No), the server 5 specifies that the figure corresponding to the grouped stroke is a circle (step S17). On the other hand, when the number of branch points is 3 (step S12; Yes), the server 5 determines whether all sides connecting the points are the X axis or the Y axis based on the start point, the end point, and the position coordinates of the branch point. It is determined whether or not it is parallel to (step S13). When all the sides are parallel to either the X axis or the Y axis (step S13; Yes), the server 5 specifies that the figure corresponding to the grouped stroke is a square / rectangle (step S14). Proceed to step S19. On the other hand, when the side is not parallel to either the X axis or the Y axis (step S13; No), the server 5 determines whether the appearance frequency of the grouped strokes in the specific region is high (step S15). .

  When the appearance frequency is low (step S15; No), the server 5 specifies that the graphic corresponding to the grouped stroke is a rhombus (step S16), and proceeds to step S19. On the other hand, when the appearance frequency is high (step S15; Yes), the server 5 specifies that the figure corresponding to the grouped stroke is a circle (step S17). Furthermore, the server 5 calculates the diameter of the circle based on the position coordinates of the start point, end point, and branch point (step S18).

  Then, the server 5 generates refined data that is image data refined to the specified figure based on the time information and the position coordinates of the start point, the end point, and the branch point (step S19). At this time, if the specified figure is a circle, the server 5 generates refined data in consideration of the diameter. Further, the server 5 transmits the generated refined data to the terminal device 25 via the network 2 (step S20), whereby the graphic analysis process is completed. The terminal device 25 that has received the refined data can perform predetermined processing such as saving or outputting on the screen.

  In the present embodiment, the terminal device 25 and the server 5 are separate and connected via the network 2, but the present invention is not limited to this, and each function is provided. It may be a single terminal device.

  Although not specifically described in the present embodiment, the server 5 uses the position coordinates of the start point, the end point, and the branch point when using the refined data of a straight line, a triangle, a square / rectangle, and a rhombus. Thus, the side length of each figure may be calculated. In other words, the server 5 analyzes the strokes that the user has entered freehand using the electronic pen 10 to identify which figure the grouped strokes are in, and on the size and grid area. Refined data is generated by performing analysis and calculation based on the position.

  According to the present invention, it is possible to automatically arrange and form an image of a figure entered freehand according to the scale on the grid paper 3. The electronic pen form having such a grid area is particularly useful when drawing a drawing at a construction site or when drawing a system flowchart or the like.

[Modification]
Although not described in the above embodiment, in order to improve the recognition rate of the figure, it is possible to select a figure to be entered in advance in the figure selection box before entering the figure in the grid area. In this case, the graph paper 3 that is a form for the electronic pen has a graphic selection area in addition to the grid area, for example, as shown in FIG. In the figure selection area, as shown in the figure, check boxes are associated with illustrations of each figure. The user enters a check mark in a check box corresponding to an arbitrary figure, and then enters the figure in the grid area. Then, when the user enters a check mark in the transmission box 39, the entry information stored in the electronic pen 10 is transmitted to the server 5 via the terminal device 25.

  The server 5 has in advance a coordinate table in which the contents of each check box in the graphic selection area are associated with the position coordinates on the dot pattern of each check box. Therefore, the server 5 can easily identify what figure the user has selected by referring to the coordinate table based on the entry information acquired from the electronic pen 10. Therefore, the server 5 can specify the graphic corresponding to the grouped strokes as in the above-described embodiment in consideration of the graphic selected by the user. That is, the figure recognition rate can be improved.

  According to the present invention, it is possible to use as a graph paper that can be imaged after automatically refining a figure entered by freehand.

It is a figure which shows the usage pattern of an electronic pen typically. It is a functional block diagram which shows the structure of an electronic pen. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. It is an example of a dot pattern and the information corresponding to it. The structure of a form composed of dedicated paper is shown. An example of an electronic pen form is shown. 1 shows a schematic configuration of a graphic analysis system. It is an example of a grid area. It is a figure which shows the freehand figure and the refined figure. It is a figure explaining the straight line on a grid area. It is a figure explaining the triangle on a grid area. It is a figure explaining the square / rectangular shape on a grid area. It is a figure explaining the rhombus on a grid area. It is a figure explaining the circle on a grid area. It is a figure explaining a specific area. It is a figure explaining the moving direction specification method of the line segment which considered fluctuation. It is a figure explaining a branch point specific method. FIG. 8 is a functional block diagram of a server included in the graphic analysis system shown in FIG. 7. It is a flowchart of a figure analysis process. It is a flowchart of a figure analysis process. It is a figure which shows the grid area and figure selection area on graph paper.

Explanation of symbols

DESCRIPTION OF SYMBOLS 2 ... Network 3 ... Graph paper 5 ... Server 10 ... Electronic pen 11 ... Processor 12 ... Memory 13 ... Data communication unit 14 ... Battery 25 ... Terminal device 26 ... Inquiry server 27 ... Service server 100 ... Graphic analysis system

Claims (13)

In a processing device that processes information entered in a form for an electronic pen printed with a dot pattern that can be recognized by an electronic pen,
Entry information acquisition means for acquiring one or more strokes entered in the electronic pen form as entry information;
Grouping means for grouping one or more strokes corresponding to one graphic based on time information included in the entry information;
A line segment extracting means for extracting a line segment of a predetermined length from the stroke included in the entry information;
A vector extracting means for extracting a vector within a predetermined time from the line segment based on the time information;
A moving direction specifying means for specifying the moving direction of the line segment based on the moving direction of the vector;
A branch point specifying means for specifying a branch point in the grouped stroke based on the moving direction of the line segment;
A graphic specifying means for specifying the graphic based on the branch point;
Refined data generating means for generating refined data refined to the specified figure based on position information on the dot pattern of the branch point, grouped stroke data, and time information; A processing apparatus comprising: The processor is
Start point specifying means for specifying a start point in the grouped strokes based on the time information and the position information included in the entry information;
End point specifying means for specifying end points in the grouped strokes based on the time information and the position information included in the entry information, and further comprising:
The refined data generating means generates refined data refined to the specified figure based on the position information of the branch point, the start point and the end point, and the time information. The processing apparatus according to claim 1. A branch point number calculating means for calculating the number of branch points in the grouped stroke;
3. The processing apparatus according to claim 1, wherein the graphic specifying unit specifies the graphic based on the number of branch points in the grouped strokes. The graphic specifying means specifies the graphic as a straight line when the number of branch points in the grouped stroke is 0,
The refined data generating means generates refined data refined into a straight line based on the position information of the start point and the end point when the number of branch points in the grouped stroke is 0. The processing apparatus according to claim 3, wherein: The graphic specifying means specifies the graphic as a triangle when the number of branch points in the grouped stroke is 2,
When the number of branch points in the grouped stroke is two, the refined data generation means, based on the position information of the start point, the end point and the branch point, and the time information, 5. The processing apparatus according to claim 3, wherein the refined data refined into a triangle is generated. The form is composed of a horizontal line parallel to the X axis and a vertical line parallel to the Y axis, and has a grid area in which a graphic is written by the electronic pen,
The processor is
Axis determination means for determining whether the moving direction of the line segment based on the position information of the start point, the end point, and the branch point and the time information is parallel to either the X axis or the Y axis. Further comprising
The graphic identifying means identifies the graphic as a square or a rectangle when the number of branch points in the grouped stroke is 3 and the axis determining means is determined to be parallel. ,
When the refined data generating means determines that the number of branch points in the grouped stroke is 3 and the axis determining means is parallel, the start point, the end point, and the 6. The processing apparatus according to any one of 3 to 5, wherein the refined data refined into a square or a rectangle is generated based on the position information of the branch point and the time information. The figure specifying means specifies the figure as a rhombus when the number of branch points in the grouped strokes is 3 and the axis determining means determines that they are not parallel,
When the refined data generating means determines that the number of branch points in the grouped strokes is 3 and the axis determining means is not parallel, the start point, the end point, and the The processing apparatus according to claim 6, wherein refinement data refined into a rhombus is generated based on position information of a branch point and the time information. The figure specifying means specifies the figure as a circle when the number of branch points in the grouped stroke is 4 or more,
The processor is
Diameter calculating means for calculating the diameter of the circle based on the position information of the start point, the end point, and the branch point, and the time information,
When the number of branch points in the grouped stroke is 3 or more, the refined data generation means, the position information of the start point, the end point and the branch point, the time information, and the calculated The processing apparatus according to claim 7, wherein refinement data refined into a circle is generated based on the diameter. The processor is
In the specific area for discriminating between the circle and the rhombus, further comprising specific area determination means for determining whether the appearance frequency of the grouped strokes is high or low,
The figure specifying means determines that the number of branch points in the grouped strokes is 3, the axis determining means is determined not to be parallel, and the specific area determining means determines that the appearance frequency of the stroke is low. If you do, identify the shape as a diamond,
The refined data generating means determines that the number of branch points in the grouped strokes is 3, the axis determining means is not parallel, and the specific area determining means has a low appearance frequency of strokes. 6 to 8, wherein refinement data refined into a rhombus is generated based on the position information of the start point, the end point, and the branch point, and the time information. The processing apparatus as described in any one. The graphic specifying means determines that the number of branch points in the grouped strokes is 3, the axis determining means determines that they are not parallel, and the specific area determining means determines that the appearance frequency of the stroke is high. If you do, identify the shape as a circle,
The refined data generating means determines that the number of branch points in the grouped strokes is 3, the axis determining means is not parallel, and the specific area determining means has a high frequency of stroke appearance. And generating refined data refined into a circle based on the position information of the start point, the end point, and the branch point, the time information, and the calculated diameter. The processing apparatus according to claim 9. The form has a selection area in which a check mark is written by the electronic pen in order to select the type of the figure,
The processor is
Based on the entry information entered in the selection area, further comprising a figure type specifying means for specifying the type of the selected figure,
The processing device according to claim 1, wherein the graphic specifying unit specifies the graphic based on a selected graphic type and the branch point. A program executed by a computer that processes information entered in a form for an electronic pen printed with a dot pattern that can be recognized by an electronic pen,
Entry information acquisition means for acquiring one or more strokes entered in the electronic pen form as entry information;
Grouping means for grouping one or more strokes corresponding to one figure based on time information included in the entry information;
A line segment extracting means for extracting a line segment of a predetermined length from the stroke included in the entry information;
Vector extraction means for extracting a vector within a predetermined time from the line segment based on the time information;
A moving direction specifying means for specifying the moving direction of the line segment based on the moving direction of the vector;
A branch point specifying means for specifying a branch point in the grouped stroke based on the moving direction of the line segment;
Graphic specifying means for specifying the graphic based on the branch point;
As refined data generating means for generating refined data refined to the specified figure based on position information on the dot pattern of the branch point, grouped stroke data, and time information, A program characterized by causing a computer to function. An electronic pen form that is filled in by an electronic pen including an ink pen unit and a reading unit that optically reads a dot pattern,
The electronic pen form is composed of a horizontal line parallel to the X axis and a vertical line parallel to the Y axis. In order to select a grid area in which a graphic is written by the electronic pen and the type of the graphic, An electronic pen form having a selection area in which a check mark is written by a pen.

Images