JP2007316836A - Written data processing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily perform the separation or processing of a part of written data. <P>SOLUTION: This written data processing device is provided with a written data acquisition part 31 for acquiring written data; a written data storage part 32 for storing written data; a written data separation part 33 for separating the written data into character images and graphic images; a character storage part 34 for storing the character images; a character recognition part 35 for shaping the character images by recognizing them; a graphic storage part 41 for storing the graphic images; a region extraction part 42 for segmenting a region from the graphic images; a pattern determination part 43 for judging the pattern of the graphic images in the region; a size adjusting part 44 for adjusting the size of the region when the number of graphics in the region is large; an image conversion part 45 for converting the graphic images according to a conversion rule when the number of graphics in the region is proper; a conversion rule storage part 46 for storing a conversion rule in advance; a composition part 36 for compositing the shaped character images and the graphic images; and a composite data storage part 37 for storing the composite images. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a writing data processing apparatus that processes writing data obtained by digitizing writing on a medium such as paper.

  An optically readable position coding pattern that enables position determination is provided on at least a portion of the surface of the sheet of paper, and information written or plotted on the surface using this position coding pattern There is known a technique for providing the electronic symbol (see, for example, Patent Document 1). In this patent document 1, the position encoding pattern includes a plurality of marks and a plurality of reference positions, and the plurality of marks are respectively associated with the plurality of reference positions. The value of each mark is determined by the position relative to the reference position. The provision of an electronic symbol is possible by continuously determining the position of the pen on the sheet of paper by reading the position coding pattern.

Japanese translation of PCT publication No. 2003-511761

  By the way, as a general request for information written or plotted on the surface of such a sheet of paper, after providing its electronic symbol, part of it can be separated from the whole or part of it can be Sometimes you want to work differently from the part. However, heretofore, no solution to such a requirement has been proposed.

  The present invention has been made under the background as described above, and its purpose is to separate a part of written data from the whole or process a part of it separately from other parts. It is to make it easy.

  For this purpose, in the present invention, a part of the writing data is separated using the mode information when writing. That is, the writing data processing device of the present invention is a first storage means for storing writing data obtained by digitizing writing on a medium in association with mode information when the original writing is made for each portion of the writing data. And a separation means for separating a specific part associated with specific mode information from the writing data stored in the first storage means, and a second part for storing the specific part separated by the separation means Storage means.

Here, as the mode information, it is possible to adopt the color of a pen that performs writing. In this case, the separating unit separates the part with the specific color as the specific part.
In addition, the writing data processing apparatus of the present invention can further include a processing unit that processes a specific part stored in the second storage unit based on mode information associated with the specific part.
Again, the pen color for writing can be adopted as the mode information. In this case, the processing means processes the specific part by a method associated with the color assigned to the specific part.

On the other hand, the present invention can also be understood as a program for causing a computer to realize a predetermined function.
In this case, the first program of the present invention stores the writing data obtained by digitizing the writing on the medium in the computer in association with the mode information when the original writing is made for each portion of the writing data. And a function for separating a specific part associated with specific mode information from the writing data and a function for storing the separated specific part.

  The second program of the present invention has a function of storing, in a computer, writing data obtained by digitizing writing on a medium in association with mode information when the original writing is made for each portion of the writing data. This is to realize a function of processing a specific part of the writing data based on mode information associated with the specific part and a function of storing the processed specific part.

  According to the present invention, it is possible to easily perform a process of separating a part of writing data from the whole or processing a part of the writing data separately from other parts.

The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below in detail with reference to the accompanying drawings.
First, a system to which this embodiment is applied will be described.
FIG. 1 is a diagram showing an overall configuration of a system to which the present embodiment is applied.
As shown in the figure, in this computer system, a digital pen 60 and a computer 70 are connected via a communication means 90.

  The digital pen 60 is a pen device used for writing on a medium such as paper. Here, it is assumed that a position code image obtained by imaging a position code pattern is printed on this medium. Any method may be used for generating the position code pattern and the shape of the position code image as long as the digital pen 60 can recognize the writing position. For example, what was shown to patent document 1 can also be used. The digital pen 60 optically reads the content (handwritten manuscript) written on such a medium and digitizes it to generate written data. Then, this is transmitted to the computer 70 via the communication means 90.

The computer 70 receives writing data from the digital pen 60 and performs various processes on the writing data. An example of the computer 70 is a personal computer (PC).
As long as the communication means 90 can transmit the writing data produced | generated with the digital pen 60 to the computer 70, what kind of thing may be sufficient as it. An example is USB (Universal Serial Bus).

Next, the digital pen 60 will be described.
FIG. 2 is a diagram illustrating a hardware configuration of the digital pen 60.
As shown in the figure, the digital pen 60 includes a CPU 61 that controls the operation of the entire pen, a pressure sensor 62 that detects a writing operation by the digital pen 60 based on pressure applied to the pen tip 69, and a red that irradiates infrared light on the medium. It has an outer LED 63 and an infrared CMOS 64 for inputting an image. Also, a RAM 65 for storing writing data and the like configured based on a code pattern image read from a medium, a communication interface (hereinafter referred to as “communication I / F”) 66 for communicating with an external device such as a computer 70, A battery 67 for driving the pen and a ROM 68 for storing pen identification information (pen ID) and the like are included.

Here, an outline of the operation of the digital pen 60 will be described.
When writing with the digital pen 60 is performed, the pressure sensor 62 connected to the pen tip 69 detects the writing operation. Thereby, the infrared LED 63 is turned on, and the infrared CMOS 64 captures an image on the medium by the CMOS sensor. The infrared LED 63 is pulsed in synchronization with the shutter timing of the CMOS sensor in order to reduce power consumption.
When an image is captured in this way, the digital pen 60 takes out a position code image from the captured image and converts it into a position code pattern under the control of the CPU 61. And writing data is produced | generated by connecting the writing position determined by this position code pattern, and it stores in RAM65.

  Although not shown in FIG. 2, in the present embodiment, the digital pen 60 is assumed to include a switch that enables switching of the pen color. The switching of the pen color by this switch is transmitted to the inside of the digital pen 60 in real time and stored in the RAM 65. Thus, when the pressure sensor 62 detects a writing operation by the digital pen 60, the writing data is stored in the RAM 65 in association with the color information stored when the writing of each part is performed under the control of the CPU 61. Is done.

Next, the computer 70 will be described.
FIG. 3 is a diagram illustrating a hardware configuration of the computer 70.
As shown in the figure, the computer 70 includes a CPU (Central Processing Unit) 301 as a calculation means, a main memory 302 as a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 303. Here, the CPU 301 executes various types of software such as an OS (Operating System) and applications, and realizes functions described below. The main memory 302 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 303 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 70 includes a communication I / F 304 for performing communication with the outside, a display mechanism 305 including a video memory and a display, and an input device 306 such as a keyboard and a mouse.

In the system having such a hardware configuration, in the present embodiment, for example, the processing shown in FIGS. 4 and 5 is performed on a handwritten document. In the present embodiment, “shaping”, which is often performed on a handwritten document, is considered as an aspect of processing.
First, FIG. 4 shows a case where a handwritten flowchart in which characters and graphics are mixed is separated into a graphic portion and a character portion. Here, when a flowchart is drawn on a medium using the digital pen 60, letters such as “START”, “END”, “Yes”, and “No” are drawn in color A, and a figure is drawn in other colors. . In this way, the character portion can be separated from the other portions by making the color of the character portion different from the other portions.

  FIG. 5 shows a case where a graphic part and a character part of a handwritten document are shaped and combined to generate a shaped flowchart. Here, when drawing a flowchart on a medium using the digital pen 60, a rectangle with rounded corners (a figure surrounding “START” and “END”) is drawn in color B. Further, it is assumed that a rectangle with right angles is drawn with color C, a diamond is drawn with color D, and a graphic representing a paper list is drawn with color E. The arrows connecting these figures are drawn in color F. In this way, by changing the color for each type of graphic, it is possible to perform shaping according to a shaping rule corresponding to the type of graphic. On the other hand, the characters separated in FIG. 4 are shaped by performing character recognition.

Hereinafter, the present embodiment for performing such shaping will be described in detail.
FIG. 6 is a block diagram showing a functional configuration of the writing data processing apparatus according to the present embodiment. The writing data processing apparatus can be realized by the digital pen 60 shown in FIG.
As shown in the figure, the writing data processing device in the present embodiment includes a writing data acquisition unit 31, a writing data storage unit 32, a writing data separation unit 33, a character storage unit 34, a character recognition unit 35, and a graphic. The shaping unit 40, the synthesis unit 36, and the synthesis data storage unit 37 are provided.

The writing data acquisition unit 31 acquires writing data obtained by digitizing writing on the medium, and the writing data storage unit 32 stores the writing data. The writing data separation unit 33 separates the writing data into a character image and a graphic image based on the color added to the writing data. The character storage unit 34 stores the separated character image, and the character recognition unit 35 recognizes the character image and replaces it with a character image based on the corresponding character code.
The figure shaping unit 40 shapes the separated figure image for each figure according to the color assigned to each figure. The combining unit 36 combines the shaped character image and the graphic image, and the combined data storage unit 37 stores the combined writing data (shaped writing data).

The figure shaping unit 40 will be described in more detail. The figure shaping unit 40 includes a figure storage unit 41, a region extraction unit 42, a pattern determination unit 43, a size adjustment unit 44, an image conversion unit 45, and a conversion rule. And a storage unit 46.
The graphic storage unit 41 stores the graphic image separated by the writing data separation unit 33, and the region extraction unit 42 cuts out a predetermined region from the graphic image. The pattern determination unit 43 determines the pattern of the graphic image in the cut out region, and the size adjustment unit 44 changes the size of the region when the determined pattern does not satisfy a predetermined condition. The image conversion unit 45 converts the graphic image using a conversion rule (shaping rule) according to the color added to the graphic image and the determined pattern. The conversion rule storage unit 46 stores the conversion rule used at this time.

These functions are realized by cooperation between software and hardware resources.
First, when the writing data processing device is realized by the digital pen 60, the writing data acquisition unit 31, the writing data separation unit 33, the character recognition unit 35, the synthesis unit 36, the region extraction unit 42, the pattern determination unit 43, the size The adjustment unit 44 and the image conversion unit 45 are realized by the CPU 61 reading a program for realizing these functions from the ROM 68. The writing data storage unit 32, the character storage unit 34, and the graphic storage unit 41 can be realized using, for example, the RAM 65, and the conversion rule storage unit 46 can be realized using, for example, the ROM 68. Furthermore, data such as programs and conversion rules stored in the ROM 68 may be loaded from a recording medium such as a CD, or may be downloaded via a network such as the Internet.

  When the writing data processing device is realized by the computer 70, the writing data acquisition unit 31, the writing data separation unit 33, the character recognition unit 35, the synthesis unit 36, the region extraction unit 42, the pattern determination unit 43, and the size adjustment. The unit 44 and the image conversion unit 45 are realized by the CPU 301 reading a program for realizing each of these functions from the magnetic disk device 303 to the main memory 302. The writing data storage unit 32, the character storage unit 34, and the graphic storage unit 41 can be realized by using, for example, the magnetic disk device 303. Further, data such as programs and conversion rules stored in the magnetic disk device 303 may be loaded from a recording medium such as a CD, or may be downloaded via a network such as the Internet.

Here, the conversion rule memorize | stored in the conversion rule memory | storage part 46 is demonstrated concretely.
FIG. 7 is a diagram showing an example of such a conversion rule.
As shown in the figure, in this conversion rule, after the conversion, the color added to the graphic image in the area cut out by the area extraction unit 42 and the pattern of the intersection of the frame of the area and the line of the graphic are converted. Graphic images are defined. In the figure, the graphic image before conversion is not shown, but this is because the pattern of the intersection of the region frame and the graphic line can be easily specified from the converted graphic image. For example, pattern 1 for color B is a pattern in which a graphic line intersects the left side of the rectangular frame at two points.

Hereinafter, the conversion rules will be specifically described.
For color B, a graphic image after conversion is defined for patterns 1 to 3. This color B is a color used when drawing a rectangle with rounded corners. Therefore, a conversion rule suitable for shaping a quadrangle with rounded corners is also defined.
First, pattern 1 is a pattern in which a graphic line intersects the left side of the rectangular frame at two points. Pattern 2 is a pattern in which a graphic line intersects the left and right sides of the rectangular frame at one point. Pattern 3 is a pattern in which a graphic line intersects the left side and the lower side of the rectangular frame at one point. In either case, it is stipulated that the figure from one point to the other point should be shaped following the figure shown without changing the position of the two intersections.

For color C, a converted graphic image is defined for patterns 1 to 3. This color C is a color used when drawing a quadrangle with right angles. Therefore, a conversion rule that is suitable for shaping a quadrangle having a right angle is defined.
First, pattern 1 is a pattern in which a graphic line intersects the left side of the rectangular frame at two points. Pattern 2 is a pattern in which a graphic line intersects the left and right sides of the rectangular frame at one point. Pattern 3 is a pattern in which a graphic line intersects the left side and the lower side of the rectangular frame at one point. In either case, it is stipulated that the figure from one point to the other point should be shaped following the figure shown without changing the position of the two intersections.

For color D, converted graphic images are defined for patterns 1 to 4. This color D is a color used when drawing a rhombus. Therefore, a conversion rule that is suitable for shaping the rhombus is also defined.
First, pattern 1 is a pattern in which a graphic line intersects with the upper left side and lower left side of the rhombus at one point. Pattern 2 is a pattern in which a graphic line intersects with the upper left side and lower right side of the rhombus at one point. Pattern 3 is a pattern in which a graphic line intersects the upper left side and upper right side of the rhombus at one point. Pattern 4 is a pattern in which a graphic line intersects with the lower left and upper right sides of the rhombus at one point. In either case, it is stipulated that the figure from one point to the other point should be shaped following the figure shown without changing the position of the two intersections.

Note that the conversion rule similar to the above is defined for the color E shown in FIG. 5, but is omitted in FIG. The color E is a color used when drawing a graphic representing a paper list. Therefore, a conversion rule that is suitable for shaping such a figure is defined.
Further, when the figure after shaping becomes complicated as described above, the user can simply draw, for example, a square having right angles. In other words, by shaping this quadrangle with a right angle by the shaping rule, it is possible to obtain a graphic representing a list of papers of almost the same size.

  By the way, in this embodiment, since the shaping of the flowchart is assumed, an arrow may be connected to a square with rounded corners, a square with squared corners, a rhombus, or the like. Here, the arrow is drawn in the color F. Therefore, when there are color B and color F in the area (color B + color F), when color C and color F are in the area (color C + color F), and when color D and color F are in the area ( Conversion rules are also defined for color D + color F).

For color B + color F, converted graphic images are defined for patterns 1 and 2. This color B + color F is a combination of colors that appear in a portion where an arrow is connected to a square with rounded corners. Therefore, a conversion rule that is suitable for shaping a connection portion between a rectangle with rounded corners and an arrow is defined.
First, pattern 1 is a pattern in which a square line with rounded corners intersects the left side of the square frame at two points, and an arrow line intersects the right side of the square frame at one point. Pattern 2 is a pattern in which a square line with rounded corners intersects the left and right sides of the square frame at one point, and an arrow line intersects the upper side of the square frame at one point. In either case, for squares with rounded corners, it is stipulated that the shape from one point to the other point should be shaped according to the figure shown without changing the position of the two intersections. Has been. Regarding the arrow, it is stipulated that the figure from the intersection to the point on the quadrangle with rounded corners should be shaped following the figure shown without changing the position of one intersection.

For color C + color F, converted graphic images are defined for patterns 1 and 2. This color C + color F is a combination of colors that appear in a portion where an arrow is connected to a quadrangle with right angles. Therefore, a conversion rule suitable for shaping a connection portion between a square having a right angle and an arrow is defined.
First, pattern 1 is a pattern in which a square line with a right angle intersects the left side of the square frame at two points, and an arrow line intersects the right side of the square frame at one point. Pattern 2 is a pattern in which a square line with a right angle intersects the left and right sides of the square frame at one point, and an arrow line intersects the upper side of the square frame at one point. In either case, for a quadrangle with a right angle, the shape from one point to the other point should be shaped following the shape shown without changing the position of the two intersections. It is prescribed. With respect to the arrow, it is stipulated that the figure from the intersection to the point on the square with a right angle should be shaped to follow the figure shown without changing the position of one intersection. .

For color D + color F, converted graphic images are defined for patterns 1 and 2. This color D + color F is a combination of colors that appear in a portion where an arrow is connected to a diamond. Therefore, a conversion rule that is suitable for shaping the connecting portion of the diamond and the arrow is also defined.
First, the pattern 1 is a pattern in which the rhombus line intersects with the upper left side and the lower left side of the rhombus frame at one point, and the arrow line intersects with the upper right side of the rhombus frame at one point. Pattern 2 is a pattern in which the rhombus line intersects with the upper left side and the upper right side of the rhombus frame at one point, and the arrow line intersects with the lower left side at one point. In either case, the rhombus is specified that the shape from one point to the other point should be shaped according to the figure shown without changing the position of the two intersections. . With respect to the arrows, it is stipulated that the figure from the intersection to the point on the diamond should be shaped following the figure shown without changing the position of one intersection.

FIG. 7 shows only a part of the conversion rule.
For example, pattern 1 for color B is one in which the graphic line intersects the left side of the square frame at two points, but apart from this, the pattern line also intersects the right side of the rectangular frame at two points. Conversion rules are defined. In the pattern 3 for the color B, the figure line intersects the left side and the bottom side of the square frame at one point, but apart from this, the figure line is one point each from the left side and the top side of the square frame. Conversion rules are also defined for patterns that intersect at one point, patterns that intersect with the right and top sides of the square frame at one point, and patterns that intersect with the right and bottom sides of the square frame at one point. The

Alternatively, when the image conversion unit 45 interprets the conversion rule in FIG. 7, the converted graphic image for a similar pattern may be interpreted by analogy.
For example, pattern 1 for color B is a graphic line that intersects the left side of the square frame at two points. From now on, the conversion rule for the pattern in which the graphic line intersects the right side of the square frame at two points Make sure it can be derived. In the pattern 3 for the color B, the figure line intersects with the left side and the bottom side of the square frame at one point, but the figure line intersects with the left side and the top side of the square frame at one point. It is also possible to derive a conversion rule for a pattern in which a pattern and a graphic line intersect with the right side and the upper side of the square frame at one point, and a pattern in which a graphic line intersects with the right side and the lower side of the square frame at one point, respectively.

If the analogy of such a pattern is considered, the conversion rule of FIG. 7 can be summarized into the following pattern.
(a) Pattern for square area • Pattern that intersects either left or right side at two points • Pattern that intersects each left or right side at one point • Pattern that intersects two adjacent sides at one point • Left or right A pattern that intersects one of the sides at two points, intersects the side facing that side at one point, intersects each of the left and right sides at one point, and intersects at one point with the sides between those sides pattern
(b) Patterns for the rhombus area ・ Pattern that intersects each of the opposite sides at one point ・ Pattern that intersects each of the two adjacent sides at one point ・ Intersection of each of the two adjacent sides at one point A pattern that intersects one side with one side

Next, the operation of the writing data processing apparatus shown in FIG. 6 will be described.
In the writing data processing apparatus, first, the writing data acquisition unit 31 acquires writing data. When the writing data processing device is realized by the digital pen 60, the writing data acquisition unit 31 of the digital pen 60 acquires the writing data stored in the RAM 65 by the operation described with reference to FIG. . On the other hand, when the writing data processing apparatus is realized by the computer 70, the writing data stored in the RAM 65 by the operation described with reference to FIG. 2 is sent to the computer 70 via the communication I / F 66, and the computer 70 70 of the writing data acquisition unit 31 acquires this. In any case, the writing data acquisition unit 31 acquires color information added to each portion of the writing data in addition to the writing data.
The writing data and the color information acquired by the writing data acquisition unit 31 are stored in the writing data storage unit 32.

Thereafter, the writing data separation unit 33 reads the writing data from the writing data storage unit 32 and separates it into a graphic image and a character image. At this time, the writing data separating unit 33 separates the writing data based on the color added to the writing data. In the example shown in FIGS. 4 and 5, the portion written with the color A is separated as a character image, and the portion added with other colors is separated as a graphic image.
As a result, the character image is stored in the character storage unit 34 and the graphic image is stored in the graphic storage unit 41.

Among these, the character image stored in the character storage unit 34 is shaped by replacing the character image corresponding to each character code by the character recognition unit 35 performing character recognition and acquiring the character code.
On the other hand, the graphic shaping unit 40 shapes the graphic image stored in the graphic storage unit 41.

Here, the operation of the figure shaping unit 40 will be described in detail.
FIG. 8 is a flowchart showing the operation of the graphic shaping unit 40 at this time.
When the operation starts, first, the region extraction unit 42 randomly selects one point P on the graphic image stored in the graphic storage unit 41 (step 301). For example, the random number generator generates one address of the graphic storage unit 41, reads the pixel at that address, and if it is a white pixel, reselects the point P, and if it is a pixel of a color other than white, the address Is the address of point P.

Next, the area extraction unit 42 determines whether or not the selected point P is the color D (step 302).
Here, when it is determined that the point P is not the color D, as illustrated in FIG. 5, the graphic including the point P is a graphic other than the rhombus. Therefore, the area extraction unit 42 cuts out a rectangular area from the graphic image stored in the graphic storage unit 41 (step 303). That is, addresses in a rectangular area of a predetermined size are sequentially generated around the point P selected in step 301, and a graphic image is read from the graphic storage unit 41 using the addresses. Then, the area extraction unit 42 passes control to the pattern determination unit 43.

Next, the pattern determining unit 43 determines whether or not two or more colors are included in the rectangular area except for the color F (step 304). This is because the conversion rule shown in FIG. 7 can be applied when a single-color graphic is included in the region, or when a single-color graphic to which an arrow of color F is connected is included. .
If it is determined that two or more colors other than the color F are included, the pattern determination unit 43 passes control to the size adjustment unit 44. Then, the size adjusting unit 44 reduces the size of the region and returns control to the region extracting unit 42 (step 305), and the region extracting unit 42 cuts out the square region having the adjusted size again (step 303). Then, this process is repeated until a state in which one color figure is included in the region or one color figure to which the arrow of color F is connected is obtained.

  On the other hand, when it is determined in step 302 that the point P is the color D, the graphic including the point P is a diamond as shown in FIG. Therefore, the area extraction unit 42 cuts out a rhombus area from the graphic image stored in the graphic storage unit 41 (step 306). That is, addresses in a diamond area of a predetermined size are generated sequentially around the point P selected in step 301, and a graphic image is read from the graphic storage unit 41 using the addresses. Then, the area extraction unit 42 passes control to the pattern determination unit 43.

Next, the pattern determination unit 43 determines whether or not two or more colors are included in the rhombus area except for the color F (step 307). This is because the conversion rule shown in FIG. 7 can be applied when a single-color graphic is included in the region, or when a single-color graphic to which an arrow of color F is connected is included. .
If it is determined that two or more colors other than the color F are included, the pattern determination unit 43 passes control to the size adjustment unit 44. Then, the size adjusting unit 44 reduces the size of the region and returns control to the region extracting unit 42 (step 308), and the region extracting unit 42 cuts out the adjusted rhombus region again (step 306). Then, this process is repeated until a state in which one color figure is included in the region or one color figure to which the arrow of color F is connected is obtained.

By the way, in the previous step 304, when a state in which one color figure is included in the area or a state in which one color figure to which the arrow of the color F is connected is obtained, the color D in the area is obtained. Is determined (step 309). However, when the point P is the color D, the determination result in step 302 is “Yes”, and therefore it is determined whether or not two colors of the color D and the color F are included in the region. become.
As a result, when the color D exists in the region, the processing of steps 306 to 308 is executed as in the case where the point P is the color D.

  By such processing, when the region to which the conversion rule of FIG. 7 can be applied can be extracted, that is, when the determination result in Step 309 is “No”, or the determination result in Step 307 is “No”. When it becomes, the area extraction unit 42 passes control to the pattern determination unit 43, and the pattern determination unit 43 determines which pattern the graphic image in the area corresponds to (step 310).

(a) Pattern for square area • Pattern that intersects either left or right side at two points • Pattern that intersects each left or right side at one point • Pattern that intersects two adjacent sides at one point • Left or right A pattern that intersects one of the sides at two points, intersects the side facing that side at one point, intersects each of the left and right sides at one point, and intersects at one point with the sides between those sides pattern
(b) Patterns for the rhombus area ・ Pattern that intersects each of the opposite sides at one point ・ Pattern that intersects each of the two adjacent sides at one point ・ Intersection of each of the two adjacent sides at one point A pattern that intersects one side with one side

When the pattern is determined, control is passed to the image conversion unit 45, and the image conversion unit 45 converts the graphic image with reference to the conversion rule storage unit 46 (step 311). In other words, the converted graphic image corresponding to the combination of the color assigned to the conversion target portion and the pattern determined in step 310 is extracted from the conversion rule of FIG. 7, and the conversion target portion is extracted from this graphic image. replace.
Thereafter, the region extraction unit 42 determines whether the processing is finished (step 312). For example, a threshold is determined in advance as the number of selections of the point P sufficient to complete the shaping of the graphic image, and it is determined whether or not the number of selections of the point P has exceeded this threshold.
If the machining has not been completed, the process returns to step 301. If the machining has been completed, the process is terminated.

Thus, the operation of the present embodiment ends.
In the above description, the handwritten document is separated or processed according to the color when writing with the digital pen 60, but the information used for the separation or processing is not necessarily limited to the color. For example, the digital pen 60 can be provided with a switch for switching between a special mode such as a character mode and a graphic mode, and a handwritten document can be separated or processed based on the mode information.
In this embodiment, a flowchart is assumed as an object of separation and shaping. However, this is only an example, and if a rule corresponding to the object is defined, any other object can be separated and shaped. It is possible to do.
In addition, the present embodiment is applicable not only when “shaping” a handwritten document but also when performing some kind of processing.

  As described above, in the present embodiment, part of the writing data is separated from the whole by using the mode information at the time of writing, or part of the writing data is processed separately from the other parts. As a result, such separation and processing can be easily performed.

It is the figure which showed the structure of the system with which embodiment of this invention is applied. It is the figure which showed the hardware constitutions of the digital pen in the system of embodiment of this invention. It is the figure which showed the hardware constitutions of the computer in the system of embodiment of this invention. It is a figure which shows the example of isolation | separation of the handwritten flowchart by embodiment of this invention. It is a figure which shows the shaping example of the handwritten flowchart by embodiment of this invention. It is the block diagram which showed the function structure of the writing data processing apparatus in embodiment of this invention. It is the figure which showed the example of the conversion rule used by embodiment of this invention. It is the flowchart which showed operation | movement of the figure shaping part of the writing data processing apparatus in embodiment of this invention.

Explanation of symbols

60 ... Digital pen, 70 ... Computer, 90 ... Communication means

Claims (8)

First storage means for storing writing data obtained by digitizing writing on a medium in association with mode information when the original writing is made for each portion of the writing data;
Separating means for separating a specific portion associated with specific mode information from the writing data stored in the first storage means;
A writing data processing apparatus comprising: a second storage unit that stores the specific portion separated by the separation unit. The mode information is the color of the pen that performs the writing,
The writing data processing apparatus according to claim 1, wherein the separating unit separates a portion with a specific color as the specific portion.   2. The writing data according to claim 1, further comprising processing means for processing the specific part stored in the second storage means based on the mode information associated with the specific part. Processing equipment.   4. The handwritten data processing apparatus according to claim 3, wherein the processing unit shapes the specific portion with a region having a shape corresponding to the mode information associated with the specific portion as a unit. The mode information is the color of the pen that performs the writing,
4. The writing data processing apparatus according to claim 3, wherein the processing means processes the specific part by a method associated with a color assigned to the specific part. On the computer,
A function of storing writing data obtained by digitizing writing on a medium in association with mode information when the original writing is made for each portion of the writing data;
A function of separating a specific part associated with specific mode information from the writing data;
A program for realizing a function of storing the separated specific part. On the computer,
A function of storing writing data obtained by digitizing writing on a medium in association with mode information when the original writing is made for each portion of the writing data;
A function of processing a specific portion of the writing data based on the mode information associated with the specific portion;
A program for realizing a function of storing the processed specific part.   8. The program according to claim 7, wherein in the function to be processed, the specific part is shaped with a region having a shape corresponding to the mode information associated with the specific part as a unit.

Images