WO2008004624A1

WO2008004624A1 - Handwritten input processing device, handwritten input processing method, and handwritten input processing program

Info

Publication number: WO2008004624A1
Application number: PCT/JP2007/063468
Authority: WO
Inventors: Takeo Igarashi
Original assignee: The University Of Tokyo
Priority date: 2006-07-07
Filing date: 2007-07-05
Publication date: 2008-01-10
Also published as: JP4752066B2; JP2008015929A

Abstract

An electronic board system (20) includes a display unit (30) having a plot display screen (31). When a series of handwritten input operations is performed on the plot display screen (31), coordinates of a stroke S based on the series of handwritten input operations on the plot display screen (31) are acquired (step S100). According to the acquired coordinates, a plurality of strokes S spatially grouped on the plot display screen (31) are grouped into one group (step S120). The plot display screen (31) displays a bubble B as a group identifying display indicating belonging of the stroke S to the group (step S150).

Description

Specification

Handwriting input processing device, handwriting input processing method, and program for handwriting input processing

Technical field

[0001] The present invention relates to a handwriting input processing device, a handwriting input processing method, and a program for handwriting input processing. Background art

Conventionally, as a handwriting input processing device configured as an electronic whiteboard, for example, by inputting a stroke on a screen (board) via an input pen, an arbitrary character or line diagram is displayed on the screen. (For example, see Patent Document 1.) o In the device described in Patent Document 1, when the user finishes inputting a stroke, the segment surrounding the stroke input on the screen is known. Is displayed, and strokes can be processed in this segment unit. For example, when a new stroke is drawn in a segment, the new stroke is incorporated into the segment. In addition, if there are two segments on the screen! /, You can combine the two segments by entering a stroke that connects these two segments. In this device, overlapping of segments is prohibited, and when any segment is brought closer to another segment, the other segment is reduced on the screen.

[0003] Patent Document 1: US Pat. No. 6,459,422

Disclosure of the invention

[0004] Stroke processing in segment units disclosed in Patent Document 1 is considered to be one useful technique for handling handwritten input strokes. However, the device described in Patent Document 1 requires a special operation of inputting a stroke connecting two segments, for example, when two segments are combined. However, it is not satisfactory. In addition, the above-mentioned Patent Document 1 describes in detail how to set and display segments, how to combine segments, and the like.

[0005] Therefore, the handwriting input processing device, the handwriting input processing method, and the handwriting input according to the present invention. One of the purposes of the force processing program is to improve usability when handwriting input is executed on the screen. Further, the handwriting input processing device, the handwriting input processing method, and the handwriting input processing program according to the present invention are spatially grouped on the screen in order to improve usability when executing handwriting input on the screen. One purpose is to more appropriately group multiple strokes.

[0006] A handwriting input processing device, a handwriting input processing method, and a program for handwriting input processing according to the present invention employ the following means in order to achieve at least a part of the above object.

[0007] A handwriting input processing apparatus according to the present invention comprises:

A display unit that accepts handwriting input operations on a screen and displays strokes based on a series of handwriting input operations on the screen;

Coordinate acquisition means for acquiring coordinates on the screen of the stroke, and a plurality of strokes grouped spatially on the screen based on the acquired coordinates, and grouped as one group Grouping means;

Display control means for displaying a group identification display indicating attribution of the stroke to the group on the screen;

Group processing means for executing a group process, which is a process for the group according to the operation, when a predetermined operation is performed on the group on the screen.

[0008] In this handwriting input processing device, when a series of handwriting input operations are performed on the screen of the display unit, the coordinates of strokes based on the series of handwriting input operations are acquired. Based on the acquired coordinates, multiple strokes that are close to each other on the screen or overlapped and spatially grouped are grouped as one group, and the strokes belong to the group on the screen. The group identification display indicating is displayed. Then, when a predetermined operation for a group such as a movement operation is performed on the screen, a group process that is a process for the group corresponding to the operation is executed. As a result, in this handwriting input processing apparatus, if a spatial group of strokes is constructed on the screen, a plurality of strokes are grouped and a group unit is created. It is possible to process strokes in the order. Therefore, according to the handwriting input processing device, it is possible to improve usability when executing handwriting input on the screen.

[0009] The grouping means includes distance calculation means for calculating a distance on the screen between a pair of strokes, and the pair of strokes when the calculated distance is equal to or less than a predetermined threshold value. They may be grouped together. This makes it possible to more appropriately group a plurality of strokes grouped spatially on the screen according to the state of grouping.

[0010] In addition, the grouping means may group the pair of strokes that are not grouped together when the distance between the pair of strokes is equal to or less than a first threshold. In addition, when the distance between a pair of strokes that have already been grouped is equal to or less than a second threshold value that is greater than the first threshold value, the grouping of the paired strokes is maintained. It may be a thing. As a result, when the positional relationship of the strokes on the screen is changed, it is relatively difficult to group strokes that have not been grouped so far, and the grouping of constructed groups is made easier. It becomes possible to make it difficult to release. Therefore, it is possible to change the positional relationship of strokes (groups) on the screen while suppressing unintentional stroke grouping, so that it is more convenient to perform handwriting input on the screen. It can be further improved.

[0011] Further, the handwriting input processing device according to the present invention comprises a group range setting means for setting a group range which is a range on the screen of the group based on the acquired coordinates of the stroke and a predetermined constraint. The display control means that may further include: the set group range may be displayed on the screen as the group identification display. This makes it possible to easily identify one group and its associated stroke on the screen.

[0012] In this case, the group range setting means corresponds to a stroke in which the potential based on the potential field applied to each stroke is grouped at least spatially based on the acquired coordinates. A potential calculating means for calculating the region, and a boundary surrounding the region where the calculated potential is equal to or greater than a predetermined threshold. Boundary setting means for setting as a group range. In this way, when a virtual potential field is assigned to each stroke and the potentials of each stroke are calculated for the area corresponding to the stroke that is at least spatially organized (area on the screen), The calculated potential value increases in the region where the stroke density is high, that is, in the region where the degree of stroke grouping is high. Therefore, if the boundary surrounding the region where the calculated potential is equal to or greater than the predetermined threshold is defined as the group range, the group identification display indicating the attribution of the stroke to the group is displayed as a spatial arrangement of strokes on the screen. It is possible to display on the screen with more appropriate setting according to the

[0013] Further, the grouping means sets a group range, which is a range on the screen, of the group based on the acquired coordinates of the stroke and a predetermined constraint, and the stroke is set for each stroke. It may be determined whether or not the force is within the group range, and the stroke grouping is executed based on the determination result. Even if such a grouping means is used, it is possible to more appropriately group a plurality of strokes grouped spatially on the screen according to the condition of grouping.

[0014] In this case, the grouping means calculates a potential based on the potential field applied for each stroke based on the acquired coordinates for at least a region corresponding to a stroke that is spatially grouped. A potential calculation means, and a boundary setting means for setting a boundary surrounding an area where the calculated potential is equal to or greater than a predetermined threshold, and the strokes located within the boundary are grouped as a group. There may be. The display control means may display the set boundary on the screen as the group identification display.

[0015] Further, the potential field may be defined as a concentration function that defines the potential to be smaller as it moves away from each point constituting the stroke in the tangential direction of the stroke and outward. If such a concentration function is used as a potential field for assigning the concentration function to each stroke, the so-called marching square method is used to determine the group range, that is, the group range, according to the spatial arrangement of the strokes on the screen. Knowledge It is possible to set the boundary as a separate display more appropriately.

[0016] Further, the potential calculating means may calculate the potential for each grid corresponding to at least a spatially organized stroke of a plurality of grids set for the screen. .

[0017] Further, in the handwriting input processing device according to the present invention, the group processing means is configured to input the segmentation input when a segmentation stroke input operation for segmenting the group is performed on the screen. The group may be divided into a plurality of new groups based on the stroke. This makes it possible to easily divide one group constructed according to the spatial arrangement of strokes on the screen into multiple groups again. In addition, if a group is created that includes strokes that are not intended for groupings, if a split stroke is entered to separate the strokes for which groupings are intended and those that are not, It is possible to easily construct the intended group. Therefore, in the handwriting input processing device provided with such a group processing means, it is possible to further improve the usability when executing handwriting input on the screen.

[0018] In this case, the group processing means groups the strokes located on one side of the dividing stroke among the strokes belonging to the group as a new group, and on the other side of the dividing stroke. The strokes located at may be grouped together as a new drape. Further, the potential calculation means for the handwriting input processing device to calculate the potential based on the potential field applied to each stroke based on the acquired coordinates for at least a region corresponding to the spatially grouped stroke. And a boundary setting means for setting a boundary surrounding an area where the calculated potential is equal to or greater than a predetermined threshold, the group processing means is formed based on the boundary and the dividing stroke For each two loops, the strokes in the loop may be grouped as a group.

[0019] Further, the grouping means may execute the grouping of strokes when the positional relationship of the strokes on the screen is changed. This place If any stroke or group is moved on the screen or a new stroke is created and the stroke positional relationship is changed on the screen, the grouping of strokes is executed. Become. Therefore, if a new stroke is added near a certain stroke or group, or if any stroke or group is moved closer to another group on the screen, those strokes etc. are automatically grouped. It becomes possible to hesitate.

[0020] Further, the handwriting input processing device according to the present invention includes a selection of a group mode in which grouping by the grouping means, display processing by the display control means, and group processing by the group processing means are enabled, and A group mode setting means that can cancel the selection may be further provided. This makes it possible to select an arbitrary group mode, and it is also possible to execute construction of multiple groups or cancellation of grouping in one action.

[0021] Further, the handwriting input processing device according to the present invention performs processing for any one of the strokes according to the operation when any predetermined operation is performed on any of the strokes belonging to the group. You may further provide the individual processing means which performs a certain individual process.

[0022] Further, in the handwriting input processing device according to the present invention, the display unit can display an object based on a predetermined object input operation on the screen, and the coordinate acquisition means includes the object of the object. The grouping means that can acquire the coordinates on the screen groups the strokes and objects that are spatially grouped on the screen based on the acquired coordinates as one group. Even handwritten.

[0023] The handwriting input device according to the present invention may be configured as an electronic board system including an electronic board capable of detecting absolute coordinates on the screen designated by a predetermined input device as the display unit. The display unit may be configured as a tablet computer including a tablet capable of detecting absolute coordinates on the screen designated by a predetermined input device. That is, the handwriting input processing device according to the present invention is extremely useful when configured as a device that enables input display of characters, diagrams, and the like on the screen. [0024] A handwriting input processing method according to the present invention includes:

A handwriting input processing method using a display unit that accepts a handwriting input operation on a screen and displays a stroke based on a series of handwriting input operations on the screen,

(a) obtaining coordinates on the screen of the stroke;

(b) Based on the coordinates acquired in step (a) !, and a step of gnoleizing a plurality of strokes that are spatially combined on the screen as one gnole; and

(c) displaying a group identification display indicating the attribution of the stroke to the group on the screen;

(d) executing a group process that is a process for the group in accordance with the operation when a predetermined operation is performed on the group on the screen;

Is included.

[0025] According to this handwriting input processing method, if a spatial unit of strokes is constructed on the screen, a plurality of strokes can be grouped and processed in groups. It is possible to improve usability when performing handwriting input with.

[0026] In step (b), a distance on the screen between a pair of strokes is calculated, and when the calculated distance is equal to or less than a predetermined threshold, the pair of strokes are grouped together.

[0027] Further, in step (b), when the distance between a pair of ungrouped strokes is less than or equal to the first threshold, the pair of ungrouped strokes are grouped together and When the distance between a pair of strokes that are grouped is equal to or less than a second threshold value that is greater than the first threshold value, the grouping of the paired strokes is maintained. Anyway.

[0028] Further, the handwriting input processing method according to the present invention is a group that is a range on the screen of the group based on the coordinates of the stroke acquired in step (a) and a predetermined constraint. In the step (c), which further includes a step of setting a range, the set group range may be displayed on the screen as the group identification display. Good.

[0029] Further, in step (e), based on the coordinates acquired in step (a), the potentials due to the potential field applied to each stroke are at least spatially combined into a stroke. While calculating for the corresponding region, a boundary surrounding the region where the calculated potential is equal to or greater than a predetermined threshold may be set as the group range.

[0030] In step (b), a group range that is a range on the screen of the group is set based on the coordinates of the stroke acquired in step (a) and a predetermined constraint, and the stroke Each stroke may be determined whether or not the stroke is located within the group range, and the stroke grouping may be executed based on the result of the determination.

[0031] Further, in step (b), at least a potential corresponding to a potential field applied to each stroke based on the coordinates acquired in step (a) corresponds to a stroke that is spatially grouped. It is also possible to calculate a region, set a boundary surrounding a region where the calculated potential is equal to or greater than a predetermined threshold value, and group strokes located within the boundary as a group.

[0032] In step (c), the boundary set in step (b) may be displayed on the screen as the group identification display.

[0033] Further, in step (d), when an input operation of a dividing stroke, which is a stroke for dividing the group, is performed on the screen, a plurality of groups are newly added based on the input dividing stroke. It may be divided into groups.

[0034] Further, in step (d), of the strokes belonging to the group, the strokes located on one side of the dividing stroke are grouped as a new group, which is more than the dividing stroke. Strokes located on the other side may be dalped as a new group.

[0035] Further, in the handwriting input processing method according to the present invention, (f) the potential due to the potential field applied for each stroke based on the coordinates acquired in step (a) is summarized at least spatially. To calculate the area corresponding to the stroke And (g) a step of setting a boundary surrounding a region where the potential calculated in step (f) is not less than a predetermined threshold value. For every two loops formed on the basis of and, the strokes in the loop may be grouped as a group.

[0036] In step (b), the stroke grouping may be executed when the positional relationship of the strokes on the screen is changed.

[0037] A program for handwriting input processing according to the present invention includes:

Handwriting that accepts a handwriting input operation on the screen and displays a stroke based on a series of handwriting input operations on the screen, or a handwriting that causes the computer including the display unit to function as a handwriting input processing device An input processing program,

A coordinate acquisition module that acquires coordinates on the screen of the stroke, and a plurality of strokes that are spatially grouped on the screen based on the acquired coordinates and grouped as one group A grouping module;

A display control module for displaying a group identification display indicating attribution of the stroke to the group on the screen;

A group processing module for executing group processing, which is processing for the group according to the operation, when a predetermined operation is performed on the group on the screen;

Is provided.

Since the computer in which the program for handwriting input processing is installed functions as the handwriting input processing device according to the present invention that processes a stroke based on the handwriting input operation on the screen, the program for handwriting input processing is provided. Can improve usability when handwriting input is executed on the screen.

Brief Description of Drawings

FIG. 1 is a schematic configuration diagram of an electronic board system 20 that is a handwriting input processing device according to a first embodiment of the present invention.

FIG. 2 is a drawing table of the display unit 30 included in the electronic board system 20 according to the first embodiment. 11 is an explanatory diagram showing a display example of a display screen 31. FIG.

FIG. 3 is an explanatory diagram showing a display example of the drawing display screen 31 of the display unit 30 when the group mode is selected.

FIG. 4 is a flowchart showing an example of grouping display processing executed in the electronic board system 20 according to the first embodiment.

FIG. 5 is a flowchart showing an example of grouping processing in step S120 of FIG.

FIG. 6A is an explanatory diagram illustrating a potential field given to each stroke S in the electronic board system 20 of the embodiment.

FIG. 6B is an explanatory diagram illustrating a potential field given to each stroke S in the electronic board system 20 of the embodiment.

FIG. 7 is an explanatory diagram showing a bubble boundary bb defined by a potential based on the coordinates of each stroke S and the potential field applied to each stroke S.

FIG. 8 is an explanatory diagram illustrating a look-up table used when setting the bubble boundary bb.

9A] An illustration showing the display state of the drawing display screen 31 when an illustration is drawn by performing a handwriting input operation on the drawing display screen 31. FIG.

9B] FIG. 9B is an explanatory diagram illustrating the display state of the drawing display screen 31 when an illustration is drawn by performing a handwriting input operation on the drawing display screen 31.

[9C] FIG. 9C is an explanatory diagram illustrating the display state of the drawing display screen 31 when an illustration is drawn by performing a handwriting input operation on the drawing display screen 31.

[9D] FIG. 9D is an explanatory diagram illustrating the display state of the drawing display screen 31 when a handwriting input operation is performed on the drawing display screen 31 to draw an illustration.

FIG. 10A is an explanatory diagram illustrating a display state of the drawing display screen 31 when a group SG having a plurality of strokes S force is moved on the drawing display screen 31.

FIG. 10B is an explanatory diagram illustrating the display state of the drawing display screen 31 when the group SG having a plurality of strokes S force is moved on the drawing display screen 31.

FIG. 11 shows an example of group division processing executed in the electronic board system 20 of the embodiment. It is a flowchart which shows an example.

FIG. 12A is an explanatory diagram for explaining group division processing executed in the electronic board system 20 of the embodiment.

FIG. 12B is an explanatory diagram for explaining group division processing executed in the electronic board system 20 of the embodiment.

FIG. 12C is an explanatory diagram for describing group division processing executed in the electronic board system 20 of the embodiment.

FIG. 12D is an explanatory diagram for explaining group division processing executed in the electronic board system 20 of the embodiment.

FIG. 13 is a flowchart showing an example of grouping display processing executed in the electronic board system 20B according to the second embodiment.

FIG. 14 is an explanatory diagram illustrating a tablet computer 20C as a modification of the handwriting input processing device according to the invention.

BEST MODE FOR CARRYING OUT THE INVENTION

Next, the best mode for carrying out the present invention will be described with reference to examples.

FIG. 1 is a schematic configuration diagram of an electronic board system (electronic whiteboard) 20 as a handwriting input processing apparatus according to the first embodiment of the present invention. As shown in the figure, the electronic board system 20 of this embodiment includes a display unit 30 and a converter 40 connected to the display unit 30. The display unit 30 having the drawing display screen 31 accepts a handwriting input operation by the input pen (pointing device) 35 on the drawing display screen 31 and displays a stroke S based on a series of handwriting input operations on the drawing display screen 31. It is possible to make it. In other words, the display unit 30 is a pressure-sensitive, electromagnetic induction, infrared, or optical sensor unit that can detect the absolute coordinates (X coordinate and Y coordinate) of the drawing display screen 31 specified using the input pen 35. (Not shown) is on the back side of the drawing display screen 31 and is configured as an electronic board having a digitizer function. Note that this sensor unit is not limited to a sensor unit that is pre-installed in the display unit 30, and is separate from the display unit 30 and is drawn and displayed during use. It may be attached to the screen 31. The computer 40 is a general-purpose computer including a CPU, ROM, RAM, graphic processor (GPU), system bus, various interfaces, a storage device (hard disk drive), an external storage device, etc. (not shown). The computer 40 is installed with a handwriting input processing program according to the present invention. The program for handwriting input processing is a group of strokes S that are input and displayed by handwriting input operation on the drawing display screen 31 in order to improve the use and ease of handwriting input on the drawing display screen 31. This means that the stroke S can be processed on a group basis.

As shown in FIG. 1, the computer 40 has the cooperation of one or both of a nodeware such as a CPU, ROM, RAM, GPU, various interfaces, and a storage device and an installed handwriting input processing program. Coordinate processing unit 41, grouping calculation unit 42, potential calculation unit 43, bubble boundary setting unit 44, individual processing unit 45, group processing unit 46, image processing unit 48, and image data storage unit 49 Are constructed as functional blocks. The coordinate processing unit 41 acquires the coordinates (absolute coordinates) of the stroke S detected by the display unit 30 from the display unit 30. Further, the grouping calculation unit 42 performs calculation processing based on the coordinates of the stroke S acquired by the coordinate processing unit 41 to group the strokes S that are spatially grouped on the drawing display screen 31. Further, the potential calculation unit 43 calculates a potential based on the coordinates of each stroke S on the drawing display screen 31 and the virtual potential field assigned to each stroke S, and the bubble boundary setting unit 44 calculates the potential. A bubble boundary is set as a group range, which is a range of strokes S (groups) that are doubled based on the potential calculated by the calculation unit 43. Regardless of whether or not the grouped force is applied, the individual processing unit 45 performs the operation when any one of the strokes S is executed via the input pen 35, such as a move operation or a delete operation. The group processing unit 46 executes specific group processing for the grouped strokes S. The group processing includes group division processing for further dividing the grouped stroke S into a plurality of groups, and the group processing unit 46 includes a division processing unit 47 for executing the group division processing. The image processing unit 48 then displays images related to various tasks. Image processing is executed, and the image data storage unit 49 stores various generated image data and the like.

FIG. 2 is an explanatory diagram showing a display example of the drawing display screen 31 of the display unit 30 described above.

As shown in the figure, in the electronic board system 20, the user brings the tip of the input pen 35 into contact with the drawing display screen 31, and for example, while pressing a predetermined button (not shown) provided on the input pen 35, a desired locus is obtained. When the handwriting input operation is performed, stroke S is sequentially input and displayed, and the drawing display screen 31 displays words such as “Animals”, “Rabbit”, and “bear” according to the user's handwriting input operation. Or illustrations of rabbits and bears will be displayed. Further, in the electronic board system 20 of the present embodiment, when the above button is pressed twice while the tip of the input pen 35 is in contact with the drawing display screen 31, a menu as shown in FIG. M is displayed. For example, in addition to the general menu items such as “Move” and “Delete” of stroke S, “Undo” and “Redo”, and “Change color” of stroke S, menu M includes the above-mentioned grouping operation unit. Menu items called “group mode” are provided to enable functions of 42 and group processing unit 46. Then, when the user selects (checks) the “group mode” using the input pen 35 as shown in FIG. 2, they are brought close to each other on the drawing display screen 31 or overlapped and spatially collected. The strokes S are grouped as a predetermined grouping condition is satisfied, and the display state of the drawing display screen 31 is switched to the display state as shown in FIG.

[0044] When the group mode is selected, as shown in Fig. 3, each stroke S is displayed as it is while maintaining the same arrangement (positional relationship) as before the group mode selection. A light-colored bubble B appears around. As can be seen from FIG. 3, the stroke S grouped according to the degree of grouping on the drawing display screen 31 (for example, the stroke S constituting the word “Animals”, “bear”, A bubble B is displayed around the stroke S that constitutes the illustration “Rab bit” and the word “、” and the stroke S) that constitutes the bear illustration so as to surround all the strokes S belonging to the group. Bubble B functions as a group identification display that indicates the attribution of the stroke S to the group and the group range. For example, when the tip of the input pen 35 is placed on the bubble B around the stroke S, the grouped stroke S can be grasped and moved together by pressing the above button. Furthermore, when the above button is pressed twice with the tip of the input vent 35 placed on the bubble B around the grouped stroke S, the loop menu GM is displayed as shown in FIG. . The group menu GM allows you to select group processing, which is a collective process for grouped strokes S. “Cut” for the entire group, “Copy” for the entire group, “ “Paste”,..., “Release group”, “Drop division” t specified when executing the above-described group division processing, and a plurality of menu items corresponding to the group processing. When the desired group processing of the group menu GM is selected, the stroke S grouped by the above-described group processing unit 46 and the like is processed collectively. Of course, even in the group mode, regardless of whether it is grouped or not, when a moving operation or the like is performed for any one stroke S through the input pen 35, it is common. Similar to this type of apparatus, the individual processing unit 45 executes processing corresponding to the operation. In addition, when the above button is pressed twice with the tip of the input pen 35 placed on one stroke S, it is possible to select individual processing such as “move” or “delete” for that stroke S. The above menu M is displayed.

Under the group mode, when a new stroke S is input and displayed by a handwriting input operation on the drawing display screen 31, the position of any stroke S or any group is changed. Sometimes a stroke S grouping is performed. That is, under the group mode, if any one stroke S or any group is brought close to any other stroke S or group on the drawing display screen 31, these strokes S are grouped. Can be jealous. In addition, if any stroke S is pulled away from a certain group on the drawing display screen 31, the grouping of any stroke S can be canceled. At this time, the bubble B is deformed according to the position of the moved stroke S or the like, and the boundary of the bubble B is changed according to the groupie or its release. Therefore, bubble B also serves as a connected area that provides a clue for visually recognizing the possibility of grouping. Next, a grouping display process that is a process for realizing the grouping of strokes S as described above in the electronic board system 20 of the present embodiment will be described. Further, following the description of the grouped display process, the group division process will be described as a representative example of the group process executed by the group processing unit 46.

[0047] [Grouping display processing]

FIG. 4 is a flowchart showing an example of the grouping display process executed in the electronic board system 20 of the present embodiment. This grouped display process is executed for one cycle when “Group mode” is selected from menu M, and when the new stroke S is input under group mode, the starting power of the handwriting input operation is also completed. When a movement operation is performed to move any stroke S or group on the drawing display screen 31 under the group mode, the starting force of the movement operation is also repeated until completion. Is to be executed.

At the start of the grouped display process of FIG. 4, the coordinate processing unit 41 of the computer 40 performs a coordinate system of the drawing display screen 31 of all strokes S detected by the display unit 30 (for example, a coordinate system in pixel units). The coordinates based on (the absolute coordinates of each point constituting one stroke S) are acquired from the display unit 30 (step S100). The coordinates of all strokes S acquired by the coordinate processing unit 41 are given to the grouping calculation unit 42. The groupy calculation unit 42 is a pair of strokes S in the total strokes S displayed on the drawing display screen 31. Based on the acquired coordinates of each stroke S, the distance (shortest distance) d between the pair of strokes S is calculated for all the extracted strokes S (step S110). . Here, the distance d between the pair of striking strokes S is calculated as the minimum value of the distances between the points constituting one of the target strokes S and the points constituting the other. Is. Then, based on the distance d between the obtained pair of strokes S, the grouping calculation unit 42 executes the grouping of the strokes S spatially grouped on the drawing display screen 31 as one group. (Step S120)

[0049] The grouping process in step S120 is described in detail with reference to FIG. At the start of the grouping process in FIG. 5, the grouping unit 42 is set in advance. After obtaining the distance d corresponding to the first pair of strokes S (step S200), it is determined whether or not the pair of strokes S corresponding to the obtained distance d is already grouped (No. Step S210). If the pair of strokes S is not grouped, the threshold value dr ef serving as a criterion for grouping the pair of strokes S is set to the first value drefl (step S220). . If the target pair of strokes S has already been grouped, the threshold dref as a criterion is set to a second value dref2 that is larger than the first value d refl (step S230). . Subsequently, the distance d acquired in step S200 is compared with the threshold value dref set in step S220 or S230 (step S240). If the distance d is equal to or less than the threshold value dref, the target pair of strokes S (Step S250), if the distance d exceeds the threshold d ref, the target pair of strokes S is ungrouped (grouped). Is maintained) (step S260). Thereafter, it is determined whether or not the processing for all of the pair of strokes S has been completed (step S270), and if the processing has not been completed, steps S200 to S200 for the remaining pair of strokes S are performed according to a predetermined order. The processing of S250 or S260 is repeatedly executed, and this processing is terminated when an affirmative determination is made in step S270. As a result, when the grouping process of step S120 is executed, the strokes S that satisfy the determination criteria in step S240, that is, the strokes S that are spatially combined by being brought close to each other on the drawing display screen 31 or superimposed on each other. Will be grouped sequentially. Note that the force S depends on how the threshold value dref is set. As long as the criterion in step S240 is satisfied, the strokes S separated from each other are also grouped. The group グループ here refers to the stroke S that satisfies the criteria in step S240 for the group processing such as “Cut”, “Copy”, and “Paste” included in the above-mentioned group menu GM. It means to associate with each other so as to be regarded as one stroke.

After the grouping process as described above, the coordinates of all the strokes S acquired by the grouping operation unit 42 are given to the potential calculation unit 43, and the potential calculation unit 43 compares the coordinates of each stroke S with the coordinates of each stroke S. Using the virtual potential field assigned to each stroke S, each stroke opening is set for each of the plurality of potential grids set for the drawing display screen 31. The potential based on the coordinates of the stroke s and the potential field of each stroke s is calculated (step S130). Here, in the present embodiment, as a virtual potential field given to each stroke S, as shown in FIGS. 6A and 6B, the tangent line of the stroke S from each point constituting one stroke S is shown. A concentration function is used that defines the potential to be smaller in the direction and outward. In other words, this concentration function sets the potential at any point that constitutes one stroke S to the maximum value Pmax, and the potential is specified to become smaller in accordance with a predetermined law as it moves away from that point in the tangential direction of the stroke S and outward. At the same time, the potential at the position where the distance of any of the above point forces becomes the value rl is set to 0. As a result, a concentric potential field is virtually formed around the start point and end point of the stroke S, and an equipotential line force surrounding the stroke S along the stroke S is formed around the stroke S. A hypothetical potential field is formed. Further, the plurality of potential grids are arranged in parallel at equal intervals, for example, with a predetermined number of pixels, and have a corresponding relationship with the coordinate system of the drawing display screen 31.

[0051] In this way, when a virtual potential field is given to each stroke S, and the potential based on the coordinates of the points constituting each stroke S and the potential field is calculated for the potential grid corresponding to each stroke s, As can be seen from FIG. 7, due to the overlapping of potential fields, the potential becomes larger in the region where the density of stroke S is high, that is, the potential grid corresponding to the periphery of stroke S that is spatially organized on the screen. Therefore, the stroke S collected on the drawing display screen 31 is included in the region based on the potential grid where the calculated potential is equal to or greater than a certain threshold Pref. As shown in FIG. For, you can set the bubble boundary bb, which is the closed boundary surrounding it. The process of step S130 calculates the potential for each potential grid corresponding to each stroke S for the purpose of setting the bubble boundary bb. In this case, the potential in one potential grid is obtained by adding the potential field force as a concentration function based on the distance between the one potential grid and each point constituting each stroke S. .

[0052] The potential of each potential grid calculated by the potential calculation unit 43 The bubble boundary setting unit 44 sets the bubble boundary bb (see FIG. 7) as the boundary of the bubble B described above based on the potential of each potential grid from the potential calculation unit 43. (Step S 140). In this case, the bubble boundary setting unit 44 compares the calculated potential of each potential grid with a predetermined threshold value Pref by using a marching square method that applies the so-called marching cube method in two dimensions. Set bubble boundary bb which is the boundary of bubble B mentioned above. Thus, when comparing the potential of each potential grid and the threshold value Pref, the potential of any one of the potential grids is equal to or greater than the threshold value Pref, but adjacent to any one of the potential grids. When the potential of the potential grid falls below the threshold value Pref, a boundary corresponding to the isosurface in the marching cube method exists between these two potential grids. Based on this, in this example, a look-up table patterned as shown in Fig. 8 shows the boundary corresponding to the comparison result between the calculated potential value and the threshold value Pref between the four potential grids. It is stored in the storage unit 49 (however, in FIG. 8, black circles indicate potential grids whose potential is greater than or equal to the threshold Pref, and white circles indicate potential grids whose potential is less than the threshold Pref). In step S140, the bubble boundary setting unit 44 refers to the look-up table and displays the bubble B to be displayed on the drawing display screen 31 based on the comparison result between the potential value of each potential bold and the predetermined threshold value Pref. Set the coordinates of the bubble boundary bb. This makes it possible to set the bubble boundary bb, which is the range (group range) of the stroke S to be grouped, on the drawing display screen 31 for all strokes S on the drawing display screen 31 at a higher speed. . When the bubble boundary bb for all the strokes S on the drawing display screen 31 is set in this way, the image processing unit 48 reads necessary data from the image data storage unit 49, and the coordinates input in step S100. Based on the!, The stroke S is displayed and the bubble B corresponding to each stroke S is displayed based on the coordinates of the bubble boundary bb set in step S140 (step S150). And finish.

As described above, in the electronic board system 20 of the present embodiment, when the “group mode” is selected from the menu M, the above-described grouping display process is executed, so that a plurality of strokes are displayed. s It is possible to execute powerful group construction or group release in one action. In addition, when “Group mode” is selected, any stroke

When S or a group is moved on the drawing display screen 31 or a new stroke S is created on the drawing display screen 31 and the positional relationship of the stroke S on the drawing display screen 31 is changed, the stroke S The above-mentioned grouping display process is executed until the creation start force is completed or until the start of the movement operation is completed, so that it is possible to construct a group according to the positional relationship of the stroke S after the change. It becomes possible.

Here, referring to FIG. 9A, FIG. 9B, FIG. 9C, FIG. 9D, FIG. 10A, and FIG. 10B, the above-described grouped display processing is performed by taking the display state of the drawing display screen 31 as an example. This will be explained in detail. FIG. 9A to FIG. 9D are explanatory views illustrating the display state of the drawing display screen 31 when drawing the illustration by executing the handwriting input operation on the drawing display screen 31. FIG. When drawing a desired illustration (here, the face of a bear) by hand-writing the first ring-shaped first stroke S1 (face outline) on the drawing display screen 31, as shown in FIG. 9A, the drawing display screen 31 Above it is displayed a generally circular bubble B surrounding it with stroke S1 (step S150). If you enter the second stroke S2 (the left ear by force) in the vicinity of the first stroke S1 or in contact with the stroke S1 on the drawing display screen 31, the stroke S1 and As S2 is grouped (steps S120 and S250), bubble B is displayed so as to surround strokes S1 and S2 as shown in FIG. 9B (step S150). Similarly, when the third stroke S2 (right ear) is input so that it is close to or touching stroke S1 on drawing display screen 31, strokes SI, S2 and S3 are grouped together ( Steps S120 and S250), bubble B is displayed so as to surround strokes SI, S2 and S3 as shown in FIG. 9C (step S150). Finally, when strokes S4, S5, and S6 (eyes and mouth) are entered inside stroke S1 on drawing display screen 31, strokes S1 to S6 are grouped (steps S120 and S250). Bubble B is displayed so as to surround strokes S1 to S6 as shown in 9D (step S150).

[0055] Also, as shown in FIG. 10A, a group SG composed of a plurality of strokes S constituting an illustration of a rabbit is displayed on a drawing display screen 31, and a plurality of straws constituting a word "Rabbit". When the group SG consisting of S is separated (without being grouped) and displayed, for example, the bubble B around the group SG of the word “Rabbit” is entered with the input pen 35. By grasping, the stroke S belonging to the group SG can be moved integrally. Then, when the group SG of the word “Rabbit” is brought closer to the group SG of the rabbit illustration on the drawing display screen 31, any stroke S belonging to the group SG of the word “Rabbit”, and When the distance d to any stroke S belonging to the group SG of the Usagi illustration falls below the threshold dref (= dref 1) (steps S 120 and S240), both groups SG are grouped as one group. (Steps S120 and S250). Then, when such a grouping is made, any stroke S belonging to the group SG of the word “Rabbit” is sufficiently close to any stroke S belonging to the group SG of the Usagi illustration. These strokes S are included in the region where the potential is greater than or equal to the threshold value Pref due to the junction (overlap) of the potential fields. Along with this, based on the potential calculated in step S130, the publish boundary bb surrounding the stroke S that belonged to the two groups SG so far is set (step S 140) and displayed separately until then. Each group SG's bubble B force is displayed as if they were combined in step S150. When the group SG of the word “Rabbit” stops on the drawing display screen 31, a bubble B based on the positions (coordinates) of all the strokes S grouped is displayed as shown in FIG. 10B. Thus, in the electronic board system 20 of the present embodiment, if any group SG (or stroke S) is brought closer to another group SG (or stroke S) on the drawing display screen 31, those strokes S (Group SG) can be automatically grouped and bubble B indicating the group range can be displayed on the drawing display screen 31.

As described above, in the electronic board system 20 according to the present embodiment, when a series (one stroke) of handwriting input operation is performed on the drawing display screen 31 of the display unit 30, a stroke based on the series of handwriting input operation is performed. The coordinates of S on the drawing display screen 31 are acquired (step S100). A plurality of strokes S, which are spatially grouped on the drawing display screen 31 based on the acquired coordinates, are grouped as one group (step S 1 20) The bubble B as a group identification display indicating the attribution of the stroke S to the group is displayed on the drawing display screen 31 (step S150). That is, in the electronic board system 20 of this embodiment, the distance d on the drawing display screen 31 between the pair of strokes S is calculated (step S110), and the calculated distance d is set to a predetermined threshold value dref (value drefl Or when the value dref is 2) or less, a pair of strokes S are grouped together. As a result, in the electronic board system 20, if the stroke S is brought close to each other on the drawing display screen 31 or overlapped to construct a spatial group of the stroke S, the multiple strokes S are grouped together. Accordingly, it becomes possible to perform grouping more appropriately. When a predetermined operation is performed on the drawing display screen 31 with respect to the group of strokes S, for example, a moving operation, a group process that is a process for the group corresponding to the operation is executed. As a result, in the electronic board system 20 of the present embodiment, if a spatial unit of the stroke S is constructed on the drawing display screen 31, it is possible to process the stroke S in units of groups having multiple strokes S force. Become. Therefore, according to the electronic board system 20, it is possible to improve usability when executing handwriting input on the drawing display screen 31.

[0057] Further, in the grouping process of step S120, if the distance between a pair of strokes S that have not been grouped so far is equal to or less than the first value drefl, the grouping is performed! A pair of strokes S are grouped and already grouped! / If the distance between a pair of strokes S is less than or equal to a second value dref2 greater than the first value drefl, the grouping The grouping between the paired strokes S is maintained. As a result, when the positional relationship of the strokes on the drawing display screen 31 is changed, it is relatively difficult to group the strokes S that have not been grouped so far, and grouping of the groups once constructed is prevented. It becomes possible to make it difficult to release. Therefore, it is possible to change the positional relationship of the stroke S (group) on the screen while suppressing unintended stroke S grouping and degrouping, so handwriting input is executed on the drawing display screen 31. The user-friendliness can be further improved.

Further, in the electronic board system 20 of the present embodiment, each stroke on the drawing display screen 31 is displayed. After the bubble boundary bb, which is the range of the group on the drawing display screen 31, is set based on the coordinates of S and the result of potential calculation as a predetermined constraint (step S130) (step S140), the set bubble The boundary bb (group range) is displayed on the drawing display screen 31 together with the stroke S as a group identification display (step S150). In this way, a virtual potential field is assigned to each stroke S, and the potential based on the coordinates of each stroke S and the potential field is calculated for each of the plurality of potential grids, and the calculated potential is equal to or greater than a predetermined threshold value Pref. If the bubble boundary bb surrounding the region to be set is set, the bubble boundary bb as the group range is set more appropriately according to the spatial arrangement of the strokes S on the drawing display screen 31 and displayed on the drawing display screen 31. Can be displayed. This makes it possible to easily identify one group and the stroke S belonging to it on the drawing display screen 31. By separating the potential calculation process (step S130) and the setting of the bubble boundary bb (step S140) from the grouping process (step S120), the calculation load can be reduced.

[0059] Further, as the potential field to be applied to each stroke S, if each point force constituting the stroke S is a concentration function that defines the potential to be smaller as it goes away from the tangential direction of the stroke S, the so-called marching square is obtained. By using the method, it is possible to set the group range, that is, the bubble boundary bb as the group identification display more appropriately according to the spatial arrangement of the strokes S on the drawing display screen 31. In this embodiment, the force for calculating the potential for all of the plurality of potential grids set for the drawing display screen 31 is not limited to this. In other words, considering the computational load, etc., after selecting the potential grid for calculating the potential based on the coordinates of each stroke S and the extension of the potential field, the potential is only applied to the selected potential grid. You can calculate it! /

[0060] Furthermore, the group identification display need not necessarily be bubble B based on bubble boundary bb. Instead of bubble B, it is not necessary to display group S as a group identification display indicating the attribution of stroke S to the group. It is also possible to change the color of the grouped strokes S, which can be displayed with some mark, or to make them uniform, and display them as a group identification display. Even in group mode, the bubble B Is not displayed on the drawing display screen 31, and when the tip of the input pen 35 is spatially grouped on the drawing display screen 31, the bubble B or Bubble boundary bb may be displayed. In this embodiment, the potential calculation (step S130) is executed after the grouping process of step S120, and the bubble boundary bb is set based on the result of the potential calculation. (Step S 140) In some cases, it cannot be said that a plurality of bubble boundaries bb may be set for one group defined in Step S 120. Therefore, when a plurality of bubble boundaries bb are set for one group, the threshold value Pref to be compared with the potential of each potential grid is reduced after the processing of step S 140, or the 1 The post-processing may be executed to reinforce the public boundary bb by increasing the potential field of the stroke S belonging to one group. In addition, if multiple bubble boundaries bb are set in step S140 for one group determined in step S120, the position is set inside the set bubble boundary bb after step S140. Post-processing may be performed to regroup the strokes S to be regrouped into one group.

[0061] [Group division processing]

Subsequently, a group division process which is one of the group processes by the group processing unit 46 of the electronic board system 20 of the present embodiment will be described. FIG. 11 is a flowchart showing an example of group division processing mainly executed by the division processing unit 47 of the group processing unit 46. The group division process in FIG. 11 is performed in a state in which “group mode” is selected from menu M, as shown in FIG. Bubble B surrounding the stroke S, ie, when bubble B of any group SG is broken. In the following, the stroke that divides bubble B of group SG, that is, the stroke that intersects the bubble boundary bb of any bubble BB at two points is called “breaking stroke DS” t.

[0062] At the start of the group division process in FIG. 11, the division processing unit 47 firstly coordinates the entire stroke S (absolute coordinates of each point) surrounded by the bubble B divided by the division stroke DS, The coordinates of the bubble boundary bb (absolute coordinates of each point) of the bubble and the coordinates of the input dividing stroke DS (absolute coordinates of each point) are acquired (step S300). Then get Based on the coordinates of the bubble boundary bb and the coordinates of the dividing stroke DS, two closed loops LI and L2 as shown in FIG. 12B are created (S310). If such two loops L1 and L2 are created, using the coordinates of each stroke S acquired in step S300, whether or not it is located inside loop LI or L2 for each stroke S Based on the determination result, a stroke S grouping is executed (step S320). Here, grouping means that all strokes S located in one loop L1 or L2 are related to the group processing such as “Cut”, “Copy” and “Paste” included in the above-mentioned group menu GM. It means to associate with each other so that it can be regarded as a stroke.

When the regrouping of the stroke S surrounded by the bubble B divided by the division stroke DS is executed in this way, the potential calculation unit 43 subsequently sets in step S310. A plurality of potential grids corresponding to the area on the drawing display screen 31 surrounding the loop L1 that is necessary and sufficient, and a plurality of areas corresponding to the area on the drawing display screen 31 surrounding the loop L2 set sufficiently at step S310. The potential with the potential dalid is calculated (step S330). In this case, for a plurality of potential grids corresponding to the loop L1, the potential based on the potential field of only the stroke S located in the loop L1 is calculated, and for a plurality of potential grids corresponding to the loop L2, the potential grid is included in the loop L2. The potential based on the potential field of only the stroke S is calculated. Note that the potential grid corresponding to the region surrounding the loops LI and L2 as necessary and sufficient can be selected based on the coordinates of each stroke S and the extension of the potential field. The potential of each potential grid calculated in step S330 is given to the bubble boundary setting unit 44. The bubble boundary setting unit 44 uses the marching square method described above to set the potential of each potential grid and a predetermined threshold value P. By comparing with ref, the coordinates of the bubble boundary bb corresponding to the stroke S located in the loop L1 and the bubble boundary bb corresponding to the stroke S located in the loop L2 are set (step S340). Then, the image processing unit 48 reads out the necessary data from the 49 image data storage units, and displays each stroke S based on the coordinates acquired in step S300 as shown in FIGS. 12C and 12D. The bar set in step S340 Based on the coordinates of the bull boundary bb! /, The bubble B corresponding to each loop LI, L2 is displayed (step S350), and the process is terminated.

[0064] As described above, in the electronic board system 20 according to the present embodiment, when the bubble B surrounding the plurality of strokes S on the drawing display screen 31, that is, the dividing stroke DS for dividing the group SG is input. In addition, for each of the two loops LI and L2 formed based on the bubble boundary bb of the bubble B and the dividing stroke DS, the strokes S in the loops LI and L2 are grouped as one group. In other words, in the electronic board system 20, when a dividing stroke DS for dividing any bubble B is input, as shown in FIGS. 12B and 12C, one side of the dividing stroke DS (the left side in the figure). Stroke S located at is grouped as a new group, and stroke S located on the other side (right side in the figure) of the input split stroke DS is grouped as a new group. As a result, one group SG constructed according to the spatial arrangement of strokes S on the drawing display screen 31 can be easily divided again into a plurality of groups SG. In addition, if a group SG that includes a stroke S that is not intended to be grouped is constructed, if the stroke S is input so as to separate the stroke S that is intended to be grouped from the stroke S that is not, The originally intended group can be easily constructed. Therefore, in the electronic board system 20 in which such group division processing can be executed, it is possible to further improve the usability when executing handwritten input on the drawing display screen 31.

[0065] Depending on how the dividing stroke DS is input, only one stroke S may be included in either or both of the two loops LI and L2 formed by the bubble boundary bb and the dividing stroke DS. As such, the term “new groups” here includes those to which only a single stroke S belongs. Depending on the spatial arrangement of the stroke S on the drawing display screen 31, the bubble boundary bb and the loop L2 corresponding to the loop L1 set in step S340, as shown by the two-dot chain line in FIG. 12C. It is possible that the bubble boundary bb corresponding to 交差 intersects, so that the bubble B corresponding to the loop L1 and the bubble B corresponding to the loop L2 overlap on the drawing display screen 31. However, even if the bubble boundaries bb overlap each other in this way, as shown in FIG. Since it is assumed that both groups SG (Bubble B) are separated from each other on the drawing display screen 31 by one user, there is no practical problem.

[0066] Further, as an example of another doubling process related to the group dividing process based on such a dividing stroke DS, the following batch deletion of groups can be cited. That is, the stroke S that does not completely divide the bubble B (group) that surrounds multiple strokes S, that is, the stroke S that intersects the bubble boundary bb of the bubble B that surrounds multiple strokes S at only one point (one place) is input. If this happens, delete the group corresponding to bubble B as a whole.

[0067] Next, an electronic board system 20B as a handwriting input processing apparatus according to a second embodiment of the present invention will be described. The electronic board system 20B according to the second embodiment has basically the same hardware configuration as that of the electronic board system 20 according to the first embodiment except for a part thereof. Therefore, in order to avoid redundant description, the same reference numerals as those of the electronic board system 20 of the first embodiment are used for the electronic board system 20B of the second embodiment. Omitted. In the electronic board system 20B according to the second embodiment, a grouping display process illustrated in FIG. 13 is executed instead of the grouping display process in FIG. This grouping display process is also executed for one cycle when “Group mode” is selected from menu M, and when a new stroke S is input under group mode, the starting power of the handwriting input operation is completed. When a move operation is performed to move any stroke S or group on the drawing display screen 31 under the overlap mode, it is repeated until the start force of the move operation is completed. It will be executed.

At the start of the grouped display process of FIG. 13, the coordinate processing unit 41 of the computer 40 acquires the coordinates of all strokes S (absolute coordinates of each point) detected by the display unit 30 from the display unit 30 ( Step S400). The coordinates of all strokes S acquired by the coordinate processing unit 41 are given to the potential calculation unit 43. The potential calculation unit 43 is a virtual assignment given to the coordinates of each stroke S and each stroke S. Using the potential field, the potential based on the coordinates of each stroke S and the potential field of each stroke S is calculated for each of the plurality of potential grids set for the drawing display screen 31 (scaling). Step S410). As in the case of the grouped display process in FIG. 4, the virtual potential field applied to each stroke S is separated from each point constituting one stroke S in the tangential direction and outward of the stroke S. It is a concentration function that defines a smaller potential. In step S410, the potential in one potential grid is obtained by adding the obtained potential field force as a concentration function based on the distance between the one potential grid and each point constituting each stroke S. It is done.

[0069] The potential of each potential grid calculated by the potential calculation unit 43 is given to the bubble boundary setting unit 44. The bubble boundary setting unit 44 compares the calculated potential of each potential grid with a predetermined threshold value Pref by using a marching square method in which the so-called marching cube method is applied in two dimensions. Using the look-up table as illustrated, the coordinates of bubble boundary bb, which is the boundary of bubble B described above, are set. When the bubble boundaries bb for all the strokes S on the drawing display screen 31 are set in this way, the grouping calculation unit 42 sets the coordinates of each stroke S acquired in step S400 and all the values set in step S420. Based on the coordinates of each bubble boundary bb, it is determined for each stroke S whether or not it is located within the bubble boundary bb as any group range, and the grouping of stroke S is determined based on the determination result. Run (step S430). Grouping here also means that all the tokens S located within one bubble boundary bb are grouped with “Cut”, “Copy”, “Paste” and V included in the above group menu GM. Is related to each other so that it is considered as one stroke. When the grouping of the strokes S is completed, the image processing unit 48 reads out necessary data from the image data storage unit 49, displays each stroke S based on the coordinates input in step S400, and causes the step S420 to The bubble B corresponding to each stroke S is displayed based on the coordinates of the publishing boundary bb set in the above (step S440), and this processing is terminated.

[0070] As described above, in the electronic board system 20B according to the second embodiment, based on the coordinates on the drawing display screen 31 of a plurality of strokes S! Stroke S grouped together as a group (Step S430), and a group B indicating the attribution of stroke S to group B and Both strokes S are displayed on the drawing display screen 31 (step S440). That is, in the electronic board system 20B, based on each coordinate of the stroke S on the drawing display screen 31 acquired in step S400 and the result of the above-described potential calculation (step S410) as a predetermined constraint. The bubble boundary bb that is the range (group range) of the stroke S to be grouped as one group on the drawing display screen 31 is set (step S420), and for each stroke S, the stroke S is the bubble boundary bb It is determined whether or not it is positioned within the position, and a stroke S grouping is executed based on the determination result (step S430).

[0071] As a result, even in the electronic board system 20B, the stroke S is grouped only by constructing a spatial unit of the stroke S by bringing the stroke S close to each other on the drawing display screen 31 or by superimposing them. be able to. Also, a virtual potential field is assigned to each stroke S, and the potential based on the coordinates of each stroke S and the potential field is calculated for each of the plurality of potential grids set for the drawing display screen 31. If the strokes within the bubble boundary bb surrounding the region where the potential is equal to or greater than the predetermined threshold Pref are grouped into one group, the stroke S is more appropriately determined according to the spatial arrangement of the stroke S on the drawing display screen 31. Can be executed. Furthermore, in the electronic board system 20B of the present embodiment, the bubble boundary bb set in step S420 is displayed around the stroke S as a group identification display, so that one group and the stroke S belonging to it are drawn and displayed. It can be easily identified on the screen 31. In the electronic board system 20B, when a predetermined operation is performed on the drawing display screen 31 with respect to a group of strokes S, for example, a movement operation, group processing that is processing for the group corresponding to the operation is executed. As a result, in the electronic board system 20 of the present embodiment, if a spatial group of strokes S is constructed on the drawing display screen 31, the strokes S can be processed in groups of multiple strokes S force. It becomes possible. Therefore, according to the electronic board system 20, it is possible to improve usability when executing handwriting input on the drawing display screen 31.

[0072] In the second embodiment, the group identification display does not necessarily have to be based on the bubble boundary bb. Instead of bubble B, the attribution of stroke S to the group is not necessary. It is possible to change the color of the grouped strokes S, which may be displayed on the grouped strokes s as a group identification display, or to unify them. . Also, even in the group mode, the stroke S in which the tip of the input pen 35 is spatially grouped on the drawing display screen 31 is not displayed on the drawing display screen 31 under normal circumstances. When placed inside the bubble boundary bb, there is a bubble B! /, So that the bubble boundary bb is displayed!

As described above, the embodiments of the present invention have been described using examples. However, the present invention is not limited to the above examples, and various modifications can be made without departing from the gist of the present invention. It goes without saying that it can be done.

That is, the electronic board systems 20 and 20B of each of the above-described embodiments are configured to display diagrams (illustrations) An object such as a character may be read out and displayed on the drawing display screen 31. In this case, the coordinate processing unit 41 obtains the coordinates of the stroke S on the drawing display screen 31 as well as the coordinates on the drawing display screen 31 of the objects displayed according to the object input operation, and performs grouping calculation. The unit 42 may group the strokes S and the objects spatially grouped on the drawing display screen 31 based on the coordinates acquired by the coordinate processing unit 41 as one group. If such functions are incorporated into the electronic board systems 20 and 20B, the usability and versatility as a handwriting input processing device can be further improved. For the object displayed on the drawing display screen 31, for example, the potential at the reference position such as the image center (or center of gravity) of the object is maximized, and the potential is specified to be smaller as the distance from the reference position in the radial direction is increased. It is better to give the concentration function to be a potential field. Then, based on the coordinates of the reference position of the object on the drawing display screen 31, a distance between the stroke S and the object or a group based on the potential can be executed!

In addition, as shown in FIG. 14, the handwriting input device according to the present invention is installed with the program for handwriting input processing according to the present invention, and at the same time, is displayed with a stylus 50 as a display unit and designated by the input device. Tablet capable of detecting absolute coordinates on screen 31 It may be configured as a tablet computer 20C having Then, if such a tablet computer 20C is connected to the projector 60 and the image on the drawing display screen 31 is projected onto the screen 70, the tablet computer 20C is connected to the electronic board system 20 according to the first embodiment. It can be used in a similar manner. Furthermore, the handwriting input device according to the present invention may be configured as an electronic board system that enables handwriting input on a projection screen projected by a projector connected to a computer.

Industrial applicability

The present invention is useful in the field of information processing.

Claims

The scope of the claims

[1] A display unit that accepts handwriting input operations on a screen and displays strokes based on a series of handwriting input operations on the screen;

And a group processing unit configured to perform group processing, which is processing for the group according to the operation, when a predetermined operation is performed on the group on the screen.

[2] In the handwriting input processing device according to claim 1,!

The grouping means includes distance calculating means for calculating a distance on the screen between a pair of strokes, and groups the pair of strokes when the calculated distance is equal to or less than a predetermined threshold. Handwriting input processing device.

[3] The grouping means groups the pair of ungrouped strokes when the distance between the pair of ungrouped strokes is equal to or less than a first threshold, Maintaining a grouping of the paired strokes when the distance between the paired strokes is equal to or less than a second threshold value greater than the first threshold value. Item 2. The handwriting input processing device according to Item 1.

[4] In the handwriting input processing device according to claim 1,!

Further comprising group range setting means for setting a group range which is a range on the screen of the group based on the acquired coordinates of the stroke and a predetermined constraint;

The handwriting input processing device, wherein the display control means displays the set group range on the screen as the group identification display.

[5] The handwriting input processing device according to claim 4,

The group range setting means includes A potential calculation means for calculating a potential due to a potential field applied to each stroke based on the acquired coordinates at least in a region corresponding to the stroke that is spatially combined;

Boundary setting means for setting a boundary that surrounds a region where the calculated potential is equal to or greater than a predetermined threshold as the double range;

A handwriting input processing device.

[6] The grouping means sets a group range that is a range on the screen of the group based on the coordinates of the acquired stroke and a predetermined constraint, and the stroke is set for each stroke. 2. The handwriting input processing device according to claim 1, wherein it is determined whether or not the key is located within a group range, and grouping of the strokes is executed based on a result of the determination.

[7] The handwriting input processing device according to claim 6,

The grouping means includes

A potential calculation means for calculating a potential due to a potential field applied to each stroke based on the acquired coordinates at least in a region corresponding to the stroke that is spatially combined;

A boundary setting means for setting a boundary surrounding an area where the calculated potential is equal to or greater than a predetermined threshold,

A handwriting input processing device for grouping strokes located within the boundary as one group.

8. The handwriting input processing apparatus according to claim 7, wherein the display control means displays the set boundary as the group identification display on the screen.

9. The handwriting input processing device according to claim 5, wherein the potential field is defined as a density function that defines the potential to be smaller as each point constituting the stroke is further away from the tangential direction of the stroke and outward. .

10. The handwriting input processing device according to claim 7, wherein the potential field is defined as a density function that defines the potential to be smaller as each point constituting the stroke is further away from the tangential direction of the stroke and outward. .

[11] The handwriting according to claim 5, wherein the potential calculation means calculates the potential for each grid corresponding to at least a spatially arranged stroke of a plurality of grids set for the screen. Input processing device.

12. The handwriting according to claim 7, wherein the potential calculation means calculates the potential for each grid corresponding to at least a spatially grouped stroke of a plurality of grids set for the screen. Input processing device.

[13] The group processing means, based on the input dividing stroke, when an input operation of a dividing stroke, which is a stroke for dividing the group, is performed on the screen.

2. The handwriting input processing device according to claim 1, wherein the group is divided into a plurality of new groups.

[14] Of the strokes belonging to the group, the group processing means groups the strokes located on one side of the dividing stroke as a new group, and is located on the other side of the dividing stroke. 14. The handwriting input processing device according to claim 13, wherein the strokes are grouped as a new group.

[15] The handwriting input processing device according to claim 13,

A boundary setting means for setting a boundary surrounding an area where the calculated potential is equal to or greater than a predetermined threshold;

The handwriting input processing device, wherein the group processing means performs a grouping of the strokes in the norepe as a single grouping for every two noreps formed based on the boundary and the dividing stroke.

16. The handwriting input processing apparatus according to claim 1, wherein the grouping means executes the grouping of the strokes when the positional relationship of the strokes on the screen is changed.

[17] Select a group mode in which grouping by the grouping means, display processing by the display control means, and group processing by the group processing means are enabled. The handwriting input processing device according to claim 1, further comprising group mode setting means for enabling the cancellation of the selection.

[18] The method according to claim 1, further comprising individual processing means for executing individual processing that is processing for any one of the strokes according to the operation when a predetermined operation is performed on any of the strokes belonging to the group. The handwriting input processing device described in 1.

[19] In the handwriting input processing device according to claim 1,!

The display unit can display an object based on a predetermined object input operation on the screen, and the coordinate acquisition means can acquire the coordinates of the object on the screen,

The hand grouping input processing device, wherein the grouping means groups the strokes and the objects spatially grouped on the screen based on the acquired coordinates as one group.

20. The handwriting input processing device according to claim 1, wherein the handwriting input processing device is configured as an electronic board system including an electronic board capable of detecting an absolute coordinate on the screen designated by a predetermined input device as the display unit.

21. The handwriting input processing device according to claim 1, wherein the handwriting input processing device is configured as a tablet computer including a tablet capable of detecting absolute coordinates on the screen designated by a predetermined input device as the display unit.

[22] A handwriting input processing method using a display unit that accepts a handwriting input operation on a screen and displays a stroke based on a series of handwriting input operations on the screen.

(a) obtaining coordinates on the screen of the stroke;

(d) when a predetermined operation is performed on the group on the screen, a step of executing a group process that is a process for the group according to the operation; Handwriting input processing method including.

[23] The handwriting input processing method according to claim 22,

In step (b), a distance on the screen between a pair of strokes is calculated, and the pair of strokes are grouped together when the calculated distance is equal to or less than a predetermined threshold.

[24] In step (b), when the distance between a pair of ungrouped strokes is equal to or smaller than the first threshold, the paired strokes are grouped together and are grouped together. When the distance between a pair of strokes that are already grouped is equal to or less than a second threshold value that is greater than the first threshold value, the grouping of the paired strokes is maintained. The handwriting input processing method according to claim 22.

[25] The handwriting input processing method according to claim 22,

(e) further includes a step of setting a group range that is a range on the screen of the group based on the coordinates of the stroke acquired in step (a) and a predetermined constraint;

In step (c), the handwritten input processing method of displaying the set group range on the screen as the group identification display.

[26] The handwriting input processing method according to claim 25,

In step (e), based on the coordinates acquired in step (a), the potential based on the potential field applied to each stroke is calculated for at least the region corresponding to the stroke that is spatially summarized. The handwriting input processing method which sets the boundary surrounding the area | region where the made potential becomes more than a predetermined threshold value as said group range.

[27] In step (b), a group range that is a range on the screen of the group is set based on the coordinates of the stroke acquired in step (a) and a predetermined constraint, and for each stroke. 23. The handwriting input processing method according to claim 22, wherein it is determined whether or not the stroke is a force positioned within the group range, and grouping of the strokes is executed based on a result of the determination.

[28] The handwriting input processing method according to claim 27, In step (b), based on the coordinates acquired in step (a), the potential due to the potential field applied for each stroke is calculated at least in the region corresponding to the stroke that is spatially summarized. A handwriting input processing method that sets a boundary surrounding an area where the potential calculated together with the potential is equal to or greater than a predetermined threshold value, and groups strokes located within the boundary as a group.

29. The handwriting input processing method according to claim 28, wherein in step (c), the boundary set in step (b) is displayed on the screen as the group identification display.

[30] In step (d), when an input operation of a dividing stroke, which is a stroke for dividing the group, is performed on the screen, the group is added to a plurality of new groups based on the inputted dividing stroke. 23. The handwriting input processing method according to claim 22, which is divided into two.

[31] In step (d), of the strokes belonging to the group, the strokes located on one side of the dividing stroke are grouped together as a new group, and on the other side of the dividing stroke. 31. The handwriting input processing method according to claim 30, wherein the positioned strokes are grouped as a new group.

[32] The handwriting input processing method according to claim 30,

(f) calculating a potential based on the potential field applied to each stroke based on the coordinates acquired in step (a) for an area corresponding to at least a spatially organized stroke;

(g) further including a step of setting a boundary surrounding a region where the potential calculated in step (f) is equal to or greater than a predetermined threshold value,

In step (d), the handwriting input processing method of grouping the strokes in the loop into one group for every two loops formed based on the boundary and the dividing stroke.

[33] The handwriting input processing method according to claim 22, wherein in step (b), grouping of the strokes is executed when the positional relationship of the strokes on the screen is changed.

[34] Force connected to a display unit that accepts a handwriting input operation on the screen and displays a stroke based on a series of handwriting input operations on the screen, or the display A program for handwriting input processing that causes a computer including a unit to function as a handwriting input processing device,

A program for handwriting input processing.