JP2013114431A - Handwriting input device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a handwriting input device securing viewability during a handwriting input and capable of inserting a new handwriting object in an existing handwriting object without any layout disruption.SOLUTION: The handwriting input device enters a postscript mode by an entry of a postscript mark 31. In the postscript mode, a postscript area 32 with a translucent background is superimposedly displayed on an existing object 34 and a handwriting input of a postscript object is received within the postscript area 32. The postscript area 32 is sequentially enlarged according to the handwriting input. When the input of a postscript object 36 is completed, the peripheral existing object 34 is moved by a necessary amount on the basis of the size of the postscript object 36 and the postscript object 36 is inserted into the handwriting position.

Description

  The present invention relates to a handwriting input device that receives handwritten input such as characters and figures and displays the contents and a program thereof.

  It is relatively easy to insert another icon into a row of icons that are already displayed side by side, as long as the display / movement position is determined, such as an icon displayed on the desktop screen of a personal computer. With this process, an existing icon can be automatically moved to secure a free area necessary for insertion.

  However, in the case of handwritten objects such as handwritten input characters and figures, the size and position of each handwritten object are free and irregular, and it is difficult to automatically move existing objects and insert them appropriately. Therefore, when adding another handwritten object where a handwritten object is already displayed, the new object is handwritten in an empty area that does not overlap the existing object, and the new object and the existing object are moved to the arrow. The only thing that can be done is to create a pseudo-relation by connecting them, etc., and when they increased, it was very difficult to see.

  As an insertion technique in handwriting input, for example, during handwriting input, the next handwritten input position is predicted from the arrangement of handwritten strokes already input, and an empty space is secured at the predicted position. In addition, there is a technique for moving existing objects one after another in a direction in which the movement distance in the X / Y-axis direction is small (see Patent Document 1).

JP 2007-79623 A

  When the next handwritten input position is predicted during handwriting input and the existing object is moved one after another so that an empty space is secured at the predicted position, as in Patent Literature 1, when the prediction is lost Therefore, it becomes difficult to input the handwriting at the position intended by the user.

  Further, when surrounding objects move for each input, a situation that is very difficult for the user to see occurs.

  Further, when existing objects are moved one after another according to the next predicted input position, ad hoc movements corresponding to only the next input are accumulated, and when the input is completed, the layout of the existing object may be greatly collapsed.

  The present invention is intended to solve the above-described problem, and provides a handwriting input device and a program for the same that can ensure easy viewing during handwriting input and can insert a new handwritten object into an existing handwritten object. It is intended to provide. It is a second object of the present invention to provide a handwriting input device and a program thereof that can insert a new handwritten object into an existing handwritten object without destroying the entire layout.

  The gist of the present invention for achieving the object lies in the inventions of the following items.

[1] A handwriting input unit that receives input of a handwritten object;
A display unit for displaying a handwritten object input from the handwriting input unit;
A control unit and
The control unit displays the handwritten object superimposed on the existing object during handwriting input of the handwritten object that has received the predetermined additional instruction, and when the input of the handwritten object is completed, the handwritten object is converted into the existing object. A handwriting input device characterized by performing an insertion process of inserting and displaying.

  In the invention described in [1] and [10] below, during handwriting input of a handwritten object that has received a postscript instruction, the handwritten object is displayed on top of an existing object, and when input of the handwritten object is completed, Insert a handwritten object into an existing object and display it. Insertion processing is performed after input is completed, so insertion processing is performed according to the size of the handwritten object confirmed by the completion of input and the surrounding conditions, and new handwritten objects are inserted into existing handwritten objects without breaking the overall balance. can do.

[2] During the handwriting input of the handwritten object that has received the additional instruction, the control unit changes the background of the handwritten object at least in a portion overlapping with the existing object to a predetermined background that makes the handwritten object easy to see. The handwriting input device according to [1], characterized by:

  In the inventions described in [2] and [11] below, a background that makes the handwritten object easy to see is displayed during handwriting input of the handwritten object that has received the additional writing instruction. For example, a white background or a plain and translucent background is suitable.

[3] The control unit secures an empty area for inserting the handwritten object at the input position of the handwritten object by moving an existing object so as to fill in a margin. [1] Or the handwriting input device as described in [2].

  In the inventions described in [3] and [12] below, the margins on the other side of an existing object around the input position of the handwritten object when an existing object or the like around the input position of the handwritten object is viewed Since an empty area is secured at the handwritten position by moving the data so as to close the area, a large layout change does not occur.

[4] The control unit receives designation of an existing object to be moved to insert the handwritten object from a user, and moves the designated existing object to secure the free space. The handwriting input device according to [3].

  In the inventions described in [4] and [13] below, the user can specify an existing object to be moved in order to insert a new handwritten object.

[5] When the control unit cannot secure a blank area into which the handwritten object can be inserted by filling in a margin, the reduced handwritten object is reduced by reducing the existing object and the handwritten object to fill the margin. An empty area in which can be inserted is secured. The handwriting input device according to [3] or [4].

  In the inventions described in [5] and [14] below, the reduction process is performed when an empty area of a necessary size cannot be secured only by moving the margin. Occurrence of a situation where the handwritten object cannot be inserted after completion of the additional writing of the handwritten object is avoided.

[6] The handwriting input device according to [2], wherein the predetermined background is an opaque or low-transparency background superimposed on an existing object.

  In the inventions described in [6] and [15] below, since the existing object is covered with the opaque background, the handwritten content is easy to see. On the other hand, in the case of a low-transparency (semi-transparent) background, it can be added while confirming the contents of the existing object in the lower layer.

[7] The handwriting input device according to any one of [1] to [6], wherein the additional writing instruction is a handwritten input of a predetermined additional writing start mark.

  In the above invention, by writing the additional recording start mark at the position where additional recording is desired, the start of additional recording can be instructed, and good operability is provided.

[8] The handwriting input device according to any one of [1] to [7], wherein completion of input of the handwritten object is determined by handwriting input of a predetermined additional writing end mark.

  In the said invention, completion | finish of additional writing can be instruct | indicated by handwriting input, and favorable operativity is provided.

[9] The handwriting input device according to [4], wherein the designation of the existing object to be moved to insert the handwritten object is a handwriting input of a predetermined selection mark for the existing object to be moved. .

  In the said invention, the object of a movement target can be designated by handwritten input, and favorable operativity is provided.

[10] An information processing apparatus including a handwriting input unit that receives input of a handwritten object, and a display unit that displays the handwritten object input from the handwriting input unit,
During handwriting input of a handwritten object that has received a predetermined appending instruction, the handwritten object is displayed overlaid on an existing object, and when the input of the handwritten object is completed, the handwritten object is inserted into the existing object and displayed. A program characterized by operating as follows.

[11] The information processing apparatus is
During the handwriting input of the handwritten object that has received the additional instruction, the background of the handwritten object that overlaps at least the existing object is operated to change to a predetermined background that makes the handwritten object easier to see. The program according to [10].

[12] The information processing apparatus is
[10] or [11], wherein an operation is performed to secure a free space for inserting the handwritten object at an input position of the handwritten object by moving an existing object so as to fill in a margin. The program described in.

[13] The information processing apparatus is
[12] characterized in that a specification of an existing object to be moved to insert the handwritten object is received from a user, and the specified existing object is moved to secure the free space. The listed program.

[14] The information processing apparatus is
If it is not possible to secure a free space where the handwritten object can be inserted by filling the margin, the existing object and the handwritten object are reduced and the blank space is filled to secure a free space where the reduced handwritten object can be inserted. The program according to [12] or [13], wherein the program is operated as follows.

[15] The program according to [11], wherein the predetermined background is an opaque or low-transparency background superimposed on an existing object.

  According to the handwriting input device and the program thereof according to the present invention, it is possible to insert a new handwritten object into an existing handwritten object while ensuring ease of viewing during handwriting input and without destroying the overall layout. it can.

It is a block diagram which shows the structural example of the handwriting input device which concerns on embodiment of this invention. It is explanatory drawing which shows the outline of the handwriting input operation | movement in the postscript mode of the handwriting input apparatus which concerns on embodiment of this invention. It is explanatory drawing which shows the example of entry of the movement direction instruction | indication of the object in the additional recording mode of the handwriting input device which concerns on embodiment of this invention, and a movement object instruction | indication. It is a flowchart which shows the outline | summary of operation | movement at the time of the handwriting input device which concerns on embodiment of this invention receiving handwriting input, and displaying it. It is a flowchart which shows a coordinate detection process (step S102 of FIG. 4). It is a flowchart which shows the detail of an object recognition process (step S107 of FIG. 4). It is a flowchart which shows the continuation of FIG. It is explanatory drawing which shows the specific example of operation | movement of the object recognition process when a character is input. It is explanatory drawing which shows the example by which several handwritten content was divided into two objects, and was recognized by the object recognition process. A specific example of blank area search and registration by the overall area blank calculation process (step S110 in FIG. 4) is shown. It is a flowchart which shows the detail of a whole area margin calculation process. It is a flowchart which shows the detail of a postscript area | region initial setting process (step S112 of FIG. 4). It is explanatory drawing which shows an example of a mode that a write-once area is extended sequentially by a write-once area expansion process (step S121 of FIG. 4). It is a flowchart which shows the detail of a postscript object state setting process (step S118 of FIG. 4). It is a flowchart which shows the continuation of FIG. It is explanatory drawing which shows an example when the movement object (or moving direction) is designated when the margin area is insufficient. It is explanatory drawing which shows an example of the reduction process at the time of the shortage of a blank area.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of a handwriting input device 10 according to the present invention.

  The handwriting input device 10 is configured by connecting a control unit 11 to a display unit 12, an operation input unit 13, a wireless communication unit 14, and an external memory connection unit 15. The control unit 11 that performs overall control of the operation of the handwriting input device 10 includes a CPU (Central Processing Unit) 16, a Flash ROM (Read Only Memory) 17, a memory 18, and the like as main parts.

  The display unit 12 includes a liquid crystal display. The operation input unit 13 is provided on the screen of the display unit 12, and includes a touch panel unit (coordinate position detection sensor) 13a that detects a contact position of a pen or the like on the screen, and various operation switches. The operation input unit 13 receives an input of an object (handwritten object) such as a user's handwritten character or figure from the touch panel unit 13a. The detection method of the touch panel unit 13a may be arbitrary, such as capacitance, analog / digital resistance film, infrared rays, ultrasonic waves, electromagnetic induction, and the like.

  The wireless communication unit 14 has a function of connecting to a network by wireless communication and communicating with other devices.

  The flash ROM 17 of the control unit 11 is a rewritable memory that retains the stored contents even when the power is turned off. Various programs and data are stored in the FlashROM 17, and each function as the handwriting input device 10 is realized by the CPU 16 executing various processes according to these programs. The flash ROM 17 also stores various setting values set for the handwriting input device 10. The memory 18 is used as a work memory for temporarily storing various data when the CPU 16 executes a program and a memory for temporarily storing display data.

  An SD (Secure Digital) memory card or the like is detachably connected to the external memory connection unit 15. In the SD memory, for example, data of a predetermined object (part) such as a template is stored.

  The handwriting input device 10 includes a normal input mode in which a new handwritten object is overwritten without moving an existing object as a handwriting input mode, and an additional writing in which a new handwritten object is inserted by moving the existing object as necessary. Mode. The normal input mode is used when a new handwritten object is written in a blank portion or when a new handwritten object is overwritten on an existing object.

  In write-once mode, while writing a new handwritten object, the new object being written is displayed over the existing object, and when writing is complete, the free space required to insert the handwritten object at the handwritten position is displayed. The surrounding existing objects are moved so that the area is secured, and a new handwritten object is automatically inserted into the empty area secured by the movement. In addition, when an empty area having a size necessary for inserting a new handwritten object cannot be secured due to the movement of an existing object that is around, the existing object and the new handwritten object are automatically reduced.

  FIG. 2 shows an outline of the handwriting input work in the write-once mode of the handwriting input device 10. Note that the screen of the handwriting input device 10 is set with a coordinate system in which the upper left corner is the origin, the left to right direction is the + X-axis direction, and the top to bottom direction is the + Y-axis direction.

  The user handwrites a predetermined postscript mark 31 at a place where a new object is desired to be handwritten in the postscript mode (see FIG. 2A). The handwriting input device 10 determines whether the handwritten content is an additional writing start instruction (additional mark 31), and if it is the additional writing mark 31, sets the handwriting input mode to the additional writing mode. Note that the additional recording start instruction is not limited to the additional recording mark 31 described above. The additional writing start instruction may be a method other than handwriting input, for example, a method of inputting by operating a specific switch.

  When the handwriting input device 10 enters the additional writing mode, as shown in FIG. 2B, the additional writing area 32 for receiving a new handwritten input is immediately adjacent to the position where the additional writing mark 31 is written in the + X direction. indicate. The initial size of the additional recording area 32 is set according to the size of the additional recording mark 31. For example, a rectangular area 5 times as large as the additional recording mark 31 in the + X-axis direction and twice as long as the additional recording mark 31 in the + Y-axis direction is set as the initial additional recording area 32.

  The additional writing area 32 has an opaque or low-transparent plain background that is displayed on top of an existing object, and characters and figures that are input by handwriting in the additional writing area 32 are displayed on this background. Is done. As a result, handwritten objects such as characters written in the additional recording area 32 are displayed in an easy-to-see manner even if there is an existing object below the background of the additional recording area 32. In addition, when the background of the additional recording area 32 is translucent, additional recording can be performed while confirming an existing object in the lower layer. Although the additional recording area 32 in the figure has a frame line, it may not have a frame line.

  When the user handwrites characters or the like in the additional recording area 32, the additional recording area 32 is sequentially expanded accordingly.

  The additional writing end instruction indicating the completion of handwriting input to the additional writing area 32 (end of the additional writing mode) is performed by entering a punctuation mark indicating the end of a sentence such as “.” Or a specific mark. The additional writing end instruction is not limited to the entry of the specific mark. For example, the end of the write-once mode may be instructed according to the operation of a specific switch.

  When the handwriting input device 10 recognizes the completion of writing of the handwritten object in the additional writing area 32, the size of the written handwritten object (referred to as an additional writing object) is specified, and an empty area necessary for inserting the handwritten object is at the handwritten position. The surrounding existing object is moved so as to be secured, and the append object is inserted at the writing position. In the example of FIG. 2, as shown in FIG. 2A, there is an existing object 34 below the postscript mark 31, and there is a blank area 35 of a size that can contain the postscript object. Therefore, as shown in FIG. 5C, the existing object 34 is moved downward (+ Y direction: the direction of the arrow 37 in the figure) so as to fill the blank area 35, and the size required for the writing position of the postscript object 36. The additional writing object 36 is inserted here.

  In the handwriting input device 10, in order to secure a free space of a necessary size at the writing position of the postscript object 36, a direction of movement indicating a surrounding existing object is moved, and which object is a movement target. It is possible to accept from the user an instruction to move.

  In the present embodiment, as shown in FIG. 3, after the additional mark 31 is input, the movement direction instruction mark 41 having the same shape as the additional mark 31 is continuously written in the direction in which the object is to be moved. The direction of movement is specified. In the example of FIG. 3, a downward movement is instructed. When the circle 42 is handwritten in the next stroke after the additional mark 31 is entered, the circle 42 functions as a movement target instruction, and the object surrounded by the circle 42 is designated as the movement target object. . Note that the method of specifying the moving direction and the moving target is not limited to the above, and may be arbitrary.

  Next, operation | movement of the handwriting input device 10 provided with the above write-once modes is demonstrated in detail.

  FIG. 4 is a flowchart showing an outline of an operation when the handwriting input device 10 receives a handwritten input and displays it. This process shows the operation every time one stroke of handwritten input is received. One stroke is an input trajectory from when the pen is lowered until the pen is released.

  When the control unit 11 detects a handwriting input (touch of a finger, a pen, or the like) to the touch panel unit 13a (step S101), the control unit 11 performs coordinate detection processing for acquiring XY coordinates of the handwritten position and determining stroke breaks (step S101). S102). The handwritten content is displayed on the display unit 12 (step S103). The coordinate detection process sets a one-stroke flag when the completion of one-stroke input is detected. Details of the coordinate detection process will be described later. The control unit 11 refers to the one-stroke flag to determine the completion of one-stroke input (step S104). If the one-stroke input is not completed (step S104; No), the control unit 11 returns to step S101 and continues the process. . As a result, the stroke trajectory during handwriting input is displayed on the display unit 12 in real time.

  When the input of one stroke is completed (step S104; Yes), the control unit 11 clears the one stroke flag (step S105) and performs the following processing.

  First, it is determined whether or not the stroke input this time is a character or a mark such as an additional writing start instruction (step S106). Next, it is determined whether or not the stroke input this time is included in the handwritten object to which the previously input stroke belongs, and an object recognition process is performed to combine a plurality of related strokes into one object (step S107). In the object recognition process, a plurality of adjacent strokes input within a predetermined time are recognized as one handwritten object. Details of the object recognition processing will be described later.

  The control unit 11 determines whether or not the current handwriting input mode is the write-once mode (step S108). If the current handwriting input mode is not the write-once mode (step S108; No), the stroke input this time is a write-once start instruction (additional mark 31). Whether or not (step S109). If the stroke input this time is the additional recording mark 31 (step S109; Yes), the handwriting input mode is set to the additional recording mode, and preparation processing for receiving the handwritten input in the additional recording mode is performed. That is, an overall area margin calculation process is performed to search for a margin area such as the periphery of the written additional mark 31 (step S110), the blank area detected by this process is registered (step S111), and the additional area 32 is initialized. The additional write area initial setting process to be set (step S112) is performed, and this process is terminated. Details of the overall area margin calculation process (step S110) and the additional area initial setting process (step S112) will be described later.

  If the stroke input this time is not the postscript mark 31 (step S109; No), since this stroke is handwritten input such as characters in the normal input mode, no special processing other than the display in step S103 is required. Exit.

  If it is in the appending mode (step S108; Yes), it is determined whether or not the stroke input this time is a movement direction instruction (step S113), and if it is a movement direction instruction (step S113; Yes). The instructed moving direction is recognized and registered (step S114), and this process is terminated.

  If the stroke input this time is not a movement direction instruction (step S113; No), it is determined whether or not the stroke is a movement target instruction (step S115). If the stroke input this time is a movement target instruction (step S115; Yes), the instructed object to be moved is registered (step S116), and the process ends.

  If the stroke input this time is not a movement target instruction (step S115; No), it is determined whether or not the stroke input this time is an additional write end instruction (step S117). If it is not an additional writing end instruction (step S117; No), since the current stroke is an entry of normal characters or the like in the additional writing area 32, an additional writing area extending process for expanding the additional writing area 32 according to the writing is performed (step S121). ), This process is terminated. Details of the additional write area expansion process (step S121) will be described later.

  If the stroke input this time is a postscript end instruction (step S117; Yes), the size of the postscript object in the postscript area 32 is specified, and a blank area for inserting the postscript object at this handwriting position is specified. An additional object state setting process (step S118) is performed in which surrounding existing objects are secured by being moved or reduced as necessary, and an additional object is inserted into the secured blank area. Further, a refinement process (step S119) for adjusting the arrangement of each object, normal display for deleting the frame and background of the additional recording area 32, and deleting the additional recording mark 31, the moving direction instruction, and the movement target instruction instruction symbol. A process (step S120) is performed and this process is terminated. The details of the postscript object state setting process (step S118) will be described later.

  In the refinement process, if the input handwritten object has numbering or bullets “•”, etc., and if there are similar symbols on the top and bottom, the position in the X-axis direction or the Y-axis direction is aligned. Done.

  FIG. 5 is a flowchart showing the coordinate detection process (step S102 in FIG. 4). The control unit 11 acquires information with handwriting detection from the touch panel unit 13a (step S201), and acquires coordinate information in the X-axis direction and coordinate information in the Y-axis direction of the detected handwriting position (steps S202 and S203). The coordinate information is stored (step S204). Next, the coordinate information of the previous handwritten position is read (step S205), and it is determined whether or not the handwritten position detected this time is close (continuous) to the previous handwritten position (step S206).

  If they are not close (step S206; No), assuming that handwriting has been interrupted, a one-stroke flag indicating completion of one-stroke input is set (step S207), and the process is terminated. If they are close to each other (step S206; Yes), it is determined that the input of the same one stroke is continued, and the processing is ended as it is. In addition to the above, the completion of one stroke input is recognized when handwriting detection is interrupted.

  6 and 7 show details of the object recognition process (step S107 in FIG. 4). The handwriting input device 10 recognizes, as one object, a plurality of strokes that are written close to each other within a predetermined time in handwriting input in the normal input mode.

In this example, the object is determined by the following procedure.
First, it is determined from the recognition result performed in S106 of FIG. 4 whether the current handwritten content is a character or an image (step S301).

  In the case of a character (step S301; Yes), a time counter that measures the elapsed time from the start of input of the first stroke of the input object is read (step S302), and the elapsed time is within a certain time (for example, 1 minute). (Step S303; Yes), it is determined whether or not the current input character is in the vicinity of the input object (steps S304 to S307).

  That is, if the current input character is an input in the X-axis direction based on the existence range of the input object (step S304; Yes), an input area 5 times the input character size in the + X-axis direction is set. If the input is not in the X-axis direction (step S304; No), an input area 5 times as large as the input character size is secured in the + Y-axis direction (step S306). It is determined whether or not the current input character is located within (step S307). If the current input character is in the input area (step S307; Yes), the current input character is added to the constituent member of the input object (step S310), and the registration of the input object is updated (step S311). ) End the process.

  If the elapsed time from the start of input of the input object exceeds a certain time (step S303; No), or if the current input character is not in the input area (step S307; No), a new object is selected. Setting is performed (step S308). This new object becomes the input object in the next object recognition process. Thereafter, the time counter is cleared (step S309), the current input character is set as the first constituent member of the new object (step S310), this object is registered (step S311), and the process is terminated.

  When the handwritten content this time is not an image but an image (step S301; No), the elapsed time from the start of input of the object being input is checked (FIG. 7, steps S321 and S322), and within a certain time (for example, 1 If within (min) (step S322; Yes), it is determined whether the current input image is in the vicinity of the input object (steps S323 to S326).

  That is, if the current input image is input in the X-axis direction based on the existence range of the input object (step S323; Yes), an input area 10 times the input image size in the + X-axis direction is set. If the input is not in the X-axis direction (step S323; No), an input area 10 times as large as the input image size is secured in the + Y-axis direction (step S325). It is determined whether or not the current input image is located within (step S326). If the current input image is within the input area (step S326; Yes), the current input image is added to the constituent member of the input object (step S329), and the registration of the input object is updated (step S311). ) End the process.

  When the elapsed time from the input start of the input object exceeds a certain time (step S322; No), or when the current input image is not in the input area (step S326; No), a new object is selected. Setting is made (step S327). This new object becomes the input object in the next object recognition process. Thereafter, the time counter is cleared (step S328), the current input image is set as the first constituent member of the new object (step S329), this object is registered (step S311), and this process is terminated.

  Even when characters and images are mixed in one object, the above processing can be used.

  FIG. 8 shows a specific example of the operation of the object recognition process when a character is input. In FIG. 8A, the character A is an input object 51 (gray portion), and in this case, an input area 52 that is five times the size of the character A in the + X-axis direction and the + Y-axis direction. Secured.

  When the character B is input by handwriting at the position shown in FIG. 5B, the character B is in the input area 52 with the object 51 being input as a reference, so that it is added to the constituent members of the same object as the character A. By adding the letter B, the range of the input object 51 is expanded as shown in FIG. 3C, and a new input area 52 is set for the expanded range of the input object 51.

  In this way, a plurality of characters and images written in the vicinity are associated with each other within a certain time and are collected into one object.

  FIG. 9 shows an example in which a plurality of handwritten contents are recognized by being divided into two objects 34A and 34B by the object recognition processing shown in FIGS.

  Next, the overall area margin calculation process (step S110 in FIG. 4) will be described.

  FIG. 10 shows a specific example of blank area search and registration by the overall area blank calculation process. When the additional mark 31 is entered, the surrounding blank area and the blank area on the other side of the surrounding object are searched with reference to the position of the additional mark 31. It should be noted that if there are more objects beyond the margin area beyond the surrounding objects, the margin area is searched until reaching the edge of the screen in such a manner as to search the margin area beyond that. In the example of FIG. 10, the first to fourth blank areas 61 to 64 are searched and registered as the X-axis direction. As the Y-axis direction, the fifth to seventh blank areas 65 to 67 are searched and registered.

  FIG. 11 shows the detailed flow of the overall area margin calculation process. First, the size of the written additional mark 31 is checked (step S401), and whether or not there is a blank area having a size more than twice the size of the additional written mark 31 in the + -X direction of the additional written mark 31. (Step S402). If there is a corresponding margin area (step S402; Yes), the margin area is expanded and temporarily set within a range that can be expanded in the + -X direction (step S403). In the example of FIG. 10, the second blank area 62 and the third blank area 63 are searched by this process.

  Next, it is checked whether or not there is a blank area having a size more than twice the size of the write-once mark 31 in the + -Y direction of the write-once mark 31 (step S404). If there is a corresponding blank area (step S404). S404; Yes), the margin area is provisionally set as a margin area in the Y-axis direction (step S405). In the example of FIG. 10, the seventh blank area 67 is searched by this process. After that, the margin areas temporarily set in steps S403 and S405 are matched and the margin areas are registered (step S406).

  Next, information (size, position) of an object including or around the additional recording mark 31 is acquired (step S407). In the example of FIG. 10, there are objects 34A and 34B (these are the same as those in FIG. 9), and their information is acquired.

  Using the additional mark 31 as a reference, a search is made for a margin area around the object existing in the + -X direction and other than the already registered margin area, and the corresponding margin area is provisionally registered (step S408, S409). In this process, the first margin area 61 and the fourth margin area 64 are searched and temporarily registered. The second margin area 62 is excluded because it has already been registered.

  Similarly, with reference to the postscript mark 31, a search is made for a blank area around the object existing in the + -Y-axis direction other than the already registered blank area, and the corresponding blank area is provisionally registered (step S410, S411). In this process, the fifth margin area 65 and the sixth margin area 66 are searched and temporarily registered.

  After that, the margin areas temporarily registered in steps S409 and S411 are matched and the margin areas are registered (step S412).

  With the above processing, in the example of FIG. 10, the first to seventh blank areas 61 to 67 are searched and registered. The margin area around the object is set by the width of the object. This is because a margin area having a width in a direction perpendicular to the moving direction of the object is sufficient to close the margin area beyond the object and move the object in the direction of the margin area. For example, the range of the first margin area 61 in FIG. 10 in the Y-axis direction is the same as the existence range of the object 34A in the Y-axis direction.

  FIG. 12 shows details of the additional write area initial setting process (step S112 in FIG. 4). First, the position and size of the written additional mark 31 are checked (step S501), and a rectangular area having a width five times in the + X axis direction and twice in the + Y axis direction of the size of the additional mark 31 is set as an initial additional write area. 32 is set to the closest position of the additional recording mark 31 in the + X-axis direction (step S502). The set additional recording area 32 is displayed as a semi-transparent (in this case, transparency 25%) and plain background layered on the existing object (step S503). The characters and images entered in the additional recording area 32 are displayed on the background of the additional recording area 32.

  FIG. 13 shows an example of how the additional recording area 32 is sequentially expanded by the additional recording area expansion process (step S121 in FIG. 4). FIG. 4A shows an initial additional recording area 32a displayed immediately after the additional recording mark 31 is entered. A rectangular area that is five times the size of the additional recording mark 31 in the X-axis direction and twice the Y-axis direction is set as the initial additional recording area 32a. The background of the additional recording area 32 is a plain white color with a transmittance of 25%. FIG. 5A illustrates a state in which the lower layer object 34C can be seen through thinly.

  FIG. 6B shows the additional recording area 32b expanded in the + X-axis direction due to the entry of the letter A, and FIG. 6C shows additional characters B and C added next to the letter A in the + X-axis direction. Thus, the additional recording area 32c further expanded in the + X-axis direction is shown, and FIG. 4D shows the additional recording area 32d expanded in the + Y-axis direction by adding the letter D in the + Y-axis direction of the letter A. . FIG. 9E shows in gray the range of the postscript object that has been confirmed in response to the postscript end instruction 43. When the additional recording end instruction 43 is received, instruction marks such as the additional recording mark 31, the movement direction instruction, and the movement target instruction are automatically deleted. However, as in the case of “.” Which is the movement end instruction 43 of the present embodiment, an instruction symbol that also serves as the character of the appending object is not automatically deleted.

  14 and 15 show the details of the postscript object state setting process (step S118 in FIG. 4). First, the control unit 11 obtains the size of a write-once object handwritten in the write-once area 32 (step S601). Next, information regarding the blank area around the additional mark 31 is acquired (step S602). This information is information related to the blank area searched and registered in step S110 of FIG. 4 when the additional recording start instruction is received.

  Next, it is confirmed whether or not there is a blank area in which the additional object can be stored as it is at the handwritten position of the additional object (step S603). If there is a blank area in which the postscript object can be stored as it is at the handwriting position of the postscript object (step S604; Yes), the arrangement of the postscript object is fixed at the handwriting position (step S611), and the process is terminated.

  If there is no blank area where the additional object can be stored as it is at the handwritten position (step S604; No), it is checked whether or not a movement target instruction has been received (step S605).

  If a movement target instruction has been received (step S605; Yes), whether or not a blank area in which the additional object can be stored at the handwritten position of the additional object can be secured by moving the object designated as the movement target. Check out. The moving direction of the object designated as the movement target is automatically determined by the relative position with respect to the additional recording mark 31. That is, the direction in which the object designated as the movement target exists with respect to the additional recording mark 31 is automatically set as the movement direction.

  If it is possible to secure a blank area that can accommodate the additional object at the handwritten position of the additional object by moving the object designated as the movement target in the above direction (step S606; Yes), an empty area of the required size is secured. The movement amount of the designated object is determined so as to be the smallest movement amount within the possible range, and the object is moved (step S610). The arrangement of the postscript object is fixed at the handwritten position (step S611), and the process is terminated.

  For example, as illustrated in FIG. 3, when an object below the postscript object (+ Y-axis direction) is designated as a movement target, it is determined whether a blank area exists further below the object. If there is a margin area, when the object specified as the movement target is moved downward so as to fill the margin area, a blank area that can store the additional object at the handwritten position of the additional object is secured. Determine whether or not. If a margin area originally exists at the handwriting position, the margin area is expanded by moving the object, and a blank area is secured.

  If a blank area of the required size can be secured, the movement amount of the designated object is determined so that the minimum movement amount is within a range where the blank area of the necessary size can be secured.

  If the movement of the designated object cannot secure a blank area that can accommodate the additional object at the current position of the additional object (FIG. 14, step S606; No), the object specified as the movement target is maximized. In the moved state, reduction processing is performed so that the postscript object fits in the blank area generated at the handwritten position of the postscript object (steps S607 to S609), and necessary objects are moved (step S610). Is determined (step S611), and the process ends.

  For example, as shown in FIG. 16, it is assumed that a recordable object 71 whose size in the Y-axis direction is A is inserted at the position of the recordable mark 31. The size in the Y-axis direction of the object 72 designated as the movement target is B, and the size in the Y-axis direction of the blank area 73 on the other side of the object 72 when viewed from the additional mark 31 is C. Since C <A, a necessary blank area cannot be secured with the current size.

  In this case, the reduction ratio is determined so that (A + B) falls within the range of (B + C) (step S607). The reduction ratio is preferably closer to 1. In this case, (B + C) / (A + B) is the most preferable reduction ratio.

  The additional object 71 and the object 72 designated as the movement target are reduced according to the reduction ratio (steps S608 and S609), and the reduced object 72 is moved by the maximum amount in the direction of filling the margin area 73, and the post-reduction postscript is added. The object 71 is placed at the handwritten position.

  If the reduction ratio exceeds the allowable upper limit, move after the warning that the object specified in the move target instruction cannot be inserted properly or after obtaining the user's approval after the warning. It is preferable that the target instruction is canceled and the process proceeds to step S622 in FIG.

  If a movement target instruction has not been received (FIG. 14, step S605; No), it is checked whether a movement direction instruction has been received (FIG. 15, step S621). If no movement direction instruction has been received (step S621; No), information relating to an existing object around the additional mark 31 is acquired (step S622). Further, information on the margin area around the existing existing object is acquired (step S623). Then, it is confirmed whether or not a blank area that can store the additional recording object is secured at the handwritten position of the additional writing object by moving the surrounding existing objects so as to close the surrounding blank area (step S624). .

Here, it is determined by the following procedure whether or not a blank area of a necessary size can be secured.
1. Among the surrounding margin areas, the margin area in the + Y-axis direction (lower side) is preferentially used.
2. Above 1. If a blank area of the required size cannot be secured, use the margin area in the -Y axis direction (upper side).
3. 2. If it is not possible to secure a blank area of the required size, use all the lower blank area and fill the upper blank area by the shortage.
4). 3. above. However, if a blank area of the required size cannot be secured, it is determined No in step S624.

  Note that if there is a blank area at the original handwritten position, the blank area is expanded by moving the object. In addition, by determining the margin area to be used, the surrounding existing objects to be moved and their moving directions are also determined. Also, in the above procedure 2. May be omitted.

  Furthermore, it is preferable that the user can change the setting regarding which direction of the margin area to use preferentially. Also, the direction in which the margin area is preferentially used may be automatically changed according to the character input direction (vertical writing, horizontal writing).

  If a blank area of the required size can be secured (step S625; Yes), the existing object to be moved and its movement direction are determined according to the blank area to be used, and the movement amount of the object is determined as the blank area of the required size. Is determined to be the minimum amount within a range that can be secured (step S636). Then, after moving the surrounding existing objects according to the determination (step S637), the process proceeds to step S611.

  If a blank area of a necessary size cannot be secured due to the movement of existing surrounding objects (step S625; No), a reduction process is performed (steps S626 to S628). After the reduction, the necessary objects are moved (steps S636 and S637), the arrangement position of the postscript object is determined (step S611), and the process is terminated.

  For example, as shown in FIG. 17A, it is assumed that a write-once object 74 whose size in the Y-axis direction is A is inserted at the position of the write-once mark 31. The state of the existing object and the margin area is the same as that shown in FIG. The Y-axis size of the existing object 34B at the position of the additional mark 31 is D, the Y-axis size of the upper fifth blank area 65 is B, and the Y-axis size of the lower sixth blank area 66 is C. To do. Since C + B <A, a necessary blank area cannot be secured with the current size.

  In this case, the reduction ratio is determined so that (A + D) − (B + D + C) is insufficient and (A + D) falls within the range of (B + D + C) (step S626). The reduction ratio is preferably closer to 1. In this case, (B + D + C) / (A + D) is a preferable reduction ratio.

  After the additional object 74 and the corresponding existing object 34B are reduced according to the reduction ratio (steps S627 and S628), the reduced object 34B is vertically divided in the vicinity of the portion corresponding to the additional mark 31. Then, the divided upper object is moved by the maximum amount in the upward direction (the negative Y-axis direction) filling the fifth blank area 65, and the divided lower object is filled in the sixth blank area 66. The maximum amount is moved downward (+ Y-axis direction) (steps S636 and S637). By this movement, a blank area in which the postscript object 74 after reduction is accommodated is secured at the position where the postscript mark 31 is located, and the postscript object after reduction is arranged in the blank area. FIG. 17B shows a state in which the postscript object is inserted after being reduced.

  If there is a movement direction instruction (step S621; Yes), information (size, position, etc.) of an existing object in the direction specified by the movement direction instruction is acquired for the additional mark 31 (step S629). Further, information on the blank area around the existing object existing in the designated direction is acquired (step S630). Then, by moving the existing object in the specified direction so as to fill the blank area in the specified direction, whether or not a blank area that can store the additional object at the handwritten position of the additional object is secured (Step S631).

  If a blank area of the required size can be secured (step S632; Yes), the existing object to be moved and its movement direction are determined, and the amount of movement of the object is the minimum amount within a range where the blank area of the required size can be secured. (Step S636). Then, after moving the existing object according to the determination (step S637), the process proceeds to step S611.

  When a blank area of a required size cannot be secured by moving an existing object in the direction specified by the movement direction instruction in the specified direction (step S632; No), reduction processing is performed (steps S633 to S635). The reduced object is moved (steps S636 and S637). Further, the arrangement position of the postscript object is determined (step S611), and this process is terminated.

  For example, when the movement direction is designated as the downward direction in FIG. 16, the object 72 below the additional recording mark 31 is moved downward so as to fill the blank area 73 below it. However, since the size C of the margin area 73 in the Y-axis direction is smaller than the size A of the additional object, the necessary blank area cannot be secured by moving the object in the specified direction with the current size. Therefore, the reduction ratio is determined so that (A + B) falls within the range of (B + C) (step S633). The reduction ratio is preferably closer to 1. In this case, (B + C) / (A + B) is a preferable reduction ratio.

  The append object 71 and the object 72 to be moved are respectively reduced according to the reduction ratio (steps S634 and S635), and the reduced object 72 is moved by the maximum amount in the designated direction, that is, the downward direction in which the margin area 73 is packed, The postscript object 71 after the reduction is arranged in the blank area secured by this movement.

  If the reduction ratio exceeds the allowable upper limit, the user's approval was obtained after giving a warning that the object cannot be inserted properly by moving the object in the direction specified by the direction of movement, or after the warning. Thereafter, it is preferable that the moving direction instruction is canceled and the process proceeds to step S622.

  As described above, in the handwriting input device 10 of the present invention, during handwriting input in the appending mode, the handwritten object is displayed so as to overlap the existing object, and when the input of the handwritten object is completed, the handwritten object is displayed in the existing handwritten object. Since it inserts in an object, a new handwritten object can be inserted in the existing handwritten object, without destroying the whole arrangement | positioning.

  Further, during handwriting input in the appending mode, the appending area 32 is displayed so as to be superimposed on the existing object, and the background of the appending area 32 is made opaque or low in transparency, so that it is easy to see the handwritten object being appended. Can be displayed. In particular, by making the background low in transparency, it is possible to add an existing object under the background while confirming with a thin display.

  In addition, since the user can specify the moving direction and the object to be moved, the additional object can be inserted by moving the existing object so as to meet the user's intention.

  The embodiment of the present invention has been described with reference to the drawings. However, the specific configuration is not limited to that shown in the embodiment, and there are changes and additions within the scope of the present invention. Are also included in the present invention.

  For example, instruction symbols such as an additional recording start instruction, an additional recording end instruction, a movement direction instruction, and a movement target instruction are not limited to those exemplified in the embodiment.

  A method for recognizing a plurality of characters and strokes as one object, a method for searching for a blank area, a method for initial setting and expansion of a write-once area, steps S305 and S306 in FIG. 6, steps S324 and S325 in FIG. The magnification for securing the input area and the magnification for initializing or expanding the additional recording area shown in step S502 of FIG. 12 are examples, and are not limited to those shown in the embodiment. , Optional.

  Processing such as which object is selected as a movement target from among surrounding existing objects and how it is moved is not limited to the processing of the algorithm shown in the embodiment. The existing object around the postscript object is moved so as to fill the blank area on the far side as seen from the postscript mark 31 of the object, and an empty area of a size capable of inserting the postscript object in the handwritten position of the postscript object Any process that can be secured may be used.

  The background of the additional recording area 32 is made opaque white or the like, semi-transparent, or translucent when the semi-transparent is set so that the user can change the setting. In addition, the background is not limited to the background illustrated in the embodiment as long as it is easy to see the handwritten content being added. Further, in the embodiment, the rectangular additional writing area 32 is set and displayed in order to distinguish the contents of the handwritten object being input from the existing objects and display them in an easy-to-view manner. However, the method for making them easy to see is not limited thereto. For example, without providing the additional recording area 32, the background may be displayed only in the portion where the existing object exists in the lower layer among the objects being handwritten, or around the portion where the added stroke exists Only a background may be provided.

  The handwriting input device 10 may be configured in a portable size, or may be configured as a device for handwriting on a large display or screen that many participants commonly view in a meeting or the like.

DESCRIPTION OF SYMBOLS 10 ... Handwriting input device 11 ... Control part 12 ... Display part 13 ... Operation input part 13a ... Touch panel part 14 ... Wireless communication part 15 ... External memory connection part 16 ... CPU
17… FlashROM
18 ... Memory 31 ... Additional recording mark 32, 32a to 32d ... Additional recording region 34, 34A, 34B, 34c ... Existing object 35 ... Margin region 36 ... Additional recording object 37 ... Arrow indicating movement direction 41 ... Movement direction indication mark 42 ... Movement target Instruction mark (circle)
43 ... Additional writing end instruction (punctuation)
51 ... Inputting object 52 ... Input area 61-67 ... Blank area 71 ... Additional object 72 ... Existing object (movement target)
73 ... margin area to be filled by moving the object 74 ... postscript object

Claims (15)

A handwriting input unit that receives input of a handwritten object;
A display unit for displaying a handwritten object input from the handwriting input unit;
A control unit and
The control unit displays the handwritten object superimposed on the existing object during handwriting input of the handwritten object that has received the predetermined additional instruction, and when the input of the handwritten object is completed, the handwritten object is converted into the existing object. A handwriting input device characterized by performing an insertion process of inserting and displaying. The control unit changes a background of the handwritten object at least in a portion overlapping with an existing object to a predetermined background that makes the handwritten object easy to see during handwriting input of the handwritten object that has received the additional writing instruction. The handwriting input device according to claim 1. The said control part ensures the empty area | region for inserting the said handwritten object in the input position of the said handwritten object by moving the existing object so that a margin may be packed. The handwriting input device described. The said control part receives the designation | designated of the existing object moved in order to insert the said handwritten object from a user, moves the designated existing object, and secures the said empty area. The handwriting input device described in 1. The control unit can insert the reduced handwritten object by reducing the existing object and the handwritten object to reduce the blank space when the empty area where the handwritten object can be inserted cannot be secured by reducing the margin. A free space is ensured. The handwriting input device according to claim 3 or 4. The handwriting input device according to claim 2, wherein the predetermined background is an opaque or low-transparency background superimposed on an existing object. The handwriting input device according to any one of claims 1 to 6, wherein the additional writing instruction is a handwritten input of a predetermined additional writing start mark. The handwriting input device according to any one of claims 1 to 7, wherein completion of input of the handwritten object is determined by handwriting input of a predetermined additional writing end mark. The handwriting input device according to claim 4, wherein the designation of an existing object to be moved to insert the handwritten object is a handwriting input of a predetermined selection mark for the existing object to be moved. An information processing apparatus comprising: a handwriting input unit that receives input of a handwritten object; and a display unit that displays the handwritten object input from the handwriting input unit,
During handwriting input of a handwritten object that has received a predetermined appending instruction, the handwritten object is displayed overlaid on an existing object, and when the input of the handwritten object is completed, the handwritten object is inserted into the existing object and displayed. A program characterized by operating as follows. The information processing apparatus;
During the handwriting input of the handwritten object that has received the additional instruction, the background of the handwritten object that overlaps at least the existing object is operated to change to a predetermined background that makes the handwritten object easier to see. The program according to claim 10. The information processing apparatus;
12. The operation according to claim 10, wherein an operation is performed so as to secure an empty area for inserting the handwritten object at an input position of the handwritten object by moving an existing object so as to fill in a blank space. Program. The information processing apparatus;
The specification of an existing object to be moved to insert the handwritten object is received from a user, and the specified existing object is moved to operate to secure the free space. The listed program. The information processing apparatus;
If it is not possible to secure a free space where the handwritten object can be inserted by filling the margin, the existing object and the handwritten object are reduced and the blank space is filled to secure a free space where the reduced handwritten object can be inserted. The program according to claim 12 or 13, wherein the program is operated as follows. The program according to claim 11, wherein the predetermined background is an opaque or low-transparency background superimposed on an existing object.