JP2006053741A - Tag information processing method, tag information processing system, and tag information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display content information of an electronic tag composed of characters not made to text data such as pen input characters on a computer system in an easy-to-see state. <P>SOLUTION: In the electronic tag display system (tag information processing system), a character cut-out means 110 determines an area of character string within image data of tag content information character by character. An extraction area designation means 11 determines an area for omitting the content of an electronic tag character by character. An extraction means 112 extracts an image based on the extraction area. A tag image formation means 113 forms an omitted tag from the extracted image. The tag information processing system is operated to superpose and display the omitted tag on an electronic document and switch it to the original tag according to a user's request. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a sticky note information processing method, a sticky note information processing system, and a sticky note information processing program for displaying an electronic sticky note attached to an electronic document. In particular, the present invention targets processing of electronic sticky notes that display handwritten characters and characters stored as image data in a pen input environment, and displays the contents of electronic sticky notes when superimposed on an electronic document being viewed. The present invention relates to a sticky note information processing method, a sticky note information processing system, and a sticky note information processing program that are displayed with a part omitted.

  There is a method of inputting and displaying an electronic sticky note (hereinafter referred to as an electronic sticky note) as an information input and display method that realizes the same usability as a sticky note pasted on a paper document for an electronic document using a GUI. . The method of inputting / displaying an electronic sticky note is realized by a method of attaching sticky note data to an electronic document or the like, and the sticky note data of the electronic sticky note is mainly composed of position information to which the sticky note is pasted and content information described in the sticky note. .

  As a method for displaying an electronic sticky note, there is usually a method of superimposing and displaying electronic information on the original screen as it is. However, with this display method, the contents of the electronic document are difficult to see due to the sticky note. Therefore, in order to avoid the problem that the contents of the electronic document are difficult to see, there is a method of reducing the size of the tag and displaying it.

  In addition, as an input method of electronic sticky notes, in an environment where pen input is possible (for example, an environment in which handwritten characters can be input in a terminal equipped with a pressure-sensitive touch panel or an electromagnetic induction tablet) There is a method of inputting electronic sticky notes by pen input. When inputting an electronic sticky note with a pen, the content information of the electronic sticky note input by hand on an electronic document on the GUI is often stored as input stroke data or image data instead of text data.

  When inputting an electronic sticky note with a pen, it is difficult for a user to write a fine character due to the restriction of an input device called a pen, and a character displayed by a pen stroke tends to be a character larger than a text character. In addition, since the character frame is not displayed as in the original paper, a part of the character frame may be a small character and characters of different sizes may be mixed. Therefore, reducing a large character so that it is displayed in a small character size not only makes the small character unreadable, but on the other hand, reducing a small character so that it can be displayed in a size that can be read is a large character. Will be unnecessarily large, and the original electronic document may become invisible. In these cases, if the user does not write characters of an appropriate size in consideration of the reduction ratio at the stage of inputting characters, either the electronic sticky note or the electronic document becomes difficult to read, which is a burden on the user.

  Further, Patent Document 1 describes an electronic sticky note display method that displays an underline indicating the presence of a sticky note instead of simply reducing the electronic sticky note instead of displaying the content information of the electronic sticky note. In the method for displaying an electronic sticky note attached to an electronic document described in Patent Document 1, the document management apparatus includes a composite data holding unit that holds the document and associated sticky note information in the information processing apparatus, and original document information A document data holding unit, an attached information holding unit for holding information to be displayed as composite data such as electronic sticky notes and marker information, and a terminal control unit.

  In the electronic sticky note display method described in Patent Document 1, the document management apparatus attaches an electronic sticky note to a character string of a document, does not normally display the contents of the electronic sticky note, and instead attaches an electronic sticky note. An underline indicating that the character string has an electronic sticky note is displayed. In addition, when the user performs an operation such as clicking an underline, the document management apparatus displays information on the electronic sticky note that is not normally displayed as memo information.

JP 2000-339299 A (Page 6, FIG. 9)

  When handling an electronic sticky note in an environment such as a pen input environment, the reduction rate of the electronic sticky note is irrelevant to the size of the input character. There are cases where the contents of sticky notes cannot be understood due to the occurrence of unreadable characters.

  Moreover, if the display method of the electronic sticky note described in patent document 1 is used, an electronic document can be made easy to read. However, since the content information of the electronic sticky note is not normally displayed, the content of the electronic sticky note cannot be grasped at all unless the user performs a content display instruction operation.

  Therefore, the present invention provides a sticky information processing method, a sticky information processing system, and a sticky note information processing program that can be displayed in an easy-to-see manner on the content information of an electronic sticky note composed of characters that are not converted into text data such as pen input characters on a computer system. The purpose is to provide. Further, the present invention provides a sticky note information processing method capable of partially browsing content information of an electronic sticky note composed of characters that are not converted into text data such as pen input characters on a computer system without impairing browsing of the electronic document, An object is to provide a tag information processing system and a tag information processing program.

  The sticky note information processing method according to the present invention is based on a character extraction step of extracting characters written on an electronic sticky note inputted as image information in units of characters and extracting region information of each character, and based on the extracted region information of each character. Based on the extraction area calculation step for calculating a target area to be extracted as an abbreviated sticky note, which is an electronic sticky note in which the extracted characters are counted in character units and a part of the contents of the original electronic sticky note is omitted. The method includes an extraction step of extracting a part of the content information of the electronic sticky note, and a sticky note creation step of creating an abbreviated sticky note based on the extracted content information.

  Further, the sticky note information processing method may calculate a region in which a gap between characters and a margin before and after the character are deleted as a target region to be extracted as an omitted sticky note in the extraction region calculation step. . According to such a configuration, the character region and the margin region can be distinguished by performing the character cutout process, and the sticky note can be reduced by efficiently removing the useless blank space of the sticky note.

  The tag information processing method calculates the character size based on the area information of each character obtained in the character segmentation step in the extraction area calculation step, and sets the character size of each character to be equal for each character. It may be processed. According to such a configuration, the reduction rate considering the character size is used in the character cut-out process, so that the sticky note can be reduced so that the character written on the sticky note does not become too small.

  Also, the sticky note information processing method cuts out characters written on an electronic sticky note inputted as image information in character units, extracts area information of each character, and derives line information of each line written on the electronic sticky note. Using the character extraction step and line information derived in the process of the character extraction step, the target area to be extracted as an abbreviated sticky note, which is an electronic sticky note that omits part of the contents of the original electronic sticky note, is calculated in line units. An extraction area calculating step, an extraction step for extracting a part of the content information of the electronic sticky note based on the calculated extraction region, and a sticky note creating step for creating an abbreviated sticky note based on the extracted content information. There may be.

  The tag information processing method calculates an area composed of a plurality of rectangular areas in which margins before and after characters in a line are deleted as a target area to be extracted as an abbreviated tag in an extraction area calculation step. Also good. According to such a configuration, the character region and the margin region can be distinguished by performing the character cutout process, and the sticky note can be reduced by efficiently removing the useless blank region of the sticky note.

  The tag information processing method calculates the character size based on the area information of each character obtained in the character segmentation step in the extraction area calculation step, and selects a line having a large average character size for each line as the target area. You may do.

  In addition, the tag information processing method includes a character extracting step of extracting characters written on an electronic tag inputted as image information in units of one character and extracting area information of each character, and an un-omitted electronic character displayed on the output device. An input specification step for directly specifying a character area to be displayed as an abbreviated note, which is an electronic sticky note in which a part of the content of the original electronic sticky note is omitted according to a user input instruction, and a location specified in the input specification step An extraction area calculation step for calculating a character area including a target area of an abbreviated sticky note, an extraction step for extracting a part of content information of an electronic sticky note based on the calculated extraction area, and based on the extracted content information A sticky note creating step for creating an abbreviated sticky note.

  The sticky note information processing method includes a rule storing step for storing rule information indicating a rule for processing an electronic sticky note in advance, and a changing step for changing the stored rule information. The extraction area calculating step is based on the rule information. The target area of the abbreviated sticky note may be calculated.

  The sticky note information processing method includes a sticky note data storing step for storing sticky note data of an electronic sticky note, and the sticky note data storing step stores the processed sticky note data of the omitted sticky note in association with the rule information. Also good. According to such a configuration, since the rule is stored in association with the tag data, it is also possible to store the omitted result tag data in which the same electronic tag is omitted using a plurality of rules.

  The sticky note information processing system according to the present invention includes a manuscript data storage unit (for example, realized by the manuscript data storage unit 108) that stores manuscript data of an electronic document that is a target for displaying an electronic sticky note, and a sticky note of the electronic sticky note to be displayed. Sticky note data storage means for storing data (for example, realized by the sticky note data storage unit 107) and information processing means for creating and displaying one or a plurality of processed omitted sticky notes for document data (for example, the computer 103) And the information processing means cuts out characters written on the electronic sticky note inputted as image information in character units and extracts area information of each character (for example, character cutout means) 110), and the character cut-out means extracts the cut-out character based on the area information of each character extracted. An extraction area calculation means (for example, realized by the extraction area designation means 111) for calculating a target area to be extracted as an abbreviated sticky note that is an electronic sticky note that is obtained by omitting a part of the content of the original electronic sticky note, counted in character units. Extraction means for extracting a part of the content information of the electronic sticky note based on the calculated extraction area (for example, realized by the extraction means 112), and sticky note creation means for creating an abbreviated sticky note based on the extracted content information (For example, realized by the sticky note image creating means 113). In addition, the electronic sticky note display system using the present invention operates to superimpose an abbreviated sticky note on the electronic document and to switch and display the original sticky note in response to a user request. According to such a configuration, the content information of the electronic sticky note composed of characters not converted into text data such as pen input characters on the computer system by displaying the abbreviated omitted sticky note added to the electronic document It is possible to achieve the object of the present invention to display in an easy-to-see state.

  In addition, the sticky note information processing system includes a manuscript data storage unit that stores manuscript data of an electronic document that is a target for displaying an electronic sticky note, a sticky note data storage unit that stores sticky note data of an electronic tag to be displayed, and a manuscript data Information processing means for creating and displaying one or a plurality of processed abbreviated sticky notes, and the information processing means cuts out characters written on the electronic sticky note inputted as image information in units of characters. A part of the contents of the original electronic sticky note using character extraction means for extracting information and deriving line information of each line written on the electronic sticky note, and line information derived by the character extraction means in the process of extraction processing An extraction area calculation means for calculating a target area to be extracted as an abbreviated sticky note, which is an electronic sticky note from which the information is omitted, and an extraction for extracting content information of the electronic sticky note based on the calculated extraction area And stage, based on the extracted content information may include a tag generating means for generating omitted sticky.

  In addition, the sticky note information processing system includes a manuscript data storage unit that stores manuscript data of an electronic document that is a target for displaying an electronic sticky note, a sticky note data storage unit that stores sticky note data of an electronic tag to be displayed, and a manuscript data Information processing means for creating and displaying one or a plurality of processed abbreviated sticky notes, and the information processing means cuts out characters written on the electronic sticky note inputted as image information in units of characters. Character extraction means for extracting area information and an electronic sticky note that is an electronic sticky note that omits a part of the contents of the original electronic sticky note according to a user input instruction with respect to the electronic sticky note that is displayed on the output device before being omitted An input specifying means (for example, realized by the input means 101 and the input information interpreting unit 104) for directly specifying a character area to be performed, and a sentence including a portion specified by the input specifying means Extraction area calculation means for calculating the area as the target area of the abbreviated sticky note, extraction means for extracting a part of the content information of the electronic sticky note based on the calculated extraction area, and abbreviated sticky note based on the extracted content information It may include a sticky note creating means to create.

  One or both of the sticky note data storage means and the document data storage means are realized by an apparatus (for example, the storage means 230) connected to the information processing means via a network and different from the information processing means. It may be. According to such a configuration, by sharing the document data and the tag data between a plurality of computers, it is possible to use the omitted tag content information processed by another computer.

  The information processing means may create an abbreviated sticky note that maintains legibility in accordance with the screen size of the output means for displaying the electronic document.

  The sticky note information processing program according to the present invention includes a character cutout process for cutting out characters written on an electronic sticky note inputted as image information into a computer in units of characters and extracting region information of each character, and regions of each extracted character Based on the information, an extracted area calculation process for calculating a target area to be extracted as an abbreviated sticky note that is an electronic sticky note in which a part of the contents of the original electronic sticky note is omitted by counting the number of characters cut out and calculated An extraction process for extracting a part of the content information of the electronic sticky note based on the area and a sticky note creation process for creating an abbreviated sticky note based on the extracted content information are executed.

  Also, the sticky note information processing program extracts characters written on the electronic sticky note inputted as image information to the computer in units of one character to extract area information of each character, and line information of each line written on the electronic sticky note The target area to be extracted as an abbreviated sticky note, which is an electronic sticky note that omits a part of the content of the original electronic sticky note, using the character cutout process that derives the character and the line information that is derived in the cutout process in the character cutout process. Extraction area calculation processing calculated in units, extraction processing for extracting part of the content information of the electronic sticky note based on the calculated extraction region, and sticky note creation processing for creating an abbreviated sticky note based on the extracted content information It may be executed.

  The sticky note information processing program also includes a character cut-out process for cutting out characters written on an electronic sticky note inputted as image information in units of characters and extracting area information of each character on a computer, and an omission displayed on the output device. An input designation process for directly designating a character area to be displayed as an abbreviated sticky note that is an electronic sticky note in which a part of the contents of the original electronic sticky note is omitted according to a user input instruction, and an input designation process for the previous electronic sticky note Extraction area calculation processing for calculating a character area including a specified location as a target area of an abbreviated sticky note, extraction processing for extracting a part of content information of an electronic sticky note based on the calculated extraction region, and extracted content information And a sticky note creation process for creating an abbreviated sticky note based on the above.

  According to the present invention, even for handwritten data that does not include information on the size of characters, the character size is understood and the characters are cut out. Then, sticky note data in which a part of the original sticky note is omitted is generated based on the character cutout result. Therefore, it is possible to display the contents information of the electronic sticky note composed of characters not converted into text data such as pen input characters on the computer system in an easy-to-view state.

Embodiment 1 FIG.
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of a sticky note information processing system (electronic sticky note display system) according to the present invention. As shown in FIG. 1, the sticky note information processing system includes an input means 101, an output means 102, and a computer (information processing apparatus) 103 that operates under program control. The computer 103 also includes an input information interpretation unit 104, a sticky note information processing unit 105, a display image generation unit 106, a sticky note data storage unit 107, and a document data storage unit 108. The sticky note information processing unit 105 includes a position / content information extracting unit 109, a character segmenting unit 110, an extraction area designating unit 111, an extracting unit 112, a sticky note image creating unit 113, and a rule information table 114. .

  The input unit 101 is, for example, a pen input device or an input device such as a mouse, a camera, or a scanner. The input means 101 inputs sticky note data of an electronic sticky note. In the present embodiment, the sticky note data includes position information indicating the position of the electronic sticky note and sticky note content information indicating the content of the electronic sticky note. That is, the input means 101 inputs the electronic sticky note position information and sticky note content information in accordance with a user input instruction. In the present embodiment, the input unit 101 does not input the tag content information as text data, but inputs the tag content information as image data using an electronic pen or the like.

  The input unit 101 inputs a command such as an instruction to change the display method of the sticky note according to the user's input instruction. As will be described later, the input information interpretation unit 104 performs electrical interpretation and semantic interpretation of the input signal.

  For example, the user performs a GUI operation such as pressing a button displayed on the output means (display means) 102 by operating the input means 101 such as a pen input device or a mouse that can be pointed. Further, the input information interpretation unit 104 analyzes input information input by a camera device or a scanner, so that the tag information processing system understands the input command. The detailed operation for analyzing the input information and understanding the input command is described in, for example, “JP 2000-222394 (Document A)”.

  Specifically, the output means 102 is an image output device such as a monitor. The output unit 102 has a function of outputting (displaying) an image in accordance with an instruction from the display image generating unit 106. In the present embodiment, the output unit 102 displays an electronic document on which an electronic tag is superimposed in accordance with an instruction from the display image generation unit 106.

  The computer 103 has a function of interpreting input information from the input unit 101 and causing the output unit 102 to output an image generated as a result of information processing. In the present embodiment, the computer 103 generates an image that displays a sticky note in which a part of the content of the original electronic sticky note is omitted, and causes the output unit 102 to output the image. The input information interpretation unit 104 has a function of interpreting information input by the input unit 101 and sending a command or data to the sticky note information processing unit 105 according to a command specified based on the result of the interpretation.

  The sticky note information processing unit 105 has a function of creating an omitted sticky note in accordance with a command received from the input information interpretation unit 104. Further, the sticky note information processing unit 105 has a function of outputting, in accordance with the command received from the input information interpreting unit 104, a sticky note image to be displayed instructed by the command to the display image generating unit 106 together with position information. The “abbreviated sticky note” is an electronic sticky note composed of a part of the content information of the original electronic sticky note entered / created by the user as an electronic sticky note, and is more electronic than the original sticky note at the time of writing by the user. The sticky note is processed so that the display area becomes small.

  The position / content information extraction unit 109 has a function of extracting the content information of a tag that can be processed as an abbreviated tag from the tag data newly received from the input information interpretation unit 104, and passing the extracted content information to the character segmentation unit 110. . Further, the position / content information extraction unit 109 has a function of saving the tag data received from the input information interpretation unit 104 in the tag data storage unit 107. Further, the position / content information extraction unit 109 has a function of extracting the content information of a sticky note that can be processed as an abbreviated sticky note from the sticky note data storage unit 107 and passing the extracted content information to the character cutout unit 110. Further, the position / content information extracting unit 109 has a function of delivering the extracted content information to the character cutout unit 110 and passing the position information of the tag to the tag image creating unit 113.

  If the omitted sticky note data is already stored in the sticky note data storage unit 107, the position / content information extracting unit 109 combines the position information and the content information of the omitted sticky note with the sticky note data storage unit 107. And a function of passing to the tag image creation means 113.

  The character cutout unit 110 has a function of performing character cutout processing on the image of the tag content information received from the position / content information extraction unit 109 and passing the region information of each character to the extraction region specifying unit 111 as a cutout result. . In the present embodiment, the character cutout unit 110 passes the character frame information of each character to the extraction region specifying unit 111 as the region information of each character. The extraction area designating unit 111 has a function of calculating a coordinate area to be cut out as an abbreviated tag by applying a predetermined rule to the character frame received from the character cutout unit 110. In the present embodiment, the extraction area designating unit 111 calculates a coordinate area according to the rules described in the rule information table 114.

  The extraction unit 112 extracts a part of the content information of the electronic sticky note based on the extraction region (coordinate region) calculated by the extraction region specifying unit 111. In the present embodiment, the extracting unit 112 processes the image of the sticky note content information based on the region information calculated by the extraction region specifying unit 111 and omits the omitted sticky note image of the electronic sticky note (the sticky note content information of the omitted sticky note). Create

  Specifically, the rule information table 114 is stored in a storage device of the computer 103 or the like. The rule information table 114 is a table that describes a rule for extracting a clip area of a tag content and a rule for reducing a tag image. In the present embodiment, the rule information table 114 provides rules for performing extraction processing and reduction processing to the extraction region designation unit 111 and the extraction unit 112.

  The tag image creating unit 113 has a function of creating an abbreviated tag based on the tag content information extracted by the extracting unit 112. In the present embodiment, the sticky note image creating means 113 generates the sticky note data of the omitted sticky notes to be displayed based on the position information received from the position / content information extracting means 109 and the sticky note content information received from the extracting means 112. Generate. Further, when receiving the tag content information together with the position information from the position / content information extracting unit 109, the tag image creating unit 113 generates the tag data using the received position information and the tag content information as they are. The tag image creating unit 113 has a function of passing the generated tag data to the display image generating unit 106. In addition, when there are a plurality of sticky notes in the electronic document to be displayed, the sticky note image creating means 113 passes the sticky note data as a set to the display image generating unit 106 in order.

  The display image generation unit 106 has a function of extracting a document image from the document data storage unit 108 and generating a display image by superimposing the extracted document image and the tag image of the tag data generated by the tag information processing unit 105. . In this case, the display image generation unit 106 generates a display image that also displays related display information shown to the user through the output unit 102.

  Specifically, the sticky note data storage unit 107 is a storage device such as a memory or a hard disk device. The sticky note data storage unit 107 corresponds to the position information and content information of the input sticky note and information such as a file name and page number for specifying the electronic manuscript displayed on the output unit 102 when the sticky note is added. Add and remember. The sticky note data storage unit 107 stores processed sticky note content information (sticky note content information of omitted sticky notes).

  In the present embodiment, the sticky note data storage unit 107 stores sticky note data of omitted sticky notes and also stores original sticky note data before processing. By doing so, it is possible to easily generate and display an image in which the original tag is added to the electronic document based on the original tag data even after the abbreviated tag image is created.

  Specifically, the document data storage unit 108 is a storage device such as a memory or a hard disk device. The document data storage unit 108 stores document data that the display image generation unit 106 causes the output unit 102 to display.

  Next, the operation will be described. FIG. 2 is a flowchart showing an example of sticky note information processing in which the sticky note information processing system processes sticky note information. In the present embodiment, the sticky note information processing system performs processing for creating an abbreviated sticky note attached to one electronic document surface and displaying the created abbreviated note superimposed on the electronic document.

  The input unit 101 inputs an instruction to add an electronic sticky note to the electronic document or to create an abbreviated sticky note in accordance with a user operation. An input information interpretation unit 104 of the computer 103 interprets information input by the input unit 101. When the input information interpretation unit 104 interprets the input information as an abbreviated sticky note creation instruction, the position / content information extraction unit 109 of the sticky note information processing unit 105 receives the instructed omitted sticky note in response to the received abbreviated sticky note creation instruction. It is determined whether or not a new creation process is required (step S101). In the present embodiment, the position / content information extracting unit 109 determines whether or not the instructed omitted sticky note has already been created. When the abbreviated sticky note has already been created, the position / content information extracting unit 109 determines that it is not necessary to create a new abbreviated sticky note. When the omitted sticky note has not been created, the position / content information extracting unit 109 determines that it is necessary to newly create the omitted sticky note.

  If it is determined that it is not necessary to create a new abbreviated sticky note, since the already created data (abbreviated sticky note data) is saved in the sticky note data storage unit 107, the position / content information extracting unit 109 saves the data. The attached tag data is extracted from the tag data storage unit 107 (step S102), and the extracted tag data is transferred to the display image generation unit 106.

  If it is determined that it is necessary to create a new abbreviated sticky note, the position / content information extraction unit 109 acquires unprocessed sticky note data (step S103). In the present embodiment, the position / content information extraction unit 109 performs processing of unprocessed tag data that has been input in the past but is not processed as an abbreviated tag and is still stored in the tag data storage unit 107. Extracted from the tag data storage unit 107 as target data. Further, the position / content information extraction unit 109 acquires (inputs) the sticky note data input together with the omitted sticky note creation instruction from the input information interpretation unit 104 via the position / content information extraction unit 109 as unprocessed processing target data. To do.

  In addition, the position / content information extraction unit 109 separates and extracts position information and content information from the acquired tag data (step S104). For example, the position / content information extracting unit 109 extracts the coordinate information of the upper left point of the tag as the position information. Further, for example, the position / content information extracting unit 109 extracts image data of an electronic sticky note as the content information.

  The character cutout unit 110 performs a character cutout process on the content information of the sticky notes cut out by the position / content information extraction unit 109, and calculates the position information (character frame information) of the character frame of each character (step S105). . Note that in the process of character cutout processing in step S105, the character cutout unit 110 may perform character cutout processing after separating a character string composed of a plurality of lines into units of lines, and calculate line information. .

  The extraction area designating unit 111 calculates an area to be extracted as an abbreviated tag from the character frame information cut out by the character cutout unit 110 based on the rules of the rule information table 114 (step S106). For example, the extraction area designating unit 111 determines the extraction area in accordance with extraction condition rules such as “extract four characters from the first line (upper left)” and “select an extraction location based on information from the outside”. Further, for example, the extraction area designating unit 111 determines the extraction area according to the rule of the processing condition for each character such as “equalize the size of each character”. Further, for example, the extraction area designating unit 111 determines the extraction area in accordance with a rule regarding a rectangular size as an abbreviated tag (condition for creating contents information of an abbreviated tag) such as “reduction to fit within 50 pixels”. .

  The extraction unit 112 performs region extraction processing in accordance with the extraction region determined (calculated) by the extraction region designating unit 111, and newly creates the content information of the omitted sticky note (step S107). In this case, the extracting unit 112 also performs processing such as changing the image size on the content information of the created abbreviated sticky note according to the rule used in step S106.

  The sticky note image creating unit 113 newly creates sticky note data (omitted sticky note information) including the position information received from the position / content information extracting unit 109 and the sticky note content information newly created by the extracting unit 112 in step S107. (Step S108). Further, the sticky note image creation unit 113 stores the created sticky note data in the sticky note data storage unit 107. By doing so, when it is necessary to display an abbreviated sticky note again with the same rule, the process of generating the abbreviated sticky note data again can be omitted.

  The sticky note information processing unit 105 determines whether there is an unprocessed sticky note among the sticky notes to be displayed (step S109). That is, the sticky note information processing unit 105 determines whether or not the creation processing of all sticky note data of the sticky notes to be displayed has been completed. If it is determined that there is an unprocessed sticky note, the sticky note information processing unit 105 returns to step S101 and repeatedly executes the omitted sticky note creation process.

  When it is determined that there is no unprocessed sticky note (all the sticky data creation processing has been completed), the display image generation unit 106 extracts the original data from the original data storage unit 108. The display image generation unit 106 generates a display image in which the document data and each omitted tag to be displayed are superimposed based on the extracted document data and the tag data from the tag information processing unit 105 (step S110). . Then, the display image generation unit 106 causes the output unit 102 to display the generated display image.

  As described above, according to the present embodiment, the character cutout unit 110 understands the character size and cuts out the character even if it is not text data but handwritten data that does not include information related to the character size. Then, the computer 103 generates sticky note data in which a part of the content of the original sticky note is omitted based on the character cutout result. Therefore, the omission considering the number of characters on the tag and the reduction of the tag considering the character size can be performed, and the content information of the tag can be omitted and displayed. In addition, the content information of the tag can be partially reduced and displayed. Therefore, it is possible to display the contents information of the electronic sticky note composed of characters not converted into text data such as pen input characters on the computer system in an easy-to-view state. In addition, when reading an electronic document, a sticky note can be displayed without interfering with the document portion, and a part of the content of the sticky note can be browsed.

  Further, according to the present embodiment, the sticky note data storage unit 107 stores the sticky note data of the omitted sticky note together with the original sticky note data before being omitted. Therefore, even after creating an abbreviated sticky note image, the sticky note image creation means 113 can easily display an image with the original sticky note added by extracting the original sticky note data and recreating the superimposed image. it can. Further, according to the present embodiment, an area to be displayed as an abbreviated sticky note can be arbitrarily designated by a user input, so that any part of the sticky note can be displayed even after it is omitted. Further, the electronic sticky note display device using the present embodiment can be operated so that the omitted sticky note is superimposed on the electronic document and switched to the original sticky note in response to a user request.

Embodiment 2. FIG.
Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a block diagram illustrating another configuration example of the tag information processing system. As shown in FIG. 3, the sticky note information processing system includes an input unit 101, an output unit 102, and a computer (information processing apparatus) 103 that operates under program control. The computer 103 also includes an input information interpretation unit 104, a sticky note information processing unit 105, a display image generation unit 106, a sticky note data storage unit 107, and a document data storage unit 108. The sticky note information processing unit 105 includes a position / content information extracting unit 109, a character segmenting unit 110, an extraction area specifying unit 111, an extracting unit 112, and a sticky note image creating unit 113.

  This embodiment is different from the first embodiment in that the sticky note information processing unit 105 does not include the rule information table 114. Further, the present embodiment is different from the first embodiment in that the sticky note data storage unit 107 includes an extraction rule storage unit 115 that stores a rule for creating an omitted sticky note. In the present embodiment, the functions of the input unit 101 and the output unit 102 are the same as those functions in the first embodiment.

  The computer 103 has a function of interpreting input information from the input unit 101 and causing the output unit 102 to output an image generated as a result of information processing. The input information interpretation unit 104 has a function of interpreting information input by the input unit 101 and sending a command or data to the sticky note information processing unit 105 according to a command specified based on the result of the interpretation.

  The sticky note information processing unit 105 has a function of creating an omitted sticky note in accordance with a command received from the input information interpretation unit 104. Further, the sticky note information processing unit 105 has a function of outputting, in accordance with the command received from the input information interpreting unit 104, a sticky note image to be displayed instructed by the command to the display image generating unit 106 together with position information.

  The position / content information extracting unit 109 has a function of extracting the content information of a sticky note to be processed as an abbreviated sticky from the tag data newly received from the input information interpretation unit 104 and passing the extracted content information to the character cutout unit 110. . Further, the position / content information extraction unit 109 has a function of saving the tag data received from the input information interpretation unit 104 in the tag data storage unit 107. Further, the position / content information extraction unit 109 has a function of extracting the content information of the sticky note to be processed as an abbreviated sticky note from the sticky note data storage unit 107 and passing the extracted content information to the character cutout unit 110. Further, the position / content information extracting unit 109 has a function of delivering the extracted content information to the character cutout unit 110 and passing the position information of the tag to the tag image creating unit 113.

  If the omitted sticky note data is already stored in the sticky note data storage unit 107, the position / content information extracting unit 109 combines the position information and the content information of the omitted sticky note with the sticky note data storage unit 107. And a function of passing to the tag image creation means 113.

  The character segmentation unit 110 performs a character segmentation process on the image of the tag content information received from the position / content information extraction unit 109 and passes the character frame information of each character to the extraction area designation unit 111 as the segmentation result. Prepare. When performing the character cutout process, the character cutout unit 110 may perform line extraction processing on a plurality of character strings to extract line information. When extracting line information, the character cutout unit 110 may extract character frame information including line information as a cutout result.

  The extraction area designating unit 111 has a function of calculating a coordinate area to be cut out as an abbreviated tag by applying a predetermined rule to the character frame received from the character cutout unit 110. In the present embodiment, the extraction area designating unit 111 extracts a predetermined rule from the extraction rule storage unit 115 and calculates a coordinate area according to the extracted rule. The extraction area designating unit 111 calculates a coordinate area in accordance with a rule specifically instructed from the input information interpretation unit 104. For the applied rule information, the sticky note information processing unit 105 stores the sticky note content information in the sticky note data storage unit 107 so that it can correspond to the sticky note content information when storing the processed sticky note content information. At the same time, the rule is stored in the extraction rule storage unit 115. The extraction unit 112 has a function of processing an image of the sticky note content information based on the region information calculated by the extraction region specifying unit 111 and creating an abbreviated sticky note image of the electronic sticky note after omission (the sticky note content information of the omitted sticky note). Prepare.

  The sticky note image creating unit 113 has a function of generating sticky note data of an omitted sticky note to be displayed based on the position information received from the position / content information extracting unit 109 and the sticky note content information received from the extracting unit 112. Further, when receiving the tag content information together with the position information from the position / content information extracting unit 109, the tag image creating unit 113 generates the tag data using the received position information and the tag content information as they are. The tag image creating unit 113 has a function of passing the generated tag data to the display image generating unit 106. In addition, when there are a plurality of sticky notes in the electronic document to be displayed, the sticky note image creating means 113 passes the sticky note data as a set to the display image generating unit 106 in order.

  The display image generation unit 106 has a function of extracting a document image from the document data storage unit 108 and generating a display image by superimposing the extracted document image and the tag image of the tag data generated by the tag information processing unit 105. . In this case, the display image generation unit 106 generates a display image that also displays related display information shown to the user through the output unit 102.

  Specifically, the sticky note data storage unit 107 is a storage device such as a memory or a hard disk device. The sticky note data storage unit 107 corresponds to the position information and content information of the input sticky note and information such as a file name and page number for specifying the electronic manuscript displayed on the output unit 102 when the sticky note is added. Add and remember. The sticky note data storage unit 107 stores processed sticky note content information (sticky note content information of omitted sticky notes).

  In the present embodiment, the tag data storage unit 107 includes an extraction rule storage unit 115. The extraction rule storage unit 115 stores rule information for generating the omitted sticky note by omitting the sticky note content information. In the present embodiment, the extraction rule storage unit 115 stores in advance a rule indicating a method for omitting a sticky note. When a rule is input from the input information interpretation unit 104, the extraction rule storage unit 115 may store the input rule. In the present embodiment, the extraction rule storage unit 115 stores the rules used for processing in association with the processed sticky note content information stored in the sticky note data storage unit 107.

  Specifically, the document data storage unit 108 is a storage device such as a memory or a hard disk device. The document data storage unit 108 stores document data that the display image generation unit 106 causes the output unit 102 to display.

  In the present embodiment, the operation of the tag information processing system is basically the same as the operation of the tag information processing of FIG. 2 shown in the first embodiment. However, in the present embodiment, in step S106 of FIG. 2, the extraction area designating unit 111 extracts an area based on the rules stored in the extraction rule storage unit 115 instead of the rule information table 114. Alternatively, the extraction area designating unit 111 extracts an area based on the rule input from the input information interpretation unit 104.

  As described above, according to the present embodiment, the extraction area designating unit 111 performs the extraction process based on the rule for generating the omitted sticky note by omitting a part of the sticky note content information. Can process electronic sticky notes. Further, according to the present embodiment, since the rule is stored in association with the tag data in the tag data storage unit 107, it is possible to store the tag data as a result of omitting the same electronic tag using a plurality of rules. it can. Further, according to the present embodiment, processing conditions and the like are held as rules, and are stored in cooperation with processed tag data as necessary, so that processing corresponding to a plurality of omission methods can be performed. it can.

Embodiment 3 FIG.
Next, a third embodiment of the present invention will be described with reference to the drawings. FIG. 4 is a block diagram showing still another configuration example of the tag information processing system. As shown in FIG. 4, in the present embodiment, the sticky note information processing system is configured using a program, and is configured using an environment in which computers operating according to the program are connected to a network. As shown in FIG. 4, the sticky note information processing system includes computers (information processing devices) 210 and 220 and storage means 230 such as a hard disk device. The computers 210 and 220 include input devices such as a pen and a mouse, output means 102 such as a monitor, and storage means 211 and 221 such as a memory and a hard disk device.

  In the present embodiment, the storage units 211 and 221 of the computers 210 and 220 store various programs for processing the tag information. For example, the storage units 211 and 221 may be a computer that extracts character information written on an electronic tag inputted as image information in units of characters and extracts region information of each character, and regions of the extracted characters. Based on the information, an extracted area calculation process for calculating a target area to be extracted as an abbreviated sticky note that is an electronic sticky note in which a part of the contents of the original electronic sticky note is omitted by counting the number of characters cut out and calculated A sticky note information processing program for executing an extraction process for extracting a part of content information of an electronic sticky note based on an area and a sticky note creation process for creating an abbreviated sticky note based on the extracted content information is stored. .

  In the present embodiment, the operation of the computer 210 is controlled by reading and executing the tag information processing program from the storage unit 211 to the computer (central processing unit, processor, or data processing unit) 210. The computer 210 performs processing similar to the processing of the computer 103 described in the first embodiment or the second embodiment by operating according to the control of the program.

  In the present embodiment, the sticky note data storage unit 107 and the document data storage unit 108 described in the first embodiment and the second embodiment are storage units 230 connected to the computer 210 via a network. It is realized by. That is, in the present embodiment, sticky note data and document data are stored in the storage unit 230.

  Further, in this embodiment, the computer 220 having the same configuration as the computer 210 is connected to the network, so that the storage unit 230 can be shared between the computer 210 and the computer 220. Therefore, the computer 210 and the computer 220 can share data stored in the storage unit 230 as the tag data storage unit 107 and the document data storage unit 108.

  As described above, according to the present embodiment, by sharing document data and sticky note data among a plurality of computers, it is possible to use omitted sticky note content information processed by other computers.

  Next, the operation of the sticky note information processing system according to the present invention will be described using a specific embodiment. First, a first embodiment of the tag information processing system will be described with reference to the drawings. FIG. 5 is an explanatory diagram illustrating an example of an electronic document 301 in which a sticky note 401 is input and added using a computer terminal capable of pen input. In general, characters input by a pen tend to be larger than text characters, and as shown in FIG. 5, a sticky note including characters larger than characters of an electronic document is formed. In this example, the omission process is performed on the sticky note 401 by using the sticky note information processing system shown in any of the first to third embodiments.

  When the user gives an instruction to input the sticky note 401, the input information analysis unit 104 in FIG. 1 indicates that the new sticky note data combining the position information and the content information has been input. Information is transmitted to the information extraction means 109. The position / content information extraction unit 109 stores the tag data in the tag data storage unit 107. Further, the position / content information extraction unit 109 passes the tag content information to the character cutout unit 110.

  FIG. 6 is an explanatory diagram illustrating an example of character frame information cut out by the character cutout unit 110. As shown in FIG. 6, the character cutout unit 110 analyzes each character based on the tag content information and calculates an area of each character. The character cutout unit 110 first analyzes a line with respect to a character string composed of a plurality of lines to obtain line information. Then, the character cutout unit 110 cuts out characters from the character string in each line.

  In FIG. 6, each rectangular frame 501, 502, 503, 504, 505, 506, 507 indicates the character frame of each character in the first line. For example, as each character frame, the character cutout unit 110 obtains numerical information of the start point coordinates of the upper left point and the end point coordinates of the lower right point with coordinate values in the xy directions. In addition, the character cutout unit 110 obtains character frame information having a line number corresponding to the area information of each character from the line information obtained in the analysis process. Even if line information cannot be obtained, by obtaining the area information of each character by coordinates, it is possible to select line units by rearrangement or to arrange them in a character string from the left. Good. For example, the top left top character can be found by rearranging the xy coordinates of each character frame. Further, the character on the first line can be selected by finding a character group having a y coordinate close to the end point coordinate at the lower right of the first character and rearranging the character group.

  FIG. 7 is an explanatory diagram illustrating an example of an area calculated by the extraction area designating unit 111. The extraction area designating unit 111 determines an area to be displayed as an abbreviated tag based on the calculation result of the character cutout unit 110. For example, when determining based on the extraction rule “select the first row”, the extraction region designating unit 111 extracts the calculated region 601 of the first row as shown in FIG.

  For example, the extraction area designating unit 111 sorts the start point coordinates of each character from the left end to the right end of the character string in the first line, and determines the start point coordinates of the area 601 based on the minimum value of the x coordinate and the minimum value of the y coordinate. Ask. Further, the extraction area designating unit 111 sorts the end point coordinates of each character, and obtains the end point coordinates of the area 601 based on the maximum value of the x coordinate and the maximum value of the y coordinate. That is, the extraction area designating unit 111 obtains the rectangular area 601 by obtaining the start point coordinates and the end point coordinates.

  The extraction unit 112 extracts the rectangular area 601 and performs a reduction process on the extracted rectangular area 601. The extraction unit 112 calculates the reduction rate from the height of the extracted row based on a rule such as “reduction of the content information rectangle to fit in 24 pixels” as the reduction rate.

  FIG. 8 is an explanatory diagram showing an example of an abbreviated sticky note 701 processed by the extraction unit 112. FIG. 9 is an explanatory diagram showing an example of a display screen in which the omitted sticky note 701 shown in FIG. As shown in FIG. 9, the display image generation unit 106 causes the output unit 102 to display a display screen in which the omitted tag 701 is superimposed on the original document 301. When the electronic document with the abbreviated sticky note shown in FIG. 9 is returned to the original display state, the sticky information processing system is stored in the sticky note data storage unit 107 when the user gives an instruction through the input unit 101. The original sticky note data is extracted, and the original electronic sticky note is superimposed on the original and displayed again.

  As described above, according to the present embodiment, it is possible to display omitted sticky notes, and the user can roughly understand the contents of the sticky notes. In addition, since it is known that the height of the rectangle of the abbreviated sticky note is about one character high, it can be displayed in a size considering readability. Furthermore, since the display state of the sticky note can be easily changed, when the user wants to see the original sticky note content before the omission, for example, the user can easily tap the sticky note with a pen or click with the mouse to quickly and easily You can go back to see it.

  Note that, when a sticky note having a blank portion between characters is omitted as shown in FIG. 10, the character cutout unit 110 may delete margins excluding the character regions 511, 512, and 513. Then, the sticky note information processing unit 105 may create an abbreviated sticky note 701 shown in FIG. 9 based on the character frame information from which the blank portion is deleted. By doing so, it is possible to efficiently reduce the tag size, and it is not necessary to wastefully reduce the reduction rate of the character size when creating the omitted tag.

  Next, a second embodiment of the tag information processing system will be described with reference to the drawings. 11 and 12 are explanatory diagrams illustrating an example of a process of creating new omitted sticky note content information from input sticky note content information. The extraction area designating unit 111 calculates an extraction area using a predetermined rule based on the area information 521, 522, and 523 of each character calculated by the character cutout unit 110. In the present embodiment, in the process of calculating the extraction area, the extraction area designating unit 111 does not obtain the rectangle 601 shown in FIG. 7, but selects each character according to the extraction condition rule such as “delete margin between characters”. Rearrange characters in the cut-out left justification.

  The extraction area designating unit 111 derives the character areas 521, 522, and 523 and passes the extraction source coordinates and the extraction destination coordinates to the extraction unit 112. By doing so, the information in the area 521 is reflected in the area 525 in FIG. 12, the information in the area 522 is reflected in the area 526 in FIG. 12, and the information in the area 523 is reflected in the area 527 in FIG. The sticky note information processing unit 105 can create a new sticky note 704 in which a blank portion is omitted.

  As described above, according to the present embodiment, in the process of extracting a sticky note by the extracting unit 112, by setting a rule that also deletes the margin between characters in the extraction area, It is possible to create a smaller sticky note with the margin removed. Therefore, the size of the sticky note can be efficiently reduced, and the reduction rate of the character size does not need to be reduced when creating the omitted sticky note. Therefore, by performing the character cut-out process, it is possible to distinguish the character area from the blank area, and it is possible to reduce the sticky note by efficiently removing the useless blank space of the sticky note.

  Next, a third embodiment of the tag information processing system will be described with reference to the drawings. 13 and 14 are explanatory diagrams showing another example of a process of creating new omitted sticky note content information from input sticky note content information. The extraction area designating unit 111 calculates an extraction area using a predetermined rule based on the area information 531, 532, 533, 534 of each character calculated by the character cutout unit 110. In this embodiment, in the process of calculating the extraction area, the extraction area designating unit 111 does not obtain the rectangle 601 shown in FIG. 7, but selects the extraction area according to the extraction condition rule such as “equalize the size of each character”. Ask.

  The extraction area designating unit 111 derives the areas 531, 532, 533, and 534 of each character and passes the extraction source coordinates and the extraction destination coordinates to the extraction unit 112. By doing so, the extraction unit 112 can obtain the height of the region 531, the height of the region 532, the height of the region 533, and the height of the region 534, respectively. Further, the extraction unit 112 performs a reduction process for each character by obtaining a reduction rate for each character frame so that the height of each character becomes the height h of the sticky note when creating an abbreviated sticky note. Then, the sticky note information processing unit 105 creates a new sticky note 705 in which the height of each character is aligned with h, as shown in FIG.

  As described above, according to the present embodiment, the reduction ratio is obtained for each character frame and the reduction processing is performed. Therefore, when the character is reduced to fit a small character, the large character remains unnecessarily large, and the character is reduced to fit the large character. Then, the problem that small characters cannot be read can be solved. Therefore, it is possible to create an abbreviated sticky note that is easy to read even a small character like the abbreviated sticky note 705 shown in FIG. Therefore, according to the present embodiment, the reduction rate considering the size of the character is used in the character cutout process, so that the sticky note can be reduced so that the character written on the sticky note does not become too small.

  Next, a fourth embodiment of the tag information processing system will be described with reference to the drawings. FIG. 15 is an explanatory diagram showing an example of a process for calculating an area to be selected as an abbreviated sticky note from input sticky note content information. The extraction area designating unit 111 calculates a rectangular area to be extracted using a predetermined rule based on the area information of each character calculated by the character cutout unit 110. In this embodiment, in the process of calculating the extraction area, the extraction area designating unit 111 does not calculate the entire rectangular area of the first line as shown in the first embodiment, The extraction area is obtained according to the extraction condition rule such as “select up to the third character”.

  The extraction area designating unit 111 selects from the left of the first line to the third character using the start point coordinates from the area information of each character. In this embodiment, as shown in FIG. 15, the extraction area designating unit 111 selects the character areas 541, 542, and 543, and selects the area composed of the character areas 541, 542, and 543 as an abbreviated sticky note. Calculate as

  Next, a fifth embodiment of the tag information processing system will be described with reference to the drawings. FIG. 16 is an explanatory diagram illustrating another example of a process of calculating an area to be selected as an abbreviated sticky note from input sticky note content information. The extraction area designating unit 111 calculates a rectangular area to be extracted using a predetermined rule based on the area information of each character calculated by the character cutout unit 110. In this embodiment, in the process of calculating the extraction area, the extraction area designating unit 111 does not calculate the entire rectangular area of the first line as shown in the first embodiment, but instead of calculating the first and second lines. An extraction region is obtained according to a rule of extraction conditions such as “select left three characters for each line”.

  Based on the area information of each character, the extraction area designating unit 111 calculates a rectangle including two areas from the left to the third character on the first line and from the left to the third character on the second line. In this embodiment, as shown in FIG. 16, the extraction area designating unit 111 includes at least areas 551, 552, 553, 555, 556, 557 among character areas 551, 552, 553, 554, 555, 556, 557. Select a rectangular area containing. The extraction area designating unit 111 calculates the selected rectangular area as an area to be selected as an abbreviated sticky note.

  Next, a sixth embodiment of the tag information processing system will be described with reference to the drawings. FIG. 17 is an explanatory diagram showing still another example of a process of calculating a region to be selected as an abbreviated sticky note from input sticky note content information. The extraction area designating unit 111 calculates a rectangular area to be extracted using a predetermined rule based on the area information of each character calculated by the character cutout unit 110. In the present embodiment, in the process of calculating the extraction area, the extraction area designating unit 111 does not calculate the entire rectangular area of the first row as shown in the first embodiment, but instead of calculating the rectangle for each line. The extracted region is obtained in accordance with the rule of the extraction condition such as “select the region of the row with the highest row height”.

  The extraction area designating unit 111 calculates a rectangle in each row and selects the rectangle 608 having the highest height. Then, the sticky note information processing unit 105 creates an abbreviated sticky note including the character rectangles 561, 562, and 563 constituting the selected rectangle 608. By doing so, the user can intentionally select an arbitrary line in the sentence to be displayed as an abbreviated sticky note by writing a character larger than other portions.

  In the sticky note information processing system shown in the first to sixth examples, a predetermined rule is stored in the extraction rule storage unit 115 in FIG. 3 as shown in the second embodiment. By doing so, it is possible to easily change the rule contents. In the sticky note information processing system shown in the first to sixth embodiments, any rule can be freely applied by inputting a new rule from the input means 101.

  Further, in the sticky note information processing system shown in the first to sixth embodiments, sticky note data may be shared via a network as shown in FIG. By doing so, even if different rules are used for each computer, it is possible to store omitted sticky notes with different rules in the same sticky note data storage unit 107 by storing the omitted sticky notes together with the rules. If the rules are the same, the abbreviated sticky note can be used as it is.

  Next, a seventh embodiment of the tag information processing system will be described with reference to the drawings. 18 and 19 are explanatory diagrams showing still another example of a process of calculating a region to be selected as an omitted sticky note from input sticky note content information. The sticky note information processing unit 105 creates an abbreviated sticky note based on the area information of each character calculated by the character cutout unit 110. In this embodiment, when creating an abbreviated sticky note, the area is directly selected by the user from the input device 101 through the GUI. In this case, the extraction condition of the rule used by the extraction area specifying unit 111 describes a condition such as “specify the extraction area from the outside”.

  As shown in FIG. 18, in this embodiment, the user inputs a marker by tracing the input unit 101 such as a touch panel using a pen 801 with respect to the tag 409 before omission displayed on the output unit 102. Perform the operation. The sticky note information processing system inputs a marker input area 802 in accordance with a user input operation. In this case, the input marker input area 802 serves as a determination material when determining whether to select each character.

  The extraction area designating unit 111 calculates the extraction area based on the input marker input area 802. In the present embodiment, the extraction area designating unit 111 calculates center coordinates for each character calculated by the character cutout unit 110, and determines whether each character is included in the marker input area 802. Further, as shown in FIG. 19, the extraction area designating unit 111 selects three character areas 571, 572, and 573 included in the marker input area 802 as shown in FIG. 19, and a rectangular area 609 including the selected three characters. Is adopted as an abbreviated sticky note (area is calculated).

  Next, an eighth embodiment of the tag information processing system will be described with reference to the drawings. Hereinafter, in the present embodiment, a process of calculating a region to be selected as an omitted sticky note from input sticky note content information will be described with reference to FIGS. 20, 21, and 22. FIG. 20 is a block diagram illustrating a configuration example of the sticky note information processing system in the present embodiment. As shown in FIG. 20, in this embodiment, in the sticky note information processing system, a computer 910, a computer 920, and a storage unit 930 are connected via a network.

  In this embodiment, the output unit 902 and the output unit 904 are monitors having display screens with different resolutions. For example, the output unit 902 is a monitor having a resolution of 1024 dots × 768 dots. For example, the output unit 904 is a monitor having a resolution of 800 dots × 600 dots. FIGS. 21 and 22 are explanatory diagrams illustrating display examples of a display screen of an electronic document when the output unit 902 and the output unit 904 are used, respectively. For example, when the output unit 902 is used, the document displayed on the screen is displayed in the size of the document 302 shown in FIG. If the output unit 904 is used, the document displayed on the screen is displayed in the size of the document 303 shown in FIG.

  The document data storage means and the tag data storage means are realized by the storage means 930, and the storage means 930 is shared by the computers 910 and 920. The rules are also shared by the computers 910 and 920, but the programs necessary for the operation of the computers 910 and 920 are stored in the storage means 931 and 932, and the storage space required for each processing is realized by the storage means 931 and 932. Is done.

  The display image generation unit 106 of the computer 910 causes the output unit 902 to generate and display a document image 302 (for example, an image with a document display size of 100%) shown in FIG. Further, the display image generation unit 106 of the computer 920 generates and displays a document image 303 (for example, an image of 70% of the document image) shown in FIG. In this case, the computers 910 and 920 search the sticky note data storage unit to check whether there is information on the sticky note to be superimposed, and search whether the sticky note data already processed for the target sticky note is stored. If the processed sticky note data is not stored, the computers 910 and 920 perform an omitted sticky note generation process.

  When the display image generation unit 106 transmits the document data of the display document to the input information analysis unit 104, the display image generation unit 106 also transmits the display size together with information specifying the document. Further, the input information analysis unit 104 sends the image size of the document as additional information for the rules sent to the extraction area designating unit 111. Then, the extraction area designating unit calculates the size of the omitted sticky note that matches the document size. For example, if the reference width and reference height of a reduced sticky note to be created for a document size of 100% are described in the rule, the extraction area designating unit 111 can generate a reduced sticky note for a 70% original image. The calculation is performed so that the reference width and the reference height are 70%, and the extraction unit 112 is instructed.

  However, for example, if there is a rule that “the height of each character is 24 pixels or less”, if it is determined that if the character is made 70% in size, the height will be smaller than 24 pixels and the character cannot be read. The computers 910 and 920 may generate an abbreviated sticky note having a size that exceeds the reference height but fits within the reference width without reducing the character size. In addition, when there is a rule that “the first line is an abbreviated sticky note”, the computers 910 and 920 generate a horizontal abbreviated sticky that fits one line if there is no restriction on the size of the abbreviated sticky note. If there is, an abbreviated sticky note up to the number of characters that fits in the width may be created.

  When an abbreviated sticky note is created in this way, for example, when the output unit 902 having a large screen size is used, the computer 910 generates and displays an abbreviated sticky note composed of one line like the abbreviated sticky note 706 shown in FIG. . When the output unit 904 having a small screen size is used, the computer 920 generates and displays an abbreviated sticky note composed of five characters from the front, such as an abbreviated sticky note 707 shown in FIG. By doing so, an abbreviated sticky note that maintains visibility according to the screen size can be automatically superimposed and displayed.

  INDUSTRIAL APPLICABILITY The present invention can be applied to uses such as an information display device that omits and displays a sticky note input with a pen input or an image in a state where the contents are visible to some extent, and a program for realizing the information display device on a computer. Further, the present invention can be applied to a purpose of realizing an input information organizing function in a computer capable of pen input.

It is a block diagram which shows an example of a structure of the tag information processing system by this invention. It is a flowchart which shows an example of the tag information processing in which a tag information processing system processes tag information. It is a block diagram which shows the other structural example of a tag information processing system. It is a block diagram which shows the further another structural example of a tag information processing system. FIG. 6 is an explanatory diagram illustrating an example of an electronic document 301 in which a sticky note 401 is input and added using a computer terminal capable of pen input. It is explanatory drawing which shows an example of the character frame information which the character extraction means 110 cut out. It is explanatory drawing which shows an example of the area | region which the extraction area | region designation | designated means 111 calculates. It is explanatory drawing which shows an example of the omission note 701 which the extraction means 112 processed. FIG. 9 is an explanatory diagram illustrating an example of a display screen in which an abbreviated sticky note 701 illustrated in FIG. 8 is superimposed on an electronic document. It is explanatory drawing which shows the example in the case of omitting the tag with a blank part between characters. It is explanatory drawing which shows an example of the process which produces new abbreviated sticky note content information from the input sticky note content information. FIG. 12 is a continuation of an example of a process of creating new omitted sticky note content information from the input sticky note content information shown in FIG. 11. It is explanatory drawing which shows the other example of the process which produces new abbreviated sticky note content information from the input sticky note content information. FIG. 14 is a continuation of an example of a process of creating new omitted sticky note content information from the input sticky note content information shown in FIG. 13. It is explanatory drawing which shows an example of the process of calculating the area | region selected as an abbreviation tag from the input tag content information. It is explanatory drawing which shows the other example of the process of calculating the area | region selected as an abbreviation tag from the input tag content information. It is explanatory drawing which shows the further another example of the process of calculating the area | region selected as an abbreviation tag from the input tag content information. It is explanatory drawing which shows the further another example of the process of calculating the area | region selected as an abbreviation tag from the input tag content information. It is a continuation of the example of the process which calculates the area | region selected as an abbreviated sticky note from the input sticky note content information shown in FIG. It is a block diagram which shows the structural example of the tag information processing system in a present Example. FIG. 10 is an explanatory diagram illustrating a display example of a display screen of an electronic document when using an output unit 902. FIG. 10 is an explanatory diagram illustrating a display example of a display screen of an electronic document when an output unit 904 is used.

Explanation of symbols

101 Input means 102 Output means 103 Computer (information processing apparatus)
104 Input information interpretation unit 105 Sticky note information processing unit 106 Display image generation unit 107 Sticky note data storage unit 108 Document data storage unit 109 Position / content information extraction unit 110 Character segmentation unit 111 Extraction area designation unit 112 Extraction unit 113 Sticky note image creation unit 114 Rule information table

Claims (17)

A character extraction step of extracting characters written on an electronic sticky note input as image information in character units and extracting area information of each character;
An extraction area that calculates a target area to be extracted as an abbreviated sticky note that is an electronic sticky note in which a part of the content of the original electronic sticky note is omitted based on the extracted character area information. A calculation step;
An extraction step of extracting a part of the content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing method comprising: a sticky note creation step of creating an abbreviated sticky note based on the extracted content information.   The sticky note information processing method according to claim 1, wherein, in the extraction area calculating step, an area from which a gap between characters and a margin before and after a character is deleted is calculated as a target area to be extracted as an abbreviated sticky note.   The sticky note according to claim 1, wherein in the extraction area calculation step, the character size is calculated based on the area information of each character obtained in the character cutout step, and the character size of each character is processed for each character. Information processing method. A character extraction step of extracting characters written on the electronic sticky note inputted as image information in character units to extract area information of each character and deriving line information of each line written on the electronic sticky note;
Extraction area calculation that calculates the target area to be extracted as an abbreviated sticky note that is an electronic sticky note that omits a part of the content of the original electronic sticky note using line information derived in the cutout process of the character cutout step Steps,
An extraction step of extracting a part of the content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing method comprising: a sticky note creation step of creating an abbreviated sticky note based on the extracted content information.   5. The sticky note information processing method according to claim 4, wherein, in the extraction area calculating step, an area from which margins before and after the characters in the line are deleted is calculated as a target area to be extracted as an abbreviated sticky note.   5. The sticky note information according to claim 4, wherein in the extraction area calculation step, the character size is calculated based on the area information of each character obtained in the character segmentation step, and a line having a large average character size of each line is selected as a target area. Processing method. A character extracting step of extracting characters written on the electronic sticky note inputted as image information in units of one character and extracting area information of each character;
An input designation step for directly designating a character area to be displayed as an abbreviated note, which is an electronic sticky note in which a part of the content of the original electronic sticky note is omitted, in accordance with a user input instruction, with respect to the electronic abbreviated note displayed on the output device When,
An extraction area calculation step for calculating a character area including the part specified in the input specification step as a target area of the abbreviated sticky note;
An extraction step of extracting a part of the content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing method comprising: a sticky note creation step of creating an abbreviated sticky note based on the extracted content information. A rule storage step for storing in advance rule information indicating rules for processing electronic sticky notes;
A change step for changing the stored rule information,
The sticky note information processing method according to any one of claims 1 to 7, wherein, in an extraction area calculation step, a target area of the omitted sticky note is calculated based on the rule information. Including a sticky note data storing step for storing sticky note data of an electronic sticky note,
The sticky note information processing method according to claim 8, wherein in the sticky note data storing step, the sticky note data of the processed omitted sticky note is stored in association with the rule information. Manuscript data storage means for storing manuscript data of an electronic document to be displayed on an electronic sticky note;
Sticky note data storage means for storing sticky note data of electronic sticky notes to be displayed;
Information processing means for creating and displaying one or more processed abbreviated sticky notes for document data,
The information processing means includes
Character extraction means for extracting character information written on an electronic sticky note input as image information in character units and extracting area information of each character;
Based on the area information of each character extracted by the character cutout means, a target area to be extracted as an abbreviation tag, which is an electronic sticky note in which a part of the contents of the original electronic sticky note is omitted by counting the cut out characters in units of characters. Extraction area calculation means for calculating,
An extracting means for extracting a part of the content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing system including sticky note creating means for creating an abbreviated sticky note based on the extracted content information. Manuscript data storage means for storing manuscript data of an electronic document to be displayed on an electronic sticky note;
Sticky note data storage means for storing sticky note data of electronic sticky notes to be displayed;
Information processing means for creating and displaying one or more processed abbreviated sticky notes for document data,
The information processing means includes
Character extraction means for extracting character information written on the electronic sticky note input as image information in character units to extract area information of each character and deriving line information of each line written on the electronic sticky note;
Extraction area calculation that calculates, in line units, a target area to be extracted as an abbreviated sticky note that is an electronic sticky note that omits a part of the content of the original electronic sticky note using line information derived by the character cutout means in the process of cutout processing Means,
Extraction means for extracting content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing system including sticky note creating means for creating an abbreviated sticky note based on the extracted content information. Manuscript data storage means for storing manuscript data of an electronic document to be displayed on an electronic sticky note;
Sticky note data storage means for storing sticky note data of electronic sticky notes to be displayed;
Information processing means for creating and displaying one or more processed abbreviated sticky notes for document data,
The information processing means includes
Character extraction means for extracting character information written on an electronic sticky note input as image information in character units and extracting area information of each character;
An input designation means for directly designating a character area to be displayed as an abbreviated note, which is an electronic abbreviated form in which a part of the contents of the original electronic sticky note is omitted in accordance with a user input instruction with respect to the electronic abbreviated note displayed on the output device When,
An extraction area calculation means for calculating a character area including the location designated by the input designation means as a target area of an abbreviated tag;
An extracting means for extracting a part of the content information of the electronic sticky note based on the calculated extraction area;
A sticky note information processing system including sticky note creating means for creating an abbreviated sticky note based on the extracted content information.   13. One or both of the sticky note data storage unit and the document data storage unit are devices connected to the information processing unit via a network and different from the information processing unit. The sticky note information processing system according to any one of the above.   The sticky note information processing system according to any one of claims 10 to 13, wherein the information processing means creates an abbreviated sticky note that maintains legibility according to the screen size of the output means for displaying the electronic document. . On the computer,
A character extraction process for extracting characters written on an electronic sticky note input as image information in units of one character and extracting area information of each character;
An extraction area that calculates a target area to be extracted as an abbreviated sticky note that is an electronic sticky note in which a part of the content of the original electronic sticky note is omitted based on the extracted character area information. Calculation process,
Based on the calculated extraction area, an extraction process for extracting a part of the content information of the electronic sticky note,
A sticky information processing program for executing a sticky note creation process for creating an abbreviated sticky note based on extracted content information. On the computer,
Character extraction processing for extracting character information written in electronic sticky notes inputted as image information in character units to extract area information of each character and deriving line information of each line written in electronic sticky notes;
Extraction area calculation that calculates a target area to be extracted as an abbreviated sticky note that is an electronic sticky note that omits a part of the content of the original electronic sticky note using line information derived in the process of the clipping process in the character cutout process Processing,
Based on the calculated extraction area, an extraction process for extracting a part of the content information of the electronic sticky note,
A sticky information processing program for executing a sticky note creation process for creating an abbreviated sticky note based on extracted content information. On the computer,
A character extraction process for extracting characters written on an electronic sticky note input as image information in character units and extracting area information of each character;
An input designation process for directly designating a character area to be displayed as an abbreviated note, which is an electronic abbreviated note in which a part of the contents of the original electronic affix is omitted according to a user input instruction with respect to the abbreviated electronic affix displayed on the output device When,
An extraction area calculation process for calculating a character area including a part specified in the input specification process as a target area of an abbreviated tag;
Based on the calculated extraction area, an extraction process for extracting a part of the content information of the electronic sticky note,
A sticky information processing program for executing a sticky note creation process for creating an abbreviated sticky note based on extracted content information.

Images