JP2005244301A - Image generating method, image generating apparatus, and image generating program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generating method or the like capable of displaying an annotation in a form of an easily visually searchable thumbnail picture when a browsing applicant visually searches an electronic document with the annotation added thereto. <P>SOLUTION: An annotation data selection means 22 selects an annotation 303 included in annotation data 301 on the basis of conditional data from an input information analysis means 21 to generate reconfiguration annotation data. A layout image generating means 23 generates a reduced image by reading the electronic document. Further, the layout image generating means 23 generates a reduced image of the annotation image on the basis of reconfiguration annotation data. Then the layout image generating means 23 composes the electronic document with the reduced image of the annotation image to generate the thumbnail picture. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image generation method, an image generation apparatus, and an image generation program for generating a thumbnail image, and more particularly, to an image generation method, an image generation apparatus, and an image generation program used for visually searching an electronic document.

  Patent Document 1 generates a thumbnail image that is used when a viewer wants to visually search for a target electronic document using the annotation in an environment where a plurality of viewers who have viewed the electronic document can add annotations to the electronic document. An information processing apparatus is described.

  In the information processing apparatus described in Patent Literature 1, each viewer can view annotations in a range corresponding to the access right by having the access right of the individual annotation as attribute information. Moreover, the information processing apparatus described in Patent Literature 1 generates a display image according to the access right that classifies the viewer into several groups. Further, the information processing apparatus described in Patent Document 1 can cope with the use of thumbnail images by preparing several types of images according to access rights.

JP 2000-181868 (page 5-7, FIG. 1)

  Since the information processing apparatus described in Patent Document 1 does not assume that too many annotations are input, even if a large number of annotations are input, the annotations are directly combined with the electronic document image and reduced. To generate a thumbnail image. Therefore, if a thumbnail image is a reduced image in which a large number of annotations are written by a plurality of people, the amount of annotation increases so that it becomes difficult to understand what is written in a thumbnail image that is a small image.

  In the information processing apparatus described in Patent Document 1, only an annotation input person has an authority to display or hide an annotation, and controls information display depending on the authority. However, although the viewer himself who entered the annotation can specify whether or not to display such as an access right, the viewer who wishes to browse does not have the freedom to make a selection on the display.

  Furthermore, in the information processing apparatus described in Patent Document 1, if thumbnail images are generated in a large size that is easy to see, the number of thumbnail images that can be displayed is reduced due to the limitation of the display area, and visual search efficiency is reduced. That is, when a user who wants to view a thumbnail image looks for a target file by looking at the thumbnail image, the larger thumbnail image is easier to see, but the larger the thumbnail image, the fewer thumbnail images that can be displayed.

  Therefore, the present invention provides an image generation method, an image generation apparatus, and an image generation program capable of displaying an annotation in the form of a thumbnail image that is visually easy to search when a viewing applicant visually searches for an electronic document with an annotation. The purpose is to provide.

  In addition, the present invention provides an image generation method, an image generation apparatus, and an image generation program that can generate a thumbnail image that allows a user who wants to browse annotations to freely select an annotation and can easily search for an electronic document. For the purpose.

  Furthermore, the present invention provides an image generation method, an image generation apparatus, and an image generation program that enable a viewing applicant to find a desired electronic document visually and efficiently using a thumbnail image of an electronic document with an annotation. The purpose is to provide.

  An image generation method according to the present invention includes an annotation that is information added to an electronic document, user information indicating a user who has input the annotation, annotation data including an input date and time of the annotation, and the annotation data. Among the generated annotations, a step for selecting an annotation whose user information and input date and time match the user's specified conditions, and a thumbnail image with the annotation of the electronic document is generated by superimposing using the electronic document and the selected annotation. And a step.

  The image generation method may include a step of extracting a specified size of the thumbnail image from the input information. According to such a configuration, it is possible to generate thumbnail images that are easy to see in various sizes.

  Further, the image generation method may include a step of extracting a specified calculation rule for obtaining the size of the thumbnail image from the input information. According to such a configuration, it is possible to generate a thumbnail image in which the annotation is easier to see.

  In addition, the image generation method increases the image size when the amount of annotation to be displayed on the thumbnail image is large, and reduces the image size when the amount of annotation to be displayed on the thumbnail image is small. A thumbnail image may be generated.

  The image generation method may generate a thumbnail image in which annotations displayed on the thumbnail image are color-coded according to the input user. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

  The image generation method may generate a thumbnail image in which annotations displayed on the thumbnail image are color-coded according to the input date and time. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

  Further, the image generation method may generate a thumbnail image so that an annotation with an older input date and time is displayed in a lighter color. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

  Further, the image generation method may generate a thumbnail image so that an annotation with an older input date / time is displayed in a darker color. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

  In addition, the image generation method extracts a rectangular or round display area of the annotation by performing a layout analysis of the selected annotation, and generates a thumbnail image so that the extracted display area is highlighted. Also good. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

  In addition, the image generation method highlights an area including an annotation by using area information of a rectangular or round area surrounding the annotation and making the area other than the rectangular or round area lighter in color. May generate a thumbnail image. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to understand a region of interest to be viewed for identification work for searching for a target electronic document.

  Further, the image generation method uses the area information of the rectangular or round area surrounding the annotation to change the reduction ratio between the rectangular or round area and the area other than the rectangular or round area, A thumbnail image may be generated so that a region including the annotation is highlighted.

  Further, the image generation method obtains the title part area of the electronic document by performing layout analysis of the electronic document, and highlights the obtained title part area together with the rectangular or round area including the annotation. Alternatively, a thumbnail image may be generated. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from information other than the annotation.

  In addition, the image generation method includes a title area of an electronic document obtained by performing an electronic document layout analysis, an attention area including a display area extracted by performing an annotation layout analysis, and an area other than the attention area. A thumbnail image may be generated by highlighting a region of interest by changing the reduction ratio.

  In addition, the image generation method obtains a layout structure in the document of the electronic document by performing a layout analysis of the electronic document, generates an abstract image based on the obtained layout structure, and performs an annotation layout analysis. It is also possible to generate a small image by superimposing a rectangular or round region surrounding the annotation extracted by performing on the image image. According to such a configuration, it is possible to obtain information such as the number of annotations and the approximate position of the annotation even for a small image in which the annotation itself cannot be seen.

  The image generation method may generate an icon image as a small image.

  The image generation method includes a step of extracting a specified size of the thumbnail image from the input information, and generates a thumbnail image in which the annotation to be displayed on the thumbnail image is color-coded according to the input user. May be.

  The image generation method includes a step of extracting a specified size of the thumbnail image from the input information, and generates a thumbnail image in which the annotation to be displayed on the thumbnail image is color-coded according to the input date and time. Also good.

  The image generation method may include a step of extracting a specified size of the thumbnail image from the input information, and may generate a thumbnail image so that an annotation with an older input date is displayed in a lighter color.

  The image generation method may include a step of extracting a designated size of the thumbnail image from the input information, and generate a thumbnail image so that an annotation with an older input date is displayed in a darker color.

  The image generation method also includes a step of extracting a specified size of the thumbnail image from the input information, and extracting and extracting a rectangular or round annotation display area by performing a layout analysis of the selected annotation. The thumbnail image may be generated so that the displayed area is highlighted.

  In addition, the image generation method includes a step of extracting a specified size of the thumbnail image from the input information, and the region information other than the rectangular or round region is light-colored using the region information of the rectangular or round region. By doing so, the thumbnail image may be generated so that the region including the annotation is highlighted.

  Further, the image generation method includes a step of extracting a specified size of the thumbnail image from the input information, and using the area information of the rectangular or round area, the rectangular or round area and the rectangular or round shape are used. The thumbnail image may be generated so that the region including the annotation is highlighted by changing the reduction ratio with the region other than the region.

  An image generation apparatus according to the present invention includes an annotation data storage unit that stores annotation data including annotation that is information added to an electronic document, user information indicating a user who has input the annotation, and an input date and time of the annotation, Among annotations included in the data, annotations for electronic documents are added by annotation selection means for selecting annotations whose user information and input date and time match the user's specified conditions, and superimposition using electronic documents and selected annotations. A thumbnail image generating means for generating a thumbnail image is provided.

  The image generation apparatus includes an annotation layout analysis unit that performs a layout analysis of the annotation annotation selected by the annotation selection unit, and the annotation layout analysis unit generates a rectangular or round display area of the annotation by performing the layout analysis. The extracted thumbnail image generation means may generate a thumbnail image so that the display area extracted by the annotation layout analysis means is highlighted. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

  An image generation program according to the present invention is provided in a computer including a storage unit that stores annotation data including annotation that is information added to an electronic document, user information indicating a user who has input the annotation, and an input date and time of the annotation. , Of annotations included in annotation data, processing to select annotations whose user information and input date and time match the user's specified conditions, and superimposing and combining electronic documents and selected annotations. And processing for generating a thumbnail image.

  In addition, the image generation program performs a layout analysis of the selected annotation on the computer to extract a rectangular or round display area of the annotation and generate a thumbnail image so that the extracted display area is highlighted. It is also possible to execute the processing to be performed. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

  According to the present invention, since the thumbnail image of the electronic document with only the annotation that matches the designation condition of the user who wants to view (user) is generated, when the user who wants to visually search the electronic document with the annotation added, Annotations can be displayed in the form of thumbnail images that are visually easy to find.

Embodiment 1 FIG.
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of an image generation apparatus according to the present invention. The image generating apparatus shown in FIG. 1 is used when a user who wishes to browse uses the added annotation to search for the target electronic document in an environment where a plurality of users who have viewed the electronic document can add the annotation to the electronic document. As shown in FIG. 1, the image generation apparatus includes an input device 1 for inputting annotations, conditions, and instructions, an information processing device 2 that operates by program control, a storage device 3 for storing each data, and a created thumbnail image. Output device 4.

  The input device 1 is a keyboard, a touch panel, a pen tablet, or the like. The information processing apparatus 2 is a personal computer, a PDA, a tablet PC, or the like. The storage device 3 is, for example, a magnetic disk device. The output device 4 is a display device, for example.

  The storage device 3 includes an annotation data storage unit 31 that stores annotation data, and an electronic document storage unit 32 that stores electronic documents. The annotation data storage unit 31 stores annotation data including attribute information such as annotation, user information of the user who input the annotation, input date and time of the annotation, and information (data name and URL) specifying the electronic document corresponding to the annotation. . An annotation is, for example, additional information such as characters and symbols such as characters, lines, and circles written on a document with a pen or the like, markings, highlights, and sticky notes. In the present embodiment, the annotation is input from the input device 1 by the user who has viewed the electronic document.

  The electronic document data storage unit 32 stores an electronic document that the user visually browses through the output device 4. An electronic document is a document created using a word processor or a document saved in a format such as PDF, HTML, text, bitmap, TIFF, or JPEG. Further, the electronic document may be a document of another format as long as it can be read by the viewer through the output device 4, and may be a storage file handled by spreadsheet software, CAD software, or presentation software, for example. In addition, as long as it can be read out as necessary, it may be a DTD file used for a document in HTML or XML format, and may be stored in distributed locations via a communication network.

  In the present embodiment, when an annotation input operation is performed by the user, the electronic document itself is not updated, but annotation data stored in the storage device 3 separately from the electronic document is updated. In the present embodiment, when an instruction to display an electronic document is input by the user, the information processing apparatus 2 generates an electronic document or a thumbnail image with an annotation by superposition and synthesis using the electronic document and the annotation. .

  The information processing apparatus 2 includes an input information analysis unit 21 that extracts selection conditions for creating thumbnail images, an annotation data selection unit 22 that selects annotations included in annotation data, and a layout image generation that generates thumbnail images. Means 23 and thumbnail image receiving means 24 for receiving the generated thumbnail image. Note that the input information analysis unit 21, the annotation data selection unit 22, the layout image generation unit 23, and the thumbnail image reception unit 24 are specifically executed by the CPU of the information processing apparatus 2 that executes a program installed in the information processing apparatus 2. Realized.

  The input information analysis means 21 extracts user information and input date / time for use in selecting annotations included in annotation data from various information input from the input device 1. In this embodiment, a user who wishes to view an electronic document inputs an instruction to display an electronic document in a state where only the annotation to be referred to is added among all annotations added to the electronic document. In this embodiment, the user designates the annotation to be referred to by inputting the name of the user who input the annotation and the input date and time of the annotation. Hereinafter, user information input to specify an annotation to be referred to is referred to as selection target user information. The input date and time input to specify the annotation to be referred to is referred to as a selection target input date and time.

  Further, the input information analysis unit 21 extracts instruction information within a range for creating a thumbnail image from various information input from the input device 1. Hereinafter, the instruction information of the range for creating a thumbnail image is referred to as a thumbnail creation range. In the present embodiment, the thumbnail creation range is specified by specifying the range of annotation data stored in association with the electronic document.

  For example, the input information analysis means 21 selects user information to be selected from various input information such as information input from a keyboard, handwritten information input using an electronic pen, and information selected and input from options on a display screen. Extract the selection target input date and thumbnail creation range. The input information is not limited to such information. For example, the input information analysis unit 21 extracts the selection target user information, the selection target date and time, and the thumbnail creation range from the information input by voice recognition using voice dialogue input. May be. When a default folder is determined in advance, the input information analysis unit 21 may extract the default folder as a thumbnail creation range.

  The input information analysis unit 21 generates condition data based on the extracted selection target user information and the selection target input date and time. The condition data is data indicating conditions of an input user of an annotation to be displayed on a thumbnail image, an input user of an annotation not to be displayed, an input date and time of an annotation to be displayed, and an input date and time of an annotation to be not displayed. Further, the input information analyzing unit 21 passes the generated condition data to the annotation data selecting unit 22.

  Based on the condition data from the input information analysis unit 21, the annotation data selection unit 22 selects annotations included in the annotation data and reconstructs the annotation data. Hereinafter, the annotation data reconstructed by the annotation data selection means 22 is referred to as reconstructed annotation data. The annotation data selection unit 22 passes the reconstructed annotation data to the layout image generation unit 23 as thumbnail generation data.

  The layout image generation unit 23 extracts an electronic document corresponding to the reconstructed annotation data from the annotation data selection unit 22 from the electronic document storage unit 32. Then, the layout image generation unit 23 generates a reduced image of the extracted electronic document.

  Further, the layout image generation means 23 generates a reduced image of the annotation image for displaying the annotation based on the reconstructed annotation data. The layout image generation unit 23 generates a thumbnail image corresponding to the input annotation data by synthesizing the reduced image of the electronic document and the reduced image of the annotation image. Then, the layout image generating unit 23 outputs the generated thumbnail image to the thumbnail image receiving unit 24.

  The thumbnail image receiving unit 24 sequentially receives the thumbnail images generated by the layout image generating unit 23 and visually presents them to the user through the output device 4. For example, the thumbnail image receiving means 24 creates a display screen for displaying a plurality of thumbnail images on one screen and displays the display screen on the output device 4 that is a display device. In this case, a plurality of thumbnail images may be displayed side by side in the vertical and horizontal directions, or may be displayed in a row in the vertical or horizontal direction. Alternatively, the thumbnail images may be displayed so as to overlap each other so that the user can view the thumbnail images while sequentially turning them one by one.

  In the present embodiment, the annotation data storage means is realized by the annotation data storage unit 31. The annotation selection unit is realized by the annotation data selection unit 22. The thumbnail image generation means is realized by the layout image generation means 23.

  Next, the operation will be described. FIG. 2 is a flowchart illustrating an example of a thumbnail image generation process in which the information processing apparatus 2 generates a thumbnail image of an electronic document to which an annotation has been added.

  The user operates the input device 1 to input a thumbnail image generation instruction. In addition, the user operates the input device 1 to input selection target user information, selection target input date and time, and a thumbnail creation range. When a user inputs an instruction to generate a thumbnail image from the input device 1, the input information analysis unit 21 of the information processing device 2 selects selection target user information used for selecting annotations from the input information input from the input device 1. Then, the selection target input date and time and the thumbnail creation range are extracted (step S11).

  For example, the input information analysis unit 21 extracts one or more user names as selection target user information. Moreover, the input information analysis means 21 extracts a specific date as the selection target input date. Note that the input information analysis means 21 may extract a period having a certain width as the selection target input date and time.

  Further, for example, when the annotation data storage unit 31 has a directory structure or a file structure and the annotation data is managed in a directory unit or a file unit, the input information analysis unit 21 uses the directory name or the directory creation range as the thumbnail creation range. Extract the file name. For example, when the annotation data storage unit 31 has a structure in which annotation data is managed only by the data name, the input information analysis unit 21 extracts the data name as a thumbnail creation range.

  FIG. 3 is an explanatory diagram showing an example of annotation data. As shown in FIG. 3, the annotation data 301 is data having a structure including a plurality of blocks 302a, 302b, 302c,. Hereinafter, the blocks 302a, 302b, 302c,... Will be referred to as the block 302 when they are comprehensively expressed, or when referring to any block. The block 302 includes annotation 303, input user information 305, input date / time information 306, and electronic document information 304 corresponding to the annotation 303.

  An annotation 303 is an annotation added to the electronic document. The input user information 305 is information (for example, user name) indicating the user who has input the annotation 303. The input date / time information 306 is the date / time when the annotation 303 is input. The electronic document information 304 is information for specifying an electronic file to which the annotation 303 is added. For example, when the electronic document is on the file system, the annotation data 301 includes a path name and a file name as the electronic document information 304. When the electronic document includes a plurality of pages, the annotation data 301 may include a path name, a file name, and a page number as the electronic document information 304. The annotation data 301 may include a URL or a URI as the electronic document information 304.

  As shown in FIG. 3, in the annotation data 301, information on the input user name and input date / time is recorded for each annotation 303. For example, in the annotation 303 of the block 302b, an annotation having a different content from the annotation 303 of the block 302a is recorded. Also, the input user information 305, the input date / time information 306, and the electronic document information 304 in the block 302b describe the input person information, the input date / time, and the electronic document information that have input the annotation 303 in the block 302b, respectively. Is configured.

  In the present embodiment, annotation data 301 shown in FIG. 3 is stored in the annotation data storage unit 31 in association with each electronic document. When a plurality of annotations are added to the electronic document, the annotation data 301 includes a plurality of blocks 302 as shown in FIG. In this embodiment, since one annotation data 301 is associated with one electronic document, the contents of the electronic document information 304 of the block 302 included in the same annotation data 301 are the same.

  Based on the information extracted in step S11, the input information analysis unit 21 indicates the input user of the annotation to be displayed on the thumbnail image, the input user of the annotation not to be displayed, the input date and time of the annotation to be displayed, and the input date and time of the annotation to be not displayed. Condition data is generated (step S12).

  The annotation data selection unit 22 reads the annotation data 301 in the range specified by the thumbnail creation range extracted by the input information analysis unit 21 from the annotation data storage unit 31 one by one (step S13). Note that the annotation data 301 may be read out in units of a plurality of data instead of sequentially reading unread data one by one.

  The annotation data selection unit 22 deletes the annotation 303 that does not match the condition data selection condition from the annotations 303 included in the read annotation data 301, and newly constructs annotation data that includes only the annotation 303 that matches the condition. Thus, reconstructed annotation data is generated (step S14). That is, the annotation data selection unit 22 generates reconstructed annotation data including only the annotation designated by the user.

  FIG. 4 is an explanatory diagram illustrating a specific example of a generation process in which the image generation apparatus generates a thumbnail image. In the example illustrated in FIG. 4, the annotation data storage unit 31 stores annotation data including three annotations, annotations 701 and 702 input by the user A in advance and annotation 703 input by the user B. Further, the input information analysis means 21 extracts the condition “annotation recently input by the user A” from the input information of the input device 1.

  If only the annotation 702 matches the condition of “annotation recently entered by the user A”, the annotation data selection unit 22 leaves only the annotation 702, deletes the annotations 701 and 703, and re-creates new annotation data. Constitute.

  The layout image generation unit 23 reads out an electronic document corresponding to the reconstructed annotation data from the electronic document storage unit 32 based on the electronic document information 304 included in the reconstructed annotation data generated by the annotation data selection unit 22 (step S15). ).

  The layout image generation means 23 generates a reduced image having a thumbnail image size based on the read electronic document. In addition, the layout image generation unit 23 generates a reduced image of the annotation image having the same thumbnail image size based on the reconstructed annotation data. For example, the layout image generation unit 23 generates a reduced image by rendering the annotation 303 included in the reconstructed annotation data. Then, the layout image generating unit 23 generates a thumbnail image by combining the reduced image of the electronic document and the reduced image of the annotation image (step S16).

  For example, in the example illustrated in FIG. 4, the layout image generation unit 23 generates a thumbnail image 74 by combining the reduced image 72 of the annotation image and the reduced image 73 of the electronic document.

  The layout image generating unit 23 passes the generated thumbnail image to the thumbnail image receiving unit 24 (step S17).

  The annotation data selection unit 22 determines whether there is unread annotation data 301 in the annotation data storage unit 31 based on the thumbnail creation range extracted in step S11 (step S18). When it is determined that there is unread annotation data 301, the annotation data selection unit 22 reads unread annotation data 301 from the annotation data storage unit 31. And the process after step S13 is repeatedly performed. For example, when a directory name or file name is designated as the thumbnail creation range, all annotation data 301 stored in the directory or file is read in order, and thumbnail images are repeatedly generated.

  By executing the above processing, it is possible to generate a thumbnail image including only the annotation noted by the user and present it as visual information for the electronic document in which the annotation data in the specified range is input.

  As described above, according to the present embodiment, based on the input user information 305 and the input date / time information 306 stored in association with individual annotations 303, the annotation data selection unit 22 uses the annotation that has been input by whom. Is identified. Then, a thumbnail image in which only annotations necessary for the person who wants to browse is selected is generated. For this reason, when a user who wishes to browse an electronic document with an annotation visually finds the annotation, the annotation can be displayed in the form of a thumbnail image that is visually easy to find. Therefore, a viewer who wants to visually search an electronic document with annotations added by multiple viewers using thumbnail images, removes unnecessary annotations and selects only necessary annotations. You can search based on it.

  Further, according to the present embodiment, the annotation data selection unit 22 selects the annotations included in the annotation data using the user information and the input date / time, so that a thumbnail image that is easy for the user to view can be generated. Further, according to the present embodiment, since the thumbnail image is generated according to the input condition after the condition is input, it is also possible to generate a thumbnail image that is dynamically changed while changing the condition. Furthermore, according to the present embodiment, since thumbnail images can be dynamically generated, there is no need to prepare in advance a plurality of individual thumbnail images such as thumbnail images without annotations or thumbnail images with annotations.

Embodiment 2. FIG.
Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 5 is a block diagram illustrating another configuration example of the image generation apparatus. In the present embodiment, the functions of the input device 1, the storage device 3, and the output device 4 are the same as those functions in the first embodiment. Among the means of the information processing apparatus 2, the functions of the annotation data selecting means 22 and the thumbnail image receiving means 24 are the same as those functions in the first embodiment. In the present embodiment, the functions of the input information analysis means 21 and the layout image generation means 23 are different from those in the first embodiment.

  In the present embodiment, the input information analysis unit 21 extracts the size of the thumbnail image to be generated from the input information input from the input device 1 in addition to the selection condition for creating the thumbnail image.

  The layout image generation unit 23 generates a thumbnail image using the reconstructed annotation data from the annotation data selection unit 22 and the electronic document extracted from the electronic document storage unit 32. In the present embodiment, the layout image generation unit 23 generates a thumbnail image based on the size information of the thumbnail image from the input information analysis unit 21.

  Next, the operation will be described. FIG. 6 is a flowchart showing another example of the thumbnail image generation process for generating the thumbnail image of the electronic document to which the annotation is added.

  When a user inputs an instruction to generate a thumbnail image from the input device 1, the input information analysis unit 21 of the information processing device 2 selects selection target user information used for selecting annotations from the input information input from the input device 1. The selection target input date and time, the thumbnail creation range, and the size of the thumbnail image designated by the user are extracted (step S21).

  As the size of the thumbnail image, the vertical and horizontal bit numbers of the image may be input. Further, the reduction ratio from the original image before reduction may be input as the size of the thumbnail image. Note that the selection target user information, the selection target input date and time, and the thumbnail creation range are the same as those in the first embodiment.

  The processing from step S22 to step S25 is the same as the processing from step S12 to step S15 in the first embodiment.

  When the electronic document is read out, the layout image generating unit 23 generates a reduced image having an image size designated by the size information of the thumbnail image from the input information analyzing unit 21 based on the electronic document. Further, the layout image generation unit 23 generates a reduced image having an image size designated by the size information of the thumbnail image from the input information analysis unit 21 based on the reconstructed annotation data. Then, the layout image generating unit 23 generates a thumbnail image by combining the reduced image of the electronic document and the reduced image of the annotation image (step S26).

  The process of step S27 is the same as the process of step S17 in the first embodiment.

  The annotation data selection unit 22 determines whether there is unread annotation data 301 in the annotation data storage unit 31 based on the thumbnail creation range extracted in step S21 (step S28). When it is determined that there is unread annotation data 301, the annotation data selection unit 22 reads unread annotation data 301 from the annotation data storage unit 31. And the process after step S23 is repeatedly performed.

  By executing the above processing, it is possible to generate a thumbnail image having a size desired by the user and including only the annotation that the user is interested in for the electronic document in which the annotation data in the specified range is input.

  As described above, according to the present embodiment, a thumbnail image is generated every time a browsing requester inputs a browsing request condition, so that a thumbnail image can be generated in a size that is easy for the browsing requester to view. Since the thumbnail image is generated in a size desired by the user, in addition to the effect in the first embodiment, it is possible to generate thumbnail images that are easy to see in various sizes.

  Further, according to the present embodiment, thumbnail images having different sizes can be generated for individual electronic documents. Therefore, by generating thumbnail images in various sizes, it is possible to display many thumbnail images within a limited area, or to generate thumbnail images that are unlikely to be selected by those who wish to view them in advance. can do. Therefore, visual search efficiency can be improved by generating easy-to-view thumbnail images in various sizes.

Embodiment 3 FIG.
Next, a third embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 5 in the second embodiment. In the present embodiment, the input information analysis unit 21 calculates the image size corresponding to the annotation amount displayed on the thumbnail image, not the size of the thumbnail image desired by the user, as information to be passed to the layout image generation unit 23. The information of the calculation rule to do is extracted from the input information. In the present embodiment, as a calculation rule, a calculation formula for obtaining a reduction ratio using a linear function based on the number of annotations is used. For example, “reduction ratio (%)” = “number of annotations” × 0.5 + 5.0 is used as a calculation rule. Here, the “number of annotations” is the number of blocks 302 shown in FIG.

  Note that the calculation formula for obtaining the reduction ratio is not limited to the calculation rule, and other calculation formulas may be used as the calculation rule. For example, the calculation rule for calculating the size of the diagonal line after obtaining the size of the diagonal dot number represented by the number of vertical and horizontal dots of the electronic document image read by the layout image generation unit 23 may be used as the calculation rule. In this case, for example, “size of diagonal line after reduction” = 10 × “number of annotations” +10 may be used as a calculation rule. In addition, an upper limit may be set for the reduction rate and the reduction size, and a calculation formula or conditional expression using a logarithm instead of a linear function may be used as a calculation rule.

  The layout image generation unit 23 determines the size of the thumbnail image according to the amount of annotation included in the reconstructed annotation data generated by selection and generation by the annotation data selection unit 22, and generates a thumbnail image according to the determined size.

  By executing the above processing, it is possible to generate a thumbnail image of an electronic document in which annotation data in a specified range is input, including only the annotation that the user is interested in and having a size corresponding to the amount of annotation.

  As described above, according to the present embodiment, it is possible to generate a thumbnail image of an electronic document with no annotation small and a large thumbnail image of an electronic document with many annotations. In addition to the effects of the first embodiment, , It is possible to generate a thumbnail image in which the annotation is easier to see. Further, according to the present embodiment, thumbnail images of electronic documents without annotations can be displayed smaller, so that when displaying a large number of thumbnail images, a larger number of thumbnail images can be displayed on one screen. In addition, according to the present embodiment, since thumbnail images of electronic documents with few annotations are displayed smaller, it is possible to intuitively determine the amount of annotation by looking at the size of thumbnail images without looking at the details of the thumbnail images. Can grasp.

Embodiment 4 FIG.
Next, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 7 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, the functions of the input device 1, the storage device 3, and the output device 4 are the same as those functions in the third embodiment. In addition, the functions of the input information analysis unit 21, the annotation data selection unit 22, and the thumbnail image reception unit 24 of the information processing apparatus 2 are the same as those functions in the third embodiment.

  In the present embodiment, as shown in FIG. 7, the layout image generation unit 23 includes an annotation layout analysis unit 201, an electronic document layout analysis unit 202, an attention area reduction rate calculation unit 203, and a reduction composition unit 204.

  The annotation layout analysis unit 201 generates an annotation image by rendering an annotation. Further, the annotation layout analysis unit 201 extracts display area information such as a rectangle or a circle for each annotation included in the annotation data by an annotation layout analysis. The electronic document layout analysis unit 202 generates an image of the electronic document by rendering the electronic document.

  The attention area reduction rate calculation unit 203 calculates the thumbnail image reduction rate based on the output data of the annotation layout analysis unit 201, the output data of the electronic document layout analysis unit 202, and the desired thumbnail image size from the input information analysis unit 21. Ask. The reduction composition unit 204 generates a thumbnail image based on the information from the attention area reduction rate calculation unit 203.

  Next, the operation will be described. In the present embodiment, the operations of the input information analyzing unit 21, the annotation data selecting unit 22, and the thumbnail image receiving unit 24 are the same as those in the third embodiment. In the present embodiment, the operation of the layout image generating means 23 is different from the operation in the third embodiment.

  The annotation data selection unit 22 passes the generated reconstructed annotation data to the annotation layout analysis unit 201. The annotation layout analysis unit 201 renders each annotation included in the reconstructed annotation data to generate an annotation image. Further, the annotation layout analysis unit 201 calculates a rectangular or round area including an area for displaying the annotation. When a plurality of annotations are included, the annotation layout analysis unit 201 calculates a rectangular or round area for each annotation.

  FIG. 8 is an explanatory diagram showing an example of an entire area 401 that is an area of the same size as the electronic document layout image corresponding to the reconstructed annotation data and can render the annotation. For example, in FIG. 8, small areas 402 and 403 indicate rectangular areas including annotations.

  The electronic document layout analysis unit 202 reads an electronic document corresponding to the reconstructed annotation data from the electronic document storage unit 32, and generates an electronic document layout image by performing rendering.

  The attention area reduction rate calculation unit 203 determines whether the annotation among thumbnail images is based on the output data of the annotation layout analysis unit 201, the output data of the electronic document layout analysis unit 202, and the desired thumbnail image size from the input information analysis unit 21. Processing is performed to make the existing area easy to see as the attention area. The attention area reduction rate calculating means 203 does not reduce the rectangular or round area in which the annotation exists so as to be displayed larger in the thumbnail image, and reduces the area in which the annotation does not exist to be displayed smaller. The processing to do. By processing in this way, the attention area reduction rate calculating means 203 makes the annotation larger in the whole thumbnail image and easier to see.

  For example, in FIG. 8, α1, α2, α3, α4, and α5 indicate the reduction ratios in the vertical direction of the respective regions. In FIG. 8, β1, β2, β3, β4, and β5 indicate the reduction ratios in the horizontal direction of the respective regions. For example, since α1, α3, α5, β1, β3, and β5 do not correspond to the regions 402 and 403 including the annotation, the attention region reduction rate calculation unit 203 reduces the size to a smaller value than when all the regions are uniformly reduced. To do. Since α2, α4, β2, and β4 correspond to the regions 402 and 403 including the annotation, the attention region reduction rate calculation unit 203 reduces the size larger than when all the regions are uniformly reduced. Then, the attention area reduction rate calculation unit 203 calculates the reduction rate so that the overall size matches the desired size from the input information analysis unit 21.

  The reduction composition unit 204 reduces the electronic document layout image and the annotation layout image based on the reduction rate data obtained by the attention area reduction rate calculation unit 203. Then, the reduction composition unit 204 generates a thumbnail image by superimposing the reduced annotation layout image on the reduced electronic document layout image.

  By executing the above processing, for the electronic document in which annotation data in the specified range is input, a thumbnail image that includes only the annotation that the user is interested in and that makes the attention area where the annotation exists larger and easier to see is generated. Can do.

  As described above, according to the present embodiment, when generating a thumbnail image of an electronic document that does not include an annotation, a thumbnail image that does not destroy the layout of the electronic document is generated by uniformly reducing the entire image. can do. In addition, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner. Therefore, in addition to the effect of the first embodiment, a thumbnail image that makes it easy to search for the target electronic document is generated. Can do.

Embodiment 5 FIG.
Next, a fifth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the electronic document layout analysis unit 202 analyzes the logical structure in the electronic document such as the title part, subtitle part, text part, and chart part in addition to the function of image generation by rendering the electronic document, The display area is analyzed.

  FIG. 9 is an explanatory diagram illustrating an example of an electronic document layout image. For example, as shown in FIG. 9, the electronic document layout image includes a title part 502, subtitle parts 503 and 504, body parts 505 and 507, and a chart part 506.

  Since the title portion 502 is useful information representing the contents of the electronic document, the attention area reduction rate calculating means 203 is based on the analysis result of the electronic document layout analyzing means 202 and the rectangle or circle in which the annotation of the annotation layout image exists. Along with the shape area, processing is performed so as not to reduce too much as the attention area. By performing such processing, it is possible to generate a thumbnail image that makes it easier to search for a document.

  As described above, according to the present embodiment, a thumbnail image is generated that makes it easy to see the location of useful information indicating the content of the electronic document, such as the title location of the electronic document, even in a location that does not include an annotation. Therefore, in addition to the effects of the fourth embodiment, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from information other than the annotation.

Embodiment 6 FIG.
Next, a sixth embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the layout image generation unit 23 classifies the annotations for each input user at the stage of rendering the annotations in order to generate thumbnail images based on the annotations selected by the annotation data selection unit 22. . Then, the layout image generation unit 23 changes the display color of the annotation for each classified user.

  Similarly, the layout image generation unit 23 may change the display color of the annotation by rendering the old annotation so that the color of the old annotation becomes light according to the order of the input date and time in the stage of rendering the annotation. In addition, the layout image generation unit 23 may change the display color of the annotation by rendering the old annotation so that the brightness of the color of the old annotation is reduced and displayed in a dark color.

  By executing the above processing, it is possible to generate a thumbnail image in which the annotation attribute information can be grasped according to the display color of the annotation.

  As described above, according to the present embodiment, a thumbnail image is generated in which an annotation that matches the selection condition is further distinguished by the user and the input date and time and is easy to see. Therefore, in addition to the effects of the fourth embodiment, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

Embodiment 7 FIG.
Next, a seventh embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the reduction composition unit 204 converts the color information so that the display color on the electronic document is lightened in an area where there is no attention part such as an annotation or a title part. Then, the reduction composition unit 204 synthesizes an image with a contrast between the target location and a location other than the target location.

  By executing the above processing, the attention area where the annotation exists on the thumbnail image is more emphasized, and the user can easily determine the thumbnail image.

  As described above, according to the present embodiment, a thumbnail image is displayed by reducing the contrast of an area where there is no annotation and there is no useful information indicating the content of the electronic document such as a title part. Therefore, in addition to the effects of the fifth embodiment, it is possible to generate a thumbnail image that makes it easy to understand the region of interest to be viewed for the identification work for searching for the target electronic document.

Embodiment 8 FIG.
Next, an eighth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the reduction synthesis unit 204 does not use an image obtained by reducing a rendered image as each reduced image used for superimposition synthesis, but generates a bitmap generated as an abstract image based on a layout analysis result. Use images.

  The reduction composition unit 204 generates and uses a bitmap image abstracted based on information from the electronic document layout analysis unit 202, not an image that has been rendered and reduced, as an electronic document layout image. By doing so, even in the case of a reduced image, it is possible to know approximate information such as a rough title location, subtitle location, text location, and chart location.

  Further, the reduction composition unit 204 generates a bitmap image in which the rectangular or round region is filled based on the rectangular or round region where the annotation obtained by the annotation layout analysis unit 201 exists as the annotation layout image. Use. By doing so, it is possible to know approximate information such as where the annotation exists and how many annotations exist.

  The reduction synthesis unit 204 generates an icon image by synthesizing the bitmap image generated as the electronic document layout image and the bitmap image generated as the annotation layout image. FIG. 10 is an explanatory diagram showing an example of an icon image 601 generated by the reduction composition unit 204. For example, as shown in FIG. 10, even when a small image such as an icon image 601 is used, not only the rough layout of the text can be understood, but also there are two attention area portions 602 and 603 where annotations exist. . You can also see where the annotation is in the rough layout of the text.

  By executing the above processing, even in a small image where the annotation cannot be seen in detail, it is possible to grasp the attention area location where the annotation exists, the number of annotations, and the overall layout.

  As described above, according to the present embodiment, only an electronic document layout image based on logical structure information obtained by layout analysis and a rectangular or round area indicating a display area obtained by analyzing annotations are used. A thumbnail image is generated by superposition and synthesis with the configured image. Therefore, in addition to the effects of the fifth embodiment, information such as the number of annotations and the approximate position of the annotation can be obtained even for a small image such as an icon image where the annotation itself cannot be seen. it can.

  Further, the annotation may be color-coded according to the user name of the input user and the input date and time. By doing so, the user can know when and when the annotation is input.

Embodiment 9 FIG.
Next, a ninth embodiment of the present invention will be described with reference to the drawings. FIG. 11 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, as shown in FIG. 11, the image generation device includes an information acquisition unit 1001 instead of the input device 1 shown in the first embodiment. The information acquisition unit 1001 is realized by the CPU of the information processing apparatus 2 that executes a program installed in the information processing apparatus 2.

  In the present embodiment, for example, a terminal used by a user is connected to the information processing device 2 via a communication network, and the information processing device 2 transmits a generated thumbnail image to the user terminal via the communication network. Provides image generation services. The information acquisition unit 1001 receives the selection target user information, the selection target input date and time, and the thumbnail creation range via the communication network, and passes them to the input information analysis unit 21. As described above, as long as the information necessary for generating the thumbnail image can be passed to the input information analysis unit 21, the input unit is not limited to the input device 1 such as a keyboard, and is realized by a program. Also good.

  Further, the thumbnail image receiving means 24 may pass the image information including the thumbnail image to the program that requested the thumbnail image instead of passing it to the output device 4.

  In the present embodiment, the case where the image generation apparatus in the first embodiment includes the information acquisition unit 1001 instead of the input device 1 has been described. However, the information acquisition unit 1001 described in the present embodiment is The present invention can also be applied to other than the first embodiment. For example, in FIG. 5 shown in the second embodiment and the third embodiment, the image generation apparatus may include an information acquisition unit 1001 instead of the input apparatus 1. In FIG. 7 shown in the fourth to eighth embodiments, the image generation apparatus may include an information acquisition unit 1001 instead of the input apparatus 1.

Embodiment 10 FIG.
Next, a tenth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of any of FIG. 1, FIG. 5, FIG. 7, or FIG. 11 shown in the first to ninth embodiments.

  12 to 17 are explanatory diagrams illustrating other examples of annotation data. In the annotation data 301 illustrated in FIG. 3, the case where the block 302 includes the annotation 303, the electronic document information 304, the input user information 305, and the input date / time information 306 has been described. In the present embodiment, FIG. As shown in FIG. 17, the contents of the information constituting the block 302 are different.

  In the example shown in FIG. 12, blocks 302b, 302c,... Other than the top block 302a in the annotation data 301 include only the annotation 303, input user information 305, and input date / time information 306. Since the first block 302a includes the electronic document information 304, if the block 302a is present, the electronic document corresponding to the annotation data 301 is included even if the other blocks 302b, 302c,. Can be specified.

  In the example illustrated in FIG. 13, in the annotation data 301 illustrated in FIG. 11, the block 302 c includes another input date information 306 b in addition to the input date information 306. According to such a configuration, the annotation 303 included in the block 302c is selected if any of the input date / time information 306, 306b meets the condition when the annotation data selection unit 22 performs filtering. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the input date and time information 306 and 306b match the conditions.

  For example, when a plurality of inputs written by the same person and having different input dates and times are grouped and handled as one annotation 303, the block 302 includes a plurality of input date and time information 306. When there is a time difference from the start of input to the end when inputting one annotation 303, the block 302 includes, for example, an input start time and an input end time as the input date / time information 306.

  In the example illustrated in FIG. 14, the block 302 includes other attribute information 307 in addition to the information included in the block 302 illustrated in FIG. 3. The block 302 may include additional information that is not involved in the selection process of the annotation data selection unit 22 as the other attribute information 307.

  In the example illustrated in FIG. 15, the block 302 includes additional modification date information 308 as the other attribute information 307 illustrated in FIG. 14. According to such a configuration, the annotation 303 included in the block 302 is selected if any of the input date / time information 306 and the modified date / time information 308 meets the condition when the annotation data selection unit 22 performs filtering. Is done. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the input date information 306 and the correction date information 308 match the conditions. Further, as in the example illustrated in FIG. 14, the modification date information 308 may not be treated as a filtering condition when the annotation data selection unit 22 selects and selects.

  In the example illustrated in FIG. 16, the block 302 includes retouching correction user information 309 and retouching correction date / time information 310 as the other attribute information 307 illustrated in FIG. 14. According to such a configuration, when the annotation data selection unit 22 filters the annotation 303 included in the block 302, any user information 305, 309 and any date information 306, 310 match the condition. Selected. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the user information 305 and 309 and both the date and time information 306 and 310 match the conditions. Further, as in the example illustrated in FIG. 14, the correction correction user information 309 and the correction correction date / time information 310 may not be handled as filtering conditions when the annotation data selection unit 22 selects and selects.

  In the example illustrated in FIG. 17, the block 302 includes browsing user information 311 a and 311 b and browsing date information 312 a and 312 b as the other attribute information 307 illustrated in FIG. 14. In the example shown in FIG. 17, user information and browsing date and time of the user who has browsed annotation data 301 are sequentially added to block 302. According to such a configuration, when the annotation data selection unit 22 performs filtering, the annotation 303 included in the block 302 is one of the user information 305, 311a, 311b and one of the date / time information 306, 312a, 312b. Is selected if meets the conditions. Note that the annotation data selection means 22 may not select the annotation 303 unless all the user information 305, 311a, 311b and all the date / time information 306, 312a, 312b match the conditions. Further, as in the example illustrated in FIG. 14, the browsing user information 311 a and 311 b and the browsing date information 312 a and 312 b may not be handled as filtering conditions when the annotation data selection unit 22 selects and sorts.

  As described above, according to the embodiment, even if the information included in the annotation data 301 is described in detail, the effects of the first to ninth embodiments can be obtained. Similar effects can be obtained.

Embodiment 11 FIG.
Next, an eleventh embodiment of the present invention will be described with reference to the drawings. FIG. 18 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, the basic configuration of the image generation device is the same as the configuration shown in the first to tenth embodiments, and the image generation device includes the input device 1 and the information processing device 2. A storage device 3 and an output device 4. In the present embodiment, the information processing apparatus 2 reads the thumbnail image generation processing program 5 stored in the storage medium. Then, the information processing apparatus 2 executes any one of the thumbnail image generation processes shown in the first to tenth embodiments in accordance with the read thumbnail image generation process program 5.

  In the present embodiment, for example, the information processing apparatus 2 displays, as the thumbnail image generation processing program 5, an annotation whose user information and input date and time match the user-specified conditions among annotations included in the annotation data. Executes thumbnail image generation processing by reading an image generation program that performs processing to select and processing to generate thumbnail images with annotations of electronic documents by superimposing and combining electronic documents and selected annotations. To do.

  Note that the image generation apparatus may execute a thumbnail image generation process that is a combination of the processes described in the first to tenth embodiments. In the eleventh embodiment, the information processing apparatus 2 reads the thumbnail image generation processing program 5 that is executed in combination with the processes shown in the first to tenth embodiments, and performs thumbnail processing. An image generation process may be executed.

  The present invention can be applied to the use of a program for providing an interface capable of visually selecting an electronic document having annotation data indicating an annotation input person and input date and time. Further, in an environment where a plurality of viewers can add annotations to an electronic document stored in a file server or a database, the present invention can be applied to the use of a personal adaptation selection button function using thumbnail images.

It is a block diagram which shows an example of a structure of the image generation apparatus by this invention. 12 is a flowchart illustrating an example of thumbnail image generation processing for generating a thumbnail image of an electronic document with an annotation added thereto. It is explanatory drawing which shows an example of annotation data. It is explanatory drawing which shows the specific example of the production | generation process in which an image generation apparatus produces | generates a thumbnail image. It is a block diagram which shows the other structural example of an image generation apparatus. 14 is a flowchart illustrating another example of thumbnail image generation processing for generating a thumbnail image of an electronic document with an annotation added thereto. It is a block diagram which shows the other structural example of an image generation apparatus. It is explanatory drawing which shows the example of all the area | regions 401 which can render an annotation. It is explanatory drawing which shows the example of an electronic document layout image. It is explanatory drawing which shows the example of the icon image 601 which the reduction | restoration synthetic | combination means 204 produces | generates. It is a block diagram which shows the other structural example of an image generation apparatus. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is a block diagram which shows the other structural example of an image generation apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input device 2 Information processing device 3 Storage device 4 Output device 21 Input information analysis means 22 Annotation data selection means 23 Layout image generation means 24 Thumbnail image reception means 31 Annotation data storage section 32 Electronic document storage section

Claims (36)

Storing annotation data including annotation that is information added to an electronic document, user information indicating a user who has input the annotation, and an input date and time of the annotation;
Selecting an annotation whose user information and input date and time match the user's specified conditions from the annotations included in the annotation data;
Generating a thumbnail image with an annotation of the electronic document by superposition and synthesis using the electronic document and the selected annotation.   The image generation method according to claim 1, further comprising: extracting a specified size of the thumbnail image from the input information.   The image generation method according to claim 1, further comprising a step of extracting a specified calculation rule for obtaining a size of the thumbnail image from the input information.   A thumbnail image in which the size of an image is increased when the amount of annotation to be displayed on the thumbnail image is large, and the thumbnail size is reduced when the amount of annotation to be displayed on the thumbnail image is small. 3. The image generation method according to 3.   The image generation method according to claim 1, wherein a thumbnail image in which an annotation to be displayed on the thumbnail image is color-coded is generated according to an input user.   The image generation method according to claim 1, wherein a thumbnail image in which an annotation to be displayed on the thumbnail image is color-coded is generated according to an input date and time.   The image generation method according to claim 6, wherein the thumbnail image is generated so that an annotation with an older input date is displayed in a lighter color.   The image generation method according to claim 6, wherein the thumbnail image is generated so that an annotation with an older input date is displayed in a darker color. By analyzing the layout of the selected annotation, extract the rectangular or round display area of the annotation,
The image generation method according to claim 1, wherein the thumbnail image is generated so that the extracted display area is highlighted.   Using the area information of the rectangular or round area surrounding the annotation, the thumbnail image is generated so that the area including the annotation is highlighted by making the area other than the rectangular or round area light color. The image generation method according to claim 9.   An area including an annotation by changing the reduction ratio between the rectangular or round area and an area other than the rectangular or round area using area information of a rectangular or round area surrounding the annotation The image generation method according to claim 9, wherein the thumbnail image is generated so as to be highlighted. By performing a layout analysis of the electronic document, an area of the title portion of the electronic document is obtained,
The image generation method according to claim 9, wherein the thumbnail image is generated so that the obtained title location area is highlighted together with a rectangular or round area including the annotation.   Changing the reduction ratio between the title area of the electronic document obtained by performing the layout analysis of the electronic document and the attention area including the display area extracted by performing the layout analysis of the annotation and the area other than the attention area. The image generation method according to claim 9, wherein a thumbnail image is generated so that the region of interest is highlighted. By performing a layout analysis of the electronic document, a layout structure in the document of the electronic document is obtained,
Based on the obtained layout structure, generate an abstract image,
The image generation method according to claim 9, wherein a small image is generated by superimposing a rectangular or round area surrounding the annotation extracted by performing an annotation layout analysis on the image image.   The image generation method according to claim 14, wherein an icon image is generated as a small image.   The image generation method according to claim 5, further comprising: extracting a specified size of the thumbnail image from the input information.   The image generation method according to any one of claims 5 to 15, further comprising a step of extracting a specified calculation rule for obtaining a size of a thumbnail image from input information.   A thumbnail image in which the size of an image is increased when the amount of annotation to be displayed on the thumbnail image is large, and the thumbnail size is reduced when the amount of annotation to be displayed on the thumbnail image is small. 18. The image generation method according to 17.   The image generation method according to any one of claims 6 to 15, wherein a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded is generated according to an input user.   The image generation method according to any one of claims 9 to 15, wherein a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded is generated according to an input date and time.   21. The image generation method according to claim 20, wherein the thumbnail image is generated so that an annotation with an older input date is displayed in a lighter color.   21. The image generation method according to claim 20, wherein the thumbnail image is generated so that an annotation with an older input date and time is displayed in a darker color.   Using the area information of the rectangular or round area surrounding the annotation, the thumbnail image is generated so that the area including the annotation is highlighted by making the area other than the rectangular or round area light color. The image generation method according to any one of claims 11 to 15.   An area including an annotation by changing the reduction ratio between the rectangular or round area and an area other than the rectangular or round area using area information of a rectangular or round area surrounding the annotation The image generation method according to any one of claims 12 to 15, wherein a thumbnail image is generated so as to be highlighted. Extracting the specified size of the thumbnail image from the input information,
The image generation method according to any one of claims 6 to 15, wherein a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded is generated according to an input user. Extracting the specified size of the thumbnail image from the input information,
The image generation method according to any one of claims 9 to 15, wherein a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded is generated according to an input date and time. Extracting the specified size of the thumbnail image from the input information,
The image generation method according to any one of claims 9 to 15, wherein a thumbnail image is generated so that an annotation with an older input date and time is displayed in a lighter color. Extracting the specified size of the thumbnail image from the input information,
The image generation method according to any one of claims 9 to 15, wherein a thumbnail image is generated so that an annotation with an older input date and time is displayed in a darker color. Extracting the specified size of the thumbnail image from the input information,
By analyzing the layout of the selected annotation, the display area of the rectangular or round annotation is extracted,
The image generation method according to any one of claims 10 to 15, wherein a thumbnail image is generated so that the extracted display area is highlighted. Extracting the specified size of the thumbnail image from the input information,
The thumbnail image is generated so that an area including an annotation is highlighted by making the area other than the rectangular or round area light-colored using area information of the rectangular or round area. The image generation method according to any one of claims 11 to 15. Extracting the specified size of the thumbnail image from the input information,
Emphasize the area containing the annotation by changing the reduction ratio between the rectangular or round area and the area other than the rectangular or round area using the area information of the rectangular or round area. The image generation method according to claim 12, wherein a thumbnail image is generated so as to be displayed.   The image generation method according to any one of claims 19 to 24, further comprising a step of extracting a specified calculation rule for obtaining a size of a thumbnail image from input information. Annotation data storage means for storing annotation data including annotation that is information added to an electronic document, user information indicating a user who has input the annotation, and input date and time of the annotation;
Annotation selection means for selecting an annotation whose user information and input date and time match the user's designated conditions from the annotations included in the annotation data;
An image generation apparatus comprising: a thumbnail image generation unit configured to generate a thumbnail image with an annotation of the electronic document by superposition and synthesis using the electronic document and the selected annotation. Annotation layout analysis means for analyzing the layout of the annotation annotation selected by the annotation selection means,
The annotation layout analysis means extracts a rectangular or round display area of the annotation by performing layout analysis,
34. The image generation apparatus according to claim 33, wherein the thumbnail image generation means generates a thumbnail image so as to highlight the display area extracted by the annotation layout analysis means. In a computer provided with storage means for storing annotation data including annotation that is information added to an electronic document, user information indicating a user who has input the annotation, and input date and time of the annotation,
A process of selecting an annotation whose user information and input date and time match the user-specified conditions from the annotations included in the annotation data;
An image generation program that executes processing for generating an annotated thumbnail image of the electronic document by superposition and synthesis using the electronic document and the selected annotation. On the computer,
Processing to extract the rectangular or round display area of the annotation by performing layout analysis of the selected annotation,
36. The image generation program according to claim 35, wherein a process for generating a thumbnail image is executed so as to highlight the extracted display area.

Images