JP4396314B2 - Image generation method, image generation apparatus, and image generation program - Google Patents

Description

  The present invention relates to an image generation method, an image generation apparatus, and an image generation program for generating a thumbnail image, and more particularly, to an image generation method, an image generation apparatus, and an image generation program used for visually searching an electronic document.

  Patent Document 1 generates a thumbnail image that is used when a viewer wants to visually search for a target electronic document using the annotation in an environment where a plurality of viewers who have viewed the electronic document can add annotations to the electronic document. An information processing apparatus is described.

  In the information processing apparatus described in Patent Literature 1, each viewer can view annotations in a range corresponding to the access right by having the access right of the individual annotation as attribute information. Moreover, the information processing apparatus described in Patent Literature 1 generates a display image according to the access right that classifies the viewer into several groups. Further, the information processing apparatus described in Patent Document 1 can cope with the use of thumbnail images by preparing several types of images according to access rights.

JP 2000-181868 (page 5-7, FIG. 1)

  Since the information processing apparatus described in Patent Document 1 does not assume that too many annotations are input, even if a large number of annotations are input, the annotations are directly combined with the electronic document image and reduced. To generate a thumbnail image. Therefore, if a thumbnail image is a reduced image in which a large number of annotations are written by a plurality of people, the amount of annotation increases so that it becomes difficult to understand what is written in a thumbnail image that is a small image.

  In the information processing apparatus described in Patent Document 1, only an annotation input person has an authority to display or hide an annotation, and controls information display depending on the authority. However, although the viewer himself who entered the annotation can specify whether or not to display such as an access right, the viewer who wishes to browse does not have the freedom to make a selection on the display.

  Furthermore, in the information processing apparatus described in Patent Document 1, if thumbnail images are generated in a large size that is easy to see, the number of thumbnail images that can be displayed is reduced due to the limitation of the display area, and visual search efficiency is reduced. That is, when a user who wants to view a thumbnail image looks for a target file by looking at the thumbnail image, the larger thumbnail image is easier to see, but the larger the thumbnail image, the fewer thumbnail images that can be displayed.

  Therefore, the present invention provides an image generation method, an image generation apparatus, and an image generation program capable of displaying an annotation in the form of a thumbnail image that is visually easy to search when a viewing applicant visually searches for an electronic document with an annotation. The purpose is to provide.

  In addition, the present invention provides an image generation method, an image generation apparatus, and an image generation program that can generate a thumbnail image that allows a user who wants to browse annotations to freely select an annotation and can easily search for an electronic document. For the purpose.

  Furthermore, the present invention provides an image generation method, an image generation apparatus, and an image generation program that enable a viewing applicant to find a desired electronic document visually and efficiently using a thumbnail image of an electronic document with an annotation. The purpose is to provide.

Image producing method of the present invention, the storage processing device, and annotations is information added to the electronic document, the user information indicating the user who inputs an annotation, the annotation data comprising in association with the input date and time of annotation A step in which the information processing device inputs input information including a designated condition designated by the user from the input device, and a user that the information processing device stores in association among the annotations included in the annotation data Annotation of an electronic document is performed by selecting an annotation whose information and input date and time match the user-specified conditions included in the input information, and by superimposing the information processing device using the electronic document and the selected annotation. Thumbnail with Characterized in that it comprises the steps of generating an image.

The image generation method may include a step in which the information processing apparatus extracts a designated size of the thumbnail image from the input information. According to such a configuration, it is possible to generate thumbnail images that are easy to see in various sizes.

The image generation method may include a step in which the information processing apparatus extracts a specified calculation rule for obtaining the size of the thumbnail image from the input information. According to such a configuration, it is possible to generate a thumbnail image in which the annotation is easier to see.

The image generation method, an information processing apparatus, as a calculation rule, determine the size of the image using the calculation formula set so that the size of the image is increased according to the amount of annotations increases, according to the size of the obtained image A thumbnail image may be generated.

Further, the image generation method may be a method in which the information processing apparatus generates thumbnail images in which annotations to be displayed on the thumbnail images are color-coded according to the input user. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

Further, the image generation method may be a method in which the information processing apparatus generates thumbnail images in which annotations displayed on the thumbnail images are color-coded according to the input date and time. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

The image generation method may be a method in which the information processing apparatus generates a thumbnail image so that an annotation with an older input date / time is displayed in a lighter color. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

The image generation method may be a method in which the information processing apparatus generates a thumbnail image so that an annotation with an older input date / time is displayed in a darker color. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

The image generation method, an information processing apparatus, the shape of the selected annotation, by analyzing the size and position, and extracts a display area of the annotation, the information processing apparatus, which highlights the display area of the extracted annotations Thus, a thumbnail image may be generated. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

In addition, the image generation method uses a thumbnail image so that the information processing apparatus highlights an area including the annotation by using the extracted annotation display area and making an area other than the annotation display area a light color. There may be one that generates According to such a configuration, it is possible to generate a thumbnail image that makes it easy to understand a region of interest to be viewed for identification work for searching for a target electronic document.

The image generation method, an information processing apparatus, using the display area of the extracted annotation, to reduce the display area of the annotation to be larger in size than a predetermined reduced size, an area other than the display area of the annotation A thumbnail image may be generated so that an area including an annotation is highlighted by reducing the size to be smaller than a predetermined size .

Also, the title image generation method, an information processing apparatus, the shape of the title portion included in the electronic document, by analyzing the size and position, determine the display area of the title portion of the electronic document, the information processing apparatus has determined The thumbnail image may be generated so that the area of the location is highlighted together with the display area of the annotation. According to such a configuration, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from information other than the annotation.

In addition, the image generation method is such that the information processing apparatus analyzes the title part of the electronic document obtained by analyzing the shape, size and position of the title part included in the electronic document, and the shape, size and position of the annotation. by the region of interest that includes a display region extracted reduced so that the size larger than a predetermined reduced size, reducing the area other than the attention area so that a size smaller than a predetermined reduced size by area of interest A thumbnail image may be generated so that is highlighted.

Layout The image generation method, an information processing apparatus, the shape of the title portion included in the electronic document, by analyzing the size and position, obtains the layout structure of the document of the electronic document, the information processing apparatus, the obtained Based on the structure, an abstract image is generated, and the information processing device generates a small image by superimposing the annotation display area extracted by analyzing the shape, size, and position of the annotation on the image image It may be. According to such a configuration, it is possible to obtain information such as the number of annotations and the approximate position of the annotation even for a small image in which the annotation itself cannot be seen.

The image generation method, an information processing apparatus, may be configured to generate an icon image as small images.

The image generation method includes a step in which the information processing device extracts a specified size of the thumbnail image from the input information, and the information processing device displays an annotation to be displayed on the thumbnail image according to the input user. A thumbnail image that is color-coded may be generated.

The image generation method includes a step in which the information processing apparatus extracts a specified size of the thumbnail image from the input information, and the information processing apparatus color-codes the annotation displayed on the thumbnail image according to the input date and time. The thumbnail image may be generated.

Further, the image generation method includes a step in which the information processing device extracts a specified size of the thumbnail image from the input information, and the information processing device displays the thumbnail image so that an annotation with an older input date is displayed in a lighter color. May be generated.

The image generation method includes a step in which the information processing device extracts a specified size of the thumbnail image from the input information, and the information processing device displays the thumbnail image so that the annotation with the older input date and time is displayed in a darker color. May be generated.

The image generation method includes a step in which the information processing device extracts a specified size of the thumbnail image from the input information, and the information processing device analyzes the shape, size, and position of the selected annotation , extracting a display area of the annotation, the information processing apparatus, a display area of the extracted annotation may be configured to generate a thumbnail image to highlight.

The image generation method includes a step in which the information processing apparatus extracts a specified size of the thumbnail image from the input information, and the information processing apparatus uses the extracted annotation display area to select a region other than the annotation display area. The thumbnail image may be generated so that the region including the annotation is highlighted by making the region of light color.

The image generation method includes a step in which the information processing device extracts a specified size of the thumbnail image from the input information, and the information processing device uses the extracted annotation display region to generate an annotation display region. The area containing the annotation is highlighted by reducing the size so that it is larger than the predetermined reduction size and reducing the area other than the annotation display area so that it is smaller than the predetermined reduction size. Alternatively, a thumbnail image may be generated.

An image generation apparatus according to the present invention includes annotation data storage means for storing annotation data including annotations that are information added to an electronic document, user information indicating a user who has input the annotations, and input date and time of the annotations in association with each other. And input means for inputting input information including a specified condition designated by the user from the input device, and user information and input date and time stored in association with the annotation data storage means among the annotations included in the annotation data , and annotations selecting means for selecting the annotation matching the specified condition of the user input unit included in the input information inputted by superposition synthesis using the annotations and selected electronic document, with the electronic document annotation Characterized in that a thumbnail image generating means for generating thumbnails image.

The image generation apparatus includes an annotation analysis means for analyzing the shape of the annotation annotation selection means has selected, the size and location, annotation analyzing means by analyzing the shape of the annotation, the size and position, display of the annotation The region may be extracted, and the thumbnail image generation unit may generate a thumbnail image so that the annotation display region extracted by the annotation analysis unit is highlighted. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

Image generating program according to the present invention includes a annotation is information added to the electronic document, the user information indicating the user who inputs an annotation, a storage means for storing annotation data comprising in association with the input date and time of annotation The processing for inputting the input information including the specified condition specified by the user from the input device to the computer, and the user information and the input date and time stored in association with the storage means among the annotations included in the annotation data are input. Processing to select annotations that match the user's specified conditions included in the input information, and to generate thumbnail images with annotations of the electronic document by superimposing using the electronic document and the selected annotation thing And features.

The image generating program causes the computer, the shape of the selected annotation, by analyzing the size and position, the process of extracting a display area of the annotation, the thumbnail images to highlight the display area of the extracted annotations You may perform the process to produce | generate. According to such a configuration, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner, so that it is possible to generate a thumbnail image that facilitates searching for the target electronic document.

  According to the present invention, since the thumbnail image of the electronic document with only the annotation that matches the designation condition of the user who wants to view (user) is generated, when the user who wants to visually search the electronic document with the annotation added, Annotations can be displayed in the form of thumbnail images that are visually easy to find.

Embodiment 1 FIG.
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of an image generation apparatus according to the present invention. The image generating apparatus shown in FIG. 1 is used when a user who wishes to browse uses the added annotation to search for the target electronic document in an environment where a plurality of users who have viewed the electronic document can add the annotation to the electronic document. As shown in FIG. 1, the image generation apparatus includes an input device 1 for inputting annotations, conditions, and instructions, an information processing device 2 that operates by program control, a storage device 3 for storing each data, and a created thumbnail image. Output device 4.

  The input device 1 is a keyboard, a touch panel, a pen tablet, or the like. The information processing apparatus 2 is a personal computer, a PDA, a tablet PC, or the like. The storage device 3 is, for example, a magnetic disk device. The output device 4 is a display device, for example.

  The storage device 3 includes an annotation data storage unit 31 that stores annotation data, and an electronic document storage unit 32 that stores electronic documents. The annotation data storage unit 31 stores annotation data including attribute information such as annotation, user information of the user who input the annotation, input date and time of the annotation, and information (data name and URL) specifying the electronic document corresponding to the annotation. . An annotation is, for example, additional information such as characters and symbols such as characters, lines, and circles written on a document with a pen or the like, markings, highlights, and sticky notes. In the present embodiment, the annotation is input from the input device 1 by the user who has viewed the electronic document.

  The electronic document data storage unit 32 stores an electronic document that the user visually browses through the output device 4. An electronic document is a document created using a word processor or a document saved in a format such as PDF, HTML, text, bitmap, TIFF, or JPEG. Further, the electronic document may be a document of another format as long as it can be read by the viewer through the output device 4, and may be a storage file handled by spreadsheet software, CAD software, or presentation software, for example. In addition, as long as it can be read out as necessary, it may be a DTD file used for a document in HTML or XML format, and may be stored in distributed locations via a communication network.

  In the present embodiment, when an annotation input operation is performed by the user, the electronic document itself is not updated, but annotation data stored in the storage device 3 separately from the electronic document is updated. In the present embodiment, when an instruction to display an electronic document is input by the user, the information processing apparatus 2 generates an electronic document or a thumbnail image with an annotation by superposition and synthesis using the electronic document and the annotation. .

  The information processing apparatus 2 includes an input information analysis unit 21 that extracts selection conditions for creating thumbnail images, an annotation data selection unit 22 that selects annotations included in annotation data, and a layout image generation that generates thumbnail images. Means 23 and thumbnail image receiving means 24 for receiving the generated thumbnail image. Note that the input information analysis unit 21, the annotation data selection unit 22, the layout image generation unit 23, and the thumbnail image reception unit 24 are specifically executed by the CPU of the information processing apparatus 2 that executes a program installed in the information processing apparatus 2. Realized.

  The input information analysis means 21 extracts user information and input date / time for use in selecting annotations included in annotation data from various information input from the input device 1. In this embodiment, a user who wishes to view an electronic document inputs an instruction to display an electronic document in a state where only the annotation to be referred to is added among all annotations added to the electronic document. In this embodiment, the user designates the annotation to be referred to by inputting the name of the user who input the annotation and the input date and time of the annotation. Hereinafter, user information input to specify an annotation to be referred to is referred to as selection target user information. The input date and time input to specify the annotation to be referred to is referred to as the selection target input date and time.

  Further, the input information analysis unit 21 extracts instruction information within a range for creating a thumbnail image from various information input from the input device 1. Hereinafter, the instruction information of the range for creating a thumbnail image is referred to as a thumbnail creation range. In the present embodiment, the thumbnail creation range is specified by specifying the range of annotation data stored in association with the electronic document.

  For example, the input information analysis means 21 selects user information to be selected from various input information such as information input from a keyboard, handwritten information input using an electronic pen, and information selected and input from options on a display screen. Extract the selection target input date and thumbnail creation range. The input information is not limited to such information. For example, the input information analysis unit 21 extracts the selection target user information, the selection target date and time, and the thumbnail creation range from the information input by voice recognition using voice dialogue input. May be. When a default folder is determined in advance, the input information analysis unit 21 may extract the default folder as a thumbnail creation range.

  The input information analysis unit 21 generates condition data based on the extracted selection target user information and the selection target input date and time. The condition data is data indicating conditions of an input user of an annotation to be displayed on a thumbnail image, an input user of an annotation not to be displayed, an input date and time of an annotation to be displayed, and an input date and time of an annotation to be not displayed. Further, the input information analyzing unit 21 passes the generated condition data to the annotation data selecting unit 22.

  Based on the condition data from the input information analysis unit 21, the annotation data selection unit 22 selects annotations included in the annotation data and reconstructs the annotation data. Hereinafter, the annotation data reconstructed by the annotation data selection means 22 is referred to as reconstructed annotation data. The annotation data selection unit 22 passes the reconstructed annotation data to the layout image generation unit 23 as thumbnail generation data.

  The layout image generation unit 23 extracts an electronic document corresponding to the reconstructed annotation data from the annotation data selection unit 22 from the electronic document storage unit 32. Then, the layout image generation unit 23 generates a reduced image of the extracted electronic document.

  Further, the layout image generation means 23 generates a reduced image of the annotation image for displaying the annotation based on the reconstructed annotation data. The layout image generation unit 23 generates a thumbnail image corresponding to the input annotation data by synthesizing the reduced image of the electronic document and the reduced image of the annotation image. Then, the layout image generating unit 23 outputs the generated thumbnail image to the thumbnail image receiving unit 24.

  The thumbnail image receiving unit 24 sequentially receives the thumbnail images generated by the layout image generating unit 23 and visually presents them to the user through the output device 4. For example, the thumbnail image receiving means 24 creates a display screen for displaying a plurality of thumbnail images on one screen and displays the display screen on the output device 4 that is a display device. In this case, a plurality of thumbnail images may be displayed side by side in the vertical and horizontal directions, or may be displayed in a row in the vertical or horizontal direction. Alternatively, the thumbnail images may be displayed so as to overlap each other so that the user can view the thumbnail images while sequentially turning them one by one.

  In the present embodiment, the annotation data storage means is realized by the annotation data storage unit 31. The annotation selection unit is realized by the annotation data selection unit 22. The thumbnail image generation means is realized by the layout image generation means 23.

  Next, the operation will be described. FIG. 2 is a flowchart illustrating an example of a thumbnail image generation process in which the information processing apparatus 2 generates a thumbnail image of an electronic document to which an annotation has been added.

  The user operates the input device 1 to input a thumbnail image generation instruction. In addition, the user operates the input device 1 to input selection target user information, selection target input date and time, and a thumbnail creation range. When a user inputs an instruction to generate a thumbnail image from the input device 1, the input information analysis unit 21 of the information processing device 2 selects selection target user information used for selecting annotations from the input information input from the input device 1. Then, the selection target input date and time and the thumbnail creation range are extracted (step S11).

  For example, the input information analysis unit 21 extracts one or more user names as selection target user information. Moreover, the input information analysis means 21 extracts a specific date as the selection target input date. Note that the input information analysis means 21 may extract a period having a certain width as the selection target input date and time.

  Further, for example, when the annotation data storage unit 31 has a directory structure or a file structure and the annotation data is managed in a directory unit or a file unit, the input information analysis unit 21 uses the directory name or the directory creation range as the thumbnail creation range. Extract the file name. For example, when the annotation data storage unit 31 has a structure in which annotation data is managed only by the data name, the input information analysis unit 21 extracts the data name as a thumbnail creation range.

  FIG. 3 is an explanatory diagram showing an example of annotation data. As shown in FIG. 3, the annotation data 301 is data having a structure including a plurality of blocks 302a, 302b, 302c,. Hereinafter, the blocks 302a, 302b, 302c,... Will be referred to as the block 302 when they are comprehensively expressed or when any of the blocks is indicated. The block 302 includes annotation 303, input user information 305, input date / time information 306, and electronic document information 304 corresponding to the annotation 303.

  An annotation 303 is an annotation added to the electronic document. The input user information 305 is information (for example, user name) indicating the user who has input the annotation 303. The input date / time information 306 is the date / time when the annotation 303 is input. The electronic document information 304 is information for specifying an electronic file to which the annotation 303 is added. For example, when the electronic document is on the file system, the annotation data 301 includes a path name and a file name as the electronic document information 304. When the electronic document includes a plurality of pages, the annotation data 301 may include a path name, a file name, and a page number as the electronic document information 304. The annotation data 301 may include a URL or a URI as the electronic document information 304.

  As shown in FIG. 3, in the annotation data 301, information on the input user name and input date / time is recorded for each annotation 303. For example, in the annotation 303 of the block 302b, an annotation having a different content from the annotation 303 of the block 302a is recorded. Also, the input user information 305, the input date / time information 306, and the electronic document information 304 in the block 302b describe the input person information, the input date / time, and the electronic document information that have input the annotation 303 in the block 302b, respectively. Is configured.

  In the present embodiment, annotation data 301 shown in FIG. 3 is stored in the annotation data storage unit 31 in association with each electronic document. When a plurality of annotations are added to the electronic document, the annotation data 301 includes a plurality of blocks 302 as shown in FIG. In this embodiment, since one annotation data 301 is associated with one electronic document, the contents of the electronic document information 304 of the block 302 included in the same annotation data 301 are the same.

  Based on the information extracted in step S11, the input information analysis unit 21 indicates the input user of the annotation to be displayed on the thumbnail image, the input user of the annotation not to be displayed, the input date and time of the annotation to be displayed, and the input date and time of the annotation to be not displayed. Condition data is generated (step S12).

  The annotation data selection unit 22 reads the annotation data 301 in the range specified by the thumbnail creation range extracted by the input information analysis unit 21 from the annotation data storage unit 31 one by one (step S13). Note that the annotation data 301 may be read out in units of a plurality of data instead of sequentially reading unread data one by one.

  The annotation data selection unit 22 deletes the annotation 303 that does not match the condition data selection condition from the annotations 303 included in the read annotation data 301, and newly constructs annotation data that includes only the annotation 303 that matches the condition. Thus, reconstructed annotation data is generated (step S14). That is, the annotation data selection unit 22 generates reconstructed annotation data including only the annotation designated by the user.

  FIG. 4 is an explanatory diagram illustrating a specific example of a generation process in which the image generation apparatus generates a thumbnail image. In the example illustrated in FIG. 4, the annotation data storage unit 31 stores annotation data including three annotations, annotations 701 and 702 input by the user A in advance and annotation 703 input by the user B. Further, the input information analysis means 21 extracts the condition “annotation recently input by the user A” from the input information of the input device 1.

  If only the annotation 702 matches the condition “annotation recently entered by the user A”, the annotation data selection unit 22 leaves only the annotation 702, deletes the annotations 701 and 703, and re-creates new annotation data. Constitute.

  The layout image generation unit 23 reads out an electronic document corresponding to the reconstructed annotation data from the electronic document storage unit 32 based on the electronic document information 304 included in the reconstructed annotation data generated by the annotation data selection unit 22 (step S15). ).

  The layout image generation means 23 generates a reduced image having a thumbnail image size based on the read electronic document. In addition, the layout image generation unit 23 generates a reduced image of the annotation image having the same thumbnail image size based on the reconstructed annotation data. For example, the layout image generation unit 23 generates a reduced image by rendering the annotation 303 included in the reconstructed annotation data. Then, the layout image generating unit 23 generates a thumbnail image by combining the reduced image of the electronic document and the reduced image of the annotation image (step S16).

  For example, in the example illustrated in FIG. 4, the layout image generation unit 23 generates a thumbnail image 74 by combining the reduced image 72 of the annotation image and the reduced image 73 of the electronic document.

  The layout image generating unit 23 passes the generated thumbnail image to the thumbnail image receiving unit 24 (step S17).

  The annotation data selection unit 22 determines whether there is unread annotation data 301 in the annotation data storage unit 31 based on the thumbnail creation range extracted in step S11 (step S18). When it is determined that there is unread annotation data 301, the annotation data selection unit 22 reads unread annotation data 301 from the annotation data storage unit 31. And the process after step S13 is repeatedly performed. For example, when a directory name or file name is designated as the thumbnail creation range, all annotation data 301 stored in the directory or file is read in order, and thumbnail images are repeatedly generated.

  By executing the above processing, it is possible to generate a thumbnail image including only the annotation noted by the user and present it as visual information for the electronic document in which the annotation data in the specified range is input.

  As described above, according to the present embodiment, based on the input user information 305 and the input date / time information 306 stored in association with individual annotations 303, the annotation data selection unit 22 uses the annotation that has been input by whom. Is identified. Then, a thumbnail image in which only annotations necessary for the person who wants to browse is selected is generated. For this reason, when a user who wishes to browse an electronic document with an annotation visually finds the annotation, the annotation can be displayed in the form of a thumbnail image that is visually easy to find. Therefore, a viewer who wants to visually search an electronic document with annotations added by multiple viewers using thumbnail images, removes unnecessary annotations and selects only necessary annotations. You can search based on it.

  Further, according to the present embodiment, the annotation data selection unit 22 selects the annotations included in the annotation data using the user information and the input date / time, so that a thumbnail image that is easy for the user to view can be generated. Further, according to the present embodiment, since the thumbnail image is generated according to the input condition after the condition is input, it is also possible to generate a thumbnail image that is dynamically changed while changing the condition. Furthermore, according to the present embodiment, since thumbnail images can be dynamically generated, there is no need to prepare in advance a plurality of individual thumbnail images such as thumbnail images without annotations or thumbnail images with annotations.

Embodiment 2. FIG.
Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 5 is a block diagram illustrating another configuration example of the image generation apparatus. In the present embodiment, the functions of the input device 1, the storage device 3, and the output device 4 are the same as those functions in the first embodiment. Among the means of the information processing apparatus 2, the functions of the annotation data selecting means 22 and the thumbnail image receiving means 24 are the same as those functions in the first embodiment. In the present embodiment, the functions of the input information analysis means 21 and the layout image generation means 23 are different from those in the first embodiment.

  In the present embodiment, the input information analysis unit 21 extracts the size of the thumbnail image to be generated from the input information input from the input device 1 in addition to the selection condition for creating the thumbnail image.

  The layout image generation unit 23 generates a thumbnail image using the reconstructed annotation data from the annotation data selection unit 22 and the electronic document extracted from the electronic document storage unit 32. In the present embodiment, the layout image generation unit 23 generates a thumbnail image based on the size information of the thumbnail image from the input information analysis unit 21.

  Next, the operation will be described. FIG. 6 is a flowchart showing another example of the thumbnail image generation process for generating the thumbnail image of the electronic document to which the annotation is added.

  When a user inputs an instruction to generate a thumbnail image from the input device 1, the input information analysis unit 21 of the information processing device 2 selects selection target user information used for selecting annotations from the input information input from the input device 1. The selection target input date and time, the thumbnail creation range, and the size of the thumbnail image designated by the user are extracted (step S21).

  As the size of the thumbnail image, the vertical and horizontal bit numbers of the image may be input. Further, the reduction ratio from the original image before reduction may be input as the size of the thumbnail image. Note that the selection target user information, the selection target input date and time, and the thumbnail creation range are the same as those in the first embodiment.

  The processing from step S22 to step S25 is the same as the processing from step S12 to step S15 in the first embodiment.

  When the electronic document is read out, the layout image generating unit 23 generates a reduced image having an image size designated by the size information of the thumbnail image from the input information analyzing unit 21 based on the electronic document. Further, the layout image generation unit 23 generates a reduced image having an image size designated by the size information of the thumbnail image from the input information analysis unit 21 based on the reconstructed annotation data. Then, the layout image generating unit 23 generates a thumbnail image by combining the reduced image of the electronic document and the reduced image of the annotation image (step S26).

  The process of step S27 is the same as the process of step S17 in the first embodiment.

  The annotation data selection unit 22 determines whether there is unread annotation data 301 in the annotation data storage unit 31 based on the thumbnail creation range extracted in step S21 (step S28). When it is determined that there is unread annotation data 301, the annotation data selection unit 22 reads unread annotation data 301 from the annotation data storage unit 31. And the process after step S23 is repeatedly performed.

  By executing the above processing, it is possible to generate a thumbnail image having a size desired by the user and including only the annotation that the user is interested in for the electronic document in which the annotation data in the specified range is input.

  As described above, according to the present embodiment, a thumbnail image is generated every time a browsing requester inputs a browsing request condition, so that a thumbnail image can be generated in a size that is easy for the browsing requester to view. Since the thumbnail image is generated in a size desired by the user, in addition to the effect in the first embodiment, it is possible to generate thumbnail images that are easy to see in various sizes.

  Further, according to the present embodiment, thumbnail images having different sizes can be generated for individual electronic documents. Therefore, by generating thumbnail images in various sizes, it is possible to display many thumbnail images within a limited area, or to generate thumbnail images that are unlikely to be selected by those who wish to view them in advance. can do. Therefore, visual search efficiency can be improved by generating easy-to-view thumbnail images in various sizes.

Embodiment 3 FIG.
Next, a third embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 5 in the second embodiment. In the present embodiment, the input information analysis unit 21 calculates the image size corresponding to the annotation amount displayed on the thumbnail image, not the size of the thumbnail image desired by the user, as information to be passed to the layout image generation unit 23. The information of the calculation rule to do is extracted from the input information. In the present embodiment, as a calculation rule, a calculation formula for obtaining a reduction ratio using a linear function based on the number of annotations is used. For example, “reduction ratio (%)” = “number of annotations” × 0.5 + 5.0 is used as a calculation rule. Here, the “number of annotations” is the number of blocks 302 shown in FIG.

  Note that the calculation formula for obtaining the reduction ratio is not limited to the calculation rule, and other calculation formulas may be used as the calculation rule. For example, the calculation rule for calculating the size of the diagonal line after obtaining the size of the diagonal dot number represented by the number of vertical and horizontal dots of the electronic document image read by the layout image generation unit 23 may be used as the calculation rule. In this case, for example, “size of diagonal line after reduction” = 10 × “number of annotations” +10 may be used as a calculation rule. In addition, an upper limit may be set for the reduction rate and the reduction size, and a calculation formula or conditional expression using a logarithm instead of a linear function may be used as a calculation rule.

  The layout image generation unit 23 determines the size of the thumbnail image according to the amount of annotation included in the reconstructed annotation data generated by selection and generation by the annotation data selection unit 22, and generates a thumbnail image according to the determined size.

  By executing the above processing, it is possible to generate a thumbnail image of an electronic document in which annotation data in a specified range is input, including only the annotation that the user is interested in and having a size corresponding to the amount of annotation.

  As described above, according to the present embodiment, it is possible to generate a thumbnail image of an electronic document with no annotation small and a large thumbnail image of an electronic document with many annotations. In addition to the effects of the first embodiment, , It is possible to generate a thumbnail image in which the annotation is easier to see. Further, according to the present embodiment, thumbnail images of electronic documents without annotations can be displayed smaller, so that when displaying a large number of thumbnail images, a larger number of thumbnail images can be displayed on one screen. In addition, according to the present embodiment, since thumbnail images of electronic documents with few annotations are displayed smaller, it is possible to intuitively determine the amount of annotation by looking at the size of thumbnail images without looking at the details of the thumbnail images. Can grasp.

Embodiment 4 FIG.
Next, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 7 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, the functions of the input device 1, the storage device 3, and the output device 4 are the same as those functions in the third embodiment. In addition, the functions of the input information analysis unit 21, the annotation data selection unit 22, and the thumbnail image reception unit 24 of the information processing apparatus 2 are the same as those functions in the third embodiment.

  In the present embodiment, as shown in FIG. 7, the layout image generation unit 23 includes an annotation layout analysis unit 201, an electronic document layout analysis unit 202, an attention area reduction rate calculation unit 203, and a reduction composition unit 204.

  The annotation layout analysis unit 201 generates an annotation image by rendering an annotation. Further, the annotation layout analysis unit 201 extracts display area information such as a rectangle or a circle for each annotation included in the annotation data by an annotation layout analysis. The electronic document layout analysis unit 202 generates an image of the electronic document by rendering the electronic document.

  The attention area reduction rate calculation unit 203 calculates the thumbnail image reduction rate based on the output data of the annotation layout analysis unit 201, the output data of the electronic document layout analysis unit 202, and the desired thumbnail image size from the input information analysis unit 21. Ask. The reduction composition unit 204 generates a thumbnail image based on the information from the attention area reduction rate calculation unit 203.

  Next, the operation will be described. In the present embodiment, the operations of the input information analyzing unit 21, the annotation data selecting unit 22, and the thumbnail image receiving unit 24 are the same as those in the third embodiment. In the present embodiment, the operation of the layout image generating means 23 is different from the operation in the third embodiment.

  The annotation data selection unit 22 passes the generated reconstructed annotation data to the annotation layout analysis unit 201. The annotation layout analysis unit 201 renders each annotation included in the reconstructed annotation data to generate an annotation image. Further, the annotation layout analysis unit 201 calculates a rectangular or round area including an area for displaying the annotation. When a plurality of annotations are included, the annotation layout analysis unit 201 calculates a rectangular or round area for each annotation.

  FIG. 8 is an explanatory diagram showing an example of an entire area 401 that is an area of the same size as the electronic document layout image corresponding to the reconstructed annotation data and can render the annotation. For example, in FIG. 8, small areas 402 and 403 indicate rectangular areas including annotations.

  The electronic document layout analysis unit 202 reads an electronic document corresponding to the reconstructed annotation data from the electronic document storage unit 32, and generates an electronic document layout image by performing rendering.

  The attention area reduction rate calculation unit 203 determines whether the annotation among thumbnail images is based on the output data of the annotation layout analysis unit 201, the output data of the electronic document layout analysis unit 202, and the desired thumbnail image size from the input information analysis unit 21. Processing is performed to make the existing area easy to see as the attention area. The attention area reduction rate calculating means 203 does not reduce the rectangular or round area in which the annotation exists so as to be displayed larger in the thumbnail image, and reduces the area in which the annotation does not exist to be displayed smaller. The processing to do. By processing in this way, the attention area reduction rate calculating means 203 makes the annotation larger in the whole thumbnail image and easier to see.

  For example, in FIG. 8, α1, α2, α3, α4, and α5 indicate the reduction ratios in the vertical direction of the respective regions. In FIG. 8, β1, β2, β3, β4, and β5 indicate the reduction ratios in the horizontal direction of the respective regions. For example, since α1, α3, α5, β1, β3, and β5 do not correspond to the regions 402 and 403 including the annotation, the attention region reduction rate calculation unit 203 reduces the size to a smaller value than when all the regions are uniformly reduced. To do. Since α2, α4, β2, and β4 correspond to the regions 402 and 403 including the annotation, the attention region reduction rate calculating unit 203 reduces the size larger than when all the regions are uniformly reduced. Then, the attention area reduction rate calculation unit 203 calculates the reduction rate so that the overall size matches the desired size from the input information analysis unit 21.

  The reduction composition unit 204 reduces the electronic document layout image and the annotation layout image based on the reduction rate data obtained by the attention area reduction rate calculation unit 203. Then, the reduction composition unit 204 generates a thumbnail image by superimposing the reduced annotation layout image on the reduced electronic document layout image.

  By executing the above processing, for the electronic document in which annotation data in the specified range is input, a thumbnail image that includes only the annotation that the user is interested in and that makes the attention area where the annotation exists larger and easier to see is generated. Can do.

  As described above, according to the present embodiment, when generating a thumbnail image of an electronic document that does not include an annotation, a thumbnail image that does not destroy the layout of the electronic document is generated by uniformly reducing the entire image. can do. In addition, when generating a thumbnail image of an electronic document including an annotation, the annotation can be displayed in a large and easy-to-view manner. Therefore, in addition to the effect of the first embodiment, a thumbnail image that makes it easy to search for the target electronic document is generated. Can do.

Embodiment 5 FIG.
Next, a fifth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the electronic document layout analysis unit 202 analyzes the logical structure in the electronic document such as the title part, subtitle part, text part, and chart part in addition to the function of image generation by rendering the electronic document, The display area is analyzed.

  FIG. 9 is an explanatory diagram illustrating an example of an electronic document layout image. For example, as shown in FIG. 9, the electronic document layout image includes a title part 502, subtitle parts 503 and 504, body parts 505 and 507, and a chart part 506.

  Since the title portion 502 is useful information representing the contents of the electronic document, the attention area reduction rate calculating means 203 is based on the analysis result of the electronic document layout analyzing means 202 and the rectangle or circle in which the annotation of the annotation layout image exists. Along with the shape area, processing is performed so as not to reduce too much as the attention area. By performing such processing, it is possible to generate a thumbnail image that makes it easier to search for a document.

  As described above, according to the present embodiment, a thumbnail image is generated that makes it easy to see the location of useful information indicating the content of the electronic document, such as the title location of the electronic document, even in a location that does not include an annotation. Therefore, in addition to the effects of the fourth embodiment, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from information other than the annotation.

Embodiment 6 FIG.
Next, a sixth embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the layout image generation unit 23 classifies annotations for each input user at the stage of rendering the annotations in order to generate thumbnail images based on the annotations selected by the annotation data selection unit 22. . Then, the layout image generation unit 23 changes the display color of the annotation for each classified user.

  Similarly, the layout image generation unit 23 may change the display color of the annotation by rendering the old annotation so that the color of the old annotation becomes light according to the order of the input date and time in the stage of rendering the annotation. In addition, the layout image generation unit 23 may change the display color of the annotation by rendering the old annotation so that the brightness of the color of the old annotation is reduced and displayed in a dark color.

  By executing the above processing, it is possible to generate a thumbnail image in which the annotation attribute information can be grasped according to the display color of the annotation.

  As described above, according to the present embodiment, a thumbnail image is generated in which an annotation that matches the selection condition is further distinguished by the user and the input date and time and is easy to see. Therefore, in addition to the effects of the fourth embodiment, it is possible to generate a thumbnail image that makes it easy to search for the target electronic document from the display color of the annotation.

Embodiment 7 FIG.
Next, a seventh embodiment of the present invention will be described. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the reduction composition unit 204 converts the color information so that the display color on the electronic document is lightened in an area where there is no attention part such as an annotation or a title part. Then, the reduction composition unit 204 synthesizes an image with a contrast between the target location and a location other than the target location.

  By executing the above processing, the attention area where the annotation exists on the thumbnail image is more emphasized, and the user can easily determine the thumbnail image.

  As described above, according to the present embodiment, a thumbnail image is displayed by reducing the contrast of an area where there is no annotation and there is no useful information indicating the content of the electronic document such as a title part. Therefore, in addition to the effects of the fifth embodiment, it is possible to generate a thumbnail image that makes it easy to understand the region of interest to be viewed for the identification work for searching for the target electronic document.

Embodiment 8 FIG.
Next, an eighth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of FIG. 7 in the fourth embodiment. In the present embodiment, the reduction synthesis unit 204 does not use an image obtained by reducing a rendered image as each reduced image used for superimposition synthesis, but generates a bitmap generated as an abstract image based on a layout analysis result. Use images.

  The reduction composition unit 204 generates and uses a bitmap image abstracted based on information from the electronic document layout analysis unit 202, not an image that has been rendered and reduced, as an electronic document layout image. By doing so, even in the case of a reduced image, it is possible to know approximate information such as a rough title location, subtitle location, text location, and chart location.

  Further, the reduction composition unit 204 generates a bitmap image in which the rectangular or round region is filled based on the rectangular or round region where the annotation obtained by the annotation layout analysis unit 201 exists as the annotation layout image. Use. By doing so, it is possible to know approximate information such as where the annotation exists and how many annotations exist.

  The reduction synthesis unit 204 generates an icon image by synthesizing the bitmap image generated as the electronic document layout image and the bitmap image generated as the annotation layout image. FIG. 10 is an explanatory diagram showing an example of an icon image 601 generated by the reduction composition unit 204. For example, as shown in FIG. 10, even when a small image such as an icon image 601 is used, not only the rough layout of the text can be understood, but also there are two attention area portions 602 and 603 where annotations exist. . You can also see where the annotation is in the rough layout of the text.

  By executing the above processing, even in a small image where the annotation cannot be seen in detail, it is possible to grasp the attention area location where the annotation exists, the number of annotations, and the overall layout.

  As described above, according to the present embodiment, only an electronic document layout image based on logical structure information obtained by layout analysis and a rectangular or round area indicating a display area obtained by analyzing annotations are used. A thumbnail image is generated by superposition and synthesis with the configured image. Therefore, in addition to the effects of the fifth embodiment, information such as the number of annotations and the approximate position of the annotation can be obtained even for a small image such as an icon image where the annotation itself cannot be seen. it can.

  Further, the annotation may be color-coded according to the user name of the input user and the input date and time. By doing so, the user can know when and when the annotation is input.

Embodiment 9 FIG.
Next, a ninth embodiment of the present invention will be described with reference to the drawings. FIG. 11 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, as shown in FIG. 11, the image generation device includes an information acquisition unit 1001 instead of the input device 1 shown in the first embodiment. The information acquisition unit 1001 is realized by the CPU of the information processing apparatus 2 that executes a program installed in the information processing apparatus 2.

  In the present embodiment, for example, a terminal used by a user is connected to the information processing device 2 via a communication network, and the information processing device 2 transmits a generated thumbnail image to the user terminal via the communication network. Provides image generation services. The information acquisition unit 1001 receives the selection target user information, the selection target input date and time, and the thumbnail creation range via the communication network, and passes them to the input information analysis unit 21. As described above, as long as the information necessary for generating the thumbnail image can be passed to the input information analysis unit 21, the input unit is not limited to the input device 1 such as a keyboard, and is realized by a program. Also good.

  Further, the thumbnail image receiving means 24 may pass the image information including the thumbnail image to the program that requested the thumbnail image instead of passing it to the output device 4.

  Further, in the present embodiment, the case where the image generation apparatus in the first embodiment includes the information acquisition unit 1001 instead of the input device 1 has been described, but the information acquisition unit 1001 shown in the present embodiment is The present invention can be applied to other than the first embodiment. For example, in FIG. 5 shown in the second embodiment and the third embodiment, the image generation apparatus may include an information acquisition unit 1001 instead of the input apparatus 1. In FIG. 7 shown in the fourth to eighth embodiments, the image generation apparatus may include an information acquisition unit 1001 instead of the input apparatus 1.

Embodiment 10 FIG.
Next, a tenth embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the configuration of the image generation apparatus is the same as the configuration of any of FIG. 1, FIG. 5, FIG. 7, or FIG. 11 shown in the first to ninth embodiments.

  12 to 17 are explanatory diagrams illustrating other examples of annotation data. In the annotation data 301 illustrated in FIG. 3, the case where the block 302 includes the annotation 303, the electronic document information 304, the input user information 305, and the input date / time information 306 has been described. In the present embodiment, FIG. As shown in FIG. 17, the contents of the information constituting the block 302 are different.

  In the example shown in FIG. 12, blocks 302b, 302c,... Other than the top block 302a in the annotation data 301 include only the annotation 303, the input user information 305, and the input date / time information 306. Since the first block 302a includes the electronic document information 304, if the block 302a is present, the electronic document corresponding to the annotation data 301 is included even if the other blocks 302b, 302c,. Can be specified.

  In the example illustrated in FIG. 13, in the annotation data 301 illustrated in FIG. 11, the block 302 c includes another input date information 306 b in addition to the input date information 306. According to such a configuration, the annotation 303 included in the block 302c is selected if any of the input date / time information 306, 306b meets the condition when the annotation data selection unit 22 performs filtering. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the input date and time information 306 and 306b match the conditions.

  For example, when a plurality of inputs written by the same person and having different input dates and times are grouped and handled as one annotation 303, the block 302 includes a plurality of input date and time information 306. When there is a time difference from the start of input to the end when inputting one annotation 303, the block 302 includes, for example, an input start time and an input end time as the input date / time information 306.

  In the example illustrated in FIG. 14, the block 302 includes other attribute information 307 in addition to the information included in the block 302 illustrated in FIG. 3. The block 302 may include additional information that is not involved in the selection process of the annotation data selection unit 22 as the other attribute information 307.

  In the example illustrated in FIG. 15, the block 302 includes additional modification date information 308 as the other attribute information 307 illustrated in FIG. 14. According to such a configuration, the annotation 303 included in the block 302 is selected if any of the input date / time information 306 and the modified date / time information 308 meets the condition when the annotation data selection unit 22 performs filtering. Is done. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the input date information 306 and the correction date information 308 match the conditions. Further, as in the example illustrated in FIG. 14, the modification date information 308 may not be treated as a filtering condition when the annotation data selection unit 22 selects and selects.

  In the example illustrated in FIG. 16, the block 302 includes retouching correction user information 309 and retouching correction date / time information 310 as the other attribute information 307 illustrated in FIG. 14. According to such a configuration, when the annotation data selection unit 22 filters the annotation 303 included in the block 302, any user information 305, 309 and any date information 306, 310 match the condition. Selected. Note that the annotation data selection unit 22 may not select the annotation 303 unless both the user information 305 and 309 and both the date and time information 306 and 310 match the conditions. Further, as in the example illustrated in FIG. 14, the correction correction user information 309 and the correction correction date / time information 310 may not be handled as filtering conditions when the annotation data selection unit 22 selects and selects.

  In the example illustrated in FIG. 17, the block 302 includes browsing user information 311 a and 311 b and browsing date information 312 a and 312 b as the other attribute information 307 illustrated in FIG. 14. In the example shown in FIG. 17, user information and browsing date and time of the user who has browsed annotation data 301 are sequentially added to block 302. According to such a configuration, when the annotation data selection unit 22 performs filtering, the annotation 303 included in the block 302 is one of the user information 305, 311a, 311b and one of the date / time information 306, 312a, 312b. Is selected if meets the conditions. Note that the annotation data selection means 22 may not select the annotation 303 unless all the user information 305, 311a, 311b and all the date / time information 306, 312a, 312b match the conditions. Further, as in the example illustrated in FIG. 14, the browsing user information 311 a and 311 b and the browsing date information 312 a and 312 b may not be handled as filtering conditions when the annotation data selection unit 22 selects and sorts.

  As described above, according to the embodiment, even if the information included in the annotation data 301 is described in detail, the effects of the first to ninth embodiments can be obtained. Similar effects can be obtained.

Embodiment 11 FIG.
Next, an eleventh embodiment of the present invention will be described with reference to the drawings. FIG. 18 is a block diagram illustrating still another configuration example of the image generation apparatus. In the present embodiment, the basic configuration of the image generation device is the same as the configuration shown in the first to tenth embodiments, and the image generation device includes the input device 1 and the information processing device 2. A storage device 3 and an output device 4. In the present embodiment, the information processing apparatus 2 reads the thumbnail image generation processing program 5 stored in the storage medium. Then, the information processing apparatus 2 executes any one of the thumbnail image generation processes shown in the first to tenth embodiments in accordance with the read thumbnail image generation process program 5.

  In the present embodiment, for example, the information processing apparatus 2 displays, as the thumbnail image generation processing program 5, an annotation whose user information and input date and time match the user-specified conditions among annotations included in the annotation data. Executes thumbnail image generation processing by reading an image generation program that performs processing to select and processing to generate thumbnail images with annotations of electronic documents by superimposing and combining electronic documents and selected annotations. To do.

  Note that the image generation apparatus may execute a thumbnail image generation process that combines the processes shown in the first to tenth embodiments. In the eleventh embodiment, the information processing apparatus 2 reads the thumbnail image generation processing program 5 that is executed in combination with the processes shown in the first to tenth embodiments, and displays the thumbnail. An image generation process may be executed.

  The present invention can be applied to the use of a program for providing an interface capable of visually selecting an electronic document having annotation data in which an annotation input person and input date and time are known. In addition, in an environment where a plurality of viewers can add annotations to electronic documents stored in a file server, a database, or the like, the present invention can be applied to the use of an individual selection button function using thumbnail images.

It is a block diagram which shows an example of a structure of the image generation apparatus by this invention. 12 is a flowchart illustrating an example of thumbnail image generation processing for generating a thumbnail image of an electronic document with an annotation added thereto. It is explanatory drawing which shows an example of annotation data. It is explanatory drawing which shows the specific example of the production | generation process in which an image generation apparatus produces | generates a thumbnail image. It is a block diagram which shows the other structural example of an image generation apparatus. 14 is a flowchart illustrating another example of thumbnail image generation processing for generating a thumbnail image of an electronic document with an annotation added thereto. It is a block diagram which shows the other structural example of an image generation apparatus. It is explanatory drawing which shows the example of all the area | regions 401 which can render an annotation. It is explanatory drawing which shows the example of an electronic document layout image. It is explanatory drawing which shows the example of the icon image 601 which the reduction | restoration synthetic | combination means 204 produces | generates. It is a block diagram which shows the other structural example of an image generation apparatus. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is explanatory drawing which shows the other example of annotation data. It is a block diagram which shows the other structural example of an image generation apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input device 2 Information processing device 3 Storage device 4 Output device 21 Input information analysis means 22 Annotation data selection means 23 Layout image generation means 24 Thumbnail image reception means 31 Annotation data storage section 32 Electronic document storage section

Claims (36)

Comprising the steps of the information processing apparatus stores the annotation is information added to the electronic document, the user information indicating the user who inputs the annotation, the annotation data comprising in association with the input date and time of the annotation,
The information processing device inputs input information including a specified condition specified by a user from the input device;
A step wherein the information processing apparatus, of the annotations included in the annotation data, user information and input date and time associated with memory selects the annotation matching the specified condition of the user included in the input information input,
The information processing apparatus includes a step of generating a thumbnail image with an annotation of the electronic document by superposition and synthesis using the electronic document and the selected annotation. The image generation method according to claim 1 , wherein the information processing apparatus includes a step of extracting a specified size of a thumbnail image from the input information. The image generation method according to claim 1 , wherein the information processing apparatus includes a step of extracting a designated calculation rule for obtaining a size of a thumbnail image from the input information. The information processing apparatus obtains the size of an image using a calculation formula that is set so that the size of the image increases as the amount of annotation increases as a calculation rule, and generates a thumbnail image according to the size of the obtained image Item 4. The image generation method according to Item 3. The image generation method according to claim 1 , wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on the thumbnail image is color-coded according to an input user. The image generation method according to claim 1 , wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on the thumbnail image is color-coded according to an input date and time. The image generation method according to claim 6 , wherein the information processing apparatus generates a thumbnail image so that an annotation with an older input date is displayed in a lighter color. The information processing apparatus, an image generating method according to claim 6, wherein the input date and time to generate a thumbnail image to be displayed in a dark color the older annotations. The information processing device extracts the display area of the annotation by analyzing the shape, size and position of the selected annotation,
The image generation method according to claim 1 , wherein the information processing apparatus generates a thumbnail image so that the extracted display area of the annotation is highlighted. The information processing apparatus generates a thumbnail image so that an area including an annotation is highlighted by using the extracted display area of the annotation and making an area other than the display area of the annotation a light color. Item 10. The image generation method according to Item 9. The information processing apparatus uses the extracted display area of the annotation to reduce the annotation display area to a size larger than a predetermined reduction size , and performs an area other than the display area of the annotation on the predetermined display area . by reducing to be smaller than the reduced size, the image generating method according to claim 9, wherein for generating a thumbnail image to highlight regions containing the annotation. The information processing apparatus determines the display area of the title location of the electronic document by analyzing the shape, size and position of the title location included in the electronic document,
The image generation method according to claim 9 , wherein the information processing apparatus generates a thumbnail image so that the obtained title location area is highlighted together with an annotation display area. The information processing apparatus extracts a display area extracted by analyzing the title part of the electronic document obtained by analyzing the shape, size and position of the title part included in the electronic document, and the shape, size and position of the annotation. The attention area is highlighted by reducing the including attention area to a size larger than a predetermined reduction size and reducing the area other than the attention area to a size smaller than the predetermined reduction size. The image generation method according to claim 9, wherein thumbnail images are generated as described above. The information processing apparatus determines the layout structure in the document of the electronic document by analyzing the shape, size and position of the title part included in the electronic document,
The information processing apparatus generates an abstract image based on the obtained layout structure,
The image generation method according to claim 9 , wherein the information processing apparatus generates a small image in which the display area of the annotation extracted by analyzing the shape, size, and position of the annotation is superimposed on the image image. The image generation method according to claim 14 , wherein the information processing apparatus generates an icon image as a small image. The image generation method according to any one of claims 5 to 15, including a step in which the information processing apparatus extracts a specified size of a thumbnail image from the input information. The image generation method according to any one of claims 5 to 15, further comprising a step of the information processing apparatus extracting a specified calculation rule for obtaining a size of a thumbnail image from the input information. . Claim that the information processing apparatus obtains a size of an image using a calculation formula set so that the size of the image increases as the amount of annotation increases, and generates a thumbnail image according to the obtained size of the image. Item 18. The image generation method according to Item 17. The image generation method according to any one of claims 6 to 15, wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded according to an input user. The image generation method according to claim 9 , wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on the thumbnail image is color-coded according to an input date and time. 21. The image generation method according to claim 20 , wherein the information processing apparatus generates a thumbnail image so that an annotation with an older input date is displayed in a lighter color. 21. The image generation method according to claim 20 , wherein the information processing apparatus generates a thumbnail image so that an annotation with an older input date and time is displayed in a darker color. The information processing apparatus generates a thumbnail image so that an area including an annotation is highlighted by using the extracted display area of the annotation and making an area other than the display area of the annotation a light color. The image generation method according to any one of claims 11 to 15. The information processing apparatus, using the extracted display area of the annotation, to reduce the display area of the annotation to be larger in size than a predetermined reduced size, reduced area other than the display of the annotation of the predetermined The image generation method according to any one of claims 12 to 15, wherein the thumbnail image is generated so as to highlight an area including an annotation by reducing the size to be smaller than the size. . The information processing apparatus includes a step of extracting a specified size of a thumbnail image from the input information;
The image generation method according to any one of claims 6 to 15, wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded according to an input user. The information processing apparatus includes a step of extracting a specified size of a thumbnail image from the force information,
The image generation method according to any one of claims 9 to 15, wherein the information processing apparatus generates a thumbnail image in which an annotation to be displayed on a thumbnail image is color-coded according to an input date and time. The information processing apparatus includes a step of extracting a specified size of a thumbnail image from the input information;
The image generation method according to any one of claims 9 to 15, wherein the information processing apparatus generates a thumbnail image so that an annotation with an older input date and time is displayed in a lighter color. The information processing apparatus, from said input information comprises extracting a specified size of the thumbnail image,
The image generation method according to any one of claims 9 to 15, wherein the information processing device generates a thumbnail image so that an annotation with an older input date and time is displayed in a darker color. The information processing apparatus, from said input information comprises extracting a specified size of the thumbnail image,
The information processing apparatus, the shape of the selected annotation, by analyzing the size and position, and extracts a display area of the annotation,
The image generation method according to any one of claims 10 to 15, wherein the information processing apparatus generates a thumbnail image so that a display area of the extracted annotation is highlighted. The information processing apparatus includes a step of extracting a specified size of a thumbnail image from the input information;
The information processing apparatus generates a thumbnail image so that an area including an annotation is highlighted by using the extracted display area of the annotation to make an area other than the display area of the annotation a light color. The image generation method according to any one of claims 11 to 15. The information processing apparatus includes a step of extracting a specified size of a thumbnail image from the input information;
The information processing apparatus uses the extracted display area of the annotation to reduce the annotation display area to a size larger than a predetermined reduction size , and performs an area other than the display area of the annotation on the predetermined display area . The image generation according to any one of claims 12 to 15, wherein the thumbnail image is generated so as to highlight an area including the annotation by reducing the size to be smaller than the reduced size. Method. The image generation method according to any one of claims 19 to 24, including a step in which the information processing apparatus extracts a specified calculation rule for obtaining a size of a thumbnail image from the input information. . Annotation data storage means for storing annotation data including annotations that are information added to an electronic document, user information indicating a user who has input the annotations, and input date and time of the annotations in association with each other;
An input means for inputting input information including a designated condition designated by the user from the input device;
Among the annotations included in the annotation data, select an annotation whose user information and input date and time stored in association with the annotation data storage unit match the user-specified conditions included in the input information input by the input unit Annotation selection means to
An image generation apparatus comprising: a thumbnail image generation unit configured to generate a thumbnail image with an annotation of the electronic document by superposition and synthesis using the electronic document and the selected annotation. Annotation analysis means for analyzing the shape, size and position of the annotation selected by the annotation selection means,
The annotation analysis means extracts the display area of the annotation by analyzing the shape, size and position of the annotation,
34. The image generation apparatus according to claim 33, wherein the thumbnail image generation unit generates a thumbnail image so that the display area of the annotation extracted by the annotation analysis unit is highlighted. And annotations is information added to the electronic document, the user information indicating the user who inputs the annotation, the computer having a storage means for storing annotation data comprising in association with the input date and time of the annotation,
A process of inputting input information including a designated condition designated by a user from an input device;
A process of selecting an annotation in which user information and input date and time stored in association with the storage unit are matched with a user-specified condition included in the input information, among annotations included in the annotation data;
An image generation program that executes processing for generating a thumbnail image with an annotation of the electronic document by superposition and synthesis using the electronic document and the selected annotation. On the computer,
Processing to extract the display area of the annotation by analyzing the shape, size and position of the selected annotation;
36. The image generation program according to claim 35, wherein a processing for generating a thumbnail image is executed so as to highlight the extracted display area of the annotation .

Images