JP5900204B2 - Document processing apparatus and program - Google Patents

Description

  The present invention relates to a document processing apparatus and a program.

  In Patent Document 1, when a document is photographed with a camera of a mobile phone, the photographed image is transmitted to a database, the document data is searched for the content close to the image in the database, and the document data is returned to the mobile phone. A system that displays a screen is disclosed.

  In Patent Document 2, position information obtained from GPS is added to image data photographed by a digital camera, and the name of the place where the image was photographed and its related information are obtained from the position information of the image data by a personal computer image management program. Disclosed is an image processing method that displays a URL (Uniform Resource Locator) of an Internet home page where information and files are stored, and allows the user to browse the home page and download necessary information and files according to user instructions. ing.

JP 2007-264992 A JP 2004-023449 A

  By the way, when a sales employee visits a customer, a paper document may be received from the customer, and such a paper document is digitized by a scanner or the like (internal document DB to which the sales employee belongs) ( Databases are often stored and managed. In this case, in order to search for a scanned document stored in the document DB, a sales employee or the like often sets attribute information such as a customer name for the scanned document.

  According to the present invention, attribute information corresponding to a document image can be associated with a document image using a paper document as electronic data by a scanning device or the like based on data relating to the activity of obtaining the paper document. With the goal.

  According to a first aspect of the present invention, there is provided a first document image obtained by generating an image of at least a part of the paper document with a first imaging device and the paper document. Compare the second document image generated by the second imaging device with more parts than the first document image, and determine a pair of the first document image and the second document image corresponding to each other. From the specifying means for specifying, the date and time extracting means for extracting image generation date and time information from the first document image included in the specified pair, and the schedule information of the activities registered in the schedule management system, the schedule Schedule search means for searching for schedule information similar in date and time to the extracted image generation date and time, and the specified pair based on the attribute value of a predetermined attribute attribute of interest included in the searched schedule information included A determination means for determining an assignment target attribute value to be assigned to the second document image, and a database that associates the second document image included in the identified pair with the determined assignment target attribute value. A document processing apparatus.

  According to a second aspect of the present invention, the determination means is a schedule corresponding to the image generation date and time of the first document image included in the specified pair in the schedule information searched by the schedule search means. The document processing according to claim 1, wherein when there is schedule information having a date and time, the attribute attribute item included in the schedule information having the corresponding scheduled date and time is determined as the attribute value to be assigned. Device.

  According to a third aspect of the present invention, the determination means is a schedule corresponding to the image generation date and time of the first document image included in the specified pair in the schedule information searched by the schedule search means. If there is no schedule information having a date and time, a selection list in which each searched schedule information is arranged in order of closeness of the scheduled date and time with respect to the image generation date and time is presented to the user for selection. The document processing apparatus according to claim 2, wherein the attention attribute item included in the schedule information selected from the list is determined as the assignment target attribute value.

  In the invention according to claim 4, the determination unit includes the attribute value as a value of the attention attribute item for each attribute value of the attention attribute item included in each schedule information searched by the schedule search unit. The first similarity between the scheduled date and time of the scheduled information and the extracted image generation date and time, and the second document image registered in the database in association with the attribute value and the specified pair included in the specified pair An evaluation value for the attribute value is calculated based on the second similarity with the first document image, and the assignment target attribute value is selected from the attribute values based on the calculated evaluation value. The document processing apparatus according to claim 1, wherein:

  According to a fifth aspect of the present invention, the determination means presents a selection list in which the attribute values are arranged in descending order of the evaluation values to the user, receives the selection, and selects the attribute value selected from the selection list by the user. The document processing apparatus according to claim 4, wherein the attribute value is determined as the attribute value to be assigned.

  The invention according to claim 6 further comprises authentication means for accepting input of the first document image or the second document image from the user when the authentication of the user is successful, the schedule search means, Among the schedule information registered in the schedule management system, the schedule information related to the user who has input the first document image or the second document image included in the pair specified by the specifying unit is targeted. The document processing apparatus according to claim 1, wherein the schedule information corresponding to the image generation date and time is searched.

  According to a seventh aspect of the present invention, there is provided a first document image obtained by generating an image of at least a part of a paper document with a first imaging device, and the paper document. Of the first document image and the second document image generated by the second imaging device with more portions than the first document image, and the first document image and the second document image corresponding to each other From the specifying means for specifying the pair of the date, the date and time extracting means for extracting the information of the image generation date and time from the first document image included in the specified pair, the schedule information of the activity registered in the schedule management system, Schedule search means for searching for schedule information whose schedule date and time is similar to the extracted image generation date and time, the identified pair based on the attribute value of a predetermined attribute attribute of interest included in the searched schedule information Determining means for determining an attribute value to be assigned to the second document image included in the second document image, associating the second document image included in the identified pair with the determined attribute value to be assigned This is a program for functioning as registration means for registering in the database.

  According to the invention according to claim 1 or 7, the attribute value of the document image can be associated according to the date / time information of the generated document image based on the data related to the activity of obtaining the paper document.

  According to the second aspect of the present invention, if the user follows the rule that the image of the original paper document of the second document image is taken within the time corresponding to the scheduled date and time, it corresponds to the second document image. The attribute value can be associated without the user specifying the attribute value.

  According to the third aspect of the present invention, when the first document image cannot be generated for the original paper document by the first imaging device within the time corresponding to the scheduled date and time, the user The operation of associating the attribute value with the second document image corresponding to the document can be supported.

  According to the fourth aspect of the present invention, the attribute value can be associated with the second document image using the similarity according to both the information based on the image generation date and the information of the image.

  According to the invention of claim 5, when the attribute value cannot be determined only by the evaluation value corresponding to both the information based on the image generation date and the information of the image, the user can assign the attribute value to the second document image. Can be supported.

  According to the invention of claim 6, even when schedule information of a plurality of users is registered in the schedule management system, the schedule information of the user corresponding to the second document image is obtained, and the attribute value of the schedule information Can be associated with the second document image.

1 is a diagram illustrating an example of a system configuration including a scanned document processing apparatus according to an embodiment. It is a figure for demonstrating an example of the schedule information registered into the scheduler. It is a figure which shows an example of the data of the acquisition origin attribute ("customer information") of each document file managed by document DB. It is a figure which shows an example of a structure of a photograph registration part. It is a figure which shows an example of the data memorize | stored in a photograph temporary storage part. It is a figure which shows an example of the data memorize | stored in a scanning document temporary storage part. It is a figure which shows an example of a structure of a scanning document registration process part. It is a figure which shows an example of the process sequence of a scanning document registration process part. It is a figure which shows the principal part of the modification of the process sequence of a scan document registration process part. It is a figure which shows the principal part of another modification of the process sequence of a scan document registration process part. It is a figure which shows the example of the procedure in the case of making an inquiry to a user in the procedure of FIG.

  The system shown in FIG. 1 includes a scanned document processing apparatus 10, a scheduler 20, a camera-equipped mobile terminal 30, a scanner 40, and a document DB 50. This system can be applied to objects of various scales, from individuals to organizations such as companies, but in the following, a case where it is introduced into a company will be described as a typical example. In this example, the devices other than the camera-equipped mobile terminal 30 are typically connected to a company internal network (for example, an intranet).

  The scheduler 20 is a system for managing the schedule (plan) of each employee (hereinafter referred to as “user”) belonging to a company. Each user registers schedule information in the scheduler 20 and browses the registered information, thereby confirming the schedule in advance and reviewing past actions. The schedule information registered in the scheduler 20 includes the ID of the user who registered the schedule, the date and time of the start and end of the schedule, and the visit destination (hereinafter also referred to as “customer”) visited in the schedule. The information shown is included. The information indicating the registered visit destination is typically at least identification information of the visit destination uniquely determined in the scheduler 20. For example, the scheduler 20 presents visit destination options on the schedule input screen, and the user selects a visit destination related to the schedule from the options, whereby the visit destination information is registered in the scheduler 20.

  FIG. 2 shows an example of data registered in the scheduler 20. This example shows a schedule for a certain day for a certain user (user ID “001”). One row of information in the figure is one piece of schedule information. The schedule information includes a “customer name” (namely, identification information of a visit destination), a visit start time (namely, a schedule start date and time), and a visit end time (schedule end date and time). In this example, the employee “001” is scheduled to visit three companies on March 12, 2012.

  The schedule information registered in the scheduler 20 may include identification information of participants who participate in the schedule (other than the user), memo information that is freely entered, and the like.

  The camera-equipped mobile terminal 30 is a terminal device having the function of a digital still camera, and for example, a smartphone or a camera-equipped mobile phone is a typical example. The camera-equipped mobile terminal 30 is an example of an imaging apparatus. Further, the camera-equipped mobile terminal 30 may be a digital camera itself. Here, the camera-equipped mobile terminal 30 stores information on the date and time of the shooting operation (hereinafter referred to as “shooting date and time”) obtained by the clock function of the terminal 30 in the image file obtained by the shooting operation by the camera function. (For example, in Exif format. Exif is an abbreviation of Exchangeable image file format). The digital photo image file obtained by photographing with the camera-equipped mobile terminal 30 is an example of a document image.

  The scanner 40 is a device that reads a paper document and converts it into electronic data. The scanner 40 is an example of an imaging device. The scanner 40 may be a read-only device, or may be a device such as a so-called digital multi-function device that also has functions such as printing in addition to reading. The scanner 40 is connected to an in-house network directly or via a connected personal computer (hereinafter abbreviated as “PC”). For example, the scanner 40 is used when a paper document obtained by a user at a visit is converted into electronic data. The scanner 40 collects image data of each page of a document composed of a plurality of pages read at once using an automatic document feeder or the like into one document file (for example, PDF format; PDF is an abbreviation of Portable Document Format). . The scanned document file generated by the scanning process by the scanner 40 is an example of a document image. A document file created by the scanner 40 (hereinafter referred to as “scanned document”) may be registered in the document DB 50 via the scanned document processing apparatus 10 for reuse or in-house shared use.

  The document DB 50 is a database that stores document files used in the company and is provided for use by each user. The document DB 50 organizes and stores registered document file groups according to an information organization structure such as a directory structure, and manages the access rights of each user to the saved document file groups, and from each user according to the access rights. Limit the use of document files.

  The document DB 50 manages attribute information of the document file in association with the registered document file. The attribute information includes one or more attribute items. Examples of the attribute item include, but are not limited to, creator, creation date / time, updater, update date / time, registrant, registration date / time, version, document type, document source, and the like. Further, the attribute information may not include all of the attribute items exemplified. The method of associating the attribute information with the document file is not particularly limited. For example, the attribute information may be distributed and managed for each document by integrating the attribute information with the document file (for example, the document file and the attribute information are combined into one file), and the document DB 50 may manage the attribute of each document file. Information may be centrally managed at the center. FIG. 3 shows an example of a management table of acquisition source attributes (that is, “customer information”) of each document file, which is centrally managed by the document DB 50. In this example, the identification information (customer company name or identification information) of the document file is registered in association with the identification information (“document ID”) of each document file.

  Alternatively, a compromise method may be used in which part of attribute information is centrally managed and another part is incorporated into each document file and distributedly managed. In some cases, the directory structure of the document DB 50 is made to correspond to a specific attribute item of the document file, and each document file is stored in a directory corresponding to the value of the specific attribute item. In this method, the value of the specific attribute item of the document file is represented by the directory where the document file is stored.

  The attribute information of each document file managed by the document DB 50 is used as, for example, a key for searching for a document file.

  When the scanned document read by the scanner 40 is registered in the document DB 50, the scanned document processing apparatus 10 executes a process for adding attribute information to the scanned document. In particular, in this embodiment, an attribute assignment process using information registered in the scheduler 20 is executed. An example of the attribute to be added is information on the source of obtaining the scanned document (for example, the customer company when the document is obtained at the customer company that visited).

  The scan document processing apparatus 10 uses the photographing time information in the photograph image file photographed by the user's camera-equipped mobile terminal 30 in order to assign an attribute using the information of the scheduler 20. That is, in this embodiment, when a user obtains a paper material at a place of visit, a representative page (for example, the first page) of the paper material during the visit or immediately after the visit is completed. ) With the camera-equipped mobile terminal 30. Information on the shooting date and time is incorporated in the file of the photographed photograph image. If the photographic image file is passed to the scanned document processing apparatus 10, the scanned document processing apparatus 10 selects a scanned document having a page similar in content to the photographic image from the scanned document group input from the scanner 40 or the like. At the same time, the schedule information corresponding to the shooting date and time in the photo image file is searched from the schedule information of the user registered in the scheduler 20, and the information on the visit destination is acquired from the schedule information. Then, the found scanned document is registered in the document DB 50 while giving the acquired visitor information as an acquisition source attribute.

  The scan document processing apparatus 10 includes a user authentication unit 11, a photo registration unit 12, a photo temporary storage unit 14, a scan document temporary storage unit 16, and a scan document registration processing unit 18.

  The user authentication unit 11 is existing or will be developed for a user who wants to input a photographic image file photographed by the camera-equipped mobile terminal 30 and a scanned document created by the scanner 40 reading a paper document. User authentication is performed using a user authentication technique. By this user authentication, identification information (user ID) of the user is specified. The scanned document processing apparatus 10 permits the input of the photographic image file and the scanned document only after the user authentication is successful.

  The photo registration unit 12 is means for receiving registration of a photo image file. The photographic image file can be acquired directly from the camera-equipped mobile terminal 30 (for example, via a wireless communication network) or another device (for example, the photographer's file) that has received the photographic image file from the camera-equipped mobile terminal 30. From the PC) to the photo registration unit 12. The photo registration unit 12 is implemented, for example, in the form of a web service. In this example, the URL of the web service (which may be set in advance in the terminal 30 or the like) is accessed from the camera-equipped mobile terminal 30 or the PC, and the photo image file is sent to the web service. Note that user authentication by the user authentication unit 11 is performed at the time of this access, and the photo registration unit 12 accepts input of a photo image file only when the authentication is successful. The photo registration unit 12 registers the input photo image file in the photo temporary storage unit 14 in association with the user ID of the transmission source user specified by the user authentication.

  FIG. 4 shows an example of the internal configuration of the photo registration unit 12. In this example, the photo registration unit 12 includes a user ID acquisition unit 122 and a photo storage processing unit 124. When there is a registration request of the photo image file 100 from the camera-equipped mobile terminal 30 or the like to the photo registration unit 12, login information 110 (for example, a combination of a user ID and a password) sent from the mobile terminal 30 or the like for the request. The user authentication unit 11 performs user authentication processing using If the user authentication is successful, the photo registration unit 12 receives an input of the photo image file 100 from the portable terminal 30 or the like. In this case, the user ID acquisition unit 122 of the photo registration unit 12 acquires the user ID of the transmission source user from the user authentication unit 11. Then, the photo storage processing unit 124 registers the user ID in the temporary photo storage unit 14 in association with the photo image file 100 input from the mobile terminal 30 or the like.

  The photo temporary storage unit 14 is a device for temporarily storing an input photo image file. In this embodiment, a photograph image of a paper document that has been obtained or a scan document corresponding to the paper document may be input to the scan document processing apparatus 10 at any timing, so that the photograph image that is input at any time is input. A photo image file and a scan document derived from the same paper document are stored in the photo temporary storage unit 14 and collated with a scan document group that is similarly input at any time and stored in the scan document temporary storage unit 16. The configuration of specifying a pair of is adopted. That is, in the present embodiment, there is no operational restriction such as inputting a photographic image file and a scanned document simultaneously through one interface.

  FIG. 5 shows an example of data stored in the temporary photo storage unit 14. In this example, the ID of the photographer of the photograph image file (that is, the user who inputs the image file to the apparatus 10) is stored in association with the ID of the stored photograph image file. Each photo image file is stored in association with the photo image file ID.

  Returning to the description of FIG. 1, the scan document temporary storage unit 16 temporarily stores the scan document input from the scanner 40 or the like. When this scan document input request is made, the user authentication unit 11 authenticates the requesting user, and accepts the input of the scan document when the authentication is successful. The input scanned document is stored in the scanned document temporary storage unit 16 in association with the user ID of the input person found by the authentication (see FIG. 6).

  The scanned document registration processing unit 18 registers each scanned document stored in the scanned document temporary storage unit 16 in the document DB 18 with an attribute such as an acquisition source of the document obtained from the scheduler 20. An example of the functional configuration of the scanned document registration processing unit 18 is shown in FIG.

  The user identification unit 181 of the scanned document registration processing unit 18 illustrated in FIG. 7 obtains the user ID 115 corresponding to the photo image file 100 extracted from the temporary photo storage unit 14. The date / time information detection unit 182 detects the value of the shooting date / time included in the photo image file 100.

  The matching processing unit 184 performs matching (association) between each photo image file 100 in the photo temporary storage unit 14 and each scan document 200 in the scan document temporary storage unit 16. That is, by comparing a photographic image of each photographic image file 100 with, for example, a representative page image of each scanned document 200, it is derived from the same paper document (that is, obtained by photographing and scanning the same paper document). A pair of the photographic image file 100 and the scanned document 200 is obtained. For example, if a specific page such as the first page of a document is set as a representative page, and a rule such as shooting a representative page of a paper document received by a user from a visited site with the camera-equipped mobile terminal 30, a photo is obtained. The scanned document corresponding to the photographic image is determined by comparing the image with the image of the representative page of each scanned document. Matching between a photographic image and an image of a scanned document may be performed using an existing or future matching technique. Note that the photographic image may be compared with the images of all the pages in each scanned document without defining the representative page, but the representative page is determined from the viewpoint of search time and accuracy. Better.

  The scheduler search unit 186 searches the scheduler 20 using the shooting date and time of the photo image file 100 detected by the date and time information detection unit 182 and the user ID of the input person of the photo image file 100 identified by the user identification unit 181 as keys. To do. That is, the scheduler 20 searches for schedule information corresponding to the shooting date and time of the input person. Here, the “schedule information corresponding to the shooting date / time” is, in principle, schedule information including the shooting date / time within the scheduled time, that is, the time from the scheduled start date / time to the scheduled end date / time. However, it is likely that the paper material received during the scheduled visit will not be taken, and will often be taken after the visit. Therefore, in practice, the preset allowable time should be added after the scheduled time. The time corresponding to the schedule information may be set as the time, and if the shooting date and time of a certain photographic image is within the corresponding time, it may be determined that the photographic image corresponds to the schedule information. Further, an allowable time may be provided before and after the scheduled time.

  In the present embodiment, the schedule information searched in this way is considered to represent an event that the paper document that is the source of the photographic image and the scanned document is visited, and the attribute included in the schedule information Information is given to the scanned document. For this attribute assignment, the attribute extraction unit 188 extracts a value of an attribute item that is predetermined as an assignment target from the searched schedule information. The attribute item to be given is, for example, identification information of a visit destination (“customer”), and this information is used as an acquisition source attribute (“customer information”) of the scanned document. Note that this is only an example, and the value of an attribute item other than the visit destination included in the schedule information (for example, participant, schedule type (meeting or business negotiation)) is extracted as the attribute item to be given. Also good. The number of attribute items to be extracted is not limited to one and may be plural.

  The registration unit 189 adds the value of the attribute attribute item to be added extracted from the schedule information obtained by searching the scan document corresponding to the photographic image obtained by the matching processing unit 184 based on the shooting date and time of the photographic image. Register with. The attribute item value is assigned to the scanned document in accordance with the management method of the attribute item in the document DB 50. For example, when the document DB 50 employs a method of storing a document file in a directory corresponding to the attribute item value, the registration unit 189 corresponds to the extracted attribute item value in the document DB 50. Register the scanned document in the directory. If the value of the attribute item is centrally managed, the registration unit 189 registers the ID of the scanned document and the value of the attribute item in a table that manages the attribute item in the document DB 50. To do.

  Next, an example of the processing procedure of the scanned document registration processing unit 18 will be described with reference to FIG. In this procedure, the matching processing unit 184 determines whether there is a scanned document in the scanned document temporary storage unit 16 (S10), and if there is one, extracts one of them (S12). Next, the photograph temporary storage unit 14 is searched for a photographic image similar to the image (for example, the image of the representative page) of the scanned document taken out (S14). In this step, for example, the user ID of the input person of the scanned document may be obtained from the scanned document temporary storage unit 16, and the photographic images to be compared may be narrowed down based on the user ID. In one example, a photographic image similar to the scanned document image is searched from only photographic images input by the same person as the input person of the scanned document. If a similar photographic image is not found (for example, because the photographic image upload is delayed) (No in S16), the scanned document retrieved in S10 is returned to the scanned document temporary storage unit 16 (S18). Return to S10. Here, the returned scanned document may be controlled so that it is not selected again for the matching process in S10 for a predetermined time.

  If a similar photographic image is found in S16, the photographic image and the scanned document taken out in S12 form a pair corresponding to each other.

  Next, the user identification unit 181 and the date / time information detection unit 182 specify the photographer and the shooting date / time of the photographic image in the pair (S20). Then, the scheduler search unit 186 searches the scheduler search unit 186 using the photographer's user ID and shooting date and time as keys, and obtains schedule information corresponding to the shooting date and time among the shooting person schedule information (S22). In S22, the schedule information of the input person who inputs the scanned document to the scanned document processing apparatus 10 may be included in the search target instead of the photographer or in addition to the photographer. Further, not only the schedule information of the photographer or the input person but also schedule information of another person who includes the photographer or the input person in the “participant” attribute may be included in the search target.

  Next, the attribute extraction unit 188 extracts the value of the attribute item to be granted (for example, “customer information” of the visited site) from the searched schedule information (S24), and the registration unit 189 selects the scanned document as the attribute. It is registered in the document DB 50 in association with the item value (S26). After this registration, the scanned document and the similar photo image searched in S14 are deleted from the scanned document temporary storage unit 16 and the temporary photo storage unit 14. In addition, a notification that the scanned document is registered in the document DB 50 may be sent to the photographer (and the input person of the scanned document) by using e-mail, for example (S28). In this notification, for example, when the attribute value automatically given is wrong by displaying the attribute value given to the scanned document or including the link to the scanned document in the document DB 50 The change operation may be made easier.

  In the example of FIG. 8, processing is performed using the scanned document in the scanned document temporary storage unit 16 as a reference, but similar processing may be executed using the photographic image in the temporary photo storage unit 14 as a reference. Moreover, you may use both of them together.

  In addition, when a photographic image file or a scanned document is input to the scanned document processing apparatus 10, the processing from S12 onward may be executed for the input photographic image file or scanned document.

  Further, in the above example, “visit destination” among the attributes of the schedule information registered in the scheduler 20 is the attribute to be assigned to the scanned document, but this is merely an example. Attributes other than “visit destination” may be set as attributes to be given. Further, a plurality of attributes among the attributes of the schedule information may be set as the assignment target attributes.

  The procedure of FIG. 8 is performed when a user takes a picture of a paper document obtained in the schedule within a predetermined allowable time with respect to the schedule registered in the scheduler 20 (photograph image to the scanned document processing apparatus 10). The upload is valid after the allowable time has elapsed. However, for some reason, the user may not be able to register a photo of the paper document within the allowable time according to the rules. A modification considering such a case will be described below.

  The processing procedure of the modification shown in FIG. 9 replaces S24 and S26 in the procedure of FIG. As a premise of this procedure, the scheduler search unit 186 includes schedule information related to the input person of the photographic image or the scanned document in the pair identified in S16 (the input information of the input person himself / herself or the input person as a participant). It is assumed that some schedule information having a schedule time similar (that is, “close”) to the shooting date and time of the photographic image is searched from the schedule information. For example, all the schedule information having a scheduled time included in a predetermined time range based on the shooting date and time (for example, “same date as shooting date” or “3 hours before and after the shooting date”) is obtained. Alternatively, a predetermined number of schedule information is obtained from the schedule information in order of the scheduled time closest to the shooting date and time.

  In the procedure of FIG. 9, the registration unit 189 of the scanned document processing apparatus 10 includes schedule information (corresponding to the shooting date and time of the photographic image in the pair identified in S <b> 16 in the schedule information group searched by the scheduler search unit 186. That is, it is determined whether or not “scheduled time + allowable time” includes schedule information including the shooting date and time (S30). If there is such schedule information (the determination result of S30 is Yes), the registration unit 189 sets the attribute value of the attribute attribute item of interest in the schedule information as the attribute value to be added to the scanned document in the pair. The determination is made (S32), and the scanned document is associated with the assignment target attribute value and registered in the document DB 50 (S42).

  On the other hand, when the determination result in S30 is negative (No), the registration unit 189 creates a list in which the schedule information searched by the scheduler search unit 186 is ranked and arranged in order of close to the shooting date and time. A web page for selection including a list is generated (S34). The web page includes photographic images and / or scanned documents in the pair. Then, an e-mail including the URL of the web page for selection is transmitted to the photographer of the photographic image (or the input person of the scanned document in the pair) (S36), and the photographer and the like are listed in the webpage. From this, it waits to select the schedule information corresponding to the pair (S38). When the selection result on the web page is sent from the photographer or the like, the registration unit 189 determines the attribute value of the attention attribute item in the selected schedule information as the assignment target attribute value (S40). The scanned document is registered in the document DB 50 in association with the assignment target attribute value (S42).

  FIG. 9 always asks for the user's judgment when the assignment target attribute value cannot be determined only by the shooting time. On the other hand, FIG. 10 shows an example of processing aiming at automatic determination as much as possible by considering the attribute value of the target attribute item attached to the already registered similar scan document. The processing procedure of the modification shown in FIG. 10 replaces S24 and S26 in the procedure of FIG. The premise of the procedure of FIG. 10 is the same as that of FIG.

  In the procedure of FIG. 10, the registration unit 189 performs the processing of S50 to S54 for each attribute value of the attention attribute item of each schedule information searched by the scheduler search unit 186. For example, if three schedule information items are searched and the attribute values of the attention attribute item “visit destination” of each schedule information item are “Company A”, “Company B”, and “Company C”, respectively, the attribute values “A” The processes of S50 to S54 are performed for each of “Company”, “Company B”, and “Company C”.

  That is, the registration unit 189 calculates the similarity (referred to as “time similarity”) between the scheduled time of the schedule information including the attribute value and the shooting date and time of the photographic image (S50). The time similarity is determined so as to increase as the scheduled time approaches the shooting date and time. Also, the registration unit 189 searches the scanned document registered in the document DB 50 for the scanned document to which the attribute value is assigned, and searches the scanned document image (for example, the image of the representative page), the photographic image, and the like. The similarity (referred to as “image similarity”) is calculated (S52). Then, the registration unit 189 calculates an evaluation value indicating the degree of matching of the attribute value with respect to the scanned document in the pair by integrating the temporal similarity and the image similarity (S54). The method of calculating the evaluation value from the time similarity and the image similarity is not particularly limited, and for example, addition of both or multiplication of both may be used.

  When the evaluation value is obtained for each attribute value in this way, the attribute value to be assigned is determined from the attribute values based on the evaluation value (S56). In a simple example, the attribute value having the highest evaluation value may be determined as the assignment target attribute value.

  In addition, in order to reduce erroneous determination as much as possible, a user (photographer or the like) may be asked for when there is not much difference between the higher evaluation values. That is, in this example, if the difference between the highest evaluation value and the next highest evaluation value is greater than or equal to a predetermined threshold value, the attribute value having the highest evaluation value is determined as the assignment target attribute value. On the other hand, when another evaluation value exists within a range within the threshold when viewed from the highest evaluation value, the procedure of FIG. 11 is executed. In the procedure of FIG. 11, the registration unit 189 ranks the attribute values corresponding to the highest evaluation value and the attribute values corresponding to another evaluation value that is within the threshold from then on in order from the highest evaluation value. And a web page for selection including the list is generated (S560). Then, an e-mail including the URL of the web page for selection is transmitted to the photographer of the photographic image (or the input person of the scanned document in the pair) (S562), and notification of the selection result from the photographer or the like is sent. Wait (S564). When the photographer or the like selects an attribute value corresponding to a photographic image or the like from the list displayed on the web page and returns the selection result, the registration unit 189 returns the attribute of the attention attribute item in the selected schedule information. The value is determined to be a grant target attribute value (S566).

  The registration unit 189 registers the scanned document in the document DB 50 while assigning the assignment target attribute value determined as described above (S56).

  The embodiment and the modification shown above are examples in the case where the present invention is applied to an organization including a plurality of individuals such as companies, but the present invention is not limited to such an organization and may be applied to individuals. Applicable. When applying to an individual, there is no need to perform a process of narrowing down in consideration of who the uploaded photographic image, scanned document, and schedule information in the scheduler 20 belongs.

The scan document processing apparatus exemplified above is realized, for example, by causing a general-purpose computer to execute a program representing the processing of each functional module described above. Here, the computer includes, as hardware, a microprocessor such as a CPU, a memory (primary storage) such as a random access memory (RAM) and a read only memory (ROM), an HDD controller that controls an HDD (hard disk drive), Various I / O (input / output) interfaces, network interfaces that perform control for connection to a network such as a local area network, and the like have a circuit configuration connected via a bus, for example. Also, portable non-volatile recording of various standards such as a disk drive and a flash memory for reading and / or writing to a portable disk recording medium such as a CD or a DVD via the I / O interface, for example. A memory reader / writer for reading from and / or writing to a medium may be connected. A program in which the processing contents of each functional module exemplified above are described is stored in a fixed storage device such as a hard disk drive via a recording medium such as a CD or DVD, or via a communication means such as a network, and stored in a computer. Installed. The program stored in the fixed storage device is read into the RAM and executed by a microprocessor such as a CPU, thereby realizing the functional module group exemplified above. In addition, the constituent elements of the scanned document processing apparatus exemplified above are distributed and implemented on a plurality of computers that can communicate with each other via a network, and these distributed constituent elements communicate with each other via a network. Thus, the functions of the above-described scanned document processing apparatus may be realized.
In the above example, the portable terminal 30 with a camera is used as the “first imaging device” and the scanner 40 is used as the “second imaging device”, but this is only an example. For example, the “first imaging device” has the date and time when image generation (for example, shooting) is performed for at least a part of a paper document, for example, as attribute information in the generated image (that is, “first document image”). Any device that can do so may be used. Whereas the “first imaging device” generates an image of a representative part (for example, a display page) of a paper document, the “second imaging device” should store the paper document. Any page may be used as long as the page of the portion (including the “representative part” and more than the “representative part”) is converted into image data.

10 Scan Document Processing Device, 11 User Authentication Unit, 12 Photo Registration Unit, 14 Photo Temporary Storage Unit, 16 Scan Document Temporary Storage Unit, 18 Scan Document Registration Processing Unit, 20 Scheduler, 30 Mobile Terminal with Camera, 40 Scanner, 50 Document DB, 100 photo image file, 110 login information, 122 user ID acquisition unit, 124 photo storage processing unit, 181 user identification unit, 182 date and time information detection unit, 184 matching processing unit, 186 scheduler search unit, 188 attribute extraction unit, 189 Registration unit, 200 scanned documents.

Claims (7)

For a paper document composed of at least one sheet, a first document image in which at least a part of the paper document is generated by the first imaging device and more than the first document image among the paper documents And a second document image generated by the second imaging device, and specifying means for identifying a pair of the first document image and the second document image corresponding to each other,
A date and time extraction means for extracting information on the image generation date and time from the first document image included in the identified pair;
Schedule search means for searching for schedule information whose schedule date and time is similar to the extracted image generation date and time from among schedule information of activities registered in the schedule management system;
Determination means for determining an attribute value to be assigned to be added to the second document image included in the identified pair based on an attribute value of a predetermined attribute attribute of interest included in the searched schedule information; ,
Registration means for registering the second document image included in the identified pair in a database in association with the determined attribute value to be assigned;
A document processing apparatus comprising:   In the case where there is schedule information having a schedule date and time corresponding to the image generation date and time of the first document image included in the specified pair in the schedule information searched by the schedule search means. The document processing apparatus according to claim 1, wherein the target attribute item included in the schedule information having the corresponding scheduled date and time is determined as the assignment target attribute value.   In the case where there is no schedule information having a scheduled date and time corresponding to the image generation date and time of the first document image included in the specified pair in the schedule information searched by the schedule searching unit. Presents a selection list in which the retrieved schedule information is arranged in the order of closeness of the scheduled date and time with respect to the image generation date and time, and is selected and included in the schedule information selected by the user from the selection list. The document processing apparatus according to claim 2, wherein the attention attribute item to be determined is determined to be the attribute attribute value to be assigned. The determination means includes
For each attribute value of the attention attribute item included in each schedule information searched by the schedule search means, the scheduled date and time of the schedule information including the attribute value as the value of the attention attribute item and the extracted image generation date and time A second similarity between the second document image registered in the database in association with the attribute value and the first document image included in the identified pair; On the basis of the evaluation value for the attribute value, and based on the calculated evaluation value, select the grant target attribute value from the attribute value,
The document processing apparatus according to claim 1.   The determination means presents a selection list in which the attribute values are arranged in descending order of the evaluation value to the user, receives the selection, and determines the attribute value selected from the selection list by the user as the assignment target attribute value. The document processing apparatus according to claim 4, wherein: An authentication unit that receives an input of the first document image or the second document image from the user when the user authentication is successful;
The schedule search means relates to a user who has input the first document image or the second document image included in the pair specified by the specification means among the schedule information registered in the schedule management system. For the schedule information, search for schedule information corresponding to the image generation date and time,
The document processing apparatus according to claim 1, wherein the document processing apparatus is a document processing apparatus. Computer
For a paper document composed of at least one sheet, a first document image in which at least a part of the paper document is generated by the first imaging device and more than the first document image among the paper documents A specifying means for comparing the first document image and the second document image corresponding to each other by comparing a portion of the second document image generated by the second imaging device
A date and time extraction means for extracting information on the date and time of image generation from the first document image included in the identified pair;
Schedule search means for searching for schedule information whose schedule date and time is similar to the extracted image generation date and time from schedule information of activities registered in the schedule management system;
A determination unit for determining an assignment target attribute value to be assigned to the second document image included in the identified pair, based on an attribute value of a predetermined attribute attribute of interest included in the searched schedule information;
Registration means for registering the second document image included in the identified pair in a database in association with the determined attribute value to be assigned;
Program to function as.

Images