JP2012108720A - Information processing apparatus, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire proper photographed data on a document.SOLUTION: An information processing apparatus according to an embodiment comprises: a storage device storing size data in which a type of a document and aspect ratio data on the document in image data with a proper positional relation between a photographing unit and the document are associated with each other; acquisition means for acquiring the image data generated by photographing the document by the photographing unit and storing the image data in the storage device; size identifying means for reading the size data and identifying aspect ratio data closest to the ratio of edges of the document detected by the image data; and preview means for displaying the image data acquired by the acquisition means and displaying an ideal frame showing a position of the document with a proper positional relation between the photographing unit and the document based on the aspect ratio identified by the size identifying means.

Description

  Embodiments described herein relate generally to an information processing apparatus, method, and program for processing image data obtained by photographing a document.

  With recent development of information processing apparatuses, downsizing and high performance are remarkable. Along with this, sales representatives such as insurance companies carry information processing devices such as notebook personal computers to visit customers and increase their opportunities to work.

  For example, a sales representative may enter data into a laptop computer he / she carries based on documents such as an application completed by a customer, take the documents, convert them to electronic data, and store them as evidence data. It is done. Here, when the electronic data obtained by photographing the document is stored, it is preferable that the electronic data is stored in front of the customer in order to obtain the customer's consent to store it as evidence data. Moreover, it is preferable that it can be confirmed in real time that the image quality is provided as evidence data such as character readability.

  In order for the sales person to confirm in real time that the conditions required for the evidence data, such as character readability, are provided, it is necessary for the customer to capture an image. Moreover, in order to ensure the readability of the image acquired as such, it is necessary to have a mechanism that can always shoot with an image quality of a certain level or higher.

JP 2004-213215 A

  However, it is difficult to acquire photographing data having conditions required for evidence data by the conventional technique.

  To provide an information processing apparatus, method, and program capable of acquiring photographing data of appropriate documents.

  The information processing apparatus according to the embodiment includes a storage device that stores size data in which the type of document and the aspect ratio data of the document in the image data when the positional relationship between the photographing unit and the document is appropriate, and The image capturing unit acquires the image data generated by capturing the document and stores it in the storage device, and the aspect ratio data closest to the ratio of the edge of the document detected from the image data by reading the size data The size specifying means for specifying the image and the image data acquired by the acquiring means are displayed, and the document when the positional relationship between the photographing unit and the document is appropriate based on the aspect ratio data specified by the size specifying means Preview means for displaying an ideal frame indicating the position of the image.

It is a figure explaining the external appearance of the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining signs that the information processor concerning a 1st embodiment photographs a document. It is a hardware block diagram of the information processing apparatus which concerns on 1st Embodiment. It is a functional block diagram of the information processor concerning a 1st embodiment. It is a figure explaining an example of a data structure and data of size data of an information processor concerning a 1st embodiment. It is a flowchart explaining the process of the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining the process of correction | amendment of the image data of the information processing apparatus which concerns on 1st Embodiment. It is a figure explaining a mode that the information processor concerning a 2nd embodiment photographs a document. (Part 1) It is a figure explaining a mode that the information processor concerning a 2nd embodiment photographs a document. (Part 2) It is a figure explaining a mode that the information processor concerning a 2nd embodiment photographs a document. (Part 3) It is a figure explaining an example of a data structure and data of size data of an information processor concerning a 2nd embodiment. It is a functional block diagram of the information processing apparatus which concerns on 3rd Embodiment. It is a figure explaining the example of the screen which the information processing apparatus which concerns on 3rd Embodiment displays. It is a flowchart explaining the process of the information processing apparatus which concerns on 3rd Embodiment.

  Next, embodiments will be described with reference to the drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

(First embodiment)
The information processing apparatus 1 according to the first embodiment processes image data obtained by photographing a document. The information processing apparatus 1 is, for example, a tablet computer (slate PC) as shown in FIG. The surface of the information processing apparatus 1 according to the first embodiment includes a display unit 105 as illustrated in FIG. Moreover, the back surface opposite to the surface provided with the display unit 105 includes a photographing unit 121 as shown in FIG. The display unit 105 of the information processing apparatus 1 includes a touch panel. A keyboard and buttons are displayed on the display unit 105 by software executed by the information processing apparatus 1. The user can input an instruction to the information processing apparatus 1 by touching the displayed keyboard or button. Further, a keyboard or mouse may be connected to the information processing apparatus 1, and a button for inputting an instruction may be provided on the housing of the information processing apparatus 1.

  A case where the information processing apparatus 1 captures the document 3 will be described. As shown in FIG. 2, the document 3 is set on a table such as a desk. For example, the user holds the information processing apparatus 1 with both hands, points the photographing unit 121 of the information processing apparatus 1 toward the document 3, and photographs from the top of the document 3. Here, on the display unit 105 of the information processing apparatus 1, image data of the document 3 photographed by the photographing unit 121 is sequentially displayed as a preview and an ideal frame 51 is displayed. In FIG. 2, the document 3 is rectangular. Since the document 3 is photographed from above, the document 3 is displayed on the display unit 105 as a rectangular document unit 52. Since the display unit 105 of the information processing apparatus 1 is located on the user side, the user can adjust the positional relationship between the document 3 and the information processing apparatus 1 while confirming that the image is captured on the display unit 105.

  The ideal frame 51 indicates on the display unit 105 the position of the document 3 on the display unit 105 when the positional relationship between the photographing unit 121 and the document 3 is appropriate in the image data. Since the image data is sequentially previewed on the display unit 105, the user looks at the display unit 105 and positions the information processing apparatus 1 so that the document unit 52 displayed on the display unit 105 fits the ideal frame 51. Adjust. Here, “when the positional relationship is appropriate” between the photographing unit 121 and the document 3 is, for example, a positional relationship where image data having image quality as the evidence data can be photographed when the document 3 is stored as evidence data. Say there is. In the first embodiment, this positional relationship depends on the angle and distance between the document 3 and the information processing apparatus 1. The appropriate positional relationship may be different depending on the purpose of the information processing apparatus 1 storing the image data of the document 3.

  In the example shown in FIG. 2, the ideal frame 51 has a shape that surrounds the document part 52 to be previewed on the display unit 105 when the positional relationship between the photographing unit 121 and the document 3 is appropriate. The shape of the ideal frame 51 is not limited to the shape surrounding the document part 52, and for example, a shape in which a marker on the “L” character is applied to the corner of the document part 52 can be considered.

  As shown in FIG. 3, the information processing apparatus 1 according to the first embodiment includes a central processing control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an input / output interface 109, and image data generation. The unit 123 is connected via the bus 110. An input device 104, a display unit 105, a communication control device 106, a storage device 107, and a removable disk 108 are connected to the input / output interface 109. The image data generation unit 123 is connected to the first imaging unit 121 and the second imaging unit.

  The photographing unit 121 is a CCD, for example, and converts the light received from the document 3 into an electrical signal. The imaging unit 121 inputs an electrical signal to the image data generation unit 122. The imaging unit 121 is, for example, a CCD that is fixed to the information processing apparatus 1 and built in.

  For example, the imaging unit 121 may be a camera that can be fixed to the information processing apparatus 1 and can be connected via a USB port or the like. Here, “fixable” means that the information processing apparatus 1 and the photographing unit 121 are configured by different hardware, and the photographing unit 121 is attached to the information processing apparatus 1 in a state where it can be removed by a connecting member such as a hook. Says that it can be fixed. In this case, the photographing unit 121 inputs image data to the central processing control apparatus 101 via an external interface such as a USB port.

  The image data generation unit 122 is a circuit that converts the electrical signal received from the imaging unit 121 into image data and sends the image data to the bus 110. In the image data generation unit 122 according to the first embodiment, the image data generation unit 122 may be implemented by a circuit board or a software program.

  The central processing control apparatus 101 reads out and executes a boot program for starting up the information processing apparatus 1 from the ROM 102 based on an input signal from the input apparatus 104, and further reads out an operating system stored in the storage apparatus 107. Further, the central processing control device 101 controls various devices based on input signals from the input device 104, the communication control device 106, etc., and reads programs and data stored in the RAM 103, the storage device 107, etc. into the RAM 103. A processing device that loads and implements a series of processing described later, such as data calculation or processing, based on a program command read from the RAM 103.

  The input device 104 includes input devices such as a keyboard 104a and a mouse 104b through which an operator inputs various operations. The input device 104 generates an input signal based on the operation of the operator, and connects the input / output interface 109 and the bus 110. To the central processing control apparatus 101.

  The display unit 105 is a liquid crystal display, for example. The display unit 105 receives an output signal to be displayed on the display unit 105 from the central processing control device 101 via the bus 110 and the input / output interface 109, and displays the processing result of the central processing control device 101, for example. The display unit 105 of the information processing apparatus 1 according to the first embodiment is provided with a touch panel 105a, and an input signal is transmitted to the central processing control device 101 when the user touches the screen of the display unit 105. be able to.

  The communication control device 106 is a device such as a LAN card, a modem, or an antenna, and is a device that connects the information processing device 1 to a communication network such as the Internet, a LAN, or a mobile phone network. Data transmitted / received to / from the communication network via the communication control device 106 is transmitted / received to / from the central processing control device 101 via the input / output interface 109 and the bus 110 as an input signal or an output signal.

  The storage device 107 is a semiconductor storage device or a magnetic disk device, and stores programs and data executed by the central processing control device 101. The removable disk 108 is an optical disk or a flexible disk, and signals read / written by the disk drive are transmitted / received to / from the central processing control apparatus 101 via the input / output interface 109 and the bus 110.

  An information processing program is stored in the storage device 107 of the information processing apparatus 1 according to the first embodiment. As illustrated in FIG. 4, the storage device 107 includes an image data storage unit 11, a size data storage unit 12, An ideal frame data storage unit 13 and a saved image data storage unit 14 are provided. In addition, the information processing program is read and executed by the central processing control device 101 of the information processing apparatus 1, whereby the acquisition unit 21, the size specifying unit 22, the preview unit 23, and the storage unit 25 are mounted on the information processing device 1. .

  The image data storage unit 11 is a storage area in which the image data 11 a generated by the photographing unit 121 and the image data generation unit 122 is stored in the storage device 107. The image data 11a is sequentially input by the photographing unit 121 and the acquisition unit 21.

  The size data storage unit 12 is a storage area in the storage device 107 in which the size data 12a is stored. The size data 12a is data in which the document type is associated with the aspect ratio data of the document in the image data when the positional relationship between the photographing unit 121 and the document 3 is appropriate. The size data 12a includes the type of the document 3 that the information processing apparatus 1 according to the first embodiment needs to store as evidence data, and the aspect ratio data. Here, the aspect ratio data is data of a ratio between the vertical direction and the horizontal direction of the document 3. As shown in FIG. 2, in the first embodiment, the longitudinal direction of the display unit 105 is the horizontal direction, but may vary depending on the position of the imaging unit 121 and the imaging method.

  The size data 12a includes, for example, the data structure and data example shown in FIG. As the document type, the type of the document 3 stored in the information processing apparatus 1 is listed. Furthermore, the aspect ratio of each document is associated with the type of each document 3. In the example shown in FIG. 5, the size of the document 3 is included, but the size of the document 3 may not be included.

  The ideal frame data storage unit 13 is a storage area in the storage device 107 in which ideal frame data 13a is stored. The ideal frame data 13a is data indicating the position of the document 3 when the positional relationship between the photographing unit 121 and the document 3 is appropriate. The ideal frame data 13 a may include data on the display position of the ideal frame 51 displayed on the display unit 105 and data on the coordinate positions of the corners of the ideal frame 51. The ideal frame data 13a is referred to when an ideal frame 51 is displayed on the display unit 105 in an ideal frame drawing unit 24, which will be described later, or when compared with the position of the document unit 52 in the storage unit 25.

  For example, since the document 3 types A4 and B5 have the same aspect ratio, the same ideal frame can be applied even if the document 3 types are different. Therefore, in the first embodiment, the ideal frame data 13a includes data indicating the position of the document 3. The data indicating the position of the document 3 may be set for each type of the document 3, or the document 3 It may be set for every aspect ratio of 3.

  The saved image data storage unit 14 is a storage area in which stored image data 14 a is stored in the storage device 107. The saved image data 14a is image data of any of the plurality of image data 11a stored in the image data storage unit 11, and is image data processed by the saving unit 25 described later. Specifically, when the storage unit 25 detects the timing at which the difference between the edge of the document section 52 and the ideal frame 51 shown in FIG. 2 falls within a predetermined value, the image data 11a at that time is corrected. The stored image data 13a is stored in the stored image data storage unit 13.

  The obtaining unit 21 obtains image data generated by the photographing unit 121 photographing the document 3 and stores the image data in the storage device 107. The acquisition unit 21 acquires the image data 11 a generated by the image data generation unit 122 based on the electrical signal captured by the imaging unit 121 and stores the acquired image data 11 a in the image data storage unit 11. The acquisition unit 21 sequentially stores the image data input from the photographing unit 121 in the image data storage unit 11 and is displayed on the display unit 105 like a moving image by the preview unit 23 previewing.

  The size specifying means 22 reads the size data 12a, and specifies the aspect ratio data closest to the ratio of the edges of the document 3 detected from the image data 11a. First, the size specifying unit 22 detects the edge of the document 3 in order to specify the photographing unit 52 that is a portion where the document 3 is photographed from the image data 11a. For example, the size specifying unit 22 detects a portion having a large color tone change rate in the image data 11 a as an edge portion of the document 3. Further, when the color of the document 3 or the color of the desk on which the document 3 is installed is known in advance, the edge detection unit 23 may detect the boundary of each color from the image data 11a and use it as the edge of the document 3. . Next, the size specifying unit 22 calculates the length of at least two adjacent edges of the document portion of the image data 11a. The size specifying means 22 extracts the document type associated with the aspect ratio data closest to the ratio of the two sides from the size data 12a.

  When photographing is performed as shown in FIG. 2, if the document 3 and the information processing apparatus 1 are not parallel, the document 3 is photographed in a trapezoidal shape as displayed on the display unit 105 of FIG. Therefore, the size specifying unit 22 can increase the accuracy of specifying the document type by calculating the length of all four sides of the document 3 and calculating the ratio of the long side to the short side.

  The preview unit 23 displays the image data 11 a acquired by the acquisition unit 21 and displays the ideal frame 51 based on the aspect ratio data specified by the size specifying unit 22. The ideal frame 51 is a guide that indicates the position of the document 3 on the display unit 105 when the positional relationship between the photographing unit 121 and the document 3 is appropriate. The preview unit 23 includes an ideal frame drawing unit 24.

  The ideal frame drawing unit 24 draws the ideal frame associated with the document type determined from the aspect ratio data specified by the size specifying unit 22 from the ideal frame data 13a on the image data 11a. For example, the ideal frame drawing unit 24 may display the layer that displays the ideal frame 51 on the display unit 105 so as to overlap the layer that displays the image data 11a. The user adjusts the positions and angles of the document 3 and the information processing apparatus 1 so that the document unit 52 fits in the ideal frame 51 displayed on the display unit 105.

  The storage unit 25 determines whether or not the document part 52 is within the ideal frame 51. When the storage unit 25 determines that the document part 52 is within the ideal frame 51, the storage unit 25 stores the stored image data 14a based on the image data 11a at that timing. Here, the storage unit 25 may determine that the document part 52 is within the ideal frame 51 when, for example, the difference in the distance between the document part 52 and the ideal frame 51 is within a predetermined value. The storage unit 25 includes a stored image selection unit 26, a correction unit 27, and a digital watermark insertion unit 28.

  The saved image selection means 26 acquires a plurality of image data 11 a at the timing when the document part 52 is accommodated in the ideal frame 51. Specifically, the central processing control apparatus 101 can acquire a plurality of pieces of image data 11a by inputting, for example, an instruction to capture 30 images per second to the imaging unit 121. By automatically shooting in this way, it is possible to save the user from pressing the shooting button and reduce the blurring factor.

  The saved image selection means 26 selects the image with the least blur among the acquired plurality of image data 11a as the saved candidate image data. An image with less blur is an image with a small gradation change rate and high contrast. Specifically, the saved image selection unit 26 calculates the gradation change rate and the sharpness of the image for each of the acquired plurality of image data 11a, and selects the image with the least blur.

  The correction unit 27 corrects the storage candidate image data selected by the storage image selection unit 26, such as keystone correction, trimming, and shadow elimination.

  With reference to FIG. 6, the image correction processing by the correction means 27 will be described. As shown in FIG. 6A, in the image data 11a selected by the saved image selection means 25, the document part 52 may have a trapezoidal shape. Further, since the information processing apparatus 1 photographs the document 3 from the upper part of the document 3 as shown in FIG. 2, the shadow of the information processing apparatus 1 may occur on the document 3. In this case, the image data 11a may include a shadow part 53 in which the shadow of the information processing apparatus 1 is generated.

  For such image data 11a, the correction means 27 performs trapezoidal correction to generate an image as shown in FIG. In FIG. 6A, since the rectangular document 3 is photographed with the upper part of the image data 11a being narrow and the lower part being wide, the keystone correction is performed so that the upper part of the image data 11a is expanded. As a result, the correction means 27 can acquire image data including a rectangular document portion 52a as shown in FIG.

  Further, the correcting unit 27 deletes the shadow from the image data shown in FIG. Here, the “shadow” is considered to be an image area within a predetermined value that has a lower luminance than the background color of the document 3 but has a higher luminance than the character color on the document 3. This predetermined value is, for example, predetermined data in a range of luminance values to be specified as shadows. It is considered that the color of the document 3 is generally white. Therefore, the correcting unit 27 specifies the ground color of the document 3 and the character color on the document 3 from the luminance distribution of the image data 11a of the document 3, and specifies the shadow portion on the image data 11a. At this time, the character color portion on the document 3 is excluded from the shadow portion. The correcting unit 27 replaces the color of the shadow portion thus identified with the background color of the document. As a result, the correction means 27 can acquire image data with a uniform ground color of the document portion 52b as shown in FIG.

  The correction unit 27 trims the part other than the document from the image data shown in FIG. 6C, and acquires the image data of only the document 3. At this time, the correction unit 27 may trim the part other than the document by using the information of the ideal frame drawn by the preview unit 23. For example, the correction unit 27 can acquire saved image candidate data including only the document portion by deleting a portion outside the coordinates of the ideal frame from the image data shown in FIG.

  The correction processing sequence shown in FIG. 6 is merely an example, and can be changed as appropriate. Further, the correction process shown in FIG. 6 is an example, and a part of the process may be omitted, or another correction process may be performed.

  The digital watermark insertion unit 28 inserts the digital watermark into the saved image candidate data corrected by the correcting unit 27 to generate the saved image data 14a. The digital watermark insertion unit 28 inserts information such as the date and time when the evidence data is acquired, the acquisition terminal, and the acquirer as a digital watermark.

  With reference to FIG. 7, the process of the information processing apparatus 1 according to the first embodiment will be described.

  First, in step S <b> 101, the size specifying unit 22 reads the image data 11 a from the image data storage unit 11. In step S102, the size specifying unit 102 detects the edge of the image data 11a read in step S101, and calculates the aspect ratio of the document portion. In step S103, the size specifying unit 103 determines an ideal frame suitable for the document 3 displayed by the image data 11a.

  In step S104, the preview unit 23 reads the image data 11a, and in step S105, previews the image data together with the ideal frame on the display unit 105. At this time, the document 3 and the ideal frame are displayed on the display unit 105 of the information processing apparatus 1, for example, as shown in FIG.

  In step S106, the storage unit 25 detects the edge portion of the document 3 from the image data read out in step S104. In step S107, whether the edge portion of the document 3 is inside the ideal frame 51 specified in step S103. Determine. If the document part 52 does not fit within the ideal frame 51, the process returns to step S104, and the preview means 23 displays new image data. Here, when the edge of the document 3 is acquired again, the size specifying means 22 calculates the aspect ratio, compares the size data 12a, determines the type of the document 3, and the newly determined type of the document 3 The processing of step S105 and step S106 may be executed using an ideal frame corresponding to.

  On the other hand, when it is determined that the document part 52 is within the ideal frame 51, the storage unit 25 automatically captures a predetermined number of images in step S108, acquires a plurality of storage candidate image data, and has the least blur in step S109. Select save candidate image data. In step S110, the storage unit 25 corrects keystone correction, shadow removal, trimming, and the like for the storage candidate image data acquired in step S109, and inserts a digital watermark in step S111. In step S112, the storage unit 25 stores the storage candidate image data into which the digital watermark is inserted in the storage image data storage unit 14 as the storage image data 14a.

  As described above, the information processing apparatus 1 according to the first embodiment displays the ideal frame 51 by specifying the type of the document 3 from the document unit 52 included in the image data 11a, thereby allowing the user to capture the imaging unit 121. And the positional relationship between the document 3 and the document 3 can be easily adjusted. Further, by displaying the ideal frame 51 and acquiring the image data 11a, the information processing apparatus 1 can store the entire document 3 in the frame and acquire the maximum image.

(Second Embodiment)
In the first embodiment, the case where the distance between the information processing apparatus 1 and the document 3 can be freely changed has been described. In the second embodiment, the case where the distance between the photographing unit 121 and the document 3 can be fixed is described. To do.

  The case where the distance between the photographing unit 121 and the document 3 can be fixed is, for example, as shown in FIGS. 8 to 10, depending on the shape of the information processing apparatus 1 a according to the second embodiment and the installation location of the document 3. This is a case where the section 121 and the document 3 are at a substantially constant distance.

  FIG. 8 illustrates a case where the information processing apparatus 1 a is a tablet computer and the information processing apparatus 1 a is installed on the stand 5 as in the first embodiment. By installing on the stand 5, the information processing apparatus 1a is fixed, and the distance from the document 3 is also substantially constant.

  FIG. 9 illustrates a general notebook computer, in which the photographing unit 121 is provided at the top of the display unit of the notebook computer. By placing the document 3 on the keyboard of the notebook computer and setting the opening / closing angle between the display unit and the keyboard unit to approximately 90 degrees, the information processing apparatus 1a is fixed and the distance from the document 3 is also substantially constant. .

  FIG. 10 illustrates a general notebook computer, in which the photographing unit 121 is provided on the back surface of the display unit of the notebook computer. By placing the document 3 on the backside of the display unit of the notebook computer and setting the display unit and the keyboard unit to an angle of about 90 degrees or less, the information processing apparatus 1a is fixed, and the distance from the document 3 is almost the same. It becomes a certain distance.

  When the distance between the photographing unit 121 and the document 3 can be fixed as described above, the size of the document 3 can be specified by the size of the document unit 52 in the image data 11a. Therefore, in the second embodiment, a case will be described in which the type of the document 3 is specified by the size of the document part 52 and the ideal frame is displayed instead of the aspect ratio of the edge of the document part 52.

  In the size data 12b according to the second embodiment, pixel size data of the document 3 when the positional relationship between the photographing unit 121 and the document 3 is appropriate is further associated with the type of document.

The size data 12b according to the second embodiment shown in FIG. 11 is different from the size data 12a according to the first embodiment shown in FIG.

  The size specifying unit 22a according to the second embodiment specifies the pixel size data closest to the number of pixels at the edge of the document 3 detected from the image data 11a. The size specifying unit 22 detects the edge of the document part 52 from the image data 11a, and calculates the size of the area surrounded by the four sides of the document part 52. Further, the document type having the pixel size closest to the calculated area size is specified with reference to the size data 12b.

  The preview unit 23a according to the second embodiment displays an ideal frame on the display unit 105 based on the pixel size data specified by the size specifying unit 22a.

  The information processing apparatus 1a according to the second embodiment can recognize the distance between the document 3 and the photographing unit 121, thereby determining the types of documents having the same shape but different sizes, such as A4 and B5. A frame can be displayed.

(Third embodiment)
The information processing apparatus 1b according to the third embodiment removes noise using a composite. In the third embodiment, the display method of the ideal frame is also different from that in the first embodiment.

  Compared with the information processing apparatus 1 according to the first embodiment shown in FIG. 4, the information processing apparatus 1b according to the third embodiment shown in FIG. The processing of is different.

  The preview unit 23a according to the third embodiment includes an ideal frame drawing unit 24a. The ideal frame drawing unit 24a displays an ideal frame on the display unit 105 based on the ideal frame data 13a. In the first embodiment, the software determines the document type. However, in the third embodiment, it is not necessary to determine the document type. For example, the user may input the document type to the information processing apparatus 1b, or the information processing apparatus 1b handles only one type of document type, and the ideal frame data 13a includes only the ideal frame data of that one type of document type. It may be.

  The preview unit 23a according to the third embodiment displays an ideal frame as shown in FIG. 13, for example. The ideal frame shown in FIG. 13 includes a first ideal frame 51a and a second ideal frame 51b. In the third embodiment, when the edge of the document section 52 enters between the first ideal frame 51a and the second ideal frame 51b, the storage unit 25a uses the image data 11a at that timing, Saved image data 14a is saved.

  In FIG. 13A, the edge of the document part 52 is not placed between the first ideal frame 51a and the second ideal frame 51b. When the user changes the position of the document 3 or the like and the edge of the document unit 52 is placed between the first ideal frame 51a and the second ideal frame 51b as shown in FIG. 25a stores the storage data 14a.

  The storage unit 14a is different from the information processing apparatus 1 according to the first embodiment shown in FIG. 4 in that it includes a composite noise removing unit 29. Also, the processing of the stored image selection unit and the correction unit is different.

  The saved image selection unit 26 a acquires a plurality of image data 11 a at the timing when the document part 52 is accommodated in the ideal frame 51. Further, the stored image selection unit 26a selects a predetermined number of images with the least blur among the acquired plurality of image data 11a as the storage candidate image data. Specifically, the saved image selection unit 26 calculates the gradation change rate and sharpness of the image for each of the acquired plurality of image data 11a, and the gradation change rate is small, the contrast is high, and there is little blurring. A predetermined elementary image is selected.

  The correcting unit 27a extracts a portion where the document 3 of a plurality of image data is photographed and corrects the keystone. For example, the correction unit 27a corrects the storage candidate image data selected by the storage image selection unit 26, such as keystone correction, trimming, and shadow removal. In the first embodiment, only one image selected by the storage selection unit 26 is corrected. However, the correction unit 27a according to the third embodiment uses all the images selected by the storage image selection unit 26a. Correct the image.

  The composite noise removing unit 29 generates saved image data from which composite noise has been removed from a plurality of saved candidate image data corrected by the correcting unit 27a. For example, when noise is removed by compositing using eight pieces of storage candidate image data, data in which the opacity of each storage candidate image data is 1/12 is superimposed on each pixel. The composite noise removing unit 29 can match the edges of the document by using the corrected storage candidate image data that has been subjected to the trapezoidal correction in the correcting unit 27a. Thereby, noise can be effectively removed.

  In addition, a rotation mark for alignment may be attached to the document 3, and the pixels in which the document is photographed may be matched based on the rotation mark of each storage candidate image data. The edges of the document portions 52 in a plurality of images may be matched by printing a guide display indicating the document installation position on the housing portion of the information processing apparatus 1b and taking a picture including the guide display.

  With reference to FIG. 14, the process of the information processing apparatus 1b according to the third embodiment will be described.

  In step S201, the preview unit 23a reads the image data 11a, and in step S202, previews the image data together with the ideal frame on the display unit 105. At this time, for example, as shown in FIG. 13, the document 3 and the ideal frame are displayed on the display unit 105 of the information processing apparatus 1b.

  In step S204, the storage unit 25a detects the edge portion of the document 3 from the image data read in step S203. In step S204, the edge portion of the document 3 is the first ideal frame 51a and the second ideal frame 51b. It is determined whether or not. If it is not between the first ideal frame 51a and the second ideal frame 51b, the process returns to step S204, and the preview means 23a displays new image data.

  On the other hand, if it is determined that the distance is between the first ideal frame 51a and the second ideal frame 51b, the storage unit 25a automatically captures a predetermined number of images in step S205, acquires a plurality of storage candidate image data, In S206, a plurality of storage candidate image data with less blur is selected. Further, in step S207, the storage unit 25a corrects each of the plurality of storage candidate image data acquired in step S206, such as keystone correction, shadow elimination, and trimming. In step S208, the storage unit 25a removes noise using a composite of the plurality of storage candidate image data corrected in step S207, and inserts a digital watermark in step S209. In step S210, the storage unit 25a stores the storage candidate image data into which the digital watermark is inserted in the storage image data storage unit 14 as the storage image data 14a.

  The information processing apparatus according to at least one embodiment described above can acquire shooting data of appropriate documents.

  Note that the processing order of the information processing apparatus according to at least one embodiment described above is not limited as described above.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 3 Document 5 Stand 11 Image data storage part 12 Size data storage part 13 Ideal frame data storage part 13 Saved image data storage part 21 Acquisition means 22 Size specification means 23 Preview means 24 Ideal frame drawing means 25 Storage means 26 Save Image selection means 27 Trapezoid means 28 Digital watermark insertion means 29 Composite noise removal means 51 Ideal frame 52 Document section 101 Central processing control device 102 ROM
103 RAM
104 Input Device 105 Display Unit 105a Touch Panel 106 Communication Control Device 107 Storage Device 108 Removable Disk 109 Input / Output Interface 110 Bus 121 Imaging Unit 122 Image Data Conversion Unit

Claims (8)

An information processing apparatus for processing image data obtained by photographing a document,
A storage device storing size data in which the type of document and the aspect ratio data of the document in the image data when the positional relationship between the photographing unit and the document is appropriate;
Acquisition means for acquiring image data generated by the imaging unit imaging the document, and storing the acquired image data in the storage device;
Size specifying means for reading the size data and specifying aspect ratio data closest to the ratio of the edges of the document detected from the image data;
The image data acquired by the acquisition unit is displayed, and the position of the document when the positional relationship between the photographing unit and the document is appropriate is indicated based on the aspect ratio data specified by the size specifying unit. A preview means for displaying an ideal frame;
An information processing apparatus comprising: When the distance between the photographing unit and the document can be fixed, the size data is further associated with pixel size data of the document when the positional relationship between the photographing unit and the document is appropriate for the type of the document. And
The size specifying means specifies pixel size data closest to the number of pixels of the edge of the document detected from the image data;
The information processing apparatus according to claim 1, wherein the preview unit displays the ideal frame based on pixel size data specified by the size specifying unit. An information processing method for processing image data obtained by photographing a document,
An acquisition step in which the imaging unit acquires image data generated by shooting a document and stores it in a storage device;
Read the size data associating the document type with the aspect ratio data of the document when the positional relationship between the photographing unit and the document is appropriate, and the ratio of the edge of the document detected from the image data Size specifying means for specifying the aspect ratio data closest to,
The image data acquired in the acquisition step is displayed, and the position of the document when the positional relationship between the photographing unit and the document is appropriate is indicated based on the aspect ratio data specified in the size specifying step. A preview step to display the ideal frame;
An information processing method comprising: An information processing program for processing image data obtained by photographing a document,
Computer
An acquisition unit that acquires image data generated by the imaging unit shooting a document and stores the acquired image data in a storage device;
Read the size data associating the document type with the aspect ratio data of the document when the positional relationship between the photographing unit and the document is appropriate, and the ratio of the edge of the document detected from the image data Size specifying means for specifying the aspect ratio data closest to,
The image data acquired by the acquisition unit is displayed, and the position of the document when the positional relationship between the photographing unit and the document is appropriate is indicated based on the aspect ratio data specified by the size specifying unit. An information processing program that functions as a preview means for displaying an ideal frame. An information processing apparatus for processing image data obtained by photographing a document,
An acquisition unit that acquires a plurality of image data generated by the imaging unit shooting a document, and stores the acquired image data in a storage device;
An information processing apparatus comprising: composite noise removal means for extracting a portion of the plurality of image data acquired by the acquisition means where the document is photographed and correcting trapezoid and generating saved image data from which composite noise has been removed. The information processing apparatus according to claim 5, wherein the composite noise removing unit generates the stored image data based on a plurality of image data with high sharpness among the plurality of image data acquired by the acquiring unit. An information processing method for processing image data obtained by photographing a document,
An acquisition step in which the imaging unit acquires a plurality of image data generated by imaging a document and stores the acquired image data in a storage device;
An information processing method comprising: a composite noise removal step of extracting a portion of the plurality of image data acquired in the acquisition step in which the document is photographed to correct a trapezoid and generating saved image data from which composite noise has been removed. An information processing program for processing image data obtained by photographing a document,
Computer
An acquisition unit that acquires a plurality of image data generated by the imaging unit shooting a document, and stores the acquired image data in a storage device;
An information processing program that extracts a portion of the plurality of image data acquired by the acquisition unit where the document is photographed and corrects the keystone, and functions as a composite noise removal unit that generates stored image data from which composite noise is removed.

Images