JP2012205089A - Information processing device, information processing method, and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, an information processing method and an information processing program, all for obtaining appropriate image data.SOLUTION: An information processing device includes: a photography part for photographing a document; an image acquisition part for acquiring image data of the document photographed by the photography part; first and second determination parts; and an image registration part. The first determination part determines whether image data of an outer frame region being a predetermined region has a color of the document itself or a background color of the document for a predetermined ratio. The second determination part determines that image data of an inner frame region being a predetermined region inside the outer frame region has neither the color of the document itself nor the background color of the document for the predetermined ratio. The image registration part stores the image data based on the determination result of the first determination part and that of the second determination part.

Description

  Embodiments described herein relate generally to an information processing apparatus, an information processing method, and an information processing program.

  There is a technique for acquiring an image such as a document using a mobile terminal equipped with a camera. As a field in which such a portable terminal equipped with a camera is applied, for example, a business when an insurance sales staff performs a contract procedure with a contractor outside the company can be given. At the time of the contract procedure, the insurance sales staff bring a mobile terminal equipped with the camera as described above, and at the meeting place with the insurance contractor, documents such as receipts necessary for the procedure are stored on the mobile terminal camera. Take a picture with to get an image.

  For example, there may be a case where documents such as application forms filled in by a customer are photographed with a notebook computer carried by a sales representative, converted into electronic data, and stored as evidence data. Here, when the electronic data obtained by photographing the document is stored, it is preferable that the electronic data is stored in front of the customer in order to obtain the customer's consent to store it as evidence data. Moreover, it is preferable that it can be confirmed in real time that the image quality is provided as evidence data such as character readability.

  In order for the sales person to confirm in real time that the conditions required for the evidence data, such as character readability, are provided, it is necessary for the customer to capture an image. Moreover, in order to ensure the readability of the image acquired as such, it is necessary to have a mechanism that can always shoot with an image quality of a certain level or higher.

  On the other hand, there is a method for determining whether the document image is sufficiently large in order to determine whether the photographed document image has a readable image quality of a certain level or higher. In this method, the edge of the document included in the image is detected, and the size of the document image is determined based on the size of the edge. However, the places where the insurance sales staff and policyholders meet as described above are in various unspecified places, such as coffee shops, as well as ordinary homes and offices, and the color of the desk surface on which the documents are placed varies. Therefore, this method has a problem in that the size of the document itself to be photographed and the background color of the document such as a desk cannot be detected because the edge of the document cannot be detected.

JP 2007-267415 A

  An object of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program that acquire appropriate image data.

  An information processing apparatus according to an embodiment includes an imaging unit that captures a document, an image acquisition unit that acquires image data of a document captured by the imaging unit, a first determination unit, a second determination unit, and an image registration unit. With. The first determination unit determines whether the color of the image data in the outer frame area, which is a predetermined area, is the color of the document itself or the background color of the document by a predetermined ratio or more. The second determination unit determines that the color of the image data in the inner frame area, which is a predetermined area inside the outer frame area, is not a color of the document itself or a background color of the document by a predetermined ratio or more. The image registration unit stores the image data in the storage device based on the determination result of the first determination unit and the determination result of the second determination unit.

The figure which shows an example of the external appearance of the information processing apparatus which concerns on 1st Embodiment. The image figure of the mode of imaging | photography of the document by the information processing apparatus which concerns on 1st Embodiment. 1 is a diagram illustrating an example of a hardware configuration of an information processing device according to a first embodiment. The functional block diagram of the information processing apparatus which concerns on 1st Embodiment. The image figure of the ideal frame area | region which concerns on 1st Embodiment. The figure which shows an example of the screen of the display part which concerns on 1st Embodiment. 6 is a flowchart illustrating an example of processing of the information processing apparatus according to the first embodiment. The flowchart which shows an example of the edge estimation process which concerns on 1st Embodiment. The image figure which shows an example of the outer side frame area | region and inner side frame area | region which concern on 1st Embodiment. The image figure which shows the relationship between the outer frame area | region which concerns on 1st Embodiment, an inner frame area | region, and the acquired image data. The functional block diagram of the information processing apparatus which concerns on 2nd Embodiment. 9 is a flowchart illustrating an example of processing of an information processing device according to a second embodiment. The flowchart which shows an example of the readability determination process which concerns on 2nd Embodiment.

(First embodiment)
The information processing apparatus 1 according to the first embodiment will be described below with reference to the drawings.

  The information processing apparatus 1 according to the first embodiment processes image data obtained by photographing a document. The information processing apparatus 1 is, for example, a tablet computer (slate PC) as shown in FIG. The surface of the information processing apparatus 1 according to the first embodiment includes a display unit 105 as shown in FIG. Moreover, the back surface opposite to the surface provided with the display unit 105 includes a photographing unit 121 as shown in FIG. The display unit 105 of the information processing apparatus 1 includes a touch panel. A keyboard and buttons are displayed on the display unit 105 by software executed by the information processing apparatus 1. The user can input an instruction to the information processing apparatus 1 by touching the displayed keyboard or button. Further, a keyboard or mouse may be connected to the information processing apparatus 1, and a button for inputting an instruction may be provided on the housing of the information processing apparatus 1.

  A case where a document is photographed by the information processing apparatus 1 will be described. As shown in FIG. 2, the document is placed on a table such as a desk. For example, the user holds the information processing apparatus 1 with both hands, points the photographing unit 121 of the information processing apparatus 1 toward the document, and photographs from the top of the document. Here, the image data of the document photographed by the photographing unit 121 is sequentially displayed on the display unit 105 of the information processing apparatus 1 as a preview. Since the display unit 105 of the information processing apparatus 1 is located on the user side, the user can adjust the positional relationship between the document and the information processing apparatus 1 while confirming that the image is captured on the display unit 105. Note that the image data displayed on the display unit 105 includes document image data 801 and image data 802 of the document background (desk in this case).

  As shown in FIG. 3, the information processing apparatus 1 according to the first embodiment includes a central processing control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an input / output interface 109, and image data generation. The unit 123 is connected via the bus 110. An input device 104, a display unit 105, a communication control device 106, a storage device 107, and a removable disk 108 are connected to the input / output interface 109. A photographing unit 121 is connected to the image data generation unit 122.

  The photographing unit 121 is, for example, a CCD (Charge Coupled Device), and converts light received from a document into an electrical signal. The imaging unit 121 inputs an electrical signal to the image data generation unit 122. The imaging unit 121 is, for example, a CCD that is fixed to the information processing apparatus 1 and built in.

  For example, the imaging unit 121 may be a camera that can be fixed to the information processing apparatus 1 and can be connected via a USB port or the like. Here, “fixable” means that the information processing apparatus 1 and the photographing unit 121 are configured by different hardware, and the photographing unit 121 is attached to the information processing apparatus 1 in a state where it can be removed by a connecting member such as a hook. Says that it can be fixed. In this case, the photographing unit 121 inputs image data to the central processing control apparatus 101 via an external interface such as a USB port.

  The image data generation unit 122 is a circuit that converts the electrical signal received from the imaging unit 121 into image data and sends the image data to the bus 110. The image data generation unit 122 according to the first embodiment may be implemented by a circuit board or a software program.

  The central processing control apparatus 101 reads out and executes a boot program for starting up the information processing apparatus 1 from the ROM 102 based on an input signal from the input apparatus 104, and further reads out an operating system stored in the storage apparatus 107. Further, the central processing control device 101 controls various devices based on input signals from the input device 104, the communication control device 106, etc., or reads out programs and data stored in the RAM 103, the storage device 107, etc. into the RAM 103. A processing device that loads and implements a series of processes to be described later, such as data calculation or processing, based on program commands read from the RAM 103.

  The input device 104 includes input devices such as a keyboard 104a and a mouse 104b through which an operator inputs various operations. The input device 104 generates an input signal based on the operation of the operator, and connects the input / output interface 109 and the bus 110. To the central processing control apparatus 101.

  The display unit 105 is a liquid crystal display, for example. The display unit 105 receives an output signal to be displayed on the display unit 105 from the central processing control device 101 via the bus 110 and the input / output interface 109, and displays the processing result of the central processing control device 101, for example. The display unit 105 of the information processing apparatus 1 according to the first embodiment is provided with a touch panel, and the user touches the screen of the display unit 105 to transmit an input signal to the central processing control device 101. Can do.

  The communication control device 106 is a device such as a LAN card, a modem, or an antenna, and is a device that connects the information processing device 1 to a communication network such as the Internet, a LAN, or a mobile phone network. Data transmitted / received to / from the communication network via the communication control device 106 is transmitted / received to / from the central processing control device 101 via the input / output interface 109 and the bus 110 as an input signal or an output signal.

  The storage device 107 is a semiconductor storage device or a magnetic disk device, and stores programs and data executed by the central processing control device 101. The removable disk 108 is an optical disk or a flexible disk, and signals read / written by the disk drive are transmitted / received to / from the central processing control apparatus 101 via the input / output interface 109 and the bus 110.

  The storage device 107 of the information processing apparatus 1 according to the first embodiment stores an information processing program. As illustrated in FIG. 4, the storage device 107 includes an image data storage unit 40 and an ideal frame region storage unit 41. A stored image data storage unit 42 and an edge estimation data storage unit 43. In addition, the information processing program is read and executed by the central processing control device 101 of the information processing apparatus 1, so that the image data acquisition unit 19, the preview unit 20, the edge detection unit 22, the timer unit 23, the edge estimation unit 24, An image registration unit 25 is mounted on the information processing apparatus 1.

The image data storage unit 40 is a storage area in which the image data generated by the photographing unit 121 and the image data generation unit 122 in the storage device 107 is stored. The image data is sequentially input by the photographing unit 121 and the image data acquisition unit 19.
The ideal frame area storage unit 41 is a storage area in the storage device 107 in which ideal frame area data indicating the ideal frame area 411 as shown in FIG. 5 is stored. The ideal frame region data includes, for example, the x coordinate and y coordinate of the upper left corner of the inner periphery of the ideal frame region 411, the x coordinate and y coordinate of the lower right corner of the inner periphery, and a predetermined width. That is, the ideal frame region 411 is a region having a predetermined width from the inner periphery to the outer side. Alternatively, the ideal frame region information may include the x coordinate and y coordinate of the upper left corner of the outer periphery of the ideal frame region 411 and the x coordinate and y coordinate of the lower right corner of the outer periphery. Alternatively, information including the size of the image data displayed on the display unit 105 and a predetermined width may be used. In this case, an area having a predetermined width from the image size displayed on the display unit 105 becomes the ideal frame area 411.

  In other words, the ideal frame area 411 is an area for determining whether the image data generated by the photographing unit 121 and the image data generation unit 122 is appropriate image data.

  “Appropriate image data” means that when image data of a document is stored as evidence data, it is necessary to correctly recognize and read characters and images described in the document from the image data of the document. This is image data in which characters and images included in the are readable. In the present embodiment, it is assumed that image data having a size that includes an edge of a document (hereinafter referred to as an edge) in the ideal frame region 411 is readable and appropriate image data.

  In this embodiment, the ideal frame region 411 is set in advance within the range of image sizes that can be captured by the image capturing unit 121, and the document edge in the image data captured by the image capturing unit 121 is included in the ideal frame region 411. Are saved as saved image data. Note that the characters and images are readable means that a human or a character recognition device can recognize the characters or images.

  In the present embodiment, the ideal frame region 411 is a region (dot region) having a predetermined width from the maximum size of image data that can be generated by the photographing unit 121 and the image data generation unit 122 as shown in FIG. That is, an area having a predetermined width from the outer periphery of the image data displayed on the display unit 15 is set as an ideal frame area. As shown in FIG. 5, the ideal frame region 411 has a shape with a constant width surrounding a predetermined region. The shape of the ideal frame 211 is not limited to the above-described shape, and for example, a shape in which a marker on an “L” shape is provided. Alternatively, the vertical region width and the horizontal region width may be different.

  The ideal frame region 411 is referred to when an ideal frame region display unit 21 (to be described later) displays the ideal frame region 411 on the display unit 105 or when the saved image selection unit 26 compares the position with the edge position in the image data. The

  The saved image data storage unit 42 is a storage area in the storage device 107 in which saved image data is stored. The saved image data is one of a plurality of image data stored in the image data storage unit 11 and is image data stored in the saved image data storage unit 42 by the saved image registration unit 25 described later. . Specifically, when the stored image selection unit 26 determines whether the edge of the image data is included in the ideal frame region 411 and detects that the edge is included in the ideal frame region 411, the image registration is performed. The unit 25 stores the image data at that time in the saved image data storage unit 42 as saved image data.

  The edge estimation data storage unit 43 is a storage area in the storage device 107 that stores edge estimation data including outer frame area data indicating the outer frame area 431 and inner frame area data indicating the inner frame area 432. The outer frame area data and the inner frame area data include the x coordinate and y coordinate of the upper left corner of the inner circumference of each area, the x coordinate and y coordinate of the lower right corner of the inner circumference, and a predetermined width. Alternatively, the outer frame region data and the inner frame region data may include the x coordinate and y coordinate of the upper left corner of the outer periphery of each region and the x coordinate and y coordinate of the lower right corner of the outer periphery. Alternatively, an area having a predetermined width from the maximum data size that can be acquired by the information processing apparatus 1 of the present embodiment may be set as the outer frame area 431. In this case, an area having a predetermined width from the image size displayed on the display unit 105 becomes the outer frame area 431.

  The image data acquisition unit 19 acquires image data generated by the shooting unit 121 shooting a document and stores the image data in the storage device 107. The image data acquisition unit 19 acquires the image data generated by the image data generation unit 122 based on the electrical signal captured by the imaging unit 121 and stores the acquired image data in the image data storage unit 11. The image data acquisition unit 19 sequentially stores the image data input from the photographing unit 121 in the image data storage unit 11, and is displayed on the display unit 105 as a moving image by the preview unit 20 previewing.

  The preview unit 20 displays the image data acquired by the image data acquisition unit 19 and the ideal frame region 411. Here, the ideal frame region 411 is a guide indicating an appropriate size of the image data acquired by the image data acquisition unit 19 in the display unit 105. The preview unit 20 includes an ideal frame area display unit 21.

  The ideal frame area display unit 21 displays the ideal frame area 411 on the display unit 30. For example, the ideal frame region display unit 21 may display the layer that displays the ideal frame region 411 on the display unit 105 so as to overlap the layer that displays the image data. The user adjusts the position and angle of the document and the information processing apparatus 1 so that the edge of the document is within the ideal frame region 411 displayed on the display unit 105.

  The edge detection unit 22 detects the edge of the document in the image data displayed on the display unit 105. The timer unit 23 determines whether or not the edge detection unit 22 has detected an edge of the image data within a preset time. The preset time is 20 seconds, for example.

  The edge estimation unit 24 estimates the edge of the document in the image data generated by the imaging unit 121 when the edge detection unit 22 does not detect the edge within the time set in the timer unit 23. . The edge estimation process of the document by the edge estimation unit 24 will be described later.

  The saved image registration unit 25 stores the saved image data in the saved image data storage unit 42. The saved image registration unit 25 includes a saved image selection unit 26.

  The saved image selection unit 26 determines whether the edge of the document in the image data generated by the photographing unit 121 photographing the document is included in the range of the ideal frame region 411, and the edge of the document is the ideal frame region 411. The image data included in the range is taken as saved image data.

  That is, when the document edge determined by the edge detection unit 22 or the edge estimation unit 24 is included in the range of the ideal frame region 411, the saved image registration unit 25 registers the saved image data in the saved image data storage unit 42. To do.

  Here, with reference to FIG. 6 to FIG. 11, an example of a processing procedure performed by the information processing apparatus 1 according to the present embodiment will be described.

  FIG. 6 shows an example of a screen displayed by the display unit 105 of this embodiment. Image data generated by photographing a document by the photographing unit 121 is displayed on the display unit 105 in FIG. 6, but the color of the document background is the same as the background color, and the edge is unclear.

  FIG. 7 is a flowchart illustrating an example of processing of the information processing apparatus 1 according to the present embodiment.

  First, the image data acquisition unit 19 acquires image data of a document imaged by the imaging unit 121 and registers it in the image data storage unit 40 (step S10). Here, for example, an insurance salesperson photographs the document by directing the lens of the camera serving as the photographing unit 121 to the document to be photographed, and acquires image data.

  The preview unit 20 reads the image data from the image data storage unit 40 and displays the preview on the display unit 105 (step S20).

  Subsequently, the edge detection unit 22 detects the edge of the image data displayed on the display unit 105 (step S30). Note that edge detection can be performed using a luminance gradient, for example.

  When the edge detection unit 22 detects the edge of the image data within the time set in advance by the timer unit 23 (No in step S30), the edge detection unit 22 identifies the detected edge as the edge of the image data. Then, the process of step S50 is performed.

  If the edge detection unit 22 cannot detect an edge included in the image data even after a time set in advance by the timer unit 23 (Yes in step S30), the edge estimation unit 24 estimates the edge of the image data. An estimation process is performed (step S40). This edge estimation process will be described later. If the edge detection unit 22 cannot detect the edge of the image data even after the time preset by the timer unit 23 has elapsed, for example, the background color (paper color) of the document to be photographed and the color of the desk are displayed. For example, it is the same.

  When the edge detection unit 22 detects the edge in step S30 or the edge estimation unit 24 estimates the edge of the image data in step S30, and the edge of the image data is specified, the ideal frame region display unit 21 Based on the ideal frame region information registered in the ideal frame region storage unit 41, the ideal frame region 411 is displayed on the display unit 105 (step S50).

  Subsequently, the saved image selection unit 26 determines whether the edge of the image data specified in step S30 or step S40 is within the range of the ideal frame region 411 displayed on the display unit 105 (step S60). In other words, the stored image selection unit 26 determines that the edge enters the range of the ideal frame region 411 when the edge exceeds the inner periphery of the ideal frame region 411 and does not exceed the outer periphery continues for a predetermined time. It is determined that In this determination, for example, the angular coordinates of the target edge are specified, the upper left coordinates and the lower right coordinates of the inner periphery of the ideal frame region 411 are set as the first threshold, and the upper left coordinates and the lower right coordinates of the outer periphery of the ideal frame region 411 are determined. When the second threshold is set, the determination is made by determining whether the upper left coordinate and the lower right coordinate of the target edge are each equal to or higher than the first threshold and equal to or lower than the second threshold.

  When the saved image selection unit 26 determines that the edge is within the range of the ideal frame region 411 (Yes in step S60), the saved image selection unit 26 selects this image data as saved image data (step S70). . The saved image registration unit 25 registers the saved image data in the saved image data storage unit 42 (step S80). Thereby, the process of the information acquisition apparatus 1 is complete | finished. Note that the saved image registration unit 25 may trim the image outside the edge when the saved image data is registered in the saved image data storage unit 42.

  If the saved image selection unit 26 determines that the edge is not within the ideal frame region 411 (No in step S50), the process returns to step S20, and the preview unit 20 displays new image data. In this case, the user moves the photographing unit 121 of the information processing apparatus 1 or the target document so that the edge of the document falls within the range of the ideal frame region 411, so that the edge falls within the range of the ideal frame region 411. To do. Thus, the display of the edge of the image data and the ideal frame region 411 can assist the user in acquiring image data of an appropriate size.

  Here, the edge estimation processing in step S40 in FIG. 7 will be described with reference to FIGS. Here, the edge estimation process in the image data shown in FIG. 6 will be described.

  FIG. 8 is a flowchart showing an example of edge estimation processing according to the edge estimation unit 24 of the present embodiment. When the state in which the edge of the document is not detected by the edge detection unit 22 continues for a predetermined time set in the timer unit 23, the edge estimation unit 24 binarizes the acquired image data (step S41). .

  The edge estimation unit 24 performs edge estimation with reference to the outer frame region data and the inner frame region data included in the edge estimation data stored in the edge estimation data storage unit 43 in the binarized image data. . Specifically, an edge in the image data is estimated using an outer frame region 431 based on the outer frame region data and an inner frame region 432 based on the inner frame region data.

  Here, FIG. 9 shows an image diagram of the outer frame region 431 and the inner frame region 432. As shown in FIG. 9, the outer frame region 431 is a region having a predetermined width from the outer periphery of the image data displayed on the display unit 105, for example, and is a region indicated by shading in FIG. That is, the outer frame area 431 is an area having a predetermined width from the maximum size of image data that can be acquired by the information processing apparatus 1 of the present embodiment, for example.

  On the other hand, the inner frame region 432 is a region having a predetermined width inside the inner periphery of the outer frame region 431, and is a region indicated by hatching in FIG.

  The outer frame region 431 may be the same region as the ideal frame region 411 described above. Alternatively, the area including the outer frame area 431 and the inner frame area 432 may be the same area as the ideal frame area 411. Each of these areas is set in advance by a device designer or user. For example, the widths of the outer frame region 431 and the inner frame region 432 may be the same or different. It is also possible to make the width different for each side of the region in accordance with the type and layout of the document to be photographed.

  The edge estimation unit 24 determines whether the binarized image data included in the outer frame region 431 is white at a predetermined ratio or more (step S42). When the binarized image data included in the outer frame region 431 is white for a predetermined ratio or more (Yes in step S42), the edge estimation unit 24 determines that the binarized image data included in the inner frame region 432 is predetermined. It is determined whether the ratio is black or more (step S43). In this case, in the binarized image data, the white image data is the image data of the background of the document and the background of the document such as a desk, and the black image data is other than the background of the document characters and images. Image data. That is, in this embodiment, the background color of the document and the color of the document itself in the binarized image data are set to white and the description content of the document is set to black. However, the present invention is not limited to this. It may be changed according to the color of the printed character.

  When the binarized image data included in the inner frame region 432 is black at a predetermined ratio or more (Yes in step S43), the edge estimation unit 24 identifies the edge of the acquired image data within the range of the outer frame region 431. (Step S44). The edge specified in step S44 is, for example, a broken line frame shown in FIG.

  The edge estimation unit 24 transmits the specified edge to the saved image selection unit 26, and ends the edge estimation process. Note that the edge specified in step S44 may be the outermost frame in the outer frame region 431, for example. Alternatively, the outer periphery of the ideal frame region 441 may be an edge. Alternatively, the middle frame of the ideal frame region can be used as an edge, and the maximum size of image data that can be displayed on the display unit 105 can be used as an edge. It is also possible to set an edge for each size of a document to be photographed. In this case, when the photographer activates the camera, a screen for selecting the size of the document to be photographed is displayed on the display unit 105. When the photographer selects a document size, edge estimation is performed using an edge corresponding to the type of the document.

  When the binarized image data included in the outer frame region 431 is black at a predetermined ratio or more (No in step S42), the edge estimation unit 24 ends the edge estimation process. In this case, since it can be considered that the shooting distance of the document is close, the preview unit 20 displays on the display unit 105 that the shooting distance of the document is close based on the estimation result of the edge estimation unit 24 and presents it to the user. May be. Based on the presented information, for example, the user moves the position of the photographing unit 121 to the far side of the document, and acquires image data again.

  If the binarized image data included in the inner frame region 432 is white for a certain ratio or more (No in step S43), the edge estimation unit 24 ends the edge estimation process. In this case, since the shooting distance of the document can be considered to be long, the preview unit 20 displays on the display unit 105 that the shooting distance of the document is long based on the estimation result of the edge estimation unit 24 and presents it to the user. May be. Based on the presented information, for example, the user moves the position of the photographing unit 121 closer to the document and acquires image data again.

  In the binarized image data, when the outer frame region 431 is white at a predetermined ratio or more, it can be estimated that the document edge and the document background are captured by the imaging unit 121. Therefore, it can be estimated that the entire photographing unit 121 document is photographed. However, in this case, the contents of the document in the acquired image data may be so small that it is difficult to read. In order to prevent such a situation, in the present embodiment, when the outer frame area 431 is white at a predetermined ratio or more and the inner frame area 432 is black at a predetermined ratio or more, it is in a state suitable for acquisition of stored image data. The image data is determined to be present, and the image data is registered in the saved image data storage unit 42. As a result, it can be confirmed that the description content has been acquired in an appropriate size, so that it is possible to store the character data and image data that are recognizable and readable from the image data of the document.

  Further, when the outer frame area 431 is white at a predetermined ratio or more and the inner frame area 432 is white at a predetermined ratio or more, it can be estimated that the document is photographed at a long distance. Therefore, since it is difficult to read the acquired image data, the image data is not registered.

  When the outer frame area 431 is black at a predetermined ratio or more, it is estimated that the image data of the entire target document has not been acquired because the distance is short, that is, the captured image data is incomplete. The determination of the outer frame region 431 and the inner frame region 432 may be performed in the reverse order.

  In the information processing apparatus 1 according to the present embodiment, when the stored image selection unit 26 determines that the edge is within the ideal frame region 411, the shooting unit 121 automatically captures a predetermined number of images and stores a plurality of storage candidates. Image data may be acquired, and image data with the least camera shake or focus shift may be selected in step S70 from among the plurality of acquired storage candidate image data. In this case, a countdown is displayed on the display unit 105 while the storage candidate image data is continuously acquired. Further, selection of image data having the least camera shake or focus shift can be realized by, for example, calculating a gradation change rate and selecting image data having the highest gradation change rate. Further, for the readability of the image data, corrections such as contrast correction, trapezoid correction, and shadow elimination of the stored image data may be performed. Thereby, image data with high readability can be stored.

  Further, the image data may be stored by trimming the outside of the edge or the outside of the ideal frame region 411. Thereby, only the image data of a necessary part can be registered.

  As described above, according to the information processing apparatus 1 of the present embodiment, it is determined whether or not the image data of the document to be imaged is an appropriate size, and only the image data of an appropriate size is acquired. Thereby, it is possible to acquire appropriate image data.

  Further, according to the information processing apparatus 1 of the present embodiment, even if the background color of the image is almost the same color because the color of the document and the desk are the same color, and the edge cannot be detected, the edge of the document is estimated, An image is acquired based on the estimated edge. For this reason, it is possible to acquire appropriate image data regardless of the shooting location.

That is, the information processing apparatus 1 according to the present embodiment can be shortened in time required for the procedure by being mounted on, for example, a sales staff terminal, thereby reducing the distribution time loss of the form. Therefore, the information processing apparatus 1 according to the present embodiment eliminates the work of the contractor copying and mailing a document such as a contract, and contributes to increasing the value of the sales staff visiting the contractor (second Embodiment)
Hereinafter, the information processing apparatus 100 according to the second embodiment will be described with reference to FIGS. 11 to 13. In addition, the same code | symbol is attached | subjected to the structure same as the information processing apparatus 1 of 1st Embodiment, and description is abbreviate | omitted.

FIG. 11 is a block diagram illustrating an overall configuration of the information processing apparatus 100 according to the second embodiment.

As illustrated in FIG. 11, the information processing apparatus 100 according to the present embodiment is configured to further include a readability determination unit 27 and a character string candidate storage unit 44 in the configuration of the information processing apparatus 1 illustrated in FIG. 1.

  The readability determination unit 27 includes a character recognition unit 28, and the image data of the document acquired by the imaging unit 121 with reference to the result of the character recognition unit 28 performing character recognition on the image data acquired by the imaging unit 121. However, a readability determination process is performed to determine whether the description content of the document is readable image data.

  Processing performed by the information processing apparatus 100 will be described with reference to FIG. FIG. 11 is a flowchart illustrating an example of processing of the information processing apparatus 100 according to the present embodiment.

  Since the processing from step S10 to step S50 in FIG. 12 is the same as the processing in the information processing apparatus 1 of the first embodiment, the description thereof is omitted. The processing from step S60 in FIG. 12 will be described.

  When the stored image selection unit 26 determines that the edge of the image data is within the ideal frame region 411 (Yes in step S60), the readability determination unit 27 determines the readability of the image data (step S90).

  With reference to FIG. 13, the determination process of the readability of the image data by the readability determination part 27 is demonstrated. FIG. 13 is a flowchart illustrating an example of image data readability determination processing according to the present embodiment.

  First, the character recognition unit 28 of the readability determination unit 27 performs character recognition of target image data (step S91). Here, the readability determination unit 27 searches the character string candidate storage unit 44 of the storage device 107 using the character string of the character recognition result (step S92). In the character string candidate storage unit 44, a character string that makes sense as Japanese and a character string that is unique to the document from which image data is to be acquired are registered in advance as keywords. That is, in step S92, the readability determination unit 27 searches for a keyword in the character string of the character recognition result.

  As a result of the search, if there is a keyword (Yes in step S93), the readability determination unit 27 determines that the image data is readable (step S94). Thereby, the readability determination unit 27 ends the readability determination process.

  As a result of the search, if there is no keyword (No in step S93) and the keyword search count is 3 or less (Yes in step S95), the readability determination unit 27 rotates the image data by 90 degrees (step S95). . Then, the processing from step S91 is repeated.

  If there is no keyword (No in step S93), and the number of keyword searches exceeds 3 (No in step S95), the readability determination unit 27 determines that the image data is not readable (step S97). Thereby, the readability determination unit 27 ends the readability determination process.

  Returning to the description of FIG. When the readability determination unit 27 determines that the image data is readable (Yes in step S100), the saved image data determination unit 26 selects the image data as saved image data (step S70). The saved image registration unit 25 registers the saved image data in the saved image data storage unit 42 (step S80). At this time, the angle rotated by the readability determination unit 27 is corrected and registered. Then, the information processing apparatus 100 ends the process.

  When the readability determination unit 27 determines that the image data cannot be read (No in step S100), the preview unit 20 displays a notification for prompting the user to reacquire the image on the display unit 105 (step S110). Then, the information processing apparatus 100 ends the process.

  As described above, the information processing apparatus 100 according to the present embodiment determines whether the size of the acquired image data is sufficient, and further determines whether the description is readable before registering the image data. Thereby, the information processing apparatus 100 of this embodiment enables acquisition of image data having sufficient readability. Therefore, it is possible to prevent a burden on the user and the customer, which occurs when the acquired image is incomplete, so that the user's work can be made efficient.

  As mentioned above, although some embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  For example, the ideal frame region 411 may be a region having a predetermined width from the set threshold value by setting a threshold value for the image size.

  Further, in the first embodiment, the edge estimation unit 24 saves image data when it is determined that the outer frame region 431 is white at a predetermined rate or more and the inner frame region 432 is black at a predetermined rate or more. It may be saved as data. That is, when the edge estimation process in step S40 in FIG. 7 is performed, the image data may be stored without performing the processes in steps S50 and 60 in FIG.

  DESCRIPTION OF SYMBOLS 1,100 ... Information processing apparatus, 101 ... Central processing control apparatus, 105 ... Display part, 107 ... Memory | storage device, 121 ... Imaging | photography part

Claims (10)

A shooting section for shooting documents;
An image acquisition unit for acquiring image data of the document imaged by the imaging unit;
A first determination unit that determines whether the color of the image data in the outer frame region that is a predetermined region is a color of the document itself or the background color of the document over a predetermined ratio;
A second determination unit that determines that the color of the image data in the inner frame area, which is a predetermined area inside the outer frame area, is not a color of the document itself and a background color of the document over a predetermined ratio; ,
An image registration unit that stores the image data in a storage device based on the determination result of the first determination unit and the determination result of the second determination unit;
An information processing apparatus comprising: A shooting section for shooting documents;
An image acquisition unit for acquiring image data of the document imaged by the imaging unit;
A first determination unit that determines whether the color of the image data in the outer frame region that is the predetermined region is white at a predetermined ratio or more;
A second determination unit that determines whether the color of the image data in the inner frame region, which is a predetermined region inside the outer frame region, is black at a predetermined ratio or more;
An image registration unit that stores the image data in a storage device based on the determination result of the first determination unit and the determination result of the second determination unit;
An information processing apparatus comprising: An edge estimation unit that estimates an edge of the image data based on a determination result of the first determination unit and a determination result of the second determination unit;
The image registration unit determines whether the estimated edge is included in an ideal frame region in which an appropriate size region of the image data is set in advance, and the image data is stored in the storage device based on the determination result. The information processing apparatus according to claim 1, wherein the information processing apparatus is registered.   The information processing apparatus according to claim 3, further comprising a preview unit that displays the ideal frame region and the image data on the display unit when the edge is not included in the ideal frame region. The imaging unit captures a plurality of image data,
The information processing apparatus according to claim 1, wherein the image registration unit registers image data having a highest gradation change rate from the plurality of image data.   Character recognition of the image data is performed, and a character string of the character recognition result is used and a character string stored in the character string candidate storage unit as a character string specific to the image data acquisition target. The information processing apparatus according to claim 1, further comprising a third determination unit that determines readability. Taking a document, and
Obtaining image data of the document photographed by the photographing unit;
Determining whether the color of the image data of the outer frame area which is a predetermined area is a color of the document itself or the background color of the document over a predetermined ratio;
Determining that the color of the image data in the inner frame area, which is a predetermined area inside the outer frame area, is not a color of the document itself and a background color of the document, not less than a predetermined ratio;
Storing the image data in a storage device based on the determination result of the first determination unit and the determination result of the second determination unit;
An information processing method comprising: Taking a document, and
Obtaining image data of the document photographed by the photographing unit;
Determining whether the color of the image data in the outer frame area, which is a predetermined area, is white above a predetermined ratio;
Determining whether the color of the image data in the inner frame area, which is a predetermined area inside the outer frame area, is black at a predetermined ratio or more;
Storing the image data in a storage device based on the determination result of the first determination unit and the determination result of the second determination unit;
An information processing method comprising: To a computer with a camera,
The ability to shoot documents,
A function of acquiring image data of the document photographed by the photographing unit;
A function of determining whether the color of the image data in the outer frame area which is a predetermined area is a color of the document itself or the background color of the document over a predetermined ratio;
A function of determining that the color of the image data in the inner frame region, which is a predetermined region inside the outer frame region, is not a color of the document itself or a background color of the document more than a predetermined ratio;
A function of storing the image data in a storage device based on a determination result of the first determination unit and a determination result of the second determination unit;
Information processing program that realizes To a computer with a camera,
The ability to shoot documents,
A function of acquiring image data of the document photographed by the photographing unit;
A function for determining whether the color of the image data in the outer frame area, which is a predetermined area, is white or more than a predetermined ratio;
A function of determining whether the color of the image data in the inner frame area, which is a predetermined area inside the outer frame area, is black at a predetermined ratio or more;
A function of storing the image data in a storage device based on a determination result of the first determination unit and a determination result of the second determination unit;
Information processing program that realizes

Images