JP6787298B2 - Image processing device - Google Patents

Description

The present invention relates to an image processing apparatus.

It is necessary to fill in personal information in a predetermined area on an application form (input form) to be submitted at a government office, hospital or store. Personal information is, for example, an address, a name and a date of birth.

The image forming apparatus described in Patent Document 1 scans a driver's license, masks personal information as appropriate, and then combines it with a form to maintain security related to the handling of personal information.

Japanese Unexamined Patent Publication No. 2009-140021

However, in the image forming apparatus described in Patent Document 1, only the masked license is attached to the form, and personal information cannot be input into a predetermined area of the input form. Therefore, the user needs to manually enter personal information in a predetermined area of the input form.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an image processing device capable of automatically inputting personal information into a predetermined area of an input form.

The image processing apparatus according to the present invention includes a display unit, an insertion area setting unit, an extraction unit, and an image processing unit. The display unit displays an input screen. The insertion area setting unit sets an insertion area in a designated area of the input screen displayed on the display unit by the user in the input form image. The insertion area is an area for inserting an image showing input information. The extraction unit extracts an image showing the personal information from the certificate image. The certificate image shows an image of a recording medium in which personal information is described. The image processing unit inserts an image showing the personal information into the corresponding insertion region.

According to the present invention, personal information can be automatically input into a predetermined area of an input form.

It is a schematic diagram which shows the image processing apparatus which concerns on embodiment of this invention. It is a block diagram which shows the control part. It is a schematic diagram which shows the input form. It is a schematic diagram which shows the display part. It is a schematic diagram which shows the display part. It is a schematic diagram which shows the display part. It is a schematic diagram which shows the display part. It is a schematic diagram which shows the input form image. It is a schematic diagram of a driver's license. It is a schematic diagram which shows the certificate image. It is a schematic diagram which shows the input form image which executed the function of automatic input.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals and the description is not repeated.

An embodiment of the image processing apparatus 100 according to the present invention will be described with reference to FIG. FIG. 1 is a schematic view showing an image processing apparatus 100 according to an embodiment of the present invention. The image processing device 100 is, for example, a copier, a printer, or a multifunction device. Hereinafter, as an example, a case where the image processing device 100 is a monochrome multifunction device having a printer function, a copying function, and a facsimile function will be described.

As shown in FIG. 1, the image processing device 100 includes an image reading unit 10, an image forming unit 20, a control unit 30, a storage unit 40, a document base 12, a document transport device 110, and an operation panel 120. , A paper feed cassette 130, a paper transport unit 140, and a paper discharge unit 170 are provided.

The image scanning unit 10 reads the image formed on the document M and acquires the scanned image. Specifically, the image scanning unit 10 reads an image formed on the document M conveyed by the document conveying device 110 or an image formed on the document M placed on the platen 12 and acquires a scanned image. The image reading unit 10 reads the input form image from the document M (recording medium) on which the input form image is formed, and the image reading unit 10 reads the certificate image from the recording medium on which the certificate image is formed. The input form image and the certificate image will be described later.

The image forming unit 20 forms an image on the recording medium P based on the scanned image read by the image reading unit 10.

The control unit 30 is a hardware circuit composed of a processor such as a CPU (Central Processing Unit) and an ASIC (Application Specific Integrated Circuit) or the like. The control unit 30 controls the operation of each unit of the image processing device 100 by the processor reading and executing the control program stored in the storage unit 40. The control unit 30 has an OCR (Optical Character Recognition) function. The OCR function is a function that optically recognizes characters (for example, hiragana, katakana, alphabed, kanji, numbers, symbols) contained in an image formed on a scanned document and converts the characters into character codes.

The storage unit 40 is composed of an HDD (Hard Disk Drive), a RAM (Random Access Memory), and a ROM (Read Only Memory). The storage unit 40 may include an external memory. The external memory is removable media. The storage unit 40 includes, for example, a USB (Universal Serial Bus) memory and an SD (Secure Digital) card as external memories. The storage unit 40 stores various data and a control program for controlling the operation of each unit of the image processing device 100. The control program is executed by the control unit 30.

The operation panel 120 is used to allow the user to operate the image processing device 100. The operation panel 120 has a display unit 122. An input screen for allowing the user to operate the image processing device 100 is displayed on the display unit 122. In addition, the display unit 122 displays an input screen for setting the insertion area. The setting of the insertion area will be described later with reference to FIGS. 6 to 8.

The paper cassette 130 contains a recording medium P for printing. When printing is performed, the recording medium P in the paper feed cassette 130 is conveyed by the paper conveying unit 140 so as to be ejected from the paper discharging unit 170 via the image forming unit 20.

The control unit 30 will be further described with reference to FIGS. 1 and 2. FIG. 2 is a block diagram showing the control unit 30.

As shown in FIG. 2, the control unit 30 includes an insertion area setting unit 32, an extraction unit 34, and an image processing unit 36. The insertion area setting unit 32 sets the insertion area in a predetermined area in the input form image. The input form image is an image showing an input form. The input form is, for example, an application form to be submitted at a government office, hospital or store. The input form contains multiple input information items. In each of the plurality of input information items, an image showing the input information is inserted in the area corresponding to the input information item. The insertion area is an area for inserting an image showing input information. The input information is personal information such as address, name and date of birth.

The extraction unit 34 extracts an image showing personal information from the certificate image. The certificate image shows an image of a recording medium in which personal information is described. The recording medium on which the personal information is described is, for example, a driver's license, a health insurance card, or a passport. The extraction unit 34 extracts a character string image or a photographic image as an image showing personal information. A character string image is an image including a character string. The photographic image is, for example, an ID photo showing an individual. The extraction unit 34 has an OCR function. The extraction unit 34 extracts the character string included in the character string image by the OCR function.

The image processing unit 36 inserts an image showing the personal information extracted by the extraction unit 34 into the corresponding insertion region.

As described above with reference to FIGS. 1 and 2, the image processing unit 36 inserts an image showing the personal information extracted by the extraction unit 34 into the corresponding insertion region. Therefore, personal information can be automatically entered in a predetermined area of the input form.

The automatic input to the input form of the image processing unit 36 will be further described with reference to FIGS. 1 to 11. In the present specification, the function of automatic input to the input form may be described as "Autofill Form".

First, the input form M1 will be described with reference to FIG. FIG. 3 is a schematic view showing the input form M1.

As shown in FIG. 3, the input form M1 includes a plurality of input information items. The plurality of input information items include input information items 211 to 218 and 220. Input information items 211 to 218 and 220 are, for example, items related to personal information. For example, the input information item 211 is "First name", the input information item 212 is "Middle name", and the input information item 213 is "Last name". In the input information item 220, an ID photo showing an individual is input.

Subsequently, the setting of the insertion area will be described with reference to FIGS. 4 to 8. 4 to 7 are schematic views showing the display unit 122. FIG. 8 is a schematic view showing the input form image G1. First, the function selection screen 230 will be described with reference to FIG. As shown in FIG. 4, when the function of "Autofill Form" is selected, the control unit 30 causes the display unit 122 to display the function selection screen 230. The function selection screen 230 includes function item buttons 232, 234, and 236, and an exit button 238. "Autofill Form Print" is assigned to the function item button 232. "Autofill Form Save" is assigned to the function item button 234. "Autofill Form Settings" is assigned to the function item button 236.

When the user touches each function item button, a screen for executing the function of the item assigned to the function item button is displayed. For example, when the user touches the function item button 236, a screen for executing "Autofill Form Settings" is displayed.

The Exit button 238 is a button for terminating the function of the "Autofill Form".

Subsequently, the setting screen 240 of the “Autofill Form” will be described with reference to FIG. From the state where the function selection screen 230 (see FIG. 4) is displayed, the setting screen 240 is displayed on the display unit 122 in response to the touch operation of the function item button 236 of the user.

As shown in FIG. 5, the setting screen 240 includes an input form image setting unit 250, a certificate image setting unit 260, and an exit button 270.

The input form image setting unit 250 includes a new registration button 252 and a correction button 254. The new registration button 252 is a button for newly registering the template of the input form. The modification button 254 is a button for modifying an input form that has already been registered.

The certificate image setting unit 260 includes a new registration button 262 and a correction button 264. The new registration button 262 is a button for newly registering the coordinate information of the certificate image. The correction button 264 is a button for correcting the coordinate information of the certificate image that has already been registered.

The Exit button 270 is a button for ending the display of the setting screen 240.

Subsequently, the setting of the insertion region 320 will be described with reference to FIGS. 6 to 8. FIG. 6 shows a setting screen 280 for inputting the insertion area 320. Hereinafter, a case where the insertion area 320 of the input information item “Nationality” is set will be described.

As shown in FIG. 6, the setting screen 280 has a scan button 272, an insertion area setting button 274, a Save button 276, a Cancel button 278, and a preview image display unit 290.

The scan button 272 is a button for scanning the input form M1. For example, when scanning the input form M1, the user H1 places the input form M1 on the platen 12 (see FIG. 1). Then, when the user H1 touches the scan button 272, the input form image showing the input form M1 is read by the image reading unit 10.

The insertion area setting button 274 is a button for setting the insertion area 320. By touching the insertion area setting button 274, the user H1 can set the insertion area 320 using the preview image 296 displayed on the preview image display unit 290.

The Save button 276 is a button for saving the setting of the insertion area 320. The Candle button 278 is a button for canceling the setting of the insertion area 320.

The preview image 296 is displayed on the preview image display unit 290. The preview image 296 includes an ID photo input unit image 292 and an input information item image 294.

The insertion area setting unit 32 sets the insertion area 320 based on the area designated by the user H1. For example, the user H1 drags the preview image 296 (traces with a finger) to specify the insertion area 320. Then, the insertion area setting unit 32 determines the coordinates of the area designated by the user H1 and stores the coordinates in the storage unit 40.

When the finger dragged by the user H1 is released from the display unit 122, the insertion area setting unit 32 causes the item name setting screen 300 to be displayed on the display unit 122 as shown in FIG. 7. The item name setting screen 300 includes an item name input unit 302, an OK button 304, and a Cancel button 306.

The name of the input information item corresponding to the insertion area 320 is input to the item name input unit 302 by the user H1. For example, when the item name input unit 302 is touch-operated by the user H1, the insertion area setting unit 32 displays a software keyboard for inputting the name of the input information item into the item name input unit 302. When the user H1 operates the software keyboard and inputs characters, the name of the input information item is input to the item name input unit 302.

The OK button 304 is a button for confirming the name of the input information item input to the item name input unit 302. When the user touches the item name input unit 302, the insertion area setting unit 32 stores the name of the input information item input to the item name input unit 302 in association with the insertion area 320 in the storage unit 40.

The Cancel button 306 is a button for canceling the input of the input information item name to the item name input unit 302.

When the user specifies the insertion area 320 and the name of the input information item for each of the plurality of input information items, the insertion area setting unit 32 sets each of the plurality of input information items, as shown in FIG. The insertion areas 321 to 328 are set. Further, the insertion area setting unit 32 stores the name of the input information and the insertion area 320 in the storage unit 40 in association with each of the plurality of input information items.

FIG. 8 is a schematic view showing an input form image G1 in which an insertion region is set. As shown in FIG. 8, the input form image G1 includes insertion areas 321, 328, 330. As shown in FIG. 8, the insertion area setting unit 32 sets the insertion areas 321 to 328 and 330 for each of the plurality of input information items. Specifically, the insertion areas 321 to 328 and 330 correspond to the input information items 211 to 218 and 220 shown in FIG. As described with reference to FIGS. 7 and 8, the insertion areas 321 to 328 and 330 are set to the insertion areas 320 by, for example, a user dragging (tracing with a finger) the preview image 296. Will be done.

Subsequently, the setting of the extraction region will be described with reference to FIGS. 9 and 10. FIG. 9 is a schematic view of the driver's license M2. The driver's license M2 is an example of "a recording medium in which personal information is stored". On one of the main surfaces of the driver's license M2, personal information images 411-420, 430, 432 showing personal information are printed. Specifically, the personal information image 411 is an image showing a "license number". The personal information image 412 is an image showing the "issue date of the driver's license". The personal information image 413 is an image showing a "birthday". The personal information image 414 is an image showing "Last Name". The personal information image 415 is an image showing "First Name". The personal information image 416 is an image showing an "address". The personal information image 417 is an image showing "height". The personal information image 418 is an image showing "gender". The personal information image 419 is an image showing "eye color". The personal information image 420 is an image showing "nationality". The personal information image 430 is an image showing an "ID photo". The personal information image 432 is an image showing a "signature". In this way, the personal information includes a plurality of personal information items.

Subsequently, FIG. 10 is referred to. FIG. 10 is a schematic view showing the certificate image G2. The certificate image G2 is an image obtained by scanning the license M2 shown in FIG. As shown in FIG. 10, the certificate image G2 includes personal information images 511-520, 530, 532. The personal information images 511-520, 530, 532 correspond to the personal information images 411-420, 430, 432 shown in FIG.

When registering the new certificate image G2, the extraction area R is set by touching the new registration button 262 on the setting screen 240 shown in FIG. Specifically, the coordinate information of the extraction region R is set in each of the personal information images 511 to 520, 530, and 532.

The set extraction area R is stored in the storage unit 40. Specifically, the storage unit 40 stores the extraction area included in the certificate image G2 in association with each of the plurality of personal information items. The storage unit 40 stores the extraction area R in association with, for example, the personal information item of “Last Name”. Specifically, the storage unit 40 stores the upper left coordinate and the lower right coordinate of the extraction area R in association with the personal information item of “Last Name”. For example, the storage unit 40 corresponds to the item of "Last Name" and has the upper left coordinate "X1 = 60, Y1 = 50" of the extraction area R and the lower right coordinate "X2 = 70, Y2 =" of the extraction area R. 52 ”is remembered.

When the personal information is automatically input to the input form image, the extraction unit 34 extracts an image showing the personal information based on the extraction area R. For example, the extraction unit 34 extracts an image included in the extraction area R. Then, the extraction unit 34 extracts the character string included in the image extracted by the OCR process. For example, the extraction unit 34 extracts the character string “SAMPLE” indicating “Last Name” based on the extraction area R. Similarly, the extraction unit 34 extracts an image showing personal information from the personal information images 511-520, 530, 532 based on the corresponding extraction area R.

As described above with reference to FIGS. 9 and 10, when the personal information is automatically input to the input form image, the extraction unit 34 extracts an image showing the personal information included in the certificate image G2. To.

A method of automatically inputting personal information into the input form image will be described with reference to FIG. FIG. 11 is a schematic view showing an input form image G3 in which the automatic input function is executed.

Select the desired input form from the input forms registered by the user. Then, the operation mode is selected. Specifically, when the user wants to print the input form after the automatic input, the user's function item button 232 is pressed from the state where the function selection screen 230 (see FIG. 4) is displayed. Alternatively, when the user wants to save the input form after the automatic input, the user's function item button 234 is pressed from the state where the function selection screen 230 (see FIG. 4) is displayed.

Then, when the user scans the driver's license, the extraction unit 34 extracts an image showing personal information based on the extraction area R, as described with reference to FIGS. 9 and 10.

Then, the image processing unit 36 inserts an image showing the personal information extracted by the extraction unit 34 into the corresponding insertion region. For example, as shown in FIG. 11, the image processing unit 36 inserts the image “SAMPLE” indicating the personal information extracted by the extraction unit 34 into the insertion region 323 associated with the “Last Name”.

The storage unit 40 stores the name of the input information item associated with the insertion area. In addition, the name of the personal information item associated with the extraction area is stored. The name of the personal information item and the name of the input information item correspond to each other. When the image processing unit 36 specifies the name of the input information item (“Last Name”), the image processing unit 36 specifies the name of the personal information item (“Last Name”) corresponding to the name of the specified input information item. Then, the extraction area associated with the name of the specified personal information item is specified. Then, the personal information extracted based on the specified extraction area is inserted into the insertion area associated with the name of the specified input information item. Therefore, the personal information extracted from the certificate image (driver's license) is inserted into the corresponding insertion area. Specifically, the images 602, 604, 606, 608, 610, 612, 614 indicate the personal information. It is inserted into the corresponding insertion areas 321, 323, 324, 325, 327, 328, 330. The insertion areas 322 and 326 are blank because the image showing the corresponding personal information was not extracted. The image 614 showing the personal information inserted in the insertion area 330 is a photographic image. It is preferable that the image 614 (photographic image) showing the personal information is inserted by changing the size according to the size of the insertion area 330.

The embodiments of the present invention have been described above with reference to the drawings (FIGS. 1 to 11). However, the present invention is not limited to the above-described embodiment, and can be implemented in various embodiments without departing from the gist thereof (for example, (1) to (4) shown below). The drawings are schematically shown mainly for each component for easy understanding, and the thickness, length, number, etc. of each component shown are different from the actual ones for the convenience of drawing creation. .. Further, the material, shape, dimensions, etc. of each component shown in the above embodiment are merely examples, and are not particularly limited, and various changes can be made without substantially deviating from the effects of the present invention. is there.

(1) In the embodiment of the present invention, the image processing device 100 includes the image reading unit 10, but the present invention is not limited to this. The image processing device 100 does not have to include the image reading unit 10. For example, the input form image and the certificate image may be read by using an external scanner such as a card scanner.

(2) In the embodiment of the present invention, the image processing device 100 is a multifunction device, but the image processing device 100 may be a printing machine, a copier, or a scanner.

(3) In the embodiment of the present invention, the image processing device 100 is a monochrome machine, but the image processing device 100 may be a color machine.

(4) In the embodiment of the present invention, the image processing device 100 is an electrophotographic image processing device 100, but the image processing device 100 may be an inkjet type image processing device. Specifically, the image may be recorded by ejecting ink from the recording head onto the sheet.

10 Image reading unit 20 Image forming unit 30 Control unit 32 Insertion area setting unit 34 Extraction unit 36 Image processing unit 40 Storage unit 100 Image processing device 122 Display unit 320, 321, 322, 323, 324, 325, 326, 327, 328 , 330 Insertion area 602, 604, 606, 608, 610, 612, 614 Image R extraction area showing personal information

Claims (6)

A display unit that displays the input screen and
In the input form image, an insertion area setting unit for setting an insertion area for inserting an image showing input information in a designated area of the input screen displayed on the display unit by the user,
An extraction unit that extracts an image showing the personal information from a certificate image showing an image of a recording medium on which personal information is described, and an extraction unit.
An image processing device including an image processing unit that inserts an image showing the personal information into the corresponding insertion region. The personal information includes a plurality of personal information items.
A storage unit for storing an extraction area included in the certificate image is further provided in association with each of the plurality of personal information items.
The image processing apparatus according to claim 1, wherein the extraction unit extracts an image showing the personal information based on the extraction region. The input information includes a plurality of input information items.
The name of the personal information item and the name of the input information item correspond to each other.
The storage unit stores the name of the input information item associated with the insertion area and the name of the personal information item associated with the extraction area.
When the image processing unit specifies the name of the input information item, the name of the personal information item corresponding to the name of the specified input information item and the extraction area associated with the name of the personal information item The second aspect of the present invention, wherein the image showing the personal information extracted based on the specified extraction area is inserted into the insertion area associated with the name of the specified input information item. Image processing device. The image processing apparatus according to any one of claims 1 to 3, wherein the extraction unit extracts a character string image or a photographic image as an image indicating the personal information. Claim 1 to claim 1, further comprising an image reading unit that reads the input form image from the recording medium on which the input form image is formed, or reads the certificate image from the recording medium on which the certificate image is formed. The image processing apparatus according to 4. The image processing device according to claim 1 to 5, wherein the recording medium on which the personal information is described includes a driver's license, a health insurance card, or a passport.

Images