JP2011253325A - Input support device, input support method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a new framework for supporting data-input operations using terminals by users.SOLUTION: Characters showing at least a part of names, address and birth date from the image of a driving license 51 generated by photographing in which the driving license 51 is placed on a light transmitting panel 3 and photographed from the bottom of the light-transmitting panel 3 are extracted. The extracted characters of the names, address and birth date are associated with the corresponding items on a predetermined input form. The light-transmitting panel 3 is a touch panel. It is also possible to perform the correction of the characters extracted based on the operation received by the touch panel.

Description

  The present invention relates to a technique for supporting data input work using a terminal by a user.

2. Description of the Related Art In recent years, terminals used to apply for some kind of product or service, such as a terminal called a so-called unmanned contract machine for applying for a loan installed in a store such as a bank, have become widespread. The user operates a so-called soft keyboard with a touch panel provided in the terminal, and inputs characters (for example, name and address) necessary for application, or operates a reading device provided in the terminal. , Make a copy of the ID needed to apply.
For example, Patent Documents 1 and 2 below disclose examples of terminals including a reading device.
Specifically, in Patent Document 1, an object having a predetermined shape is placed on the display screen, and a person moves the object or manipulates an image displayed on the display screen by drawing a figure. An image display apparatus capable of performing the above is disclosed.
Further, in Patent Document 2, when imaging is performed by using an external light monitor or other methods, and when extraneous light is insufficient, the effective transmittance of the light control sheet is increased so that more extraneous light is taken in. Thus, there is disclosed a projection apparatus with an imaging function that secures a white background level and conversely reduces the effective transmittance in a place that is too bright.
Further, Patent Document 3 discloses a customer operation type terminal device in which a set position of a reading target such as a form or an identification card is set on the screen of the customer operation display unit 6 and is read from above.

JP 2007-11276 A JP 2009-171442 A JP 2005-184361 A

By the way, a user who cannot input characters by touch panel operation (for example, a soft keyboard) requires much time and effort to apply for a product or service by terminal operation. Due to such a problem of convenience, there also arises a problem that the rotation efficiency of the terminal deteriorates.
However, the devices disclosed in Patent Documents 1 and 2 are not expected to be used as a terminal for applying for goods and services because the user is not expected to input characters and the like. . Therefore, the devices disclosed in these documents cannot solve the above-described problems related to the convenience of the terminal.
An object of the present invention is to provide a new framework for supporting data input work performed by a user using a terminal.

  An input support apparatus according to the present invention includes a translucent panel, an imaging unit that captures an object placed on the translucent panel from below the translucent panel, and an image of the object that is generated by imaging. And an information extracting unit that extracts at least a part of predetermined information.

  In an embodiment of the present invention, an information-related unit that associates the extracted information with a corresponding item in a predetermined input form is provided. In this case, the translucent panel may be a touch panel, and the information related unit may associate the extracted information with a corresponding item in the input form based on an operation received by the touch panel.

In another embodiment of the present invention, a display control unit that displays the extracted information on the translucent panel in real time is provided.
In another embodiment, the translucent panel is a touch panel, and the input support device may further include an information correction unit that corrects the extracted information based on an operation received by the touch panel. Good.

  In another embodiment, the information extraction unit extracts at least part of characters representing predetermined information from the subject image by OCR processing, and the input support device further performs the OCR processing. A correction log recording unit that records the accuracy and the correction information of the character extracted by the OCR process in association with each other is provided.

In another embodiment, an upper photographing unit that photographs the same subject as that disposed on the translucent panel from above the translucent panel, and the information extracting unit is disposed above the translucent panel. At least a part of the predetermined information is extracted from the image of the subject generated by the shooting.
In another embodiment, the information extraction unit may write information extracted from the image of the subject to a volatile recording medium.

  The input support method according to the present invention includes a step of photographing a subject arranged on a translucent panel from below the translucent panel, and at least predetermined information from an image of the subject generated by photographing. Extracting a part.

The program of the present invention is a computer program that causes an information processing apparatus to execute the input support method.
In the present invention, even if the function of one functional unit or device is realized by two or more physical means or devices, the function of two or more functional units or devices is achieved by one physical means or device. It may be realized.

  According to the present invention, since at least a part of predetermined information is extracted from the image of the subject, it is possible to support the data input operation performed by the user using the terminal and reduce the burden on the user. can do.

It is a figure which shows the whole structure of the input assistance apparatus of 1st Embodiment. It is a figure which shows the hardware constitutions of an input assistance apparatus. It is a figure which shows the function structure of an input assistance apparatus. It is a flowchart which shows the flow of the input assistance process of the data to the predetermined input form by an input assistance apparatus. It is a figure which shows the state which has arrange | positioned the to-be-photographed object on a touch panel. It is a figure which shows the state which displayed on the translucent panel the information (extracted information) extracted from the image | photograph of a to-be-photographed object, and the input form in which this extracted information was reflected. It is a figure explaining the specific example of the method of setting an area | region on a touch panel. It is a figure explaining the modification of an input assistance device. It is a figure explaining another modification of an input support device. It is a figure explaining another modification of an input support device. It is a figure explaining another modification of an input support device. It is a figure which shows the flow of the input assistance process by an input assistance apparatus provided with an upper imaging | photography part. It is a figure which shows the flow of the input assistance process by an input assistance apparatus provided with an upper imaging | photography part. It is a figure explaining embodiment which image | photographs the document corresponding to an input form and extracts the information regarding the item in an input form. It is a figure explaining embodiment which displays extracted information on a translucent panel in real time.

  Hereinafter, as a first embodiment of the present invention, an input support apparatus 1 that has a projection display function and an imaging function and assists a user in inputting application information for products and services will be described with reference to the drawings.

FIG. 1 schematically shows the overall configuration of the input support apparatus 1 of the first embodiment.
The input support device 1 includes a translucent panel 3, a control device 5, a display unit 7, and a photographing unit 9. In the first embodiment, for example, the translucent panel 3 is disposed so as to form a part of the upper surface of the housing 11, and the control device 5, the display unit 7, and the imaging unit 9 are appropriately disposed in the housing 11. Is done. In FIG. 1, a cord and a board that connect each piece of hardware are omitted.

  The translucent panel 3 is a translucent panel in which a touch panel 13 that receives an operation from a user and a screen 15 that displays an image via the touch panel 13 are overlapped with an appropriate interval or without gaps. Use. The translucent panel 3 forms a document table and a reading surface on which a subject (for example, some application form or identification card) photographed by the photographing unit 9 is arranged.

As the touch panel 13, a touch panel with a high transmittance (for example, a capacitance method, or the like, which can instruct an operation to an electronic device (here, the input support device 1) with a finger or a dedicated pen (such as a stylus pen). Optical type etc. are used.
In addition, as the screen 15, a member whose translucency changes according to voltage (for example, UMU film (registered trademark)) is used.
In FIG. 1, the thickness of the translucent panel 3 (touch panel 13 and screen 15) is exaggerated.

  The control device 5 controls the function of setting an area on the translucent panel 3, the function of changing the translucency of the translucent panel 3 (specifically, the translucency of the screen 15), and the display unit 7. It has various functions such as a function, a function for controlling the photographing unit 9, and a function for extracting desired information from an image generated by photographing. Details of the hardware configuration and functions of the control device 5 will be described later with reference to FIGS.

The display unit 7 irradiates the area on the translucent panel 3 set by the control device 5 with light for photographing or projects an image (user interface or the like) to be presented to the user onto the screen 15. In the first embodiment, a known projector such as a CRT projector, a liquid crystal projector, or a DLP projector is used as the display unit 7. Hereinafter, in the first embodiment, the display unit 7 is referred to as a projector 7.
The shooting light emitted by the projector 7 is used for projecting an image corresponding to the set area (for example, an image of white color) onto a range corresponding to the set area of the screen 15. It is light and plays the role of a so-called strobe. In the figure, a broken line shown between the projector 7 and the screen 15 represents a light irradiation range by the projector 7.

The photographing unit 9 photographs the reflected light from the translucent panel 3 of the light irradiated on the translucent panel 3 (specifically, the screen 15) from below the translucent panel 3.
In the first embodiment, a known digital camera including an image sensor such as a CCD image sensor or a CMOS image sensor is used as the photographing unit 9. Hereinafter, in the first embodiment, the photographing unit 9 is referred to as a camera 9. In the figure, the broken line shown between the camera 9 and the screen 15 represents the imaging range by the camera 9.

FIG. 2 shows a hardware configuration of the input support apparatus 1.
In the input support device 1 according to the first embodiment, the touch panel 13, the screen 15, the projector 7, and the camera 9 are connected to the control device 5 so as to be able to communicate with each other. The control device 5 includes components such as a CPU 21, a ROM 22, a RAM 23, an HDD (hard disk) 24, and a communication device 25 that are communicably connected via a bus.

FIG. 3 shows a functional configuration of the control device 5.
The control device 5 includes an area setting unit 31, a translucency control unit 32, a display control unit 33, an imaging control unit 34, an information extraction unit 35, an information related unit 36, an information correction unit 37, and a correction log recording unit 38. . These functional units are functionally realized, for example, when the CPU 21 reads and executes a predetermined program on the RAM 23 from a storage device such as the HDD 24 or the ROM 22. In the following, each function unit will be described in principle in the order of reference numerals, but for convenience of description, the display control unit 33 and the imaging control unit 34 will be described last.

  The area setting unit 31 sets an area on the translucent panel 3 based on an operation received from the user on the touch panel 13. Specifically, for a subject placed on the touch panel 13, when the position of the subject on the touch panel 13 is designated by a touch panel operation, a region corresponding to the designated position is irradiated with photographing light. Set as the area to be. An example of the region setting method will be described later with reference to FIG.

  The translucency control unit 32 changes the translucency of the screen 15. For example, when an image to be presented to the user is projected and displayed on the screen 15 by the projector 7, when the camera 9 shoots with the camera 9, the translucency of the screen 15 is lowered (changed more opaque (for example, translucent)) Increase the translucency of 15 (change to more transparent).

  The information extraction unit 35 extracts at least a part of predetermined information from an image of a subject generated by photographing, and writes the extracted information in a volatile recording medium such as the RAM 23. In the first embodiment, the information extraction unit 35 extracts at least part of characters representing predetermined information (for example, name, address, date of birth, etc.) from the subject image by a known OCR process. At the same time, it is configured to output information representing the accuracy (likelihood) of the OCR process.

  The information association unit 36 associates information extracted from the image of the subject by the information extraction unit 35 with a corresponding item in a predetermined input form. In the first embodiment, the extracted information is associated with the corresponding item in the input form based on the operation received on the touch panel 13.

  The information correction unit 37 corrects the information extracted from the subject image by the information extraction unit 35 based on the operation received on the touch panel 13.

  The correction log recording unit 38 records the accuracy of the OCR process performed by the information extraction unit 35 and the correction information of the character extracted by the OCR process by writing them in a storage device such as the HDD 24, for example.

  The display control unit 33 determines light conditions (for example, an image pattern, luminance, color, and the like) that the projector 7 irradiates the screen 15 and controls the projector 7 so that light is emitted under the determined conditions. To do. For example, the projector 7 is controlled so that information extracted from the image of the subject by the information extracting unit 35 and information corrected by the information correcting unit 37 (information after correction) are displayed on the translucent panel 3.

  The photographing control unit 34 controls the camera 9 so that the reflected light from the screen 15 is photographed at the timing when the projector 7 irradiates the translucent panel 3 with photographing light.

  FIG. 4 is a flowchart showing a flow of data input support processing for a predetermined input form by the input support device 1, and FIG. 5 shows a subject (for example, a driver's license as an identification card) 51 on the touch panel 13. FIG. 6 shows a state where information extracted from the image of the subject 51 (extracted information) and an input form reflecting the extracted information are displayed on the translucent panel 3, FIG. 7 shows a specific example of a method for setting an area on the touch panel 13. Hereinafter, such input support processing will be described with reference to FIGS.

  Until the area setting unit 31 sets an area on the touch panel 13 (executes the area setting process), the translucency control unit 32 of the input support apparatus 1 makes the translucent panel 3 opaque (for example, translucent). The display control unit 33 controls the projector 7 to irradiate the screen 15 with predetermined light, and displays a screen (image) as shown in FIG. It shall be. In FIG. 5A, the hatched lines on the touch panel 13 indicate that the translucent panel 3 is in an opaque state, not an image pattern.

First, as shown in FIG. 5A, the user places the subject 51 (driver's license as an identification card) on the touch panel 13 with one side (for example, the front side) facing down, When the Scan button 52 for instructing photographing is pressed, the photographing control unit 34 of the input support apparatus 1 controls the camera 9 to photograph one surface of the subject 51 (S41).
Specifically, first, the area setting unit 31 sets an area on the translucent panel 3 in accordance with a touch panel operation by the user. For example, the region setting unit 31 sets a region corresponding to the position of the subject 51, triggered by pressing of the Scan button 52. Hereinafter, in the translucent panel 3, the set area is referred to as “set area”, and the other area is referred to as “margin area”.

  When the region is set, the translucency control unit 32 increases the translucency of the screen 15 of the translucent panel 3 and changes the screen 15 to a transparent state, for example.

Next, the display control unit 33 controls the projector 7 in accordance with the timing when the translucency of the screen 15 increases (for example, when the screen 15 becomes transparent), and as shown in FIG. Light for photographing is irradiated, and dark light is irradiated by the blank area 55.
As a result, the subject arranged on the touch panel 13 is irradiated with photographing light. In FIG. 5B, the dot pattern shown in the margin area 55 does not represent the pattern of light (image) irradiated by the projector 7, but the entire margin area 55 is irradiated with a dark color. Represents. 5B, the subject 51 is not shown in order to describe the state of the translucent panel 3 when the projector 7 emits light.

Then, the photographing control unit 34 controls the camera 9 in accordance with the timing when the projector 7 irradiates the light transmitting panel 3 with light for photographing, and photographs the reflected light from the light transmitting panel 3. To do. As a result, an image in which the set area, that is, the subject 51 arranged on the touch panel 13 is clearly displayed and the blank area is displayed in a dark color (black or the like) is generated.
Thus, in the input support device 1 of the first embodiment, the projector 7 irradiates a darker color with respect to the blank area at the time of shooting, so that the user's eyes are not dazzled.

Next, the information extraction unit 35 performs OCR processing on the image of the subject 51 generated by photographing, and extracts at least a part of predetermined information (S42).
Specifically, in the first embodiment, the predetermined information is the name, address, and date of birth, and the information extraction unit 35 obtains the name, address, and date of birth from the image of the subject 51. The item name is extracted, and characters described in correspondence with the item name are extracted.

  Then, the information extraction unit 35 writes the extracted information into a volatile recording medium such as the RAM 23 (S43). As a result, when the power of the input support apparatus 1 is turned off, the information extracted by the OCR process is deleted, so that leakage of personal information of the user can be suppressed and the user can feel secure. Can do.

When the information extraction from the image of the subject 51 is completed, the display control unit 33 displays the extracted information and the input form corresponding to the predetermined application form on the touch panel 13 (S44).
Specifically, as shown in FIG. 6A, the display control unit 33 controls the projector 7 to extract the extracted information 61 in the right area of the touch panel 13 and the input form 62 in the left area of the touch panel 13. Are displayed so as to be operable on the touch panel 13 (for example, displayed so that they can be selected and dragged). The extracted information 61 and the input form 62 can be displayed at an arbitrary position on the touch panel 13 regardless of the illustrated example.

Next, the information correction unit 37 determines whether or not there has been a correction instruction from the user for the extracted information 61 (S45).
Specifically, for example, when any of the extracted information 61 is pressed (selected) by the user and then the correction button 64 for instructing execution of the correction process is pressed, the correction instruction Judge that there was.

When there is no correction instruction (when the determination in S45 is No), the information related unit 36 associates the extracted information 61 with the corresponding item in the input form 62 based on the operation received on the touch panel 13 (S46).
Specifically, as shown in FIG. 6B, one of the input forms 62 is selected in a state in which any of the extracted information 61 (for example, information related to the name) is pressed (selected) by the user. When dragged (moved) onto an item (for example, an item related to a name), the information-related unit 36 associates the moved information with the item in the input form 62 that is the movement destination.

  Further, among items in the input form 62, for items that do not correspond to the extracted information 61 (items related to gender and plan in FIG. 6), information is input by operating check boxes, list boxes, and the like on the touch panel 13. It is good to be able to do it. And the information relevant part 36 shall be related with the corresponding item also about the information input in this way.

  And the information correction part 37 judges whether the correction instruction | indication was received from the user about the extracted information 61 similarly to S45 (S47). Note that the extracted information 61 here includes information associated with the corresponding item in the input form 62 (information moved and displayed on the input form 62).

On the other hand, when there is a correction instruction in S45 or S47, the information correction unit 37 corrects the extracted information 61 based on the operation received on the touch panel 13 (S48).
Specifically, for example, correction candidate information (for example, characters) and a so-called software keyboard (a soft keyboard) for inputting correction contents are displayed on the touch panel 13 (specifically, by the display control unit 33). Process), the input of correction content is received from the user for the extracted information 61 to be corrected, and the extracted information 61 is corrected with the received content.

Next, the input support apparatus 1 determines whether or not the input of information to the input form 62 has been completed (S49).
Specifically, when the user presses the completion button 65 for notifying that the input has been completed, it is determined that the input has been completed. When the input support apparatus 1 determines that the input has not been completed, the process proceeds to S47, and thereafter waits until there is a correction instruction or the input is completed.

  On the other hand, when the input is completed (when the completion button 65 is pressed), the correction log recording unit 38 determines the accuracy of the OCR processing by the information extraction unit 35 and the correction information of the character extracted by the OCR processing. Are recorded in a storage device such as the HDD 24 as log information (S50).

  Then, the input support apparatus 1 transmits the information associated with each item of the input form 62 and the log information to the management center that performs the reception work of the service corresponding to the input form 62 (S51), and ends the processing. To do.

Next, an example of a method for setting an area on the translucent panel 3 according to the touch panel operation at the time of photographing the subject 51 (S41) will be described in detail.
As shown in FIG. 7A, a point on the touch panel 13 (for example, the upper left corner of the subject 51 arranged at an arbitrary position on the touch panel 13) is pressed, and subsequently, as shown in FIG. 7B. When the scan button 52 (see FIG. 5A) is pressed after a point on the touch panel 13 (for example, the lower right corner of the subject 51) is pressed, the area setting unit 31 is pressed. Two points are set as points for designating an area (area designation point P1 and area designation point P2).
Then, the area setting unit 31 sets a rectangular area having the coordinates of the area designation points P1 and P2 as diagonal coordinates.
As a result, as shown in FIG. 7C, at the time of shooting, the set area 54 on the touch panel 13 is irradiated with shooting light, and the blank area 55 is irradiated with darker light.

  Note that the method of setting the area on the translucent panel 3 is not limited to the above, and the area corresponding to the outer shape of the subject is traced by tracing the outer edge of the subject with the finger on the touch panel 13. It may be set, or a region corresponding to an arbitrary shape formed by pressing each corner of the subject and connecting the corners with line segments in the pressed order may be set.

  As described above, according to the input support device 1 of the first embodiment, a user who applies for a predetermined service basically operates the information extracted from the image of the subject 51 on the touch panel 13 ( By selecting or dragging, it is possible to input information necessary for the application (association between the extracted information 61 and items in the input form 62). Thereby, even a user unfamiliar with inputting characters by operating the touch panel 13 can easily input application information.

  In the management center, service acceptance processing is performed based on the received information. Then, by referring to the log information at that time, it is possible to determine whether or not to permit the use of the service. For example, when the accuracy of the OCR process and the correction information do not match, for example, the character recognized by the OCR process is corrected even though the accuracy of the OCR process is high (the possibility that the character is correctly extracted) is high. If this is the case, it may be determined that an illegal input has been made and the use of the service is not permitted.

The first embodiment of the present invention has been described above, but the present invention is not limited to the above-described embodiment, and can be variously modified and applied as described below. In the drawings for explaining the modified examples, elements having the same reference numerals as the elements in the drawings relating to the first embodiment or any modified example basically have the same functions. It shall be.
[Modification]
For example, in the input support apparatus 1 described in the first embodiment, an image scanner (for example, a line scanner) is used as a photographing unit instead of the camera 9, or a transparent display (for example, instead of the projector 7 and the screen 15) is used. A so-called organic EL display made transparent, etc.) may be used as a display unit, and an upper photographing unit (for example, a digital camera) for photographing a subject arranged on the translucent panel 3 from above may be provided. .
Specifically, as shown in FIG. 8, the modified input support device 81 has substantially the same function as the input support device 1 described in the first embodiment, and the camera 9 is a translucent panel 3. An upper photographing unit (hereinafter referred to as an upper camera) 82 is provided for photographing the same subject that is photographed from below from above the translucent panel 3. In this example, the imaging control unit 34 controls the camera 9 and the upper camera 82.

  As shown in FIG. 9, the input support device 91 of another modification has substantially the same function as the input support device 1 described in the first embodiment, and includes an upper photographing unit 82 and the first implementation. Instead of the camera 9 described in the embodiment, an image scanner (for example, a line scanner) 93 is provided. In this example, the imaging control unit 34 controls the image scanner 93 and the upper camera 82.

  As shown in FIG. 10, the input support apparatus 101 of another modification has substantially the same function as the input support apparatus 1 described in the first embodiment, and includes an upper photographing unit 82. In addition to the projector 7 and the screen 15 described in the above, a transparent display 102 and an illumination device 103 that functions as a so-called strobe for irradiating photographing light are provided. In this example, the display control unit 33 controls the transparent display 102, and the imaging control unit 34 controls the camera 9, the illumination device 103, and the upper camera 82. In this example, the translucency control unit 32 is not necessarily required.

  As shown in FIG. 11, the input support apparatus 111 of another modified example has substantially the same function as the input support apparatus 1 described in the first embodiment, and includes an upper photographing unit 82. Instead of the projector 7 and the screen 15 described in the above, a transparent display 102 is provided, and an image scanner (for example, a line scanner) 93 is provided instead of the camera 9. In this example, the display control unit 33 controls the transparent display 102, and the shooting control unit 34 controls the image scanner 93. In this example as well, the translucency control unit 32 is not necessarily required.

12 and 13 show the flow of data input support processing for a predetermined input form by the input support device 81 including the upper photographing unit 82.
The input support device 81 including the upper photographing unit 82 performs OCR processing on characters written on the front and back surfaces of a subject 121 (for example, a driver's license as an identification card) disposed on the touch panel 13. And at least a part of the predetermined information is extracted.
For example, as illustrated in FIG. 13, when the subject 121 with the new address on the back surface is arranged on the touch panel 13 with the front side facing down, the shooting control unit 34 uses the camera 9 and the upper shooting. The unit 82 is controlled to cause the camera 9 to photograph the front side of the subject 121 and cause the upper photographing unit 82 to photograph the back side of the subject 121.

Then, the information extraction unit 35 extracts at least a part of predetermined information from each of the front and back images of the subject 121 generated by photographing. In this example, characters representing the name, address, and date of birth are extracted from the image on the front surface of the subject 121 (driver's license) by OCR processing, and characters representing the new address are extracted from the image on the back surface.
In addition, when the information extraction unit 35 extracts information of the same type (in this example, an address) from each of the front and back images of the subject 121, the information extraction unit 35 holds new information as extracted information for the type. Shall. Specifically, in the illustrated example, information extracted from the image on the front surface is deleted, and information extracted from the image on the back surface (newer information) is held as extracted information.

Next, as shown in FIG. 13, the display control unit 33 controls the projector 7 to extract the extracted information 131 in the right area of the touch panel 13, the input form 132 in the left area of the touch panel 13, and the touch panel 13. Is displayed so that it can be operated (for example, displayed so that it can be selected and dragged).
The contents of processing by the other input support device 81 (control device 5) are the same as those described in the first embodiment. Also, other input support devices 91, 101, and 111 including the upper photographing unit 82 can execute the same processing as described above.

  Also, for example, unlike the first embodiment, as shown in FIG. 14, together with a subject (for example, a driver's license as an identification card) 51, a document corresponding to a predetermined input form (for example, a service use application) 141 may be arranged on the touch panel 13 and photographed by a photographing unit such as the camera 9 or the image scanner 93, and predetermined information may be extracted by OCR processing from an image generated by photographing. Thereby, from the part corresponding to the driver's license 51 in the image, extracted information to be used for input to the input form is extracted, and from the part corresponding to the service use application form 141 in the image, the input form is extracted. Information representing each item in is extracted.

  As shown in this example, for example, by extracting predetermined information from the front and back images of the identification card and using it as extracted information, unauthorized use of the identification card can be suppressed. For example, in general, when a copy of an ID card is sent to a management center along with an application for a product or service, the front and back copies of the ID card must be copies of the same ID card. Can not be confirmed. On the other hand, if the input support device 81 provided with the upper photographing unit 82 is used, the front and back surfaces of the same subject (for example, a driver's license as an identification card) are photographed and information extracted from each image is used. Since the input to the input form is performed, the front and back images cannot be prepared based on different subjects, so that unauthorized use of the identification card can be suppressed.

Further, for example, in the input support device 81 including the upper photographing unit 82, the display control unit 33 and the photographing control unit 34 of the control device 5 control the projector 7, the camera 9, and the upper photographing unit 82, respectively, and extract the extracted information. You may make it display on the translucent panel 3 in real time.
Specifically, for example, as shown in FIG. 15, it is detected in real time whether or not a subject (for example, a driver's license placed inside out) 151 exists on the touch panel 13. If it is removed, it may be possible to erase the extracted information 152 from the touch panel 13. Thereby, it is possible to give the user a sense of security that the personal information described in the identification card is not used unnecessarily in the apparatus.

  As a method for detecting whether or not the subject 151 is present on the touch panel 13, for example, the upper photographing unit 82 photographs the subject 151 in real time, and an image generated by the photographing changes (for example, corresponds to the subject 151). For example, a method of detecting that the amount of change in the pixel value of a portion that exceeds the threshold value may be considered. Also, other input support devices 91, 101, and 111 including the upper photographing unit 82 can execute the same processing as described above. Note that the subject 151 may be detected in real time by the photographing unit 9 provided in the apparatus.

  Further, for example, unlike the case described in the first embodiment, the information related unit 36 may associate the extracted information with the corresponding item in the input form regardless of whether any operation is received on the touch panel 13. Good. In this case, the user does not need to associate the extracted information 61 with the item in the input form 62 as shown in FIG. 6B on the touch panel 13, but only makes corrections as necessary. Therefore, the application information can be input more easily.

  Further, for example, in the first embodiment, the information extraction unit 35 extracts at least part of predetermined information from the subject image by OCR processing, but there is a character to be extracted in the image. A portion (partial image) may be cut out, and the cut out partial image may be extracted information. As a result, even when the predetermined information cannot be accurately recognized and extracted, such as when the accuracy of the OCR process is extremely low, the input work can be performed on the input form using the extracted information.

DESCRIPTION OF SYMBOLS 1,81,91,101,111 ... Input support apparatus 3 ... Translucent panel 5 ... Control apparatus 7 ... Projector (display part)
9 ... Camera (shooting unit)
DESCRIPTION OF SYMBOLS 11 ... Housing | casing 13 ... Touch panel 15 ... Screen 31 ... Area | region setting part 32 ... Translucency control part 33 ... Display control part 34 ... Shooting control part 35 ... Information extraction part 36 ... Information related part 37 ... Information correction part 38 ... Correction Log recording unit 82 ... Upper photographing unit 93 ... Image scanner 102 ... Transparent display 103 ... Lighting device

Claims (10)

A translucent panel;
A photographing unit that photographs a subject arranged on the translucent panel from below the translucent panel;
An information extraction unit that extracts at least part of predetermined information from the image of the subject generated by photographing;
An input support apparatus.   The input support apparatus according to claim 1, further comprising an information related unit that associates the extracted information with a corresponding item in a predetermined input form. The translucent panel is a touch panel,
The input support apparatus according to claim 2, wherein the information related unit associates the extracted information with a corresponding item in the input form based on an operation received on the touch panel.   The input support apparatus according to claim 1, further comprising a display control unit that displays the extracted information on the translucent panel in real time. The translucent panel is a touch panel,
The input support apparatus according to claim 1, further comprising an information correction unit that corrects the extracted information based on an operation received by the touch panel. The information extraction unit extracts at least part of characters representing predetermined information from the subject image by OCR processing,
The input support apparatus according to claim 5, further comprising a correction log recording unit that records the accuracy of the OCR process and the correction information of the character extracted by the OCR process in association with each other. An upper photographing unit that photographs the same subject as that disposed on the translucent panel from above the translucent panel;
The input support apparatus according to claim 1, wherein the information extraction unit extracts at least a part of predetermined information from an image of the subject generated by photographing from above the translucent panel.   The input support apparatus according to claim 1, wherein the information extraction unit writes information extracted from the image of the subject to a volatile recording medium. Photographing a subject placed on the translucent panel from below the translucent panel;
Extracting at least a part of predetermined information from the image of the subject generated by photographing;
Input support method including   A computer program for causing an information processing apparatus to execute the input support method according to claim 9.

Images