JP5754293B2 - Entry support system and server device - Google Patents

Description

The present invention fill support system, server device, relates to entry support apparatus, and a program, particularly relates to a fill support system and a server equipment to help fill in the object entry thereof.

  When filling out various forms such as application forms and invoices, for example, each form item included in the image obtained by photographing the form to be filled in using a camera mounted on a mobile phone. For example, a technique for supporting entry in a form by combining an entry method, an entry example, and the like and providing it to the entry person is disclosed (see, for example, Patent Document 1 and Patent Document 2).

  In Patent Document 1, a target device, a server device that provides help information, and a mobile communication terminal are connected to a network, the target device transmits a device ID and a status code to the server device, and the mobile communication terminal identifies the target device. Help information providing system that extracts an image of a marker attached to a target device from captured image data obtained by imaging, acquires a device ID and a surface code of the target device from the extracted marker image, and transmits the acquired device ID to the server device Is disclosed. This help information providing system provides unique help corresponding to the state of the target device based on the device ID and status code transmitted from the target device by the server device and the device ID and surface code transmitted from the mobile communication terminal. The information is transmitted to the mobile communication terminal, and the mobile communication terminal is characterized in that the help information providing image data is generated and displayed by synthesizing the transmitted help information and the captured image data.

  Patent Document 2 discloses a plurality of forms for one procedure, entry field information including information for specifying entry fields included in each form, a processing device that processes each form, and each of the processing devices. A document providing device that provides a set of application documents including process definition information including processing order information, and an image of the input application document is read, and an image of each form is entered from the read application document image. The column information and process definition information are acquired, the image content of each entry column is extracted from the image of each form based on the acquired entry column information, and each entry column is filled based on the extracted image content of each entry column. When it is determined that all the fields are filled in, a display is made to prompt the user to fill in the fields that have been determined to be unfilled and re-enter the results. , Process definition information The image of each form, entry field information from the window device that transmits the extracted image of each form, entry field information, and process definition information to the first processing apparatus in the processing order, and the window device or other processing device And processing definition information is received, based on the entry field information and the processing definition information, the image of the form to be processed by the processing device is specified from the images of the form group, and predetermined processing is performed on the specified form image. If there is a processing device next to the processing device in the processing order represented by the processing definition information, one or more processing devices that transfer the image of each form, entry field information, and processing definition information to the next processing device. An electronic application processing system provided is disclosed.

JP 2010-219879 A JP 2009-48321 A

  However, in the techniques described in Patent Documents 1 and 2, since the filling method and filling examples are combined and displayed for a plurality of unfilled filling areas, not only the readability is deteriorated but also filling is hindered. There was a problem.

The present invention has been made to solve the above problems, and aims to provide a complete support system and a server equipment capable of supporting entry to the fill material without deteriorating the readability To do.

To achieve the above object mentioned above, fill support system according to claim 1, imaging means for imaging an object entry having a plurality of writing areas, where the object to be filled was obtained been captured by the imaging means Predetermined specific auxiliary information used for specifying an area corresponding to an unfilled entry area among the plurality of areas in an image including a plurality of areas corresponding to a plurality of entry areas, and filling in the unfilled entry area Requesting means for requesting a predetermined request destination to provide support related information configured to include predetermined support information for supporting the request, and the specific auxiliary information provided from the request destination in response to a request from the request means Based on the above, one area corresponding to the unfilled entry area from the plurality of areas in the image including the plurality of areas obtained by photographing the article to be filled by the photographing means. The entry area corresponding to one area specified by the specifying means includes the specifying means to be determined and the support information included in the support-related information provided from the request destination in response to a request from the request means. In response to a request from the requesting means, a client device having a display means for displaying the entry destination in an identifiable manner, a storage means for storing the support-related information, and the support-related information stored in the storage means And a server device functioning as a request destination having a providing means for providing to the client device , wherein the photographing means is obtained from a plurality of images each including the plurality of regions obtained by photographing the article to be filled. A moving image generating unit configured to generate a moving image, wherein the request unit includes a plurality of consecutively arranged moving images generated by the moving image generating unit; Each image includes an article type information indicating the type of the article to be sent, and is sent to the server device to request provision of the support related information, and the storage means for each type of the article to be entered Storing the support-related information;
The providing means acquires the support related information corresponding to the entry type information transmitted from the request means from the storage means, and provides the acquired support related information to the client device. Yes.

To achieve the above object, the server device of claim 8, photographing means for photographing the object to be filled product having a plurality of entry areas, the plurality of the object to be filled object by the imaging means is obtained by being photographed In the image including a plurality of areas corresponding to the above-mentioned entry areas, predetermined specific auxiliary information used for specifying an area corresponding to the unfilled entry area among the plurality of areas and filling in the unfilled entry area Request means for requesting a predetermined request destination to provide support related information configured to include predetermined support information to be supported, and the specific auxiliary information provided from the request destination in response to a request from the request means Based on the plurality of regions in the image including the plurality of regions obtained by photographing the article to be recorded by the photographing unit, one region corresponding to the unfilled region is specified. The support area included in the support-related information provided from the request destination in response to a request of the specifying means and the request means is the input area corresponding to one area specified by the specifying means. Storage means storing the support-related information provided to the client device of the entry support system configured to include a client device having display means for identifiably displaying the function, and functioning as the predetermined request destination And providing means for providing the support-related information stored in the storage means to the client device in response to a request from the request means , wherein the storage means is provided for each type of the article to be entered. The support-related information is stored, and the providing unit generates a moving image from a plurality of images each including the plurality of entry areas obtained by photographing the article to be filled. Article type information indicating the type of the article in each of a plurality of continuously arranged images constituting the moving image generated by the moving image generating means of the photographing means having the moving image generating means. The support-related information corresponding to the article type information transmitted from the requesting unit that requests the provision of the support-related information by transmitting to the providing unit is acquired from the storage unit and acquired. The support related information is provided to the client device.

According to the first and eighth aspects of the present invention, it is possible to provide an effect that it is possible to support entry in an article without deteriorating readability as compared with the case where the configuration of the present invention is not provided.

According to the invention of claim 1 and 8, as compared with the case of not having the constitution of the invention according to claim 1, 8, for different target fill material, to help fill in the object to be filled was without deteriorating the readability The effect that it can be obtained.

According to the invention of claim 1 and 8, that compared with the case of not having the configuration of the invention according to claim 1, 8, identifies the type of the fill material that is a complete object quickly and accurately The effect that it can be obtained.

According to the inventions according to claims 2, 3, 4 , 9 , 10, and 11, it is possible to obtain the effect that the type of the article to be filled can be specified with higher accuracy.

According to the invention of claim 5, 6, 12, 13, compared with the case of not having the configuration of the invention according to claim 5, 6, 12, 13, accurately the entry region which is filled target registrant The effect of being able to grasp is acquired.

According to the invention of claim 7, 14, compared with the case of not having the configuration of the invention according to claim 7 and 14, it is possible to prevent the omission of the entry region where entry is required, that An effect is obtained.

It is a block diagram which shows an example of the whole structure of the entry assistance system which concerns on 1st Embodiment. It is a block diagram which shows an example of a structure of the mobile telephone which concerns on 1st Embodiment. It is a block diagram which shows an example of a structure of the entry assistance server apparatus and imprint management server apparatus which concern on 1st Embodiment. It is a schematic diagram which shows an example of the article image database which concerns on 1st Embodiment. It is a schematic diagram which shows an example of the support relevant information database which concerns on 1st Embodiment. It is a schematic diagram which shows an example of the seal impression database which concerns on 1st Embodiment. It is a flowchart which shows an example of the flow of a process of the portable side entry assistance process program which concerns on 1st Embodiment. It is a continuation of the flowchart shown in FIG. It is a schematic diagram which shows an example (the 1) of the method of specifying the kind of to-be-written item. It is a schematic diagram which shows an example (the 2) of the method of specifying the kind of article to be filled. It is a schematic diagram which shows an example (the 3) of the method of specifying the kind of to-be-written item. It is a schematic diagram which shows an example (the 4) of the method of specifying the kind of article to be filled. It is a schematic diagram which shows an example of the method of narrowing down the entry area where entry is required from several entry areas. It is a schematic diagram which shows the example of the method of specifying the unfilled entry area. It is a schematic diagram which shows an example of the state by which assistance information was displayed on the display part of the mobile telephone which concerns on 1st Embodiment. It is a flowchart which shows an example of the flow of a process of the server side entry assistance process program which concerns on 1st Embodiment. It is a flowchart which shows an example of the flow of a process of the imprint correctness determination processing program which concerns on 1st Embodiment. It is a state transition diagram which shows an example of the transition state of the process between the mobile telephone and the entry assistance server apparatus in the entry assistance system which concerns on 1st Embodiment. It is a block diagram which shows an example of the whole structure of the entry assistance system which concerns on 2nd Embodiment. It is a flowchart which shows an example of the flow of a process of the entry assistance process program which concerns on 2nd Embodiment. It is a continuation of the flowchart shown in FIG.

  Hereinafter, an example of an embodiment for carrying out the present invention will be described in detail with reference to the drawings. In the present embodiment, an article to be submitted to a financial institution or a local public entity, which has a plurality of entry areas such as an account opening application form, a card loan application form, and a resident management information change notification. A description will be given by taking an entry support system that supports entry in as an example.

  [First Embodiment]

  First, the configuration of the entry support system 10 according to the first embodiment will be described with reference to FIGS. FIG. 1 is a configuration diagram showing an example of the overall configuration of the entry support system 10 according to the first embodiment. As shown in FIG. 1, the entry support system 10 includes a mobile phone 12, an entry support server device 14, an imprint management server device 16, and communication lines 18 and 20. In the entry support system 10 according to the first embodiment, a public communication line is used as the communication line 18, and the communication line 20 is installed exclusively between the entry support server device 14 and the seal imprint management server device 16. A case where a dedicated communication line is used will be described as an example.

  The mobile phone 12 is a mobile terminal device having various functions included in a general telephone such as transmission and reception, a mail transmission / reception function, and a user interface function using a touch panel display. It is a terminal device that is possessed or installed in a facility of a financial institution or a local public entity. In addition, the mobile phone 12 has a shooting function for selectively performing moving image shooting (for example, moving image shooting at a frame rate of 30 frames per second) and still image shooting, and a user who is a user of the writing support system 10. It has an entry support function that supports entry of entries. In the entry support system 10 according to the first embodiment, the entry support function is activated when the entry person receives assistance for filling in the article.

  The entry support server device 14 is communicably connected to the mobile phone 12 via the communication line 18, and fills in an article to be filled in in response to a request from the entry person via the mobile phone 12. It has an entry support service providing function for providing support services.

  The seal stamp management server device 16 manages seal stamps related to users of the entry support system 10. In addition, the imprint management server device 16 is connected to the entry support server device 14 through the communication line 20 so as to be communicable, and determines whether or not the imprint is correct in response to a request from the entry support server device 14. It has a correct / incorrect determination function.

  FIG. 2 is a configuration diagram showing an example of the configuration of the mobile phone 12 according to the first embodiment. As shown in FIG. 2, the mobile phone 12 has a CPU 12A that controls the operation of the mobile phone 12 as a whole, a RAM 12B that is used as a work area when the CPU 12A executes various processing programs, various processing programs, various parameters, and the like. ROM 12C stored, secondary storage unit (here, flash memory as an example) 12D used for storing various types of information, receiver unit 12E that receives a call from the other party, and transmitter unit that transmits to the other party 12F, an input unit 12G configured to include a number key used for inputting various information, a cross key, a touch panel included in the touch panel display, and a display included in the touch panel display. Display unit 12H for displaying moving images and still images A camera (for example, a digital camera) 12I used for realizing the photographing function is connected to the entry support server device 14 via the communication line 18 so that various information can be communicated with the entry support server device 14. And an external interface (I / F) 12J that controls the transmission and reception. These units are electrically connected to each other via a system bus 12K. Accordingly, the CPU 12A accesses the RAM 12B, ROM 12C, and secondary storage unit 12D, acquires various input information via the input unit 12G, displays various information on the display unit 12H, controls the operation of the camera 12I, and the camera. Acquisition of images captured by 12I, control of operations of the receiving unit 12E and the transmitting unit 12F, understanding of operating states of the receiving unit 12E and the transmitting unit 12F, and entry via the external I / F 12J Various kinds of information can be exchanged with the support server device 14.

  FIG. 3 is a configuration diagram showing an example of the configuration of the entry support server device 14 and the stamp management server device 16 according to the first embodiment. As shown in FIG. 3, the entry support server device 14 includes a CPU 14A that controls the operation of the entry support server device 14 as a whole, a RAM 14B that is used as a work area when the CPU 14A executes various processing programs, various processing programs, and various types. An input including a ROM 14C in which parameters and the like are stored in advance, a secondary storage unit (in this case, a hard disk device as an example) 14D used for storing various information, a keyboard and a mouse (pointing device), etc. 14E, a display unit 14F having a display for displaying various information, and an external I / F 14G that is connected to the mobile phone 12 via the communication line 18 so as to communicate with the mobile phone 12. Can communicate with the seal imprint management server device 16 via the communication line 20. It is continued, is configured to include a, and an external I / F14H responsible for exchange of various information between the seal impression management server device 16. These units are electrically connected to each other via a system bus 14I. Accordingly, the CPU 14A accesses the RAM 14B, ROM 14C and secondary storage unit 14D, acquires various input information via the input unit 14E, displays various information on the display unit 14F, and a mobile phone via the external I / F 14G. Various types of information can be exchanged with the server 12, and various types of information can be exchanged with the seal imprint management server device 16 via the external I / F 14H.

  On the other hand, the seal stamp management server device 16 stores in advance a CPU 16A that controls the operation of the seal stamp management server device 16 as a whole, a RAM 16B that is used as a work area when the CPU 16A executes various processing programs, various processing programs, various parameters, and the like. ROM 16C, a secondary storage unit (here, a hard disk device as an example) 16D used for storing various information, an input unit 16E configured to include a keyboard and a mouse (pointing device), and the like, A display unit 16F having a display for displaying information, and an external I / F 16G that is communicably connected to the entry support server device 14 via the communication line 20 and manages the exchange of various information with the entry support server device 14; , Including. These units are electrically connected to each other via a system bus 14I. Therefore, the CPU 16A accesses the RAM 16B, the ROM 16C, and the secondary storage unit 16D, obtains various input information via the input unit 16E, displays various information on the display unit 16F, and supports entry through the external I / F 16G. Various kinds of information can be exchanged with the server device 14.

  The entry support server device 14 includes an article image database in order to realize the entry support service providing function. FIG. 4 schematically shows an example of the article image database 22 included in the entry support server device 14 according to the first embodiment. As shown in FIG. 4, the article image database 22 is an image of an article (an image obtained by being photographed by the camera 12I and including a plurality of areas corresponding to a plurality of entry areas). It is configured to include image information (hereinafter referred to as “entry-equivalent image information”) indicating a corresponding image (hereinafter referred to as “entry-equivalent image”). This form database 22 is built in the ROM 14C in advance. The image information corresponding to the articles related to various articles is assigned to each article identification number and each article name. The article identification number is a number that identifies an article corresponding to the article-equivalent image indicated by the article-equivalent image information. The article name is a name that identifies the article corresponding to the article-equivalent image indicated by the article-equivalent image information. In the example shown in FIG. 4, the case where the entry is an account opening application form and the case of a card loan application form are listed, and the entry specifying number of the account opening application form is “001” and the card The entry specific number of the loan application form is “002”. The entry specific number “001” and the entry name “account opening application” are assigned the image information corresponding to the entry related to the account opening application, and “002” is filled in. The article-equivalent image information related to the card loan application form is assigned to the article identification number and the name of the article to be entered as “card loan application form”.

  Further, the entry support server device 14 includes a support related information database in order to realize an entry support service providing function. FIG. 5 schematically shows an example of the support related information database 24 included in the entry support server device 14 according to the first embodiment. As shown in FIG. 5, the support related information database 24 includes support related information. Support-related information is the identification of an equivalent entry area corresponding to an unfilled entry area among a plurality of areas corresponding to a plurality of entry areas (hereinafter referred to as “equivalent entry area”) in an image corresponding to an entry. It is information configured to include predetermined specific auxiliary information to be provided and predetermined support information for assisting entry into an unfilled entry area.

  In the support related information database 24, an article identification number, an article name, and a field number are assigned to each type of article. The field number is a number (for example, an address) that specifies the storage location of the image information corresponding to the entry.

Further, in the support-related information database 24, for each type of entry, the name of the item assigned in advance to each of the plurality of entry areas, the support information assigned in advance for each item, and the specific information included in the entry Question information indicating a question related to the entry area and candidate information designated according to an answer to the question indicated by the question information are assigned. Candidate information is information that identifies a candidate for a specific target that identifies an entry area to which support information should be added, among all entry areas included in the article. In the first embodiment, information other than support information in the support related information database 24 is specified auxiliary information.

  In the example shown in FIG. 5, the case where the entry is an account opening application form and the case of a card loan application form are listed, and the entry specifying number of the account opening application form is “001” and the card The entry specific number of the loan application form is “002”. The entry specific number “001” and the entry name “account opening application” are assigned the image information corresponding to the entry related to the account opening application, and “002” is filled in. The article-equivalent image information related to the card loan application form is assigned to the article identification number and the name of the article to be entered as “card loan application form”. Items 1 to 8 are assigned to the account opening application form. In the account opening application form, item 1 is an item that specifies the entry area of the application date, item 2 is an item that specifies the entry area of the name, and item 3 is an item that specifies the entry area of the name reading Item 4 is an item for specifying the date of birth entry, Item 5 is an item for specifying the gender entry region, Item 6 is an item for specifying the address entry region, and Item 7 is a telephone number. The item 8 is an item for specifying the entry area of the mail address, and the item 8 is an item for specifying the entry area of the mail address. The account opening application form also has a seal area.

  On the other hand, in the card loan application form, items 1 to 4 are items related to the entry area by the applicant of the card loan, item 1 is an item for specifying the entry area for the application date, and item 2 is an entry area for the name. Item 3 is an item that specifies the entry area of the name reading, and item 4 is an item that specifies the entry area of the date of birth. In the card loan application form, items 5 to 7 are items related to the entry area by the guardian of the card loan applicant, item 5 is an item for specifying the name entry area, and item 6 is the name reading. The item 7 is an item for specifying the entry area, and the item 7 is an item for specifying the entry area for the date of birth. The card loan application form also has a seal area.

  Each item included in the support related information database 24 is assigned support information. For example, information indicating the message “Please enter the application date” is assigned as support information to item 1 (application date: “Date”) related to the account opening application form and card loan application form. Yes. Thus, corresponding support information is assigned to each item.

  The question information included in the support related information database 24 includes the question content and options 1 and 2, and either option 1 or 2 is selected as an answer to the question content by the writer. The candidate information includes an option 1 input item and an option 2 input item, and includes the name of the item uniquely determined for the option selected by the writer. In the example shown in FIG. 5, since there is no question content of the account opening application, the content of the question is “Null (invalid)”. Therefore, since the options 1 and 2 are not selected, the options 1 and 2 are both “Null”. The fact that the options 1 and 2 are not selected means that it is not necessary to use candidate information, and therefore both the option 1 input item and the option 2 input item are set to “Null”. On the other hand, the question content of the account opening application form is “Which age is applicable?”, Option 1 is “Under 20 years”, and Option 2 is “Over 20 years”. When the answerer selects "Under 20" for option 1 as an answer to the question, the option 1 input item is used, and when "Under 20" is selected as an answer from the entrant Used for. The option 1 input item is “All” which means that all of the items 1 to 7 are candidates for the specific target for specifying the entry area to which the support information is to be added, and the option 2 input item is the support information “1, 2, 3, 4” means that the candidates for the identification target for identifying the entry area to be added are items 1 to 4 of items 1 to 7.

  In addition, the seal imprint management server device 16 includes a seal imprint database in order to realize the seal correct / incorrect determination function. FIG. 6 schematically shows an example of an imprint database 26 included in the imprint management server device 16 according to the first embodiment. As shown in FIG. 6, the imprint database 26 is configured to include, for each writer, imprint image image information indicating an imprint related to the writer who is a user of the entry support system 10. It is used to determine whether or not the seal stamp to be verified is correct. In the example shown in FIG. 6, a branch number and an account number are assigned as a key for specifying a corresponding customer (for example, a customer of a financial institution) for each imprint image image information.

  Next, the operation of the entry support system 10 according to the first embodiment will be described with reference to FIGS. First, the mobile-side entry support process executed by the mobile phone 12 will be described with reference to FIG. FIG. 7 is a flowchart showing an example of the flow of the mobile side entry support processing program executed by the CPU 12A of the mobile phone 12 when the entry support function of the mobile phone 12 is activated. Further, here, in order to avoid complications, moving image shooting is performed by the camera 12I with the object to be filled including the entire entry area as a subject, and the moving image obtained by shooting is displayed as a through image. The case where it is displayed on the part 12H will be described.

  In step 100 of FIG. 7, after displaying a type specifying method reception screen for receiving a method for specifying the type of an article to be filled in (hereinafter referred to as “type specifying method”), the process proceeds to step 102. To do. In the entry support system 10 according to the first embodiment, methods A to D are prepared in advance as shown in FIGS. As an example, the method A includes, as shown in FIG. 9, by specifying via the input unit 12G from the information indicating the types of a plurality of items displayed on the display unit 12H of the mobile phone 12, the type of the item to be entered. It is a method to specify. As shown in FIG. 10, method B is preliminarily attached to each article, and code information indicating the type of each article (here, QR code indicating the article identification number as an example). In this method, the type of an object to be filled is specified using an image obtained by photographing with the camera 12I. In the method C, as shown in FIG. 11 as an example, a plurality of pieces of code information (in this case, a QR code indicating an article identification number as an example) arranged so that the positional relationship is different for each article is obtained by the camera 12I. This is a method for specifying the type of an article to be entered using an image obtained by photographing. As an example, the method D is a method for specifying the type of an article using an image obtained by photographing a ruled line formation pattern different for each article with a camera 12I as shown in FIG.

  In step 102, input of information indicating any of the methods A to D is waited for. Here, if information indicating any of the methods A to D is input via the input unit 12G, an affirmative determination is made and the process proceeds to step 104. In step 104, a screen that prompts the writer to perform a predetermined operation in order to specify the type of the article by the method indicated by the information input in the processing of step 102 among the methods A to D. After the display, the process proceeds to step 106.

  In step 104 described above, for example, when the type of an article is specified using the method A, information indicating a plurality of types of entries is displayed in a list in a button format as shown in FIG. A screen that allows the writer to specify via the input unit 12G is displayed. When the type of the article to be entered is specified using the method B, a screen that prompts the user to photograph the code information included in the entry using the camera 12I is displayed. Further, when the type of the article to be entered is specified using the method C, a screen that prompts the subject to photograph all the code information scattered in the entry using the camera 12I is displayed. In addition, when specifying the type of article to be entered using Method D, a screen is displayed that prompts the subject to be photographed, including the code information previously given to the four corners and all entry areas. To do.

  In step 106, the process waits until entry type information indicating the type of the entry is input in accordance with the screen content displayed on the display unit 12H in the process of step 104. In this step 106, for example, when the information indicating the method A is input in the processing of the above step 102, the article type information is input by designating the type of the article via the input unit 12G. Is affirmative. Further, when information indicating any of the methods B to D is input in the process of step 102, the article type information is input by photographing with the camera 12I and the determination is affirmative.

  In the next step 108, the article type information input in the process of step 106 is transmitted to the entry support server device 14, and the process proceeds to step 110. In this step 108, for example, in the case of the method A, information indicating the type of the article specified through the input unit 12G in the processing of step 106 is transmitted to the entry support server apparatus 14 as the article type information. . In the case of Method B, the article identification number (or article to be identified) identified by analyzing the information corresponding to the code information included in the image captured by the camera 12I in the process of Step 106 above. Name) is transmitted to the entry support server device 14 as article type information. Further, in the case of method C, each uniquely defined code information and filled-in information are assigned in advance to each filling area included in the filled-in article included in the image captured by the camera 12I in the process of step 106 above. Positional relationship of a plurality of pieces of information corresponding to all code information including code information (code information for specifying the outer contour of the object to be filled) previously attached to the four corners of the object (here, as an example, the outer contour of the object to be filled) Information (hereinafter referred to as “positional relationship information”) indicating the type information to be sent to the entry support server device 14. In the case of method D, information indicating a ruled line formation pattern included in an article included in the image obtained by the camera 12I in the process of step 106 (hereinafter referred to as “ruled line formation pattern information”). ) Is transmitted to the entry support server device 14 as article type information. In Method D, it is necessary to specify the outer contour of the article in order to make it possible to specify the ruled line formation pattern relative to the entire area of the article. Here, for example, as shown in FIG. The outer contour is specified by the code information previously attached to the four corners of the article to be entered, and the ruled line formation pattern is specified by the relative position of the ruled line to the outer outline of the article to be entered.

  In step 110, it is determined whether or not the re-input instruction information transmitted by executing the processing in step 208 of the server-side entry support processing program, which will be described later, has been received. , And a re-input screen prompting the user to input the item type information again is displayed. Then, the process returns to step 106. If the determination is negative, the process proceeds to step 114. In step 114, it is determined whether or not the support-related information transmitted by executing the processing in step 206 of the server-side entry support processing program to be described later is received. On the other hand, if the determination is affirmative, the process proceeds to step 116.

  In step 116, the support related information received in the process of step 114 is stored in the RAM 12B, and then the process proceeds to step 118. It is determined whether or not the question content included in the support-related information stored in the RAM 12B in the process of step 116 is “Null”. If the determination is negative, the process proceeds to step 130 while the determination is affirmative. If YES, go to step 120. In step 120, after displaying the question contents and options 1 and 2 included in the support-related information stored in the RAM 12B in the process of step 116, the process proceeds to step 122, where answer information indicating an answer to the question has been input. Determine whether or not. In the above step 120, for example, as shown in FIG. 13, a message “Which age corresponds?” Is displayed on the display unit 12H, and information “under 20 years old” and “over 20 years old” are displayed. List information in button format. Here, the answer information is specified by the writer specifying either the information “under 20 years old” or the information “20 years old or older” as an answer to the displayed question content via the input unit 12G. As a result of the input, step 122 becomes affirmative and the process proceeds to step 124. If a negative determination is made in step 122, the process proceeds to step 126, and a predetermined end condition (for example, one minute has elapsed since the execution of the process in step 120 has been completed). If the determination is negative, the process returns to step 122. If the determination is affirmative, the process proceeds to step 128. In step 128, since no answer information has been input, an error screen indicating that the portable side entry support processing program is terminated is displayed on the display unit 12G, and then the portable side entry support processing program is terminated.

  In step 124, the process of step 122 is performed with any one of the option 1 input item and option 2 input item of the candidate information included in the support-related information stored in the RAM 12B in the process of step 116 as a specific target candidate. After selecting according to the answer information input in step, the process proceeds to step. In step 124, for example, when the information “under the age of 20” is specified via the input unit 12G in the process of step 122, the option 1 input item is selected as a candidate for the specific target. When the information “20 years or older” is specified through the input unit 12G in the process, the option 2 input item is selected as a candidate for the specific target. In the example shown in FIG. 13, all the items included in the card loan application form are indispensable as display examples when the information “under the age of 20” is specified through the input unit 12G in the process of step 122 above. The guardian included in the card loan application form is shown as an example of display when the information “20 years old or older” is specified via the input unit 12G in the above-described step 122 is shown in the form to be filled in The aspect (state where the entry areas of items 5 to 7 are concealed) is excluded from the entry area (the entry areas of items 5 to 7 in the example shown in FIG. 5).

  In step 130, the specific auxiliary information included in the support related information stored in the RAM 12B in the process of step 116 is extracted, and then the process proceeds to step 132. In step 132, field information included in the specific auxiliary information extracted in the process of step 130 is transmitted to the entry support server device 14 to request provision of article-equivalent image information, and then the process proceeds to step 134. . In response to the request by the processing of step 132, the entry support server device 14 acquires the article-equivalent image information from the article image database 22 according to the field information transmitted from the mobile phone 12, and the acquired article equivalent The image information is transmitted to the mobile phone 12. In step 134, it is determined whether or not the article-equivalent image information transmitted from the entry support server device 14 has been received. If the determination is negative, the process proceeds to step 136, and the execution of the process in step 132 is executed. It is determined whether or not a predetermined time (for example, 30 seconds) has passed since the end of the process. If a negative determination is made, the process returns to step 134. If an affirmative determination is made, the process proceeds to step 138. In step 138, an error screen indicating that timeout has occurred is displayed on the display unit 12H, and then the portable-side entry support processing program is terminated. On the other hand, if the determination in step 134 is affirmative, the process proceeds to step 140. In step 140, the object equivalent image indicated by the object equivalent image information received in the process of step 134 is compared with the image of the object photographed at the present time. It is determined whether or not there is.

  As a specific determination method for the presence / absence of an unfilled area, for example, position specifying information that can specify the relative position of the corresponding filled area in the image corresponding to the entry with respect to the name of the item included in the specific auxiliary information In advance, and in accordance with the position specifying information associated with the name of the item included in the specific auxiliary information, an entry area (an area surrounded by a ruled line) in the image of the article to be photographed obtained at the present time ) Is determined, and by performing pattern matching between the specified entry area and the corresponding entry area in the image corresponding to the object, it is determined whether or not any entry has been made in the entry area. If it is, it is not filled in by determining whether the ratio of the area of the written mark (for example, handwriting) to the blank area of the filled area exceeds a predetermined threshold value. It determines the presence or absence of frequency, determination method that can be cited. As an example of the position specifying information, as shown in FIG. 14, the relative position of each item with respect to the vertical length of the outer contour of the article obtained by photographing the article with the camera 12I. The information shown (for example, two-dimensional coordinates) can be exemplified.

  As another determination method, for example, the same code information as the code information previously attached to the entry area for each item is associated with the name of the item included in the specific auxiliary information in advance, and the specific auxiliary information is According to the code information associated with the name of the included item and the information corresponding to the code information extracted from the image of the article taken at the current time, the information of the article obtained at the current time Identify the entry area in the image, determine whether or not any entry has been made in the entry area by performing pattern matching between the identified entry area and the corresponding equivalent entry area in the image corresponding to the object, and enter Whether or not the ratio of the area of the written mark (for example, handwriting) to the blank area of the filled area has exceeded a predetermined threshold when the area is filled in It determines the presence or absence of blank areas by determining the determination method of the like.

  In the next step 142, using the specific auxiliary information (for example, specific position specifying information or specific code information) extracted in the processing of step 130, one of the unfilled entry areas present at present is displayed. After identifying a corresponding entry area corresponding to one unfilled entry area, the process proceeds to step 144. In step 144, among the support information included in the support related information stored in the RAM 12B in the process of step 116, support information corresponding to the corresponding entry area specified in the process of step 142 is acquired. That is, the support information corresponding to the specific auxiliary information (for example, the specific position specifying information or the specific code information) extracted in the process of step 130 is acquired from the support information included in the support related information.

  In the next step 146, the support information acquired in the process of step 144 is added to one corresponding entry area specified in the process of step 142, and the image of the entry is displayed on the display unit 12H. Then, the process proceeds to step 148.

  In step 148, it is determined whether or not the entry area corresponding to one unfilled equivalent entry area specified at the present time has been filled at a rate exceeding the above threshold, and the determination is affirmative On the other hand, if the determination is negative, the process proceeds to step 152, and it is determined whether or not a predetermined time (for example, 30 seconds) has elapsed since the execution of the processing of step 146 has been completed. If a negative determination is made, the process returns to step 148. On the other hand, if an affirmative determination is made, the process proceeds to step 154. After displaying an error screen indicating the end, the mobile phone side entry support processing program is terminated. In step 150, the same processing as in step 140 is executed. If the determination is affirmative, the process returns to step 142. If the determination is negative, the process proceeds to step 155.

  FIG. 15 shows a display example in which support information is added to one equivalent entry area by the processing of step 146. In the example shown in FIG. 15, an aspect in which support information “input application date” is added to an unfilled area of the “application date” item, and “application date” Support information such as “Please enter your name” will be added to the blank area of the “Name” field with the date entered in the blank area The embodiment is shown. As described above, by executing the processing up to step 150 of the portable side entry support processing program, an image to which support information is added in a predetermined order is displayed for each of the unfilled entry areas. The “predetermined order” referred to here is uniquely determined by the specific auxiliary information (for example, specific position specifying information or specific code information) extracted in the process of step 130, and this first implementation. In this form, the items are assigned in ascending order from the item with the smallest item number. However, the present invention is not limited to this. For example, a random number is generated by a random number generator, and the addition destination of the support information is randomly determined based on the generated random number. Also good. In addition, when the relative position of the mobile phone 12 with respect to the article to be filled is not fixed, the image displayed on the display unit 12H changes and one unfilled entry area to which the support information is added is added. However, when the relative position of the mobile phone 12 with respect to the entry changes as described above (for example, the amount of change does not allow one unfilled entry area to be specified). In the case), the display unit 12H is informed that the movement of the mobile phone 12 is too large to add support information, the mobile side entry support processing program is terminated, and the mobile side entry support processing program is urged to be re-executed. After the display, the portable side entry support processing program may be terminated. In addition, in order to avoid the occurrence of such a situation that the support information cannot be added to a specific equivalent entry area due to a large relative deviation between the mobile phone 12 and the article to be entered. It is preferable that the relative position between the camera 12I and the object to be filled in is fixed so that the area surrounded by the outer contour of the object to be filled including a plurality of filling areas is fixed as the imaging target area. .

In step 155, it is determined whether or not it is necessary to determine whether or not the seal is correct. If the determination is affirmative, the process proceeds to step 156. If the determination is negative, the portable side entry support process is performed. Exit the program.
In step 156, the imprint information indicating the imprint included in the area corresponding to the stamp area is acquired from the image of the article obtained by photographing at the present time, and the acquired imprint information is transmitted to the entry support server device 14. Then, the process proceeds to step 158. In step 158, it is determined whether or not the imprint correct / incorrect information transferred by executing the processing in step 216 of the server side entry support processing program to be described later is received. It is determined whether or not a predetermined time (for example, 30 seconds) has passed since the execution of the process of step 156 has been completed. If a negative determination is made, the process returns to step 158, while an affirmative determination is made. If YES in step 162, an error screen indicating that timeout has occurred is displayed on the display unit 12H, and then the portable-side entry support processing program is terminated.

  On the other hand, if an affirmative determination is made in step 158, the process proceeds to step 164, in which it is determined whether the imprinting information received in the process of step 158 indicates that the seal is correct, and a negative determination is made. If this happens, the process proceeds to step 166, and after displaying an error screen indicating that the seal is not correct, this mobile-side entry support processing program is terminated, whereas if the determination is affirmative, it indicates that the seal is correct. After the display screen is displayed, the mobile-side entry support processing program is terminated.

  Next, the server-side entry support process executed by the entry support server device 14 will be described with reference to FIG. FIG. 16 is a flowchart showing an example of the flow of the server-side entry support processing program executed by the CPU 14A of the entry support server apparatus 14 when the entry support server apparatus 14 is turned on.

  In step 200 of FIG. 16, it is determined whether or not the article type information transmitted by executing the process of step 108 of the portable side entry support processing program is received. Shifts to step 202, and whether the information specifying the type of the entry indicated by the entry type information (the entry identification number, the entry name, or the entry equivalent image information) is stored in the ROM 14C. Is determined (whether it exists in the entry object image database 22 and the support related information database 24). If the determination is affirmative, the process proceeds to step 204, and the entry is entered from the support related information database 24. After obtaining the support related information corresponding to the type information, the process proceeds to step 206. In step 206, after the support related information acquired in the process of step 204 is transmitted to the mobile phone 12, the server side entry support processing program is terminated. If the determination in step 202 is negative, the process proceeds to step 208, where re-input instruction information is transmitted to the mobile phone 12, and then the server-side entry support processing program is terminated.

  On the other hand, if a negative determination is made in step 200, the process proceeds to step 210, and it is determined whether or not the imprint information transmitted by executing the processing of step 156 of the portable side entry support processing program is received. If a negative determination is made, the process returns to step 200. If an affirmative determination is made, the process proceeds to step 212, in which the imprint management server device 16 is requested to determine whether the seal is correct. After transmitting the correct / incorrect determination request information together with the imprint information to the imprint management server device 16, the process proceeds to step 214. In step 214, it is determined whether the imprint correct / incorrect information transmitted by executing the processing of step 308 or step 310 of the seal correct / incorrect determination processing program to be described later is received. The process proceeds to H.216, and the imprint correct / incorrect information received in the process of step 214 is transferred to the entry support server apparatus 14, and then the server side entry support process program is terminated.

  On the other hand, if a negative determination is made in step 214, the process proceeds to step 218, in which it is determined whether or not a predetermined time (for example, 30 seconds) has elapsed since the execution of the process in step 212 has been completed. If YES, the process returns to step 214. If the determination is affirmative, the process proceeds to step 220, and an error screen indicating that a timeout has occurred is displayed on the display unit 14F. Exit the program.

  Next, the seal correct / incorrect determination process executed by the seal management server device 16 will be described with reference to FIG. FIG. 17 is a flowchart showing an example of the flow of an imprint correctness determination processing program executed by the CPU 16A of the imprint management server device 16 when the power of the imprint management server device 16 is turned on. Here, in order to avoid complications, a case will be described in which an entrant who has already specified a seal is specified.

  In step 300 of FIG. 17, after waiting for reception of the correctness determination request information and the seal imprint information transmitted by executing the processing of step 212 of the server side entry support processing program, the process proceeds to step 302. After acquiring the imprint image image information corresponding to the person who entered the article from the imprint database 26, the process proceeds to step 304. In step 304, the imprint indicated by the imprint information received in the process of step 300 is compared with the imprint indicated by the imprint image image information acquired in the process of step 302.

  In the next step 306, it is determined whether or not the imprint is correct by comparing whether the imprint is within a predetermined error by comparing the imprint in the process of step 304, and affirmative. If the determination is made, the process proceeds to step 308 to generate imprint correct / incorrect information indicating that the imprint is correct. After transmitting the generated imprint correct / incorrect information to the entry support server device 14, the imprint correct / incorrect determination processing program is terminated. To do. On the other hand, if a negative determination is made in step 306, the process proceeds to step 310, where imprint correct / incorrect information indicating that the imprint is incorrect is generated, and the generated imprint correct / incorrect information is transmitted to the entry support server device 14. The imprint correct / incorrect determination processing program is terminated.

  FIG. 18 is a state transition diagram showing an example of the flow of processing performed between the mobile phone 12 and the entry support server device 14.

  As shown in FIG. 18, when the entry person who fills in the article activates the entry support function of the cellular phone 12 (S1), the cellular phone 12 starts shooting a moving image with the entry as a subject. (S2). The mobile phone 12 displays a type specifying method reception screen on the display unit 12H for allowing the entry person to specify one of the methods A to D (S3).

  The writer specifies any one of the methods A to D via the input unit 12G (S4). In response to this, the mobile phone 12 displays a screen that prompts the entry person to perform a predetermined operation in order to specify the type of the article to be entered by the method designated by the entry person (S5). Then, the entry person inputs the article type information via the input unit 12G (S6). In response to this, the cellular phone 12 transmits the entry type information to the entry support server device 14 (S7).

  The entry support server device 14 receives the entry type information, acquires support related information corresponding to the received entry type information from the support related information database 24 (S8), and obtains the acquired support related information as a mobile phone. 12 (S9). The mobile phone 12 receives the support related information and stores the received support related information in the RAM 12B (S10). Then, the cellular phone 12 extracts the question content from the support related information stored in the RAM 12, and displays the extracted question content on the display unit 12H (S11). The writer inputs the answer information through the input unit 12G (S12). The cellular phone 12 selects an entry area item to which support information should be attached according to the input answer information (S13). Further, the mobile phone 12 extracts specific auxiliary information from the support related information stored in the RAM 12 (S14), and requests the entry support server device 14 for image information corresponding to the entry according to the extracted specific auxiliary information (S15). ).

  The entry support server device 14 obtains article-equivalent image information from the article image database 22 in response to a request from the cellular phone 12 (S16), and transmits the obtained article-equivalent image information to the cellular phone 12. (S17). The mobile phone 12 specifies one unfilled entry area based on the specific auxiliary information and the image data corresponding to the entry (S18), and stores the support information corresponding to the specified one unfilled entry area in the RAM 12. The extracted support related information is extracted (S19), and an image obtained by adding the extracted support information to one corresponding unfilled entry area is displayed on the display unit 12H (S20). The writer fills in the blank area according to the support information.

  As described above in detail, in the entry support system 10 according to the first embodiment, the camera 12I that is an example of a photographing unit that photographs an article to be filled having a plurality of entry areas, and the entry by the camera 12I. Supports the entry of the predetermined specific auxiliary information and the unfilled entry area for the identification of the corresponding entry area corresponding to the unfilled entry area among the plurality of equivalent entry areas in the image obtained by photographing the object CPU 12A, which is an example of request means for requesting the server device to provide support-related information configured to include predetermined support information, and based on specific auxiliary information provided from the server device in response to a request from CPU 12A Thus, one equivalent entry corresponding to an unfilled entry area from a plurality of equivalent entry areas in the image obtained by photographing the article to be photographed by the camera 12I. An entry corresponding to one equivalent entry area specified by the CPU 12A, and the support information included in the support-related information provided from the server device in response to a request from the CPU 12A, which is an example of the specifying means for specifying the area. This is an example of a mobile phone 12 that is an example of a client device that includes a display unit 12H that is an example of a display unit that displays that an area is an entry destination, and a storage unit that stores support-related information. An entry support server device 14, which is an example of a server device, includes a ROM 14 </ b> C and a CPU 14 </ b> A that is an example of a providing unit that provides support-related information stored in the ROM 14 </ b> C to the mobile phone 12 in response to a request from the CPU 12 </ b> A. Therefore, it is possible to support the entry of an entry without deteriorating readability.

  Further, in the entry support system 10 according to the first embodiment, the mobile phone 12 receives the support information included in the support related information provided from the CPU 14A of the entry support server device 14 in response to a request from the CPU 12A. The CPU 12A, which is an example of an adding means for adding to the image of the article to be filled in, can be specified so as to be able to specify that the writing area corresponding to one corresponding writing area specified by Since the display unit 12H displays the image of the article to which the support information is added by the CPU 12A, the entry area to be filled in can be easily grasped by the writer.

  In the entry support system 10 according to the first embodiment, the CPU 12A requests the provision of support-related information by transmitting the entry type information indicating the type of the entry to the entry support server device 14. The ROM 14C of the entry support server device 14 stores support related information for each type of entry, and the CPU 14A of the entry support server device 14 supports the support related information corresponding to the entry type information transmitted from the CPU 12A. Is acquired from the ROM 14C, and the acquired support related information is provided to the mobile phone 12, so that it is possible to support the entry of the different items to be filled without degrading the readability.

  In the entry support system 10 according to the first embodiment, the camera 12I generates a moving image from a plurality of article images each including a plurality of corresponding entry areas obtained by photographing the article. The CPU 12A provides support related information by transmitting to the entry support server device 14 including the article type information in each of a plurality of continuously arranged images constituting the moving image generated by the camera 12I. Therefore, it is possible to quickly and accurately specify the type of article to be filled in.

  Further, in the entry support system 10 according to the first embodiment, the entry has code information which is an example of a type specifying image for specifying the type of the entry, and the entry type information is stored. Since the code information is used, the type of the object to be filled can be specified with higher accuracy.

  In addition, in the entry support system 10 according to the first embodiment, the positional relationship of code information, which is an example of a plurality of type specifying images used for specifying the type of an article, is different for each article. Thus, since the article type information is information indicating the positional relationship of the code information, the type of the article to be entered can be specified with higher accuracy.

  In the entry support system 10 according to the first embodiment, the entry area is formed by ruled lines, and the article type information is information indicating the formation pattern of the ruled lines. It is possible to specify the type of the article to be filled with higher accuracy.

  In the entry support system 10 according to the first embodiment, the support-related information corresponds to an image including a plurality of equivalent entry areas obtained by photographing the article to be filled with the camera 12I as the specific assistance information. Image information indicating an image to be performed, and a plurality of position specifying information capable of specifying the relative position of each of a plurality of corresponding entry areas in the image indicated by the image information, and for each of the position specifying information The CPU 12A is configured by associating support information uniquely determined for each position specifying information, and the CPU 12A provides image information and a plurality of positions as specifying auxiliary information of support related information provided from the CPU 14A of the entry support server device 14. Based on the specific position specifying information of the specific information and an image including a plurality of corresponding input areas obtained by photographing the object to be input by the camera 12I, the image One equivalent entry area is specified by specifying the equivalent entry area specified by the specific position specifying information from the plurality of equivalent entry areas in the display area, and the display unit 12H is provided from the CPU 14A of the entry support server device 14 Support information corresponding to specific position specifying information is extracted from support related information, and it is possible to specify that the entry area corresponding to one equivalent entry area specified by the CPU 12A is the entry destination. Since it is displayed, it is possible to make the writer accurately grasp the entry area to be filled in.

  In the entry support system 10 according to the first embodiment, each of the plurality of entry areas has code information that is an example of entry area specifying information for specifying each of the entry areas. The information is indicated by an article-equivalent image information and an article-equivalent image information indicating an image corresponding to an image including each piece of information corresponding to each piece of code information obtained by photographing the article by the camera 12I. Each piece of information corresponding to each piece of code information in the article image is provided, and each piece of information corresponding to each piece of code information is associated with support information uniquely determined for each piece of information. The CPU 12A corresponds to each of the article-equivalent image information and the code information as the specific auxiliary information included in the support related information provided from the CPU 14A of the entry support server device 14. Each of the information corresponding to each of the code information in the image based on the specific information of the information and the image including each information corresponding to each of the code information obtained by photographing the article to be recorded by the camera 12I One area is specified by specifying one piece of information corresponding to the specific information from the information, and the display unit 12H converts the support related information provided from the CPU 14A of the entry support searcher device 14 into the specific position specifying information. The corresponding support information is extracted, and the extracted support information is displayed so that it can be specified that the entry area corresponding to one equivalent entry area specified by the CPU 12A is the entry destination. Can be accurately grasped by the writer.

  In the entry support system 10 according to the first embodiment, the support related information further includes question information indicating a question related to a specific entry area included in the article to be filled, and the mobile phone 12 is An input unit 12G that is an example of an answer receiving unit that receives answer information indicating an answer to the question indicated by the question information included in the support-related information, and an image of the article to be filled based on the answer information received by the input unit 12G It further includes a CPU 12A that is an example of a selection unit that selects a candidate to be specified by the CPU 12A from a plurality of equivalent entry areas that are included, and the CPU 12A corresponds to one of the candidates selected by the CPU 12A that is an example of the selection unit. Since the entry area is specified, it is possible to prevent omission of entry into the entry area where entry is indispensable.

  In the first embodiment, as shown in FIG. 15, the support information is added to the entry area by bringing the tip of the balloon constituting a part of the support information into contact with the entry area. Although described with an example, the present invention is not limited to this, and support information may be added to an image of an article so that it is possible to specify which entry area is a support information addition destination. For example, there is an example in which a message “Please enter the application date” is displayed at a location away from the entry area where the application date is entered. Further, in addition to adding support information to an image of an article to be entered, guidance may be provided auxiliary using voice. When visual display and audible display are used together in this way, voice data indicating a message “Please enter the application date” is associated with the support information in advance, and the support information is acquired from the support related information. Audio data may be acquired at the timing, and audio based on the audio data may be output via the speaker at the timing when the support information is added to the image of the entry.

  In the first embodiment, a message is added to the through image of the article displayed on the display unit 12H to support entry in an unfilled entry area. However, the present invention is not limited to this. First, the corresponding entry area corresponding to one unfilled entry area in the image of the article displayed on the display unit 12H is displayed in a blinking manner so that the entry area to be filled in can be recognized. May be. In this case, instead of information indicating a message such as “Please input the application date” as support information, data indicating a blinking pattern may be applied. Further, the message display and the blinking display of the corresponding entry area may be used in combination.

  In the first embodiment, each step of the mobile side entry support processing program is realized by the CPU 12A executing the mobile side entry support processing program, and the server side entry support processing program is executed by the CPU 14A. Thus, each step of the server-side entry support processing program is realized, and in the second embodiment, a software form that realizes each step of the entry support processing program by the CPU 52A executing the entry support processing program. However, the present invention is not limited to this, and a hardware form configured by connecting various circuits (for example, an ASIC (Application Specific Integrated Circuit)), a software form, and a hardware form may be used. Combination forms can also be exemplified.

  [Second Embodiment]

  The first embodiment has been described with reference to an example of a case in which entry to an unfilled entry area is supported by performing distributed processing using the mobile phone 12 and the entry support server device 14. In the second embodiment, a description will be given by taking a form example in the case of assisting entry in an unfilled entry area with a single device. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 19 is a configuration diagram showing an example of the overall configuration of the entry support system 50 according to the second embodiment. As shown in FIG. 19, the entry support system 50 includes an entry support apparatus 52, an imprint management server apparatus 16, and a communication line 54. In the entry support system 50 according to the second embodiment, a case where a dedicated communication line laid exclusively between the entry support apparatus 52 and the imprint management server apparatus 16 is used as the communication line 54 is taken as an example. I will give a description.

  The entry support device 52 is, for example, a terminal device that is possessed by a person who fills in an article or is installed in a facility of a financial institution or a local public entity, and is used by a person who fills in an article. In addition, the entry support device 52 has a user interface function using a touch panel display, a shooting function that selectively performs moving image shooting and still image shooting, and an entry person who is a user of the entry support system 50. It has an entry support function that supports entry. In the entry support system 50 according to the second embodiment, the entry support function is activated when the entry person receives assistance for filling in the article.

  The entry support device 52 includes a CPU 52A that controls the operation of the entry support device 52 as a whole, a RAM 52B that is used as a work area when the CPU 52A executes various processing programs, and a ROM 52C that stores various processing programs and various parameters in advance. , A secondary storage unit (here, a flash memory as an example) 52D used for storing various types of information, and a camera (for example, a digital camera) used to realize the above-described shooting function for shooting moving images and still images ) 52E, an operation key used to input various information, a cross key, an input unit 52F configured to include a touch panel included in the touch panel display, and a display included in the touch panel display. A display unit 52G for displaying information; Through the line 54 is communicably connected to imprint the management server device 16, it is configured to include a, and an external I / F52H responsible for exchange of various information between the seal impression management server device 16. These units are electrically connected to each other via a system bus 52I. Accordingly, the CPU 52A accesses the RAM 52B, ROM 52C, and secondary storage unit 52D, acquires various input information via the input unit 52F, displays various information on the display unit 52G, controls the operation of the camera 52E, and the camera. Acquisition of an image obtained by shooting with 52E and transmission / reception of various information to / from the imprint management server device 16 via the external I / F 52H can be performed.

  The entry support system 50 according to the second embodiment includes an article image database 22 and a support related information database 24 in order to implement an entry support function, and these databases are constructed in the ROM 52C. Yes.

  Next, the operation of the entry support system 50 according to the second embodiment will be described with reference to FIGS. 17, 20, and 21. 21 and 22 are flowcharts showing an example of the flow of an entry support processing program executed by the CPU 52A of the entry support apparatus 52 when the entry support function of the entry support apparatus 52 is activated. Further, here, in order to avoid complications, the moving image is shot by the camera 52E with the object to be filled including the entire entry area as a subject, and the moving image obtained by shooting is displayed as a through image. The case where it is displayed on the part 52G will be described.

  In steps 400, 402, 404, and 406 of FIG. 21, the same processing as in steps 100, 102, 104, and 106 is executed, and then the process proceeds to step 408, where the type of the article indicated by the article type information is entered. Whether or not information (entry identification number, entry name, or entry equivalent image information) is stored in the ROM 52B (exists in the entry image database 22 and the support related information database 24). If the determination is affirmative, the process proceeds to step 410. If the determination is negative, the process proceeds to step 411, and information specifying the type of the entry is stored in the ROM 52B. Since an error screen indicating that the entry support processing program is to be terminated is displayed on the display unit 52G, the entry support processing program is To completion.

  In step 410, support related information corresponding to the entry type information is acquired from the support related information database 24 and stored in the RAM 52B, and then the process proceeds to step 412. In step 412, it is determined whether or not the question content stored in the RAM 52B in the process of step 410 and included in the support-related information is “Null”. If the determination is negative, the process proceeds to step 424. If the determination is affirmative, the process proceeds to step 414. In steps 414, 416, 420, and 422, processing similar to that in steps 120, 122, 126, and 128 is executed. When the process of step 416 is executed, the process proceeds to step 418, and any one of the option 1 input item and option 2 input item of the candidate information included in the support related information stored in the RAM 52B by the process of step 410 is specified. After selecting according to the answer information input in the process of step 416 as a candidate for the target, the process proceeds to step 424.

  In step 424, the specific auxiliary information included in the support related information stored in the RAM 52B in the process of step 410 is extracted, and then the process proceeds to step 426. In step 426, the entry equivalent image information is derived from the entry image database 22 in accordance with the field information included in the specific auxiliary information extracted in the processing of step 424, and then the process proceeds to step 428. In steps 428 to 456, the same processing as in steps 140 to 168 is executed, and then the entry support processing program is terminated.

  In the second embodiment, the entry support device 52 is a terminal device installed in a facility of a financial institution or a local public body. However, the present invention is not limited to this, and a portable terminal device (portable by an entry person) For example, it may be a mobile phone).

  In the second embodiment, the software form for realizing each step of the entry support processing program by executing the entry support processing program by the CPU 52A is exemplified. However, the present invention is not limited to this, and various circuits ( As an example, a hardware form configured by connecting an ASIC (Application Specific Integrated Circuit) or a form combining a software form and a hardware form can be exemplified.

  In each of the above embodiments, various processing programs are stored in advance in the ROM. However, the present invention is not limited to this, and the various processing programs are stored on a computer such as a CD-ROM, DVD-ROM, or USB (Universal Serial Bus) memory. A form provided in a state stored in a storage medium to be read may be applied, or a form distributed via wired or wireless communication means may be applied.

10 entry support system 12 mobile phone 12A, 14A, 52A CPU
12G, 52F Input unit 12H, 52G Display unit 14 Entry support server device 14A, 52C ROM

Claims (14)

Photographing means for photographing an article having a plurality of entry areas, the plurality of areas in an image including a plurality of areas corresponding to the plurality of entry areas obtained by photographing the article to be photographed by the photography means Of support-related information configured to include predetermined specific auxiliary information used for specifying an area corresponding to an unfilled entry area and predetermined support information for assisting entry into the unfilled entry area. Request means for requesting provision to a predetermined request destination, obtained based on the specific auxiliary information provided from the request destination in response to the request of the request means, obtained by photographing the article to be filled by the photographing means The specifying means for specifying one area corresponding to the unfilled entry area from the plurality of areas in the image including the plurality of areas, and the request destination in response to a request from the request means A client device having display means for displaying the support information included in the provided support-related information so that the entry area corresponding to the one area specified by the specifying means can be specified; ,
A server device functioning as the request destination, having storage means for storing the support related information, and providing means for providing the support related information stored in the storage means to the client device in response to a request from the request means And including
The photographing means has a moving image generating means for generating a moving image from a plurality of images each including the plurality of regions obtained by photographing the entry object,
The request unit includes the article type information indicating the type of an article in each of a plurality of continuously arranged images constituting the moving image generated by the moving image generation unit. Requesting the provision of the support related information by sending to
The storage means stores the support-related information for each type of the entry item,
The providing unit acquires the support related information corresponding to the entry type information transmitted from the request unit from the storage unit, and provides the acquired support related information to the client device.
Entry support system. The article has a type specifying image for specifying the type of the article,
The entry support system according to claim 1 , wherein the entry type information is information indicating the type specifying image. Arranging a plurality of type specifying images used for specifying the type of the article so that the positional relationship is different for each of the articles,
The entry support system according to claim 1 , wherein the entry type information is information indicating the positional relationship. The entry area is formed by ruled lines,
The entry support system according to claim 1 , wherein the entry type information is information indicating the ruled line formation pattern. The support related information is indicated by image information indicating an image corresponding to an image including the plurality of areas obtained by photographing the article to be recorded by the photographing unit as the specific auxiliary information, and the image information. The support having a plurality of pieces of position specifying information capable of specifying relative positions of the plurality of regions in the image and uniquely determined for each piece of the position specifying information with respect to each of the position specifying information It is configured by associating information,
The specifying means includes the image information as the auxiliary auxiliary information of the support related information provided from the providing means, specific position specifying information among the plurality of position specifying information, and the entry by the photographing means. Based on an image including the plurality of regions obtained by photographing an object, the one region is identified by identifying a region identified by the specific position identifying information from the plurality of regions in the image. And
The display means extracts the support information corresponding to the specific position specifying information from the support related information provided by the providing means, and the extracted support information is identified by the specifying means. The entry support system according to any one of claims 1 to 4 , wherein the entry area corresponding to the area is displayed so that it can be specified that the entry area is an entry destination. Each of the plurality of entry areas has entry area specifying information for specifying each,
The support-related information is image information indicating an image corresponding to an image including each piece of information corresponding to each of the entry area specifying information obtained by photographing the article to be filled by the photographing unit as the specific auxiliary information. Each information corresponding to each of the entry area specifying information in the image indicated by the image information, and uniquely determined for each piece of information corresponding to each of the entry area specifying information The support information is associated with each other,
The specifying means includes specific information of each piece of information corresponding to each of the image information and the entry area specifying information as the specifying auxiliary information included in the support related information provided from the providing means, and the Based on an image including information corresponding to each of the entry area specifying information obtained by imaging the article to be recorded by the imaging means, from each information corresponding to each of the entry area specifying information in the image Identifying the one region by identifying one piece of information corresponding to the particular information;
The display means extracts the support information corresponding to the specific position specifying information from the support related information provided by the providing means, and the extracted support information is identified by the specifying means. The entry support system according to any one of claims 1 to 5 , wherein the entry area corresponding to the area is displayed in an identifiable manner as an entry destination. The support related information further includes question information indicating a question related to the specific entry area included in the article,
The client device includes: an answer receiving unit that receives answer information indicating an answer to the question indicated by the question information included in the support related information; and the article to be filled based on the answer information received by the answer receiving unit. A selection means for selecting a candidate to be specified by the specifying means from the plurality of areas included in the image;
The entry support system according to claim 1 , wherein the specifying unit specifies the one region from candidates selected by the selection unit. Photographing means for photographing an article having a plurality of entry areas, the plurality of areas in an image including a plurality of areas corresponding to the plurality of entry areas obtained by photographing the article to be photographed by the photography means Of support-related information configured to include predetermined specific auxiliary information used for specifying an area corresponding to an unfilled entry area and predetermined support information for assisting entry into the unfilled entry area. Request means for requesting provision to a predetermined request destination, obtained based on the specific auxiliary information provided from the request destination in response to the request of the request means, obtained by photographing the article to be filled by the photographing means The specifying means for specifying one area corresponding to the unfilled entry area from the plurality of areas in the image including the plurality of areas, and the request destination in response to a request from the request means A client device having display means for displaying the support information included in the provided support-related information so that the entry area corresponding to one area specified by the specifying means can be specified; Storage means for storing the support-related information provided to the client device of the entry support system configured to include:
Providing means for functioning as the predetermined request destination and providing the support-related information stored in the storage means to the client device in response to a request from the request means ;
The storage means stores the support-related information for each type of the entry item,
The providing means is generated by the moving image generating means of the photographing means having moving image generating means for generating a moving image from a plurality of images each including the plurality of entry areas obtained by photographing the article to be filled. Further, the provision of the support related information is requested by transmitting to the providing means including the article type information indicating the type of the article in each of a plurality of continuously arranged images constituting the moving image. The support related information corresponding to the article type information transmitted from the requesting means is acquired from the storage means, and the acquired support related information is provided to the client device.
Server device. The article has a type specifying image for specifying the type of the article,
The server device according to claim 8 , wherein the entry type information is information indicating the type specifying image. Arranging a plurality of type specifying images used for specifying the type of the article so that the positional relationship is different for each of the articles,
The server device according to claim 8 , wherein the entry type information is information indicating the positional relationship. The entry area is formed by ruled lines,
The server device according to claim 8 , wherein the entry type information is information indicating a ruled line formation pattern. The support related information is indicated by image information indicating an image corresponding to an image including the plurality of areas obtained by photographing the article to be recorded by the photographing unit as the specific auxiliary information, and the image information. The support having a plurality of pieces of position specifying information capable of specifying relative positions of the plurality of regions in the image and uniquely determined for each piece of the position specifying information with respect to each of the position specifying information It is configured by associating information,
The providing means is obtained by photographing the entry object by the image information as the specific auxiliary information of the support related information, specific position specifying information among the plurality of position specifying information, and the photographing means. For the specifying means for specifying the one area by specifying an area specified by the specific position specifying information from the plurality of areas in the image based on the image including the plurality of areas. Providing the support related information to the specifying means for specifying the one area, extracting the support information corresponding to the specific position specifying information from the support related information, and extracting the extracted support information, The support information for the display means for displaying the entry area corresponding to one area specified by the specifying means so as to be specified as an entry destination, Any claim 8 to claim 11, wherein the entry region corresponding to one region identified by serial specific means for providing the assistance-related information to the client device in order to identify possible displays that the entry destination The server device according to claim 1. Each of the plurality of entry areas has entry area specifying information for specifying each,
The support-related information is image information indicating an image corresponding to an image including each piece of information corresponding to each of the entry area specifying information obtained by photographing the article to be filled by the photographing unit as the specific auxiliary information. Each information corresponding to each of the entry area specifying information in the image indicated by the image information, and uniquely determined for each piece of information corresponding to each of the entry area specifying information The support information is associated with each other,
The providing means includes the image information as the specific auxiliary information included in the support related information, specific information of each information corresponding to each of the writing area specifying information, and the article to be filled by the photographing means. Corresponding to the specific information from the information corresponding to each of the entry area specifying information in the image, based on an image including information corresponding to each of the entry area specifying information obtained by photographing Providing the support related information to the specifying means to cause the specifying means for specifying the one area by specifying one information to specify the one area, and the specifying from the support related information The support information corresponding to the information is extracted, and the entry area corresponding to the one area specified by the specifying means is the entry destination of the extracted support information. Preparative identifiable, the support information, the entry region corresponding to one area identified by the identifying means filling to the pressing means with you added to the image of the object to be filled product is a filled object The server device according to any one of claims 8 to 11 , wherein the support related information is provided to the client device so as to be able to specify the destination. The support related information further includes question information indicating a question related to the specific entry area included in the article,
The providing means includes answer receiving means for receiving answer information indicating an answer to the question indicated by the question information included in the support-related information, and the article to be filled based on the answer information received by the answer receiving means. From the candidates selected by the selection unit, the selection unit further includes a selection unit that selects a candidate to be identified by the identification unit from the plurality of regions included in the image. The server device according to any one of claims 8 to 13 , wherein the support-related information is provided to specify one area.

Images