JP5526847B2 - Information processing system and information processing apparatus - Google Patents

Description

  The present invention relates to an information processing system, an information processing method, and an information processing apparatus.

  Conventionally, a bank is installed at a financial institution's branch for general customers who are engaged in commercial banking. When a customer visits a store, he / she uses the bank for the first time. It is common to fill in an entry form. When the entry by the customer is completed, the contents entered on the entry form are read by a store clerk or a reading device and used for the procedure by the sales office. Examples of such financial institutions include commercial banks, securities companies, and consumer finance operators.

  A person who requests a prescribed procedure from a prescribed institution, not limited to a financial institution, first fills in the necessary information on the entry form by hand and submits the completed entry form to the prescribed institution. Is common. According to such a method, the relevant institution can easily grasp the matters necessary for the procedure from the person who requests the procedure. For example, when a customer uses a customer terminal to fill in a necessary item by handwriting, the center terminal is notified of the entry operation, and the center terminal displays the notified entry operation, thereby disclosing an error entry to the operator. (For example, refer to Patent Document 1).

JP-A-10-69566

  However, for example, according to the technique disclosed in Patent Document 1, when an operator finds an erroneous entry, it is possible to notify the customer that the erroneous entry has been made. No action is taken when an erroneous entry is found. Therefore, as a matter of course, there is a problem that the customer needs to re-enter from the beginning when he / she notices an erroneous entry by himself / herself. That is, there is a problem that the customer needs to re-enter items other than the items that have been erroneously entered among the completed items.

  Accordingly, the present invention has been made in view of the above problems, and the object of the present invention is to make an error entry among the completed items for the writer who noticed an incorrect entry on the entry form. It is an object of the present invention to provide a technique capable of eliminating the need to re-enter items other than the items that have been performed.

In order to solve the above problem, according to one aspect of the present invention, when a character is written on the entry sheet with a writing instrument, a detection device that detects a change in an item to be entered by the writing instrument, and an entry on the entry sheet by the writing instrument. An information processing system is provided that includes a handwriting data acquisition device that acquires a handwriting of a character as handwriting data, an information processing device, and a printer that prints the handwriting on a print sheet based on the handwriting data. The information processing apparatus includes an entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item is detected from the detection device, and an entry target item change detection unit. A handwriting data acquisition unit that acquires handwriting data from a handwriting data acquisition device each time a change in an entry item is detected, a handwriting data storage unit that stores handwriting data acquired by the handwriting data acquisition unit, and a handwriting data storage unit The information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data, the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit is acquired from the handwriting data storage unit, comprising an output controller for outputting the acquired handwriting data to the printer, and listed before the handwriting is written in blank form A paper information storage unit that stores paper information as information, and a paper information acquisition unit that acquires paper information stored in the paper information storage unit, and the detection device further detects the start of entry on the entry paper In addition, the entry information related to the entry form when the start of entry is detected is acquired, and the form information acquisition unit receives the entry form related information acquired by the detection apparatus from the detection apparatus, and based on the received entry form related information. The type of the entry form is specified, and the form information corresponding to the specified entry form is obtained from the form information storage unit .

  In order to solve the above problem, according to one aspect of the present invention, when a character is written on the entry sheet with a writing instrument, a detection device that detects a change in an item to be entered by the writing instrument, and an entry on the entry sheet by the writing instrument. An information processing system is provided that includes a handwriting data acquisition device that acquires a handwriting of a character as handwriting data, an information processing device, and a printer that prints the handwriting on a print sheet based on the handwriting data. The information processing apparatus includes an entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item is detected from the detection device, and an entry target item change detection unit. A handwriting data acquisition unit that acquires handwriting data from a handwriting data acquisition device each time a change in an entry item is detected, a handwriting data storage unit that stores handwriting data acquired by the handwriting data acquisition unit, and a handwriting data storage unit The information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data, the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit is acquired from the handwriting data storage unit, An output control unit that outputs the acquired handwriting data to a printer, and the information acquisition unit is assigned from a plurality of handwriting data identification information. Of a selection means for selecting the handwriting data identification information, and acquires the handwriting data other than handwriting data entry target item associated with the selected handwriting data identification information by the selection means.

Further, according to another aspect of the present invention, when a character is entered on the entry sheet with a writing instrument, a detection device that detects a change in an item to be entered by the writing instrument, and a handwriting of the character entered on the entry sheet with the writing instrument There is provided an information processing apparatus in an information processing system that includes a handwriting data acquisition device that acquires the handwriting data as handwriting data, an information processing device, and a printer that prints handwriting on printing paper based on the handwriting data. The information processing apparatus includes an entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item is detected from the detection device, and an entry target item change detection unit. A handwriting data acquisition unit that acquires handwriting data from a handwriting data acquisition device each time a change in an entry item is detected, a handwriting data storage unit that stores handwriting data acquired by the handwriting data acquisition unit, and a handwriting data storage unit The information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data, the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit is acquired from the handwriting data storage unit, comprising an output controller for outputting the acquired handwriting data to the printer, and listed before the handwriting is written in blank form A paper information storage unit that stores paper information as information, and a paper information acquisition unit that acquires paper information stored in the paper information storage unit, and the detection device further detects the start of entry on the entry paper In addition, the entry information related to the entry form when the start of entry is detected is acquired, and the form information acquisition unit receives the entry form related information acquired by the detection apparatus from the detection apparatus, and based on the received entry form related information. The type of the entry form is specified, and the form information corresponding to the specified entry form is obtained from the form information storage unit.
Further, according to another aspect of the present invention, when a character is entered on the entry sheet with a writing instrument, a detection device that detects a change in an item to be entered by the writing instrument, and a handwriting of the character entered on the entry sheet with the writing instrument There is provided an information processing apparatus in an information processing system that includes a handwriting data acquisition device that acquires the handwriting data as handwriting data, an information processing device, and a printer that prints handwriting on printing paper based on the handwriting data. The information processing apparatus includes an entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item is detected from the detection device, and an entry target item change detection unit. A handwriting data acquisition unit that acquires handwriting data from a handwriting data acquisition device each time a change in an entry item is detected, a handwriting data storage unit that stores handwriting data acquired by the handwriting data acquisition unit, and a handwriting data storage unit The information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data, the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit is acquired from the handwriting data storage unit, An output control unit that outputs the acquired handwriting data to a printer, and the information acquisition unit is assigned from a plurality of handwriting data identification information. Of a selection means for selecting the handwriting data identification information, and acquires the handwriting data other than handwriting data entry target item associated with the selected handwriting data identification information by the selection means.

  As described above, according to the present invention, a writer who notices an incorrect entry on the entry form does not need to re-enter items other than the items that have been entered incorrectly among the completed items. It is possible to finish.

1 is a configuration diagram of an information processing system according to an embodiment of the present invention. It is a figure which shows the surface of the entry paper used in the embodiment. It is a figure which shows the back surface of the entry paper used in the embodiment. It is a figure which shows the structural example of the paper information used in the embodiment. It is a figure which shows the structural example of the handwriting data used in the embodiment. It is a block diagram which shows the function structure of the information processing apparatus which concerns on the embodiment. It is a figure which shows the example of a screen displayed on the display apparatus which concerns on the same embodiment. It is a sequence diagram which shows the flow of the process performed by the information processing system which concerns on the embodiment.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  First, an information processing system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a configuration diagram of an information processing system according to an embodiment of the present invention. Hereinafter, in the present embodiment, an information processing system installed in a sales office of a financial institution, for example, when a customer fills in a predetermined item on an entry form when performing procedures such as opening an account or making a transfer. An explanation will be given.

  The information processing system 10 according to the present embodiment includes an information processing apparatus 100, a handwriting data acquisition apparatus 200, a detection apparatus 300, an input apparatus 400, a display apparatus 500, and a printer 600. The bookkeeping table 900 includes a top board 910. On the top board 910, for example, when a customer C performs a procedure such as opening an account or making a transfer, an entry form 810 on which a predetermined item is entered, and an entry form 810 are used. A writing instrument 710 to be used is installed. As shown in FIG. 1, an input device 400, a display device 500, a printer 600, and the like may be installed on the top plate 910. The writing instrument 710 is stored, for example, inside the writing instrument holder 720, and the entry sheet 810 is stored, for example, inside the entry sheet holder 820.

  The information processing apparatus 100 is connected to the handwriting data acquisition apparatus 200, the detection apparatus 300, the input apparatus 400, the display apparatus 500, and the printer 600, and is an apparatus for controlling the operation of the information processing system 10. Based on the detection information received from the detection device 300, the information processing device 100 specifies the type of the entry sheet 810 that the customer C intends to fill in and determines the placement position of the entry sheet 810 on the top plate 910 of the bookkeeping table 900. get. Further, the information processing apparatus 100 detects the change of the entry target item by the customer C based on the detection information received from the detection apparatus 300. When the information processing apparatus 100 detects a change in the entry target item, the information processing apparatus 100 receives handwriting data from the handwriting data acquisition apparatus 200. The information processing apparatus 100 assigns handwriting data identification information to the received handwriting data, and stores the assigned handwriting data identification information and handwriting data in association with each other. In the present embodiment, handwritten data identification information “1”, “2”, “3”, and “4” is sequentially assigned from the acquired early handwritten data to the late handwritten data, and the assigned handwritten data identifying information and handwritten data are assigned. Are stored in association with each other. The information processing apparatus 100 synthesizes the handwriting data received from the handwriting data acquisition apparatus 200 and the form information corresponding to the type of the specified entry form 810 to generate an entry halfway image, and the generated entry halfway image is displayed on the display unit. 500. When the information processing apparatus 100 receives handwriting data identification information for identifying handwriting data from the input device 400, the information processing apparatus 100 causes the printer 600 to print the generated halfway image. The paper information is information written before the handwriting is written on the entry paper 810. The information processing apparatus 100 can match the positions of the handwriting data and the paper information, for example, by generating handwriting data by combining the handwriting data at the position corresponding to the acquired placement position with the paper information. .

  The handwriting data acquisition device 200 is a device that acquires, as handwriting data, a handwriting of characters entered on the entry form 810 by the writing tool 710. In the present embodiment, the handwriting data acquisition device 200 is a camera that images the direction of the top plate 910 from the top of the top plate 910 of the bookkeeping table 900. The handwriting data acquisition device 200 can specify pixels indicating a predetermined color from the pixels constituting the captured image, and can acquire the specified set of pixels as handwriting data. In this case, as the predetermined color, for example, brightness, brightness, or the like can be used, and a color corresponding to the color of the handwriting remaining on the entry sheet 810 when the entry is made by the writing tool 710 can be used. . In response to a request from the information processing apparatus 100, handwriting data is transmitted to the information processing apparatus 100. The handwriting data acquisition device 200 is preferably installed at a position where the entire area of the top plate 910 of the bookkeeping table 900 is included in the imaging region.

  The detection apparatus 300 detects change of the entry target item by the writing tool 710 when the character is entered in the entry form 810 by the writing tool 710, and the change information indicating that the change of the entry target item is detected. This is a device provided to the information processing apparatus 100. In addition, the information processing apparatus 100 includes information for specifying the type of the entry form 810 that the customer C is about to fill in and information for detecting the placement position of the entry form 810 on the top board 910 of the entry table 900. Provided to the information processing apparatus 100. In the present embodiment, the detection device 300 is an infrared camera that images the direction of the top plate 910 from below the top plate 910 of the bookkeeping table 900. The detection apparatus 300 detects that the entry target item has been changed by detecting that the position of the tip of the writing instrument 710 has moved by a predetermined amount or more based on the captured image, and transmits the captured image to the information processing apparatus 100. To do.

  The detection apparatus 300 may further detect the start of entry on the entry form 810 and obtain entry form related information regarding the entry form 810 when the entry start is detected. In the present embodiment, the detection apparatus 300 can detect the start of entry on the entry sheet 810 by detecting that something is placed on the top plate 910 of the bookkeeping table 900 based on the captured image. Specifically, for example, when a person or an object is reflected in the imaging area, the detection apparatus 300 transmits a captured image at that time to the information processing apparatus 100. For this reason, it is preferable that the detection apparatus 300 is installed in a position that includes the entire top plate 910 of the bookkeeping table 900 in the imaging region. When detecting the entry start on the entry form 810, the detection apparatus 300 transmits the captured image to the information processing apparatus 100. The detection apparatus 300 can also acquire entry sheet related information regarding the entry sheet 810 when the entry start is detected. In the present embodiment, the photographed image of the entry sheet 810 is used as entry sheet related information.

  The input device 400 is a device that accepts input of handwriting data identification information for identifying any of the handwriting data acquired by the information processing apparatus 100 from the customer C. The buttons of the input device 400 are provided with handwriting data identification information “1”, “2”, “3”, and “4”, and the customer C has buttons with handwriting data identification information “1”, for example. When is pressed, handwriting data identification information “1” is transmitted to the information processing apparatus 100. In the present embodiment, the input device 400 is provided with a button, and the customer C transmits handwriting data identification information to the information processing device 100 by a signal generated by pressing the button. However, other input configurations can be used instead of the buttons provided in the input device 400. For example, a touch panel attached to the first display area 511 to the fourth display area 514 of the display device 500 may be used instead of the buttons provided on the input device 400.

  The display device 500 is a device that displays handwriting data acquired by the information processing apparatus 100. In addition, the display device 500 can also display a halfway image generated by the information processing device 100. The display device 500 displays the halfway image at a position corresponding to the handwriting data identification information for identifying the handwriting data that is the composition source of the halfway image. In the present embodiment, for example, the display device 500 displays in the first display area 511 a filling-in-progress image in which handwriting data identified by handwriting data identification information “1” and paper information are combined. Similarly, a halfway entry image in which handwriting data identified by handwriting data identification information “2” and paper information are combined is displayed in the second display area 512, and handwriting data identified by handwriting data identification information “3” is displayed. An intermediate image in which the paper information and the paper information are combined is displayed in the third display area 513, and an intermediate image in which the handwriting data identified by the handwriting data identification information “4” and the paper information are combined is displayed in the fourth display area. 514. As shown in FIG. 1, handwriting data identification information “1” to handwriting data identification information “4” may be displayed by the display device 500 in each of the first display area 511 to the fourth display area 514. Alternatively, paper or the like on which handwriting data identification information “1” to handwriting data identification information “4” are described may be pasted on the display device 500.

  The printer 600 is a device that prints handwriting on printing paper based on handwriting data output from the information processing apparatus 100. For example, when the handwriting data is composed of a set of pixels corresponding to the handwritten position, printing is performed on the printing paper so that a predetermined color adheres to the pixels. The predetermined color may be the same as or different from the color of the handwriting that was captured in the captured image captured by the handwriting data acquisition device 200. In addition, the printer 600 can print the halfway image output from the information processing apparatus 100 on printing paper.

  The bookkeeping table 900 is a desk installed in the bank and used when the customer C fills in the entry form 810. The table 900 is provided with a top plate 910. The top plate 910 is, for example, translucent, and is installed at the bottom of the bookkeeping table 900. The detection device 300, which is an infrared camera directed toward the top plate 910, is placed on the top of the top plate 910. The completed entry form 810 can be detected. Here, the top plate 910 is assumed to be translucent, for example. However, if the detection device 300 can detect entry item change or specify the type of the entry sheet 810, the top plate 910 is particularly transparent. It does not have to be translucent.

  Next, an example of an entry form used by the information processing system according to the present embodiment will be described with reference to FIGS. FIG. 2 is a view showing the surface of an entry form used in the present embodiment. FIG. 3 is a diagram showing the back side of the entry form used in the present embodiment.

  On the surface 810a of the entry form 810 used by the information processing system 10 according to the present embodiment, an item name and an entry column for the item are entered for the customer C to complete the procedure. ing. As shown in FIG. 2, for example, a name entry field, a date of birth entry field, an address entry field, an occupation entry field, and an amount entry field are written on the surface 810 a of the entry form 810. On the other hand, on the back surface 810b of the entry form 810, a unique mark 811 is printed for each type of entry form 810.

  Next, the configuration of the paper information used in the present embodiment will be described with reference to FIG. FIG. 4 is a diagram illustrating a configuration example of sheet information.

  As shown in FIG. 4, the paper information is associated with a mark as an example of information indicating the type of paper information, and is stored in the paper information storage unit 121 together with the mark. Here, it is assumed that there are a plurality of types of entry sheets 810. However, when there is only one type of entry sheet 810, the form information may not be associated with the mark. The paper information and marks stored in the paper information storage unit 121 can be appropriately changed by, for example, an administrator of the information processing system 10.

  Next, the structure of handwriting data used in the present embodiment will be described with reference to FIG. FIG. 5 is a diagram illustrating a configuration example of handwriting data.

  As illustrated in FIG. 5, the handwriting data stored in the handwriting data storage unit 122 is acquired by the handwriting data acquisition device 200 at the timing when the entry for each item is completed, and the handwriting data acquired by the handwriting data acquisition device 200. Are acquired by the handwriting data acquisition unit 113 and sequentially stored in the handwriting data storage unit 122. Here, four handwriting data are stored in the handwriting data storage unit 122, but the number of handwriting data stored in the handwriting data storage unit 122 is not particularly limited. Here, the handwriting data D1 to D4 are associated with items “1”, “2”, “3”, and “4” as examples of handwriting data identification information, respectively, and the items “1”, “2”, “3”, and “4”. 4 ”is stored in the handwriting data storage unit 122.

  Next, the functional configuration of the information processing apparatus included in the information processing system according to the present embodiment will be described with reference to FIG. FIG. 6 is a block diagram illustrating a functional configuration of the information processing apparatus 100.

  An information processing apparatus 100 according to an embodiment of the present invention includes a paper information acquisition unit 111, an entry target item change detection unit 112, a handwriting data acquisition unit 113, an information acquisition unit 114, an output control unit 115, and display control. It mainly includes a unit 116, a paper information storage unit 121, and a handwriting data storage unit 122.

  The paper information storage unit 121 stores paper information that is information written before characters are written on the entry paper 810. For example, in the example shown in FIG. 2, “paper A”, “name”, “date of birth”, “address”, “profession”, “amount”, ruled lines, and the like written on the surface 810 a of the entry paper 810 are paper information. In the example shown in FIG. 3, a mark 811 or the like written on the back surface 810b of the entry sheet 810 corresponds to the sheet information. As shown in FIG. 4, the paper information is associated with, for example, a mark and stored together with the mark by the paper information storage unit 121. Further, the paper information may include information indicating the size of the printing paper on which the paper information is printed.

  The paper information acquisition unit 111 acquires paper information from the paper information storage unit 121. However, it is assumed that there are a plurality of types of entry forms 810 instead of one. In such a case, the paper information acquisition unit 111 specifies the type of the entry paper 810 filled in with the writing instrument 710, and acquires the paper information corresponding to the specified type from the paper information storage unit 121. More specifically, the paper information acquisition unit 111 acquires an image obtained by photographing the direction of the top plate 910 of the bookkeeping table 900 from the detection device 300, and analyzes the image so that the entry paper 810 selected by the customer C is analyzed. The type may be specified, and paper information corresponding to the specified type may be acquired from the paper information storage unit 121.

  As described above, on the back surface 810b of the entry form 810, a unique mark 811 is printed for each type of entry form 810, and the top plate 910 of the book table 900 is translucent. When the customer C places the entry sheet 810 on the top panel 910, the detection apparatus 300 captures an image of the top panel 910 taken from the bottom of the top panel 910 at this time on the sheet information acquisition unit 111 of the information processing apparatus 100. In this image, a mark 811 printed on the back surface 810b of the entry sheet 810 is photographed through the translucent top plate 910. The paper information acquisition unit 111 detects the mark 811 from this image, specifies the type of the entry paper 810 selected by the customer C from the mark type and placed on the bookkeeping table 900. For example, when the paper information acquisition unit 111 determines that the mark 811 “A” is described in the image as a result of analyzing the acquired image, the paper information acquisition unit 111 specifies that the type of the entry paper 810 is “A”. be able to. The sheet information acquisition unit 111 can acquire the sheet information associated with the type “A” of the entry sheet 810 and stored in the sheet information storage unit 121 as the sheet information corresponding to the specified type.

  The paper information acquisition unit 111 can also detect the placement position of the entry paper 810 placed on the top plate 910 of the bookkeeping table 900 by analyzing the image. More specifically, the sheet information acquisition unit 111 detects the position of the placed entry sheet 810 based on the detected position of the mark 811. Further, the paper information acquisition unit 111 can also detect the orientation of the entry paper 810 placed on the top 910 of the bookkeeping table 900 by analyzing the image. More specifically, the paper information acquisition unit 111 detects the orientation of the placed entry paper 810 based on the detected orientation of the mark 811.

  The entry target item change detection unit 112 detects a change in the entry target item by receiving change information indicating that a change in the entry target item has been detected from the detection device 300. When the change of the entry target item is detected, the entry target item change detection unit 112 outputs a signal indicating that the change of the entry target item is detected to the handwriting data acquisition unit 113. In the example shown in FIG. 2, for example, the customer C starts writing on the front surface 810 a of the entry form 810 with the writing tool 710 and enters the “Name”, “Birthday”, “Address”, “Occupation”, and “Amount” fields. Assuming that the entries are made in order, the entry target item change detection unit 112 detects a change in the entry target items when the entry of “name”, “birth date”, “address”, and “profession” is completed. It will be.

  In this embodiment, the change of the entry target item is detected by the detection device 300 detecting that the tip of the writing instrument 710 has moved a predetermined amount or more based on the captured image. In order to improve the detection accuracy of the entry item change, position information indicating the position of the entry column of each item in the entry form 810 can be stored in the form information storage unit 121. Then, the entry target item change detection unit 112 fills in when the position of the tip of the writing instrument 710 included in the captured image matches one of the positions indicated by the position information stored in the paper information storage unit 121. It is possible to detect that the target item has been changed, and to improve the detection accuracy of the entry target item change.

  The handwriting data acquisition unit 113 acquires handwriting data from the handwriting data acquisition device 200 every time a change of the entry target item is detected by the entry target item change detection unit 112. Therefore, in the example illustrated in FIG. 2, the handwriting data acquisition unit 113 acquires the handwriting data at the time when the entry of “name”, “date of birth”, “address”, and “profession” is completed from the handwriting data acquisition device 200. To do. When acquiring handwriting data, for example, the handwriting data acquisition unit 113 transmits a handwriting data transmission request to the handwriting data acquisition device 200 and receives handwriting data from the handwriting data acquisition device 200 as a response to the handwriting data transmission request. The handwriting data acquisition unit 113 stores the acquired handwriting data in the handwriting data storage unit 122. In the present embodiment, the order “1”, “2”, “3”, and “4” in which the handwriting data has been acquired is further stored in the handwriting data storage unit 122 in association with the handwriting data as handwriting data identification information.

  The handwriting data storage unit 122 stores the handwriting data acquired by the handwriting data acquisition unit 113. In the present embodiment, the handwriting data storage unit 122 further stores handwriting data identification information associated with handwriting data. The handwriting data identification information is not limited to the order in which the handwriting data is acquired, and may be any information as long as it is information for identifying the handwriting data stored in the handwriting data storage unit 122.

  The information acquisition unit 114 acquires handwriting data identification information for identifying handwriting data stored in the handwriting data storage unit 122. In the present embodiment, as illustrated in FIG. 1, the order “1”, “2”, “3”, and “4” in which the handwriting data is acquired by the handwriting data acquisition unit 113 is shown in the input device 400. A button 411 is provided in the vicinity of the position indicated by “1”. Similarly, a button 412 is provided near the position where the order “2” is shown, a button 413 is provided near the position where the order “3” is shown, and the button 414 is located near the position where the order “4” is shown. Is provided. When the customer C presses the button 411, “1” is transmitted from the input device 400 to the information acquisition unit 114 as handwriting data identification information. Similarly, when the customer C presses the button 412, “2” is transmitted as handwriting data identification information from the input device 400 to the information acquisition unit 114. When the customer C presses the button 413, the information acquisition unit 114 from the input device 400. “3” is transmitted as handwriting data identification information, and when the customer C presses the button 414, “4” is transmitted from the input device 400 to the information acquisition unit 114 as handwriting data identification information.

  The output control unit 115 acquires handwriting data identified by the handwriting data identification information acquired by the information acquisition unit 114 from the handwriting data storage unit 122, and outputs the acquired handwriting data to the printer 600. In the present embodiment, the output control unit 115 searches the handwriting data storage unit 122 for handwriting data identification information that matches the handwriting data identification information acquired by the information acquisition unit 114, and is associated with the matching handwriting data identification information. The handwriting data stored in this way is acquired from the handwriting data storage unit 122. When the handwriting data is output to the printer 600, the printer 600 that has received the handwriting data prints the handwriting on the printing paper based on the handwriting data. The customer C can use the paper on which the handwriting is printed, thereby omitting the trouble of rewriting the characters once entered on the paper 810 again. In addition, it is possible to specify for each item how far back to be completed the printed handwriting.

  The entry form 810 may contain form information such as items and ruled lines before entry is started by the writing instrument 710. Therefore, the output control unit 115 generates a halfway entry image by combining the paper information acquired by the paper information acquisition unit 111 and the handwriting data stored in the handwriting data storage unit 122, and the generated halfway entry image May be output to the printer 600. When the halfway image is output to the printer 600, the printer 600 that has received the halfway image prints the halfway image on a printing sheet. Thereby, in addition to the handwriting data, the paper information described in the entry form 810 can be printed on the entry form before the entry by the writing instrument 710 is started. When the handwriting data and the paper information are combined, the output control unit 115 combines the handwriting data corresponding to the placement position of the entry paper 810 acquired by the paper information acquisition unit 111 and the paper information and outputs the combined data to the printer 600. It is good as well. In addition, an intermediate image may be output to the printer 600 in the direction of the entry sheet 810 acquired by the sheet information acquisition unit 111.

  The output control unit 115 converts the acquired handwriting data into character data, acquires customer information that is information about the customer C based on the character data, and outputs the acquired customer information to the printer 600 together with the handwriting data. Good. If it does in this way, based on the handwriting already filled in by the customer C, the information regarding the customer C which has not yet been filled in by the customer C is acquired from the customer information, and printed on the printing paper together with the handwriting already filled in Can be made. As a result, the customer C can save the trouble of entering the information registered in the customer information as long as the information necessary for identifying the customer C is entered. The customer information is managed by a predetermined server that can communicate with the information processing apparatus 100, for example.

  The display control unit 116 causes the display device 500 to display handwriting data acquired by the output control unit 115. In addition, the display control unit 116 can cause the display device 500 to display a halfway image generated by the output control unit 115. The display control unit 116 causes the halfway image to be displayed at a position corresponding to the handwriting data identification information for identifying the handwriting data that is the source of synthesis of the halfway image. In the example illustrated in FIG. 1, the display control unit 116 causes the first display area 511 to display a halfway image in which handwriting data identified by handwriting data identification information “1” and paper information are combined. Similarly, a halfway entry image in which handwriting data identified by handwriting data identification information “2” and paper information are combined is displayed in the second display area 512, and handwriting data identified by handwriting data identification information “3” is displayed. An intermediate image with which paper information is combined is displayed in the third display area 513, and an intermediate image with which handwriting data identified by handwriting data identification information “4” and paper information are combined is displayed in the fourth display area. 514 is displayed.

  Next, an example of a screen displayed on the display device according to the present embodiment will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of a screen displayed on the display device.

  As shown in FIG. 7, the halfway image 811 a is written on the entry form 810 when the output control unit 115 finishes filling in the form information and the name entry field in advance on the entry form 810. Are images generated by being combined. Similarly, the halfway image 812a includes the paper information previously written on the entry form 810 and the handwriting entered on the entry form 810 when the entry in the date of birth entry field is completed by the output control unit 115. It is an image generated by combining. The intermediate image 813a is synthesized by the output control unit 115 by combining the paper information previously written on the entry form 810 and the handwriting entered on the entry form 810 when the entry in the address entry field is completed. This is a generated image. The intermediate image 814a is synthesized by the output control unit 115 by combining the paper information previously written on the entry form 810 and the handwriting entered on the entry form 810 when the entry into the occupation entry field is completed. This is a generated image. The display control unit 116 causes the display device 500 to display halfway images 811a, 812a, 813a, and 814a. Thus, by displaying the images 811a, 812a, 813a, and 814a in the middle of entry, the customer C can browse the image at the stage where each item has been completed and can be used for selection by the customer C.

  Next, the operation of the information processing system according to the present embodiment will be described with reference to FIG. FIG. 8 is a sequence diagram showing a flow of processing executed by the information processing system according to the embodiment of the present invention.

  First, when the customer C places the entry form 810 on the top plate 910 of the bookkeeping table 900 and starts filling in the entry form 810 (S101), the detection device 300 detects the presence of the entry form 810 (S102). Then, the captured image is transmitted as detection information to the information processing apparatus 100 (S103). Receiving the detection information (S104), the information processing apparatus 100 uses the paper information acquisition unit 111 to detect the mark from the detection information (see FIG. 3) and identify the type of the entry paper 810 placed by the customer C. . Then, the paper information acquisition unit 111 acquires the paper information about the entry form from the paper information storage unit 121 (S105). The sheet information is information indicating the position on the entry sheet 810, such as items and ruled lines, which are described in advance on the entry sheet 810.

  Next, when the customer C changes the items to be entered on the entry form 810 (S111), the detection apparatus 300 detects the movement of the customer C (S112) and transmits the captured image as detection information to the information processing apparatus 100. (S113). The information processing apparatus 100 that has received the detection information (S114) transmits a handwriting data transmission request to the handwriting data acquisition apparatus 200 when detecting a change in the entry target item based on the captured image (S115). Although it may be detected that the entry item has been changed by detecting the movement of the customer C by the detection device 300, here, based on the captured image received from the detection device 300 by the information processing device 100 Furthermore, it is assumed that a change in the entry target item is detected with high accuracy. The handwriting data acquisition device 200 that has received the handwriting data transmission request (S116) transmits the acquired handwriting data to the information processing device 100 (S117). In the present embodiment, the handwriting data is acquired by photographing the handwriting of characters entered on the entry form 810 by the customer C by the handwriting data acquisition device 200.

  Receiving the handwriting data (S118), the information processing apparatus 100 generates a halfway image by combining the received handwriting data and the acquired paper information (S119). The display device 500 displays the halfway image generated by the information processing device 100 (S120). While the customer C fills in the entry form 810, the customer C may make a mistake in writing in the entry column of a certain item (S121). If the customer C makes a mistake, he / she browses the display contents (including the image in the middle of entry) displayed by the display device 500 and selects which item he / she wants to rewrite from the stage where the entry has been completed. That is, handwriting data to be printed by the printer 600 is selected. The customer C inputs handwriting data identification information for identifying the selected handwriting data to the input device 400 by pressing a button corresponding to that stage (S132).

  The input device 400 transmits a print request including the handwriting data identification information to the information processing device 100 (S133). The information processing apparatus 100 receives the print request from the input device 400 (S134), and the information processing apparatus 100 combines the handwriting data identified by the handwriting data identification information included in the print request with the paper information (in S119). By transmitting (generated) to the printer 600, the printer 600 is instructed to print a halfway image (S135). The printer 600 prints the halfway image received from the information processing apparatus 100 on printing paper (S136) and provides it to the customer C. The customer C can use the paper printed by the printer 600 to resume the entry from the point when the entry of the desired item is completed (S137).

  As described above, according to the information processing system 10 according to the embodiment of the present invention, when the customer C is filling out the entry form 810, the handwriting data at the timing when the entry target item is changed is retained. Can be kept. When handwriting data is selected by the customer C who makes a mistake in writing on the entry sheet 810, the information processing system 10 can print the handwriting data held on the printing sheet and provide it to the customer C. As a result, the customer C can restart the entry from the stage where the entry to the desired item is completed, so that the trouble of rewriting can be reduced. That is, the customer C who has noticed an incorrect entry on the entry form 810 does not have to re-enter items other than the items that have been entered incorrectly among the entered items. Moreover, since the filling efficiency by the customer C can be improved, the filling by the customer C can be completed without delay. Therefore, it is possible to reduce the degree of congestion of the sales office where the procedure is performed, and to prevent deterioration in the quality of service provided to the customer C by the sales office.

  Note that the functions of each unit of the information processing apparatus 100 described in the above embodiment actually store a control program that describes processing procedures for realizing these functions by an arithmetic device such as a CPU (Central Processing Unit) (not shown). This is accomplished by reading a control program from a storage medium such as a read only memory (ROM) or a random access memory (RAM), and interpreting and executing the program. For example, in the information processing apparatus 100 according to the above-described embodiment, the paper information acquisition unit 111, the entry target item change detection unit 112, the handwriting data acquisition unit 113, the information acquisition unit 114, the output control unit 115, and the display control unit 116 Each function is actually achieved by the CPU executing a program describing a processing procedure for realizing these functions.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, in the above embodiment, the type of the entry sheet 810 is identified by detecting the mark 811 printed on the back surface of the entry sheet 810 from the image captured by the infrared camera. However, the present invention is not limited to this example. . For example, the size of the entry sheet 810 is different for each type of entry sheet 810, and the type of the entry sheet 810 may be identified by detecting this size from the image captured by the infrared camera. Further, for example, a type of the entry form 810 may be identified by installing a pressure sensor on the top plate 910 of the entry table 900 and detecting the size of the entry form 810 by detecting pressure.

  Moreover, in the said embodiment, although it detected using the infrared camera that the customer C started entry to the entry sheet 810, this invention is not limited to this example. For example, the start of entry may be detected using a pressure sensor installed on the top plate 910 of the bookkeeping table 900. Alternatively, the start of entry may be detected by installing a weight sensor on the floor in front of the bookkeeping table 900 and detecting the posture from the weight shift. Alternatively, the start of entry may be detected by an infrared sensor installed at a position where the distance between the customer C and the bookkeeping table 900 can be measured. Alternatively, if the writing instrument holder 720 has a function of detecting that the writing instrument 710 has been removed from the writing instrument holder 720 by the customer C, the start of entry may be detected by such a function. A camera is installed at a position where the face of the customer C who fills in the entry form 810 using the register 900 can be photographed, and a human face is included in the photographed image photographed by the camera. The start of entry may be detected when detected.

  Moreover, in the said embodiment, although the specification of the entry column which the customer C has filled in shall be performed with an infrared sensor, this invention is not limited to this example. For example, a pressure sensor may be installed on the top plate 910 of the bookkeeping table 900, and the entry field filled in by the customer C may be specified by detecting the pressure. Alternatively, if the writing instrument 710 has a function of detecting the position of the tip of the writing instrument 710, the entry field filled in by the customer C may be specified by such a function. As a method for detecting the position of the tip of the writing instrument 710, for example, a dot pattern for identifying the position is embedded at each position on the surface of the entry sheet 810. The writing instrument 710 reads and reads the dot pattern. The position of the tip of the writing instrument 710 may be detected based on the position obtained by converting the dot pattern. Alternatively, ultrasonic waves and infrared rays are transmitted from the transmission device provided near the tip of the writing instrument 710 at approximately the same time, and received from the transmission device by the reception device that grasps the placement position and orientation of the entry form 810. You may detect the position of the front-end | tip of the writing instrument 710 based on the arrival time difference of an ultrasonic wave or infrared rays.

  Further, in the above embodiment, the placement position and orientation of the entry sheet 810 are specified by detecting the mark 811 printed on the back surface of the entry sheet 810 from the image captured by the infrared camera. It is not limited to examples. For example, a pressure sensor may be installed on the top plate 910 of the book table 900, and the placement position and orientation of the entry sheet 810 may be specified by detecting the pressure.

  In the above embodiment, the handwriting data stored in the handwriting data storage unit 122 is not particularly deleted, but the handwriting data stored in the handwriting data storage unit 122 at the stage when the entry on the entry form 810 is completed. It is good also as deleting. In this way, it is possible to prevent the storage area of the handwriting data storage unit 122 from being wasted. Various methods for detecting the completion of the entry on the entry form 810 are also assumed. For example, completion of entry on the entry form 810 can be detected by detecting that the entry form 810 has been taken away by an infrared camera. Alternatively, the completion of entry on the entry form 810 may be detected by installing a pressure sensor on the top plate 910 of the book table 900 and detecting that pressure is no longer detected.

  Moreover, in the said embodiment, although the information processing system in the accounting stand installed in the bank was demonstrated to the example, this invention is not limited to this example. For example, the present invention can be applied to all situations where a bookkeeping table can be installed, such as financial institutions other than banks, hospital reception desks, telephone company and insurance company contract windows, and transportation commuter pass purchase windows. In the above-described embodiment, an example in which a customer who visits a bank sales office fills in an entry form has been described, but the person who fills in the entry form is not limited to a customer who visits a bank sales office. Therefore, it is clear that the person who fills out the form may be a general person who is not a customer, and the person who fills out the form for the procedure in a public institution, The person who fills in the entry form may be used.

  Moreover, although the said embodiment demonstrated the structure of the input device 400 and the display apparatus 500 as four handwriting data identification information, the number of handwriting data identification information may be changed suitably as needed, handwriting data The configuration of the input device 400 and the display device 500 may be changed as appropriate in accordance with the change in the number of identification information.

  In the above embodiment, handwriting data is acquired in time series, and it is possible to select a state before erroneously filling in the entry form based on the handwriting data identification information. Is stored in the handwriting data storage unit, and any handwriting data identification information can be selected by the input device 400, so that the item to be filled in that has been erroneously selected is selected. The handwriting data of items to be entered other than the items to be entered may be printed out by a printer.

  In the present specification, the steps described in the sequence diagram are not necessarily processed in time series in addition to the processes performed in time series in the described order, but in parallel or individually. Also includes processing to be performed. Further, it goes without saying that the order can be appropriately changed even in the steps processed in time series.

DESCRIPTION OF SYMBOLS 10 Information processing system 100 Information processing apparatus 111 Paper information acquisition part 112 Entry item change detection part 113 Handwriting data acquisition part 114 Information acquisition part 115 Output control part 116 Display control part 121 Paper information storage part 122 Handwriting data storage part 200 Handwriting data Acquisition device 300 Detection device 400 Input device 500 Display device 600 Printer 710 Writing tool 810 Filling sheet 900 Book stand 910 Top plate 811a to 814a Intermediate image

Claims (4)

A detection device that detects a change in an item to be entered by the writing instrument when a character is entered on the entry sheet by a writing instrument, and handwriting data that acquires the handwriting of the character that is entered on the entry sheet by the writing instrument as handwriting data An information processing system having an acquisition device, an information processing device, and a printer that prints the handwriting on a print sheet based on the handwriting data,
The information processing apparatus includes:
An entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item has been detected from the detection device;
A handwriting data acquisition unit that acquires the handwriting data from the handwriting data acquisition device each time a change of the entry target item is detected by the entry target item change detection unit;
A handwriting data storage unit for storing the handwriting data acquired by the handwriting data acquisition unit;
An information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data storage unit;
An output control unit for acquiring the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit from the handwriting data storage unit, and outputting the acquired handwriting data to the printer;
Equipped with a,
A paper information storage unit for storing paper information which is information written before the handwriting is written on the entry paper;
A paper information acquisition unit for acquiring the paper information stored by the paper information storage unit;
With
The detection device includes:
Further detecting the entry start on the entry form and obtaining entry form related information on the entry form when the entry start is detected;
The paper information acquisition unit
The entry sheet related information acquired by the detection device is received from the detection device, the type of the entry sheet is identified based on the received entry sheet related information, and the sheet according to the identified entry sheet type Obtaining information from the paper information storage unit;
An information processing system characterized by that. A detection device that detects a change in an item to be entered by the writing instrument when a character is entered on the entry sheet by a writing instrument, and handwriting data that acquires the handwriting of the character that is entered on the entry sheet by the writing instrument as handwriting data An information processing system having an acquisition device, an information processing device, and a printer that prints the handwriting on a print sheet based on the handwriting data,
The information processing apparatus includes:
An entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item has been detected from the detection device;
A handwriting data acquisition unit that acquires the handwriting data from the handwriting data acquisition device each time a change of the entry target item is detected by the entry target item change detection unit;
A handwriting data storage unit for storing the handwriting data acquired by the handwriting data acquisition unit;
An information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data storage unit;
An output control unit for acquiring the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit from the handwriting data storage unit, and outputting the acquired handwriting data to the printer;
Equipped with a,
The information acquisition unit includes selection means capable of selecting arbitrary handwriting data identification information from a plurality of the handwriting data identification information, and the handwriting data of the entry target item associated with the handwriting data identification information selected by the selection means Get handwriting data other than
An information processing system characterized by that. A detection device that detects a change in an item to be entered by the writing instrument when a character is entered on the entry sheet by a writing instrument, and handwriting data that acquires the handwriting of the character that is entered on the entry sheet by the writing instrument as handwriting data An information processing apparatus in an information processing system having an acquisition apparatus, an information processing apparatus, and a printer that prints the handwriting on a print sheet based on the handwriting data,
An entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item has been detected from the detection device;
A handwriting data acquisition unit that acquires the handwriting data from the handwriting data acquisition device each time a change of the entry target item is detected by the entry target item change detection unit;
A handwriting data storage unit for storing the handwriting data acquired by the handwriting data acquisition unit;
An information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data storage unit;
An output control unit for acquiring the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit from the handwriting data storage unit, and outputting the acquired handwriting data to the printer;
Equipped with a,
A paper information storage unit for storing paper information which is information written before the handwriting is written on the entry paper;
A paper information acquisition unit for acquiring the paper information stored by the paper information storage unit;
With
The detection device includes:
Further detecting the entry start on the entry form and obtaining entry form related information on the entry form when the entry start is detected;
The paper information acquisition unit
The entry sheet related information acquired by the detection device is received from the detection device, the type of the entry sheet is identified based on the received entry sheet related information, and the sheet according to the identified entry sheet type Obtaining information from the paper information storage unit;
An information processing apparatus. A detection device that detects a change in an item to be entered by the writing instrument when a character is entered on the entry sheet by a writing instrument, and handwriting data that acquires the handwriting of the character that is entered on the entry sheet by the writing instrument as handwriting data An information processing apparatus in an information processing system having an acquisition apparatus, an information processing apparatus, and a printer that prints the handwriting on a print sheet based on the handwriting data,
An entry target item change detection unit that detects a change in the entry target item by receiving change information indicating that a change in the entry target item has been detected from the detection device;
A handwriting data acquisition unit that acquires the handwriting data from the handwriting data acquisition device each time a change of the entry target item is detected by the entry target item change detection unit;
A handwriting data storage unit for storing the handwriting data acquired by the handwriting data acquisition unit;
An information acquisition unit for acquiring handwriting data identification information for identifying the handwriting data stored by the handwriting data storage unit;
An output control unit for acquiring the handwriting data identified by the handwriting data identification information acquired by the information acquisition unit from the handwriting data storage unit, and outputting the acquired handwriting data to the printer;
Equipped with a,
The information acquisition unit includes selection means capable of selecting arbitrary handwriting data identification information from a plurality of the handwriting data identification information, and the handwriting data of the entry target item associated with the handwriting data identification information selected by the selection means Get handwriting data other than
An information processing apparatus.

Images