JP2023142017A - Information processing apparatus, method for controlling information processing apparatus, and program - Google Patents

Abstract

To provide an information processing apparatus that, when a user transfers a fee to a transfer destination, allows the user to appropriately select transfer processing according to whether the expiration date to transfer the fee to the transfer destination is exceeded, a method for controlling an information processing apparatus, and a program.SOLUTION: An image forming apparatus as an information processing apparatus comprises: a reading unit that reads a transfer bill 17 appended with information on a transfer destination 171, the amount of money transferred 172, and a transfer expiration date 173; specification means (CPU) that specifies the transfer expiration date based on a reading result from the reading unit; determination means (CPU) that determines whether the transfer expiration date 173 exceeds the current date; and switching means (CPU) that switches whether to continue execution of transfer processing according to a determination result from the determination means.SELECTED DRAWING: Figure 17

Description

The present invention relates to an information processing device, a method of controlling the information processing device, and a program.

Conventionally, there has been a known technology in which, for example, when transferring public utility charges to a payee, a captured image of a bill with the payee's name written on it is taken, character recognition is performed to extract information about the payee's payee, and the information is used in the transfer process. ing. This technology can reduce the amount of effort required for users to input their payment destination. For example, Patent Document 1 discloses a device that obtains a payment deadline written on a bill by barcode recognition and determines whether the payment deadline has been exceeded. Then, the device described in Patent Document 1 can display on the screen the payment amount including the additional charge for the excess amount if the payment deadline has been exceeded. Thereby, the user will perform payment processing using this payment amount.

Japanese Patent Application Publication No. 2011-28432

However, although the device described in Patent Document 1 displays the payment amount including additional charges when the payment deadline has been exceeded, the user has to perform payment processing in accordance with the expiration of the payment deadline, that is, including the additional charges. It is not configured to allow selection and switching to payment processing for the payment amount. Therefore, the device described in Patent Document 1 is not easy to use. In addition, with conventional technology that automatically obtains the transfer destination and transfer amount from the invoice to assist the user with the transfer process, even if the payment deadline has been exceeded, the normal There is a risk that the transfer process will be executed. Therefore, it is necessary to separate the transfer process when the payment deadline is exceeded from the normal transfer process.

The present invention has been made in view of the above problems. The present invention provides an information processing device and an information processing device in which, when a user transfers a fee to a transfer destination, the user can appropriately select a transfer process depending on whether or not the transfer deadline to the transfer destination has been exceeded. The purpose is to provide control methods and programs.

In order to achieve the above object, an information processing device of the present invention is an information processing device that executes a transfer process of transferring a fee to a transfer destination, and the information processing device executes a transfer process of transferring a fee to a transfer destination, and the information processing device transfers the transfer amount to the transfer destination, the transfer amount to the transfer destination, a reading means for reading a document with information attached thereto regarding the transfer deadline; and based on the reading result of the reading means, specifying at least the transfer deadline of the transfer destination, the transfer amount, and the transfer deadline. comparing the transfer deadline specified by the specifying means with the date and time at the time when the transfer deadline was specified by the specifying means, and whether or not the transfer deadline exceeds the date and time; The present invention is characterized by comprising a determining means for determining whether the transfer process is continued or not, and a switching means for switching whether or not to continue execution of the transfer process depending on the determination result of the determining means.

According to the present invention, when the user transfers the fee to the transfer destination, the user can appropriately select the transfer process depending on whether or not the deadline for transfer to the transfer destination has passed.

1 is a block diagram illustrating a configuration example of an information processing system including an information processing apparatus according to a first embodiment; FIG. 1 is a block diagram showing a configuration example of an image forming apparatus. FIG. 2 is a diagram illustrating a configuration example of an operation unit included in the image forming apparatus. This is a screen for bank service authentication settings. This is the screen for bank service authentication via a browser. This is a sequence for executing bank service authentication processing. This screen is displayed as the authentication result when the token request is legitimate during bank service authentication processing. It is a flowchart of the first (new) transfer process. This is an example of a transfer bill. This is the screen displayed during the transfer process. This is the screen displayed during the transfer process. This is the screen displayed during the transfer process. This is the screen displayed during the transfer process. It is a flowchart of transfer processing. This is the screen displayed during the transfer process. It is a flowchart of a transfer process when a shortcut icon is selected. This is an example of a transfer bill. This is the screen displayed during the transfer process. This is the screen displayed during the transfer process. It is a flowchart of the transfer process when a shortcut icon is selected in 2nd Embodiment. This is the screen displayed during the transfer process. This is the screen displayed during the transfer process. This is the screen displayed during the transfer restart process. It is a flowchart of transfer restart processing. This is the screen displayed during the transfer restart process.

Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in each embodiment below are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment.

<First embodiment>
The first embodiment will be described below with reference to FIGS. 1 to 19. FIG. 1 is a block diagram illustrating a configuration example of an information processing system having an information processing apparatus according to the first embodiment. As shown in FIG. 1, the information processing system 10 includes an image forming apparatus 101 and a PC (Personal Computer) 102. The information processing system 10 also includes a bank service API authorization server 104, a bank service resource server 105, an online storage 106, and a mail server 107. In the information processing system 10, the image forming apparatus 101, the PC 102, the bank service API authorization server 104, the bank service resource server 105, the online storage 106, and the mail server 107 can communicate with each other.

The image forming apparatus 101 is an apparatus to which the information processing apparatus of the present invention is applied, and is capable of executing a transfer process of transferring a fee to a transfer destination. In this embodiment, the image forming apparatus 101 is an MFP (Multi Function Peripheral). Image forming apparatus 101 is communicably connected to PC 102 via network 100 . The image forming apparatus 101 and the PC 102 are also connected to the Internet 103 via the network 100. The image forming apparatus 101 can, for example, read a document and send image data obtained through the reading to the PC 102 or the online storage 106. The image forming apparatus 101 can also attach image data to an email and send it to the email server 107. The PC 102 is used, for example, to obtain and display the status of the image forming apparatus 101, to configure settings for the image forming apparatus 101, and to send print data to the image forming apparatus 101. Further, the PC 102 can set or update setting values of the image forming apparatus 101 using the HTTP protocol.

Connected to the Internet 103 are a banking service API authorization server 104, a banking service resource server 105, an online storage 106, and a mail server 107. The bank service API authorization server 104 authorizes the use of the bank service API. The bank service resource server 105 is used, for example, when providing services such as bank transfer and issuance of deposit/withdrawal details. The online storage 106 stores, for example, images and various setting information. The mail server 107 sends and receives e-mails.

The network 100 may be connected to an access point (not shown) wirelessly, for example, as long as it can transmit image data. "Image data" in this embodiment refers to electronic data. Examples of image data include, for example, electronic data obtained by converting an image into RAW data, but is not limited to this, and may include electronic data according to an image format such as TIFF or JPEG, or electronic data according to a PDF format. good.

FIG. 2 is a block diagram showing an example of the configuration of an image forming apparatus. As shown in FIG. 2, the image forming apparatus 101 includes a control section 110, an operation section 116, a reading section 118, and a printing section 120. The control unit 110 includes a CPU 111, a ROM 112, a RAM 113, a storage 114, an operation unit I/F (interface) 115, a reading unit I/F 117, a printing unit I/F 119, an external storage I/F 121, and a communication unit I/F 123. Note that "CPU" is an abbreviation for Central Processing Unit. "ROM" is an abbreviation for Read Only Memory. "RAM" is an abbreviation for Random Access Memory.

CPU 111 controls the overall operation of image forming apparatus 101 . The CPU 111 reads a program stored in the ROM 112 or the storage 114 into the RAM 113 and executes the program. The program is, for example, a control program, and the CPU 111 performs various controls such as reading control and printing control by executing the control program. Further, the program includes a program for operating each part and each means of the image forming apparatus 101 and causing the CPU 111 (computer) to execute the method for controlling an information processing apparatus of the present invention. The ROM 112 stores programs executed by the CPU 111. The ROM 112 also stores boot programs, font data, and the like. The RAM 113 is the main memory of the CPU 111. The RAM 113 is used as a work area for the CPU 111, and as a temporary storage area for expanding programs stored in the ROM 112 and the storage 114. The RAM 113 is also used to temporarily store image data.

The storage 114 stores, for example, image data, print data, address books, shortcuts, various programs, and various setting information. Although a flash memory is used as the storage 114 in this embodiment, the present invention is not limited to this, and for example, an auxiliary storage device such as an SSD, an HDD, or an eMMC may be used. Note that "SSD" is an abbreviation for Solid State Drive. "HDD" is an abbreviation for Hard Disk Drive. "eMMC" is an abbreviation for Embedded Multi Media Card.

The operation unit I/F 115 connects the operation unit 116 and the control unit 110 in a communicable manner. The operation unit 116 has hard keys and a touch panel, and can also accept operations from the user. The hard keys include, for example, push-down buttons, keyboards, and the like. A touch panel is constructed by pasting a touch panel sheet on a display. The touch panel also functions as a display means that can display various screens.

The reading unit I/F 117 communicably connects the reading unit 118 and the control unit 110. The reading unit 118 is a reading unit that performs a reading process of reading an image of a document and generating image data. The image data generated by the reading unit 118 is subjected to character recognition processing, transmitted to an external device, or printed on a printing sheet, for example.

The printing unit I/F 119 connects the printing unit 120 and the control unit 110 in a communicable manner. The CPU 111 transfers image data to be printed, that is, image data to be printed, to the printing unit 120 via the printing unit I/F 119. The printing unit 120 prints image data as an image on a sheet fed from a paper cassette. The method of printing the image may be an electrophotographic method that prints the image using toner, or an inkjet method that prints the image using ink.

External storage I/F 121 communicably connects external storage device 122 and control unit 110. The CPU 111 causes the external storage device 122 to store image data and the like via the external storage I/F 121. In this embodiment, a USB interface is used as the external storage I/F 121, and a USB memory is used as the external storage device 122. Note that as the external storage device 122, for example, an SD card or the like can also be used.

The control unit 110 is connected to the network 100 via the communication unit I/F 123. Network 100 is, for example, a LAN. "LAN" is an abbreviation for "Local Area Network." The communication unit I/F 123 controls data transmission and reception performed via the network 100. For example, the image forming apparatus 101 sends various setting information inside the apparatus to the PC 102, sends an e-mail to the mail server 107, and sends image data to the online storage 106 via the communication unit I/F 123. You can Furthermore, the image forming apparatus 101 is connected to the bank service API authorization server 104 via the communication unit I/F 123, and can acquire the authorization code of the bank service API provided by the bank service resource server 105. Further, the image forming apparatus 101 is connected to the bank service resource server 105 via the communication unit I/F 123, and can present the authorization code of the bank service API and execute the bank service from the bank service API. Registration and changes of various setting information for obtaining an authorization code for the banking service API can be performed by accessing the image forming apparatus 101 from the PC 102 using the HTTP protocol.

Although not shown, the PC 102 has a hardware configuration including a CPU, RAM, ROM, storage, communication unit I/F, operation unit, etc., like the image forming apparatus 101. Furthermore, the bank service API authorization server 104, the bank service resource server 105, the online storage 106, and the mail server 107 also have the same hardware configuration as the PC 102.

FIG. 3 is a diagram illustrating a configuration example of an operation unit included in the image forming apparatus. As shown in FIG. 3, the operation unit 116 includes a touch panel 300, a home key 305, a Data LED 306, and an Error LED 307. A home screen 320 that is displayed immediately after the image forming apparatus 101 is started is displayed on the touch panel 300 . This home screen 320 is a screen that instructs the execution of each function of the image forming apparatus 101. For example, the home screen 320 includes a copy button 308, a fax button 309, a scan button 310, and a memory media print button 311. The copy button 308 is a button for using a copy function in which the printing unit 120 prints an image based on image data generated by reading a document with the reading unit 118. The fax button 309 is a button for using a fax function that transmits image data generated by reading a document with the reading unit 118 using a modem (not shown). The scan button 310 is a button for using a transmission function for transmitting image data generated by reading a document with the reading section 118 via the communication section I/F 123. Note that the sending function includes an e-mail function that sends image data attached to an e-mail, a folder sending function that sends image data to be stored in a designated folder, and the like. The memory media print button 311 is a button that is operated when the printing unit 120 prints an image based on image data stored in the external storage device 122 such as a USB memory. The home screen 320 also includes a menu button 301, an address book button 302 for calling and displaying an address book, and a bank transfer icon registration button 303 for setting a bank transfer destination.

The home key 305 is a hard key, and is a button for switching the currently displayed screen to the home screen 320. The Data LED 306 lights up during data transmission to notify the user that the image forming apparatus 101 is transmitting data. The Error LED 307 lights up when various errors occur in the image forming apparatus 101.

FIG. 4 is a screen for bank service authentication settings. A screen 400A shown in FIG. 4 is displayed on the operation unit 116 and is operated when registering the user information of the transfer source used for bank transfer in the image forming apparatus 101. Screen 400A is displayed by selecting menu button 301 (see FIG. 3) on home screen 320. The screen 400A includes an input section into which the user ID 401 is input, an input section into which the password 402 is input, an input section into which the registered name 403 of the bank service is input, and a login button 404. Both the user ID 401 and the password 402 are registered in advance for the user to use banking services. The user ID 401 continues to be displayed as is even after the input is completed, but the password 402 is displayed in hidden letters (blacked out in FIG. 4A) after the input is completed. When the login button 404 is selected, the information processing system 10 executes bank service authentication processing according to a sequence described later (see FIG. 6). This authentication process is performed by the image forming apparatus 101 against the bank service API authorization server 104.

If the bank service authentication is successful, the screen 400A shown in FIG. 4(A) switches to the screen 400B shown in FIG. 4(B). On screen 400B, user ID 405 and password 406 are each hidden, and registered name 407 continues to be displayed. Screen 400B has a logout button 408. When this logout button 408 is selected, the screen 400A is displayed again, but on the screen 400A, the user ID 401, password 402, and registered name 403 are erased, ie, cleared, without being displayed. On the other hand, if the bank service authentication fails, a message to the effect that the authentication has failed is displayed on the operation unit 116, and then the screen 400A is displayed again. In this screen 400A as well, the user ID 401, password 402, and registered name 403 are cleared. Note that the information registered for use of bank services, which should be input on the screen 400A, is set in advance in the image forming apparatus 101 via the browser of the PC 102.

FIG. 5 shows a screen for bank service authentication via a browser. A screen 500A shown in FIG. 5A is a setting screen that allows the same operations as the screen 400A, and is displayed on the monitor of the PC 102. Operations on the screen 500A are possible using the keyboard, mouse, etc. of the PC 102. The user can input the user ID 501, password 502, and registered name 503 on the screen 500A, and select the login button 504.

When the login button 504 is selected, the user ID 501, password 502, and registered name 503 are transmitted to the image forming apparatus 101 via the network 100 and stored in the storage 114 of the image forming apparatus 101. After this storage, the information processing system 10 executes the bank service authentication process in the same manner as described above.

If the bank service authentication is successful, the screen 500A shown in FIG. 5(A) switches to the screen 500B shown in FIG. 5(B). On screen 500B, user ID 505 and password 506 are each hidden, and registered name 507 continues to be displayed. On the other hand, if the bank service authentication fails, the screen 500A shown in FIG. 5(A) switches to the screen 500C shown in FIG. 5(C). A message 509 indicating that authentication has failed is displayed on the screen 500C.

FIG. 6 is a sequence for executing bank service authentication processing. Here, a case will be described in which authentication processing is executed based on information input via the screen 400A shown in FIG. 4(A). In step S801, the user requests the image forming apparatus 101 to perform login settings for accessing banking services. In step S802, the image forming apparatus 101 displays the screen 400A on the operation unit 116. In step S803, the user selects the login button 404 after inputting the user ID 401 and password 402 on the screen 400A. In step S804, the image forming apparatus 101 transmits a token request including the user ID 401 and password 402 input by the user in step S803 to the bank service API authorization server 104. In step S805, the bank service API authorization server 104 receives the token request transmitted in step S804, and confirms that the user ID 401 and password 402 of the token request are legitimate. After this confirmation, the bank service API authorization server 104 transmits a token request response to the image forming apparatus 101. In step S806, the image forming apparatus 101 receives the token request response transmitted in step S805, and displays the authentication result based on the token request response on the operation unit 116. A screen 900 shown in FIG. 7 is displayed on the operation unit 116 as a result of the authentication.

FIG. 7 is a screen displayed as an authentication result when the token request is legitimate in bank service authentication processing. A screen 900 shown in FIG. 7 includes a start button 901, a cancel button 902, and a message 903. When the user selects the start button 901, the image forming apparatus 101 associates the access token in the token request response with user information and stores it in the storage 114. After the saving is completed, a screen 400B shown in FIG. 4(B) is displayed on the operation unit 116, a screen 500B shown in FIG. 5(B) is displayed on the display of the PC 102, and the password is cleared. , ends the process. Note that if it cannot be confirmed that the token request is legitimate, the image forming apparatus 101 displays a message to that effect on the operation unit 116 and ends the process. The cancel button 902 is a button that is operated when the start button 901 is not selected. A message 903 is a message prompting the user to operate either the start button 901 or the cancel button 902.

FIG. 8 is a flowchart of the first (new) transfer process. Each process in the flowchart shown in FIG. 8 is realized by the CPU 111 reading a program stored in the ROM 112 into the RAM 113 and executing it. FIG. 9 is an example of a transfer bill. 10 to 13 are screens displayed during the transfer process, respectively.

As shown in FIG. 8, in step S1001, when the bank transfer icon registration button 303 (see FIG. 3) on the home screen 320 is selected, the CPU 111 determines whether the bank service authentication by the bank service API authorization server 104 has been completed. Determine whether If it is determined in step S1001 that bank service authentication has been completed, the process advances to step S1002. On the other hand, if it is determined in step S1001 that bank service authentication has not been completed, the process advances to step S1009.

In step S1009, the CPU 111 causes the operation unit 116 to display a bank service authentication setting screen 400A (see FIG. 4(A)). Then, the sequence shown in FIG. 6 (bank service authentication process) is executed, and then the process returns to step S1001, and the subsequent steps are sequentially executed.

In step S1002, if the user selects a registered transfer source, the CPU 111 advances the process to step S1003.

In step S1003, the CPU 111 executes bill image reading processing to read the image of the transfer bill. In this bill image reading process, the CPU 111 causes the reading unit 118 to read the image of the transfer bill 9 (original document) shown in FIG. 9 to generate image data. The CPU 111 stores this image data in the RAM 113, and the process advances to step S1004. Note that the transfer bill 9 shown in FIG. 9 is obtained in advance by printing with the image forming apparatus 101, for example. The transfer bill 9 includes (attached to) information regarding a transfer destination 91, a transfer amount 92 to the transfer destination 91, and a transfer deadline (payment deadline) 93 to the transfer destination 91, for example. Further, in this embodiment, the information regarding the transfer destination 91, the transfer amount 92, and the transfer deadline 93 is each composed of a character string having a plurality of characters (including numbers, symbols, etc.). In step S1003, the reading unit 118 can read a character string as information regarding the transfer destination 91, a character string as information regarding the transfer amount 92, and a character string as information regarding the transfer deadline 93.

In step S1004, the CPU 111 performs character recognition processing using OCR (optical character recognition) and text object extraction processing on the image data stored in the RAM 113. Specifically, the CPU 111 performs character recognition processing on the image data stored in the RAM 113. Next, the CPU 111 performs text object extraction processing on the results obtained from the character recognition processing. In the text object extraction process, the vicinity of each recognized character in the horizontal direction is searched, and characters within a predetermined distance are treated as one piece of character information (one text object). After executing the text object extraction process, the process advances to step S1005. As described above, in the present embodiment, the CPU 111 determines the transfer destination 91, transfer amount 92, and transfer deadline 93 in the transfer bill 9 based on the reading result by the reading unit 118, that is, the image data of the transfer bill 9. It functions as an identifiable means of identification. Further, when the transfer bill 9 read by the reading unit 118 includes a character string, the CPU 111 can perform character recognition processing and text object extraction processing to recognize the character string. Thereby, the transfer destination 91, the transfer amount 92, and the transfer deadline 93 can be accurately specified. Note that specifying the transfer destination 91, transfer amount 92, and transfer deadline 93 (specifying step) is not limited to using character recognition processing or the like. For example, if the transfer deadline 93 is displayed as a barcode, it can also be specified using a barcode reader.

In step S1005, the CPU 111 causes the operation unit 116 to display a screen for acquiring information (items) necessary for bank transfer. These screens include screen 1000A shown in FIG. 10(A), screen 1000B shown in FIG. 10(B), screen 1100A shown in FIG. 11(A), screen 1100B shown in FIG. 11(B), and screen 1100B shown in FIG. 11(C). There is a screen 1100C shown in FIG. 11, which are sequentially displayed on the operation unit 116. Screens 1000A to 1100C display a transfer invoice 9 and a list of a plurality of text information such as a transfer destination 91 extracted from the transfer invoice 9. Note that this list displays only some of the character information included in the list, and the remaining character information can be displayed using the scroll key or the key to display the next list. may be configured to be displayed when the

The user can select desired character information from a plurality of pieces of character information. Further, the CPU 111 causes the storage 114 to store character information selected by the user as transfer information. Specifically, CPU 111 causes storage 114 to store character information 1001 selected on screen 1000A as a bank name. Further, the CPU 111 causes the storage 114 to store the character information 1002 selected on the screen 1000B as a branch name. The character information selected on screen 1000A and screen 1000B can be stored by operating confirmation button 1003. Note that a return button 1004 arranged alongside the confirm button 1003 is a button for returning the display to the previous screen. Further, the CPU 111 causes the storage 114 to store the character information 1101 selected on the screen 1100A as the account type. Further, the CPU 111 causes the storage 114 to store the character information 1102 selected on the screen 1100B as an account number. The CPU 111 causes the storage 114 to store the character information 1103 selected on the screen 1100C as the transfer amount. The character information selected on screens 1100A to 1100C can be stored by operating the confirm button 1104. Note that a return button 1105 arranged alongside the confirm button 1104 is a button for returning the display to the previous screen.

In step S1008, the CPU 111 determines whether the selection of information (items) necessary for bank transfer has been completed. When the confirm button 1003 on screens 1000A and 1000B and the confirm button 1104 on screens 1100A to 1100C are selected, the CPU 111 determines that the item selection is complete, and the process proceeds to step S1010. On the other hand, if it is determined in step S1008 that the selection of items is not completed, the process returns to step S1005, and the subsequent steps are sequentially executed.

In step S1010, the CPU 111 displays a confirmation screen 1200 shown in FIG. 12 on the operation unit 116. The confirmation screen 1200 displays, for example, a transfer invoice 9, a transfer amount 1201 that is the same as the transfer amount 92 written on the transfer invoice 9, and a transfer fee 1202.

In step S1011, the CPU 111 determines whether the transfer process is permitted. If the confirm button 1203 on the confirmation screen 1200 is selected, the CPU 111 determines that the transfer process is permitted, and the process proceeds to step S1012. On the other hand, if it is determined in step S1011 that the transfer process is not permitted, that is, the transfer process is canceled, the process ends.

In step S1012, the CPU 111 executes a transfer process. This transfer process will be described later with reference to FIG. 14.

In step S1013, the CPU 111 determines whether the transfer process in step S1012 has ended normally. As a result of the determination in step S1013, if it is determined that the transfer process has ended normally, the process proceeds to step S1014. On the other hand, if it is determined in step S1013 that the transfer process has not ended normally, the process ends. Note that when the CPU 111 determines that the transfer process has not been completed normally, the CPU 111 may cause the operation unit 116 to display an error screen notifying that fact.

In step S1014, the CPU 111 causes the operation unit 116 to display a screen 1300A shown in FIG. 13(A). Screen 1300A is a transfer information registration screen for registering transfer information. Screen 1300A includes a yes button 1301 and a no button 1302. A yes button 1301 is a button that is operated when registering transfer information. The No button 1302 is a button that is operated to stop the registration of transfer information.

In step S1015, the CPU 111 determines whether registration of transfer information has been instructed. Specifically, if the Yes button 1301 on the screen 1300A is selected, the CPU 111 determines that an instruction has been given to register transfer information, and the process proceeds to step S1016. On the other hand, if the No button 1302 on the screen 1300A is selected, the CPU 111 determines that no instruction has been given to register the transfer information, and ends the process.

In step S1016, the CPU 111 executes a transfer destination registration process to register transfer information. Specifically, the CPU 111 causes the operation unit 116 to display a screen 1300B shown in FIG. 13(B). A registered name 1303 can be input on the screen 1300B. This input can be made by the user operating a software keyboard (not shown). Then, when the Yes button 1301 on the screen 1300B is selected, the CPU 111 causes the storage 114 to store the following information as transfer information. The transfer information includes the registered name 1304, bank name 1305, branch name 1306, account type 1307, account number 1308, the positions of these character strings, and the position of the transfer amount character string on the screen 1300B. be. As a result, the next time the home screen 320 is displayed, the CPU 111 displays the shortcut button 1701 (see FIG. 15) on the operation unit 116 (displays the object) based on the transfer information stored in the storage 114. be able to. On the other hand, if the No button 1302 is selected on the screen 1300A, the process ends without registering the transfer information. Note that, as shown in FIG. 15, a shortcut button 1701 is added to the home screen 320. The shortcut button 170 indicates a transfer destination where transfer processing can be performed.

Next, the transfer process executed in step S1012 will be explained with reference to FIG. 14. FIG. 14 is a flowchart of the transfer process. In step S1501, the user can select the confirm button 1203 on the confirmation screen 1200 shown in FIG. In step S1502, the image forming apparatus 101 transmits an access token and a transfer instruction including transfer information (transfer destination 91, transfer amount 92, etc.) to the bank service resource server 105 from the communication unit I/F 123 (transmission means). do. Note that this access token is an access token stored in advance in the sequence shown in FIG. In addition, the transfer information includes the characters selected on the screen 1000A shown in FIG. 10(A), the screen 1000B shown in FIG. 10(B), and the screen 1100A shown in FIG. It is information. In step S1503, the bank service resource server 105 receives the transfer instruction sent in step S1502, extracts the access token from the transfer instruction, and inquires the bank service API authorization server 104 for information on the access token. In step S1504, the banking service API authorization server 104 returns the access token information received in step S1503 to the banking service resource server 105.

In step S1505, the bank service resource server 105 receives the access token information transmitted in step S1504, and confirms the validity from the access token information. Then, if the access token information is valid, the bank service resource server 105 executes the transfer process. Furthermore, the bank service resource server 105 does not execute the transfer process if the access token information is invalid. In step S1506, the bank service resource server 105 transmits the result of the transfer process to the image forming apparatus 101. In step S1507, the image forming apparatus 101 receives the result of the transfer process transmitted in step S1506, and causes the operation unit 116 to display the result of the transfer process. This allows the user to check the results of the transfer process.

Next, the transfer process when the shortcut button 1701 (see FIG. 15) is selected will be described with reference to FIGS. 16 to 19. FIG. 16 is a flowchart of the transfer process when the shortcut icon is selected. Each process shown in FIG. 16 is realized by the CPU 111 reading a program stored in the ROM 112 into the RAM 113 and executing it. FIG. 17 is an example of a transfer bill. 18 and 19 are screens displayed during the transfer process, respectively.

In step S1601, when the shortcut button 1701 is selected, the CPU 111 executes bill image reading processing on the transfer bill 17 shown in FIG. 17. The processing in step S1601 is similar to the processing in step S1003. The transfer bill 17 includes information regarding a transfer destination 171, a transfer amount 172, and a transfer deadline 173.

In step S1602, the CPU 111 executes character recognition processing and text object extraction processing. The processing in step S1602 is similar to the processing in step S1004.

In step S1603, the CPU 111 acquires the transfer information stored in the storage 114 in step S1016. As mentioned above, this transfer information includes a registered name 1304, a bank name 1305, a branch name 1306, an account type 1307, an account number 1308, the positions of these character strings, and the position of the character string of the amount to be transferred. .

In step S1604, the CPU 111 compares the transfer information (information regarding the transfer destination, etc.) obtained in step S1602 with the transfer information (information regarding the transfer destination, etc.) obtained in step S1603.

In step S1605, the CPU 111 determines whether the transfer information obtained in step S1602 and the transfer information obtained in step S1603 are the same based on the comparison result in step S1604. As a result of the determination in step S1605, if it is determined that both pieces of transfer information are the same, the process proceeds to step S1606. On the other hand, as a result of the determination in step S1605, if it is determined that both pieces of transfer information are not the same, the process advances to step S1607.

In step S1606, the CPU 111 displays a confirmation screen 1800 shown in FIG. 18 on the operation unit 116, and the process proceeds to step S1608. The confirmation screen 1800 displays a transfer invoice 17, a transfer amount 1801 that is the same as the transfer amount 172 written on the transfer invoice 17, and a transfer fee 1802. This allows the user to confirm the details of the transfer.

In step S1607, the CPU 111 accepts correction of transfer information (for example, transfer destination, etc.) from the user in bank account information user confirmation processing. After that, the process returns to step S1605, and the subsequent steps are sequentially executed.

In step S1608, the CPU 111 determines whether the transfer process is permitted. If the confirm button 1803 on the confirmation screen 1800 is selected, the CPU 111 determines that the transfer process is permitted, and the process advances to step S1609. On the other hand, if the cancel button 1804 on the confirmation screen 1800 is selected, the CPU 111 determines that the transfer process is not permitted, that is, the transfer process has been canceled, and the process ends.

In step S1609, the CPU 111 extracts keywords related to the transfer deadline 173 based on the processing result in step S1602. This extraction is possible by searching for keywords such as "transfer deadline" and "payment deadline" in the character information obtained in step S1602. Note that keywords can be registered, changed, added, etc. as appropriate. Thereby, the extraction rate of the keyword (transfer deadline 173) can be improved.

In step S1610, the CPU 111 determines whether a keyword related to the transfer deadline 173 was extracted in step S1609. As a result of the determination in step S1610, if it is determined that the keyword has been extracted, the process advances to step S1611. On the other hand, if it is determined in step S1610 that no keyword has been extracted, the process advances to step S1614.

In step S1611, the CPU 111 determines whether the transfer deadline 173 has passed. Specifically, the CPU 111 performs character recognition processing and text object extraction processing on the keyword extracted in step S1609, searches for the vicinity of the keyword in the horizontal direction, and extracts data corresponding to the date. Then, the CPU 111 specifies this extracted date as the transfer deadline 173 (transfer deadline date). Thereafter, the CPU 111 compares the specified transfer deadline 173 with the current date and time, that is, the date and time when the transfer deadline 173 was specified by the CPU 111, and determines whether the specified transfer deadline 173 is the current date and time. (judgment step). In this embodiment, the CPU 111 thus functions as a determination unit that determines whether the specified transfer deadline 173 exceeds the current date and time. As a result of the determination in step S1611, if it is determined that the transfer deadline 173 has been exceeded, the process advances to step S1612. On the other hand, if it is determined in step S1611 that the transfer deadline 173 has not been exceeded, the process proceeds to step S1614. Note that the current date and time is obtained, for example, from an NTP (Network Time Protocol) server using the communication unit I/F 123 as an obtaining means. This makes it possible to obtain accurate current date and time, which contributes to accurate determination of whether the transfer deadline 173 has been exceeded.

In step S1612, the CPU 111 displays a confirmation screen 1900 shown in FIG. 19 on the operation unit 116. The confirmation screen 1900 is a transfer deadline expiry confirmation screen for the user to confirm that the transfer deadline 173 has been exceeded. The confirmation screen 1900 displays, for example, a date 1901 of the transfer deadline 173, a current date 1902, a process continuation button 1903, and a cancel button 1904. The process continuation button 1903 is a button that is operated to continue execution of the transfer process even if the transfer deadline has passed. The cancel button 1904 is a cancel process button that is operated to cancel execution of the transfer process. In this embodiment, the CPU 111 not only functions as the above-mentioned determining means, but also functions as a switching means for switching whether or not to continue execution of the transfer process, depending on the determination result of the determining means. Function. As a result, one CPU 111 can perform two functions, and the configuration of the image forming apparatus 101 can therefore be simplified. Then, a confirmation screen 1900 is displayed on the operation unit 116 as an example of a screen for switching transfer processing by the switching means.

In step S1613, the CPU 111 determines whether or not to continue the transfer process. Specifically, if the process continuation button 1903 is operated on the confirmation screen 1900, the CPU 111 determines to continue the transfer process, and the process advances to step S1614. Further, when the cancel button 1904 is operated on the confirmation screen 1900, the CPU 111 determines that the transfer process is not to be continued, that is, the transfer process is to be canceled, and the process is ended.

In step S1614, the CPU 111 executes a transfer process. This process is similar to the sequence shown in FIG.

As described above, the image forming apparatus 101 determines whether the transfer deadline 173 exceeds the current date and time (determination step), and depending on the determination result, determines whether or not to continue executing the transfer process. can be switched (switching process). If it is determined that the transfer deadline 93 has exceeded the date and time, the transfer process can be changed to a process corresponding to the date and time, that is, to continue the transfer process or to cancel the transfer process. Note that when continuing the transfer process, if the transfer amount 172 can be left unchanged, the transfer process is performed using the transfer amount 172. Further, if it is necessary to add the amount exceeding the transfer deadline to the transfer amount 172, the transfer process is performed using the transfer amount obtained by adding the amount exceeding the transfer deadline to the transfer amount 172. On the other hand, if it is determined that the transfer deadline 93 has not exceeded the date and time, execution of the transfer process can be continued as is. Therefore, in the image forming apparatus 101, when the user transfers the fee to the transfer destination 171, the user can appropriately select the transfer process depending on whether or not the transfer deadline 93 to the transfer destination 171 has been exceeded. This can prevent the transfer process from being erroneously executed without the user's confirmation.

Further, the image forming apparatus 101 is configured to be able to continue executing the transfer process even when information regarding the transfer deadline 173 is not attached to the transfer bill 17 (see steps S1610 and S1614). Thereby, the transfer bill 17 can be processed regardless of the transfer deadline 173. Note that the image forming apparatus 101 may be configured to be able to switch whether or not to continue executing the transfer process when the transfer bill 17 does not include information regarding the transfer deadline 173. This allows the user to consider once whether or not to continue executing the transfer process.

Further, the image forming apparatus 101 may be configured to be able to forcibly stop execution of the transfer process when it is determined that the transfer deadline has passed. For example, in the case of strictly observing the transfer deadline when purchasing a concert ticket, it is preferable that execution of the transfer process is forcibly stopped if the transfer deadline is exceeded. Thereby, it is possible to prevent the transfer process from being wasted or erroneously resulting in a transfer process. Furthermore, when processing a transfer bill issued by a government or public institution, if it is determined that the transfer deadline has passed, it is preferable that execution of the transfer process is forcibly stopped. Note that it is preferable that the transfer invoice for which execution of the transfer process is forcibly canceled is accompanied by a statement indicating that it is subject to the forcible cancellation. This description is not particularly limited, and includes, for example, specific characters (for example, "Payment deadline strictly observed"), symbols (for example, "Administrative agency mark"), and the like.

Further, the image forming apparatus 101 can also acquire character information and position information of the character information about the transfer destination from the image data of the transfer bill. Then, based on the acquired character information, the bank can transfer money using the bank service API on the Web. You can also reuse the transfer destination by registering it as a shortcut. Furthermore, when making a transfer using a transfer destination registered in the shortcut, the transfer deadline of the transfer bill can be automatically detected and a transfer deadline confirmation screen can be displayed. This allows the user to decide whether or not to continue the transfer process for the invoice, and prevents the transfer process for an invoice whose transfer deadline has passed from being erroneously executed without the user's confirmation. can do.

In particular, in recent years, services for making money transfers using the Internet have become available. By using the banking service API on the web, it is possible to perform transfer processing without using a web browser. Unlike bank transfers via ATM networks or web browsers, it is difficult to obtain the name of the account holder to whom the transfer will be made even if the financial institution name, branch name, and account number are notified using the banking service API on the web. . Furthermore, it is difficult to obtain the name of the account holder of the transfer destination, which is linked to the financial institution name and account number stored in the financial institution's host computer. Therefore, if you enter the wrong financial institution name, branch name, account name, or account number, there is a risk that the money will be transferred to the wrong recipient. Additionally, the positions of the financial institution name, branch name, account name, and account number listed on general transfer invoices, etc. depend on the format of the issuer of the transfer invoice, and are therefore not fixed unlike in bank transfer request forms. Therefore, every time you received a transfer invoice, you had to check and enter the financial institution name, branch name, account number, account number, and invoice amount before making the transfer. However, according to the present embodiment, it is possible to accurately obtain textual information such as a transfer destination and positional information of the textual information from image data of a document such as a transfer bill.

<Second embodiment>
The second embodiment will be described below with reference to FIGS. 20 to 25. In the first embodiment, when it is detected that the transfer deadline has passed, the user can only choose to continue or cancel the transfer process related to the bill. Generally, even if the transfer deadline stated on the transfer invoice is exceeded, there are cases where the transfer can be processed as is according to the contents of the invoice, and the transfer process is temporarily suspended and the transfer is made after confirmation with the recipient. There may also be cases where it is desired to restart the process. In this embodiment, an image forming apparatus 101 that can restart a temporarily suspended transfer process at any timing will be described.

FIG. 20 is a flowchart of the transfer process when the shortcut icon is selected in the second embodiment. Each process in the flowchart shown in FIG. 20 is realized by the CPU 111 reading a program stored in the ROM 112 into the RAM 113 and executing it. 21 and 22 are screens displayed during the transfer process, respectively.

When the transfer processing shortcut button 1701 is selected, each process of the flowchart shown in FIG. 20 is executed. Here, steps S2001 to S2011 are the same as steps S1601 to S1611 in the flowchart shown in FIG. 16 described above, so the explanation thereof will be omitted.

In step S2012, the CPU 111 displays a confirmation screen 2100 shown in FIG. 21 on the operation unit 116. The confirmation screen 2100 is a transfer deadline expiry confirmation screen for the user to confirm that the transfer deadline 173 has been exceeded. The confirmation screen 2100 displays, for example, a date 2101 of the transfer deadline 173, a current date 2102, a process continuation button 2103, a cancel button 2104, and a process hold button 2105. The process continuation button 2103, like the process continuation button 1903, is a button that is operated to continue execution of the transfer process even if the transfer deadline has passed. The cancel button 2104, like the cancel button 1904, is a cancel process button that is operated to cancel execution of the transfer process. The process hold button 2105 is a hold process button that is operated to temporarily hold the execution of the transfer process. As described above, in this embodiment, the process after the transfer deadline has passed can be switched to continue the transfer process, cancel the transfer process, or suspend the transfer process.

In step S2013, the CPU 111 determines whether or not to continue the transfer process. Specifically, if the process continuation button 2103 is operated on the confirmation screen 2100, the CPU 111 determines to continue the transfer process, and the process advances to step S2014. Further, if a button other than the process continuation button 2103 is operated on the confirmation screen 2100, that is, the cancel button 2104 or the process hold button 2105, the CPU 111 determines that the transfer process is not to be continued, and the process returns to step S2015. move on.

In step S2014, the CPU 111 executes a transfer process. This process is similar to step S1614.

In step S2015, the CPU 111 determines whether the transfer process is on hold. Specifically, if the process pending button 2105 is operated on the confirmation screen 2100, the CPU 111 determines that the transfer process is pending, and the process proceeds to step S2016. Further, if the cancel button 2104 is operated on the confirmation screen 2100, the CPU 111 determines that the transfer process is not on hold, that is, the transfer process is canceled, and the process ends.

In step S2016, the CPU 111 displays a confirmation screen 2200 shown in FIG. 22 on the operation unit 116. A confirmation screen 2200 is a transfer processing pending confirmation screen for the user to confirm that the transfer processing is pending, and a message 2201 indicating that the transfer processing is pending is displayed. Further, the CPU 111 causes the storage 114 (storage means) to store the transfer data related to the hold processing. This transfer data includes, for example, the transfer destination name (transfer destination 171), bank name, branch name, account type, account number, transfer amount 172, and the like.

Next, the case where the once suspended transfer process is restarted will be explained with reference to FIGS. 23 to 25. FIG. 23 is a screen displayed during the transfer restart process. FIG. 24 is a flowchart of the transfer restart process. Each process in the flowchart shown in FIG. 24 is realized by the CPU 111 reading a program stored in the ROM 112 into the RAM 113 and executing it. FIG. 25 is a screen displayed during the transfer restart process.

As shown in FIG. 23, a transfer restart button 2301 is displayed on the home screen 320 of the operation unit 116. The CPU 111 executes each process of the flowchart shown in FIG. 24 when the transfer restart button 2301 is operated.

In step S2401 after execution of the suspension process, the CPU 111 calls the transfer data stored in the storage 114 in step S2016.

In step S2402, the CPU 111 causes the operation unit 116 to display a transfer processing restart screen 2500 shown in FIG. The transfer processing restart screen 2500 displays a restart button 2501 and a return button 2502. The restart button 2501 is a button that is operated when restarting the transfer process. The return button 2502 is a button that is operated when canceling the transfer process.

In step S2403, the CPU 111 determines whether there is an instruction to restart the transfer process. Specifically, when the restart button 2501 is operated on the transfer processing restart screen 2500, the CPU 111 determines that there is an instruction to restart the transfer processing, and the process proceeds to step S2404. If the CPU 111 determines that there is no instruction to restart the transfer process, the process advances to step S2406.

In step S2406, the CPU 111 determines whether the transfer restart process has been canceled. Specifically, when the return button 2502 is operated on the transfer process restart screen 2500, the CPU 111 determines that the transfer process has been canceled, and the process ends. If the CPU 111 determines that the transfer restart process is not canceled, the process returns to step S2403, and the subsequent steps are sequentially executed.

In step S2404, the CPU 111 executes a transfer process. This process is similar to step S1614. Note that when restarting the once suspended transfer process based on this flowchart, the confirmation screen 2100 (see FIG. 21) displayed on the operation unit 116 in step S2012 is not displayed.

In step S2405, the CPU 111 deletes the transfer data for which the transfer process was performed in step S2405 from the storage 114, and the process ends.

As described above, in this embodiment, it is possible to restart execution of the transfer process. As a result, after the user recognizes the payment deadline, the user temporarily suspends the transfer process, confirms with the transfer recipient how to proceed, and then transfers the transfer again if it is determined that the transfer can be processed with the details on the transfer invoice. You can resume the transfer process without scanning the invoice. An example of a case where the transfer can be processed with the contents described in the transfer invoice is a case where the transfer can be processed if the transfer deadline is exceeded within a predetermined number of days.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and various modifications and changes can be made within the scope of the gist thereof. The present invention provides a program that implements one or more functions of each embodiment described above to a system or device via a network or a storage medium, and one or more processors of a computer in the system or device reads the program. It is also possible to implement the process by executing the process. The present invention can also be implemented by a circuit (eg, an ASIC) that implements one or more functions. The device to which the information processing device is applied is an MFP in the above embodiment, but is not limited to this, and may be, for example, a device composed of a PC and a scanner or smartphone separate from the PC. You can.

101 Image forming device 111 CPU
118 Reading unit 17 Transfer bill 171 Transfer destination 172 Transfer amount 173 Transfer deadline

Claims (14)

An information processing device that executes a transfer process of transferring a fee to a transfer destination,
a reading means for reading a manuscript attached with information regarding the transfer destination, the amount to be transferred to the transfer destination, and the deadline for transfer to the transfer destination;
a specifying means for specifying at least the transfer deadline among the transfer destination, the transfer amount, and the transfer deadline based on the reading result by the reading section;
Comparing the transfer deadline specified by the specifying means with the date and time at the time when the transfer deadline was specified by the specifying means, and determining whether the transfer deadline exceeds the date and time. means and
An information processing device comprising: a switching unit that switches whether or not to continue execution of the transfer process according to a determination result by the determination unit. When the determining means determines that the transfer deadline exceeds the date and time, the switching means changes the transfer processing to a process corresponding to the exceedance of the date and time, and the determining means changes the transfer processing to a process corresponding to the exceedance of the date and time. The information processing apparatus according to claim 1, wherein when it is determined that the deadline has not exceeded the date and time, execution of the transfer process is continued. Claim 2, wherein the processing in response to the exceedance of the date and time includes at least one of a canceling process that suspends execution of the transfer process, and a hold process that suspends execution of the transfer process. The information processing device described in . 4. The information processing apparatus according to claim 3, wherein the switching means is capable of switching between the cancel processing and the hold processing. 5. The information processing apparatus according to claim 3, further comprising a storage means for storing the transfer destination, the transfer amount, and the transfer deadline in the suspension process. 6. The information processing according to claim 5, wherein after execution of the suspension process, the transfer destination, the transfer amount, and the transfer deadline are retrieved from the storage means, and execution of the transfer process can be restarted. Device. 2. The switching means is capable of forcibly canceling the execution of the transfer process when the determining means determines that the transfer deadline exceeds the date and time. 6. The information processing device according to any one of 6. 8. The information processing apparatus according to claim 1, further comprising a transmitting means for transmitting the transfer destination and the transfer amount as the transfer process. In the manuscript, the information regarding the transfer destination, the transfer amount, and the transfer deadline are each composed of character strings having a plurality of characters,
The reading means is capable of reading each of the character strings,
2. The specifying means specifies the transfer destination, the transfer amount, and the transfer deadline by performing a character recognition process that recognizes each of the character strings read by the reading device. 8. The information processing device according to any one of 8. According to any one of claims 1 to 9, the switching means is capable of continuing execution of the transfer process when information regarding the transfer deadline is not attached to the document. The information processing device described. The information processing apparatus according to any one of claims 1 to 10, further comprising a display unit capable of displaying the switching screen by the switching unit. 12. The information processing apparatus according to claim 1, further comprising an acquisition unit that acquires the date and time from an NTP (Network Time Protocol) server. A method for controlling an information processing device that executes a transfer process of transferring a fee to a transfer destination, the method comprising:
a reading step of reading a manuscript with information about the transfer destination, the amount to be transferred to the transfer destination, and the deadline for transfer to the transfer destination;
a specifying step of specifying at least the transfer deadline among the transfer destination, the transfer amount, and the transfer deadline based on the reading result in the reading step;
a determination step of comparing the transfer deadline specified in the specific step with the date and time at the time when the transfer deadline was specified in the specific step, and determining whether the transfer deadline exceeds the date and time; ,
A method for controlling an information processing apparatus, comprising: a switching step for switching whether or not to continue execution of the transfer process according to a determination result in the determination step. A program for causing a computer to execute each means of the information processing apparatus according to claim 1.

Images