JP6340943B2 - Electronic document generation system, image forming apparatus, and program - Google Patents

Description

  The present invention relates to an electronic document generation system that generates an electronic document and a technology related thereto.

  As a technique for generating an electronic document, there is a technique for improving the visibility of characters while increasing the compression rate. For example, there is a technique for generating a highly compressed PDF (Portable Document Format) file as an electronic document (also referred to as “compact PDF file”) based on a scanned image (see Patent Document 1, etc.).

JP 2009-141597 A

  By the way, in the electronic document generation processing, it is conceivable that a scan image by the image forming apparatus is transmitted to an external terminal different from the image forming apparatus, and the external document generates an electronic document based on the scan image.

  For example, when such an operation is applied in the technique according to Patent Document 1, a scan image is transmitted from the image forming apparatus to an external terminal, and the external terminal performs an operation on the scan image received from the image forming apparatus. Related processing (processing related to the generation of a highly compressed PDF file (such as compression processing)). Then, the external terminal generates an electronic document (highly compressed PDF file) based on the processing result of the related processing.

  However, for example, when the communication between the image forming apparatus and the external terminal is interrupted before the reception of the scan image is completed, the external terminal cannot execute the related process on the scan image. Then, after the communication between the image forming apparatus and the external terminal is resumed, the scanned image is transmitted (retransmitted) from the image forming apparatus to the external terminal, and the related processing for the scanned image is executed (reexecuted) in the external terminal. Is done. In other words, when communication between the image forming apparatus and the external terminal is interrupted, the external terminal cannot execute the related process until after the communication is resumed, and the electronic document generation process may be delayed.

  Accordingly, an object of the present invention is to provide a technique capable of suppressing a delay in electronic document generation processing even when communication between an image forming apparatus and an external terminal is interrupted.

In order to solve the above problems, the invention of claim 1 is an electronic document generation system, comprising an image forming apparatus that generates a scanned image of an original, and an external terminal that generates an electronic document based on the scanned image. The image forming apparatus includes: a divided data generation unit that divides the scan image into a plurality of regions to generate a plurality of divided data; and a transmission unit that transmits the plurality of divided data to the external terminal. The external terminal includes: a first process executing unit that executes the related process with respect to the divided data that has not yet been completed related processing related to the generation of the electronic document; and the related process that is related to the plurality of divided data. Document generating means for generating the electronic document based on a processing result, and the image forming apparatus and the image forming apparatus before the transmission of the plurality of divided data is completed. When communication with the terminal is interrupted, with respect to at least one of the divided data transmission is not completed to the external terminal of the plurality of divided data, a second executing on behalf of the associated process to the external terminal A processing execution unit, wherein the transmission unit of the image forming apparatus transmits a processing result relating to the divided data on which the related processing has been performed by the second processing execution unit to the external terminal after the communication is resumed. The document generation unit of the external terminal is a first processing result that is a processing result related to the divided data for which the related processing has been executed by the first processing execution unit of the external terminal among the plurality of divided data. And among the plurality of pieces of divided data, a processing result related to the divided data for which the related processing has been executed by the second processing execution unit of the image forming apparatus. Based on the second processing result, the generated electronic document, wherein the image forming apparatus, the related processing by the second process execution means of the image forming apparatus in resuming point of the communication is executed yet Calculating means for calculating a processing time relating to the specific divided data, wherein the calculating means is a first required process which is a time required for the related process relating to the specific divided data by the first process executing means; A second required process that calculates a time based on the processing capability of the external terminal and is a remaining required process time from the restart point of the related process related to the specific divided data by the second process execution unit; The time is calculated based on the processing capability of the image forming apparatus, and the second processing execution unit of the image forming apparatus is configured to execute the first requirement when the communication is resumed. When the processing time is compared with the second required processing time and it is determined that the first required processing time is longer than the second required processing time, the relation relating to the specific divided data The execution of the process is continued, and after the related process related to the specific divided data is completed, the processing result of the related process related to the specific divided data is transmitted to the external terminal by the transmission unit, and the first required When it is determined that the processing time is shorter than the second required processing time, the related processing relating to the specific divided data is stopped, and the specific divided data is transmitted to the external terminal by the transmission unit. It is characterized by transmitting.

According to a second aspect of the present invention, in the electronic document generation system according to the first aspect of the invention, the transmission unit of the image forming apparatus transmits the plurality of divided data to the external terminal when the communication is resumed. A portion of the divided data that has not been completed yet and that has not yet been started by the second processing execution unit of the image forming apparatus at the time when the communication is resumed. The first process execution means of the external terminal executes the related process with respect to the partial data received after the communication is resumed, and the external terminal document generation means, said first processing sintering including the relevant treatment process result by the first process execution means in both the after the previous communication interruption with the communication resumption If, based on the said associated processing of the processing result is that the second processing result of the second process execution means, and generates the electronic document.

According to a third aspect of the present invention, in the electronic document generation system according to the first or second aspect of the invention, the related processing includes compression processing for compressing different types of regions in the scanned image at different compression rates. The document generation means of the external terminal includes the first processing result which is the divided data subjected to the compression processing by the first processing execution means, and the compression processing by the second processing execution means. The electronic document is generated on the basis of the second processing result that is the divided data subjected to.

According to a fourth aspect of the present invention, in the electronic document generation system according to the first or second aspect of the invention, the related process includes an optical character recognition process, and the first process execution means divides the process target. First text data obtained by performing the optical character recognition processing on the data is generated as the first processing result, and the second processing execution means performs the optical character recognition processing on the divided data to be processed. Second text data obtained as a result of the processing is generated as the second processing result, and the document generation means of the external terminal generates the plurality of divided data and the first processing result generated as the first processing result. The electronic document is generated on the basis of the text data and the second text data generated as a result of the second processing.

According to a fifth aspect of the present invention, in the electronic document generation system according to any one of the first to fourth aspects of the present invention, the second processing execution unit of the image forming apparatus includes the image at the time when the communication is interrupted. When a process different from the related process is being executed in the forming apparatus, the priority of the process being executed, which is the process being executed, and the priority of the related process are assigned to each process in the image forming apparatus. If the priority order of the related process is higher than the priority order of the executing process, the related process is immediately started, and the priority order of the related process is In the case where the priority is lower than the priority of the process being executed, the related process is started after the completion of the process being executed.

The invention according to claim 6 is an image forming apparatus capable of communicating with an external terminal that generates an electronic document, and a divided data generating unit that generates a plurality of divided data by dividing a scanned image of a document into a plurality of regions; Transmitting means for transmitting the plurality of divided data to the external terminal, and causing the external terminal to execute the related processing related to the divided data for which the related processing related to generation of the electronic document has not yet been completed; When communication between the image forming apparatus and the external terminal is interrupted before data transmission is completed, the related data is related to at least one of the plurality of divided data that has not yet been transmitted to the external terminal. Processing execution means for executing processing on behalf of the external terminal, and the transmission means relates to the divided data on which the related processing has been executed by the processing execution means. Processing result to the transmission to the external terminal after the resumption of the communication that the image forming apparatus, divided specific of the relevant process by the process execution unit of the image forming apparatus in resuming point of the communication is executed yet Calculation means for calculating a processing time relating to data, wherein the calculating means determines a first required processing time, which is a time required for the related processing relating to the specific divided data by the external terminal, as a processing capability of the external terminal. And a second required processing time that is a remaining required processing time from the restart point of the related processing related to the specific divided data by the processing execution unit of the image forming device. The processing execution means calculates the first required processing time and the second place when the communication is resumed. When the processing time is compared and it is determined that the first required processing time is longer than the second required processing time, the execution of the related processing relating to the specific divided data is continued, After the related process relating to the specific divided data is completed, a processing result of the related process relating to the specific divided data is transmitted to the external terminal by the transmission unit, and the first required processing time is the second required time. When it is determined that the processing time is shorter than the processing time, the related processing relating to the specific divided data is stopped, and the specific divided data is transmitted to the external terminal by the transmission unit.

According to a seventh aspect of the present invention, a) a step of generating a plurality of divided data by dividing a scanned image of a document into a plurality of areas in a computer built in an image forming apparatus capable of communicating with an external terminal that generates an electronic document B) transmitting the plurality of pieces of divided data to the external terminal capable of executing related processing relating to generation of the electronic document; c) the plurality of divisions in step b). When communication between the image forming apparatus and the external terminal is interrupted before data transmission is completed , at least one of the plurality of divided data that has not yet been transmitted to the external terminal A step of executing the related process on behalf of the external terminal; and d) a processing result regarding the divided data on which the related process is executed in step c). A program for executing the steps of: transmitting to the external terminal after the serial communication resumption, the step c) is, c-1) the associated processing by the image forming apparatus in resuming point of the communication is still When there is specific divided data being executed, the first required processing time, which is the time required for the related processing related to the specific divided data by the external terminal, is calculated based on the processing capability of the external terminal. Calculating a second required processing time, which is a remaining required processing time from the resumption time of the related processing relating to the specific divided data by the image forming device, based on a processing capability of the image forming device; c-2) a step of comparing the first required processing time and the second required processing time when the communication is resumed; c-3) When it is determined in step c-2) that the first required processing time is longer than the second required processing time, the step of continuing the execution of the related processing relating to the specific divided data And c-4) if it is determined in step c-2) that the first required processing time is shorter than the second required processing time, the related processing relating to the specific divided data. And in step d), it is determined in step c-2) that the first required processing time is longer than the second required processing time. After completion of the related process related to the specific divided data, the processing result of the related process related to the specific divided data is transmitted to the external terminal, and the first required processing time is the second required processing time. Shorter than If it is determined in step c-2), the specific divided data is transmitted to the external terminal.

The invention of claim 8 is an electronic document generation system, an image forming apparatus that generates a scanned image of a document, and an external terminal that generates an electronic document based on the scanned image in cooperation with the image forming apparatus and the cloud server And the image forming apparatus divides the scan image into a plurality of regions to generate a plurality of divided data, and a transmission unit transmits the plurality of divided data to the external terminal. The external terminal includes first processing execution means for performing pre-processing of the related processing with respect to divided data for which related processing related to generation of the electronic document has not yet been completed, and the related processing The processing request instruction that the related processing is to be executed by the cloud server with respect to the divided data that has not yet been completed and the processing result should be transmitted to the external terminal. Communication means for transmitting to the cloud server together with the processing result of the pre-processing relating to the divided data, and document generating means for generating the electronic document based on the processing result of the related processing relating to the plurality of divided data. And when the first communication, which is communication between the image forming apparatus and the external terminal, is interrupted before the transmission of the plurality of divided data is completed, the external terminal among the plurality of divided data Second processing execution means for executing the pre-processing on behalf of the external terminal with respect to the divided data that has not been completed yet and the related processing is not yet completed. The transmission unit of the image forming apparatus performs second communication that is communication between the image forming apparatus and the cloud server while the first communication is interrupted. When it is possible to send the processing result of the preprocessing by the second processing execution means to the cloud server, and to send the processing request command for the divided data subjected to the preprocessing, Transmitting to the cloud server on behalf of the terminal, the cloud server transmits to the external terminal a processing result related to the related process executed based on the processing request command from the communication means of the external terminal, and This was executed based on the processing request command from the transmission unit of the image forming apparatus after the third communication, which is communication between the cloud server and the external terminal, was resumed along with the resumption of the first communication. The processing result related to the related processing is transmitted to the external terminal, and the document generation means of the external terminal is Based on the first processing result that is the processing result of the related processing requested by the server and the second processing result that is the processing result of the related processing requested by the image forming apparatus to the cloud server. The electronic document is generated.

According to a ninth aspect of the invention, in the electronic document generation system according to the eighth aspect of the invention, the related process includes an optical character recognition process executed in the cloud server, and the cloud server is requested from the external terminal. The first text data that is the processing result of the optical character recognition processing is generated as the first processing result, and the second text data that is the processing result of the optical character recognition processing requested by the image forming apparatus. Is generated as the second processing result.

The invention according to claim 10 is an image forming apparatus capable of communicating with an external terminal that generates an electronic document in cooperation with a cloud server, and generates a plurality of divided data by dividing a scanned image of a document into a plurality of regions. Transmitting the plurality of pieces of divided data to the external terminal and executing the preprocessing of the related processing on the divided data for which the related processing related to generation of the electronic document has not been completed yet, to the external terminal In addition, a processing request command for executing the related processing related to the divided data for which the related processing has not been completed is executed by the cloud server and transmitting the processing result to the external terminal. transmitting means together with the processing result of the processing is transmitted from the external terminal to the cloud server, the image forming apparatus and with the external terminal When the first communication that is a communication is interrupted before the transmission of the plurality of divided data is completed, the preprocessing is performed on the divided data that has not yet been transmitted to the external terminal among the plurality of divided data. Processing execution means executed on behalf of the terminal, and the transmission means is capable of second communication that is communication between the image forming apparatus and the cloud server while the first communication is interrupted. The processing execution means sends the processing result of the preprocessing to the cloud server and sends the processing request command for the divided data subjected to the preprocessing to the cloud server instead of the external terminal. It is characterized by transmitting to.

According to an eleventh aspect of the present invention, there is provided a computer incorporated in an external terminal that generates an electronic document in cooperation with an image forming apparatus and a cloud server, and a) a plurality of scan images generated by dividing a scanned image into a plurality of areas. Receiving divided data from the image forming apparatus; b) divided data received from the image forming apparatus in step a), and related data relating to generation of the electronic document has not yet been completed. A step of executing a pre-processing of the related processing, and c) the related processing related to the divided data received from the image forming apparatus in the step a) and the related processing is not yet completed. A processing request command for executing the processing by the cloud server and transmitting the processing result to the external terminal; ) Transmitting to the cloud server together with the processing result of the preprocessing executed on the divided data in d), and d) processing result of the related processing requested to the cloud server by the external terminal in step c) A step of receiving from the cloud server, and e) a case where the first communication which is a communication between the image forming apparatus and the external terminal is interrupted before the reception of the plurality of divided data in the step a) is completed. The processing result related to the related processing executed in the cloud server based on the processing request command transmitted from the image forming apparatus to the cloud server on behalf of the external terminal is transmitted with the resumption of the first communication. After the second communication that is communication between the cloud server and the external terminal is resumed, A step of receiving from the cloud server; f) a processing result of the related processing requested from the external terminal to the cloud server and received in step d); And a step of generating the electronic document based on the processing result of the related processing requested by the cloud server and the processing result received in step e). Features.

The invention of claim 12 is an electronic document generation system, an image forming apparatus for generating a scanned image of an original, and an external terminal for generating an electronic document based on the scanned image in cooperation with the image forming apparatus and a cloud server And the image forming apparatus divides the scan image into a plurality of regions to generate a plurality of divided data, and a transmission unit transmits the plurality of divided data to the external terminal. The external terminal has a first process execution means for executing the first related process with respect to the divided data for which the first related process related to the generation of the electronic document has not yet been completed, The second related process related to the divided data for which the second related process related to the generation of the electronic document has not been completed is executed by the cloud server and the processing result Is transmitted to the cloud server, a processing result of the first related processing relating to the plurality of divided data, and the first relating to the plurality of divided data. A document generation unit configured to generate the electronic document based on a processing result of the second related process, wherein the image forming apparatus performs communication between the image forming apparatus and the external terminal. Is interrupted before the transmission of the plurality of divided data is completed, among the plurality of divided data, the divided data that has not yet been transmitted to the external terminal, and the first processing execution means performs the first A second process executing means for executing the first related process on behalf of the external terminal for the divided data for which the related process has not yet been completed, and the transmission of the image forming apparatus; The stage may perform the second communication that is the communication between the image forming apparatus and the cloud server while the first communication is interrupted, and when the second communication is possible, The cloud server sends the processing request command for the divided data that has not yet been transmitted to the external terminal and for which the second related processing by the cloud server has not yet been completed, on behalf of the external terminal. To the external terminal after resuming the first communication, and the cloud server is configured to transmit the processing result related to the divided data for which the first related processing has been executed by the second processing execution unit. When the third communication, which is the communication between the cloud server and the external terminal, is resumed along with the resumption of the first communication, the processing request from the transmission unit of the image forming apparatus is resumed. A processing result related to the divided data on which the second related processing is executed based on the request command is transmitted to the external terminal, and the document generation unit of the external terminal is configured to execute the first related processing executed on the external terminal. The first processing result that is the processing result of the processing, the second processing result that is the processing result of the first related processing executed in the image forming apparatus, and the cloud server requested by the external terminal. Based on the third processing result that is the processing result of the second related processing and the fourth processing result that is the processing result of the second related processing requested to the cloud server by the image forming apparatus. The electronic document is generated.

According to a thirteenth aspect of the present invention, in the electronic document generation system according to the twelfth aspect of the present invention, the second related process includes an optical character recognition process executed in the cloud server, and the cloud server is connected to the external terminal. The first text data, which is the processing result of the optical character recognition process requested from, is generated as the third processing result, and the second result is the processing result of the optical character recognition process requested from the image forming apparatus. This text data is generated as the fourth processing result.

According to a fourteenth aspect of the present invention, in the electronic document generation system according to the thirteenth aspect of the invention, the first related processing includes compression processing for compressing different types of regions in the scanned image at different compression rates. The first processing execution unit of the external terminal generates first processed divided data that is the divided data subjected to the compression processing as the first processing result, and the first processing execution unit of the image forming apparatus performs the first processing. The second processing execution unit generates second processed divided data, which is the divided data subjected to the compression processing, as the second processing result, and the document generation unit of the external terminal includes the first processing unit. Text data, the second text data, the first processed divided data generated as the first processing result, and the second processed divided data generated as the second processing result Based on the bets, and generates an electronic document.

The invention of claim 15 is an image forming apparatus capable of communicating with an external terminal that generates an electronic document in cooperation with a cloud server, and generates a plurality of divided data by dividing a scanned image of a document into a plurality of regions. The divided data generating means transmits the plurality of divided data to the external terminal, and performs the first related processing relating to the divided data for which the first related processing related to generation of the electronic document has not been completed yet. The second related process relating to the divided data for which the second related process related to the generation of the electronic document has not been completed is executed by the cloud server and the processing result is transmitted to the external terminal. a processing request instruction to transmit, and transmission means for transmitting from the external terminal to the cloud server is the communication with the external terminal and the image forming apparatus When the communication of 1 is interrupted before the transmission of the plurality of divided data is completed, the first related processing is performed on the divided data that has not yet been transmitted to the external terminal among the plurality of divided data. A processing execution unit that executes the processing in place of the first communication, and the transmission unit is capable of performing a second communication that is a communication between the image forming apparatus and the cloud server while the first communication is interrupted. In some cases, the divided data that has not yet been transmitted to the external terminal among the plurality of divided data and the second related processing related to generation of the electronic document has not yet been completed. A processing request command for executing the second related processing by the cloud server and transmitting the processing result to the external terminal is sent to the cloud server on behalf of the external terminal. Transmitted to, and transmits to the external terminal processing results for dividing data to which the first associated process is executed after the resumption of the first communication by the process execution means.

According to a sixteenth aspect of the present invention, there is provided a computer incorporated in an external terminal that generates an electronic document in cooperation with an image forming apparatus and a cloud server, and a) a plurality of scan images generated by dividing a scanned image into a plurality of areas. A step of receiving divided data from the image forming apparatus; and b) a first related process related to generation of the electronic document, which is the divided data received from the image forming apparatus in step a). A step of executing the first related processing with respect to non-divided data; and c) a second related processing related to generation of the electronic document that is the divided data received from the image forming apparatus in step a). The cloud server executes the second related processing relating to the divided data that has not yet been completed, and sends the processing result to the external terminal. A step of transmitting a processing request command to the effect to the cloud server; and d) a processing result of the second related processing requested from the cloud server by the external terminal in the step c) from the cloud server. And e) when the first communication which is communication between the image forming apparatus and the external terminal is interrupted before reception of the plurality of divided data in the step a) is completed. Instead of receiving a processing result relating to the divided data for which the first related processing has been executed by the image forming apparatus from the image forming apparatus after resuming the first communication; f) in the first communication When the second communication that is the communication between the cloud server and the external terminal is resumed along with the resumption, the first communication is interrupted. In response to the processing request command transmitted from the image forming apparatus to the cloud server on behalf of the external terminal, a processing result relating to the divided data obtained by executing the second related processing in the cloud server is transmitted from the cloud server. A receiving step; g) a first processing result that is a processing result of the first related processing executed in the step b) by the external terminal; and the first processing executed in the image forming apparatus. The second processing result that is the processing result of the related processing and the processing result received in step e), and the processing result of the second related processing requested from the external terminal to the cloud server The third processing result that is the processing result received in step d) and the second relation requested from the image forming apparatus to the cloud server. A step of generating the electronic document based on a fourth processing result that is a processing result of the processing and received in step f). And

According to the first to sixteenth aspects, when the communication between the image forming apparatus and the external terminal is interrupted, the image forming apparatus has not yet completed transmission of the plurality of divided data to the external terminal. The related processing is executed on the divided data on behalf of the external terminal. Then, the processing result related to the divided data for which the related processing is executed in the image forming apparatus is transmitted to the external terminal after the communication is resumed, the processing result of the related processing in the image forming apparatus, and the processing result of the related processing in the external terminal Based on the above, an electronic document is generated. Therefore, even when communication between the image forming apparatus and the external terminal is interrupted, the image forming apparatus executes the related process on behalf of the external terminal, so that it is possible to suppress the delay of the electronic document generation process. is there.

1 is a diagram illustrating an electronic document generation system (image forming system). FIG. 2 is a diagram illustrating functional blocks of an image forming apparatus (MFP). It is a functional block diagram which shows schematic structure of an external terminal. 3 is a flowchart showing the operation of the MFP. It is a flowchart which shows proxy processing. It is a flowchart which shows operation | movement of an external terminal. It is a figure which shows a scanned image. It is a figure which shows division | segmentation data. It is a figure which shows the outline of operation | movement in an electronic document production | generation system. It is a flowchart which shows operation | movement of the external terminal which concerns on 2nd Embodiment. It is a figure which shows the outline of operation | movement in the electronic document production | generation system which concerns on 2nd Embodiment. It is a figure which shows the electronic document production | generation system which concerns on 4th Embodiment. It is a conceptual diagram which shows the operation | movement etc. in the electronic document production | generation system which concerns on 4th Embodiment. It is a conceptual diagram which shows the operation | movement etc. in the electronic document production | generation system which concerns on 4th Embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 4th Embodiment. It is a flowchart which shows the agency process which concerns on 4th Embodiment. It is a figure which shows the outline of operation | movement in the electronic document production | generation system which concerns on 4th Embodiment. It is a figure which shows the outline of operation | movement in the electronic document production | generation system which concerns on 4th Embodiment. It is a conceptual diagram which shows operation | movement etc. in the electronic document production | generation system which concerns on 5th Embodiment. It is a conceptual diagram which shows operation | movement etc. in the electronic document production | generation system which concerns on 5th Embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 5th Embodiment. It is a flowchart which shows the agency process which concerns on 5th Embodiment. It is a figure which shows the functional block of the image forming apparatus (MFP) which concerns on a modification. It is a figure which shows a priority table. 6 is a diagram showing an operation screen of the MFP. FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. First Embodiment>
<1-1. Outline of configuration>
FIG. 1 is a diagram showing an image forming system 1 according to the present invention. As shown in FIG. 1, the image forming system 1 includes an image forming apparatus 10 and an external terminal 50.

  The image forming apparatus 10 and the external terminal 50 are connected to each other via a network (communication network) 108. The network 108 is configured by a LAN (Local Area Network), the Internet, and the like. Further, the connection mode to the network 108 may be wired connection or wireless connection. For example, the image forming apparatus 10 is wired to the network 108, and the external terminal 50 is wirelessly connected to the network 108.

  As will be described later, in the image forming system 1, a scanned image of a document is generated by the image forming apparatus 10, and image data (divided data) relating to the scanned image is transmitted from the image forming apparatus 10 to the external terminal 50. . Then, the external terminal 50 executes related processing (processing related to generation of an electronic document) to generate an electronic document based on the scanned image.

  In the image forming system 1, if communication between the image forming apparatus 10 and the external terminal 50 is interrupted (disconnected) before the transmission of the divided data is completed, the image forming apparatus 10 performs the related processing instead of the external terminal 50. Run. Then, the processing result regarding the divided data for which the related processing is executed in the image forming apparatus 10 is transmitted from the image forming apparatus 10 to the external terminal 50 after the communication is resumed, and the electronic document is generated based on the processing result in the external terminal 50. Generated.

  Note that the image forming system 1 is also a system that generates an electronic document, and thus is also expressed as an electronic document generation system. Similarly, the external terminal 50 is also expressed as an electronic document generation device.

<1-2. Configuration of image forming apparatus>
FIG. 2 is a diagram illustrating functional blocks of the image forming apparatus 10. Here, an MFP (Multi-Functional Peripheral) is exemplified as the image forming apparatus 10. In FIG. 2, functional blocks of the MFP 10 are shown.

  The MFP 10 is a device (also referred to as a multi-function device) having a scan function, a copy function, a facsimile function, a box storage function, and the like. Specifically, as shown in the functional block diagram of FIG. 2, the MFP 10 includes an image reading unit 2, a print output unit 3, a communication unit 4, a storage unit 5, an operation unit 6, a controller 9, and the like. Various functions are realized by operating each part of the above in a complex manner.

  The image reading unit 2 is a processing unit that optically reads (that is, scans) a document placed at a predetermined position of the MFP 10 and generates image data of the document (also referred to as a document image or a scanned image). is there. The image reading unit 2 is also referred to as a scanning unit.

  The print output unit 3 is an output unit that prints out an image on various media such as paper based on data related to a print target.

  The communication unit 4 is a processing unit capable of performing facsimile communication via a public line or the like. Further, the communication unit 4 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the MFP 10 can exchange various data in cooperation with a desired partner (for example, the external terminal 50). The communication unit 4 includes a transmission unit 4a that transmits various data and a reception unit 4b that receives various data. For example, the transmission unit 4a transmits the divided data for which the related process has not been executed yet to the external terminal 50, and causes the external terminal 50 to execute the related process related to the unprocessed divided data. In addition, the transmission unit 4 a transmits the processing result of the related processing to the external terminal 50.

  The storage unit 5 includes a storage device such as a hard disk drive (HDD). For example, the processing result of the related process is temporarily stored in the storage unit 5.

  The operation unit 6 includes an operation input unit 6a that receives an operation input to the MFP 10 and a display unit 6b that displays and outputs various types of information.

  The MFP 10 is provided with a substantially plate-like operation panel unit 6c (see FIG. 1). Further, the operation panel unit 6c has a touch panel 25 (see FIG. 1) on the front side thereof. The touch panel 25 functions as a part of the operation input unit 6a and also functions as a part of the display unit 6b. The touch panel 25 is configured by embedding a piezoelectric sensor or the like in a liquid crystal display panel, and can display various kinds of information and accept various kinds of operation inputs from an operator.

  For example, on the touch panel 25, various operation screens (menu screens and the like) (including button images and the like) are displayed. The operator can set various operation contents of the MFP 10 and give operation instructions by pressing a button virtually arranged in the operation screen of the touch panel 25.

  The controller 9 is a control device that is built in the MFP 10 and controls the MFP 10 in an integrated manner. The controller 9 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 9 implements various processing units by executing a predetermined software program (hereinafter also simply referred to as a program) P1 stored in a ROM (for example, EEPROM) in the CPU. The program (specifically, a program module group) P1 may be installed in the MFP 10 via a portable recording medium such as a USB memory or the network 108.

  Specifically, as illustrated in FIG. 2, the controller 9 includes a communication control unit 11, an input control unit 12, a display control unit 13, a divided data generation unit 14, and a process execution unit 15 by executing the program P <b> 1. Implement various processing units.

  The communication control unit 11 is a processing unit that controls communication operations with other devices (such as the external terminal 50) in cooperation with the communication unit 4 and the like. For example, the communication control unit 11 transmits image data or the like to the external terminal 50.

  The input control unit 12 is a control unit that controls an operation input operation to the operation input unit 6a (the touch panel 25 or the like). For example, the input control unit 12 controls an operation for receiving an operation input on the operation screen displayed on the touch panel 25.

  The display control unit 13 is a processing unit that controls a display operation in the display unit 6b (the touch panel 25 or the like). The display control unit 13 displays an operation screen for operating the MFP 10 on the touch panel 25, for example.

  The divided data generation unit 14 controls an operation for generating a plurality of divided data (divided image data) by dividing a scanned image of a document into a plurality of regions.

  When the communication between the MFP 10 and the external terminal 50 is interrupted before transmission of the divided data is completed, the process execution unit 15 performs related processing (for generating an electronic document) on the divided data that has not been transmitted to the external terminal 50 yet. It controls the operation to execute the related processing.

<1-3. Configuration of external terminal>
Next, the configuration of the external terminal 50 will be described.

  The external terminal 50 is an information input / output terminal device (also referred to as an information terminal or a communication terminal) capable of network communication with the MFP 10. Here, a tablet type terminal is illustrated as the external terminal 50. However, the present invention is not limited to this, and the external terminal 50 may be a smartphone or a personal computer. The external terminal may be a portable device (such as a portable information terminal) (a portable terminal), or may be a stationary device.

  FIG. 3 is a functional block diagram showing a schematic configuration of the external terminal 50.

  As shown in the functional block diagram of FIG. 3, the external terminal 50 includes a communication unit 54, a storage unit 55, an operation unit 56, a controller 59, and the like. Realize the function.

  The communication unit 54 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the external terminal 50 can exchange various data in cooperation with a desired partner (MFP 10 or the like). The communication unit 54 includes a transmission unit 54a that transmits various data and a reception unit 54b that receives various data. For example, the receiving unit 54b receives image data (such as divided data) related to the scanned image from the MFP 10. In addition, the receiving unit 54b also receives, from the MFP 10, a processing result related to the divided data for which the related processing has been executed in the MFP 10.

  The storage unit 55 includes a storage device such as a nonvolatile semiconductor memory, and stores various types of information. For example, the storage unit 55 temporarily stores the processing result regarding the divided data for which the related processing is executed in the external terminal 50. The storage unit 55 also temporarily stores a processing result related to the divided data for which the related processing is executed in the MFP 10.

  The operation unit 56 includes an operation input unit 56a that receives an operation input to the external terminal 50, and a display unit 56b that displays and outputs various types of information. In the external terminal 50, a touch panel 75 (see FIG. 1) configured by embedding various sensors or the like in a liquid crystal display panel is provided. Specifically, as shown in FIG. 1, a touch panel 75 is provided on almost the entire surface excluding the peripheral edge portion (frame portion) on the front side of the substantially plate-like external terminal 50. The touch panel 75 functions as a user interface unit. In other words, the touch panel 75 functions as a part of the operation input unit 56a and also functions as a part of the display unit 56b.

  The controller 59 is a control device that is built in the external terminal 50 and controls the external terminal 50 in an integrated manner. The controller 59 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 59 implements various processing units by executing a predetermined software program (hereinafter also simply referred to as a program) P2 stored in a storage unit (semiconductor memory or the like) in the CPU. The program (specifically, a program module group) P2 may be installed in the external terminal 50 via a portable recording medium such as a USB memory, the network 108, or the like.

  Specifically, the controller 59 realizes various processing units including a communication control unit 61, an input control unit 62, a display control unit 63, a processing execution unit 64, and a document generation unit 65 by executing the program P2 and the like. .

  The communication control unit 61 is a processing unit that controls a communication operation with the MFP 10 or the like in cooperation with the communication unit 54 or the like.

  The input control unit 62 is a control unit that controls an operation input operation to the operation input unit 56a (the touch panel 75 or the like). For example, the input control unit 62 controls an operation of accepting a touch operation input on the operation screen displayed on the touch panel 75.

  The display control unit 63 is a processing unit that controls a display operation in the display unit 56b (touch panel 75 or the like). The display control unit 63 displays, for example, an operation screen for performing cooperation processing with the MFP 10 on the touch panel 75.

  The processing execution unit 64 is a processing unit that executes related processing for each piece of divided data regarding the divided data that has been received from the MFP 10 and for which related processing (processing related to generation of an electronic document) has not yet been executed.

  The document generation unit 65 is a processing unit that generates an electronic document based on the processing results of the related processing regarding all the divided data.

<1-4. Operation>
Here, the operations of the MFP 10 and the external terminal 50 according to the image forming system 1 are the operation when the communication between the MFP 10 and the external terminal is not interrupted (that is, the normal operation (normal operation)), and the communication is interrupted. The operation will be described separately.

  The first embodiment exemplifies a mode in which a “highly compressed PDF file” is generated as an electronic document. A “highly compressed PDF file” is a PDF (Portable Document Format) format (also referred to as “compact PDF format”) that is compressed at a higher compression rate than a normal PDF file and has a relatively compact size (relatively small size). File, also referred to as a “compact PDF file”.

<Normal operation>
In the image forming system 1, a scanned image of a document is generated by the image forming apparatus 10, and image data related to the scanned image is transmitted from the image forming apparatus 10 to the external terminal 50. Specifically, a plurality of pieces of divided data (divided image data generated by dividing (segmenting) a scanned image into a plurality of regions) are transmitted from the MFP 10 to the external terminal 50, respectively. Then, the external terminal 50 executes related processing (processing related to generation of an electronic document) for each divided data, and generates an electronic document based on the processing result. Note that the external terminal 50 preferably has a CPU processing capability superior to that of the MFP 10. According to this, since the related process can be executed at high speed in the external terminal 50 having a relatively superior CPU processing capability than the MFP 10, it is possible to end the related process relatively early.

  FIG. 4 is a flowchart showing the operation of the MFP 10, and FIG. 6 is a flowchart showing the operation of the external terminal 50. FIG. 7 is a diagram showing a scanned image 201, and FIG. 8 is a diagram showing divided data 251 to 254 (described later).

  First, the operation of the MFP 10 will be described with reference to FIG.

  In step S11 (FIG. 4), the MFP 10 starts a scanning operation, and the document placed on the document table of the MFP 10 (for example, an automatic document feeder (ADF) or a document placement glass surface). The scanned image 201 (see FIG. 7) is generated.

  Specifically, the user places a document to be scanned on a document table (ADF or the like) of the MFP 10 and gives an instruction to generate the electronic document 501 to the external terminal 50 on an operation screen (not shown) of the external terminal 50. When the external terminal 50 receives the generation instruction, the external terminal 50 transfers a scan image generation instruction based on the generation instruction to the MFP 10. When the MFP 10 receives the scan image generation instruction from the external terminal 50, the MFP 10 starts a scan operation (step S11).

  When giving an instruction to generate the electronic document 501, the user specifies the file format of the electronic document 501 that is finally generated by the scanning process on the operation screen. Here, it is assumed that “compact PDF (highly compressed PDF) file” is designated as the file format of the electronic document 501.

  A “compact PDF file” is an electronic document in PDF format. By compressing different types of areas in a scanned image at different compression rates, the data capacity (file size) is maintained while maintaining the legibility of characters. This is a reduced electronic document (highly compressed PDF file). Specifically, the scanned image is divided into a character region and a non-character region by region discrimination processing (preprocessing of compression processing) (in other words, a character region and a non-character region are extracted from the scanned image) Compression processing is performed on the areas (character area and non-character area). Each area is compressed at a different compression rate. More specifically, with respect to the image data of the character area, processing corresponding to the character characteristics is performed, and compression processing with improved visibility is performed with a relatively low compression rate (for example, 10%). On the other hand, image data in a non-character area is compressed at a high compression rate (for example, 50%) after being converted to an appropriate resolution. Then, a data format conversion process (PDF conversion process) is performed on the compressed image data of each area, and a highly compressed PDF file is generated. Here, “compression processing” (specifically, compression processing for compressing different types of regions in a scanned image at different compression rates) is “related processing” related to generation of an electronic document (compact PDF file). Run as. In the present application, the expression “compress with different compression rates” includes different modes of compressing one type of region (for example, a character region) at a compression rate of 0%. And For example, the expression includes a mode in which only the non-character area is compressed with a relatively high compression rate (50% or the like) and the character area is compressed with a compression rate of 0% (in other words, not compressed). In this way, it is only necessary to perform compression processing so that the data capacity of image data is comprehensively reduced.

  Here, when the scan image 201 is generated, the MFP 10 generates attribute data (data indicating an attribute) of each pixel in the scan image 201 by image processing (attribute determination processing or the like) on the scan image 201. Specifically, the MFP 10 determines attributes (character attributes, non-character attributes) for each pixel in the scan image 201, and generates attribute data for each pixel. In the area determination process, the attribute data is used to divide the image data into a character area and a non-character area.

  In step S12, the MFP 10 (divided data generation unit 14) divides (divides) the scan image 201 into a plurality of areas to generate a plurality of divided data (divided image data). Here, as shown in FIG. 8, the scan image 201 is divided into four areas with a band-like area (also referred to as a band area) formed of a predetermined number of horizontal lines as a unit, and divided data 251 to 254. Is generated.

  In steps S13 to S18, the divided data 251 to 254 are sequentially transmitted to the external terminal 50.

  In step S13, the variable i (i is a natural number; i = 1,..., N) is first set to the value “1”. The value N is the number of scan image divisions (N = 4 in this example).

  In step S14, the MFP 10 (transmission unit 4a) starts transmitting the i-th divided data. When transmitting the i-th divided data, the MFP 10 also transmits attribute data in the i-th divided data to the external terminal 50.

  In step S <b> 15, the MFP 10 confirms the communication state between the MFP 10 and the external terminal 50. If it is determined that the communication is in the connected state, the MFP 10 determines in step S16 whether transmission of the i-th divided data has been completed. If it is determined that the transmission has been completed, the process proceeds to step S17. If it is determined that the transmission has not been completed, the process returns to step S15. That is, when transmitting the i-th divided data, the MFP 10 constantly monitors the communication state between the MFP 10 and the external terminal 50. Note that the case where it is determined in step S15 that the communication is in a non-connected state (interrupted state) (that is, a case where a transition to the communication suspended state) is made will be described later.

  In step S17, it is determined whether or not the variable i has reached a value N (N = 4 in this case). If it is determined that the variable i has not reached the value N, the variable i is incremented by 1 (step S18), and transmission of the next divided data is started (step S14).

  The processes in steps S14 to S18 are repeated until the variable i reaches a value N (N = 4 in this case) (that is, until transmission of all the divided data 251 to 254 is completed). When it is determined in step S17 that the variable i has reached the value N, the operation of the MFP 10 related to the electronic document generation system 1 ends.

  Next, the operation of the external terminal 50 will be described with reference to FIG.

  In steps S31 and S32, the external terminal 50 analyzes data that has been received from the MFP 10 (reception completion data). Then, it is determined that the reception completion data is unprocessed divided data ("related processing" (here, divided data for which compact PDF file compression processing) is not yet completed) (step S31). Advances to step S33. If it is determined that the reception completion data is processed divided data (divided data for which “related processing” has already been completed) (described later) (step S32), the process proceeds to step S34.

  As will be described later, in an operation or the like when communication is interrupted, related processing for the divided data is executed by the MFP 10, and the “processed divided data” (the divided data subjected to the related processing) is restarted after the communication is resumed. To the external terminal 50. On the other hand, when the communication is normal or the like, “unprocessed divided data” (divided data that has not been subjected to the related processing) is transmitted from the MFP 10 to the external terminal 50.

  When the external terminal 50 receives “unprocessed divided data”, the related process is performed on the unprocessed divided data in step S33, and then the process proceeds to step S34. ", The process proceeds to step S34 without performing the process of step S33.

  Here, it is determined that the divided data received from the MFP 10 is unprocessed divided data, and the process proceeds to step S33.

  When reception of unprocessed divided data is completed (step S31), the external terminal 50 (process execution unit 64) executes related processing (compression processing) on the unprocessed divided data that has been received from the MFP 10 ( Step S33). Specifically, when receiving the unprocessed divided data, the external terminal 50 also receives the attribute data from the MFP 10, and the process execution unit 64 executes an area determination process based on the attribute data related to the divided data (the divided data is converted into character data). (Divided into areas and non-character areas). Then, the process execution unit 64 executes related processing (specifically, compression processing for compressing each region at a different compression rate).

  In step S <b> 34, the external terminal 50 stores (temporarily) the divided data subjected to the compression process (processed (compressed) divided data) as the processing result of the related process. The processing result of the related processing includes divided data (processed divided data) that has been subjected to compression processing by the processing execution unit 64 of the external terminal 50 and processed divided data received from the MFP 10.

  In step S <b> 35, it is determined whether or not all the processing results (here, the processed divided data) are stored in the storage unit 55. If it is determined that all the processed divided data is not yet stored in the storage unit 55, the process returns to step S31. When all the processed divided data are stored in the storage unit 55, the process proceeds to step S36.

  In the normal operation, the divided data 251 to 254 are received as unprocessed divided data from the MFP 10 (step S31), and related processing (compression processing) is performed on the unprocessed divided data 251 to 254 (step S33). ). Then, processed divided data 351 to 354 are stored in the storage unit 55 as processing results of the compression processing on the unprocessed divided data 251 to 254 (step S34).

  Furthermore, in step S36, the external terminal 50 (document generation unit 65) generates an electronic document (compact PDF file) 501 based on the processing result of the compression process (processed divided data 351 to 354). Specifically, the document generation unit 65 combines the processed divided data 351 to 354 stored in the storage unit 55 and executes a data format conversion process (PDF conversion process) to generate a compact PDF file.

<Operation when communication is interrupted>
Next, a case where communication between the MFP 10 and the external terminal 50 is interrupted before transmission (reception) of all divided data is completed will be described. In the operation when communication is interrupted, the MFP 10 executes related processing (compression processing) for the divided data instead of the external terminal 50.

  FIG. 5 is a diagram showing the subroutine processing in FIG. FIG. 9 is a diagram showing an outline of an operation including an operation when communication is interrupted in the electronic document generation system 1.

  As illustrated in FIG. 9, here, it is assumed that communication between the MFP 10 and the external terminal 50 is interrupted before transmission of all the divided data 251 to 254 is completed, and then the communication is resumed. More specifically, the communication is interrupted while the divided data 252 is being transmitted, and the communication is resumed while a compression process is performed on the divided data 253 (described later).

  First, the MFP 10 transmits the first divided data (unprocessed divided data) 251 to the external terminal 50 (steps S14 and S16 (FIG. 4)) (see also FIG. 9).

  When the external terminal 50 completes reception of the divided data (unprocessed divided data) 251 (step S31 (FIG. 6)), the external terminal 50 executes compression processing on the divided data 251 (step S33). Then, the external terminal 50 stores the processing result (processed divided data 351) in the storage unit 55 (step S34).

  After completing the transmission of the first divided data 251, the MFP 10 starts transmitting the second divided data 252 (step S14 (FIG. 4)).

  Here, as shown in FIG. 9, communication between the MFP 10 and the external terminal 50 is interrupted during transmission of the second divided data 252 (before transmission is completed).

  If the communication between the MFP 10 and the external terminal 50 is interrupted (disconnected) during the transmission of the divided data 252, the MFP 10 determines to that effect (not connected) in step S 15 (FIG. 4), and the processing is performed in step S 20 ( Go to FIG. Even when the communication between the MFP 10 and the external terminal 50 is interrupted, the generation of the electronic document 501 is not interrupted, and the process when the communication is interrupted (that is, the proxy process by the MFP 10) is executed.

  In step S21, the MFP 10 (process execution unit 15) divides the i-th (where i = K,...; K is the ordinal number of the divided data to be transmitted at the time of communication interruption (here, K = 2)). Start compression processing for data. Specifically, the process execution unit 15 first performs an area determination process based on the attribute data regarding the second divided data 252 to divide the divided data 252 into a character area and a non-character area. To execute the compression process. The process execution unit 15 executes the compression process on each area of the divided data 252 at the same compression rate as the compression ratio for each area executed by the external terminal 50 (process execution unit 64). For example, the compression process is performed on the character area of the divided data 252 at a compression rate of 10% (the same compression ratio as the character area of the divided data 251) and the non-character area of the divided data 252 is applied. Compression processing is performed at a compression rate of 50% (the same compression rate as that for the non-character area of the divided data 251).

  In step S <b> 22, the MFP 10 confirms the communication state between the MFP 10 and the external terminal 50. In other words, it is determined whether the communication has been resumed.

  If it is determined that the communication has not been resumed (is in a disconnected state), the MFP 10 determines whether or not the compression process for the i-th divided data (here, the divided data 252) has been completed. Determination is made (step S23).

  If it is determined that the compression process for the i-th divided data has not yet been completed, the process returns to step S22. That is, the MFP 10 constantly monitors the communication state between the MFP 10 and the external terminal 50 during execution of the compression process for the i-th divided data.

  When it is determined that the compression processing for the i-th divided data (unprocessed divided data 252) has been completed, the divided data (processed (compressed) divided data 352) subjected to the compression processing by the process execution unit 64 is obtained. It is further determined whether or not it has been stored in the storage unit 5 (step S24). If it is determined that the processed divided data 352 is not stored in the storage unit 5, the MFP 10 stores the processed divided data 352 (temporarily) in the storage unit 5 (step S25). At this point, since communication between the MFP 10 and the external terminal 50 remains interrupted, the processed divided data 352 is not yet transmitted to the external terminal 50.

  In step S26, it is determined whether or not the variable i has reached a value N (N = 4 in this case). If it is determined that the variable i has not reached the value N, the variable i is incremented by 1 (step S27), and the process returns to step S21 again. That is, the compression process for the next divided data (here, the third divided data 253) is started (step S21).

  Here, as shown in FIG. 9, communication between the MFP 10 and the external terminal 50 resumes during execution of the compression process for the third divided data 253.

  When communication between the MFP 10 and the external terminal 50 resumes (step S22), the MFP 10 determines whether or not the compression process for the i-th divided data (divided data 253) has been completed (step S28).

  When the compression processing for the i-th divided data is completed, the MFP 10 performs processing results (here, processed divided data 352 and 353) related to the divided data (here, divided data 252 and 253) subjected to the compression processing by the processing execution unit 15. ) Is transmitted to the external terminal 50 (step S29). In other words, when the compression processing by the process execution unit 15 is still being performed on the divided data 253 at the time when communication between the MFP 10 and the external terminal 50 is resumed, after the compression processing on the divided data 253 is completed, the MFP 10 Transmits the processing result of the compression processing (processed divided data 352 and 353) to the external terminal 50.

  Then, the subroutine processing (proxy processing) ends, and the processing proceeds to step S17 (FIG. 4).

  As described above, when the communication between the MFP 10 and the external terminal 50 is interrupted before the transmission of all the divided data 251 to 254 is completed, the processing execution unit 15 of the MFP 10 has not yet transmitted the divided data 251 to 254 to the external terminal 50. For the divided data that has not been completed (the divided data for which the compression processing by the processing execution unit 64 of the external terminal 50 has not been completed) 252, 253, the compression processing is executed on behalf of the external terminal 50 (step S21 (FIG. 5)) (see also FIG. 9). Then, the MFP 10 transmits the processing results (processed divided data 352 and 353) related to the divided data 252 and 253 subjected to the compression processing by the processing execution unit 15 to the external terminal 50 after resuming the communication (step S29).

  When the external terminal 50 receives the processed divided data 352 and 353 from the MFP 10 (step S32 (FIG. 6)), the external terminal 50 stores the processed divided data 352 and 353 in the storage unit 55 (step S34).

  The MFP 10 returns from step S20 after resuming communication, and transmits the fourth divided data (unprocessed divided data) 254 to the external terminal 50 through steps S17 and S18 (see also FIG. 9). ). The divided data 254 is divided data among the divided data 251 to 254 that has not yet been transmitted to the external terminal 50 when communication is resumed, and is compressed by the process execution unit 15 of the MFP 10 when communication is resumed. This is divided data whose processing has not yet started.

  When transmission of the divided data (unprocessed divided data) 254 is completed (step S16), it is determined that the variable i has reached the value N (N = 4 in this case) (step S17), and the operation of the MFP 10 ends. To do.

  When the external terminal 50 completes reception of unprocessed divided data (divided data received after resuming communication) 254 (step S31 (FIG. 6)), the external terminal 50 executes compression processing on the divided data 254 (step S33). ), And the processing result (processed divided data 354) is stored in the storage unit 55 (step S34).

  When it is determined that all the processed divided data 351 to 354 have been stored in the storage unit 55 (step S35), the document generation unit 65 combines all the processed divided data 351 to 354 into data. The format conversion process is executed to generate an electronic document (compact PDF file) 501 (step S36) (see also FIG. 9). Specifically, the document generation unit 65 performs processing results (processed divided data 351 and 354) related to the divided data 251 and 254 that have been compressed by the external terminal 50 (process execution unit 64) among the divided data 251 to 254. ) And processing results (processed divided data 352 and 353) related to the divided data 252 and 253 that have been compressed by the MFP 10 (process execution unit 15) among the divided data 251 to 254, the electronic document 501 is Generate. The processed divided data 351 is a processing result related to the divided data 251 that has been compressed by the external terminal 50 (process execution unit 64) before the communication is interrupted. The processed divided data 354 is processed after the communication is resumed. The processing result regarding the divided data 254 subjected to the compression processing by the external terminal 50 (processing execution unit 64).

  By the way, it is assumed that the scan image 201 itself is transmitted as it is (without being divided into a plurality of areas) from the MFP 10 to the external terminal 50, and the external terminal 50 is related to the scan image 201 after the reception of the scan image 201 is completed. A technique for starting processing (also referred to as a technique according to a comparative example) is assumed. In this technique, if communication between the MFP 10 and the external terminal 50 is interrupted before the reception of the scan image 201 is completed, the external terminal 50 cannot start the related process for the scan image 201 (incomplete reception). The MFP 10 transmits (retransmits) the scan image 201 again after the communication is resumed, and the external terminal 50 starts related processing on the scan image 201 that has been received after the communication is resumed. That is, when communication is interrupted, the external terminal 50 cannot start the related processing for the scanned image 201 until the reception of the scanned image 201 is completed after the communication is resumed, resulting in a delay in the electronic document generation processing. obtain.

  In contrast, in the operation according to the first embodiment, the MFP 10 generates the divided data 251 to 254 by dividing the scan image 201 into a plurality of areas, and starts transmitting the divided data 251 to 254. If communication between the MFP 10 and the external terminal 50 is interrupted before the transmission of the divided data 251 to 254 is completed, the MFP 10 relates to the divided data (for example, the divided data 252 and 253) that has not been transmitted to the external terminal 50 yet. The process is executed on behalf of the external terminal 50. In other words, even if communication is interrupted, “related processing” for unsent divided data is taken over by the MFP 10 and executed. Then, processing results (processed divided data 352 and 353) related to the divided data 252 and 253 for which the related processing has been executed in the MFP 10 are transmitted to the external terminal 50 after the communication is resumed. The external terminal 50 also uses these processing results (processed divided data 352 and 353) to generate an electronic document (that is, without executing related processing on the unprocessed divided data 252 and 253). Therefore, even when communication between the MFP 10 and the external terminal 50 is interrupted, the MFP 10 executes the related process in place of the external terminal 50, so that it is possible to suppress the delay of the electronic document generation process.

  Further, the MFP 10 individually transmits the divided data 251 to 254 to the external terminal 50 instead of the scan image 201 itself. When the reception of the divided data (for example, divided data 251) is completed, the external terminal 50 starts related processing on the divided data 251. In other words, the external terminal 50 starts a related process for the divided data 251 that has been received without waiting for completion of reception of the next divided data (for example, divided data 252). Therefore, the external terminal 50 performs the related process earlier than the technique according to the comparative example (the technique in which the scan image 201 itself is transmitted as it is and the related process is started for the scan image 201 after the reception of the scan image 201 is completed). It is possible to start.

<2. Second Embodiment>
The second embodiment is a modification of the first embodiment. Below, it demonstrates centering on difference with 1st Embodiment.

  In the first embodiment, a mode in which a compact PDF (highly compressed PDF) file is generated as an electronic document has been exemplified. In the first embodiment, “compression processing” is performed as “related processing” on unprocessed divided data, and processed divided data (divided image data subjected to compression processing) is processed as a processing result of the related processing. Is obtained.

  In the second embodiment, a PDF file with text data (also referred to as a “searchable PDF file”) by optical character recognition processing (hereinafter also referred to as OCR (Optical Character Recognition) processing) is generated as an electronic document. Illustrate. In the second embodiment, “OCR processing” is performed as “related processing” on unprocessed divided data, and text data (recognized character data) is obtained as a processing result of the related processing. In other words, the processing result of the related processing is obtained as data different from the divided data (data that is not image data).

  The “searchable PDF file” is a PDF file with text data in which the processing result (text data) of the OCR processing for the scanned image is added (embedded) to the scanned image. Specifically, the scanned image is divided into a character area and a non-character area by area determination processing (pre-processing of OCR processing), and an image of the character area (cut-out image) by cutting-out processing (pre-processing of OCR processing). Is cut out (extracted). Then, OCR processing is performed on the clipped image, and text data is generated as an OCR processing result. Thereafter, the text data is added (embedded) to the scanned image, and a PDF file with text data (searchable PDF) file is generated (combining process). In the second embodiment, “OCR processing” is executed as “related processing” related to generation of an electronic document (searchable PDF file).

  FIG. 10 is a flowchart showing the operation of the external terminal 50 according to the second embodiment. In each process of steps S31 (S31b) to S34 (S34b) and S36 (S36b) of FIG. 10, processes similar to the processes of steps S31 to S34 and S36 of FIG. 6 are performed. FIG. 11 is a diagram showing an outline of operations in the electronic document generation system 1 according to the second embodiment. In the MFP 10 according to the second embodiment, processes similar to the processes in FIGS. 4 and 5 are performed.

  In the second embodiment, similarly to the first embodiment, the communication is interrupted during the transmission of the divided data 252 and the communication is resumed during the execution of the related process (OCR process) for the divided data 253. Assume (see FIG. 11).

  As in the first embodiment, the MFP 10 first executes scan processing (steps S11 and S12) (see FIG. 4), and then transmits the first divided data 251 to the external terminal 50 (steps S13 to S16). .

  When the reception of the first divided data 251 is completed (step S31b (FIG. 10)), the external terminal 50 stores the divided data 251 in the storage unit 55 (step S41). Then, the external terminal 50 checks whether the flag of the divided data 251 is on (ON) or off (OFF) (step S42). This flag is information indicating whether or not the OCR processing for the divided data has been completed. When the OCR process is performed on the divided data, the flag of the divided data (the divided data that was the target of the OCR process) is changed from OFF to ON.

  As will be described later, in the operation when communication is interrupted, the OCR process for the divided data is executed by the MFP 10, and the divided data (the divided data in which the flag is changed from off to on) is the target of the OCR process. ) And the OCR processing result are transmitted from the MFP 10 to the external terminal 50 after the communication is resumed. On the other hand, when communication is normal, “unprocessed divided data” (divided data that has not been subjected to OCR processing (flag is off)) is transmitted from the MFP 10 to the external terminal 50.

  If it is determined that the flag of the divided data received from the MFP 10 is on (OCR processing has been completed), the processing proceeds to step S43. On the other hand, if it is determined that the flag of the divided data (divided data 251) received from the MFP 10 is off, the process proceeds to step S33b. Here, it is determined that the flag of the divided data 251 is off, and the process proceeds to step S33b.

  In step S33b, the external terminal 50 performs OCR processing on the divided data 251 (see also FIG. 11). Specifically, pre-processing (area determination processing and cut-out processing) is performed on the divided data 251 and the cut-out image 451 is extracted. Then, the extracted image 451 is subjected to OCR processing, and text data is generated as an OCR processing result. The OCR processing result is stored in the storage unit 55 in step S34b. Thereafter, the process proceeds to step S43.

  In step S43, whether or not all the divided data (here, the divided data 251 to 254) and all the processing results (here, the processing results of the OCR processing related to the divided data 251 to 254) are stored in the storage unit 55, Is determined. If it is determined that all the divided data and all the processing results are not yet stored, the process returns to step S31b, and it is determined that all the divided data and all the processing results are stored. Then, the process proceeds to step S36b. At the time immediately after the reception of the divided data 251 is completed, it is determined that the storage processing related to the divided data 252 to 254 has not been completed yet, and the processing returns to step S31b.

  The MFP 10 starts transmitting the second divided data 252 after the transmission of the first divided data 251 is completed. If the communication between the MFP 10 and the external terminal 50 is interrupted (disconnected) during transmission of the divided data 252 (step S15 (FIG. 4)) (see also FIG. 11), the process proceeds to step S20 (FIG. 5).

  Then, OCR processing (specifically, preprocessing and OCR processing) is executed in the MFP 10 for the second divided data 252 (steps S21 and S23), and the OCR processing result (text data) is stored in the storage unit 5. (Step S25). In other words, the process execution unit 15 generates text data obtained by performing the OCR process on the divided data 252 to be processed as a process result of the OCR process. When the OCR process for the divided data 252 is completed, the MFP 10 changes the flag of the divided data 252 from off to on.

  After that, when communication resumes during execution of the OCR process for the third divided data 253 (step S22), the MFP 10 determines the OCR process result (text data), the divided data 252 and 253 that are the targets of the OCR process, and Is transmitted to the external terminal 50 after the completion of the OCR processing for the divided data 253 (step S29) (see also FIG. 11). In other words, the MFP 10 sends the OCR processing result (text data related to the divided data 252 and 253) obtained by performing the OCR processing on the divided data 252 and 253 to be subjected to the OCR processing to the external terminal 50 after the communication is resumed. And send. When the OCR process for the divided data 253 is completed, the MFP 10 changes the flag of the divided data 253 from off to on.

  When the external terminal 50 receives the processing result of the OCR processing (the OCR processing result for the divided data 252 and 253) (step S32b (FIG. 10)), the external terminal 50 stores the OCR processing result in the storage unit 55 (step S34b). Then, the process proceeds to step S43.

  Further, when the external terminal 50 receives the divided data 252 and 253, respectively (step S31b), the external terminal 50 stores the divided data 252 and 253 in the storage unit 55 (step S41). Then, the external terminal 50 checks the flags of the divided data 252 and 253, respectively. When it is determined that the flag is on, the process proceeds from step S42 to step S43. In this case, the processes of steps S32b and S34b are not executed.

  The MFP 10 returns from step S20 after resuming communication with the external terminal 50, and transmits the fourth divided data (unprocessed divided data) 254 to the external terminal 50 (steps S14 and S16 (FIG. 4)) (FIG. 11). See also).

  When the external terminal 50 completes reception of the unprocessed divided data 254 (step S31b (FIG. 10)), the external terminal 50 stores the divided data 254 in the storage unit 55 (step S41), and performs OCR processing on the divided data 254. Is executed (step S33b). Thereafter, the processing result (text data) is stored in the storage unit 55 (step S34b).

  Then, it is determined that all the divided data 251 to 254 and all the OCR processing results are stored in the storage unit 55 (step S43), and an electronic document (searchable) is based on the divided data 251 to 254 and the OCR processing results. PDF file) 502 is generated (step S36b) (see also FIG. 11). Specifically, the document generation unit 65 adds (embeds) an OCR processing result to an image (an image corresponding to the scanned image 201) obtained by combining the divided data 251 to 254, and a searchable PDF (PDF with text data) file. Is generated. The result of the OCR processing is the text data obtained by subjecting the divided data 251 and 254 to OCR processing by the external terminal 50 (processing execution unit 64) and the MFP 10 (processing execution unit for the divided data 252 and 253). 15) and text data obtained by performing the OCR process.

  According to such an aspect, when executing the OCR process as the related process, it is possible to obtain the same effect as in the first embodiment.

  In the second embodiment, the mode in which the related process (OCR process) is executed in units of divided data is exemplified. Specifically, in the second embodiment, in step S23 (FIG. 5), it is determined whether or not the OCR process for the i-th divided data is completed, and when the OCR process for the i-th divided data is completed. The OCR processing result is stored (step S25). That is, the OCR process is executed in units of divided data, and the processing result is stored in units of divided data.

  However, the present invention is not limited to this, and OCR processing or the like may be executed in smaller units (for example, in units of rows in the divided data). Hereinafter, such modifications will be described.

  Specifically, in this modified example, in step S23 (FIG. 5), is the OCR processing for the j-th row of j-th divided data (j is a natural number; j = 1,..., M) completed? It is determined whether or not. The value M is the number of lines of the character string included in the i-th divided data. When the OCR process for the j-th row of the i-th divided data is completed, the OCR process result is stored in the storage unit 5 (steps S24 and S25). That is, the OCR process is executed in units of rows in the divided data, and the processing results are stored in units of rows in the divided data. For example, when the OCR process for the first line of the i-th divided data is completed, the OCR process result of the first line of the i-th divided data is stored. After that, if there is an unprocessed row (in between step S25 and step S26), the value j is incremented and the OCR processing for the next row (jth row after the increment) is started. Return to S22. Then, after the communication disconnected state is confirmed in step S22, in the next step S23, it is determined again whether or not the OCR processing for the j-th row (for example, the second row) of the i-th divided data is completed. The Thereafter, the same operation is repeated. When the processing for all the rows (M rows) of the i-th divided data is completed, the value i is incremented (steps S26 and S27), and the OCR processing for the first row of the next divided data is started (step S21). . When the OCR is completed for all the rows of all the divided data (or the OCR up to a certain row of the divided data is completed) and communication is resumed, the process proceeds from step S22 to step S28. .

  When communication between the MFP 10 and the external terminal 50 is resumed during the OCR process for the j-th row of the i-th divided data, the process proceeds from step S22 to step S28. In this modified example, in step S28, it is determined whether or not the OCR process for the j-th row of the i-th divided data is completed. When the OCR processing for the j-th row of the i-th divided data is completed, the MFP 10 performs the OCR processing result regarding the divided data subjected to the OCR processing in the MFP 10, the divided data that is the target of the OCR processing, and the unprocessed data The line information is transmitted to the external terminal 50. The unprocessed line information is information indicating a line (remaining line) in which the OCR process has not yet been executed in the i-th divided data.

  In this way, after completion of the OCR processing for the j-th row of the i-th divided data (without waiting for completion of OCR processing for all the rows in the i-th divided data), the OCR in units of rows. A processing result or the like is transmitted to the external terminal 50. For example, all the rows of the divided data 252 and the OCR results from the first row to the third row of the divided data 253 are transmitted. The OCR result of an unprocessed row of the divided data 253 (a row that has not yet been subjected to OCR processing) (for example, each row after the fourth row) does not yet exist and is not transmitted.

  Thereafter, the external terminal 50 performs OCR processing on the remaining rows of the i-th divided data based on the unprocessed row information, and stores the processing results in the storage unit 55. Then, the external terminal 50 generates an electronic document based on all the divided data and the OCR processing result for all the divided data.

  According to such a modification, since the OCR process is executed in units of lines in the MFP 10, when the OCR process for a character string in a certain line in the certain divided data is completed, the MFP 10 causes the certain line (for example, The OCR processing result and the like related to the first line) can be transmitted to the external terminal 50. Then, OCR processing is executed in the external terminal 50 for the remaining rows (2nd to 10th rows of certain divided data).

  As described above, the OCR process is executed in units of lines, so that after the communication between the MFP 10 and the external terminal 50 is resumed, the OCR process in the MFP 10 is rounded up relatively early, and the OCR process result or the like is relatively early. It can be transmitted to the external terminal 50. In particular, when the CPU processing capability of the external terminal 50 is relatively superior to the CPU processing capability of the MFP 10, the external terminal 50 having a CPU processing capability superior to that of the MFP 10 can handle a relatively large number of rows. Related processing can be performed. For this reason, it is possible to reduce the processing time of the related processing compared to the case where the OCR processing is performed in units of divided data, and in turn, it is possible to reduce the generation processing time of the electronic document.

<3. Third Embodiment>
The third embodiment exemplifies a mode in which two types of related processing (“OCR processing” and “compression processing”) are executed to generate a highly compressed searchable PDF file (searchable compact PDF file) as an electronic document. To do. Specifically, “OCR processing” is executed for the divided data 251 to 254 as one related process, and “compression processing” is executed for the divided data 251 to 254 as another related process. Then, an electronic document is generated based on the processing results of the two types of related processes. Specifically, text data (processing result of OCR processing) is embedded in processed divided data (processing result of compression processing) to generate a highly compressed searchable PDF file.

  In the MFP 10 according to the third embodiment, processes similar to the processes in FIGS. 4 and 5 are performed. In the external terminal 50 according to the third embodiment, processes similar to the processes in FIG. 6 are performed.

  Specifically, when communication between the MFP 10 and the external terminal 50 is normal, the external terminal 50 stores unprocessed divided data (divided data (for example, divided data 251) for which compression processing and OCR processing have not yet been executed). When reception is completed (step S31 (FIG. 6)), related processing (compression processing and OCR processing) is executed on the unprocessed divided data 251 (step S33). Then, the processing results (processed divided data 351 and text data) of each related process are stored in the storage unit 55 (step S34).

  Note that the same operation as that described above with respect to the divided data 251 is performed on the divided data 254 transmitted when communication between the MFP 10 and the external terminal 50 is interrupted and then resumed.

  On the other hand, when communication between the MFP 10 and the external terminal 50 is interrupted, the MFP 10 executes related processing (compression processing and OCR processing) on the i-th divided data (for example, the divided data 252 and 253) instead of the external terminal 50. (Steps S21 and S23 (FIG. 5)). Then, the MFP 10 transmits processing results (processed divided data 352 and 353 and text data) related to the divided data 252 and 253 to the external terminal 50 after resuming communication (step S29). In step S <b> 29, the processed divided data 352 and 353 are transmitted to the external terminal 50, and the (unprocessed) divided data 252 and 253 that are the targets of the OCR process are not transmitted to the external terminal 50.

  Thereafter, in the external terminal 50, the processing results of the compression processing (processed divided data 351 to 354) executed on the divided data 251 to 254 and the processing results of the OCR processing executed on the divided data 251 to 254. Based on (text data), a highly compressed searchable PDF file is generated as an electronic document (step S36).

  According to such an aspect, it is possible to obtain the same effect as in the first and second embodiments.

<4. Fourth Embodiment>
The fourth embodiment is a modification of the second embodiment. Below, it demonstrates centering on difference with 2nd Embodiment.

  In the second embodiment, related processing (OCR processing) and its preprocessing (area determination processing and extraction processing) are executed by the external terminal 50 during normal operation, and executed by the MFP 10 when communication is interrupted. An embodiment was illustrated.

  In the fourth embodiment, the OCR process itself is always executed by the cloud server 90, and both the OCR process pre-process (area determination process and cut-out process) and the request process to the cloud server 90 (OCR process request) are performed. An example is shown in which processing is executed by the external terminal 50 during normal operation, and both processing are executed by the MFP 10 when communication is interrupted.

  The cloud server 90 is an external device (external server) that is different from both the MFP 10 and the external terminal 50. The external terminal 50 generates an electronic document in cooperation with the MFP 10 and the cloud server 90.

  FIG. 12 is a diagram illustrating an image forming system 1 according to the fourth embodiment. As shown in FIG. 12, the cloud server 90 is wired to the network 108. FIGS. 13 and 14 are conceptual diagrams showing operations and the like in the image forming system 1 according to the fourth embodiment. FIG. 15 is a flowchart showing the operation of the external terminal 50 according to the fourth embodiment, and FIG. 16 is a flowchart showing the subroutine processing according to the fourth embodiment of the operation of the MFP 10 (FIG. 4). FIGS. 17 and 18 are diagrams showing an outline of operations in the electronic document generation system 1 according to the fourth embodiment.

  Also in the fourth embodiment, as in the above embodiments, communication between the MFP 10 and the external terminal 50 is interrupted during transmission of the divided data 252, and the communication resumes during execution of preprocessing for the divided data 253. A situation is assumed (see FIG. 17).

  As shown in FIG. 13, data exchange between the MFP 10, the external terminal 50, and the cloud server 90 in the normal operation is performed as follows.

  In the normal operation, the MFP 10 transmits the divided data to the external terminal 50, and the external terminal 50 performs preprocessing of the OCR process on the divided data. Then, the external terminal 50 transmits the processing result of the preprocessing and an OCR processing request command (described later) to the cloud server 90. The cloud server 90 executes the OCR processing based on the OCR processing request command from the external terminal 50 and transmits the OCR processing result to the external terminal 50.

  Specifically, when the external terminal 50 completes reception of the divided data (for example, divided data 251) from the MFP 10 (step S31c (FIG. 15)), the external terminal 50 stores the divided data (step S41c), and the divided data. It is determined whether the flag is ON (ON) or OFF (OFF) (step S42c).

  If it is determined that the flag of the divided data is on (preprocessing has been completed), the process immediately proceeds to step S43c.

  Here, it is determined that the flag of the divided data (for example, divided data 251) is off, and the external terminal 50 performs pre-processing (area determination processing and extraction processing) of OCR processing on the divided data 251. Execute (step S33c). Then, the external terminal 50 transmits the processing result of the preprocessing for the divided data 251 (the cut image 451) and the processing request command related to the divided data 251 to the cloud server 90 (step S51) (see also FIG. 17). ). This processing request command is a command that the OCR processing for the divided data for which the OCR processing has not yet been completed is executed by the cloud server 90 and the processing result (text data) should be transmitted to the external terminal 50. In other words, in the processing request command, the cloud server 90 should execute the OCR processing for the divided data for which the OCR processing has not yet been completed, and the processing result (text data) should be transmitted to the external terminal 50. And are included.

  The cloud server 90 executes OCR processing (OCR processing requested from the external terminal 50) on the cut-out image 451 received from the external terminal 50 based on the processing request command from the external terminal 50, and the OCR processing result (Text data) is generated and transmitted to the external terminal 50 (see also FIG. 17). In other words, the cloud server 90 transmits to the external terminal 50 the OCR processing result related to the OCR processing executed based on the processing request command from the external terminal 50.

  When the external terminal 50 receives the OCR processing result (processing result of the related processing) (step S32c), the external terminal 50 stores the OCR processing result in the storage unit 55 (step S34c).

  On the other hand, as shown in FIG. 14, data exchange between the MFP 10, the external terminal 50, and the cloud server 90 in the operation when communication is interrupted is performed as follows.

  In the operation when the communication is interrupted, the MFP 10 performs preprocessing for the divided data that has not been transmitted to the external terminal 50 on behalf of the external terminal 50, and the processing result and processing of the preprocessing. The request command is transmitted to the cloud server 90 instead of the external terminal 50. The cloud server 90 executes OCR processing based on the processing request command from the MFP 10. When the communication is resumed, the MFP 10 transmits the divided data that has been the target of the preprocessing to the external terminal 50, and the cloud server 90 sends the processing result of the OCR processing that is executed based on the processing request command from the MFP 10 to the outside. It transmits to the terminal 50.

  Specifically, when communication between the MFP 10 and the external terminal 50 is interrupted, the MFP 10 performs the OCR process before the OCR process on the i-th divided data (for example, the divided data 252 and 253) in steps S21c and S23c (FIG. 16). Processing (area determination processing and cut-out processing) is executed instead of the external terminal 50. When the preprocessing is completed, the MFP 10 sends the processing result of the preprocessing (the cut image 452, 453) and the processing request command regarding the divided data (divided data 252, 253) subjected to the preprocessing to the outside. It transmits to the cloud server 90 instead of the terminal 50 (step S62) (see also FIG. 17). Upon completion of the preprocessing, the MFP 10 changes the flags of the divided data 252 and 253 from off to on, respectively. Here, communication between the MFP 10 and the external terminal 50 (and communication between the cloud server 90 and the external terminal 50) is interrupted, but communication between the MFP 10 and the cloud server 90 can be performed (connected state). Assume a situation where Specifically, a situation is assumed in which the wireless connection of the external terminal 50 to the network 108 is disconnected, but the wired connections of the MFP 10 and the cloud server 90 to the network 108 are both well maintained.

  The cloud server 90 executes OCR processing (OCR processing requested from the MFP 10) on the cut-out images 452 and 453 received from the MFP 10 based on the processing request command from the MFP 10, and the OCR processing result (text data) ) (See also FIG. 17).

  When communication between the MFP 10 and the external terminal 50 resumes, the MFP 10 transmits the divided data (divided data whose flag is on) 252 and 253 to the external terminal 50 (step S29c) (see also FIG. 17).

  When the communication between the cloud server 90 and the external terminal 50 resumes due to the resumption of communication between the MFP 10 and the external terminal 50 (resumption of wireless connection to the network 108 of the external terminal 50), the cloud server 90 results in the OCR processing result (text Data) is transmitted to the external terminal 50 (see also FIG. 17). In other words, the cloud server 90 transmits the processing result of the OCR processing (OCR processing related to the divided data 252 and 253) executed based on the processing request command from the MFP 10 to the external terminal 50.

  When the external terminal 50 receives the OCR processing result (the OCR processing result related to the divided data 252 and 253) from the cloud server 90 (step S32c), the external terminal 50 stores the OCR processing result in the storage unit 55 (step S34c).

  Further, when the external terminal 50 receives the divided data (divided data whose flag is on) 252 and 253 from the MFP 10 (step S31c), the external terminal 50 stores the divided data 252 and 253 in the storage unit 55 (step S41c). Then, the process proceeds to step S43c through step S42c.

  Further, the divided data 254 is transmitted from the MFP 10 to the external terminal 50 as the communication between the MFP 10 and the external terminal 50 resumes. With respect to the divided data 254, the same processing as that for the divided data 251 is executed by the external terminal 50 and the cloud server 90.

  After that, the external terminal 50 (document generation unit 65) converts the searchable PDF file as an electronic document 503 based on all the divided data 251 to 254 and all the text data (the processing result of the OCR process regarding the divided data 251 to 254). (Step S36c (FIG. 15)) (see also FIG. 18). Specifically, the external terminal 50 requests all the divided data 251 to 254, the processing result (text data) of the OCR processing requested by the external terminal 50 to the cloud server 90, and the cloud server 90 requested by the MFP 10. A searchable PDF file is generated based on the processing result (text data) of the OCR processing.

  As described above, in the operation according to the fourth embodiment, when communication between the MFP 10 and the external terminal 50 is interrupted, the MFP 10 causes the divided data (divided data for which transmission to the external terminal 50 has not yet been completed) 252 Pre-processing (pre-processing of OCR processing) for H.253 is executed instead of the external terminal 50. In other words, even if communication is interrupted, “pre-processing” for unsent divided data is taken over by the MFP 10 and executed. Then, the MFP 10 transmits the OCR processing request command and the processing results (the cut images 452 and 453) related to the preprocessing executed in the MFP 10 to the cloud server 90 instead of the external terminal 50. The external terminal 50 also generates the electronic document 503 using the processing result of the OCR processing requested by the MFP 10 to the cloud server 90 (the processing result of the OCR processing regarding the divided data 252 and 253).

  Therefore, even when the communication between the MFP 10 and the external terminal 50 is interrupted, the preprocessing of the related process is taken over and executed (executed on behalf of) by the MFP 10 and the OCR process (related process) for the cloud server 90 is performed. Since the processing request is transmitted (substitute request) by the MFP 10, it is possible to suppress the delay in starting the OCR process by the cloud server 90 and the delay in the electronic document generation process.

<5. Fifth Embodiment>
The fifth embodiment is a modification of the fourth embodiment. Below, it demonstrates centering on difference with 4th Embodiment.

  The fifth embodiment exemplifies a mode in which two types of related processing (“OCR processing” and “compression processing”) are executed to generate a highly compressed searchable PDF file (searchable compact PDF file) as an electronic document. To do. In the fifth embodiment, one of the two types of related processes (OCR process) is executed in the cloud server 90 as in the fourth embodiment. Furthermore, in the fifth embodiment, the other related process (compression process) is executed in the external terminal 50 (MFP 10 when communication is interrupted) as in the first embodiment. In the fifth embodiment, as in the fourth embodiment, the OCR processing request is transmitted from the external terminal 50 to the cloud server 90 when communication is normal, and is transmitted from the MFP 10 to the cloud server 90 when communication is abnormal. .

  19 and 20 are conceptual diagrams illustrating the operation of the image forming system 1 according to the fifth embodiment. FIG. 21 is a flowchart showing the operation of the external terminal 50 according to the fifth embodiment, and FIG. 22 is a flowchart showing the subroutine processing according to the fifth embodiment of the operation of the MFP 10 (FIG. 4).

  As shown in FIG. 19, in normal operation, the external terminal 50 performs pre-processing of OCR processing and compression processing on the divided data received from the MFP 10. Further, the external terminal 50 transmits a processing request for the OCR processing related to the divided data to the cloud server 90 and receives the processing result of the OCR processing from the cloud server 90.

  Specifically, when the external terminal 50 receives unprocessed divided data (for example, unprocessed divided data 251) from the MFP 10 (step S31d (FIG. 21)), the external terminal 50 performs the OCR processing before the divided data 251. In addition to executing the process, the compression process is also executed (step S33d). Then, the external terminal 50 transmits the processing result of the preprocessing (the cut image 451) and the processing request command for the divided data 251 (specifically, the OCR processing request for the cut image 451) to the cloud server 90 (step) Along with S51d), the processing result (processed divided data 351) of the compression processing on the divided data 251 is stored in the storage unit 55 (step S51d). Further, the external terminal 50 receives the OCR processing result (the processing result of the OCR processing requested by the external terminal 50 from the cloud server 90) from the cloud server 90 and stores it in the storage unit 55 (S32d, S34d).

  On the other hand, as shown in FIG. 20, during the interruption of communication between the MFP 10 and the external terminal 50, the MFP 10 applies to the divided data (for example, 252 and 253) for which transmission to the external terminal 50 has not been completed yet. A pre-process of the OCR process is executed and a compression process is also executed. In addition, the MFP 10 transmits a processing request command or the like related to the divided data to the cloud server 90 (using an effective communication connection between the MFP 10 and the cloud server 90). When communication between the MFP 10 and the external terminal 50 resumes, the MFP 10 transmits the processing result (processed divided data) of the compression process to the external terminal 50. Further, when communication between the cloud server 90 and the external terminal 50 is resumed due to resumption of communication between the MFP 10 and the external terminal 50 (resumption of wireless connection of the external terminal 50 to the network 108), the external terminal 50 performs OCR processing. A processing result is received from the cloud server 90.

  Specifically, when communication between the MFP 10 and the external terminal 50 is interrupted due to the occurrence of an abnormality in the wireless network communication of the external terminal 50, the MFP 10 determines that the i-th divided data (for example, the divided data 252 and 253) Pre-processing of the OCR process (cut-out processing of the cut images 452 and 453, etc.) and compression processing are executed in place of the external terminal 50 (steps S21d and S23d (FIG. 22)). Then, the MFP 10 outputs the processing result of the preprocessing (the cut image 452, 453) and the processing request command for the divided data 252, 253 (specifically, the OCR processing request command for the cut image 452, 453) to the outside. It transmits to the cloud server 90 instead of the terminal 50 (step S62d). This communication is performed using an effective communication connection (wired connection) between the MFP 10 and the cloud server 90. In addition, the MFP 10 stores the processing results of the compression processing on the divided data 252 and 253 (processed divided data 352 and 353) in the storage unit 5 (step S25d). Here, the processing request command is a processing request command related to divided data that has not yet been transmitted to the external terminal 50 and for which the OCR processing by the cloud server 90 has not yet been completed.

  When communication between the MFP 10 and the external terminal 50 resumes as the wireless network communication of the external terminal 50 returns to a normal state, the MFP 10 performs processing results of compression processing on the divided data 252 and 253 (transmission incomplete) ( The processed divided data 352, 353) are transmitted to the external terminal 50 (step S29d), and the external terminal 50 stores the processed divided data 352, 353 received from the MFP 10 in the storage unit 55 (steps S32d, S34d (FIG. 21)). Further, when communication between the external terminal 50 and the cloud server 90 is resumed as the external terminal 50 returns to the wireless network communication, the external terminal 50 performs an OCR process on the divided data 252 and 253 (requested to the cloud server 90 by the MFP 10). The processing result of the OCR processing) is received from the cloud server 90.

  Note that the same operation (normal operation) as that for the divided data 251 is performed on the divided data 254 transmitted when communication between the MFP 10 and the external terminal 50 is interrupted and then resumed.

  After that, the external terminal 50 (document generation unit 65) performs a highly compressed searchable PDF file based on all processed divided data 351 to 354 and all text data (processing results of OCR processing on the divided data 251 to 254). Is generated as an electronic document (step S36d (FIG. 21)). Specifically, the external terminal 50 processes the processing results of the compression processing executed by the external terminal 50 (processed divided data 351 and 354) and the processing results of the compression processing executed by the MFP 10 (processed divided data). 352, 353), the processing result (text data) of the OCR process requested by the external terminal 50 to the cloud server 90, and the processing result (text data) of the OCR process requested by the MFP 10 to the cloud server 90. Generate a searchable PDF file.

  According to such an aspect, it is possible to obtain the same effects as those of the first embodiment and the fourth embodiment.

<6. Modified example>
Although the embodiment of the present invention has been described above, the present invention is not limited to the above-described content.

  For example, in each of the embodiments described above, when communication between the MFP 10 and the external terminal 50 resumes, the MFP 10 transmits various data (processing results and the like) to the external terminal 50 until the MFP 10 completes the related processing for specific divided data. Although the mode which does not do (namely, waits) was illustrated, it is not limited to this.

  Specifically, when communication between the MFP 10 and the external terminal 50 resumes, the MFP 10 immediately stops the related processing for specific divided data in the MFP 10 and transmits various data (processing results and the like) to the external terminal 50. You may make it make the external terminal 50 perform the said related process with respect to the said specific division data.

  Alternatively, when the communication between the MFP 10 and the external terminal 50 is resumed, the related processing relating to the specific divided data is continuously executed by the MFP 10 or the related processing relating to the specific divided data is performed again on the external terminal 50 (newly It is also possible to determine whether to execute.

  FIG. 23 is a functional block diagram of the MFP 10 according to this modification. As shown in FIG. 23, the controller 9 further includes a calculation unit 16.

  The calculating unit 16 calculates a processing time for specific divided data (for example, divided data 253) for which the related processing by the MFP 10 (processing execution unit 15) is continuously executed at the time when communication between the MFP 10 and the external terminal 50 is resumed.

  Specifically, the MFP 10 (calculation unit 16) calculates a required processing time T1 (time required for the related processing) for newly executing the related processing for the specific divided data (divided data 253) in the external terminal 50. Calculation is based on the CPU processing capacity of the external terminal 50 and the like. More specifically, the MFP 10 causes the external terminal 50 to measure in advance the required processing time (reference processing time) TA0 of the related processing with respect to the data amount D0 of the sample image data (reference data) during the normal operation of the communication. The reference processing time TA0 of the related processing by 50 is received from the external terminal 50 in advance. Then, the MFP 10 multiplies the ratio between the data amount D0 of the reference data and the data amount D1 of the divided data 253 by the reference processing time TA0, and the required processing of the related processing for the divided data 253 by the processing execution unit 64 of the external terminal 50. Time T1 is calculated (T1 = TA0 * D1 / D0).

  Further, the MFP 10 (calculation unit 16) calculates the remaining required processing time ΔT2 for continuously executing the related processing for the specific divided data (divided data 253) in the MFP 10 based on the CPU processing capability of the MFP 10 and the like. The required processing time ΔT2 is a required time from the communication resumption time to the completion time of the related processing (the remaining processing time related to the related processing).

  Specifically, first, when communication is normal, the MFP 10 measures in advance the required processing time (reference processing time) TB0 of the related processing by the MFP 10 with respect to the data amount D0 of the sample image data (reference data).

  After that, when the communication is resumed after the communication between the MFP 10 and the external terminal 50 is interrupted, the MFP 10 causes the data amount of the data that has not been executed at the time when the related process is resumed among all the data of the divided data 253. (Remaining data) ΔD2 is acquired. Then, the MFP 10 multiplies the ratio between the data amount D0 of the reference data and the data remaining amount ΔD2 in the divided data 253 by the reference processing time TB0, and performs communication related processing for the divided data 253 by the process execution unit 15 of the MFP 10. The remaining required processing time ΔT2 from the restart point of time is calculated (ΔT2 = TB0 * ΔD2 / D0).

  Then, the MFP 10 (process execution unit 15) compares the required processing time T1 of the related processing in the external terminal 50 with the remaining required processing time ΔT2 of the related processing in the MFP 10.

  When it is determined that the required processing time T1 is shorter than the remaining required processing time ΔT2, the process execution unit 15 stops the related processing for the divided data 253 and the divided data 253 (before processing) is changed to the MFP 10. (Transmission unit 4a) causes external terminal 50 to transmit. Then, the related process for the specific divided data transmitted to the external terminal 50 is executed by the external terminal 50.

  If it is determined that the required processing time T1 is longer than the remaining required processing time ΔT2, the process execution unit 15 continues the execution of the related process for the divided data 253 and also relates to the divided data 253. After the processing is completed, the processing result of the related processing is transmitted to the external terminal 50 by the MFP 10 (transmission unit 4a).

  Further, in each of the embodiments described above, the mode in which the related processing for the divided data is started (immediately) in the MFP 10 when the communication between the MFP 10 and the external terminal 50 is interrupted is illustrated, but the present invention is not limited to this. Specifically, when the MFP 10 is executing a process (in-process) that is different from the related process at the time when communication between the MFP 10 and the external terminal 50 is interrupted, the related process is performed after the in-execution process is completed. May be started.

  FIG. 24 is a diagram showing a priority table (priority management table) 600 in which the priority order of each process (job) in the MFP 10 is defined (managed). The priority table 600 is defined in advance in the MFP 10. The process execution unit 15 compares the priority of the process being executed with the priority of the related process based on the priority table 600.

  For example, when the facsimile reception process is being executed in the MFP 10 at the time when communication between the MFP 10 and the external terminal 50 is interrupted, the priority order of the related process is lower than the priority order of the facsimile reception process (see FIG. 24). ), MFP 10 (process execution unit 15) starts the related process after the facsimile reception process is completed.

  If the print processing is being executed in the MFP 10 at the time when the communication is interrupted, the priority of the related processing is higher than the priority of the print processing (see FIG. 24). Start related processing immediately. In other words, the process execution unit 15 interrupts the print process (interrupts the print process) and starts the related process.

  Note that the priority order of each process in the MFP 10 is not limited to the order shown in the priority table 600, and the priority order of each process may be appropriately defined.

  In each of the above embodiments, an example in which an instruction to generate an electronic document (501, 502) is given on an operation screen (not shown) of the external terminal 50 is not limited to this. The operation screen 801 of the MFP 10 is not limited thereto. In FIG. 25, an electronic document generation instruction may be given.

  For example, when remote operation between the MFP 10 and the external terminal 50 is started, an operation screen 801 (see FIG. 25) is displayed on the touch panel 25 of the MFP 10. Then, the user selects a desired electronic document by pressing one of the buttons 701 to 703 (for example, the button 701). Thereafter, when the OK button 705 is pressed, the generation process of the desired electronic document (compact PDF file) is started. Thus, the MFP 10 may be given an instruction to generate an electronic document.

  In each of the above-described embodiments, the scan image 201 is illustrated as being divided in units of band-like regions (configured with a predetermined number of horizontal lines), but the present invention is not limited to this. Specifically, the scan image may be divided in units of tiled areas (areas in which band-like areas are divided for each predetermined number of vertical lines).

  In addition, in the present application, the expression “related processing is executed on divided data” includes an aspect in which related processing is executed “indirectly” (through preprocessing) on divided data, and divided data The related processing is executed “directly” (without going through preprocessing).

1 Image formation system (electronic document generation system)
10 MFP (image forming apparatus)
50 External terminal
90 Cloud Server 201 Scanned Image 251 to 254 (Unprocessed) Divided Data 351 to 354 Processed Divided Data 451 to 454 Cut Image 501 to 503 Electronic Document

Claims (16)

An electronic document generation system,
An image forming apparatus for generating a scanned image of a document;
An external terminal for generating an electronic document based on the scanned image;
With
The image forming apparatus includes:
Divided data generating means for dividing the scanned image into a plurality of regions to generate a plurality of divided data;
Transmitting means for transmitting the plurality of divided data to the external terminal;
Have
The external terminal is
First processing execution means for executing the related processing with respect to divided data for which the related processing related to generation of the electronic document has not been completed;
Document generating means for generating the electronic document based on a processing result of the related processing relating to the plurality of divided data;
Have
The image forming apparatus includes:
If communication between the image forming apparatus and the external terminal is interrupted before transmission of the plurality of divided data is completed , at least one of the plurality of divided data that has not yet been transmitted to the external terminal. The second process execution means for executing the related process on behalf of the external terminal,
Further comprising
The transmission unit of the image forming apparatus transmits a processing result related to the divided data on which the related processing is executed by the second processing execution unit to the external terminal after the communication is resumed,
The document generation unit of the external terminal includes a first processing result that is a processing result related to the divided data for which the related processing has been executed by the first processing execution unit of the external terminal among the plurality of divided data; based on the second processing result as a processing result about the divided data the relevant process is executed by the second process execution means of the plurality of the image forming apparatus of the divided data, it generates the electronic document ,
The image forming apparatus includes:
Calculating means for calculating a processing time relating to specific divided data for which the related processing by the second processing execution means of the image forming apparatus is still being executed at the time when the communication is resumed;
Further comprising
The calculating means calculates a first required processing time, which is a required time of the related processing relating to the specific divided data by the first processing executing means, based on the processing capability of the external terminal, and the second A second required processing time that is a remaining required processing time from the restart point of the related processing relating to the specific divided data by the processing execution means is calculated based on processing capability of the image forming apparatus,
The second processing execution unit of the image forming apparatus includes:
When the communication is resumed, the first required processing time is compared with the second required processing time,
When it is determined that the first required processing time is longer than the second required processing time, the execution of the related processing relating to the specific divided data is continued and the related to the specific divided data After the completion of the related process, the processing unit transmits the processing result of the related process related to the specific divided data to the external terminal,
When it is determined that the first required processing time is shorter than the second required processing time, the related processing relating to the specific divided data is stopped, and the specific divided data is transmitted to the transmission unit. The electronic document generation system , wherein the external terminal transmits the electronic document. The electronic document generation system according to claim 1 ,
The transmission unit of the image forming apparatus is divided data that has not yet been transmitted to the external terminal at the time when the communication is resumed among the plurality of pieces of divided data, and the image forming apparatus when the communication is resumed. A part of the divided data, which is the divided data for which the related processing by the second processing execution means has not yet started, is transmitted to the external terminal after resuming the communication,
The first process execution means of the external terminal executes the related process for the partial data received after the communication is resumed,
The document generation unit of the external terminal includes the first processing result including the processing result of the related processing by the first processing execution unit both before the interruption of the communication and after the restart of the communication, An electronic document generation system that generates the electronic document based on the second processing result that is a processing result of the related processing by a second processing execution unit. The electronic document generation system according to claim 1 or 2 ,
The related processing includes compression processing for compressing different types of regions in the scanned image at different compression rates,
The document generation unit of the external terminal performs the compression processing by the first processing result that is the divided data subjected to the compression processing by the first processing execution unit and the second processing execution unit. An electronic document generation system that generates the electronic document based on the second processing result that is the divided data. The electronic document generation system according to claim 1 or 2 ,
The related processing includes optical character recognition processing,
The first process execution means generates first text data obtained by performing the optical character recognition process on the divided data to be processed as the first process result,
The second processing execution means generates second text data obtained by performing the optical character recognition processing on the divided data to be processed as the second processing result,
The document generation unit of the external terminal includes the plurality of divided data, the first text data generated as the first processing result, and the second text generated as the second processing result. An electronic document generation system that generates the electronic document based on data. The electronic document generation system according to any one of claims 1 to 4 ,
The second processing execution unit of the image forming apparatus includes:
If a process different from the related process is being executed in the image forming apparatus at the time when the communication is interrupted, the priority of the process being executed and the priority of the related process are determined. , The priority of each process in the image forming apparatus is compared based on a defined priority table,
If the priority of the related process is higher than the priority of the running process, immediately start the related process,
The electronic document generation system, wherein when the priority order of the related process is lower than the priority order of the executing process, the related process is started after the executing process is completed. An image forming apparatus capable of communicating with an external terminal that generates an electronic document,
Divided data generation means for dividing a scanned image of a document into a plurality of regions and generating a plurality of divided data;
Transmitting means for transmitting the plurality of divided data to the external terminal, and causing the external terminal to execute the related processing relating to the divided data that has not yet been completed related processing related to generation of the electronic document;
If communication between the image forming apparatus and the external terminal is interrupted before transmission of the plurality of divided data is completed , at least one of the plurality of divided data that has not yet been transmitted to the external terminal. With respect to the processing execution means for executing the related processing on behalf of the external terminal,
With
The transmitting unit transmits a processing result related to the divided data on which the related processing has been executed by the processing executing unit to the external terminal after resuming the communication ,
The image forming apparatus includes:
Calculating means for calculating a processing time relating to specific divided data for which the related processing by the processing execution means of the image forming apparatus is still being executed at the time of restarting the communication;
Further comprising
The calculation means calculates a first required processing time, which is a time required for the related processing relating to the specific divided data by the external terminal, based on a processing capability of the external terminal, and the processing of the image forming apparatus A second required processing time that is a remaining required processing time from the restart point of the related processing relating to the specific divided data by the execution unit is calculated based on the processing capability of the image forming apparatus;
The process execution means includes
When the communication is resumed, the first required processing time is compared with the second required processing time,
When it is determined that the first required processing time is longer than the second required processing time, the execution of the related processing relating to the specific divided data is continued and the related to the specific divided data After the completion of the related process, the processing unit transmits the processing result of the related process related to the specific divided data to the external terminal,
When it is determined that the first required processing time is shorter than the second required processing time, the related processing relating to the specific divided data is stopped, and the specific divided data is transmitted to the transmission unit. The image forming apparatus, wherein the image data is transmitted to the external terminal . In a computer built in an image forming apparatus capable of communicating with an external terminal that generates an electronic document,
a) dividing a scanned image of a document into a plurality of regions to generate a plurality of divided data;
b) transmitting the plurality of pieces of divided data to the external terminal capable of executing related processing related to generation of the electronic document;
c) When communication between the image forming apparatus and the external terminal is interrupted before transmission of the plurality of divided data in step b) is completed, transmission of the plurality of divided data to the external terminal is performed. Executing the related process on behalf of the external terminal for at least one piece of divided data that has not yet been completed;
d) transmitting a processing result related to the divided data on which the related processing has been performed in the step c) to the external terminal after resuming the communication;
A program for executing,
Said step c)
c-1) When there is specific divided data for which the related processing by the image forming apparatus is still executed at the time when the communication is resumed, the time required for the related processing related to the specific divided data by the external terminal A first required processing time is calculated based on the processing capability of the external terminal, and a second required processing time from the restart point of the related processing related to the specific divided data by the image forming apparatus is a second required processing time Calculating the required processing time based on the processing capability of the image forming apparatus;
c-2) when the communication is resumed, comparing the first required processing time and the second required processing time;
c-3) When it is determined in step c-2) that the first required processing time is longer than the second required processing time, the related processing relating to the specific divided data is executed. Step to continue,
c-4) If it is determined in step c-2) that the first required processing time is shorter than the second required processing time, the related processing relating to the specific divided data is stopped. And steps to
Have
In step d)
When it is determined in step c-2) that the first required processing time is longer than the second required processing time, the specific processing is performed after the related processing related to the specific divided data is completed. The processing result of the related processing related to the divided data is transmitted to the external terminal,
If it is determined in step c-2) that the first required processing time is shorter than the second required processing time, the specific divided data is transmitted to the external terminal. A featured program. An electronic document generation system,
An image forming apparatus for generating a scanned image of a document;
An external terminal that generates an electronic document based on the scanned image in cooperation with the image forming apparatus and a cloud server;
With
The image forming apparatus includes:
Divided data generating means for dividing the scanned image into a plurality of regions to generate a plurality of divided data;
Transmitting means for transmitting the plurality of divided data to the external terminal;
Have
The external terminal is
First processing execution means for executing preprocessing of the related processing with respect to divided data for which related processing related to generation of the electronic document has not yet been completed;
A processing request command for executing the related processing by the cloud server and transmitting the processing result to the external terminal with respect to the divided data for which the related processing has not yet been completed. Communication means for transmitting to the cloud server together with the result;
Document generating means for generating the electronic document based on a processing result of the related processing relating to the plurality of divided data;
Have
The image forming apparatus includes:
If the first communication, which is communication between the image forming apparatus and the external terminal, is interrupted before the transmission of the plurality of divided data is completed, transmission to the external terminal among the plurality of divided data is not yet completed. Second processing execution means for executing the preprocessing on behalf of the external terminal for the divided data that has not yet been completed.
Further comprising
The transmission unit of the image forming apparatus can perform the second communication that is a communication between the image forming apparatus and the cloud server while the first communication is interrupted. The processing result of the preprocessing by the second processing execution means is transmitted to the cloud server, and the processing request instruction regarding the divided data subjected to the preprocessing is transmitted to the cloud server on behalf of the external terminal. ,
The cloud server
While transmitting to the external terminal a processing result related to the related processing executed based on the processing request command from the communication means of the external terminal,
Executed based on the processing request command from the transmission unit of the image forming apparatus after the third communication, which is communication between the cloud server and the external terminal, is resumed along with the resumption of the first communication. The processing result related to the related processing is transmitted to the external terminal,
The document generation unit of the external terminal includes a first processing result that is a processing result of the related processing requested to the cloud server by the external terminal, and the association requested to the cloud server by the image forming apparatus. An electronic document generation system that generates the electronic document based on a second processing result that is a processing result of processing. The electronic document generation system according to claim 8.
The related processing includes optical character recognition processing executed in the cloud server,
The cloud server
Generating, as the first processing result, first text data which is a processing result of the optical character recognition processing requested from the external terminal;
An electronic document generation system, wherein the second text data, which is the processing result of the optical character recognition processing requested by the image forming apparatus, is generated as the second processing result. An image forming apparatus capable of communicating with an external terminal that generates an electronic document in cooperation with a cloud server,
Divided data generation means for dividing a scanned image of a document into a plurality of regions and generating a plurality of divided data;
Transmitting the plurality of pieces of divided data to the external terminal, causing the external terminal to perform pre-processing of the related processing related to the divided data for which related processing related to generation of the electronic document has not yet been completed, and the related processing The related processing relating to the divided data that has not yet been completed is executed by the cloud server, and a processing request command for sending the processing result to the external terminal is transmitted together with the processing result of the preprocessing relating to the divided data. Transmitting means for transmitting from an external terminal to the cloud server;
If the first communication, which is communication between the image forming apparatus and the external terminal, is interrupted before the transmission of the plurality of divided data is completed, transmission to the external terminal among the plurality of divided data is not yet completed. With respect to divided data, processing execution means for executing the preprocessing on behalf of the external terminal;
With
The transmission unit is configured to perform the preprocessing by the processing execution unit when the first communication is interrupted and the second communication that is communication between the image forming apparatus and the cloud server is possible. An image forming apparatus, wherein a processing result is transmitted to the cloud server, and the processing request command relating to the divided data subjected to the preprocessing is transmitted to the cloud server instead of the external terminal. A computer built in an external terminal that generates an electronic document in cooperation with an image forming apparatus and a cloud server.
a) receiving a plurality of divided data generated by dividing a scanned image of a document into a plurality of regions from the image forming apparatus;
b) executing pre-processing of the related processing on the divided data received from the image forming apparatus in the step a) and the related processing related to generation of the electronic document has not yet been completed; ,
c) The cloud server executes the related process related to the divided data received from the image forming apparatus in step a) and the related process has not yet been completed, and the processing result is sent to the external terminal. Transmitting a processing request instruction to the effect to be transmitted to the cloud server together with a processing result of the preprocessing performed on the divided data in the step b);
d) receiving a processing result of the related processing requested from the cloud server by the external terminal in the step c) from the cloud server;
e) In the case where the first communication which is communication between the image forming apparatus and the external terminal is interrupted before the reception of the plurality of divided data in the step a) is completed, the image formation is performed instead of the external terminal. Communication between the cloud server and the external terminal as a result of resuming the first communication with a processing result related to the related processing executed in the cloud server based on the processing request command transmitted from the device to the cloud server Receiving from the cloud server after the second communication is resumed,
f) The processing result of the related processing requested from the external terminal to the cloud server, the processing result received in step d), and the related processing requested from the image forming apparatus to the cloud server. And generating the electronic document based on the processing result received at step e), and
A program for running An electronic document generation system,
An image forming apparatus for generating a scanned image of a document;
An external terminal that generates an electronic document based on the scanned image in cooperation with the image forming apparatus and a cloud server;
With
The image forming apparatus includes:
Divided data generating means for dividing the scanned image into a plurality of regions to generate a plurality of divided data;
Transmitting means for transmitting the plurality of divided data to the external terminal;
Have
The external terminal is
First process execution means for executing the first related process with respect to the divided data for which the first related process related to generation of the electronic document has not yet been completed;
Processing that the second related processing related to the divided data for which the second related processing related to generation of the electronic document has not yet been completed is executed by the cloud server and the processing result should be transmitted to the external terminal A communication means for transmitting a request command to the cloud server;
Document generating means for generating the electronic document based on a processing result of the first related processing regarding the plurality of divided data and a processing result of the second related processing regarding the plurality of divided data;
Have
The image forming apparatus includes:
If the first communication, which is communication between the image forming apparatus and the external terminal, is interrupted before the transmission of the plurality of divided data is completed, transmission to the external terminal among the plurality of divided data is not yet completed. Second process execution means for executing the first related process on behalf of the external terminal for the divided data that has not yet been completed by the first related process by the first process execution means. ,
Further comprising
The transmission unit of the image forming apparatus includes:
When it is possible to perform the second communication, which is communication between the image forming apparatus and the cloud server, while the first communication is interrupted, to the external terminal among the plurality of divided data The processing request command related to the divided data that has not yet been transmitted and the second related processing by the cloud server is not yet completed is transmitted to the cloud server on behalf of the external terminal. ,
A processing result related to the divided data for which the first related processing has been executed by the second processing execution means is transmitted to the external terminal after resuming the first communication;
When the third communication, which is communication between the cloud server and the external terminal, is resumed as the first communication is resumed, the cloud server resumes the processing request from the transmission unit of the image forming apparatus. A processing result related to the divided data on which the second related processing is executed based on a command is transmitted to the external terminal;
The document generation unit of the external terminal includes a first processing result that is a processing result of the first related processing executed on the external terminal and the first related executed on the image forming apparatus. A second processing result that is a processing result of the processing; a third processing result that is a processing result of the second related processing requested by the external terminal to the cloud server; and the cloud server by the image forming apparatus. The electronic document generation system, wherein the electronic document is generated based on a fourth processing result that is a processing result of the second related processing requested by the user. The electronic document generation system according to claim 12,
The second related process includes an optical character recognition process executed in the cloud server,
The cloud server
Generating, as the third processing result, first text data which is a processing result of the optical character recognition processing requested from the external terminal;
An electronic document generation system, wherein the second text data, which is the processing result of the optical character recognition process requested by the image forming apparatus, is generated as the fourth processing result. The electronic document generation system according to claim 13.
The first related processing includes compression processing for compressing different types of regions in the scanned image at different compression rates,
The first process execution means of the external terminal generates first processed divided data, which is divided data subjected to the compression process, as the first processing result,
The second processing execution unit of the image forming apparatus generates second processed divided data, which is the divided data subjected to the compression processing, as the second processing result;
The document generation means of the external terminal includes the first text data, the second text data, the first processed divided data generated as the first processing result, and the second text data. An electronic document generation system that generates an electronic document based on the second processed divided data generated as a processing result. An image forming apparatus capable of communicating with an external terminal that generates an electronic document in cooperation with a cloud server,
Divided data generation means for dividing a scanned image of a document into a plurality of regions and generating a plurality of divided data;
Transmitting the plurality of divided data to the external terminal, causing the external terminal to execute the first related processing relating to the divided data that has not yet been completed. Processing that the second related processing related to the divided data for which the second related processing related to generation of the electronic document has not yet been completed is executed by the cloud server and the processing result should be transmitted to the external terminal A transmission means for transmitting a request command from the external terminal to the cloud server;
If the first communication, which is communication between the image forming apparatus and the external terminal, is interrupted before the transmission of the plurality of divided data is completed, transmission to the external terminal among the plurality of divided data is not yet completed. With respect to the divided data, a process execution means for executing the first related process on behalf of the external terminal;
With
The transmission means includes
When the first communication is interrupted and the second communication which is the communication between the image forming apparatus and the cloud server is possible, the transmission to the external terminal among the plurality of divided data is performed. The second related processing relating to the divided data that has not yet been completed and the second related processing related to the generation of the electronic document has not been completed is executed by the cloud server and the processing result is obtained. A processing request instruction to the effect that it should be transmitted to the external terminal is transmitted to the cloud server on behalf of the external terminal,
An image forming apparatus, wherein a processing result related to divided data for which the first related processing has been executed by the processing execution unit is transmitted to the external terminal after resumption of the first communication. A computer built in an external terminal that generates an electronic document in cooperation with an image forming apparatus and a cloud server.
a) receiving a plurality of divided data generated by dividing a scanned image of a document into a plurality of regions from the image forming apparatus;
b) Execute the first related process for the divided data received from the image forming apparatus in step a) and for which the first related process related to the generation of the electronic document has not yet been completed. And steps to
c) performing the second related processing on the divided data received from the image forming apparatus in the step a) and the second related processing related to generation of the electronic document has not yet been completed, in the cloud A process request command to be executed by the server and the processing result to be transmitted to the external terminal, and to the cloud server;
d) receiving the processing result of the second related processing requested from the cloud server by the external terminal in the step c) from the cloud server;
e) In the case where the first communication which is communication between the image forming apparatus and the external terminal is interrupted before the reception of the plurality of divided data in the step a) is completed, the image formation is performed instead of the external terminal. Receiving a processing result related to the divided data on which the first related processing has been executed by the apparatus from the image forming apparatus after the first communication is resumed;
f) When the second communication that is the communication between the cloud server and the external terminal is resumed along with the resumption of the first communication, the first communication is interrupted instead of the external terminal. Receiving from the cloud server a processing result related to the divided data for which the second related processing has been executed in the cloud server based on the processing request command transmitted from the image forming apparatus to the cloud server;
g) a first processing result which is a processing result of the first related processing executed in the step b) by the external terminal, and a processing of the first related processing executed in the image forming apparatus. A second processing result that is a result and received in step e), and a processing result of the second related processing requested from the external terminal to the cloud server, the step d ) And the result of the second related process requested from the image forming apparatus to the cloud server and received in step f). Generating the electronic document based on a fourth processing result which is a processing result;
A program for running

Images