JP2018045730A - Image management system, image management server, control method of image management system, control method of image management server, program of image management system, program of image management server - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism that, when an image of a document photographed by a portable terminal cannot be recognized as characters, can cause an image processing apparatus to easily read the photographed document to provide result of character recognition.SOLUTION: An image management server receives an image of a document photographed by a portable terminal and further performs character recognition processing on the received image to read data described on the document and register the data in a business system. When the character recognition processing on the document is not satisfactorily performed and the image is unclear, the image management server issues a scan ticket set with high-resolution scanning to an image processing apparatus, receives again image data of the document scanned by the image processing apparatus with the scan ticket, and performs character recognition processing to enable registration of the image data in the business system.SELECTED DRAWING: Figure 14

Description

  The present invention relates to a mechanism for easily reading a captured document and obtaining a character recognition result in an image processing apparatus when the image of the document captured by a portable terminal cannot be recognized.

  In the collection work of rental equipment and the like, confirmation work for filling in a check sheet of the rental equipment collection status by the person in charge of collection is performed every day at the collection site.

  When confirming the collection status, write the confirmation result of the collection status on the paper for entering the collection status (specifically, check the returned device from the list of rental devices). Thus, the result of confirming the presence or absence of the collection target device is left.

  The person in charge of collection who has confirmed that the rental device has been returned registers the result of the collection status manually or by scanning the check sheet in the business system based on the check sheet.

  However, manually registering the contents described in the form with the business system is a time-consuming operation, so by capturing the contents described in the check sheet with, for example, a mobile terminal, If the value obtained from the imaged data is recognized and registered in the business system, the business efficiency can be improved.

JP 2010-245788

  Patent Document 1 describes a portable terminal device that outputs image data in which the resolution such as the legibility of captured images is improved by performing geometric correction, skew correction, super-resolution correction, and the like. The content of outputting the image converted to high resolution is described in the band terminal device.

  By using the technique of Patent Document 1, a high-resolution image can be acquired by increasing the recognition rate of the read image data. However, in order to always capture such a high-resolution image and register the captured content, transmitting and managing the high-resolution image from the mobile terminal to the server has a high system load. Therefore, it is desirable that the resolution is a standard resolution.

  In addition, even if the image is taken at the standard resolution, if the recognition is poor, it may be possible to shoot with the mobile terminal set to a high resolution, but it is troublesome to change the setting and shoot. There is.

  Furthermore, from the viewpoint of business processing, when a document input by handwriting on a mobile terminal is photographed and the content of the read image is registered in a certain system, the processing of the image is successful. Even if you do not take a picture again, even if you take a picture again and again, depending on the environment, if you take a picture in a dark place, the recognition rate may be poor even if you take it many times. There is no. Furthermore, imaging may not be performed well due to camera shake or the like. In such a case, it is a waste of time to repeat the process over and over again.

  For this reason, a document that could not be read even at standard resolution can be reflected in the business system by providing a mechanism to read it again from another device after returning to the office. It is desirable to make work more efficient.

  Accordingly, in the present invention, in view of the above problems, when the image of a document captured by a mobile terminal cannot be recognized, the image processing apparatus can easily read the captured document and obtain a character recognition result. The purpose is to provide.

  The present invention is an image management system in which a mobile terminal, an image processing apparatus, and an image management server can communicate via a network, and the image management server accepts an image of a document captured by the mobile terminal. When the character recognition processing of the image fails by the captured image reception means, the captured image character recognition processing means for performing character recognition processing on the image received by the captured image reception means, and the captured image character recognition processing means. From the image processing device, a scan ticket issuing unit that issues a scan ticket including scan settings to be usable in the image processing device in order to perform character recognition processing again on the document imaged by the portable terminal, Scan image receiving means for receiving the image scanned by the scan ticket, and the scan image The image received by the accepting means is subjected to character recognition processing, thereby comprising scan image character recognition processing means for reading the data described in the image, and the image processing apparatus scans the image issued by the scan ticket issuing means. A scan ticket accepting unit that accepts a scan ticket including the setting of the scan ticket, and a scan image sending unit that sends an image of the document scanned using the scan ticket accepted by the scan ticket accepting unit to the image management server. Features.

  ADVANTAGE OF THE INVENTION According to this invention, when the character recognition of the image of the document input by the handwriting imaged with the portable terminal cannot be performed, it becomes possible to produce | generate the clear image which can perform character recognition easily again.

It is a figure which shows an example of a structure of the information processing system in embodiment of this invention. It is a figure which shows an example of the hardware constitutions of the portable terminal 101, the business processing server and scan ticket server 102, and the client terminal 104 in embodiment of this invention. FIG. 2 is a diagram illustrating an example of a configuration of a multifunction machine 103 according to an embodiment of the present invention. It is a figure which shows an example of the module structure in the business process server and scan ticket server 102 in embodiment of this invention. It is a figure which shows an example of the function structure in embodiment of this invention. It is a figure which shows an example of the process until reading of the check paper in embodiment of this invention. It is a figure which shows an example of a process when reading fails in reading of the check paper in the embodiment of the present invention. It is a figure which shows an example of a process when reading is successful in reading of a check sheet in the embodiment of the present invention. It is a figure which shows an example of the scanning process after reading fails in reading of the check paper in embodiment of this invention. It is a figure which shows an example of the paper image | photographed or scanned in the information processing system in embodiment of this invention. It is a figure which shows an example of the various data table utilized with the information processing system in embodiment of this invention. FIG. 6 is a diagram illustrating an example of a scan execution selection screen displayed on a multifunction peripheral of the information processing system in the embodiment of the present invention. It is a figure which shows an example of the production | generation process of the check paper in the 2nd Embodiment of this invention. It is a figure which shows an example of the process until the reading of the check paper by the portable terminal in the 2nd Embodiment of this invention. It is a figure which shows an example of a process at the time of reading failure in reading of the check paper by the portable terminal in the 2nd Embodiment of this invention. It is a figure which shows an example of the process at the time of reading succeeding in the reading of the check paper by the portable terminal in the 2nd Embodiment of this invention. It is a figure which shows an example of the scan process of the check paper which failed in reading by the portable terminal in the 2nd Embodiment of this invention, or the check paper which does not image by a portable terminal. It is a figure which shows an example of the scan ticket table in the 2nd Embodiment of this invention. It is a figure which shows an example of the authentication data table in the 2nd Embodiment of this invention. It is a figure which shows an example of the paper image | photographed or scanned in the 2nd Embodiment of this invention. It is a figure which shows an example of the application information table in the 2nd Embodiment of this invention. It is the figure which showed an example of the scan selection screen displayed on the image processing apparatus in the 2nd Embodiment of this invention. It is the figure which showed an example of the form printing screen displayed on the image processing apparatus in the 2nd Embodiment of this invention. It is the figure which showed an example of the image figure at the time of imaging a document with the portable terminal in the 2nd Embodiment of this invention. It is the figure which showed an example of the image figure of the notification which a portable terminal receives when the document imaged with the portable terminal in the 2nd Embodiment of this invention failed in reading, or reading accuracy is low. FIG. 10 is a diagram illustrating an example of an image diagram in which a mobile terminal receives a notification that the content of a document has been provisionally registered when a document captured by the mobile terminal is successfully read in the second embodiment of the present invention. FIG. 10 is a diagram illustrating an example of an image diagram in which a client terminal receives a notification of purchase registration when the content of a document scanned by an image processing apparatus is provisionally registered in the second embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a system configuration diagram showing an example of the configuration of the information processing system of the present invention.

  In FIG. 1, a mobile terminal 101, a business processing server / scan ticket server 102, a multifunction machine 103 (image processing apparatus), and a client terminal (client PC) 104 are installed, and these apparatuses are mutually connected by a network 105 such as wireless communication. The data communication is possible.

  The mobile terminal 101 is an apparatus for connecting to the business processing server / scan ticket server 102 and performing application and registration request processing in various processes. In the present embodiment, the portable terminal 101 will be described assuming a device such as a smartphone or a tablet terminal. However, the portable terminal 101 may be an apparatus having other photographing functions.

  The business processing server / scan ticket server 102 executes OCR processing (character recognition processing) of the target form in response to a processing request from the mobile terminal 101. If the OCR process is successful, the data received from the portable terminal 101 is registered in the business system table. If the OCR process is unsuccessful, a scan ticket is generated for the paper scan process, and the MFP 103 Send to. In the present invention, it may be called an image management server.

  Note that the scan ticket refers to a reservation ticket in which information such as settings required in advance when scanning with a multifunction peripheral can be designated in advance. For example, a resolution, a file format of scan data, a file storage location, and the like can be set in the scan ticket, and scan data can be generated by scanning with the set contents.

  In the present embodiment, the business processing server / scan ticket server 102 is described as performing processing for coordinating with a multifunction peripheral and other external devices (systems) and managing scan tickets. You may let them.

  The MFP 103 has a function as an MFP (Multifunction Printer) such as printing and scanning in the MFP 103, and further receives a scan ticket from the business processing server / scan ticket server 102, and sets the scan setting set in the ticket. Based on this, the paper document is scanned and transmitted to the business processing server / scan ticket server 102.

  The client terminal 104 is an apparatus for connecting to the business processing server / scan ticket server 102 and applying for various processes. In the present embodiment, the client terminal 104 is described assuming a PC (Personal computer), but it may be a device such as a smartphone or a tablet terminal, or another device.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the mobile terminal 101, the business processing server / scan ticket server 102, and the client terminal 104 illustrated in FIG. 1 according to the embodiment of the present invention.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the mobile terminal 101, the business processing server / scan ticket server 102, the multifunction peripheral 103, and the client terminal 104 in the embodiment of the present invention.

  The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

  Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS) that is a control program of the CPU 201 and a function executed by each server or each PC. Various programs to be described later are stored. The RAM 203 functions as a main memory, work area, and the like for the CPU 201.

  The CPU 201 implements various operations by loading a program necessary for execution of processing into the RAM 203 and executing the program.

  An input controller (input C) 205 controls input from a pointing device such as a keyboard 209 or a mouse (not shown).

  A video controller (VC) 206 controls display on a display device such as a CRT display (CRT) 210. The display device may be a liquid crystal display as well as a CRT. These are used by the administrator as needed. The present invention is not directly related.

  The memory controller (MC) 207 is stored in a hard disk (HD), a floppy (registered trademark) disk or a PCMCIA card slot for storing a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 211 such as a compact flash (registered trademark) memory connected via an adapter.

  A communication I / F controller (communication I / FC) 208 is connected to and communicates with an external device via a network (for example, the network 105 shown in FIG. 1), and executes communication control processing in the network. . For example, Internet communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  A program for realizing the present invention is recorded in the external memory 211, and is executed by the CPU 201 by being loaded into the RAM 203 as necessary.

  Next, the hardware configuration of the controller unit that controls the multifunction machine 103 as the information processing apparatus of the present invention will be described with reference to FIG.

  FIG. 3 is a block diagram illustrating an example of a hardware configuration of the controller unit of the multifunction peripheral 103 illustrated in FIG.

  In FIG. 3, reference numeral 316 denotes a controller unit which is connected to a scanner 314 functioning as an image input device and a printer 312 functioning as an image output device, while being connected to a LAN (for example, the LAN shown in FIG. 3) or a public line (WAN). By connecting to (for example, PSTN or ISDN), input / output of image data and device information is performed.

  In the controller unit 316, reference numeral 301 denotes a CPU, which is a processor that controls the entire system. A RAM 302 is a system work memory for the CPU 301 to operate, and is also a program memory for recording a program and an image memory for temporarily recording image data.

  A ROM 303 stores a system boot program and various control programs. An external storage device (hard disk drive (HDD)) 304 stores various programs for controlling the system, image data, and the like.

  An operation unit interface (operation unit I / F) 307 is an interface unit with the operation unit (UI) 308 and outputs image data to be displayed on the operation unit 308 to the operation unit 308. The operation unit I / F 307 serves to transmit information (for example, user information) input by the system user from the operation unit 308 to the CPU 301.

  Note that the operation unit 308 includes a display unit having a touch panel, and various instructions can be given by a user pressing (touching with a finger or the like) a button displayed on the display unit.

  A network interface (Network I / F) 305 is connected to a network (LAN) and inputs / outputs data. A modem (MODEM) 306 is connected to a public line and inputs / outputs data such as FAX transmission / reception.

  Reference numeral 318 denotes an external interface (external I / F), which is an I / F unit that accepts external inputs such as USB, IEEE 1394, printer port, and RS-232C. In this embodiment, for reading an IC card required for authentication Card reader 319 is connected to the external I / F 318.

  The CPU 301 can control reading of information from the IC card by the card reader 319 via the external I / F 318, and can acquire information read from the IC card. Note that the storage medium is not limited to an IC card, and any storage medium that can identify a user may be used. In this case, identification information for identifying the user is stored in the storage medium.

This identification information may be a production number of the storage medium or a user code given by the user within the company.
The above devices are arranged on the system bus 309.

  Reference numeral 320 denotes an image bus interface (IMAGE BUS I / F), which is a bus bridge that connects the system bus 309 and an image bus 315 that transfers image data at high speed and converts the data structure.

  The image bus 315 is configured by a PCI bus or IEEE1394. The following devices are arranged on the image bus 315.

  A raster image processor (RIP) 310 develops vector data such as a PDL code into a bitmap image. A printer interface (printer I / F) 311 connects the printer 312 and the controller unit 316, and performs synchronous / asynchronous conversion of image data.

A scanner interface (scanner I / F) 313 connects the scanner 314 and the controller unit 316 and performs synchronous / asynchronous conversion of image data.

  An image processing unit 317 performs correction, processing, and editing on input image data, and performs printer correction, resolution conversion, and the like on print output image data. In addition to this, the image processing unit 317 performs image data rotation and compression / decompression processing such as JPEG for multi-valued image data and JBIG, MMR, MH for binary image data.

  The scanner 314 illuminates an image on paper as a document and scans it with a CCD line sensor, thereby converting it into an electrical signal as raster image data. The original paper is set on the tray of the original feeder, and when the apparatus user gives a reading start instruction from the operation unit 308, the CPU 301 gives an instruction to the scanner 314, and the feeder feeds the original paper one by one to read the original image. I do.

  The printer 312 is a part that converts raster image data into an image on paper. The method is an electrophotographic method using a photosensitive drum or a photosensitive belt, and an image is directly printed on paper by ejecting ink from a minute nozzle array. There are inkjet methods for printing, but any method may be used. The activation of the printing operation is started by an instruction from the CPU 301.

  The printer 312 has a plurality of paper feed stages so that different paper sizes or different paper orientations can be selected, and has a paper cassette corresponding thereto.

  The operation unit 308 has an LCD display unit, and a touch panel sheet is pasted on the LCD. The operation unit 308 displays an operation screen of the system. When a displayed key is pressed, the position information is displayed on the operation unit I / F 307. To the CPU 301 via The operation unit 308 includes, for example, a start key, a stop key, an ID key, a reset key, and the like as various operation keys.

  Here, the start key of the operation unit 308 is used when starting a document image reading operation. At the center of the start key, there are two color LEDs, green and red, which indicate whether or not the start key can be used.

  Further, the stop key of the operation unit 308 functions to stop the operation in operation. The ID key of the operation unit 308 is used when inputting the user ID of the user. The reset key is used when initializing settings from the operation unit.

  The card reader 319 reads information stored in an IC card (for example, Sony FeliCa (registered trademark)) under the control of the CPU 301, and reads the read information via the external I / F 318. The CPU 301 is notified.

  Next, an example of a module configuration diagram according to the present invention will be described with reference to FIG.

FIG. 4 is a block diagram showing an example of the software configuration of the business processing server / scan ticket server 102 (image management server) shown in FIG. The software configuration is a basic configuration, and is assumed to be provided in the Web application server 409 including other components and modules. In addition, a configuration in which another component is added and a new process (function) can be added by the process.

  The request processing module 400 is a module that transmits and receives a request via a network using an external information processing apparatus and SOAP communication, etc., and passes data to each component or module according to the content of the received request. The result of the module is returned to the information processing apparatus that has received the request.

The external data linkage component 401 is a component that communicates with an external device such as the MFP 103 using a device-specific protocol. For example, when issuing a print instruction to the MFP 103, the external data linkage component 401 sends the MFP 103 to the MFP 103. Send a print command to

  The internal data processing component 402 is a component that processes data. For example, the internal data processing component 402 creates a form by combining data managed by the Web application server 409 with a form (form overlay processing).

  A system management component 403 is a component that outputs and manages a system log in the Web application server 409.

  The business logic processing module 404 is a Business Process Execution Language (hereinafter referred to as BPEL) and executes a process definition defined by BPEL.

  In response to a user authentication request from the MFP 103 or another system, the user authentication processing module 405 refers to an authentication table managed by an internal or external device and determines whether the user is an authorized user. .

  The content data management module 406 stores and manages content managed in the system, such as a form generated by the internal data processing component 402.

  The scan ticket management module 407 manages the scan ticket data held in the scan ticket server.

  The workflow cooperation module 408 executes processes such as application drafting, approval, and denial in cooperation with the workflow server.

  In the present embodiment, the following processing is performed using these components and modules.

  For example, when the Web application server 409 receives a communication request from the multifunction machine 103, the business logic processing module 404 acquires a form list from the content data management module 406 based on the defined processing.

  Then, the acquired form list is transmitted to the multi-function peripheral 103 via the request processing module 400. The multi-function peripheral 103 displays a form list.

  When a user selects a form in the form list and issues a print instruction, the multifunction machine 103 transmits a print request to the Web application server 409.

  The request processing module 400 receives a print request. The request processing module 400 passes a print request to the business logic processing module 404.

  Next, the business logic processing module 404 acquires a form file from the content data management module 406 based on the form ID included in the print request in accordance with the defined process, and uses the external data linkage component 401 for the form file. To the MFP 103 that requested the printing.

  This transmission is output to the multi-function peripheral 103 using a printer driver function included in the external data cooperation component, for example.

  Then, the content data management module 406 returns the output result to the request processing module 400, and transmits the print result to the MFP 103 that has requested printing via the request processing module 400 (transmitted by SOAP communication or the like). ).

  Next, an example of a functional configuration diagram of the mobile terminal 101, the business processing server / scan ticket server 102, the multifunction machine 103, and the client terminal 104 according to the present invention will be described with reference to FIG.

  The portable terminal 101 includes a captured image transmission unit 501, a character recognition processing result reception unit 502, and a scan ticket issuance request unit 503.

  The captured image transmission unit 501 transmits captured image data to the business processing server / scan ticket server 102.

  The character recognition processing result receiving unit 502 receives a notification from the business processing server / scan ticket server 102 as to whether or not the OCR processing of the image is successful.

  The scan ticket issuance request unit 503 requests the multifunction device 103 to issue a scan ticket when the character recognition processing result receiving unit 502 receives a notification that the OCR processing (character recognition processing) is successful.

  The business processing server / scan ticket server 102 includes a captured image reception unit 507, a captured image character recognition processing unit 508, a data registration unit 509, a scan ticket issuing unit 510, a scan image reception unit 511, and a scan image character recognition processing unit 512. Become.

  The captured image reception unit 507 receives a document image captured by the mobile terminal 101.

  The captured image character recognition processing unit 508 reads the data described in the document by performing OCR processing (character recognition processing) on the image received by the captured image reception unit 507.

  Data read by the data registration unit 509 and the captured image character recognition processing unit 508 are registered in the system in which the data is managed.

  When the OCR process (character recognition process) of the image by the captured image character recognition processing unit 508 fails, the scan ticket issuing unit 510 causes the multifunction device to perform the character recognition process on the document captured by the portable terminal 101 again. On the other hand, a scan ticket including settings for high-resolution scanning is issued. An example of a scan ticket in the present invention will be described by taking an example of a scan ticket with a high resolution setting, but it is possible to issue a scan ticket with different scan settings depending on the content of character recognition failure. You may do it. For example, it is possible to issue a scan ticket in which a file format other than TIFF is set in addition to the high resolution setting according to the content of the character recognition failure.

  The scan image reception unit 511 receives document image data scanned by the scan ticket from the multi-function peripheral 103.

  The scan image character recognition processing unit 512 reads the data described in the document by performing OCR processing on the image received by the scan image reception unit 511.

  The multifunction machine 103 includes a scan ticket reception unit 504 and a scan image transmission unit 505.

  The scan ticket accepting unit 504 accepts a scan ticket that has been set to enable character recognition issued by the scan ticket issuing unit 510.

  The scan image transmission unit 505 scans a document whose character recognition has failed when a data registration request is made from the mobile terminal 101 using the scan ticket received by the scan ticket reception unit 504, and serves as a business processing server / scan ticket server 102. Send to.

  The client terminal 104 includes a data correction unit 506.

  The data correction unit 506 makes it possible to correct data when there is a deficiency in the data written in the document read by the scanned image character recognition processing unit 512.

  Next, with reference to FIG. 6, a process from photographing a sheet to reading information with a portable terminal, which is executed by the information processing system according to the embodiment of the present invention, will be described. This processing is performed by the portable terminal 101 and the business processing server / scan ticket server 102.

  In step S601, the CPU 201 of the mobile terminal 101 uses the camera function of the mobile terminal 101 to photograph the rental collection document of FIG. 10 that is a check sheet.

  In step S602, the CPU 201 of the mobile terminal 101 transmits an email attached with the image taken in step S601 to a specific email address.

  In step S603, the CPU 201 of the business processing server / scan ticket server 102 receives an image of a document photographed by the mobile terminal 101, and acquires an attached file of the received mail in step S604.

  In step S <b> 605, the CPU 201 of the business processing server / scan ticket server 102 performs OCR processing (character recognition processing) on the image file received from the mobile terminal 101.

  As a result, in step S <b> 606, the CPU 201 of the business processing server / scan ticket server 102 determines whether it has been read. At this time, it is determined whether the form is a form that can be subjected to OCR processing by form recognition.

  If it is determined that the OCR process cannot be performed (in the case of failure in step S606), the CPU 201 of the business process server / scan ticket server 102 proceeds to the process of step S701 in FIG. If it is determined that the OCR process has been completed (if successful in step S606), the process proceeds to step S607, and the accuracy is determined from the read result.

  As a result of the confirmation in step S607, if the CPU 201 of the business processing server / scan ticket server 102 determines in step S608 that the accuracy is low (in the case of YES in step S608), the processing in the next step S704 in FIG. move on. If the CPU 201 of the business processing server / scan ticket server 102 determines that the accuracy is high (NO in step S608), the process proceeds to the next step S801 in FIG.

  Specific determination contents of accuracy may be performed using the authentication data table 1110 of FIG. 11 as an example. The authentication data table 1110 in FIG. 11 includes information such as a user ID 1111, a user name 1112, and an authentication destination 1113.

  As a method, the name of the person in charge 100 described in the person in charge section of the “rental collection form” that is the check sheet in FIG. 10 is read, and the name exists in the user name 1112 of the authentication data table 1110 in FIG. By confirming, it is judged by whether or not it is described so that the corresponding person in charge can confirm.

  For example, when the person in charge is “Tanaka”, it is confirmed whether or not “Tanaka” exists in the user name 1112 in the authentication data table 1110 of FIG.

  FIG. 7 illustrates a process when the check sheet reading process of FIG. 10 executed by the information processing system according to the embodiment of the present invention fails. This processing is performed by the mobile terminal 101 and the business processing server / scan ticket server 102, and is executed following the processing shown in FIG.

  In step S <b> 701, the CPU 201 of the business processing server / scan ticket server 102 notifies the portable terminal by mail that the reading has failed from the OCR processing result. At the same time, in step S703, the check sheet in FIG. 10 is scanned, and the multi-function peripheral 103 can perform character recognition so that the scanned image can be received from the multi-function peripheral 103. A scan ticket is issued (for example, high resolution setting).

  In step S702, the CPU 201 of the mobile terminal 101 receives the read failure mail transmitted from the server by the mobile terminal, and proceeds to the next process of FIG.

  In step S704, the CPU 201 of the business processing server / scan ticket server 102 notifies the mobile terminal by e-mail when the reading itself is successful from the OCR processing result but the reading accuracy is low.

  At the same time, in step S706, the CPU 201 of the business processing server / scan ticket server 102 scans the check sheet shown in FIG. 10 after returning to the office. It is issued to the table 1100.

  The scan ticket data table 1100 in FIG. 11 includes information such as a ticket ID 1101, an owner 1102, a generation date and time 1103, a file format 1104, a resolution 1105, a reading setting 1106, and a storage destination 1107. Scan command information is stored for each ticket ID.

  As an example of data to be registered, when the system user is “Tanaka”, the ticket ID 1101 is “ST0001”, the owner 1102 is “Tanaka”, and the generation date and time 1103 with respect to the scan ticket data table 1100 shown in FIG. Is “2012/11/11 10:23:00”, the file format 1104 is “TIFF”, the resolution 1105 is “400”, the scan setting 1106 is “monochrome”, and the save destination 1107 is “¥¥ abc_server ¥ scan ¥”, Register the setting information as a scan ticket record.

  In step S705, the CPU 201 of the mobile terminal 101 receives the mail transmitted from the server and indicating that the reading accuracy is low, and the process proceeds to the next step S901 in FIG.

  FIG. 8 illustrates a process when the check sheet reading process of FIG. 10 executed by the information processing system according to the embodiment of the present invention is successful. This processing is performed by the mobile terminal 101 and the business processing server / scan ticket server 102, and is executed following the processing shown in FIG.

  In step S <b> 801, the CPU 201 of the business processing server / scan ticket server 102 acquires the contents of the data that has been successfully read by the OCR processing and the accuracy exceeds a certain standard, and mails the result to the mobile terminal. Send with.

  In step S <b> 802, the CPU 201 of the mobile terminal 101 receives a notification from the business processing server / scan ticket server 102 as to whether or not the character recognition processing of the image has been successful, and confirms the contents.

  In step S803, the CPU 201 of the mobile terminal 101 determines the result received in step S802.

  If the CPU 201 of the mobile terminal 101 determines in step S803 that the reading result is incomplete (YES in step 803), the processing result received in step S806 is sent to the business processing server / scan ticket server 102. In response to the request, a request is issued for a scan ticket that is set to execute scanning at a high resolution.

  In step S807, the CPU 201 of the business processing server / scan ticket server 102 issues a scan ticket set to execute scanning at a high resolution to the multi-function peripheral 103, and proceeds to the process of step S901 in FIG.

  If the CPU 201 of the portable terminal 101 determines in step S803 that there is no defect in the reading result (NO in step S803), the business processing server / scan ticket server 102 so as to register the reading result in step S804. To give instructions.

  In step S805, the CPU 201 of the business processing server / scan ticket server 102 registers the read result held in the application information table 1120 in FIG. 11 in the system that manages the read result, and ends the process.

  The application information table 1120 in FIG. 11 includes information such as an application ID 1121, a ticket ID 1122, an applicant 1123, a processing date 1124, a case ID 1125, a registration flag 1126, an application content 1127, and scan data 1128.

  As an example of temporarily registered data, for example, when the applicant is “Tanaka”, the application ID 1121 is “A0124”, the ticket ID 1122 is “ST0001”, and the applicant 1123 is the application information table 1120 shown in FIG. “Tanaka”, processing date 1124 is “2012/11/11 11:23:00”, case ID 1125 is “100004”, registration flag 1126 is a value “1” indicating temporary registration, and application content 1127 is “each application content”. The data is registered as a record in which the scan data 1128 has a value of “each file name”.

  FIG. 9 illustrates a scan process executed by the information processing system in the embodiment of the present invention. This process is executed by the business process server / scan ticket server 102, the multifunction machine 103, and the client terminal 104, and is executed following the processes shown in FIGS.

In step S901, the CPU 301 of the multifunction peripheral 103 displays the scan list illustrated in the scan selection screen 1200 in FIG. 12 on the multifunction peripheral 103 using the scan ticket issued in advance, and the character recognition issued in step S807. Accept scan tickets that have been set to enable (high resolution settings)
A document on the target paper that has failed in character recognition is scanned with a scan ticket.

  In step S <b> 902, the CPU 301 of the multifunction machine 103 transfers the image scanned by the multifunction machine 103 to a specific folder of the business processing server / scan ticket server 102.

  In step S903, the CPU 201 of the business processing server / scan ticket server 102 monitors the folder in which the image data is stored, and accepts the image scanned by the scan ticket transferred from the MFP 103 in step S902. .

  In step S904, the CPU 201 of the business processing server / scan ticket server 102 reads the data described in the image by performing character recognition processing on the image received in step S903.

  In step S905, the CPU 201 of the business processing server / scan ticket server 102 acquires a paper reading result, which is an OCR processing result.

  Subsequently, in step S906, the CPU 201 of the business processing server / scan ticket server 102 temporarily registers the acquired content in the application information table 1120 of FIG. In addition, information indicating the temporarily registered content is transmitted to the client terminal 104.

  For example, as an example, a method of transmitting the URL of the registration screen temporarily registered in the application information table 1120 in FIG. 11 is used.

  In step S907, the CPU 201 of the client terminal 104 receives and confirms the provisional registration content.

  In step S908, the CPU 201 of the client terminal 104 determines whether there is a defect as a result of confirming the contents of the temporary registration received in step S907.

  If the CPU 201 of the client terminal 104 determines in step S908 that the read image is deficient in the temporarily registered character recognition processing result (YES in step S908), in step S909, the client terminal The CPU 201 of 104 accepts corrections such as data deficiencies as a result of character recognition processing by the user.

  Subsequently, in step S910, the CPU 201 of the client terminal 104 requests the business processing server / scan ticket server 102 to register the corrected data in the system that manages the data.

  Note that correction of data deficiency may be performed using an application already installed in the client terminal 104 as an example.

  In step S910, the CPU 201 of the client terminal 104 requests the business processing server / scan ticket server 102 to register the corrected data, and in step S911, the CPU 201 of the business processing server / scan ticket server 102. Registers the scanned content with the modified content in the system managing the scan data.

  If the CPU 201 of the client terminal 104 determines in step S908 that there is no defect in the temporary registration state (NO in step S908), the CPU 201 of the business processing server / scan ticket server 102 has been scanned in step S911. The scan data is registered in the system that manages the data with the contents provisionally registered in step S906 without changing the contents.

<Second Embodiment>
Next, the second embodiment will be described. The second embodiment is a process in which the contents described in the form are added to the first embodiment in the case where the form cannot be registered by imaging the form through the mobile terminal. In the first embodiment, when a form is imaged in the mobile terminal, image data is transmitted to the scan ticket server by e-mail. However, this process can be performed through a dedicated application. Added in the second embodiment. In addition, when scanning a form using a scan ticket, the issued scan ticket is displayed as a thumbnail on the panel of the image processing apparatus (multifunction device), so that the scanning user can refer to the thumbnail image of the scan ticket. The scan ticket corresponding to the form to be scanned can be selected.

  Further, the MFP 103 in the first embodiment will be described as the image processing apparatus 103 in the second embodiment.

  First, referring to FIG. 13, a form sheet preparation process according to the second embodiment of the present invention and a scan ticket for a check sheet (form) are issued in advance when the mobile terminal cannot be used. Processing to be described will be described. This processing is performed by the business processing server / scan ticket server 102 and the image processing apparatus 103.

  In step S <b> 1301, the image processing apparatus 103 receives and transmits a form print instruction to the business processing server / scan ticket server 102 from the user. That is, an instruction for generating a document to be photographed by the mobile terminal is received, and an instruction for generating the received document is transmitted to the business processing server / scan ticket server 102. Also, the setting accepted on the screen of FIG. 23 is transmitted to the business processing server / scan ticket server 102.

  For example, in the case of a business of collecting rental articles, the user can collect a form for one collection operation so that the conditions of the collection destination (FIG. 23, 2301) and collection date (FIG. 23, 2302) can be printed. In addition, designation of whether or not the contents described in the form are registered in the system using the portable terminal (FIGS. 23, 2303. If checked, this embodiment means that the portable terminal is used) Is performed on the screen of FIG. That is, when an instruction to generate a document is received, a setting as to whether or not to transmit an image of the document to the business processing server / scan ticket server 102 using the mobile terminal is also received.

  When the image processing apparatus 103 accepts the setting information and the user accepts pressing of the print button 2304 in FIG. 23, the corresponding information to the business processing server / scan ticket server 102 is obtained based on the setting information in FIG. Instructs to print the form.

  In step S1302, the business processing server / scan ticket server 102 acquires the data specified in step S1301. That is, it receives an instruction to generate a document and acquires designated data. Also, the business processing server / scan ticket server 102 receives the settings received on the screen of FIG.

  In step S1303, the business processing server / scan ticket server 102 determines in step S1301 whether designation for registering the content described in the form in the system using the portable terminal has been performed. That is, based on the received setting, it is determined whether the received document is transmitted to the business processing server / scan ticket server 102 using the portable terminal.

  If it is determined in step S1303 that the contents registered in the form are registered in the system using the mobile terminal, the process proceeds to step S1306. If it is determined in step S1303 that the system registration is not performed for the content described in the form using the mobile terminal, the process proceeds to step S1304. That is, if it is determined that the received document image is not transmitted to the business processing server / scan ticket server 102 using the portable terminal, the process proceeds to step S1304.

  In step S1304, the business processing server / scan ticket server 102 creates a thumbnail image based on the data acquired in step S1302. That is, when the generation of a document is accepted, a thumbnail image associated with the document is created.

  This thumbnail image indicates a form image of data targeted under the conditions specified in step S1301. For example, FIG. 20 shows an example of a thumbnail of the page when the check is not performed in 2303 in FIG. 23 and the content registered in the form is not specified for system registration using the mobile terminal. Further, reference numeral 2001 in FIG. 20 is an example of a paper surface printed in step S1307 as a subsequent process.

  In step S1305, the business processing server / scan ticket server 102 issues a scan ticket. The issued scan ticket is registered with data as described in the scan ticket table 1800 illustrated in FIG. 18 (a record in which the owner 1802 is Suzuki). That is, a scan ticket is issued for each received document. When a document generation is accepted, a scan ticket associated with the document is issued.

  In step S 1306, the business processing server / scan ticket server 102 instructs the image processing apparatus 103 to perform print processing.

  In step S1307, the image processing apparatus 103 performs print processing. An example of the printed form is as indicated by 2001 in FIG.

  In the case of the processing of FIG. 13, an ID for identifying a scan ticket is registered in the ticket ID 1801. The owner 1802 registers the user name of the logged-in user who has performed work on the image processing apparatus 103. In the generation date and time 1803, the time when the scan ticket is generated is registered. A file format 1804 is a file format of a scan ticket, a resolution 1805 is a resolution of the scan ticket, a reading setting 1806 is a monochrome / color reading setting, and a saving destination 1807 is a saving destination of data when the scan ticket is scanned. However, for these items, information is set by a dedicated scan application for scanning used when scanning in S1301. As the thumbnail image file ID 1808, the ID when the thumbnail image in S1303 is created is registered.

  After the process of step S1307 is completed, the process proceeds to the scan execution process using the scan ticket of FIG. Note that the processing of FIG. 17 will be described later.

  FIG. 14 illustrates a process from shooting a checked check sheet by the mobile terminal to reading information from the shot data. This processing is performed by the portable terminal 101 and the business processing server / scan ticket server 102.

  In step S1401, the CPU 201 of the mobile terminal 101 uses the camera function of the mobile terminal 101 to photograph the rental collection document shown in FIGS. 20 and 2002, which is a check sheet.

  In step S1402, the CPU 201 of the portable terminal 101 transmits the image captured in step S1401 attached to a specific mail address or uploads it using a dedicated application. For example, FIG. 24 shows an image diagram when a form is imaged and transmitted using a dedicated application.

  In step S1403, the CPU 201 of the business processing server / scan ticket server 102 receives an image of a document photographed by the mobile terminal 101. That is, it accepts an image of a document captured by a mobile terminal.

  In step S1404, the CPU 201 of the business processing server / scan ticket server 102 determines whether the image transmission method transmitted from the portable terminal 101 in step S1402 is email.

  If the CPU 201 of the business processing server / scan ticket server 102 determines in step S1404 that the image received from the portable terminal 101 is received by e-mail, the process advances to step S1405. If it is determined in step S1404 that the image received from the mobile terminal 101 is received by a dedicated application, the process advances to step S1406.

  In step S1405, the CPU 201 of the business processing server / scan ticket server 102 acquires an attached file of the received mail.

  In step S <b> 1406, the CPU 201 of the business processing server / scan ticket server 102 performs OCR processing (character recognition processing) on the image file received from the mobile terminal 101. That is, the captured image is received and character recognition processing is performed.

  As a result, in step S1407, the CPU 201 of the business processing server / scan ticket server 102 determines whether the reading has been completed. At this time, it is determined whether the form is a form that can be subjected to OCR processing by form recognition.

  If it is determined that the OCR process cannot be performed (NO in step S1407), the CPU 201 of the business process server / scan ticket server 102 proceeds to the next process of step S1501 in FIG. If it is determined that the OCR processing has been completed (YES in step S1407), the process proceeds to step S1408, and the accuracy is determined from the read result.

  As a result of the confirmation in step S1408, if the CPU 201 of the business processing server / scan ticket server 102 determines in step S1409 that the accuracy is low (YES in step S1409), the processing of step S1505 in FIG. move on. If the CPU 201 of the business processing server / scan ticket server 102 determines that the accuracy is high (NO in step S1409), the process proceeds to the next step S1601 in FIG.

As specific determination contents of accuracy, as an example, the authentication data table 1910 in FIG.
May be used. The authentication data table 1910 of FIG.
It consists of information such as a user name 1912, a password 1913, and a mail address 1914.

  As a method, the name of the person in charge 200 described in the person in charge section of the “rental collection form” which is the check sheet in FIG. 20 is read, and the name exists in the user name 1912 of the authentication data table 1910 in FIG. By confirming, it is judged by whether or not it is described so that the corresponding person in charge can confirm.

  For example, when the person in charge is “Tanaka”, it is confirmed whether or not “Tanaka” exists in the user name 1912 in the authentication data table 1910 of FIG.

  FIG. 15 describes a process when the check sheet reading process of FIG. 20 executed by the information processing system in the embodiment of the present invention fails. This processing is performed by the mobile terminal 101 and the business processing server / scan ticket server 102, and is executed following the processing shown in FIG.

  In step S1501, the check sheet shown in FIG. 20 is scanned to create a thumbnail image. In step S1502, the scanned image can be received from the image processing apparatus 103 (image processing apparatus). A scan ticket with scan settings (for example, high resolution settings) is issued to the image processing apparatus 103. That is, when the character recognition process of the captured image fails, a thumbnail image of the received captured image is created. That is, when the image character recognition process fails, a scan ticket including scan settings is issued to be usable in the image processing apparatus in order to perform the character recognition process again on the document captured by the portable terminal.

  This thumbnail image indicates a form image that has been checked in the list of each collected product of the form printed in step S1307, and 2002 of FIG. 20 is an example.

  In step S1503, the CPU 201 of the business processing server / scan ticket server 102 notifies the portable terminal 101 that reading has failed from the OCR processing result by e-mail or a dedicated application. At the same time, the ticket ID corresponding to the scan ticket created in step S1502 is transmitted to the portable terminal 101.

  In this way, by transmitting the ticket ID, when the operator scans a document captured by the portable terminal 101 later using the scan ticket in the image processing apparatus 103, the corresponding scan ticket can be easily obtained. It becomes possible to select.

  In step S1504, the CPU 201 of the portable terminal 101 receives the notification of the reading failure result and the ticket ID transmitted from the server, receives the mail by the portable terminal, or receives the notification by a dedicated application, and performs the next processing in FIG. Proceed to For example, FIG. 25 shows an image of a notification that is accepted when a dedicated application is used.

  In step S1505, the CPU 201 of the business processing server / scan ticket server 102 creates a thumbnail image of the check sheet. That is, when the character recognition process of the captured image fails, a thumbnail image of the received captured image is created.

  In step S1506, a scan ticket set to execute scanning at a high resolution for accepting the scan of the check sheet in FIG. 20 is issued to the scan ticket table 1800 in FIG.

  That is, when the image character recognition process fails, a scan ticket including scan settings is issued to be usable in the image processing apparatus in order to perform the character recognition process again on the document captured by the portable terminal.

  This thumbnail image indicates a form image that has been checked in the list of each collected product of the form printed in step S1307, and 2002 of FIG. 20 is an example.

  In step S1507, the CPU 201 of the business processing server / scan ticket server 102 reads the information from the OCR processing result, but if the reading accuracy is low, the information and the ticket ID issued in step S1506 are sent to the portable terminal. , E-mail, or notification with a dedicated application.

  The scan ticket table 1800 in FIG. 18 includes information such as a ticket ID 1801, an owner 1802, a generation date and time 1803, a file format 1804, a resolution 1805, a reading setting 1806, and a storage destination 1807. Scan command information is stored for each ticket ID. In step S1502 and step S1506, the following contents are registered in the scan ticket table 1800.

  That is, the scan ticket table 1800 in FIG. 18 is a correspondence table in which a ticket ID associated with the issued scan ticket is issued and the ticket ID and the thumbnail image ID for recognizing the thumbnail image are associated with each other.

  In the ticket ID 1801, an ID for identifying a scan ticket is registered. When the user uses the portable terminal 101, the owner 1802 may acquire the user associated with the transmitted mail address from the authentication data table 1910, register the value, or the user may If the application is used, the information of the user who has logged in to the application may be registered. In the generation date and time 1803, the time when the scan ticket is generated is registered. A file format 1804 is a file format of a scan ticket, a resolution 1805 is a resolution of the scan ticket, a reading setting 1806 is a monochrome / color reading setting, and a saving destination 1807 is a saving destination of data when the scan ticket is scanned. However, these items operate when the captured image is transmitted and received by the business processing server / scan ticket server 102 by the dedicated scan application used when photographing in S1401 or the mail transmission application. The processing on the business processing server / scan ticket server 102 side sets a necessary value. As for the thumbnail image file ID 1808, the ID when the thumbnail image is created in S1503 and S1507 is registered.

  As an example of registered data, if the system user is “Tanaka”, the ticket ID 1801 is “ST0001”, the owner 1802 is “Tanaka”, and the generation date and time 1803 is compared to the scan ticket table 1800 shown in FIG. “2014/07/29 10:23:00”, file format 1804 “TIFF”, resolution 1805 “400”, read setting 1806 “monochrome”, save destination 1807 “¥¥ abc_server ¥ scan ¥”, thumbnail Setting information whose image file ID 1808 is “11” is registered as a scan ticket record.

  In step S1508, the CPU 201 of the portable terminal 101 receives the result of the low reading accuracy transmitted from the server and the ticket ID at the portable terminal, or receives a notification by a dedicated application, and then receives the result shown in FIG. The process proceeds to step S1701. For example, FIG. 25 shows an image of a notification that is accepted when a dedicated application is used.

  In this way, by transmitting the ticket ID, when the operator scans a document captured by the portable terminal 101 later using the scan ticket in the image processing apparatus 103, the corresponding scan ticket can be easily obtained. It becomes possible to select.

  FIG. 16 illustrates a process when the check sheet reading process of FIG. 20 executed by the information processing system in the embodiment of the present invention is successful. This processing is performed by the mobile terminal 101 and the business processing server / scan ticket server 102, and is executed following the processing shown in FIG.

  In step S <b> 1601, the CPU 201 of the business processing server / scan ticket server 102 acquires the contents of those that have been successfully read in the OCR processing and the accuracy exceeds a certain standard, and temporarily registers them in the system. That is, when the character recognition process of the captured image does not fail, the scan ticket is not issued and the value acquired by the character recognition process is registered in the table.

  In step S <b> 1602, the temporarily registered content is notified to the mobile terminal 101 via e-mail or the business application of the mobile terminal 101. For example, an image diagram to be notified when a dedicated application is used is as shown in FIG.

  In step S <b> 1603, the CPU 201 of the mobile terminal 101 receives a notification from the business processing server / scan ticket server 102 as to whether or not the character recognition processing of the image has been successful, and accepts the presence or absence of content confirmation.

  In step S <b> 1604, the CPU 201 of the mobile terminal 101 determines whether correction for the incompleteness of the content confirmed in step S <b> 1603 has been received. If it is determined in step S1604 that correction for the incompleteness of the confirmed content has been accepted, the process proceeds to step S1605.

  In step S1605, it is determined in step S1604 how to accept the correction for the incompleteness of the confirmed content.

  If the method for accepting the correction of the incompleteness of the content confirmed in step S1604 is mail, the process proceeds to step S1608. If the method for accepting the correction of the content defect confirmed in step S1604 is a dedicated application, the process proceeds to step S1606.

  In step S1606, correction of the temporarily registered content is received using a dedicated application.

  In step S1607, the correction result of the provisional registration content in step S906 is received, and an instruction for a main registration request is issued to the business processing server / scan ticket server 102.

  In step S1608, the CPU 201 of the business processing server / scan ticket server 102 receives the correction content by mail.

  In step S1609, the CPU 201 of the business processing server / scan ticket server 102 reads the content read in step S1608 and executes a main registration request.

  In step S1610, the CPU 201 of the business processing server / scan ticket server 102 registers the read result held in the application information table 1120 in FIG. 21 in the system that manages the read result, and ends the process. That is, when the character recognition process of the captured image does not fail, the scan ticket is not issued and the value acquired by the character recognition process is registered in the table.

  As described above, the registration contents are initially set in the provisional registration state, and the mobile terminal 101 can accept the presence / absence of correction again, thereby enabling more accurate data to be fully registered.

  The application information table 2120 in FIG. 21 includes information such as an application ID 2121, a ticket ID 2122, an applicant 2123, a processing date and time 2124, a case ID 2125, a registration flag 2126, an application content 2127, and a check sheet image ID 2128.

  In the application ID 2121, an ID assigned to each application data is registered. In the ticket ID 2122, the ID of the ticket used when the scan ticket is used is registered. The name of the user who applied for is registered in the applicant 2123. If the user is using the mobile terminal 101, this value may be acquired from the authentication data table 1910 for the user associated with the transmitted mail address, and the value may be registered. If you are using, you may register with the information of the user who logged in to the application. The processing date and time 2124 registers the processing date and time when the application was made. In the registration flag 2126, a value for managing whether the data registration state is the temporary registration state or the main registration state is registered. For example, 1 is registered in the temporary registration state, and 0 is registered in the main registration state. In the case ID, an ID that is generated for each collection unit at the stage of scanning is registered. For example, in the case of a business of rental collection, the rental collection collection unit of goods is made every week ahead, every week, and this is the unit of the form. In this embodiment, the project ID is assigned in this unit. And The application content 2127 registers the content of the applied data. For this item, only one item is given as an example, but there are items to be registered as application data. As the image ID 2128 of the checked paper, the ID of the image generated when the form is scanned using the scan ticket is registered.

  As an example of temporarily registered data, for example, when the applicant is “Suzuki” and the application data is registered using a scan ticket, the application information table 2120 shown in FIG. The ID 2121 is “A0124”, the ticket ID 2122 is “ST0004”, the applicant 2123 is “Suzuki”, the processing date 2124 is “2014/08/07 11:23:00”, the case ID 2125 is “100004”, and the registration flag 2126 is temporary A record having a value “1” indicating registration, the application content 2127 described in 2002 in FIG. 20, for example, and the image ID 2128 of the checked paper “24” is registered as application data.

  FIG. 17 illustrates a process of performing a scan process and registering an image using a scan ticket executed by the information processing system according to the embodiment of the present invention. This processing is performed by the business processing server / scan ticket server 102, the image processing apparatus 103, and the client terminal 104, and is executed following the processing described in FIGS.

  In step S1701, the CPU 301 of the image processing apparatus 103 displays a list of scan tickets illustrated in the scan selection screen 2200 of FIG. 22 on the image processing apparatus 103, for example, using the scan ticket issued in advance, A scan ticket including the scan setting issued in step S1305, step S1502 or S1506 (for example, a high resolution setting) is received, and the document on the target paper that has failed in character recognition is scanned with the scan ticket. That is, a selection of a scan ticket including scan settings is accepted.

  The login user 2201 displays the user name of the user who has logged into the image processing apparatus 103.

  Note that the scan selection screen 2200 in FIG. 22 is displayed from information in the record of the owner 1802 of the same scan ticket table 1800 as the logged-in user.

  For example, when the login user 2201 is Suzuki, the owner 1802 of the scan ticket table 1800 displays a record of Suzuki. Note that values displayed in 2202, 2203, and 2204 in FIG. 22 are as follows.

  In FIG. 22, reference numeral 2202 denotes a thumbnail image. As this image, the thumbnail image generated in step S1304, step S1501, and step S1505 is displayed. In other words, the ticket ID and the thumbnail image associated with the thumbnail image ID corresponding to the ticket ID can be displayed in association with each other so that the scan ticket corresponding to the issued image for which character recognition has failed can be identified. That is, the image is acquired from the image file table (not shown) associated with the file ID 1808 of the thumbnail image in the scan ticket table 1800 and displayed.

  The ticket ID 2203 displays a number assigned to identify the scan ticket. Displayed from the ticket ID 1801 of the scan ticket table 1800.

  The generation date / time 2204 displays the date when the scan ticket was generated. Displayed from the generation date 1803 of the scan ticket table 1800.

  Reference numeral 2205 denotes a portion for switching whether or not a scan ticket is selected, and is an item for selecting a scan ticket to be used when scanning a form. The checked one is used as a scan ticket.

  Return 2206 is a button for returning to the screen from which this function is called without using the function of the scan selection screen of FIG.

  A scan 2207 is a button for scanning a form using a scan ticket that has received selection to the scan ticket selection area 2205.

  Reference numeral 2208 denotes a button for page turning when the list of scan tickets displayed in FIG.

  In this way, by configuring the screen for selecting the scan ticket on the screen of the user who has logged into the image processing apparatus 103 as described above, the form is captured using the portable terminal, and the contents of the form are stored in the system. When registering, by selecting a scan ticket having the same ticket ID 2203 as the ticket ID notified to the portable terminal in steps S1504 and S1508 in FIG. 15, the scan process can be performed. Further, when the printed form is directly registered in the system using the scan ticket without using the mobile terminal, the same as the case-by-case form printed in step S1307 in FIG. By checking the thumbnail image 2202 in FIG. 22, it becomes possible to select the corresponding scan ticket and scan the form.

  In step S <b> 1702, the CPU 301 of the image processing apparatus 103 transfers the image scanned by the image processing apparatus 103 to a specific folder of the business processing server / scan ticket server 102. That is, an image of a document scanned using the received scan ticket is transmitted to the business processing server / scan ticket server 102.

  In step S1703, the CPU 201 of the business processing server / scan ticket server 102 monitors the folder in which the image data is stored. In step S1702, the image scanned by the scan ticket transferred from the image processing apparatus 103 is displayed. Accept. That is, an image scanned by the scan ticket is received from the image processing apparatus.

  In step S1704, the CPU 201 of the business processing server / scan ticket server 102 reads the data described in the image by performing character recognition processing on the image received in step S1703.

  In step S1705, the CPU 201 of the business processing server / scan ticket server 102 acquires a paper reading result which is an OCR processing result (character recognition result). In other words, the image received by scanning is subjected to character recognition processing to read data described in the image.

  Subsequently, in step S1706, the CPU 201 of the business processing server / scan ticket server 102 temporarily registers the acquired contents in the application information table 2100 of FIG. That is, the character recognition process of the scanned and transmitted image is performed, and if the character recognition process of the image does not fail, the scan ticket is not issued and the value acquired by the character recognition is registered in the table. In addition, information indicating the temporarily registered content is transmitted to the client terminal 104.

  For example, as an example, a method may be used in which a URL of a registration screen (application) that allows access to the temporarily registered state in the application information table 2100 in FIG. 21 is transmitted by e-mail or the like. .

  In step S1707, the CPU 201 of the client terminal 104 receives the provisional registration content. For example, an image of provisional registration accepted by the client terminal 104 is as shown in FIG.

  In step S1708, the CPU 201 of the client terminal 104 determines whether there is a defect as a result of confirming the contents of the temporary registration received in step S1707.

  When the CPU 201 of the client terminal 104 determines in step S1708 that the read image has a deficiency in the temporarily registered character recognition processing result (YES in step S1708), in step S1709, the client terminal The CPU 201 of 104 accepts corrections such as data deficiencies as a result of character recognition processing by the user. In other words, when the result of the character recognition processing of the read image is incomplete, the information processing apparatus connectable to the business processing server / scan ticket server 102 accepts correction of the data of the result of the character recognition processing.

  Subsequently, in step S <b> 1710, the CPU 201 of the client terminal 104 sends a request to register the corrected data to the data management system (application information table 2120) to the business processing server / scan ticket server 102. Do it.

  Note that correction of data deficiency may be performed using an application already installed in the client terminal 104 as an example.

  After the CPU 201 of the client terminal 104 requests the business processing server / scan ticket server 102 to register the corrected data in step S1710, the CPU 201 of the business processing server / scan ticket server 102 in step S1711. Registers the scanned content with the modified content in the system managing the scan data.

  If the CPU 201 of the client terminal 104 determines in step S1708 that there is no defect in the temporary registration state (NO in step S1708), the CPU 201 of the business processing server / scan ticket server 102 has been scanned in step S1711. Without changing the contents, the scan data is permanently registered in the system managing the data with the contents provisionally registered in step S1706. That is, the character recognition process of the scanned and transmitted image is performed, and if the character recognition process of the image does not fail, the scan ticket is not issued and the value acquired by the character recognition is registered in the table.

  As described above, when the image of the document captured by the mobile terminal cannot be recognized, the image processing apparatus can easily read the captured document and obtain a character recognition result. In other words, even if there was a case where data could not be registered in the system by capturing the form filled in business with the mobile terminal and making the contents recognize the character, set the high resolution on the mobile terminal, The content described in the document can be registered in the system by causing the image processing apparatus to read the scan ticket with the scan setting without performing imaging. In addition, when an image is taken with a mobile terminal, the image is often influenced by the external environment such as brightness, camera shake, etc., so that even if the image is taken again at a high resolution, the character recognition may be successful. Although it is not certain, by scanning from the image processing apparatus using the scan ticket, the contents of the form can be read without being influenced by an external environment such as camera shake. In this way, it is possible to reliably and efficiently register the form data on the system side by complementing the case where the processing on the mobile terminal did not work.

  Although one embodiment has been described above, the present invention can take an embodiment as a system, apparatus, method, program, recording medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  The program in the present invention is a program that allows a computer to execute the processing method of the flowcharts shown in FIGS. 6, 7, 8, 9, 13, 13, 14, 15, 16, and 17. The storage medium of the present invention stores a program that allows a computer to execute the processing methods of FIGS. 6, 7, 8, 9, 13, 13, 14, 15, and 17. Note that the program according to the present invention may be a program for each processing method of each device in FIGS. 6, 7, 8, 9, 13, 14, 15, 16, and 17.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk, solid state drive, or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

101 Mobile terminal 101
102 Business processing server / scan ticket server 102
103 MFP, image processing apparatus 104 client terminal 105 network 201 CPU
202 ROM
203 RAM
204 System bus 205 Input controller (input C)
206 Video controller (VC)
207 Memory controller (MC)
208 Communication I / F controller (Communication I / FC)
209 KB (keyboard)
210 CRT
211 External memory (HD, FD)
301 CPU
302 RAM
303 ROM
304 HDD
305 Network I / F
306 MODEM
307 Operation unit I / F
308 Operation unit 309 System bus 310 RIP
311 Printer I / F
312 Printer 313 Scanner I / F
314 Scanner 315 Image bus 316 Controller unit 317 Image processing unit 318 External I / F
319 Card reader 400 Request processing module 401 External data linkage component 402 Internal data processing component 403 System management component 404 Business logic processing module 405 User authentication processing module 406 Content data management module 407 Scan ticket management module 408 Workflow linkage module 409 Web application server 501 Captured image transmission unit 502 Character recognition processing result reception unit 503 Scan ticket issuance request unit 504 Scan ticket reception unit 505 Scan image transmission unit 506 Data correction unit 507 Captured image reception unit 508 Captured image character recognition processing unit 509 Data registration unit 510 Scan Ticket issuing unit 511 Scanned image receiving unit 512 Scanned image character recognition process Part

Claims (16)

A portable terminal, an image processing apparatus, and an image management server are image management systems capable of communicating via a network,
The image management server
Captured image receiving means for receiving an image of a document captured by the portable terminal;
Captured image character recognition processing means for performing character recognition processing on the image received by the captured image reception means;
When the captured image character recognition processing means fails in the character recognition processing of the image, a scan ticket including a scan setting is used to cause the document captured by the portable terminal to perform character recognition processing again. A scan ticket issuing means for issuing it usable in the processing device;
Scan image receiving means for receiving the image scanned by the scan ticket from the image processing device;
Scanning image character recognition processing means for reading data described in the image by performing character recognition processing on the image received by the scanned image reception means;
The image processing apparatus includes:
A scan ticket accepting means for accepting a scan ticket including a scan setting issued by the scan ticket issuing means;
An image management system, comprising: a scan image transmission unit configured to transmit an image of the document scanned using the scan ticket received by the scan ticket reception unit to the image management server. The image management server does not issue the scan ticket and registers the value acquired by the character recognition processing in the table when the character recognition processing of the image does not fail by the captured image character recognition processing means. The image management system according to claim 1. When the character recognition process of the image transmitted by the scan image transmission unit is performed and the character recognition process of the image does not fail, the scan ticket is not issued, and the value acquired by the character recognition is stored in the table. The image management system according to claim 1, wherein registration is performed. The image management server creates a thumbnail image of the image received by the captured image receiving unit when the character recognition processing of the image fails by the captured image character recognition processing unit. 4. The image management system according to any one of items 1 to 3. The image management server further issues a ticket ID associated with the scan ticket issued by the scan ticket issuing means, and a correspondence table associating the ticket ID with the thumbnail image ID for recognizing the thumbnail image. 5. The image management system according to claim 4, further comprising first storage means for storing. The image processing apparatus associates the ticket ID with the thumbnail image ID corresponding to the ticket ID so that the scan ticket corresponding to the image for which the character recognition issued by the scan ticket issuing unit has failed can be identified. 6. The image management system according to claim 5, wherein the attached thumbnail images can be displayed in association with each other. The image processing apparatus further includes a document generation receiving unit that receives an instruction to generate the document photographed by the mobile terminal;
A document generation instruction unit that transmits an instruction to generate the document received by the document generation reception unit to the management server;
The management server
The image management system according to claim 1, further comprising: a document generation instruction receiving unit that receives an instruction to generate the document received by the document generation instruction unit. The image management system according to claim 7, wherein the management server issues the scan ticket for each document received by the document generation instruction reception unit. The image processing apparatus further includes:
A setting accepting unit for accepting a setting as to whether or not to transmit an image of the document to the image management server using the portable terminal when the document generation accepting unit accepts an instruction to generate the document;
Comprising setting information transmitting means for transmitting the setting set by the setting receiving means to the image management server;
The management server further includes:
Setting information receiving means for receiving the setting transmitted by the setting information transmitting means;
Use of determining whether the image of the document received by the document generation instruction receiving unit is transmitted to the image management server using the portable terminal based on the setting received by the setting information receiving unit A determination means,
When the use management unit determines that the image of the document received by the document generation instruction reception unit is not transmitted to the image management server using the portable terminal, the image management server 9. The image management system according to claim 7, wherein a scan ticket associated with the document is issued when the instruction receiving unit receives the generation of the document. When the use management unit determines that the image of the document received by the document generation instruction reception unit is not transmitted to the image management server using the portable terminal, the image management server 10. The image management system according to claim 9, wherein when the generation of the document is received by the instruction receiving unit, a thumbnail image associated with the scan ticket of the document is created. When the result of the character recognition processing of the image read by the scanned image character recognition processing means is incomplete, the information processing apparatus connectable to the image management server accepts correction of data as a result of the character recognition processing The image management system according to claim 1, wherein the image management system is an image management system. A portable terminal capable of communicating via a network, and an image management server for receiving an image of a document from an image processing device,
Captured image receiving means for receiving an image of a document captured by the portable terminal;
Captured image character recognition processing means for performing character recognition processing on the image received by the captured image reception means;
When the captured image character recognition processing means fails in the character recognition processing of the image, a scan ticket including a scan setting is used to cause the document captured by the portable terminal to perform character recognition processing again. A scan ticket issuing means for issuing it usable in the processing device;
Scan image receiving means for receiving the image scanned by the scan ticket from the image processing device;
An image management server comprising scan image character recognition processing means for reading data described in the image by performing character recognition processing on the image received by the scan image reception means. A control method of an image management system in which a portable terminal, an image processing device, and an image management server can communicate via a network,
A captured image receiving step in which the captured image receiving means of the image management server receives an image of a document captured by the mobile terminal;
A captured image character recognition processing step of performing a character recognition process on the image received by the captured image reception step by the captured image character recognition processing unit of the image management server;
The scan ticket issuing means of the image management server should perform character recognition processing again on the document imaged by the portable terminal when the character recognition processing of the image fails in the captured image character recognition processing step. A scan ticket issuing step for issuing a scan ticket including scan settings to be usable in the image processing apparatus;
A scanned image receiving unit of the image management server receives the scanned image by the scan ticket from the image processing apparatus;
The scanned image character recognition processing means of the image management server includes a scanned image character recognition processing step of reading data described in the image by performing character recognition processing on the image received by the scanned image receiving step,
A scan ticket accepting step in which the scan ticket accepting means of the image processing apparatus accepts a scan ticket including a scan setting issued by the scan ticket issuing step;
The scan image transmission unit of the image processing apparatus includes a scan image transmission step of transmitting an image of the document scanned using the scan ticket received by the scan ticket reception step to the image management server. Control method of image management system. A control method of a portable terminal capable of communicating via a network and an image management server for receiving an image of a document from an image processing device,
A captured image receiving means for receiving a document image captured by the portable terminal;
Captured image character recognition processing means, which is received by the captured image reception step, performs a character recognition process on the image, and
The scan ticket issuing means sets scan settings so that the document captured by the portable terminal is subjected to character recognition processing again when the character recognition processing of the image fails in the captured image character recognition processing step. A scan ticket issuance step for issuing a scan ticket including a usable scan ticket in the image processing apparatus;
A scan image receiving unit that receives the image scanned by the scan ticket from the image processing device;
A scan image character recognition processing unit includes a scan image character recognition processing step of reading data described in the image by performing character recognition processing on the image received by the scan image reception step. Management server control method. A portable terminal, an image processing apparatus, and an image management server are programs executed by an image management system capable of communicating via a network,
The image management server;
Captured image receiving means for receiving an image of a document captured by the portable terminal;
Captured image character recognition processing means for performing character recognition processing on the image received by the captured image reception means;
When the captured image character recognition processing means fails in the character recognition processing of the image, a scan ticket including a scan setting is used to cause the document captured by the portable terminal to perform character recognition processing again. A scan ticket issuing means for issuing it usable in the processing device;
Scan image receiving means for receiving the image scanned by the scan ticket from the image processing device;
The image received by the scanned image receiving means is subjected to character recognition processing, thereby functioning as scanned image character recognition processing means for reading data described in the image,
The image processing apparatus;
A scan ticket accepting means for accepting a scan ticket including a scan setting issued by the scan ticket issuing means;
An image management system program that functions as a scan image transmission unit that transmits an image of the document scanned using a scan ticket received by the scan ticket reception unit to the image management server. A program that is executed by a mobile terminal that can communicate via a network and an image management server that accepts an image of a document from an image processing apparatus,
The server,
Captured image receiving means for receiving an image of a document captured by the portable terminal;
Captured image character recognition processing means for performing character recognition processing on the image received by the captured image reception means;
When the captured image character recognition processing means fails in the character recognition processing of the image, a scan ticket including a scan setting is used to cause the document captured by the portable terminal to perform character recognition processing again. A scan ticket issuing means for issuing it usable in the processing device;
Scan image receiving means for receiving the image scanned by the scan ticket from the image processing device;
A program for an image management server, wherein a character recognition process is performed on the image received by the scan image reception unit to function as a scan image character recognition processing unit that reads data described in the image.

Images