JP7124859B2 - data output system, information processing system, data output method, program - Google Patents

Description

The present invention relates to a data output system, an information processing system, a data output method, and a program.

2. Description of the Related Art In the daily work of an organization such as a company or an organization, there are many cases where the processing of forms such as expense reports, invoices, or order forms occurs. A person in charge in an organization performs daily tasks such as extracting and aggregating handling dates, case numbers, amounts, etc. from forms.

Techniques related to the digitization of such forms have been devised (see, for example, Patent Document 1). Japanese Patent Application Laid-Open No. 2002-200001 discloses an image reading device that scans a form on which a user has marked an area to be masked with a multifunction machine and registers the form with the masked area in a core system or the like.

However, the conventional technique has a problem that it is impossible to output the result of OCR processing to a predetermined area of the image data. For example, when reimbursing expenses, a user in an organization fills in the expenses in an expense reimbursement form and submits it to the general affairs department. Even if this form is read by a multifunction device and converted into image data, the person in charge will not be able to read data such as dates and expenses from a predetermined area of all the image data from each user and record it in a file. is necessary.

SUMMARY OF THE INVENTION An object of the present invention is to provide a data output system capable of outputting the result of OCR processing on a predetermined area of image data.

In view of the above problems, the present invention provides a data output system in which a device and an information processing system can communicate, wherein a communication unit receives image data from the device and predetermined information is detected from the first image data. a first output unit for outputting to a setting file information about the area in which the predetermined information detected by the area detecting unit is detected; and the predetermined information included in the setting file. an area identifying unit that identifies an OCR area from second image data based on information about an area where predetermined information is detected; and an OCR area based on the identified OCR area and the second image data . and a second output unit for outputting data on which OCR processing has been performed.

It is possible to provide a data output system capable of outputting the result of OCR processing on a predetermined area of image data.

FIG. 4 is a diagram for explaining processing or operation of creating a file with data acquired from a form by the data output system; It is a figure which shows the system configuration|structure of an example of the data output system which concerns on this embodiment. It is a figure which shows the hardware constitutions of an information processing system and an example of a terminal device. 1 is a hardware configuration diagram of an example of an image forming apparatus; FIG. 1 is a diagram illustrating an example functional configuration of a device, a terminal device, and an information processing system; FIG. It is a figure which shows an example of the application processing information memorize|stored in the application processing information storage part. FIG. 4 is a diagram schematically showing a series of processes performed by an application; It is a figure explaining the marking method of the area|region in a form. FIG. 10 is a diagram showing an example of an area registration screen displayed by the device when area information is registered; FIG. 10 is an example of a sequence diagram showing a procedure for an information processing system to acquire area information from a form on which an administrator has marked areas and create a setting file; FIG. 10 is an example of a diagram illustrating detection of an area from image data; FIG. 10 is an example of a sequence diagram showing a procedure for an administrator to set information in columns F to K of a setting file; FIG. 10 is an example of a diagram illustrating correspondence between a setting file and a form; It is an example of the screen which a terminal device displays regarding correspondence of an application and area|region information. FIG. 10 is an example of a sequence diagram illustrating a process by which an administrator associates an application with a setting file; It is a figure which shows the modification of a matching screen. It is an example of the figure which shows the selection screen of several applications. It is an example of a screen operated by an administrator when duplicating an application. FIG. 10 is an example of a sequence diagram showing a procedure for an information processing system to register a copy of an application; FIG. 10 is a diagram showing an example of transition of screens displayed by the device; FIG. 4 is an example of a diagram illustrating files saved in an external service system; FIG. FIG. 10 is an example of a sequence diagram in which an information processing system receives a PDF file containing image data of a form from a device and acquires data from an area; FIG. 10 is an example of a diagram for explaining correction of OCR processing results; FIG. 4 is a diagram showing an example of a file list screen of an external service system displayed by a terminal device; It is a figure which shows an example of the output data display screen which an apparatus displays. It is an example of a diagram showing a plurality of forms and an output file.

A data output system and a data output method performed by the data output system will be described below as an example of a mode for carrying out the present invention.

<Outline of processing or operation>
2. Description of the Related Art Organizations such as companies and organizations often have to process forms such as expense reports, invoices, or order forms. A person in charge in an organization performs tasks such as extracting dates, project numbers, amounts, and the like from forms and totaling them on a daily basis. The processed forms are stored after filing, but the storage space is also costly. The digitization of forms is gradually progressing, but it takes time and effort for the person in charge to rename the file name automatically given to the file of the form.

There are systems and services that automate billing and ordering, but they are often expensive, so not many SMEs can afford to invest in them. For this reason, there is a current situation in which there is no choice but to process this form manually.

In this embodiment, the information processing system can acquire data from the areas of the form that occur daily based on the area information registered in advance from the form with the areas marked, and can output it as an electronic file. .

The outline of the processing or operation performed by the data output system will be described with reference to FIG. FIG. 1 is a diagram for explaining the process or operation of creating a file from data acquired from a form by the data output system 100. As shown in FIG. FIG. 1A is a diagram for explaining setting of area information in a form, and FIG. 1B is a diagram for explaining acquisition of data from a form using the area information.

(1) The data output system 100 can cooperate with the external service system 40 . The data output system 100 cooperates with the external service system 40 via an application. An application that operates on the data output system 100 may be simply referred to as an "application", and an application that operates on the external service system 40 may be referred to as a collaboration destination application. The data output system 100 stores the correspondence.

(2) The administrator 8 of the data output system 100 uses the forms 7 routinely used by the users in the organization and designates which area of the forms 7 data should be acquired. For example, the area of the form 7 may be painted out or surrounded with a marker pen. The device 20 transmits image data generated by reading the form 7 with the marked area to the information processing system 10 . Note that the form 7 to be marked may have characters written for the items, only the items, or may be blank.

(3) The information processing system 10 saves the area information of the area designated by the marker pen in the setting file. The area information is coordinates of diagonal vertices of, for example, a rectangular area in the image data. The information processing system 10 saves the setting file in the external service system 40 .

(4)-1 The administrator connects the terminal device 30 to the external service system 40, downloads the setting file, and supplements the setting file with the language of the form and the date and time format.

(4)-2 Further, the administrator connects the terminal device 30 to the information processing system 10 and performs an operation of associating the application ID of the application with the setting file. An administrator can associate any number of application IDs with configuration files. As a result, the icon for accepting the selection of the application is associated with the area information on which the image processing is performed.

(5) When the user 6 in the organization submits the form 7 to the organization for expense reimbursement, the icon of the application corresponding to the form 7 is pressed on the device 20 . You can easily select an application from multiple form names. The user causes the device 20 to read the form in which the necessary items are handwritten or the form printed out. The device 20 transmits image data (for example, a PDF file) generated by reading the application ID of the application and the form to the information processing system 10 .

(6) The information processing system 10 identifies the setting file by the application ID, and acquires (for example, cuts out) the area of the area information of the setting file acquired from the external service system 40 from the image data. Therefore, the area of the form registered by the administrator is acquired.

(7) The information processing system 10 performs OCR (Optical Character Reader) processing only on this area to convert it into data. That is, the data described in the area (character code such as characters) is obtained.

(8) The information processing system 10 outputs the data to an electronic file (for example, a CSV (Comma Separated Value) file) and transmits the file and image data to the external service system 40 . When the information processing system 10 designates the application ID of the cooperation destination application, the file and image data can be transmitted by designating the cooperation destination application.

(9) The external service system 40 registers the image data and files in the folder (or directory) designated by the administrator. The file contains the information necessary for settlement, so the person in charge can process the settlement.

As described above, in the data output system of the present embodiment, the device 20 reads a form on which areas are marked, and stores area information for each form. Then, the information processing system 10 obtains only the area from the image data of the form transmitted from the device, performs OCR processing, and outputs the data resulting from the OCR processing to a file. This makes it possible to associate an arbitrary number of icons with respective image processing areas, and the user only needs to select an icon according to the type of form, for example, to create an image in the desired area of the image data generated by scanning. Processing (eg, OCR processing) can be performed.

<Terms>
The administrator is a system administrator or the like on the customer side of the data output system, and is a person who sets up the data output system for general users. A user is a general user on the customer side. Since a general user may perform the work of an administrator, there is no need to distinguish between the two.

OCR (Optical Character Recognition/Reader) is a technology that converts handwritten characters or printed characters into electrical signals using photosensitive elements, thereby converting them into digital character codes that can be used by computers. It may also be called character recognition processing, character conversion processing, digitization, or the like. The data obtained by OCR processing is various, such as Japanese, English, numerals, symbols, and figures.

A ledger is a general term for a ledger, slip, and the like. It is also called office paper with blanks for the user to fill in. In the present embodiment, a form will be mainly described, but any document can be named as long as it can be read by the device 20 . For example, documents, papers, documents, reports, newspapers, magazines, etc. are also targets. Note that the form may not be printed out on a paper medium (the device 20 may not need to read the form).

Any type of image data can be used for OCR processing, including PDF, JPEG, PNG, TIFF, BMP, and the like.

Information about the OCR area is information for the information processing system 10 to specify the OCR area. In this embodiment, the term "area information" is used.

In this embodiment, a "setting file" is a file in which area information is set, and a "file" is a file in which data is output. A file is a group of data that is a basic unit of data managed by a computer.

Outputting data means enabling the user to visually check the data. In this embodiment, it is output to a file, for example.

An icon is a graphic symbolized in an easy-to-understand manner, such as an instruction or command given to a computer, a document file, or the like. A button is a graphic that you click with the mouse to give a command to the software. Both the icon and the button may have the content of the operation or the content of the instruction written on them.

<System configuration example>
First, the system configuration of the data output system 100 according to this embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an example system configuration of the data output system 100 according to this embodiment.

A data output system 100 shown in FIG. 2 includes an information processing system 10 and a device 20, which are communicably connected via a wide area network N1 such as the Internet. The data output system 100 communicates with an external service system 40, which is an external system. Also, any terminal device 30 can communicate with the information processing system 10 via the networks N1 and N2.

The information processing system 10 is realized by one or more information processing devices, and provides various services realized by a series of processes in cooperation with an external service system 40 such as a cloud service via the network N1. Specific examples of services provided by the information processing system 10 according to this embodiment will be described later. The information processing system 10 may be realized by cloud computing, or may be realized by a single information processing device. Cloud computing is a form of usage in which resources on a network are used without being conscious of specific hardware resources. The information processing system 10 may exist on the Internet or may exist on-premises. A series of processes is provided by one application, and the series of processes is also called a "processing flow" or a "workflow."

The devices 20 are various electronic devices used by users. The device 20 is, for example, an image processing device such as an MFP (Multifunction Peripheral), an image forming device, a PC (personal computer), a projector, an electronic blackboard, a digital camera, or the like. Device 20 is connected to network N2. A user can use the device 20 to use various services provided by at least one of the information processing system 10 and the external service system 40 .

In addition, hereinafter, a plurality of devices 20 will be described using suffixes such as “device 20 ₁ ”, “device 20 ₂ ”, etc. when distinguishing between them.

The terminal device 30 is, for example, a desktop PC (personal computer), a notebook PC, a smart phone, a tablet terminal, or the like used by an administrator or a user. In addition, the terminal device 30 may be any device capable of operating a web browser. The terminal device 30 is connected to the network N2. An administrator or a user can operate the terminal device 30 to use various services provided by the information processing system 10 or the external service system 40, and furthermore, can set up a linked application or an application.

For convenience of explanation, the device 20 and the terminal device 30 will be described separately, but the device 20 and the terminal device 30 may be collectively called the device.

In addition, hereinafter, when distinguishing between a plurality of terminal devices 30, they are described using suffixes such as “terminal device 30 ₁ ” and “terminal device 30 ₂ ”.

The external service system 40 is one or more information processing devices that provide services by executing a linked application via the network N1. Data management or processing is performed by executing the linked application, and the data itself and the processing result become the service.

Examples of the external service system 40 include cloud services, ASPs (Application Service Providers), etc., and may include various external services provided via a network. In this embodiment, a storage service will be described as an example of the service. The external service system 40 may exist on the Internet or may exist on-premises.

In the following, when distinguishing among the plurality of external service systems 40, the illustrated "external service system 40 ₁ " will be referred to as the external service system 40A, and the "external service system 40 ₂ " as the external service system 40B, etc. and describe.

<Hardware configuration example>
Hardware configurations of the information processing system 10 and the terminal device 30 included in the data output system 100 according to the present embodiment will be described with reference to FIG.

<<information processing system and terminal device>>
FIG. 3 is a diagram showing an example hardware configuration of the information processing system 10 and the terminal device 30 according to this embodiment. As shown in FIG. 3, the information processing system 10 and the terminal device 30 are constructed by a computer, and include a CPU 501, a ROM 502, a RAM 503, an HD 504, a HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I /F (Interface) 508 , network I/F 509 , bus line 510 , keyboard 511 , pointing device 512 , DVD-RW (Digital Versatile Disk Rewritable) drive 514 and media I/F 516 .

Among them, the CPU 501 controls the operations of the information processing system 10 and the terminal device 30 as a whole. The ROM 502 stores programs used to drive the CPU 501 such as IPL. A RAM 503 is used as a work area for the CPU 501 . The HD 504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data to/from the HD 504 under the control of the CPU 501 . A display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I/F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. A network I/F 509 is an interface for data communication using the network N2. A bus line 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501 shown in FIG.

Also, the keyboard 511 is a kind of input means having a plurality of keys for inputting characters, numerical values, various instructions, and the like. A pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. A DVD-RW drive 514 controls reading or writing of various data to a DVD-RW 513 as an example of a removable recording medium. It should be noted that not only DVD-RW but also DVD-R or the like may be used. A media I/F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<<Equipment>>
FIG. 4 is a hardware configuration diagram of an image forming apparatus, which is an example of the device 20. As shown in FIG. As shown in FIG. 4, the image forming apparatus includes a controller 910, a short-range communication circuit 920, an engine control section 930, an operation panel 940, and a network I/F 950.

Among these, the controller 910 includes a CPU 901, a system memory (MEM-P) 902, a north bridge (NB) 903, a south bridge (SB) 904, an ASIC (Application Specific Integrated Circuit) 906, and a storage unit, which are the main parts of the computer. A local memory (MEM-C) 907 , an HDD controller 908 , and an HD 909 as a storage unit, and the NB 903 and ASIC 906 are connected by an AGP (Accelerated Graphics Port) bus 921 .

Among them, the CPU 901 is a control unit that performs overall control of the image forming apparatus. The NB 903 is a bridge for connecting the CPU 901, the MEM-P 902, the SB 904, and the AGP bus 921, and is a memory controller that controls reading and writing with respect to the MEM-P 902, a PCI (Peripheral Component Interconnect) master, and an AGP target. have

The MEM-P 902 is composed of a ROM 902a, which is a memory for storing programs and data for realizing each function of the controller 910, and a RAM 902b, which is used as a drawing memory for expansion of programs and data, memory printing, and the like. The program stored in the RAM 902b is configured to be provided by being recorded in a computer-readable recording medium such as a CD-ROM, CD-R, DVD, etc. as a file in an installable format or an executable format. You may

SB 904 is a bridge for connecting NB 903 with PCI devices and peripheral devices. The ASIC 906 is an image processing IC (Integrated Circuit) having hardware elements for image processing, and serves as a bridge that connects the AGP bus 921, PCI bus 922, HDD controller 908, and MEM-C 907, respectively. This ASIC 906 includes a PCI target and AGP master, an arbiter (ARB) that forms the core of the ASIC 906, a memory controller that controls the MEM-C 907, and multiple DMACs (Direct Memory Access Controllers) that rotate image data using hardware logic. , and a PCI unit for performing data transfer via the PCI bus 922 with a scanner section 931, a printer section 932, and a facsimile section. Note that the ASIC 906 may be connected to a USB (Universal Serial Bus) interface or an IEEE 1394 (Institute of Electrical and Electronics Engineers 1394) interface.

MEM-C 907 is a local memory used as an image buffer for copying and an encoding buffer. The HD 909 is a storage for accumulating image data, accumulating font data used for printing, and accumulating forms. The HD 909 controls reading or writing of data to or from the HD 909 under the control of the CPU 901 . The AGP bus 921 is a bus interface for graphics accelerator cards proposed to speed up graphics processing, and can speed up the graphics accelerator card by directly accessing the MEM-P 902 with high throughput. .

Also, the near field communication circuit 920 is provided with an antenna 920a of the near field communication circuit. The short-range communication circuit 920 is a communication circuit for NFC, Bluetooth (registered trademark), or the like.

Furthermore, the engine control section 930 has a scanner section 931 , a printer section 932 and a facsimile section 933 . The operation panel 940 displays a current setting value, a selection screen, and the like, and a panel display unit 940a such as a touch panel for receiving input from an operator, and setting values for image forming conditions such as density setting conditions. A hardware key 940b including a numeric keypad for accepting a copy start instruction and a start key for accepting a copy start instruction is provided. A controller 910 controls the entire image forming apparatus, such as drawing, communication, and input from an operation panel 940 . The scanner unit 931 or printer unit 932 includes an image processing part such as error diffusion and gamma conversion.

Note that the image forming apparatus can switch and select the document box function, the copy function, the printer function, and the facsimile function in sequence using an application switching key on the operation panel 940 . The document box mode is set when the document box function is selected, the copy mode is set when the copy function is selected, the printer mode is set when the printer function is selected, and the facsimile mode is set when the facsimile mode is selected.

A network I/F 950 is an interface for data communication using the network N2. A short-range communication circuit 920 and a network I/F 950 are electrically connected to the ASIC 906 via a PCI bus 922 .

<About functions>
Next, the functional configuration of the data output system 100 according to this embodiment will be described with reference to FIG. FIG. 5 is a diagram showing an example functional configuration of the device 20, the terminal device 30, and the information processing system 10 according to the present embodiment.

<<Equipment>>
First, the device 20 has a second communication section 21 , a display control section 22 , an operation reception section 23 , an image data generation section 24 , a facsimile processing section 25 and an e-mail processing section 26 . Each of these functional units is a function or means implemented by the CPU 901 executing instructions included in one or more programs installed in the device 20 . For example, the second communication unit 21, the display control unit 22, and the operation reception unit 23 are implemented by a web browser, and the others are implemented by individual applications (native apps).

The second communication unit 21 transmits and receives various information to and from the information processing system 10 . In this embodiment, the screen information of the application list screen and the like are received from the information processing system 10 , and the image data of the form, the application ID and the like are transmitted to the information processing system 10 .

The display control unit 22 interprets the screen information of various screens and displays it on the panel display unit 940a. The operation accepting unit 23 accepts various user operations on various screens displayed on the panel display unit 940a.

When the application selected by the operation receiving unit 23 generates image data, the image data generating unit 24 scans the document with the scanner unit 931 to generate image data. The image data generator 24 has a scanning function. The image data generator 24 converts the image data into a PDF file. Image data (JPEG, TIFF, PNG, etc.) can be used without conversion. The facsimile processing unit 25 performs processing related to facsimile reception and transmission by the facsimile unit 933, and requests the information processing system 10 to execute an application associated in advance when a facsimile is received. An application corresponding to the facsimile transmission source (FAX number) may be requested.

The e-mail processing unit 26 performs processing related to e-mail transmission and reception, and requests the information processing system 10 to execute an application associated in advance when an e-mail is received. An application corresponding to the sender (email address) of the e-mail may be requested.

<<Terminal device>>
The terminal device 30 has a first communication section 31 , a display control section 32 and an operation reception section 33 . Each of these functional units is a function or means implemented by the CPU 501 executing instructions included in one or more programs installed in the terminal device 30 . Note that this program may be a web browser or dedicated software for communicating with the information processing system 10 .

The first communication unit 31 transmits and receives various types of information to and from the information processing system 10 or the external service system 40 (an example of a second communication unit). In this embodiment, various screen information and the like are received from the information processing system 10 or the external service system 40, and information set by the administrator or the user is transmitted to the information processing system 10 or the external service system 40. FIG.

The display control unit 32 interprets screen information of various screens and displays it on the display 506 . The operation accepting unit 33 accepts various user operations on various screens displayed on the display 506 .

<<Information Processing System>>
The information processing system 10 has an application data service section 11 , a setting reception section 12 , an authentication service section 14 , a web service processing section 15 , an input/output service section 16 , a component 18 and a communication section 19 . Each of these functional units is a function or means implemented by the CPU 501 executing instructions included in one or more programs installed in the information processing system 10 . In FIG. 5, one information processing system 10 has each functional unit for convenience of drawing, but each functional unit may be distributed and arranged in a plurality of information processing apparatuses.

The communication unit 19 transmits and receives various information to and from the terminal device 30 and the device 20 . The setting reception unit 12 provides the terminal device 30 with a setting site and receives settings for the setting site. A site may refer to a web page or a web application, or may refer to a server-side system that provides a web page or a web application to the terminal device 30 . The setting reception unit 12 has a terminal screen providing unit 42, and the terminal screen providing unit 42 provides an initial screen for allowing the administrator to set information necessary for executing the application, an application list screen, an association screen, and the like. do. In addition, the terminal screen providing unit 42 generates screen information described in HTML, XML, CSS (Cascade Style Sheet), JavaScript (registered trademark), etc. in response to an HTTP request from the terminal device 30, and transmits the screen information via HTTP. It is transmitted to the terminal device 30 as a response.

The application data service section 11 has an application data management section 41 . The application data management unit 41 manages application data 43 of applications purchased by customers such as companies for each customer. The application data 43, for example, associates the application with the area information described above. The application data 43 are stored in the application data storage unit 13 . An organization such as a customer viewed from the data output system 100 is called a tenant.

The web service processing unit 15 provides screen information to the device 20 and receives application execution from the device 20 . The web service processing unit 15 has an application executing unit 46 and a device screen providing unit 47 . The application execution unit 46 receives execution of an application from the device 20 and requests the input/output processing unit 48 to execute the application. The device screen providing unit 47 uses the screen information 54 to provide the device 20 with the screen information of the application list screen and the application screen.

The input/output service unit 16 uses the authentication service unit 14, the application processing information storage unit 17, and the component 18 to input/output data. The input/output service unit 16 has an input/output processing unit 48 and an application management unit 49 . The input/output processing unit 48 executes the application requested by the application execution unit 46 . At the time of execution, the application process information 53 is referenced and each process included in the application is requested to the component 18 . The application management unit 49 manages application processing information 53 and screen information 54 of the application stored in the application processing information storage unit 17 . In the application processing information 53, which processing is to be performed by the application in what order (for example, processing is requested to the external service system 40 after OCR) is set. The screen information 54 is information of screens displayed by the device 20, such as an icon of each application, an application list screen, and each application screen. The application processing information storage unit 17 stores application processing information 53 and screen information 54 for each application.

The authentication service unit 14 performs processing related to user (including administrator) and device 20 authentication. The authentication service section 14 has a user management section 44 and a device management section 45 . The user management unit 44 manages information about users. For example, it holds authentication information such as a user name and password. Authentication information includes information for the information processing system 10 and information for the external service system 40 . The device management unit 45 manages the devices 20 associated with tenants. That is, the identification information of the tenant and the device 20 are managed in association with each other, and when the device 20 is specified, the tenant is also specified.

The component 18 is a general term for individual functions that actually perform each process. One block within the component 18 corresponds to one process. The component 18 includes, for example, an authentication processing unit 61, an external service processing unit 62, a judgment unit 63, a PDF processing unit 64, an area detection unit 65, a file output unit 66, an area identification unit 67, an OCR processing unit 68, and an OCR correction unit. has 69. The authentication processing unit 61 is the component 18 that requests the authentication service unit 14 to perform authentication processing. The external service processing unit 62 is the component 18 that issues a processing request to the external service system 40 . In other words, the external service processing unit 62 is a function for cooperating with the external service system 40 . The external service processing unit 62 is prepared for each type of external service system 40 . The determination unit 63 makes various determinations and controls branching of the processing flow. The PDF processing unit 64 performs processing related to PDF files, such as extracting image data from a PDF file and creating a PDF file with transparent text. This is because the device 20 transmits image data in the form of a PDF file. The area detection unit 65 detects a rectangular area marked with a marker pen or the like from the image data, and creates coordinates (area information) of the rectangular area. The file output unit 66 creates a setting file containing area information, and outputs a file containing OCR processing results (data obtained from the area of the form). The area identifying section 67 identifies an area from the image data based on the area information. The area specifying unit 67 acquires (for example, cuts out) the specified area. The OCR processing unit 68 performs OCR processing only on the area and on the entire image data. The OCR corrector 69 corrects the OCR processing result. It should be noted that components such as translation may be included in addition to those illustrated.

表１は、アプリ処理情報記憶部１７が保持するアプリ処理情報の一例を示す。アプリ処理情報記憶部１７はテナントごとに購入されている（ライセンスがある）アプリのリストを記憶する。表１に示す情報はアプリ処理情報記憶部が記憶するリストに含まれるアプリうち、本実施形態で説明する受信した画像データの一部に画像処理を行うアプリの一覧で、アプリＩＤ、アプリ名、画面情報、アプリ処理情報、共有アプリ、及び、外部サービスシステム４０の各項目を有している。アプリＩＤはアプリを識別する識別情報である。アプリ名は管理者が付与したアプリの名称である。また、アプリのアイコンや設定画面を機器２０が表示する際に使用される画面情報５４（ＨＴＭＬ等で記述された）がアプリに対応付けられる。アプリには一連の処理の内容と順番（処理フロー）が定義されるので、各アプリにはアプリ処理情報５３が対応付けられる。後述するように、複製されたアプリはフロー情報が同じになる。共有アプリとは、一般のアプリがユーザごとに利用権限が与えられるのに対し、共有アプリはテナントのユーザが共通に使えるアプリであることを示す。表１では経費精算書アプリが共有アプリである。各ユーザが共通に利用するためである。外部サービスシステム４０の項目は各アプリが連携する外部サービスシステム４０である。外部サービスシステム４０と連携しないアプリも存在する。

Table 1 shows an example of application processing information held by the application processing information storage unit 17 . The application processing information storage unit 17 stores a list of applications purchased (licensed) for each tenant. The information shown in Table 1 is a list of applications included in the list stored in the application processing information storage unit, which perform image processing on part of the received image data described in this embodiment. It has items of screen information, application processing information, shared application, and external service system 40 . The application ID is identification information that identifies the application. The application name is the name of the application given by the administrator. Further, screen information 54 (written in HTML or the like) used when the device 20 displays an icon or setting screen of the application is associated with the application. Since the content and order (processing flow) of a series of processes are defined for each application, application processing information 53 is associated with each application. As will be described later, duplicated apps have the same flow information. A shared application is an application that tenant users can use in common, whereas a general application is given usage authority for each user. In Table 1, the expense report app is the shared app. This is for common use by each user. The item of the external service system 40 is the external service system 40 with which each application cooperates. There are also applications that do not cooperate with the external service system 40 .

When an administrator or user logs in, the application management unit 49 acquires from the application processing information storage unit 17 a list of applications that the administrator or user is authorized to use, and provides the list to the device 20 . Further, when an application is specified from the application list, application management unit 49 identifies screen information and application processing information associated with the application.

表２はユーザ管理部４４が管理するユーザに関する情報の一例を示す。表２（ａ）はユーザに関する情報として、情報処理システム１０におけるユーザＩＤ、ユーザ名、メールアドレス、パスワード、利用できるアプリ、及び、外部サービスシステム情報の各項目を有している。このユーザには管理者も含まれる。ユーザＩＤ、ユーザ名又はメールアドレスの少なくとも１つとパスワードは、ユーザが情報処理システム１０にログインするための認証情報である。利用できるアプリはこのユーザに利用権限が与えられているアプリである。利用権限は、利用人数などを指定してライセンスを購入したアプリを管理者が各ユーザに割り当てることで与えられる。利用できるアプリには個人アプリと共有アプリがある。個人アプリも共有アプリも複数のユーザに使用されるが、個人アプリは個人のユーザの外部サービスの認証情報を使用し、共有アプリは複数のユーザが外部サービスに対し管理者の認証情報を使用する。表２（ａ）では、U001～U003に共通のapp003が共有アプリである。その他は個人アプリである。個人アプリの場合、ユーザごとに外部サービスシステムの認証情報の登録が必要である。外部サービスシステム情報はユーザが連携設定済みの外部サービスシステム４０である。

Table 2 shows an example of user-related information managed by the user management unit 44 . Table 2(a) has items of user ID, user name, e-mail address, password, usable application, and external service system information in the information processing system 10 as information about the user. This user includes administrators. At least one of a user ID, a user name, or an e-mail address and a password are authentication information for a user to log into the information processing system 10 . An application that can be used is an application that the user is authorized to use. Usage authority is given by the administrator assigning a license-purchased application to each user by specifying the number of users. There are personal apps and shared apps available. Both personal and shared apps are used by multiple users, but personal apps use the individual user's external service credentials, and shared apps use administrator credentials for multiple users to external services. . In Table 2(a), app003 common to U001 to U003 is the shared application. Others are personal apps. In the case of a personal application, it is necessary to register the authentication information of the external service system for each user. The external service system information is the external service system 40 for which the user has already set up cooperation.

Note that "already set for cooperation" means that the user wishes to cooperate with the external service system 40 and it has been confirmed that the user can log in with the authentication information of the external service system 40. FIG. The user inputs the authentication information of the external service system 40 from the setting site, and when the login is successful, the identification information of the external service system is set in the external service system information of Table 2(a). Also, the authentication information of the external service system 40 is registered in Table 2(b).

Table 2(b) is information about each user's external service system, and has items of user ID, external service system 40, user ID, and password. Table 2(b) registers the authentication information of the external service system 40 that the user has set for cooperation. The authentication information for the external service system 40 is authentication information for the user to log in to the external service system 40 . The authentication information may be different for each external service system 40 like the user U002. Therefore, each user of the data output system 100 is associated with the authentication information of the external service system 40 . The information processing system 10 identifies the authentication information of the external service system 40 as a cooperation destination according to the authentication information such as the user ID and password of the information processing system 10 acquired from the device 20 .

Also, the authentication information may be authentication information of the external service system 40 or authentication information necessary for cooperating with the external service system 40. In addition to the user ID and password, an external A token or the like acquired from the service system 40 may be used.

Table 2(c) is the authentication information for the shared application. The identification information of the shared application is associated with the external service system 40 and the authentication information. Since the administrator's authentication information is used for the shared application, the administrator's identification information is registered.

表３は、アプリデータ記憶部１３に記憶されているアプリデータ４３の一例を示す。アプリデータ４３は、アプリと設定ファイル（領域情報）を対応づける。対応付けは管理者が行う。
・applicationId…連携元のアプリＩＤである。
・applicationName…アプリのアプリ名である。
・fileId…情報処理システム１０が作成した設定ファイルの識別情報である。
・fileName…情報処理システム１０が作成した設定ファイルのファイル名である。設定ファイルは外部サービスシステム４０に保存されるが、そのフォルダと共にファイル名が設定される。例えばＵＲＬでよい。
・アップロード先フォルダ…設定ファイルが保存される外部サービスシステム４０とそのフォルダである。例えばＵＲＬでよい。管理者が設定する。

Table 3 shows an example of the application data 43 stored in the application data storage unit 13. The application data 43 associates an application with a setting file (area information). An administrator performs correspondence.
• applicationId: the application ID of the linking source.
・applicationName: The application name of the application.
• fileId: identification information of the setting file created by the information processing system 10 .
• fileName . . . file name of the setting file created by the information processing system 10 . The configuration file is stored in the external service system 40, but the file name is set along with its folder. For example, a URL may be used.
Upload destination folder: the external service system 40 and its folder in which the setting file is stored. For example, a URL may be used. Set by administrator.

表４は、外部サービスシステム４０に記憶されている設定ファイル９の一例を示す。設定ファイル９は、ＯＣＲ処理の対象となる領域情報を有するファイルである。設定ファイルは表形式（例えばＣＳＶ形式）になっており、各セルの位置が列番号と行番号で指定される。以下、Ａ列～Ｌ列の項目について説明する。なお、設定ファイルの１行目にある項目名は、設定ファイルの作成時に情報処理システム１０により設定される。
・ＩＤ…領域情報の識別情報である。自動的に採番され、管理者やユーザが意識する必要はない。
・始点Ｘ座標、始点Ｙ座標、終点Ｘ座標、終点Ｙ座標…領域情報である。マーキングされた帳票の矩形領域の対角頂点を表す。１点の座標と幅と高さが指定されてもよい。座標の単位は例えばｃｍ、ピクセルなどでよい。

Table 4 shows an example of the configuration file 9 stored in the external service system 40. The setting file 9 is a file having area information to be subjected to OCR processing. The setting file is in tabular format (for example, CSV format), and the position of each cell is specified by column number and row number. The items in columns A to L will be described below. Note that the item name in the first line of the setting file is set by the information processing system 10 when the setting file is created.
ID: identification information of area information. It is automatically numbered, and administrators and users do not need to be aware of it.
• Start point X coordinate, start point Y coordinate, end point X coordinate, end point Y coordinate: area information. Represents the diagonal vertices of the rectangular area of the marked form. The coordinates, width and height of one point may be specified. Units of coordinates may be, for example, cm or pixel.

The above information is the information automatically set by the information processing system 10 . The following information is entered by the administrator.
• Format: the data format of the area. For example, there are date (YYYY/MM/DD), numerical value (NUMERIC), and the like. Since the format of the data is known, the OCR processing section 68 can perform OCR processing with higher precision. The format is a pull-down menu. In this way, the type of data is set for each area.
• CSV column name: name given to the area. In the case of a form, the title of the rectangular frame is entered, but the administrator can enter any value. The CSV column names are output to the file along with the data.
CSV position (column) . . . Specifies which column of the file the information processing system 10 writes the data extracted from the area.
• CSV position (starting line) . . . designates which line of the file the information processing system 10 writes the data extracted from the area. Since the line number increases each time the form is read, the "start line" is set when no data is written in the file. For example, data obtained from the first form is set in the second line, while data obtained from the second form is set in the third line. On the other hand, the column position may be fixed.
- OCR language --- The language in which the area is described is set. Since the language is known, the OCR processing section 68 can perform OCR processing with higher accuracy. The OCR language is a pull-down menu. In this way, the type of data is set for each area.
• Order used for file name: In this embodiment, it is used for the file name of the file to which the data acquired from the area is output. The order used for the file names is the order of the data used for the file names of the files output by the information processing system 10 . For example, if the "document name" is number 1 and the "application date" is number 2, the file name will be "expense report_20201010.csv" based on the data (expense report, 20201010) acquired from each area.

<Application processing information>
Next, details of the application processing information will be described with reference to FIG. FIG. 6 is a diagram showing an example of application processing information 53 stored in the application processing information storage unit 17. As shown in FIG.

The application processing information 53 shown in FIG. 6 is information relating to a series of processes for realizing a service of requesting processing of image data generated by scanning with the device 20 to the "external service system B".

The application processing information 53 includes a flow ID 1201A indicating identification information of the application processing information 53, a flow name 1202A indicating the name of the application processing information 53, and flow details 1203A indicating the processing details of a series of processes. . The flow name 1202A also serves as the name of the application.

The flow details 1203A also includes a processing content 1223A indicating that processing is requested to "external service system B".

In the processing content 1223A, the component ID "ExService_B" of the component 18 that executes processing in cooperation with "external service system B" and the parameters "AppId" and "Folder" are specified. "ExService_B" corresponds to the external service processing unit 62 for the external service system B; "AppId" stores the ID of the linked application (the correspondence between the application and the linked application is predetermined), and "Folder" stores the folder where the file is saved (upload destination folder) (administrator is set to the upload destination folder set by ). Thereby, the information processing system 10 can store the scanned image data in the "external service system B".

In addition, in the case of an application that does not cooperate with a cooperation destination application, "AppId" is omitted. The illustrated parameters are only a part, and application processing information may include more parameters.

In FIG. 6, only one component is specified for the sake of simplicity of explanation, but in the application processing information 53, a series of processing contents 1223A performed by the application are registered for the number of processes (components).

FIG. 7 is a diagram schematically showing a series of processes performed by an application. FIG. 7A shows a series of processes of an application (for example, an OCR area designation application) that creates a setting file. One block corresponds to the processing content 1223A. Details of each process will be described with reference to FIG.

FIG. 7B shows a series of processes of an application (for example, an expense report application) that outputs data from a form area. One block corresponds to the processing content 1223A. Details of each process will be described with reference to FIG.

<Specify area, get area, create configuration file>
Next, referring to FIGS. 8 to 11, the administrator's specification of areas, acquisition of areas, and creation of setting files will be described.

FIG. 8 is a diagram for explaining a method of marking an area on a form. In FIG. 8A, a colored portion 601 colored with a non-black and white (saturated) marker pen is formed. The color of the colored portion 601 corresponds to predetermined information. That is, the color applied with the marker pen is predetermined.
The area detection unit 65 detects pixels other than black and white, and detects the circumscribing rectangle of the pixels other than black and white (color adhering portion 601). A non-black and white marker pen is used so that the area detection unit 65 can easily detect the area, and a black marker pen may be used. In this case, the region detection unit 65 detects a circumscribed rectangle of black pixels having a height and area equal to or greater than a certain level.

Also, in FIG. 8B, a frame line 602 surrounding the area is formed with a marker pen other than black and white. The area detection unit 65 detects pixels other than black and white, and detects a circumscribed rectangle of the pixels (frame line 602) other than black and white.

Note that the method of marking the area is not limited to the method shown in FIG. For example, the area may be designated by double lines, or may be designated by a range surrounded by predetermined symbols (%, $, #, Δ, etc.).
The above-mentioned predetermined information may be information on figures such as circles and squares drawn by a black pen instead of a marker, as long as it indicates the OCR area, other than the information on the color drawn with the marker pen. In this case, the user draws a circle or square with a black pen to enclose the OCR area. Also, the OCR area may be an area filled with a marker pen, or the like, other than the area surrounded by the color of the marker pen.

FIG. 9 is an example of an area registration screen 610 displayed by the device 20 when area information is registered. The administrator logs into the information processing system 10 from the device 20 and selects an OCR area designation application. The area registration screen 610 has a message 611, a read setting field 612, and a start button 613 stating, "Set a document with an area to be OCR enclosed by a frame and press 'start'." The user sets the document (form) on the contact glass and presses the start button 613 . Reading conditions (color/black and white, single-sided/double-sided, orientation, resolution, etc.) may be set in the reading setting field 612 as necessary. As for color/black-and-white, it is preferable that the color is fixed to color so that the user does not set black-and-white by mistake.

It is preferable that the administrator can specify the file name of the setting file from the area registration screen 610 in FIG. This is to facilitate searching for the configuration file from the external service system 40 . Also, it is preferable that the user can set the folder in which the setting file is to be saved.

FIG. 10 is an example of a sequence diagram showing a procedure for the information processing system 10 to acquire area information from a form in which areas are marked by an administrator and to create a setting file.

S1: The administrator operates the device 20 to log in to the information processing system 10, and selects an OCR area designation application from the application list displayed on the initial screen. Thereby, the display control unit 22 of the device 20 displays the area registration screen 610 . The manager places the form with the marked area on the contact glass and presses the start button 613 . The image data generation unit 24 generates image data of a form and converts it into a PDF file.

S2: The second communication unit 21 of the device 20 transmits the PDF file to the information processing system 10 together with the execution request of the OCR area designation application.

S3: The communication unit 19 of the information processing system 10 receives the PDF file. The application execution unit 46 designates the application ID of the OCR area designation application and requests the input/output processing unit 48 to execute the application. The input/output processing unit 48 refers to the application processing information 53 associated with the application ID of the OCR area designation application and executes the application. First, the input/output processing unit 48 designates a PDF file and requests the PDF processing unit 64 to extract image data. The PDF processing unit 64 extracts the image data of the form from the PDF file.

S4: Next, the input/output processing unit 48 requests the area detection unit 65 to obtain the area together with the image data. The area detection section 65 acquires an area from the image data based on the color information of the image data.

FIG. 11 is a diagram explaining detection of an area from image data. As shown in FIG. 11A, the RGB values of the colored portion 601 specified with the marker pen have values other than black and white. Black RGB is (0,0,0) and white RGB is (255,255,255). Detect the color adhering portion 601 having Note that if the color of the marker pen is fixed, the developer can narrow the RGB range according to the color, and can detect the colored portion 601 with higher accuracy. For example, even if the form is in color, if a marker pen of a color not found in the form is used, the area detection unit 65 can detect the colored portion 601 from the color form.

FIG. 11(b) shows the detected color adhering portion 601. FIG. The area detection unit 65 sets a circumscribed rectangle 620 of the detected color adhering portion 601 . Margins are set on the top, bottom, left, and right of the circumscribing rectangle 620, and a region 621 including the margins is determined. In FIG. 11B, a [mm] is set to the left and right, and b [mm] is set to the top and bottom. The reason why the margin is set is that misalignment occurs when the device 20 reads the form. The coordinates of the upper left corner 622 in FIG. 11B are the X and Y coordinates of the start point of the area information, and the coordinates of the lower right corner 623 are the X and Y coordinates of the end point of the area information (area information).

Further, as shown in FIG. 11(c), the area detection unit 65 may detect a frame line 625 outside the color adhering portion 601 detected based on RGB. The region detection unit 65 searches for black pixels toward the outer side in the vertical direction of the color adhering portion 601 (the circumscribing rectangle 620). frame line 625 is detected. This makes it possible to detect the maximum area in which data can be written, and makes it easier for the area specifying unit 67 to specify data even if the device 20 reads the form and the position is shifted.
The administrator can set, for example, how much margin the area detection unit 65 should provide for the area specified by the marker pen. The details of FIG. 16 will be explained in the association screen 640-2. The area detection unit 65 sets area information based on the settings on the association screen 640-2.

S5: Next, the input/output processing unit 48 designates the image data whose area is designated with the marker pen and requests the external service processing unit 62 to upload it to the external service system 40 .

S6: The external service processing unit 62 acquires the authentication information of the administrator in the external service system 40 from the user management unit 44. FIG. As a result, the external service processing unit 62 logs into the external service system 40 and saves the image data in the administrator's top folder (or a folder specified by the administrator). When the administrator designates the file name of the setting file on the area registration screen 610, the external service processing unit 62 gives the same file name to the image data file. If no file name is set, the file name will be the current date and time.

S7: Next, the input/output processing unit 48 designates the area information detected by the area detection unit 65 and requests the file output unit 66 to create a setting file. The file output unit 66 assigns an ID number, arranges the area information in a predetermined column of the CSV file, and generates a setting file. At this point, information is entered in columns A to E of Table 4.

S8: Next, the input/output processing unit 48 specifies the setting file and requests the external service processing unit 62 to upload it to the external service system 40 .

S9: Since the external service processing unit 62 has already logged into the external service system 40, it saves the configuration file in the administrator's top folder (or the folder specified by the administrator). When the administrator designates the file name of the setting file on the area registration screen 610, the external service processing unit 62 gives this file name to the file of the setting file. If no file name is set, the file name will be the current date and time. Since the image data and the setting file have the same file name, the administrator can easily determine from which image data the setting file was generated.

<Registration of other information in the configuration file>
12 and 13, setting to the F to K columns in the setting file will be described. FIG. 12 is an example of a sequence diagram showing a procedure for the administrator to set information in the F to K columns of the setting file.

S<b>11 : After registering the setting file in the external service system 40 , the administrator operates the terminal device 30 to connect the terminal device 30 to the external service system 40 . The administrator logs in to the external service system 40 by entering his own authentication information.

S12: Since the external service system 40 is a storage service, the list of files registered by the administrator is sent to the terminal device 30. For example, a list of files in the top folder is sent. If it is not in the top folder, the hierarchy is specified by the administrator. The list of files also includes setting files and image data files registered from the device 20 by the administrator.

S13: The administrator selects a configuration file in order to confirm the contents of the configuration file and set information for columns F to K. The operation receiving unit 33 of the terminal device 30 receives the selection, and the first communication unit 31 specifies the file ID of the setting file and requests the setting file from the external service system 40 .

S<b>14 : The communication unit 19 of the external service system 40 receives the request for the setting file and transmits the setting file to the terminal device 30 .

S15: The administrator confirms the contents of the setting file and sets the information in columns F to K. The operation reception unit 33 of the terminal device 30 receives the settings.

S16: For example, when the administrator performs an operation of uploading a setting file, the first communication unit 31 transmits the setting file in which information is set in columns A to K to the information processing system .

The setting file is registered in the external service system 40 as described above.

FIG. 13 is a diagram for explaining the correspondence between setting files and forms. As described in Table 4, the administrator sets the format, CSV column names, CSV position (columns), CSV position (rows), OCR language, and the order used for file names. Note that it is not always necessary to set all the columns.

In the example of FIG. 13, the data acquired from the area information of ID=1 is set to correspond to the CSV column name "document name". "Document name" is used at the beginning of the file name. The data acquired from the area information of ID=2 is set to correspond to the CSV column name "application date". Also, since the CSV position of the application date is set to column 3, row 2, the data acquired from the area information of ID=2 is written to column 3, row 2 of the file. In addition, the "application date" is used second in the file name. The data acquired from the area information of ID=3 is set to correspond to the CSV column name "Amount". Also, since the CSV position of the amount is set to column 4, row 2, the data acquired from the area information of ID=3 is written to column 4, row 2 of the file.

<Associating applications with area information>
Next, with reference to FIGS. 14 and 15, the correspondence between applications and area information will be described. FIG. 14 is an example of a screen displayed by the terminal device 30 regarding association between an application and area information. The administrator operates the terminal device 30 to make the terminal device 30 communicate with the information processing system 10 .

First, FIG. 14A shows an initial screen 630 displayed when the administrator logs in to the information processing system 10 . An operation menu permitted by the administrator is displayed. In order to associate the application with the setting file, the administrator selects the icon 631 for displaying the application list.

As shown in Table 2, the user management unit 44 registers the applications that can be used by each user and the external service system information. can be provided to the terminal device 30 .

FIG. 14B shows an example of the application list screen 632. As shown in FIG. The application list screen 632 displays a list of applications that can be used by the administrator. From the application list screen 632, the administrator selects an application 633 (for example, an expense report application) to be associated with the setting file registered in the external service system 40. FIG. When the operation accepting unit 33 accepts the selection of the application 633, the association screen 640 shown in FIG. 14(c) is displayed. The association screen 640 has an external service system selection field 641 , an upload destination folder field 642 , and a setting file field 643 .
External service system selection field 641 --- This is a field for the administrator to set the external service system 40 as the storage destination of the file to which the data acquired from the area is to be written. Therefore, the administrator can change or newly set the external service system 40 previously associated with the application.
• Upload destination folder column 642 . When the administrator presses the folder selection button 642a, the information processing system 10 logs into the external service system 40 with the authentication information of the administrator in the external service system 40, and the top folder accessible by the administrator in the external service system 40 is set to the terminal. Displayed on device 30 . Administrators can select any folder.
A setting file column 643 is a column for the administrator to select a setting file to be associated with an application. When the administrator presses the file selection button 644, the information processing system 10 logs into the external service system 40 with the authentication information of the administrator in the external service system 40, and the top folder that the administrator in the external service system 40 can access. is displayed on the terminal device 30 . The top folder (or the folder set by the administrator) includes setting files registered by the information processing system 10 and updated by the administrator. If there is no configuration file in the top folder, the administrator can search for the configuration file in folders below the top folder.

FIG. 15 is an example of a sequence diagram for explaining the processing by which the administrator associates the application with the setting file via the screen of FIG. 14 . The process of FIG. 15 starts from the state where the screen of FIG. 14(a) is displayed.

S21: The administrator logs in to the information processing system 10 and inputs an operation to the terminal device 30 to display the application list from the initial screen 630 . The operation reception unit 33 of the terminal device 30 receives the operation, and the first communication unit 31 requests the information processing system 10 for the application list.

S22: The communication unit 19 of the information processing system 10 receives the application list request, and the terminal screen providing unit 42 acquires the application associated with the user ID of the administrator from the user management unit 44 . The terminal screen providing unit 42 creates screen information of an application list screen including applications that can be used by the administrator for each external service system 40 . The communication unit 19 transmits screen information of the application list screen to the terminal device 30 .

S23: The administrator selects an application with which the configuration file is associated. The operation accepting unit 33 of the terminal device 30 accepts the selection. After that, the terminal device 30 displays the association screen 640 as described above.

S24: The administrator presses a file selection button 644 on the correspondence screen 640. FIG. The operation reception unit 33 receives the depression, and the first communication unit 31 transmits a request for a list of files stored in the external service system 40 set on the association screen 640 to the information processing system 10 .

S25: The communication unit 19 of the information processing system 10 receives the request for the file list, and the application execution unit 46 designates the external service system 40 to the input/output processing unit 48 and requests the file list. The input/output processing unit 48 requests a file list from the external service processing unit 62 corresponding to the external service system 40 . The external service processing unit 62 acquires the administrator's authentication information in the external service system 40 (associated with the application or set by the user on the association screen) from the user management unit 44, and sends it to the external service system 40. Send a file listing request.

S26: Based on the administrator's authentication information, the external service system 40 permits the administrator to log in, and acquires a list of files associated with the administrator. A file list is transmitted to the terminal device 30 . Although FIG. 15 assumes that the external service system 40 that stores the setting file and the external service system 40 that stores the file of the data acquired from the area are the same, they may be different. In this case, the administrator changes the external service system 40 on the association screen 640 after selecting the setting file.

S27: The display control unit 32 of the terminal device 30 displays a list of files. The administrator selects a configuration file associated with the app. The operation accepting unit 33 of the terminal device 30 accepts the selection.

S28: The first communication unit 31 of the terminal device 30 designates the identification information of the setting file, the identification information of the application, the external service system 40, and the upload destination folder, and sends a request for associating the setting file and the application with the information processing system. Send to 10.

S29: The communication unit 19 of the information processing system 10 receives the setting file-application association request, and the application data management unit 41 registers the setting file and the application in the application data 43 in association with each other. That is, applicationId, applicationName, fileId, fileName, and upload destination folder are associated and registered. Note that the external service system 40 is registered in the application processing information 53 .

As described above, the application and the setting file are associated with each other. After that, the general user can output the data of the form area to the file simply by pressing the icon on the device 20 .

In FIG. 15, a method for the administrator to associate the application with the area information on the association screen 640 has been described, but the application may be associated with the area information when the area information is registered.

In this case, for example, a field for entering an application name is displayed on the area registration screen 610 of FIG. The administrator inputs the application name of the application to be associated with the setting file. After creating the setting file, the information processing system 10 can associate the application with the input application name with the setting file. In other words, if the administrator sets the application name and causes the form to be read, a setting file is generated, and the cooperation source file and the setting file are associated with each other.
In addition, the administrator can set the expansion width of the area on the association screen 640 shown in FIG. 14(c). FIG. 16 shows a modification of the association screen 640. FIG. In addition, in the explanation of FIG. 16, mainly the difference from FIG. 14(c) will be explained.
The association screen 640-2 of FIG. 16 has a field 645 for setting the extension width of the area. The administrator can set how much the area information (OCR area) is to be expanded from the area specified by the marker pen in the area expansion width setting field 645 . As a result, the area information in Table 4 becomes wider than the area to which the color of the marker pen is attached. , the OCR processing unit 68 can perform OCR processing on the characters in the area.
However, it is not limited to this example. The administrator may set whether the area should include the part.
In addition, regarding the format in which the administrator designates the area, the color, pen type, shape, and the like may be received on the association screen 640-2. For example, the administrator can set to enclose in a square with a yellow marker, enclose in a circle with a red pen, or fill in with a green marker.

<Duplicate the app>
Since the form has various shapes, the location of the area where data is entered by the user also varies depending on the form. Therefore, in this embodiment, the administrator can register area information according to the shape of each form. As one method for registering area information for each form, a method for an administrator to duplicate an application will be described.

FIG. 17 shows a selection screen 650 of several apps. As an example, if there are a statement application, a payment slip application, and an OCR specified area application, the statement area information for the statement application, the payment slip area information for the payment slip application, and the application They are associated with each other in the data 43 . When the user wants to acquire data from the area of the statement, the data of the expected area can be output by activating the statement application and scanning the statement. When the user wants to acquire data from the area of the payment slip, the data of the expected area can be output by activating the payment slip application and scanning the payment slip.

The processing performed by each application is described in the application processing information 53, but the processing performed by the statement application and the payment slip application are components to be executed, although the file storage destination, upload destination folder, and setting file are different. are the same. Therefore, if the administrator duplicates the statement application or the payment slip application, the information The processing system 10 can create an application corresponding to any form.

Application duplication will be described with reference to FIG. FIG. 18 is an example of a screen operated by an administrator when duplicating an application. 18A shows an initial screen 630 displayed by the terminal device 30 when the administrator logs into the information processing system 10. FIG. An initial screen 630 displays a setting button 651 for the administrator to make various settings.

FIG. 18B shows an application management screen 652 displayed after the setting button 651 is pressed. A group name 653 in which several applications are grouped is displayed on the application management screen 652 . Note that the screen transition is an example for explanation, and the illustrated screens may be omitted or new screens may be added.

A list of applications belonging to this group is displayed on the right side of the group name 653 . The applications displayed in the application list are those for which the administrator has permission to use. Some apps are for administrators only, others are for other users. The administrator presses the setting button 654 of the application to be the copy source. By pressing the setting button 654, a menu is displayed and there is a copy button 655 in the menu.

When the administrator presses the duplicate button 655, a duplicate application setting screen (pop-up screen) 660 shown in FIG. 18(c) is displayed. The duplicate application setting screen 660 has an application name setting field 661 , an icon list field 662 , and a duplicate request button 663 . In the application name setting field 661, the administrator inputs an arbitrary application name for the new application created by duplication. The application name may be arbitrary, but duplicate application names are either eliminated, or branch numbers such as "~(2)" are added. It may be called an icon name or setting name in addition to the application name.

The icon list field 662 displays a list of icons. The administrator can select the desired icon. It is also possible to display another icon by pressing the reference button 664 . When the administrator presses the copy request button 663 , the application ID, application name, and icon of the copy source application are sent to the information processing system 10 . The information processing system 10 receives these, and the application management unit 49 uses the application processing information 53 and the screen information 54 of the original application to newly register the application. Among the application processing information 53, a unique application ID is assigned, and the application name input by the administrator is set as the application name. The screen information is the same as the original application, but the icon is selected by the administrator. The items of the application processing information, the shared application, and the external service system 40 are the same as those of the original application. For example, when a user can identify an application by an application name or the like, it is not necessary to set different icons for all applications.

In addition, in the present embodiment, a new image processing area setting is added along with the duplication of the application. The administrator may make a setting that associates addition with identification information for accepting selection by the device.

FIG. 19 is an example of a sequence diagram showing a procedure for the information processing system 10 to register a copy of an application.

S31: The administrator inputs the authentication information of the information processing system 10 to the terminal device 30. FIG. The operation reception unit 33 of the terminal device 30 receives the input of the authentication information, and the first communication unit 31 transmits the authentication information to the information processing system 10 , so that the administrator logs in to the information processing system 10 .

S<b>32 : Upon login, the terminal screen providing unit 42 of the information processing system 10 transmits the screen information of the initial screen to the terminal device 30 via the communication unit 19 . After that, the terminal screen providing unit 42 transmits the screen information of the screen shown in FIG.

S33: Since the administrator inputs the application name and the like into the terminal device 30, the operation reception unit 33 receives the input.

S<b>34 : The first communication unit 31 of the terminal device 30 transmits the application ID, application name, and icon of the original application to the information processing system 10 .

S35: The communication unit 19 of the information processing system 10 receives these, and the application management unit 49 uses the application processing information 53 and the screen information 54 of the original application to newly register the application.

In this way, administrators can duplicate apps. The administrator associates a new application generated by duplication with a setting file, and can acquire data from a predetermined area of a desired form.

The administrator can create a plurality of new applications from one copy source application, and the information processing system 10 can accept selection of different setting files for each of the plurality of new applications. Since it suffices to give some kind of identification information to the same processing flow, duplication of an application is an example, and identification information may be given to the same processing flow in the form of adding an icon or adding a setting.

<Acquiring data from a form using the correspondence between the application and the setting file>
After the application and the setting file are associated with each other, the information processing system 10 can acquire data from the form by causing the device 20 to read the form.

Acquisition of data from a form will be described with reference to FIGS. 20 and 21. FIG. FIG. 20 is a diagram showing a transition example of screens displayed by the device 20. As shown in FIG.

(1) As shown in FIG. 20(a), the user causes the device 20 to display an application list screen. For example, if the user wishes to report an expense, the user selects the expense report app icon. Although the user knows which form corresponds to which application, it is preferable that the application name displayed on the application icon 690 and the name of the form (original) match. This application name may be called an icon name or a setting name. That is, the icon 690 preferably includes the name of the form. Additionally, icon 690 may include a thumbnail of the form. This makes it easier to prevent the user from selecting an icon that does not correspond to the form. Alternatively, when the user presses icon 690, a thumbnail of the form may be displayed. The user can confirm the icon 690 by enlarging or partially displaying the thumbnail.

A link may also be embedded in the icon 690 . A link has, for example, a URL including an application ID, or a URL associated with the application ID on the information processing system side. By pressing the icon 690, the device 20 notifies the information processing system of the application ID by connecting to the URL.

Also, if the user selects a form that the icon 690 does not correspond to, the device 20 may warn the user. For example, the device 20 compares the image data of the read form with the image data associated with the icon 690, and if the two are different, displays a message asking whether to continue the process or not to inquire of the user. . The information processing system 10 may compare the image data. As a comparison method, for example, there is a method in which the device 20 or the information processing system 10 performs pattern matching on the image data of the form read by the image data associated with the icon 690 . Further, when an application ID is printed on a form as a barcode or the like, there is a method in which the device 20 or the information processing system 10 compares this application ID and the application ID associated with the icon 690 .

Alternatively, an icon may be selected by the user, and a character string such as an application ID or a setting number may be transmitted from the device 20 to the information processing system 10 . In other words, the item itself to be selected may not be the application ID (identification information).

(2) When the device 20 scans the expense report, the user prepares the expense report (FIG. 20(b)). The expense report may be handwritten by the user or printed out by the device 20 . It does not have to be printed out by the user himself (publicly issued documents, documents sent from other companies, etc.).

(3) Based on the screen information 54, the application selected by the user displays the screen of FIG. The screen of FIG. 20(c) is the same as that of FIG. The user sets the printed out expense report on the contact glass and presses the start button 613 to cause the device 20 to read it.

The image data of the form is transmitted to the information processing system 10, and the file is output by the process described below.

FIG. 21 is a diagram for explaining files saved in the external service system 40. As shown in FIG. FIG. 21(a) shows an example of an upload destination folder of the external service system 40. FIG. That is, the file output by the information processing system 10 is saved in the upload destination folder set by the administrator in FIG. The file hierarchy of "My Drive>expense statement storage" in FIG. 21(a) is an example, and the administrator can designate folders to which he has access rights.

FIG. 21(b) shows two files saved in the upload destination folder. A single read operation produces two files.
A. A CSV file 681 in which data acquired from the form area is saved.
B. A PDF file 682 containing image data of a form.

CSV files created by the same app will be different for each read operation. The file name includes the application date, so the file cannot be overwritten. On the other hand, data acquired by the same application may be added to the same CSV file even if the timing of the read operation is different. This method will be described later. In this way, a person in charge of general affairs can settle accounts for each employee's data only by accessing one CSV file.

<<When the device 20 does not scan the form>>
In the explanation of FIG. 20, the device 20 scans the expense report, but the information processing system 10 can receive the image data of the form from the terminal device 30 or the like and acquire the data from the image data area. In this case, the terminal device 30 transmits the image data of the form to the information processing system 10 as follows.

- The user displays the expense report on the word processor running on the terminal device 30 and inputs necessary items. Therefore, the required items are character codes. A user connects the terminal device 30 to the information processing system 10, logs in, and displays an application list. Since the screen of the terminal device 30 is similar to the screen of FIG. 20(a), the user selects the desired application. The terminal screen providing unit 42 of the information processing system 10 transmits to the terminal device 30 screen information on which the expense report can be received. When the user selects a PDF file or the like containing image data of the expense report on this screen, the terminal device 30 can transmit the PDF file to the information processing system 10 .

Therefore, the information processing system 10 can acquire data from the form without printing out the form. In this case, the processing of the device 20 in the processing of FIG. 22 to be described later is performed by the terminal device 30 .

<Operation procedure>
FIG. 22 is an example of a sequence diagram in which the information processing system 10 receives a PDF file containing image data of a form from the device 20 and acquires data from the area.

S41: The user who has printed out the form operates the device 20 and inputs his own authentication information in the information processing system 10. FIG. The operation reception unit 23 of the device 20 receives input of authentication information, and the second communication unit 21 transmits the authentication information to the information processing system 10 . Thereby, the user logs in to the information processing system 10 . Upon login, the display control unit 22 of the device 20 displays a list of applications for which the user is authorized to use (FIG. 20(a)). The user selects an application whose application name matches the name of the printed form, for example. The operation reception unit 23 receives selection.

S42: The second communication unit 21 of the device 20 specifies the application ID and transmits an application screen acquisition request to the information processing system 10 .

S<b>43 : The communication unit 19 of the information processing system 10 receives the application screen acquisition request, and the device screen providing unit 47 acquires the screen information 54 of the application specified by the application ID from the application management unit 49 . Screen information of the application screen of the application is transmitted to the device 20 . Thereby, the display control unit 22 of the device 20 displays the application screen (FIG. 20(c)).

S 44 : The user sets the printed form on the contact glass and presses the start button 613 . The operation reception unit 23 of the device 20 receives the depression, the image data generation unit 24 generates image data of the form, and converts this image data into a PDF file.

S45: The second communication unit 21 of the device 20 designates the application ID and PDF file of the application and requests the information processing system 10 to execute the application.

S46: The communication unit 19 of the information processing system 10 receives the application execution request, and the application execution unit 46 starts executing the application. The application execution unit 46 specifies the application ID and requests the input/output service unit 16 to execute the application. The input/output service unit 16 acquires application processing information 53 via the application management unit 49 . This gave us the processing flow of the app. Also, the input/output processing unit 48 acquires the application data 43 associated with the application ID from the application data storage unit 13 . As a result, the configuration file associated with the application can be identified.

Based on the application data 43 and the application processing information 53, the input/output processing unit 48 requests the external service processing unit 62 to acquire the setting file.

S47 : The external service processing unit 62 connects to the URL of the fileName item registered in the application data 43 and acquires the setting file from the external service system 40 . If the requested application is not a shared application, the external service processing unit 62 logs into the external service system 40 with the user's authentication information in the external service system 40. If the requested application is a shared application, the external service processing unit 62 logs into the external service system 40. The administrator logs in to the external service system 40 with the authentication information in the external service system 40 .

S48: Next, based on the application processing information 53, the input/output processing unit 48 requests the file output unit 66 to acquire the area information from the setting file.

S49: The file output unit 66 acquires all area information from predetermined rows and columns of the setting file, and returns it to the input/output processing unit 48 .

S50: Next, based on the application processing information 53, the input/output processing unit 48 designates image data and area information, and requests the area specifying unit 67 to acquire (cut) an area from the image data.

S51 : The area specifying unit 67 specifies and acquires the area specified by the area information from the image data, and returns the image of the area to the input/output processing unit 48 . Note that the area specifying unit 67 does not have to acquire (cut) the area from the image data. In this case, the OCR processing unit 68 may perform OCR processing on the area of the image data specified by the area information.

Steps S52 to S55 are repeated by the number of areas.

S52: Based on the application processing information 53, the input/output processing unit 48 designates the image of the area and requests the OCR processing unit 68 to perform OCR processing of the area. At this time, the input/output processing unit 48 may specify the format and OCR language obtained from the setting file in association with the area.

S53: The OCR processing unit 68 performs OCR processing on the area with a recognition engine compatible with the format and OCR language. The OCR processing unit 68 returns the data converted into character code (OCR processing result) to the input/output processing unit 48 .

The recognition engine is, for example, a classifier that learns the correspondence between character images and character codes using learning data that is a set, and outputs OCR processing results (character codes) from the images. The simpler the training data, such as only Japanese, only English, only numbers, or only dates, the more the recognition accuracy of the classifier improves. On the other hand, if learning data includes a mixture of Japanese, English, numerical values, and dates, various data can be recognized, but the accuracy of identification tends to decrease. Therefore, recognition accuracy can be improved by using a recognition engine compatible with the format and OCR language.

Here, machine learning is a technology that allows a computer to acquire human-like learning ability, in which the computer autonomously generates algorithms necessary for judgments such as data identification from learning data taken in advance. It is a technology that makes predictions by applying this to new data. The learning method for machine learning may be supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, or deep learning, or may be a learning method combining these learning methods. Any learning method for Also, the recognition engine does not have to be generated by the learning effect of machine learning.

S54: Next, based on the application processing information 53, the input/output processing unit 48 designates the data acquired from the area, the CSV column name, the CSV position, and the file name (obtained from the setting file), and outputs the file. A request is made to the unit 66 to output a file containing the data.

S55: The file output unit 66 writes the CSV column name to the head of the column, writes the data to the cell of the CSV file specified by the CSV position, and returns the OCR processing result (CSV file) to the input/output processing unit 48. A designated file name is given to the CSV file. The file format of the output destination is not limited to the CSV file, and may be a table format file, a text file, or a file of another application.

S56: Next, based on the application processing information 53, the input/output processing unit 48 designates the OCR processing result (CSV file), format and OCR language, and requests the OCR correction unit 69 to correct the OCR processing result. This format is taken from the configuration file shown in Table 4 and was set by the administrator.

FIG. 23 is a diagram for explaining correction of OCR processing results. If the format is set in the setting file, the OCR corrector 69 can correct the OCR processing result. Rules for specified character strings and conversion characters are defined in the OCR correction unit 69 as shown in FIG. A conversion rule 2201 in FIG. 23 is a rule when the format is NUMERIC. For example, since I, B, and Z are not included in numerical values, they are corrected to 1, 8, and 2, respectively. A conversion rule 2202 in FIG. 23 is a rule when the language is English. For example, English does not include 1, 2, and 8, so they are corrected to I, B, and Z, respectively.

S57: The OCR correction unit 69 returns the corrected OCR processing result (CSV file) to the input/output processing unit 48.

Steps S58 to S61 are executed by the number of CSV files. Regardless of the number of forms, the number of CSV files created by one read operation may be one or equal to the number of pages of the form. Which one is adopted is set in the application.

S58: Next, based on the application processing information 53, the input/output processing unit 48 requests the external service processing unit 62 to upload the OCR processing result (CSV file). The upload destination folder is set in the application data 43 .

S59: The external service processing unit 62 saves the CSV file in the upload destination folder of the external service system 40.

S60: If metadata can be set, step S60 is executed. If the external service system 40 supports the setting of metadata (items set by the user on the external service system, such as character strings and dates), the user can set the metadata linked to the CSV file to be uploaded. A user can input metadata from a screen displayed by the device 20 . The input/output processing unit 48 requests the external service processing unit 62 to upload metadata. The upload destination folder is the same as the CSV file.

S61: The external service processing unit 62 saves the metadata in the upload destination folder of the external service system 40. FIG.

S62: When multiple form data are read, the user may want to save them in individual files. In this case, based on the application processing information 53, the input/output processing unit 48 requests the PDF processing unit 64 to divide pages together with image data of multiple pages. This process may be omitted, in which case the input/output processing unit 48 may store a plurality of data as one file.

S63: The PDF processing unit 64 returns the PDF file decomposed page by page to the input/output processing unit 48 .

S64: Based on the application processing information 53, the input/output processing unit 48 designates a PDF file and requests the OCR processing unit 68 to perform OCR processing.

S65: The OCR processing unit 68 performs OCR processing on the PDF file, and sets the character code generated by the OCR processing in the PDF file as transparent text.

Steps S66 to S69 are executed by the number of PDF files.

S66: Based on the application processing information 53, the input/output processing unit 48 requests the external service processing unit 62 to upload the PDF file with text. The upload destination folder is set in the application data 43 .

S67: The external service processing unit 62 saves the PDF file with text in the upload destination folder of the external service system 40.

S68: If the external service system 40 supports the above metadata (items set by the user on the external service system, such as character strings, dates, etc.), the user can input the metadata from the screen displayed by the device 20. . The input/output processing unit 48 requests the external service processing unit 62 to upload metadata. The upload destination folder is the same as the PDF file.

S69: The external service processing unit 62 saves the metadata in the upload destination folder of the external service system 40. FIG.

As described above, the CSV file and the PDF file different from the CSV file are registered in the upload destination folder of the external service system 40 .

<Display of CSV and PDF files registered in the external service system>
When a person in charge of a company calculates an employee's expenses, etc., the terminal device 30 is operated to connect to the external service system 40 . Since the upload destination folder is notified to the person in charge, the terminal device 30 can acquire the CSV file and the PDF file.

FIG. 24 is an example of a file list screen 670 of the external service system 40 displayed by the terminal device 30. As shown in FIG. As shown in FIG. 24A, a PDF file 671 and a CSV file 672 are saved in the upload destination folder. FIG. 24(b) shows the contents of the CSV file 672 displayed by the terminal device 30. FIG. That is, FIG. 24(b) is the data output from the form. In FIG. 24(b), data obtained from two areas are stored. Each column also has a CSV column name set in the setting file, so that the user can determine what data each column is.

Moreover, as shown in FIG. 25, it is preferable that the device 20 also displays the processing result. FIG. 25 is an example of an output data display screen 691 displayed by the device 20. As shown in FIG. The output data display screen 691 displays an executed application name 692 and a list 693 of files output by the application. These are transmitted from the information processing system 10 to the device 20 . The CSV file includes the contents of the CSV file, and when the user presses the CSV file, the device 20 can display the data 694 acquired from the area of the form and saved in the CSV file.

A user who has checked the file name and data can determine whether the form has been processed correctly.

Although the image data to be processed is a PDF file in FIG. 22, image data in any format such as JPEG, PNG, TIFF, and BMP may be used.

<When multiple forms are read>
A case where a plurality of forms are read in one reading operation will be described with reference to FIG. FIG. 26 is a diagram showing a plurality of forms and output files. As shown in FIG. 26(a), multiple forms were read by one reading operation when the application was executed. One read operation means that the start button 613 is pressed only once. The device 20 sequentially reads a plurality of forms, and the information processing system 10 acquires a plurality of data from the same area of the image data of each form.

FIG. 26(b) is a diagram showing a CSV file when a plurality of forms are read in one reading operation. The first line is the data obtained from the first form, and the second line is the data obtained from the second form. In this way, a plurality of data of a plurality of forms are collected in one CSV file, so that the person in charge can easily tabulate and graph.

Note that when a plurality of forms are read in one reading operation, the file output unit 66 increments the CSV position (starting line) of the setting file by one. In other words, data should be written in the lower row for each form.

When a plurality of forms are read in one reading operation, the information processing system 10 can output CSV files as many as the number of forms.

Also, when a plurality of forms are read by a plurality of reading operations (reading at different timings), the information processing system 10 can output the data to one and the same CSV file. Sometimes the external service system 40 merges, and sometimes the information processing system 10 merges.

- When the external service system 40 merges, the external service processing unit 62 requests the external service system 40 to merge the CSV files. If the applications are the same, the file name of the CSV file contains the same character string (for example, expense report), so the external service processing unit 62 can specify the file name and request merging of the CSV files. The external service system 40 adds data of the same column number of the CSV file requested to be merged to the same column number of the already saved CSV file.

- When the information processing system merges, the external service processing unit 62 downloads the CSV file from the external service system 40 by designating the file name. The external service processing unit 62 adds data of the same column number of the newly created CSV file to the same column number of the acquired CSV file. The external service processing unit 62 uploads the merged CSV file to the external service system 40 .

In this way, the information processing system acquires the same area from a plurality of received image data, the OCR processing unit 68 performs OCR processing on the same area with the plurality of image data, and the file output unit 66 outputs a plurality of images. A plurality of data generated from the same area in image data can be output to one file.

<Main effects>
As described above, in the data output system of the present embodiment, the device 20 reads a form on which areas are marked, and stores area information for each form. Then, only the area is acquired from the image data of the form transmitted from the device, OCR processing is performed, and the data resulting from the OCR processing is output to a file. This makes it possible to easily create a file in which only specific areas are extracted from multiple forms of the same type.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using examples, the present invention is by no means limited to such examples, and various modifications can be made without departing from the scope of the present invention. and substitutions can be added.

For example, in the present embodiment, the data acquired from the area of the form is output to a file, but instead of being filed, the data may be sent by e-mail or displayed on the device 20 .

Also, in the present embodiment, OCR processing is performed on the designated area, but other image processing (mask processing, image extraction processing, etc.) may be performed.

Further, the configuration examples in FIG. 5 and the like are divided according to main functions in order to facilitate understanding of the processing by the terminal device 30, the device 20, and the information processing system 10. FIG. The present invention is not limited by the division method or name of the unit of processing. The processing of the terminal device 30, the device 20, and the information processing system 10 can also be divided into more processing units according to the content of the processing. Also, one processing unit can be divided to include more processing.

Moreover, the devices described in the examples are only representative of one of several computing environments for implementing the embodiments disclosed herein. In some embodiments, information handling system 10 includes multiple computing devices, such as a server cluster. Multiple computing devices are configured to communicate with each other over any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein.

Further, the information processing system 10 can be configured to share the processing steps disclosed in this embodiment, such as FIG. 22, in various combinations. For example, a process executed by a given unit may be executed by multiple information processing devices included in the information processing system 10 . Further, the information processing system 10 may be integrated into one server device, or may be divided into a plurality of devices.

Each function of the embodiments described above may be implemented by one or more processing circuits. Here, the "processing circuit" in this specification means a processor programmed by software to perform each function, such as a processor implemented by an electronic circuit, or a processor designed to perform each function described above. Devices such as ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array) and conventional circuit modules are included.

10 Information Processing System 20 Device 30 Terminal Device 100 Data Output System

JP 2017-212575 A

Claims (20)

A data output system in which a device and an information processing system can communicate,
a communication unit that receives image data from the device;
an area detection unit that detects an area where predetermined information is detected from the first image data;
a first output unit for outputting to a setting file information about the area where the predetermined information detected by the area detection unit is detected;
an area identifying unit that identifies an OCR area from the second image data based on information about the area where the predetermined information contained in the setting file is detected;
a second output unit that outputs data obtained by performing OCR processing on the OCR area based on the specified OCR area and the second image data ;
A data output system characterized by comprising: the second output unit outputs a file containing the data;
2. The data output system according to claim 1, further comprising an external service processing unit for storing said file in an external service system. 3. The data output system according to claim 1, wherein said second output unit outputs said data obtained only from said OCR area as a file separate from said second image data. an OCR processing unit that performs OCR processing only on the OCR area specified by the area specifying unit;
The area identifying unit identifies the same OCR area from a plurality of pieces of second image data received by the communication unit,
The OCR processing unit performs OCR processing on the same OCR area with the plurality of second image data,
3. The data output system according to claim 2, wherein the second output unit outputs a plurality of data generated from the same OCR area in the plurality of second image data to one file. When the communication unit receives the second image data at different timings from the device,
wherein the area identifying unit identifies the same OCR area from a plurality of pieces of second image data received by the communication unit at different timings;
The OCR processing unit performs OCR processing on the same OCR area with the plurality of second image data,
5. The data output system according to claim 4, wherein the second output unit outputs a plurality of data generated from the same OCR area in the plurality of second image data to a same file. 6. The method according to any one of claims 2 to 5, wherein the second output unit gives the file a file name using the data generated from the OCR area of the second image data. data output system. 5. The data output system according to claim 4, wherein said external service processing unit stores said setting file in an external service system. The data type is set for each OCR area in the setting file,
8. The data output system according to claim 7, wherein said OCR processing section performs OCR processing on said OCR area according to the type of said data. The data type is set for each OCR area in the setting file,
9. The data output system according to claim 7, further comprising an OCR correction section that corrects the data obtained by the OCR processing section according to the type of the data. the data output system in communication with a terminal device;
The terminal device
an application requested to be executed by the device; an operation reception unit that receives selection of the configuration file;
a second communication unit configured to transmit the identification information of the application received by the operation receiving unit and the identification information of the setting file to the information processing system;
Associate the configuration file with the application;
When the execution of the application is requested together with the second image data, the area specifying unit determines the area where the predetermined information contained in the setting file associated with the application is detected. 9. The data output system according to claim 7, wherein the OCR area is specified from the second image data. The operation accepting unit accepts designation of the data to be used for the file name of the file among the data output by the second output unit;
The second communication unit transmits the designation of the data used for the file name to the external service system,
The external service system is
11. The data output system according to claim 10, wherein designation of said data used for said file name is set in said setting file. The operation reception unit receives a selection of a copy source application and an application name of an application created by duplication,
The second communication unit transmits the identification information of the copy source application and the application name to the information processing system,
The information processing system is
creating a new application by duplicating the duplication source application and giving the application name;
11. The data output system according to claim 10, wherein said operation accepting unit accepts selection of said new application and said setting file. The operation receiving unit receives settings related to detection of an area in which the predetermined information is detected,
the area detection unit detects an area where the predetermined information is detected based on the setting;
The second output unit outputs information about the area where the predetermined information detected by the area detection unit is detected to a setting file,
11. The data output system according to claim 10, wherein the area identifying section identifies the OCR area based on an area where predetermined information is detected from the second image data. 14. The data output system according to any one of claims 1 to 13, wherein said device is an image processing device having a scanning function. 14. The data output system according to any one of claims 1 to 13, wherein the device is a personal computer or a smart phone. 2. The data output system according to claim 1, wherein said predetermined information is predetermined specific color information. 2. The data output system according to claim 1, wherein setting of a data type corresponding to each of areas in which one or more of said predetermined information is detected is received, and OCR processing is controlled according to said data type. An information processing system capable of communicating with a device,
a communication unit that receives image data from the device;
an area detection unit that detects an area where predetermined information is detected from the first image data;
a first output unit for outputting to a setting file information about the area where the predetermined information detected by the area detection unit is detected;
an area identifying unit that identifies an OCR area from the second image data based on information about the area where the predetermined information contained in the setting file is detected;
a second output unit that outputs data obtained by performing OCR processing on the OCR area based on the specified OCR area and the second image data ;
An information processing system characterized by having: A data output method performed by a data output system capable of communicating between a device and an information processing system,
a step in which a communication unit receives image data from the device;
an area detection unit detecting an area where predetermined information is detected from the first image data;
a step in which a first output unit outputs information about the area where the predetermined information detected by the area detection unit is detected to a setting file;
a step of an area identifying unit identifying an OCR area from the second image data based on information about the area where the predetermined information is detected, which is included in the setting file ;
a second output unit outputting data obtained by performing OCR processing on the OCR area based on the specified OCR area and the second image data ;
A data output method characterized by comprising: An information processing system that can communicate with devices,
a communication unit that receives image data from the device;
an area detection unit that detects an area where predetermined information is detected from the first image data;
a first output unit for outputting to a setting file information about the area where the predetermined information detected by the area detection unit is detected;
an area identifying unit that identifies an OCR area from the second image data based on information about the area where the predetermined information contained in the setting file is detected;
a second output unit that outputs data obtained by performing OCR processing on the OCR area based on the specified OCR area and the second image data ;
A program to function as

Images