JP6750483B2 - Image processing system, image processing method, image processing device, program - Google Patents

Description

The present invention relates to an image processing system, an image processing method, an image processing device and a program.

There are many cases where the user has to create application documents in daily life. For example, when a traveler is exempt from consumption tax on products purchased in Japan, a clerk or the like needs to prepare tax-exempt sales documents. Further, when a user takes out insurance, it is necessary to prepare application documents for joining. In addition, certain application documents may be required to purchase products or services such as mobile phones that require identification.

Creating such application documents often requires documents for confirming the user's identity. The user carries out work such as pasting a printed matter obtained by copying this document onto the application document, or filling the application document with a necessary portion after viewing the document.

It is considered to support the creation of such application documents by using a multifunction peripheral or the like (see, for example, Patent Document 1). Patent Document 1 discloses an identification card recognition apparatus that detects an image area of processing by image analysis, performs character recognition in the image area, and extracts an image of an identification card.

However, the conventional support method has a problem in that the number of user operations required to create an application document is large. A device having a printer function may be used to support the creation of application documents in terms of printing the application documents. However, since the multi-function peripheral supports a wide variety of application documents, the user needs to operate the multi-function peripheral to select the application document or the like he/she wants to create. Further, even if the application document can be selected, the necessary information varies depending on the application document, and therefore the user needs to perform a copy operation or the like according to the application document.

As described above, since the user needs to perform an appropriate operation for each application document, an operation error or a redone is likely to occur, which is inconvenient for the user.

The present invention has been made in view of the above problems, and an object thereof is to provide an image processing system that supports an operation related to document creation.

The present invention relates to an image data acquisition unit that acquires image data of an information medium that holds information used for creating a document, and a medium feature in which characteristic information of the information medium is registered in association with identification information of the information medium. A medium determining unit that compares the characteristic information of information with the characteristic information extracted from the image data to determine the information medium, and a process using the information medium in association with identification information of the information medium. A process determining unit that determines the process associated with the information medium identified by the medium determining unit by referring to the medium process information associated with the identification information, and the process determined by the process determining unit. There is provided an image processing system having a processing starting means for starting.

It is possible to provide an image processing system that supports operations related to document creation.

It is an example of a diagram illustrating a schematic operation of the image processing system. It is a block diagram of an example of an image processing system. It is a figure which shows an example of the hardware constitutions of a multifunctional device. It is an example of a hardware configuration diagram of an information processing terminal. It is an example of a functional block diagram showing the functions of an information processing terminal, an operation unit, and a main body in a block shape. It is an example of a sequence diagram showing an operation procedure until the image processing system starts an application. It is an example of an initial screen displayed by the information processing terminal. It is a figure which shows an example of a reading start screen. It is a figure which shows an example of a document candidate selection screen. It is an example of an application document edit screen. It is an example of a flowchart showing a procedure for the medium determination unit to determine the reading range. It is an example of a flow chart diagram showing a procedure in which the medium determination unit determines a candidate of the information medium. It is an example of a flowchart showing a process when the operation control unit of the operation unit operates according to the information medium. It is an example of a diagram for explaining the reading of the passport. It is an example of the figure which shows the MRZ area|region of a passport. It is a figure which shows an example of a driver's license. It is a figure which shows an example of my number card. It is an example of a sequence diagram showing an operation procedure until the image processing system starts an application. FIG. 1 is an example of a diagram illustrating an outline of an image processing system in which a mobile terminal images an information medium.

Hereinafter, an embodiment for carrying out the present invention will be described with reference to the drawings while exemplifying an image processing system 100 and an image processing method performed by the image processing system 100.

<Schematic operation>
FIG. 1 is an example of a diagram for explaining a schematic operation of the image processing system 100 according to the present embodiment. FIG. 1 illustrates a case where the user U creates tax-exempt sales documents as application documents. Therefore, the user prepares a passport as the information medium 9 described later.
(1) The user U makes the multi-function device 30 read a predetermined page of the passport.
(2) The multi-function device 30 analyzes the characteristics of the image data of the passport and determines that it is a passport.
(3) The multi-function device 30 transmits to the information processing terminal 50 that it is a passport.
(4) The information processing terminal 50 activates the application corresponding to the passport, and displays the information extracted from the image data or the image data itself in a predetermined item of the application document. The user prints the application documents by adding any necessary items.

In this way, the image processing system 100 of the present embodiment activates the application associated with the information medium 9 by causing the user to read the information medium 9 required for the application document, and thus the application document that the user intends to create. It is possible to reduce the need to select the application and the application required for creating the application document.

<About terms>
The information medium 9 is a medium that holds information necessary to create an output document. For example, when an administrative service or a private service requires identification of an individual, an identification card is equivalent. Further, in a private service such as purchase of a ticket, a certificate that the ticket has been purchased (for example, a reservation ticket) is equivalent. The information medium 9 is, for example, a passport, a driver's license, a my number card, or a resident registration card.

Documents to be output include administrative service and private service application documents, service purchase records, or cancellation records. In this embodiment, the term application document will be described as an example.

<Structure example>
The image processing system 100 will be described with reference to FIG. The configuration of the image processing system 100 will be described. The image processing system 100 includes an information processing terminal 50 and a multifunction machine 30. The information processing terminal 50 and the multi-function device 30 are communicably connected.

The multi-function device 30 is a device having a function of printing on a sheet such as plain paper (printer function), a function of reading a document (scanner function), a FAX transmission function, and a copy function. The multi-function device 30 is a device called an image processing device, an image forming device, a printer, or the like, but in this embodiment, it will be described as having a printer function and a scanner function. The printer function and the scanner function may be provided by different devices. The multifunction device 30 may also be called an MFP (Multi-Function Peripheral), a copying machine, a copying machine, or the like.

The information processing terminal 50 is an information processing device that mainly serves as a user interface. The information processing terminal 50 has a display 46 with a touch panel, displays a menu on the display 46, and accepts operations via the touch panel. The information processing terminal 50 also has a function of printing on photographic printing paper (paper coated with a photosensitive material). Further, the information processing terminal 50 has a photo takeout opening 41, a media slot 47, a coin insertion opening 48, a touch area 42, a receipt output opening 43, and a change ejection opening 44. Reference numeral 45 indicated by a dotted line is a wireless LAN access point.

When the image processing system 100 is installed in a convenience store or the like, the user puts a fee for using the service into the coin slot 48. However, whether or not to charge the service is arbitrary, and the function regarding charging may not be necessary.

The access point 45 is a communication device for the mobile terminal 60 held by the user and the information processing terminal 50 to communicate with each other. The user brings the mobile terminal 60 close to the touch area 42 of the information processing terminal 50. Accordingly, the mobile terminal 60 communicates with the wireless communication device 309 of the information processing terminal 50, which will be described later, and acquires communication information. The communication information includes the IP address, port number, encryption key, etc. of the access point 45 for communicating with the multifunction machine 30 via the access point 45. The wireless communication device 309 is a communication device compatible with IC tags and Bluetooth (registered trademark; hereinafter, omitted). The mobile terminal 60 can communicate with the information processing terminal 50 via the access point 45 by acquiring the communication information.

The communication between the information processing terminal 50 and the mobile terminal 60 is used when the file stored in the mobile terminal 60 is printed by the multifunction machine 30. The mobile terminal 60 has a function as an information processing device and stores a printable file. Alternatively, the mobile terminal 60 has a function of causing the multi-function device 30 to print the file stored in the document server on the cloud (also has the function of downloading the file stored in the document server). However, in the present embodiment, since it is sufficient that the multifunction peripheral can print the application document by reading the information medium 9, such a communication function is not necessary.

The mobile terminal 60 is an information processing device carried by a user. Specifically, it includes a smartphone, a mobile phone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a digital camera, a wearable PC (Personal Computer), a notebook PC, and the like.

The information processing terminal 50 and the multi-function device 30 do not have to be separate devices, and may operate as one device. As shown in the figure, the devices are configured as separate devices because the existing multifunction peripheral 30 can be diverted.

<System configuration>
FIG. 2 is a configuration diagram of an example of the image processing system 100 according to the present embodiment. The image processing system 100 includes a mobile terminal 60, a multifunction machine 30, an information processing terminal 50, and an external server 80. The mobile terminal 60 and the external server 80 may be omitted.

The mobile terminal 60 and the information processing terminal 50 are configured to be communicable via a wired or wireless network N1. "Communicable" means having a communication function. In this embodiment, communication using the network N1 is not performed, and thus detailed description will be omitted.

The information processing terminal 50 and the multi-function device 30 communicate by wire or wirelessly. The information processing terminal 50 and the multi-function device 30 may be connected by a USB cable, a LAN cable, or the like, or may communicate wirelessly via an access point. The information processing terminal 50 controls the application document creation process. Therefore, the multi-function device 30 receives the image data created by the scan job and the information extracted from the image data.

Further, the information processing terminal 50 communicates with the external server 80 via the network N2. The network N2 is, for example, the LAN of the facility where the image processing system 100 is installed or the Internet. The external server 80 is an information processing device that mainly manages a database. The database is, for example, one that associates the characteristics of the information medium 9 with the information medium 9, or one that associates the information medium 9 with a process (application). The external server 80 may instead provide the processing performed by the multi-function device 30 and the information processing terminal 50.

<Hardware configuration>
FIG. 3 is a diagram illustrating an example of the hardware configuration of the multifunction machine 30. As shown in FIG. 3, the multi-function device 30 includes a main body 10 and an operation unit 20. The main body 10 and the operation unit 20 are communicably connected to each other via a dedicated communication path 300. The communication path 300 may be, for example, a USB (Universal Serial Bus) standard, but may be an arbitrary standard regardless of whether it is wired or wireless.

The main body 10 can perform an operation according to the operation received by the operation unit 20. The main body 10 can also communicate with an external device such as a client PC (personal computer), and can also perform an operation according to an instruction received from the external device.

Next, the hardware configuration of the main body 10 will be described. As shown in FIG. 3, the main body 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an HDD (Hard Disk Drive) 14, and a communication I/O. An F (Interface) 15, a connection I/F 16, and an engine unit 17 are provided, and these are interconnected via a system bus 18. For convenience of explanation, in FIG. 3, the main body 10 has been described by taking the configuration having the HDD 14 as an example. However, for example, there may be a configuration that does not have the HDD 14 and cannot secure a sufficient storage area.

The CPU 11 centrally controls the operation of the main body 10. The CPU 11 controls the overall operation of the main body 10 by executing a program stored in the ROM 12 or the HDD 14 using the RAM 13 as a work area (work area), and performs the above-mentioned copy function, scanner function, fax function, printer function, etc. To realize various functions of.

The communication I/F 15 is an interface for connecting to the network 8. The connection I/F 16 is an interface for communicating with the operation unit 20 via the communication path 300.

The engine unit 17 is hardware for performing processing other than general-purpose information processing and communication for realizing a copy function, a scanner function, a fax function, and a printer function. For example, a scanner (image reading unit) that scans and reads an image of a document, a plotter (image forming unit) that prints on a sheet material such as paper, and a fax unit that performs fax communication are provided. Further, a specific option such as a finisher for sorting printed sheet materials or an ADF (automatic document feeder) for automatically feeding a document can be provided.

Next, the hardware configuration of the operation unit 20 will be described. As shown in FIG. 3, the operation unit 20 includes a CPU 21, a ROM 22, a RAM 23, a flash memory 24, a communication I/F 25, a connection I/F 26, and an operation panel 27 which is a display device and an input device. These are connected to each other via a system bus 28. For convenience of description, in FIG. 3, the operation unit 20 has been described by taking the configuration having the flash memory 24 as an example, but the operation unit 20 may have a configuration not having the flash memory 24, for example. In short, the multi-function device 30 may have a configuration that does not have a storage device for storing the received content.

<<Hardware Configuration of Information Processing Terminal 50>>
FIG. 4 shows an example of a hardware configuration diagram of the information processing terminal 50. The information processing terminal 50 has a configuration unique to the information processing terminal 50, in addition to the same configuration as an information processing device such as a general PC or a server.

The information processing terminal 50 is connected to the CPU 301, the RAM 302, the ROM 303, the display 46, the touch panel 305, the network I/F 306, the HDD 307, the external I/F 308, the wireless communication device 309, and the I/F 310 via the bus. A media I/F 311, a photo transport unit 312, a photo printing unit 313, a receipt printing device 314, and a billing device 315 are connected to the I/F 310.

The CPU 301 is an arithmetic means and executes the program 307p loaded from the HDD 307 to the RAM 302 to control the functions shown in FIG. 4 to control the operation of the entire photo printing apparatus. The RAM 302 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 301 processes information.

The ROM 303 is a read-only non-volatile storage medium, and stores programs such as firmware and BIOS settings. The HDD is a non-volatile storage medium capable of reading and writing information, and stores an OS, a program for a photo printing device, and the like.

The external I/F 308 is an interface to which an external device or a storage medium is connected, for example, a USB cable or the like is connected. In this embodiment, it is assumed that the multi-function device 30 is connected to the external I/F 308.

The wireless communication device 309 is a reader/writer that supports a communication standard such as NFC. Alternatively, a communication device such as Bluetooth may be used. When the wireless communication device 309 detects the approach of (the short-range wireless communication device of) the mobile terminal 60, the wireless communication device 309 communicates with the mobile terminal 60 and transmits communication information to the mobile terminal 60. The wireless communication device 309 is arranged and configured at a predetermined position inside the housing of the information processing terminal 50, but may be arranged outside the information processing terminal 50. The communication information provided by the wireless communication device 309 can be rewritten by the administrator using a reader/writer or the like.

The wireless communication device 309 does not have to be integrated with the information processing terminal 50, and may be disposed near the information processing terminal 50, a device different from the information processing terminal 50, or a guide plate. Further, the multi-function device 30 may include the wireless communication device 309.

The I/F 310 adjusts the difference in operating clock between the media I/F 311, the photo transport unit 312, the photo printing unit 313, the receipt printing device 314, the billing device 315, and the bus B, and the media I/F 311 and the photo transport. The communication from the unit 312, the photo printing unit 313, the receipt printing device 314, and the billing device 315 to the bus B or vice versa is controlled. The I/F 310 arbitrates communication from the media I/F 311, the photo transport unit 312, the photo printing unit 313, the receipt printing device 314, and the billing device 315.

The media I/F 311 is an interface to which a storage medium such as a USB memory or SD memory is connected. In this embodiment, a file can be read from a storage medium connected to the media I/F 311 and printed.

The photo transport unit 312 is a mechanism for the user to take out the printed photo, and corresponds to the paper transport mechanism, the photo takeout opening 41, or the like. The photo printing unit 313 is a device for printing a photo on photographic paper, and has a laser light source, an exposure device, a developing device, and the like. The receipt printing device 314 is, for example, a thermal transfer printing device, and prints the number of printed sheets, unit price, total amount, etc. as a receipt by using the image processing system 100.

The billing device 315 calculates the amount of money to be injected by determining the type and number of money of curing that has been input, and subtracts the unit price from the amount of input according to the progress of the scan job and the print job. The balance is notified to the CPU 301, and the CPU 301 determines whether to continue the scan job and the print job. When the user performs a refund operation, the balance is refunded from the change withdrawal port 44.

<Functional blocks of the image processing system 100>
FIG. 5 is an example of a functional block diagram showing the functions of the information processing terminal 50, the operation unit 20, and the main body 10 in block form.

<<Information processing terminal 50>>
The information processing terminal 50 includes a terminal communication unit 51, a document creation control unit 52, an operation reception unit 53, a display control unit 54, and an application activation unit 55. Each of these functional units included in the information processing terminal 50 is realized by any one of the components illustrated in FIG. 4 being operated by an instruction from the CPU 301 according to the program 307p expanded from the HDD 307 to the RAM 302. Function or means. The program 307p is distributed from a server for distributing the program or distributed while being stored in a storage medium.

Further, the information processing terminal 50 has a storage unit 59 implemented in at least one of the HDD 307 and the RAM 302 in FIG. An application DB 5001 is built in the storage unit 59. First, the application DB 5001 will be described.

表１は、アプリＤＢ５００１に記憶されている情報をテーブル状に示す。アプリＤＢ５００１には情報媒体９と処理が対応付けて登録されている（媒体処理情報の一例）。処理とは、申請書類を作成する処理である。本実施形態では説明の便宜上、処理はアプリケーションと１対１に対応付けられているとして説明する。１つのアプリケーションが複数の処理に対応することも可能である。アプリケーションには、例えば、免税アプリ、保険アプリ、住民票アプリ及びチケットアプリがある。免税アプリは、免税販売書類の作成処理に使用され、保険アプリは保険の申請書類の作成処理に使用され、住民票アプリは住民票の印刷に使用される。なお、住民票アプリは住民票の他に住民票記載事項証明書、印鑑登録証明書、戸籍証明書、戸籍附票、税の証明書等の印刷を実行できてもよい。また、住民票アプリは行政サービスアプリと称されていてもよい。

Table 1 shows information stored in the application DB 5001 in the form of a table. The information medium 9 and the process are associated and registered in the application DB 5001 (an example of the medium process information). The process is a process of creating an application document. In the present embodiment, for convenience of description, it is assumed that the processing is associated with the application on a one-to-one basis. It is also possible for one application to support multiple processes. Examples of applications include tax exemption applications, insurance applications, resident card applications, and ticket applications. The tax exemption application is used to create tax-exempt sales documents, the insurance app is used to create insurance application documents, and the resident card application is used to print a resident card. In addition to the resident card, the resident card application may be capable of printing a resident card entry certificate, a seal registration certificate, a family register certificate, a family register tag, a tax certificate, and the like. Also, the resident card application may be referred to as an administrative service application.

A unique application ID is assigned to each application. The application ID is information for identifying the application. ID is an abbreviation of Identification and means an identifier or identification information. The ID refers to a name, a code, a character string, a numerical value, or a combination of one or more of these, which is used to uniquely distinguish a specific object from a plurality of objects.

The information medium ID is information for identifying the type of the information medium 9. The ID is the same as the application ID.

Since the application and the information medium 9 are associated with each other in the application DB 5001 in this way, when the information medium 9 is identified, the application is identified.

(Function of the information processing terminal 50)
The terminal communication unit 51 is realized by the CPU 301 shown in FIG. 4 executing the program 307p to control the external I/F 308, and the like, and transmits and receives various information to and from the image processing system 100. The terminal communication unit 51 and the external communication unit 63 of the main body 10 communicate by HTTPs, HTTP, or the like.

The document creation control unit 52 is realized by the CPU 301 shown in FIG. 4 executing the program 307p or the like, and performs overall control of application documents created by the user.

The operation accepting unit 53 is realized by the CPU 301 shown in FIG. 4 executing the program 307p to control the touch panel 305, and accepts user operations and inputs.

The display control unit 54 is realized by the CPU 301 shown in FIG. 4 executing the program 307p to control the display 46, and displays a screen serving as a user interface on the display 46.

The application activation unit 55 is realized by the CPU 301 shown in FIG. 4 executing the program 307p or the like, and activates the application 56 instructed by the document creation control unit 52. The application activation unit 55 activates the application designated by the document creation control unit 52 among the applications 56 of the applications 1 to n. Applications 1 to n correspond to tax exemption applications, insurance applications, resident card applications, and the like.

<<Main body 10>>
The main body 10 has an external communication unit 63, a main body communication unit 61, a document reading unit 62, and a printing unit 64. Each of these functional units included in the main body 10 is a function or means realized by any of the constituent elements shown in FIG. 3 being operated by an instruction from the CPU 11 according to a program expanded from the HDD 14 to the RAM 13. Is. This program is distributed from a program distribution server or distributed while being stored in a storage medium.

The external communication unit 63 is realized by the CPU 11 shown in FIG. 3 executing a program to control the communication I/F 15 and the like, and transmits and receives various information to and from the information processing terminal 50. The main body 10 operates as a Web server for the information processing terminal 50, and the terminal communication unit 51 communicates with the main body 10 using the Web API (Application Programming Interface) of the main body 10 as an interface. The WebAPI is a pre-defined interface provided for receiving a request (request), and is composed of, for example, a function and a class. In this way, the external communication unit 63 becomes a platform for the application of the information processing terminal 50. Platform is a generic term for the foundation of PC applications and peripherals.

The main body communication unit 61 is realized by the CPU 11 shown in FIG. 3 executing a program to control the connection I/F 16 and the like, and transmits and receives various information to and from the operation unit 20.

The document reading unit 62 is realized by the CPU 11 shown in FIG. 3 executing a program to control the engine unit 17 or the like, and reads (scans) the information medium 9 to generate image data.

The printing unit 64 is realized by the CPU 11 shown in FIG. 3 executing a program to control the engine unit 17, etc., and prints the image data of the application document on a sheet.

<< Operation part 20 >>
The operation unit 20 includes an operation unit communication unit 71, an OCR unit 72, an operation reception unit 73, a medium determination unit 74, a screen creation unit 75, and an operation control unit 76. Each of these functional units included in the main body 10 is a function realized by any of the components shown in FIG. 3 being operated by an instruction from the CPU 21 according to a program expanded from the flash memory 24 to the RAM 23. Or means. This program is distributed from a program distribution server or distributed while being stored in a storage medium.

Further, the information processing terminal 50 has a storage unit 79 realized in at least one of the flash memory 24 and the RAM 23 of FIG. A medium feature DB 7001 is built in the storage unit 79. First, the medium feature DB 7001 will be described.

表２は、媒体特徴ＤＢ７００１に登録されている情報をテーブル状に示す。媒体特徴ＤＢ７００１は、情報媒体ＩＤに対応付けて情報媒体９と特徴情報の各項目を有する（媒体特徴情報の一例）。情報媒体ＩＤは表１と同じものである。特徴情報は情報媒体９を特徴付ける情報であり、本実施形態では画像処理システム１００が情報媒体９を特定するために使用される。特徴情報は、情報媒体９のサイズ、色、及びバーコード（２次元バーコードを含む）などである。

Table 2 shows the information registered in the medium feature DB 7001 in a table form. The medium characteristic DB 7001 has items of the information medium 9 and characteristic information in association with the information medium ID (an example of medium characteristic information). The information medium ID is the same as in Table 1. The characteristic information is information that characterizes the information medium 9, and is used by the image processing system 100 to specify the information medium 9 in this embodiment. The characteristic information includes the size of the information medium 9, the color, the barcode (including a two-dimensional barcode), and the like.

For example, the size of the passport is 182 mm in length and 128 mm in width, and the characteristic color is not determined (assuming that the cover is red or dark blue but the surface to be read has no characteristic color). No barcode is printed on the reading surface of the passport. Similar information is registered for driver's licenses, My Number cards, and Juki cards. The driver's license, my number card, and Juki card are almost the same size, but the driver's license does not have a bar code, while the Juki card (front surface) has a bar code. Therefore, it can be discriminated by the presence or absence of the barcode and the information stored in the barcode. Both my number card (front) and driver's license do not have a bar code. However, while the driver's license (front surface) contains blue or gold, the front and back of the My Number Card do not contain blue or gold. In this way, the image processing system 100 can identify the information medium 9 by using the feature information.

(About the function of the operation unit 20)
The operation unit communication unit 71 is realized by the CPU 21 shown in FIG. 3 executing a program and controlling the connection I/F 26, and transmits and receives various information to and from the main body 10.

The screen creating unit 75 is realized by the CPU 21 shown in FIG. 3 executing a program to control the operation panel 27, and displays various screens serving as a user interface on the operation panel 27.

The medium determination unit 74 is realized by the CPU 21 shown in FIG. 3 executing a program or the like, and determines the information medium 9 by comparing the characteristic of the image data created by the main body 10 with the characteristic information of the medium characteristic DB 7001. ..

The OCR unit 72 is realized by the CPU 21 shown in FIG. 3 executing a program or the like, and performs character recognition processing on the image data created by the main body 10 to acquire text data.

The operation receiving unit 73 is realized by the CPU 21 shown in FIG. 3 executing a program to control the operation panel 27, and receives various operations by the user.

<Overall operating procedure>
FIG. 6 is an example of a sequence diagram showing an operation procedure until the image processing system 100 starts an application. The process of FIG. 6 is started by the user operating the image processing system 100, for example.

S1: The user operates the information processing terminal 50 to perform an operation for starting processing. This operation is an operation for the multifunction device 30 to start an application suitable for the information medium 9 without the user selecting the information medium 9 or the application. The specific operation performed by the user to start the process depends on what initial screen the information processing terminal 50 is displaying, but for example, a predetermined button is pressed. An example of the initial screen is shown in FIG.

S2: The operation reception unit 53 of the information processing terminal 50 receives the operation, and the terminal communication unit 51 transmits the read preparation command to the main body 10. The reading preparation command is a command for requesting the multifunction device 30 to prepare for reading (scanning) a document. Without this read preparation command, the multi-function device 30 will not operate even if the user performs an operation for reading the multi-function device 30.

S3: The external communication unit 63 of the main body 10 receives the read preparation command. When the external communication unit 63 determines that it is a read preparation command, it notifies the document reading unit 62 of read permission. Further, the main body communication unit 61 of the main body 10 transmits a read preparation command to the operation unit 20.

S4: The operation unit communication unit 71 of the operation unit 20 receives the read preparation command. As a result, the screen creation unit 75 of the operation unit 20 displays the reading start screen on the operation panel 27. The reading start screen is a screen for the user to start reading the information medium 9. An example is shown in FIG.

S5: The user looks at the operation panel 27 and places the information medium 9 on the contact glass.

S6: When placed on the contact glass, the user presses the "read start" button 613.

S7: The operation receiving unit 73 of the operation unit 20 receives the pressing of the “read start” button 613. Next, the medium determination unit 74 determines the reading range of the information medium 9. This is because the size of the information medium 9 is not constant. Details will be described with reference to FIG. The reading range may be omitted and a certain range (for example, A4) larger than the size of the information medium 9 may be set as the reading range.

S8: The operation unit communication unit 71 of the operation unit 20 transmits a reading request to the main body 10 together with the reading range.

S9: The main body communication unit 61 of the main body 10 receives the read request and sends it to the document reading unit 62. As a result, the document reading unit 62 reads the information medium 9 within the reading range.

S10: The main body communication unit 61 of the main body 10 transmits the image data of the information medium 9 to the operation unit 20.

S11: The operation unit communication unit 71 of the operation unit 20 receives the image data, and the medium determination unit 74 analyzes the image data and determines a candidate for the information medium 9. Details will be described with reference to FIG.

S12: The screen creation unit 75 of the operation unit 20 displays the document candidate selection screen having the determined candidates for the information medium 9 on the operation panel 27. This allows the user to select the application documents he/she wants to create. An example of the document candidate selection screen is shown in FIG.

S13: The user selects the application document he/she needs from one or more application documents. Then, the execution operation for starting the application is performed. The operation receiving unit 73 of the operation unit 20 receives a user operation.

S14: As a result, the main body 10 and the operation unit 20 operate according to the information medium 9. Details will be described with reference to FIG.

S15: When the operation according to the information medium 9 ends, the operation unit communication unit 71 of the operation unit 20 transmits an application activation request to the main body 10 together with the processing result. This processing result includes at least information that identifies the application.

S16: The main body communication unit 61 of the main body 10 receives the application activation request, and the external communication unit 63 transmits the application activation request to the information processing terminal 50.

S17: The terminal communication unit 51 of the information processing terminal 50 receives the application activation request, and the document creation control unit 52 causes the application activation unit 55 to activate the application.

S18: The application started on the information processing terminal 50 displays the application document edit screen 640 suitable for creating the application document on the display 46. An example of the application document edit screen 640 is shown in FIG. That is, the activated application takes in the information read from the information medium 9 and creates a document.

S19: This allows the user to complete the application documents by entering the required items on the screen. In some cases, the user does not need to input the item.

S20: The user performs printing operation according to the instruction of the application.

S21: The terminal communication unit 51 of the information processing terminal 50 creates image data of the application document by the printer driver and sends it to the main body 10 as a print job.

S22: The external communication unit 63 of the main body 10 receives the print job (print request), and the printing unit 64 prints the application document.

<Screen example>
FIG. 7 is an example of an initial screen 601 displayed by the information processing terminal 50. The initial screen 601 includes a “black and white simple copy” button 602, a “various copy” button 603, a “print” button 604, a “fax” button 605, a “scan” button 606, an “administrative service” button 607, and an “automatic selection”. A "service" button 608 is displayed selectably. The "black and white simple copy" button 602 is a button for copying in black and white on plain paper. The "various copy" button 603 is a button for copying in black and white or color on plain paper. The “print” button 604 is a button for printing a file from a storage medium or a file of the mobile terminal 60. A “fax” button 605 is a button for sending a fax, and a “scan” button 606 is a button for scanning a document and obtaining image data. The “administrative service” button 607 is a button for printing a copy of the resident's card or a seal stamp certificate. The “automatic service” button 608 is a button for activating an application suitable for the information medium 9, and in the present embodiment, the “automatic service” button 608 is selected.

FIG. 8 is a diagram showing an example of the reading start screen 611. The reading start screen 611 has a message 612 “Place an information medium on the platen”, a “reading start” button 613, and a cancel button 614. The user is guided by the message 612 to place the information medium 9 on the document table (contact glass). At this time, it is preferable that the reading start screen 611 guides the direction of the information medium 9. The “read start” button 613 is a button for the multifunction device 30 to start reading, and the cancel button 614 is a button for notifying the information processing terminal 50 of interruption of processing. As a result, the information processing terminal 50 returns to the initial screen 601.

FIG. 9 is a diagram showing an example of the document candidate selection screen 621, FIG. 9A shows the document candidate selection screen 621 when the information medium 9 is narrowed down to one, and FIG. 9B shows the information medium. 9 shows a document candidate selection screen 621 when 9 is not narrowed down to one.

In FIG. 9A, a message 622 “Do you want to create tax-exempt sales documents?”, a Yes button 623, and a No button 624 are provided. The user looks at the message 622 to determine whether or not the application document is created by himself, and presses the Yes button 623 or the No button 624. The Yes button 623 starts an operation corresponding to the information medium 9, and the No button 624 displays a screen for the user to select whether to read again or return to the initial screen 601.

In FIG. 9B, a “insurance application document” button 625, a “print resident card” button 626, an execute button 627, and a cancel button 628 are provided. The user presses the button of the application document he/she desires. The operation reception unit 73 of the operation unit 20 receives the selection, and the screen creation unit 75 sets the “insurance application document” button 625 or the “print resident's card” button 626 to the selected state. Then, when the user presses the execute button 627 or the cancel button 628, the operation receiving unit 73 receives the operation. An execution button 627 starts an operation according to the information medium 9, and a cancel button 628 displays a screen for the user to select whether to read again or return to the initial screen 601.

10A to 10C are examples of the application document edit screen 640. The reason why it is divided into three parts is that all the input items cannot be displayed at one time on the operation panel 27 of the multi-function device 30. Actually, the application document edit screen 640 is not switched, but the user or the like scrolls to display each item. Further, if the operation panel 27 has a sufficient size, scrolling becomes unnecessary. Further, the application document edit screen 640 may be divided into two or more, and the user etc. may display all the application document edit screens 640 while switching the screens. The application document edit screen 640 may be switched for each input item.

The application document edit screen 640 of FIGS. 10A to 10C is created by the tax exemption application and is displayed by the display control unit 54. The application document edit screen 640 mainly has an item column 641, a return button 642, an OK button 643, and a message column 644.

In each item column 641, the passport number (Passport No.), nationality (Nationality), name (Name), and date of birth (Date of birth) are acquired from the MRZ area described later. On the other hand, Credentials, Date of landing, Date of Purchase, Total amount (General), Consumables (Total amount ( Supplies)) needs to be input by the user or the like. When the user or the like presses (touches) an item in each item column 641, a screen for editing or inputting an input item is displayed.

The return button 642 is a button for returning to the previous screen. For example, it is pressed to read the passport again. The OK button 643 is a button for the user or the like to print tax-exempt sales documents.

The message column 644 displays the character recognition result and a message prompting the next operation. The character recognition result includes success or error. In case of success, a message such as "Please take out your passport and edit/enter each item." is displayed. If there is an error, "There may be an error in the character recognition result. The icon is displayed on the right side of the item column for the corresponding item, and the item column is blank. Items with icons are printed and handwritten after printing. Please enter the correct information. Please edit or enter the item without the icon." is displayed.

<Determination of reading range>
FIG. 11 is an example of a flowchart showing a procedure for the medium determination unit 74 to determine the reading range.

The medium determination unit 74 reads the characteristic information from the medium characteristic DB 7001 (S10). Information about the size is acquired from the characteristic information.

Next, the medium determination unit 74 determines the largest maximum size among the vertical sizes of all the information media 9 (S20).

Next, the medium determination unit 74 determines the largest maximum size of the horizontal sizes of all the information media 9 (S30).

Next, the medium determination unit 74 determines the maximum vertical size as the reading range in the main scanning direction (S40). Since the main scanning direction is line data for one line, it is not necessary to determine the reading range, but by determining the reading range in the main scanning direction, the multi-function device 30 can trim the main scanning direction.

Next, the medium determination unit 74 determines the horizontal maximum size as the reading range in the sub-scanning direction (S50). By determining the reading range in the sub-scanning direction, the reading unit (carriage equipped with the light source) of the multi-function device 30 moves only in this reading range in the sub-scanning direction, and thus the time required for reading can be reduced.

Since the user does not always arrange the information medium 9 in the correct direction, the larger one of the maximum vertical size and the maximum horizontal size may be determined as the maximum vertical and horizontal sizes. That is, the maximum vertical and horizontal sizes are the same.

<Determination of information medium 9 candidate>
FIG. 12 is an example of a flowchart showing a procedure in which the medium determination unit 74 determines a candidate for the information medium 9. The medium determination unit 74 determines the information medium 9 by comparing the characteristic information extracted from the image data of the information medium 9 with the characteristic information of the medium characteristic DB 7001.

First, the medium determination unit 74 extracts a region other than continuous black pixels from the image data (S10). The operation unit 20 displays on the operation panel 27 so that the information medium 9 can be read without closing the contact glass cover. Thus, the user does not close the cover of the contact glass when reading the information medium 9. As a result, only the part of the information medium 9 is imaged, and the other parts are almost black pixel image data. Therefore, areas other than continuous black pixels can be acquired as image data of the information medium 9.

Next, the medium determination unit 74 converts the number of pixels in the main scanning direction into length (S20). Since the resolution (dpi) of the multi-function device 30 in the main scanning direction is known, the length in the main scanning direction of the information medium 9 is calculated by multiplying the unit length of the pixel by the number of pixels.

Next, the medium determination unit 74 converts the number of pixels in the sub-scanning direction into length (S30). Since the resolution (dpi) in the sub-scanning direction is known, the length in the sub-scanning direction of the information medium 9 is calculated by multiplying the unit length of the pixel by the number of pixels.

Next, the medium determination unit 74 refers to the characteristic information of the medium characteristic DB 7001 and determines whether or not there is an information medium 9 in the medium characteristic DB 7001 whose size is within a predetermined difference from the size extracted from the image data ( S40). That is, the information medium 9 having the vertical size included in the vertical length±error and the information medium 9 having the horizontal size included in the horizontal length±error are specified from the medium feature DB 7001.

If the determination in step S40 is No, the information medium 9 cannot be specified, and the process of FIG. 12 ends.

If the determination in step S40 is Yes, the medium determination unit 74 determines whether or not the number has been narrowed down to one (S50).

When the size is limited to one information medium 9, this information medium 9 becomes a candidate (S120).

If the determination in step S50 is No, the number of information media 9 is not limited to one, so the medium determination unit 74 acquires color information from the image data (S60). As the color information, for example, a color histogram is created. From the color histogram, it is possible to determine whether or not the characteristic color registered in the characteristic information is included in a predetermined amount or more.

The medium determination unit 74 determines whether or not there is an information medium 9 having a matching color (S70). If the color registered in the characteristic information can be detected from the histogram, step S70 is determined as Yes.

When the determination in step S70 is Yes, the medium determination unit 74 determines whether or not the number has been narrowed down to one (S80).

If the color information is narrowed down to one information medium 9, this information medium 9 becomes a candidate (S120).

When the determination in step S80 is No, the information medium 9 decodes the barcode (S90). If there is no barcode, do nothing. When the barcode is decoded and a 12-digit number is obtained, it is a My Number card. If you can obtain a 14-digit (with photo) or 8-digit (without photo) number, it is a Juki card. The Juki card stores a collation number for reading the IC chip, with a photo the "expiration date (AD) + date of birth (Japanese calendar)", and without a photo only the expiration date.

The medium determining unit 74 determines whether or not the number of information mediums 9 is reduced to one (S100). If only one information medium 9 is selected, this information medium 9 becomes a candidate (S120).

When it is not possible to narrow down to one information medium 9, the medium determination unit 74 determines a plurality of information mediums 9 as candidates (S110).

In this way, the candidate of the information medium 9 can be determined from the size, color and barcode information of the information medium 9.

<Operation according to information medium 9>
When the information medium 9 is specified, the multifunction machine 30 operates according to the information medium 9. This is because the information acquired from the information medium 9 varies depending on the application documents. Therefore, the operation control unit 76 switches the control related to the reading of the image data according to the information medium 9.

FIG. 13 is an example of a flowchart showing a process when the operation control unit 76 of the operation unit 20 operates according to the information medium 9.

First, the operation control unit 76 determines what the information medium 9 is (S10). Since the user has finally selected the type of the information medium 9 on the document candidate selection screen, the type of the information medium 9 selected by the user is used. When the medium determination unit 74 narrows down the number of information mediums 9 to one, the determination result of the medium determination unit 74 may be used.

In the case of passport First, the operation control unit 76 instructs the direction of the passport (S20). Since the multi-function device 30 has already acquired the passport image data, it is possible to detect the orientation of the passport on the platen from the length and width. For example, when the longitudinal direction of the passport is in contact with the main scanning direction as shown in FIG. 14A, the screen creation unit 75 controls the operation panel so that the longitudinal direction is in contact with the sub scanning direction as shown in FIG. 14B. To display. FIG. 14B shows a passport orientation instruction screen displayed on the operation panel 27. By arranging the passport in this way, the multi-function device 30 can specify the location of the MRZ area and shorten the reading time of the MRZ area. In this way, the image processing system 100 can instruct the direction of the passport using the result obtained by the determination process of the information medium 9.

When the user performs an operation for starting reading, the operation control unit 76 instructs the main body 10 to read the MRZ area (S30).

FIG. 15 shows the MRZ area of the passport. The MRZ area is a machine reading unit that a machine reads. Since important information is written in the MRZ area and can be read by the machine, it becomes easy to read the information in the passport. The format of the passport differs depending on the country, but the position of the MRZ area 70 and the contents described in the MRZ area are defined by international standards. Specifically, it is 125 [mm] in the main scanning direction and 20 [mm] in the sub scanning direction.

The document reading unit 62 of the multi-function device 30 reads only the MRZ area 70, an area including at least the MRZ area 70, or an area slightly larger than the MRZ area 70. Therefore, it is possible to shorten the time required for reading, the time required for OCR processing, and the time required for extracting characters necessary for creating application documents.

The operation unit communication unit 71 of the operation unit 20 acquires the image data of the MRZ area 70, and the operation control unit 76 causes the OCR unit 72 to perform the OCR processing (S40). Thus, the passport number (Passport No.), nationality (Nationality), name (Name), and date of birth (Date of birth) included in the MRZ area 70 can be acquired as text data.

The operation unit communication unit 71 of the operation unit 20 transmits the information medium ID, the item key, and the value of each item as a processing result to the information processing terminal 50 via the external communication unit 63 (S50). The item key is information for identifying an item of application documents (tax-exempt sales documents in the case of passport). The terminal communication unit 51 of the information processing terminal 50 receives the processing result. The document creation control unit 52 identifies the application ID associated with the information medium ID by referring to the application DB 5001 and requests the application activation unit 55 to activate the application ID and the application. Therefore, the information processing terminal 50 can start the tax exemption application corresponding to the information medium 9.

The launched tax-exempt application captures the result of character recognition into application documents (tax-exempt sales documents) and prints the documents. The user inputs necessary items in the tax-free sales document and presses the print button. As a result, the front-end sales document is printed.

Here, one of the items required for tax-free sales documents is a general total amount. Under the consumption tax exemption system for foreign visitors to Japan, if the total amount of general goods exceeds 1 million yen, it is obligatory to save a copy of the passport or the like at the tax payment place or the sales place of the business operator who operates the store. Therefore, when the total amount of general products exceeds 1 million yen, the multi-function device 30 needs to read the entire passport and generate image data.

The tax exemption application of the information processing terminal 50 determines whether or not the general total amount entered by the user is 1,000,000 yen or more (S52). When the general total amount input by the user is 1 million yen or more, the operation control unit 76 of the multi-function device 30 is requested to read the passport. Therefore, the operation control unit 76 again instructs the orientation of the passport (S54).

When the user performs an operation for starting reading, the operation control unit 76 causes the original reading unit 62 of the main body 10 to read the entire passport (S56).

Then, the printing unit 64 of the main body 10 prints the entire passport (S58). In this way, even if the total amount of general items exceeds 1 million yen, the entire passport can be printed automatically.

Both the MRZ area reading and the entire surface reading may be performed in step S30. In this case, when it is determined that the general total amount of money is not more than 1 million yen, the tax exemption application of the information processing terminal 50 discards the entire image data. The printing in step S58 may be performed in step S22 in FIG.

In the case of a driver's license FIG. 16 is a diagram showing an example of a driver's license. 16A shows the front surface, and FIG. 16B shows the back surface. On the surface of the driver's license, the background 651 of the character of the expiration date is blue or gold. The letters "grant" 652, "number" 653, and "driver's license" 654 are written on the front surface, and the letters "remark" 655 are written on the back surface.

First, the operation control unit 76 instructs to arrange the surface of the license on the contact glass (S60). For example, the screen creation unit 75 displays a message such as “Please read the front surface of the license” on the operation panel 27.

Next, when the user presses the start button on the operation panel 27, the document reading unit 62 of the main body 10 reads the surface of the driver's license (S70). Since it is known that the document is a driver's license, the document reading unit 62 reads the driver's license with the vertical and horizontal sizes of the driver's license as the reading range. Since it is determined that the information medium 9 is a driver's license, it is considered that the image data on the surface has already been read. However, the reading settings (resolution, density, characters, The document reading unit 62 reads a document including mixed photographs. As a result, clearer image data can be obtained. However, the operation control unit 76 may omit the reading of the front surface.

Next, the operation control unit 76 instructs the rear surface of the license to be placed on the contact glass (S80). For example, the screen display unit displays a message such as "Please read the back of the license" on the operation panel 27.

When the user presses the start button on the operation panel 27, the document reading unit 62 of the main body 10 reads the back surface of the driver's license (S90). The operation control unit 76 reads the front and back of the license because it is necessary for the insurance application document, but if the back is not required for the insurance application document, only the front surface is read.

Further, when reading the front surface and the back surface, the operation control unit 76 may determine whether the front surface and the back surface are respectively read. Since the predetermined characters are written on the front surface and the back surface, the front surface and the back surface can be determined depending on whether or not these characters are recognized. In this case, the OCR unit 72 of the operation unit 20 performs OCR processing on the image data on the front surface and the image data on the back surface, respectively. For example, if the characters such as “grant”, “number”, and “driver's license” are detected, it is the front side, and if the character string “remark” is detected, the back side is detected. In addition, since the surface includes a photograph, it can be determined as the surface by detecting an area in which the halftone areas are continuous as a photograph area. The surface can also be detected by performing face recognition.

When the front surface and the back surface have not been read, the operation control unit 76 can read the surface that has not been read, so that the image data necessary for the application document can be prepared.

The operation unit communication unit 71 of the operation unit 20 transmits the information medium ID and the image data of the front surface and the back surface to the information processing terminal 50 as the processing result via the external communication unit 63 (S100). The terminal communication unit 51 of the information processing terminal 50 receives the processing result. The document creation control unit 52 identifies the application ID associated with the information medium ID by referring to the application DB 5001 and requests the application activation unit 55 to activate the application ID and this application. Therefore, the information processing terminal 50 can start the application corresponding to the information medium 9. The image processing system 100 can capture the image of the license into a document and print it.

Since the address, name, and date of birth may be required even for insurance application documents, the multifunction device 30 will notify you of the address, name, and date of birth recognized by OCR processing. It may be transmitted to the information processing terminal 50. Since the user does not need to input these, the information processing terminal 50 can assist the user's operation.

In the case of my number card FIG. 17 is a diagram showing an example of my number card. 17A shows the front surface and FIG. 17B shows the back surface. A personal number 661 and a barcode 662 are printed on the back surface.

First, the operation control unit 76 instructs to arrange the back surface of the my number card on the contact glass (S110). For example, the screen display unit displays a message such as "Please read the back of my number card" on the operation panel 27. The back side is read because of the barcode.

A Juki card may be used instead of the My Number card. The Juki card also has a card with a QR code (registered trademark) like the My Number card. In the case of a resident registry card, a resident's card code (11 digits) is read instead of my number and transmitted to the information processing terminal 50.

Next, when the user presses the start button on the operation panel 27, the document reading unit 62 of the main body 10 reads the back surface of the my number card (S120). Since it is known to be a my number card, the document reading unit 62 reads the my number card with the vertical and horizontal sizes of the my number card as the reading range.

Since it is determined that the information medium 9 is a my number card, the barcode may be read. In this case, since it is not necessary to read the barcode twice, the operation control unit 76 does not have to perform steps S110 and S120.

The operation unit communication unit 71 of the operation unit 20 transmits the information medium ID and the my number (12-digit numerical value) to the information processing terminal 50 as the processing result via the external communication unit 63 (S130). The terminal communication unit 51 of the information processing terminal 50 receives the processing result. The document creation control unit 52 identifies the application ID associated with the information medium ID by referring to the application DB 5001 and requests the application activation unit 55 to activate the application ID and this application. Therefore, the information processing terminal 50 can start the application corresponding to the information medium 9. Further, the image processing system 100 can take in my number into a document and print it.

As in the case where the license is read, the operation unit 20 transmits the my number at the time of starting the application, so that there is an advantage that the main body 10 does not need to read the my number again after starting the application.

In addition, the image processing system 100 transmits this my number to an external server that provides the administrative service, so that the document data regarding the administrative service of the user specified by the my number (resident certificate, resident card entry certificate, Document data such as seal registration certificate, family register certificate, family register slip, tax certificate, etc.) can be acquired from the server and the acquired document data can be printed. That is, the started application prints the document data acquired from the external server using the information read from the information medium 9.

<Processing Using External Server 80>
In the image processing system 100 described above, the multi-function device 30 performs processing such as determining a candidate for the information medium 9, but the external server 80 can also determine the information medium 9. In this case, the multifunction peripheral 30 displays the screen and receives the operation, and the external server 80 determines the information medium 9.

FIG. 18 is an example of a sequence diagram showing an operation procedure until the image processing system 100 starts an application. In the description of FIG. 18, differences from FIG. 6 will be described. First, the processing of steps S1 to S6 is similar to that of FIG.

S6-2: When the user presses the “read start” button 613, the operation receiving unit 73 of the operation unit 20 receives the press of the “read start” button 613. The operation unit communication unit 71 of the operation unit 20 notifies the main body 10 of the reading request.

S6-3: The external communication unit 63 of the main body 10 receives the read request, and sends the read range determination request to the external server 80.

S7: The external server 80 receives the read range determination request and refers to the medium feature DB 7001 to determine the read range.

S8: The external server 80 transmits the reading range to the main body 10. The next step S9 is the same as in FIG.

S10: The external communication unit 63 of the main body 10 transmits the image data to the external server 80.

S11: The external server 80 receives the image data and determines a candidate for the information medium 9.

S11-2: The external server 80 transmits the information medium 9 candidates to the main body 10.

S11-3: The main body communication unit 61 of the main body 10 transmits the information medium 9 candidates to the operation unit 20. The subsequent steps S12 to S22 may be the same as in FIG.

By doing so, the operation unit 20 mainly performs display, and the external server 80 can perform the same processing on a plurality of multifunction machines 30, so that the processing load of the multifunction machine 30 can be reduced.

<Imaging of the information medium 9 by the mobile terminal 60>
In addition to the multi-function device 30 capturing the information medium 9, the mobile terminal 60 may capture the information medium 9.

FIG. 19 is an example of a diagram for explaining the outline of the image processing system 100 in which the mobile terminal 60 images the information medium 9.

The user operates the information processing terminal 50 to start the processing operation. Further, the user has previously imaged the information medium 9 with the mobile terminal 60 and transmits the image data to the information processing terminal 50. NFC or Bluetooth may be used for transmission. The image data is transmitted to the multifunction machine 30. Since the image data includes the barcode, the multi-function device 30 identifies the candidate of the information medium 9 based on the characteristic information (the color other than the size and the barcode) of the information medium 9. Alternatively, when the information medium 9 has an IC chip, the mobile terminal 60 may transmit the information read from the IC chip to the multi-function device 30. The contents of the driver's license are stored in the IC chip of the driver's license, and the personal number is stored in the IC chip of the my number card.

With such usage, the user can take an image of the information medium 9 in advance, so that it is not necessary to dispose the information medium 9 in the multifunction machine 30, and the burden on the user can be reduced.

<Summary>
As described above, the image processing system 100 according to the present embodiment activates the application associated with the information medium 9 by causing the user to read the information medium 9 required for the application document. It is possible to reduce the need to select a document and an application required for creating an application document.

<Other applications>
The best mode for carrying out the present invention has been described above with reference to the embodiments, but the present invention is not limited to these embodiments, and various modifications can be made without departing from the gist of the present invention. And substitutions can be added.

For example, although a resident card is used as an example of a document printed with my number, any document such as a seal stamp certificate that can be printed with my number may be used.

Also, the application documents do not necessarily have to be created or printed. For example, when the ticket purchased by the user is used as the information medium, the image processing system 100 can activate an application for canceling the ticket. Since the ticket contents, the purchase date, and the information about the user who purchased the ticket are usually printed on the ticket, the multi-function device 30 can determine that the ticket is a ticket based on the bar code contents.

In the case of the above modified example, the information of the application for canceling the ticket is registered in Table 1.

Further, the application documents to be printed are not limited to those used for applying for some kind of service, but include those that have value in the printed matter itself. For example, when the information medium 9 is a credit card, a ticket or the like may be purchased and a ticket or a reservation ticket may be printed.

Further, although it has been described that the application document is printed in the present embodiment, only the output in a broad sense is displayed without printing such as displaying on the operation panel 27 or transmitting electronic data of the application document to the mobile terminal 60. You may be broken.

In addition, the configuration example of FIG. 5 and the like is divided according to main functions in order to facilitate understanding of the processing by the information processing terminal 50, the operation unit 20, and the main body 10. The present invention is not limited by the division method or name of the processing unit. The processing of the information processing terminal 50, the operation unit 20, and the main body 10 can be divided into more processing units according to the processing content. Also, one processing unit can be divided so as to include more processing.

Further, the processing performed by the information processing terminal 50 may be performed by the operation unit 20 or the main body 10, and the processing performed by the operation unit 20 may be performed by the information processing terminal 50 or the main body 10, or the processing performed by the main body 10. May be performed by the information processing terminal 50 or the operation unit 20.

In the case where the operation unit 20 or the main body 10 may perform the processing performed by the information processing terminal 50, the following modified examples are possible.
The operation unit 20 may include the application 56 included in the information processing terminal 50, or the main body 10 may include the application 56.
Although the application activation request is transmitted from the operation unit 20 to the information processing terminal 50 via the main body 10 in FIGS. 6 and 18, if the operation unit 20 includes the application 56, the application activation request is performed in the operation unit 20. Launch the app specified by. When the main body 10 includes the application 56, the application specified by the application activation request transmitted from the operation unit 20 is activated. In this case, the screen display of the application is displayed on the operation unit 20.
The operation unit 20 may receive the operation of starting the process in step S1 of FIG. In this case, the operation unit 20 transmits a read preparation command (step S3) to the main body 10.
The operation unit 20 may accept the print execution in step S20. In this case, the print job is transmitted from the operation unit 20 to the main body 10.

Further, the multifunction machine 30 in which the operation unit 20 and the main body 10 are integrated may be used, or the information processing terminal 50, the operation unit 20 and the main body 10 may be an integrated device.

The operation unit communication unit 71 is an example of image data acquisition unit, the medium determination unit 74 is an example of medium determination unit, the document creation control unit 52 is a process determination unit, and the application activation unit 55 is a process start unit. The screen creation unit 75 is an example of a display unit, the operation control unit 76 is an example of an operation control unit, the OCR unit 72 is an example of a character recognition unit, and the operation reception unit 73 is an acceptance unit. The external communication unit 63 is an example of a transmission unit.

9 information medium 10 main body 20 operation unit 30 multifunction device 50 information processing terminal 60 mobile terminal 80 external server 100 image processing system

JP2007-102265A

Claims (17)

Image data acquisition means for acquiring image data of an information medium holding information used for creating a document,
A medium for determining the information medium by comparing the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium with the characteristic information extracted from the image data. Decision means,
The process associated with the information medium identified by the medium determining unit by referring to the medium process information associated with the identification information of the process using the information medium in association with the identification information of the information medium A process determining means for determining
A processing start means for starting the processing determined by the processing determination means,
Image processing system having a. Information relating to the size of the information medium is registered in the medium characteristic information,
The medium determining unit extracts information regarding the size as the characteristic information from the image data, and determines the information medium whose difference from the information regarding the size extracted from the image data is within a predetermined range from the medium characteristic information. The image processing system according to claim 1. The color of the information medium, or the information stored in the barcode is registered in the medium characteristic information,
The medium determining unit extracts the color and the barcode as the characteristic information from the image data,
The information medium in which the same color as the color extracted from the image data is registered is determined from the medium characteristic information, or
The image processing system according to claim 1, wherein the information medium in which the information stored in the barcode extracted from the image data is registered is determined from the medium characteristic information. When there are a plurality of information media determined by the medium determining means,
Display means for displaying a plurality of the information media on a display device;
Accepting means for accepting selection of the information medium,
The image processing system according to claim 1, further comprising: The medium determining unit determines the maximum size of the information regarding the respective sizes of the information medium registered in the medium characteristic information as a reading range,
The image processing system according to claim 2, wherein the reading unit is instructed to the reading unit of the information medium. The image processing system according to claim 1, further comprising an operation control unit that switches a control related to reading of the image data according to the information medium determined by the medium determination unit. When the information medium is a passport, the operation control means displays the orientation of the passport with respect to the reading unit of the information medium on a display device,
The operation control unit indicates to the reading unit the reading range corresponding to the mechanical reading unit of the passport,
The reading unit has a character recognition means for performing character recognition processing on image data obtained by reading the reading range,
7. The image processing system according to claim 6, wherein the processing started by the processing start means captures a result of character recognition into the document and prints the document. 7. The image processing system according to claim 6, wherein when the information medium is a driver's license, the operation control unit displays on the display device that the reading unit reads the front surface and the back surface of the driver's license. The process determining means identifies an application that executes the process determined according to the information medium,
The image processing system according to claim 1, wherein the processing start unit activates the application determined by the processing determination unit. The image processing system according to claim 9, wherein the application started by the processing start unit captures information read from the information medium and creates a document. The image processing system according to claim 9, wherein the application started by the processing start unit prints the document data acquired from the external server using the information read from the information medium. An image data acquisition means acquiring image data of an information medium holding information used for creating a document,
The medium determining means compares the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium and the characteristic information extracted from the image data, Determining the medium,
The process determining unit refers to the medium process information in which the identification information of the process using the information medium is associated with the identification information of the information medium, and associates with the information medium identified by the medium determining unit. Determining the processing being performed,
A step for starting the processing, wherein the processing starting means starts the processing determined by the processing determining means;
An image processing method including. The medium processing information in which the identification information of the process using the information medium is associated with the identification information of the information medium is referred to, and the process associated with the information medium specified by the image processing apparatus is determined. Processing determining means to
An image processing apparatus that communicates with an external device, comprising: a process starting unit that starts the process determined by the process determining unit,
Image data acquisition means for acquiring image data of an information medium that holds information used for creating a document,
A medium for determining the information medium by comparing the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium with the characteristic information extracted from the image data. Decision means,
An image processing apparatus comprising: a transmission unit that transmits the identification information of the information medium determined by the medium determination unit to an external device. The medium processing information in which the identification information of the process using the information medium is associated with the identification information of the information medium is referred to, and the process associated with the information medium specified by the image processing apparatus is determined. Processing determining means to
An image processing apparatus that communicates with an external device, comprising: a process starting unit that starts the process determined by the process determining unit;
Image data acquisition means for acquiring image data of an information medium holding information used for creating a document,
A medium for determining the information medium by comparing the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium with the characteristic information extracted from the image data. Decision means,
Transmission means for transmitting the identification information of the information medium determined by the medium determination means to an external device,
Program to function as. The medium processing information in which the identification information of the process using the information medium is associated with the identification information of the information medium is referred to, and the process associated with the information medium specified by the image processing apparatus is determined. Processing determining means to
An image processing method performed by an image processing apparatus that communicates with an external device, comprising: a process starting unit that starts the process determined by the process determining unit;
An image data acquisition means acquiring image data of an information medium holding information used for creating a document,
The medium determining means compares the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium and the characteristic information extracted from the image data, Determining the medium,
And a step of transmitting the identification information of the information medium determined by the medium determination means to an external device. Image data acquisition means for acquiring image data of an information medium holding information used for creating a document,
A medium for determining the information medium by comparing the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium with the characteristic information extracted from the image data. Decision means,
An image processing apparatus having a transmission unit that transmits the identification information of the information medium determined by the medium determination unit to an external device;
The external device,
The process associated with the information medium identified by the medium determining unit by referring to the medium process information associated with the identification information of the process using the information medium in association with the identification information of the information medium A process determining means for determining
Processing start means for starting the processing determined by the processing determination means,
And a program for functioning as an image processing system. Image data acquisition means for acquiring image data of an information medium holding information used for creating a document,
A medium for determining the information medium by comparing the characteristic information of the medium characteristic information in which the characteristic information of the information medium is registered in association with the identification information of the information medium with the characteristic information extracted from the image data. Decision means,
A platform that serves as an interface with an external device,
The platform transmits the identification information of the information medium determined by the medium determination unit to an external device,
An image processing apparatus in which the external device acquires a print request to be transmitted according to a process started based on identification information of the information medium.

Images