JP2020135295A - Information processing system - Google Patents

Abstract

To efficiently use a result of conversion from image data into character code data.SOLUTION: An information processing system (100) comprises: an image reading device (10); and an information processing apparatus (20). The image reading device (10) includes a pre-conversion processing unit (14) that can convert image data into character code data, and the information processing apparatus (20) includes a post-conversion processing unit (22) that can convert the image data into the character code data. In the information processing apparatus (20), when receiving, from the image reading device (10), character code data (RCD) converted from object image data (OG) by the pre-conversion processing unit (14), the post-conversion processing unit (22) does not convert the object image data (OG) into the character code data, and when not receiving, from the image reading device (10), the character code data converted from object image data (OG) by the pre-conversion processing unit (14), the post-conversion processing unit (22) converts the object image data (OG) into the character code data.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing system.

Character recognition is known that reads a manuscript and recognizes characters in the manuscript. Such a process is also called an optical character recognition (OCR) process. In the optical character recognition process, image data is converted into character code data.

A scanning system in which data scanned by an MFP is transmitted to an OCR server and the OCR server executes OCR processing is being studied (for example, Patent Document 1). In the scanning system of Patent Document 1, the format data portion of the scanned data is erased, and then the remaining character string is subjected to OCR processing.

JP-A-2018-160897

In recent years, it has been considered to perform OCR processing in an MFP. However, when OCR processing is possible in the MFP, it is not clear how the MFP capable of OCR processing and the server capable of OCR processing are linked.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an information processing system that can efficiently use the conversion result from image data to character code data.

The information processing system according to the present invention includes an image reading device and an information processing device. The image reading device reads the original and generates the target image data. The information processing device processes the target image data. The image reading device includes a pre-conversion processing unit capable of converting image data into character code data. The information processing device includes a post-conversion processing unit capable of converting image data into character code data. When the information processing device receives the character code data obtained by converting the target image data by the pre-conversion processing unit from the image reading device, the post-conversion processing unit does not convert the target image data into character code data. When the character code data obtained by converting the target image data by the pre-conversion processing unit is not received from the image reading device, the post-conversion processing unit converts the target image data into character code data.

According to the present invention, the conversion result from the image data to the character code data can be efficiently used.

It is a schematic diagram of the information processing system of this embodiment. It is a schematic block diagram of the information processing system of this embodiment. It is a flow diagram of the information processing apparatus in the information processing system of this embodiment. It is a schematic block diagram of the information processing system of this embodiment. It is a flow diagram of the information processing apparatus in the information processing system of this embodiment. It is a schematic block diagram of the information processing system of this embodiment. It is a schematic diagram of the designated image data of the area in the information processing system of this embodiment. It is a schematic block diagram of the information processing system of this embodiment. (A) to (c) are schematic diagrams showing a display screen of a display unit of an image reader in the information processing system of the present embodiment. It is a flow chart of information processing by an image reader in the information processing system of this embodiment. It is a schematic block diagram of the information processing system of this embodiment. (A) and (b) are schematic diagrams showing a display screen of a display unit of an image reader in the information processing system of the present embodiment. It is a schematic diagram of the information processing system of this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals and the description is not repeated.

First, the configuration of the information processing system 100 of the present embodiment will be described with reference to FIG. FIG. 1 is a schematic diagram of the information processing system 100. The information processing system 100 includes an image reading device 10 and an information processing device 20.

The image reading device 10 and the information processing device 20 are connected by a network N. The network N may be a local area network (LAN) or a wide area network (Wide Area Network: WAN). Alternatively, the network N may be the Internet.

The image reading device 10 reads the original and generates the target image data OG. The image reading device 10 transmits the target image data OG to the information processing device 20.

The file format of the target image data OG is not particularly limited. For example, the file format of the target image data OG is a portable document format (PDF), a portable network graphics (PNG), and a tagged image file format (Tagged Image File Format). ) Or the Joint Photographic Experts Group (JPEG).

The information processing device 20 receives the target image data OG from the image reading device 10. Here, the source of the target image data OG is the image reading device 10.

The information processing device 20 processes the target image data OG. The information processing device 20 converts the target image data OG into character code data. The information processing device 20 converts the target image data OG into the character code data CD by the optical character recognition (OCR) process. For example, the information processing device 20 is a server. The character code data CD is data indicating a language, numbers, or symbols.

The file format of the character code data CD is not particularly limited. For example, the file format of the character code data CD may be any of Extendable Markup Language (XML), PDF, document creation software, table calculation software, and presentation software.

For example, the information processing device 20 stores a character code data CD. The information processing device 20 itself may store the character code data. Alternatively, the information processing device 20 may transmit the character code data so that another storage device stores the character code data. For example, the information processing device 20 may transmit character code data to the image reading device 10. Alternatively, the information processing device 20 may fax the character code data to another device.

The information processing device 20 may operate in conjunction with the image reading device 10. For example, application software for driving the information processing device 20 may be installed in the image reading device 10. By activating the application software of the image reading device 10, the image reading device 10 operates in conjunction with the information processing device 20.

The information processing system 100 may further include an information processing device 30. The information processing device 30 is connected to the network N. The information processing device 20 can transmit the character code data CD to the information processing device 30. The information processing device 30 processes the character code data CD. The information processing device 30 includes, for example, a personal computer (PC) or a smartphone (Smart Phone).

Next, the information processing system 100 of the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 2 is a block diagram of the information processing system 100 of the present embodiment.

The image reading device 10 includes a reading unit 12, a pre-conversion processing unit 14, a communication unit 16, and a control unit 17. The control unit 17 controls the reading unit 12, the pre-conversion processing unit 14, and the communication unit 16. The control unit 17 includes a processor. The processor may include a central processing unit (CPU). Alternatively, the processor may include a microcomputer. Alternatively, the processor may include an application specific integrated circuit (ASIC).

The reading unit 12 can read the original and generate image data. The reading unit 12 reads the original and generates the target image data OG.

The pre-conversion processing unit 14 can convert the image data into character code data. For example, the pre-conversion processing unit 14 can convert the target image data OG into character code data. In this specification, the character code data converted by the pre-conversion processing unit 14 may be referred to as pre-character code data or character code data RCD. Further, in the present specification, the conversion process by the pre-conversion processing unit 14 may be described as the pre-conversion process.

Typically, when the pre-conversion processing unit 14 converts the image data into character code data, the recognition rate of the pre-conversion processing is also generated. The recognition rate indicates the ratio of characters recognized as being appropriately converted by the pre-conversion processing unit 14. When the recognition rate is high, the pre-conversion process is often properly converted without error. In the present specification, the recognition rate by the pre-conversion processing unit 14 may be described as the pre-recognition rate.

The communication unit 16 communicates with an external electronic device. Here, the communication unit 16 transmits the target image data OG to the information processing device 20. When the pre-conversion processing unit 14 generates the character code data RCD, the communication unit 16 transmits the character code data RCD together with the target image data OG to the information processing device 20.

The information processing device 20 includes a post-conversion processing unit 22, a communication unit 26, a control unit 27, and a storage unit 27s. The control unit 27 controls the post-conversion processing unit 22 and the communication unit 26. The control unit 27 includes a processor. The processor may include a CPU, a microcomputer, or a special purpose integrated circuit.

The post-conversion processing unit 22 can convert the image data into character code data. For example, the post-conversion processing unit 22 can convert the target image data OG into character code data. In this specification, the character code data converted by the post-conversion processing unit 22 may be referred to as post-character code data or character code data OCD. Further, in the present specification, the conversion process by the post-conversion processing unit 22 may be described as a post-conversion process.

Typically, when the post-conversion processing unit 22 converts the image data into character code data, the recognition rate of the post-conversion processing is also generated. In the present specification, the recognition rate by the post-conversion processing unit 22 may be described as the post-recognition rate.

The pre-conversion processing unit 14 and the post-conversion processing unit 22 both convert the image data into character code data. For example, the pre-conversion processing unit 14 converts certain target image data into Japanese character code data. Similarly, the post-conversion processing unit 22 converts the same target image data into Japanese character code data.

However, even if the target image data is the same and the post-conversion processing unit 22 performs the same type of conversion processing as the pre-conversion processing unit 14, the conversion processing of the post-conversion processing unit 22 is the same as the conversion processing of the pre-conversion processing unit 14. Not the same, the character code data OCD may not be the same as the character code data RCD. For example, the conversion process of the post-conversion processing unit 22 is at a normal level, and the conversion process of the pre-conversion processing unit 14 is superior to the conversion process of the post-conversion processing unit 22. In one example, the pre-conversion processing unit 14 can appropriately convert even image data that cannot be correctly converted by the conversion processing of the post-conversion processing unit 22. In this case, the pre-recognition rate is higher than the post-recognition rate. Alternatively, the conversion process of the pre-conversion processing unit 14 may be at a normal level, and the conversion process of the post-conversion processing unit 22 may be superior to the conversion process of the post-conversion processing unit 22.

The control unit 27 controls whether the post-conversion processing unit 22 converts the target image data into a post-character code. When the character code data RCD is not received from the image reading device 10, the control unit 27 controls the post-conversion processing unit 22 to convert the target image data OG into the character code data OCD. Alternatively, when the character code data RCD is received from the image reading device 10, the control unit 27 controls the post-conversion processing unit 22 so as not to convert the target image data OG into the character code data OCD.

For example, the control unit 27 may control whether the post-conversion processing unit 22 converts the target image data according to a predetermined procedure before the information processing device 20 receives the target image data OG. In one example, the control unit 27 may select whether the post-conversion processing unit 22 converts the target image data according to a predetermined procedure before the information processing device 20 receives the target image data OG.

Even when the character code data RCD is received, the control unit 27 may control the post-conversion processing unit 22 to convert the target image data OG into the character code data OCD. For example, when the pre-recognition rate received from the image reading device 10 does not satisfy a predetermined condition, the control unit 27 may perform post-conversion processing by the post-conversion processing unit 22. In this case, the control unit 27 may compare the post-recognition rate and the pre-recognition rate of the post-conversion processing unit 22 and select the character code data corresponding to the larger recognition rate.

The storage unit 27s stores the control program. The control program is stored on a non-temporary computer-readable storage medium. Non-temporary computer-readable storage media include ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM, magnetic tape, magnetic disk or optical data storage device. The control unit 27 controls the operation of each component of the information processing device 20 by executing the control program stored in the storage unit 27s.

According to the information processing system of the present embodiment, at least one of the pre-conversion processing unit 14 and the post-conversion processing unit 22 converts the target image data OG into character code data. For example, the pre-conversion processing unit 14 and the post-conversion processing unit 22 may be selected based on cost or usage fee. Alternatively, the pre-conversion processing unit 14 and the post-conversion processing unit 22 may be selected based on the recognition rate.

Regardless of the type of the target image data and / or the character code data, the magnitude relationship between the pre-recognition rate and the post-recognition rate may be constant. For example, when the pre-recognition rate is larger than the post-recognition rate regardless of the type of the target image data and / or the character code data, the performance of the pre-conversion processing unit 14 is superior to the performance of the post-conversion processing unit 22. ..

The magnitude relationship between the pre-recognition rate and the post-recognition rate may change depending on the type of the target image data and / or the character code data. For example, when converting the target image data to Japanese character code data, the post-recognition rate is higher than the pre-recognition rate, and when converting the target image data to English character code data, the pre-recognition rate is higher than the post-recognition rate. May be high.

Further, the usage conditions of the post-conversion processing unit 22 may be different from the usage conditions of the pre-conversion processing unit 14. For example, the post-conversion processing unit 22 can be used free of charge, and the pre-conversion processing unit 14 can be used for a fee. The post-conversion processing unit 22 can be used without a license, and the pre-conversion processing unit 14 can be used with a license. Alternatively, the usage fee of the post-conversion processing unit 22 is low, and the usage fee of the pre-conversion processing unit 14 is high. Alternatively, the usage fee of the post-conversion processing unit 22 is a flat rate system, and the usage fee of the pre-conversion processing unit 14 is a pay-as-you-go system.

The usage fee of the pre-conversion processing unit 14 and the post-conversion processing unit 22 may be increased according to the processing amount (usage amount) of the image data, and is constant regardless of the processing amount (usage amount) of the image data. There may be. For example, the usage fee of the pre-conversion processing unit 14 and the post-conversion processing unit 22 may be constant over a certain period regardless of the processing amount (usage amount) of the image data.

Typically, the post-conversion processing unit 22 may not be charged a usage fee. For example, the post-conversion processing unit 22 may use open source.

The pre-conversion processing unit 14 may be subject to a usage fee. For example, the pre-conversion processing unit 14 may be software developed by a vendor.

For example, when targeting a document having a relatively low importance, the control unit 27 may select an information processing unit with a low usage fee based on a user's setting. Alternatively, when targeting a document having a relatively high importance, the control unit 27 may select an information processing unit having a recognition rate based on the user's settings. Furthermore, when the user wants to set an information processing unit to be selected according to the situation, the control unit 27 inquires the user about the information processing unit to be used for each conversion process, and processes information according to the instruction from the user. You may select a part. Alternatively, the control unit 27 may select the information processing unit based on the user's predetermined setting conditions.

For example, the post-conversion processing unit 22 may be able to convert image data into numerical and / or alphabetic character code data with a high recognition rate, but may not be able to convert image data into another character code data with a high recognition rate. .. Further, the pre-conversion processing unit 14 may be able to convert the image data into numerical and / or alphabetic character code data with a high recognition rate. As described above, the post-conversion processing unit 22 may be insufficiently converted into multi-byte characters, whereas the pre-conversion processing unit 14 may be sufficiently converted into multi-byte characters.

It is preferable that the post-conversion processing unit 22 acquires the recognition rate of the character code data when converting the image data to the character code data. When the post-conversion processing unit 22 converts the image data to the character code data, the more correct the conversion is, the higher the recognition rate of the character code data becomes.

For example, when the written language indicated by the target image data is the same as the written language stored in the database of the post-conversion processing unit 22 itself, the recognition rate of the character code data in the post-conversion processing unit 22 is high. On the contrary, when the written language indicated by the target image data is different from the written language stored in the database of the post-conversion processing unit 22 itself, the recognition rate of the character code data in the post-conversion processing unit 22 is low. Similarly, it is preferable that the second conversion processing unit 22b acquires the recognition rate of the character code data when converting the image data to the character code data.

For example, while the pre-conversion processing unit 14 can perform conversion processing with higher accuracy than the post-conversion processing unit 22, the usage fee of the pre-conversion processing unit 14 may be higher than the usage fee of the post-conversion processing unit 22. In one example, the usage fee of the second conversion processing unit 22b is determined according to the usage amount, while the post-conversion processing unit 22 may be usable without limitation by the user of the information processing apparatus 20. ..

The pre-conversion processing unit 14 and the post-conversion processing unit 22 may extract a part of the character code data obtained by converting the image data as metadata. Further, the character code data itself may or may not be saved as a file. When saving as a file, the extracted metadata may be given as a file name.

Next, a flow chart of the information processing apparatus 20 in the information processing system 100 of the present embodiment will be described with reference to FIGS. 1 to 3. FIG. 3 is a flow chart of the information processing apparatus 20 in the information processing system 100 of the present embodiment.

In step S102, the information processing device 20 receives the target image data from the image reading device 10. The image reading device 10 reads the original to generate the target image data OG, and transmits the target image data OG to the information processing device 20. The information processing device 20 receives the target image data from the image reading device 10. Specifically, the communication unit 26 of the information processing device 20 receives the target image data from the communication unit 16 of the image reading device 10.

The target image data OG is generated by scanning the document R with the image reading device 10. The reading unit 12 of the image reading device 10 generates target image data by reading the document R. After that, the image reading device 10 transmits the target image data to the information processing device 20.

As described above, the image reading device 10 can perform pre-conversion processing of the target image data OG. Specifically, the pre-conversion processing unit 14 of the image reading device 10 may generate character code data RCD from the target image data. In this way, the pre-conversion processing unit 14 may perform pre-conversion processing on the target image data.

When the pre-conversion processing unit 14 performs pre-conversion processing, the image reading device 10 transmits the character code data CD together with the target image data to the information processing device 20. The image reading device 10 may simultaneously transmit the target image data OG and the character code data RCD to the information processing device 20. Alternatively, the image reading device 10 may separately transmit the target image data OG and the character code data RCD to the information processing device 20.

In step S104, the information processing device 20 determines whether or not the character code data RCD has been received from the image reading device 10. Specifically, the control unit 27 of the information processing device 20 determines whether or not the character code data RCD has been received.

When the character code data RCD is not received (No in step S104), the post-conversion processing unit 22 converts the target image data OG into the character code data OCD in step S106.

After that, in step S108a, the storage unit 27s stores the character code data OCD. The storage unit 27s may store the target image data OG together with the character code data OCD. Further, the storage unit 27s may store a part of the character code data OCD as metadata. After that, the process ends.

When the character code data RCD is received (Yes in step S104), in step S108b, the storage unit 27s stores the character code data RCD. The storage unit 27s may store the target image data OG together with the character code data RCD. Further, the storage unit 27s may store a part of the character code data RCD as metadata.

When the character code data RCD is received, the post-conversion processing unit 22 does not post-convert the target image data OG into the character code data. However, the control unit 27 may perform a process other than the post-conversion process on the target image data OG. After that, the process ends.

As described above with reference to FIG. 3, according to the present embodiment, when the information processing apparatus 20 receives the character code data RCD from the image reading apparatus 10, the target image data OG is not post-converted. Character code data RCD is used. Further, when the character code data RCD is not received from the image reading device 10, the target image data OG is converted into the character code data OCD. Therefore, according to the present embodiment, the conversion result from the image data to the character code data can be efficiently used.

In the above description with reference to FIGS. 1 to 3, the post-conversion processing unit 22 can convert the target image data OG into one type of character code data, but the present embodiment is not limited to this. The post-conversion processing unit 22 may be able to convert the target image data OG into a plurality of types of character code data.

Next, the information processing system 100 of the present embodiment will be described with reference to FIG. FIG. 4 is a schematic block diagram of the information processing system 100 of the present embodiment. The information processing system 100 of FIG. 4 is described above with reference to FIG. 2 except that the post-conversion processing unit 22 includes a first conversion processing unit 22a, a second conversion processing unit 22b, and a selection unit 22c. It has the same configuration as. Therefore, duplicate description will be omitted in order to avoid redundancy.

The post-conversion processing unit 22 includes a first conversion processing unit 22a, a second conversion processing unit 22b, and a selection unit 22c. The first conversion processing unit 22a can convert the image data into character code data. The second conversion processing unit 22b can convert the image data into character code data. The conversion process by the second conversion processing unit 22b is different from the conversion process by the first conversion processing unit 22a. Further, the conversion process by the first conversion processing unit 22a and the conversion processing by the second conversion processing unit 22b are different from the conversion processing by the pre-conversion processing unit 14.

The first conversion processing unit 22a can convert the image data into character code data. For example, the first conversion processing unit 22a can convert the target image data OG into character code data. In this specification, the character code data converted by the first conversion processing unit 22a may be described as the first character code data or the character code data CD1. Further, in the present specification, the conversion process by the first conversion processing unit 22a may be described as the first conversion process.

Typically, when the first conversion processing unit 22a converts the image data into character code data, the recognition rate of the first conversion processing is also generated. In the present specification, the recognition rate by the first conversion processing unit 22a may be described as the first recognition rate.

The second conversion processing unit 22b can convert the image data into character code data. For example, the second conversion processing unit 22b can convert the target image data OG into character code data. In the present specification, the character code data converted by the second conversion processing unit 22b may be referred to as the second character code data or the character code data CD2. Further, in the present specification, the conversion process by the second conversion processing unit 22b may be described as the second conversion process.

When the second conversion processing unit 22b converts the image data into the character code data, the recognition rate of the second conversion processing is also generated. In the present specification, the recognition rate by the second conversion processing unit 22b may be referred to as the second recognition rate.

The first conversion processing unit 22a and the second conversion processing unit 22b both convert the image data into character code data. For example, the first conversion processing unit 22a converts certain target image data into Japanese character code data. Similarly, the second conversion processing unit 22b converts the same target image data into Japanese character code data.

However, even if the target image data is the same and the first conversion processing unit 22a performs the same type of conversion processing as the second conversion processing unit 22b, the conversion processing of the first conversion processing unit 22a is performed by the second conversion processing unit 22b. The character code data CD1 is not the same as the character code data CD2, which is not the same as the conversion process of. For example, the conversion processing of the first conversion processing unit 22a is at a normal level, and the conversion processing of the second conversion processing unit 22b is superior to the conversion processing of the first conversion processing unit 22a. In one example, the second conversion processing unit 22b can appropriately convert even image data that cannot be correctly converted by the conversion processing of the first conversion processing unit 22a.

The selection unit 22c selects which of the first conversion processing unit 22a and the second conversion processing unit 22b converts the target image data. For example, in the selection unit 22c, which of the first conversion processing unit 22a and the second conversion processing unit 22b converts the target image data according to a predetermined procedure before the information processing device 20 receives the target image data OG. May be selected. In one example, in the selection unit 22c, either the first conversion processing unit 22a or the second conversion processing unit 22b converts the target image data according to a predetermined procedure before the information processing device 20 receives the target image data OG. You may choose.

Alternatively, the selection unit 22c selects which of the first conversion processing unit 22a and the second conversion processing unit 22b converts the target image data according to the designation from the user of the image reading device 10 that generates the target image data OG. You may. For example, the image reading device 10 reads a document, generates target image data, and immediately before, simultaneously, or immediately after transmitting the target image data to the information processing device 20, the first conversion processing unit 22a and the second conversion processing unit 22b. Specifies which of the above converts the target image data. After that, according to the designation from the image reading device 10, the selection unit 22c may select which of the first conversion processing unit 22a and the second conversion processing unit 22b converts the target image data.

At least one of the first conversion processing unit 22a and the second conversion processing unit 22b converts the target image data OG into character code data based on the selection result of the selection unit 22c. For example, when the selection unit 22c selects the first conversion processing unit 22a, the first conversion processing unit 22a converts the target image data OG into the character code data CD1. Alternatively, when the selection unit 22c selects the second conversion processing unit 22b, the second conversion processing unit 22b converts the target image data OG into the character code data CD2.

The selection unit 22c may select either the first conversion processing unit 22a or the second conversion processing unit 22b a plurality of times. For example, the selection unit 22c first selects one of the first conversion processing unit 22a and the second conversion processing unit 22b, and if the conversion result does not satisfy a predetermined condition, the first conversion processing unit 22a and later The other of the second conversion processing unit 22b may be selected.

Next, a flow chart of the information processing apparatus 20 in the information processing system 100 of the present embodiment will be described with reference to FIGS. 1, 4 and 5. FIG. 5 is a flow chart of the information processing apparatus 20 in the information processing system 100 of the present embodiment. The flow chart of FIG. 5 is the same as the flow chart of the information processing system 100 described above with reference to FIG. 3, except that steps S106a to 106c, steps 108a1 and 108a2 are included. Therefore, duplicate description will be omitted in order to avoid redundancy.

When the character code data corresponding to the target image data is not received from the image reading device 10 (No in step S104), in step S106a, the first conversion processing unit 22a converts the target image data OG into the character code data CD1. To do. At the time of conversion, the first recognition rate in the conversion process by the first conversion processing unit 22a is acquired.

After that, in step S106b, the information processing apparatus 20 determines whether or not the first recognition rate is higher than the threshold value. Specifically, the control unit 27 of the information processing apparatus 20 compares the first recognition rate with the threshold value and determines whether or not the first recognition rate is higher than the threshold value.

If it is determined that the first recognition rate is higher than the threshold value (Yes in step S106b), the process proceeds to step S108a1. In step S108a1, the storage unit 27s stores the character code data CD1.

When it is determined that the first recognition rate is not higher than the threshold value (No in step S106b), in step S106c, the second conversion processing unit 22b converts the target image data OG into the character code data CD2. Then, the process proceeds to step S108a2. In step S108a2, the storage unit 27s stores the character code data CD2. The following is the same as the above description with reference to FIG. 3, and will be omitted.

As described above, according to the present embodiment with reference to FIG. 5, even when the information processing device 20 does not receive the character code data from the image reading device 10, it is higher than the threshold value due to the plurality of types of conversion processing units. Character code data with a recognition rate or character code data with a higher recognition rate can be generated. Therefore, more accurate character code data can be used.

When the pre-conversion processing unit 14, the post-conversion processing unit 22, the first conversion processing unit 22a and / or the second conversion processing unit 22b perform conversion processing on the target image data, the pre-conversion processing unit 14, post-conversion The processing unit 22, the first conversion processing unit 22a and / or the second conversion processing unit 22b may perform conversion processing on the entire target image data. Alternatively, the pre-conversion processing unit 14, the post-conversion processing unit 22, the first conversion processing unit 22a and / or the second conversion processing unit 22b may perform conversion processing on the specified area of the target image data. In this case, it is preferable that the specific area is designated in advance.

Next, the information processing system 100 of the present embodiment will be described with reference to FIG. FIG. 6 is a schematic diagram of the information processing system 100. The information processing system 100 of FIG. 6 has the same configuration as the information processing system 100 described above with reference to FIG. 2, except that the information processing apparatus 20 further includes an area designation unit 24. Therefore, duplicate description will be omitted in order to avoid redundancy.

The information processing device 20 further includes an area designation unit 24 in addition to the post-conversion processing unit 22, the communication unit 26, the control unit 27, and the storage unit 27s. The area designation unit 24 designates a target area to be converted in the target image data. Typically, the information processing apparatus 20 receives the target image data separately for each page of the document. The area designation unit 24 designates a target area to be converted for each target image data corresponding to the page of the original.

The area designation unit 24 may specify a target area for performing conversion processing on all of the target image data received from the image reading device 10. Alternatively, the area designation unit 24 may specify a target area to be converted according to the target image data. For example, the area designation unit 24 may specify the target area to be converted in the target image data based on the designated signal from the image reading device 10.

For example, when the target area to be converted is specified, the post-conversion processing unit 22 converts the designated target area in the target image data into a character code.

When the image reading device 10 reads a document, the generated image data may not be the same even if the document is the same. For example, when the image reading device 10 uses an automatic document feeding device (Auto Document Feeder: ADF) to read a document, the image data may fluctuate depending on the reading situation. Therefore, a specific reference mark is attached to the manuscript, and the information processing apparatus 20 may specify the target area of the target image data with the reference mark as a reference.

Hereinafter, the area designation of the information processing apparatus 20 in the information processing system 100 of the present embodiment will be described with reference to FIGS. 6 and 7. FIG. 7 is a schematic diagram showing target image data in which a region is designated. Here, the manuscript is an invoice, and the target image data is a read of the invoice.

As shown in FIG. 7, areas R1 and R2 are designated for the target image data. Area R1 is designated corresponding to the billing address field of the invoice. Further, the area R2 is designated corresponding to the invoiced amount.

The post-conversion processing unit 22 of the information processing device 20 can generate character code data indicating the billing destination by performing conversion processing on the area R1. In addition, the post-conversion processing unit 22 can generate character code data indicating the billed amount by performing conversion processing on the area R2.

Since the reference mark M is described in the invoice of the manuscript, the area designation unit 24 can set the areas R1 and R2 for the target image data with the reference mark M as a reference. Therefore, even if the image data fluctuates slightly when scanning the original, the predetermined area can be reliably converted.

When specifying the target area for which the target image data is to be converted, the conversion processing result for the target area may not make a substantial sense if the original is different from the one corresponding to the target area in advance. is there. For example, if the recognition rate is low as a result of the post-conversion processing unit 22 performing conversion processing on the target area designated by the area designation unit 24, there is a possibility that the original document that is the source of the target image data is not a predetermined one. is there. Therefore, the storage unit 27s separately stores the character code data having a low recognition rate and the character code data having a high recognition rate, and the information processing device 20 may output only the character code data having a high recognition rate. Good.

In the above description with reference to FIGS. 6 to 8, the information processing apparatus 20 includes the area designation unit 24, but the present embodiment is not limited to this. The image reading device 10 may include an area designating unit having the same function as the area designating unit 24, and the image reading device 10 may convert the image data of the original into character code data for a specific target area.

Further, the processing flow (workflow) for the image data generated by the image reading device 10 may be set by the image reading device 10. For example, depending on the workflow settings, the folder for storing the character code data can be different depending on the document.

In one example, a plurality of documents in which personal information is described together with a personal ID are read by an image reading device 10 to generate a plurality of target image data, so that a plurality of documents are created in a plurality of folders created according to the personal ID. Electronic data corresponding to the described personal information can be individually stored.

Further, by setting a storage location of a plurality of target image data read by the image reading device 10 for a plurality of invoices in which a billing destination, an invoice number, a billing item, and a billing amount are described by a workflow, the billing destination Character code data corresponding to invoice-related information described in a plurality of documents can be individually saved in a plurality of folders created accordingly.

In the above description with reference to FIGS. 1 to 6, in the control unit 17, the pre-conversion processing unit 14 generates the character code data RCD according to a predetermined procedure, but the present embodiment is not limited to this. The pre-conversion processing unit 14 may generate the character code data RCD based on the designation from the user.

Next, the information processing system 100 of the present embodiment will be described with reference to FIG. FIG. 8 is a schematic diagram of the information processing system 100. The information processing system 100 includes an image reading device 10 and an information processing device 20. The information processing system 100 of FIG. 8 has the same configuration as the information processing system 100 described above with reference to FIG. 8 except that the image reading device 10 further includes a display unit 18 and an input unit 18a. .. Therefore, duplicate description will be omitted in order to avoid redundancy.

The image reading device 10 includes a display unit 18 and an input unit 18a in addition to the reading unit 12, the communication unit 16, and the control unit 17. The control unit 17 controls the reading unit 12, the communication unit 16, the display unit 18, and the input unit 18a.

The display unit 18 has a display. For example, the display includes a liquid crystal display or an organic EL display.

The input unit 18a accepts the input of the user's instruction. The input unit 18a includes a keyboard and a mouse. Alternatively, the input unit 18a may include a touch sensor. The display unit 18 and the input unit 18a may be a touch panel in which both are integrated.

The input unit 18a can input information for designating a conversion processing unit that converts the target image data OG that has read the original. The user can specify by the input unit 18a that the pre-conversion processing unit 14 converts the target image data OG.

Alternatively, the user can specify the post-conversion process so that the post-conversion processing unit 22 of the information processing apparatus 20 converts the target image data OG by the input unit 18a. In this case, the communication unit 16 may transmit a designated signal indicating that the post-conversion processing unit 22 has been designated to the communication unit 26 of the information processing device 20. The designated signal may be transmitted immediately before, at the same time, or immediately after the transmission of the target image data OG.

The information processing device 20 includes a post-conversion processing unit 22, a communication unit 26, a control unit 27, and a storage unit 27s. The storage unit 27s stores the recognition rate information 27t and the threshold value information 27u.

The recognition rate information 27t is divided into recognition rates for each conversion process. Specifically, the recognition rate information 27t is divided into a pre-recognition rate by the pre-conversion processing unit 14 and a post-recognition rate by the post-conversion processing unit 22. The storage unit 27s stores the post-recognition rate as the recognition rate information 27t, while the pre-recognition rate may be stored in the image reading device 10.

Further, it is preferable that the recognition rate information 27t is divided into recognition rates for each workflow. In this case, since the format of the manuscript is the same, it is highly probable that the judgment using the past recognition rate is appropriate.

The threshold information 27u is preferably divided into thresholds for each workflow. For example, when converting many numbers described in a manuscript, the threshold value may be low. Alternatively, when converting many sentences described in the manuscript, it is preferable that the threshold value is high. In this way, the threshold value to be used may be different depending on the type of characters described in the manuscript. The storage unit 27s may store the threshold information for the post-conversion process as the threshold information 27u, while the threshold information for the pre-conversion process may be stored in the image reading device 10.

According to the present embodiment, the image reading device 10 can select a conversion processing unit that converts image data obtained by scanning a document. Therefore, the user of the image reading device 10 can determine which conversion processing unit should convert the image data obtained by scanning the original according to the user's request.

The image reading device 10 preferably displays information about the conversion process to the user before the user specifies which conversion processing unit performs the conversion process. The display unit 18 displays information about the conversion process before selecting the pre-conversion process and the post-conversion process.

In this case, it is preferable that the image reading device 10 reads the information about the conversion process from the information processing device 20 before the display unit 18 displays the information about the conversion process. The communication unit 16 of the image reading device 10 requests the communication unit 26 of the information processing device 20 to transmit the recognition rate information 27t of the storage unit 27s. The communication unit 26 transmits the recognition rate information 27t to the communication unit 26 in accordance with the request from the communication unit 16. Therefore, the display unit 18 can display the recognition rate information 27t.

Next, the designation of the information processing unit in the image reading device 10 of the present embodiment will be described with reference to FIGS. 1, 2, 8 and 9. 9 (a) to 9 (c) are schematic views of the display screen of the display unit 18 of the image reading device 10.

FIG. 9A is a schematic view of the display screen of the display unit 18 when the reading conversion process of the document R is started. As shown in FIG. 9A, the display screen of the display unit 18 displays a plurality of blocks. The display unit 18 displays four blocks arranged in the left-right direction in the upper direction and displays four blocks arranged in the left-right direction in the lower direction, and displays a total of eight blocks. In the upper leftmost block, "Company A invoice" is displayed as workflow 1. When the user selects this block via the input unit 18a, the communication unit 16 of the image reading device 10 communicates with the communication unit 26 of the information processing device 20, and the storage unit 27s of the information processing device 20 sends "Invoice of company A". Is read out and displayed on the display screen of the display unit 18.

As shown in FIG. 9A, the blocks corresponding to the workflow 2, the workflow 3, and the workflow 4 are displayed in order from the left above the display unit 18, similarly to the leftmost block. Workflow 2 corresponds to "Company A quotation", Workflow 3 corresponds to "Company A purchase order", and Workflow 4 corresponds to "Company B invoice".

Further, blocks corresponding to workflow 5, workflow 6, workflow 7, and workflow 8 are displayed in order from the left at the bottom of the display screen of the display unit 18. Workflow 5 corresponds to "Company B quotation", workflow 6 corresponds to "Company C quotation", workflow 7 corresponds to "transportation expense settlement", and workflow 8 corresponds to "receipt".

For example, when the user of the image reading device 10 reads a document relating to transportation expense settlement, the user of the image reading device 10 selects a block of the workflow 7 via the input unit 18a. When the block of the workflow 7 is selected, the communication unit 16 reads out the recognition rate regarding the transportation expense settlement stored in the storage unit 27s of the information processing device 20 via the communication unit 26 of the information processing device 20. The display unit 18 of the image reading device 10 displays the read recognition rate on the display screen.

FIG. 9B is a schematic view showing a display screen of the display unit 18 when the workflow 7 is selected. As shown in FIG. 9B, the display unit 18 displays a display screen for setting conversion processing information, reading resolution, document size, document orientation, and output destination of character code data.

In the conversion processing information, a selectable conversion processing unit and its cost and recognition rate are displayed. Here, since the information processing device 20 includes a pre-conversion processing unit 14 in which a charge is charged for each use and a post-conversion processing unit 22 in which a charge is not charged for each use, the display unit 18 is used as conversion processing information. The conversion processing unit 14 and the post-conversion processing unit 22 are displayed, and "paid" is attached next to the pre-conversion processing unit 14. Further, the conversion processing information includes the average recognition rate when the pre-conversion processing unit 14 and the post-conversion processing unit 22 read the manuscript related to the transportation expense settlement in the past. The average recognition rate may be the average recognition rate of all manuscripts related to past transportation expense settlement. Alternatively, the average recognition rate may be the average recognition rate of the manuscript regarding the transportation expense settlement for the past month.

In FIG. 9B, the average recognition rate of the pre-conversion processing unit 14 is 80%, and the average recognition rate of the post-conversion processing unit 22 is 75%.

The user of the image reading device 10 can select the pre-conversion processing unit 14 and the post-conversion processing unit 22 from the conversion processing information. For example, the user can select the pre-conversion process by touching the area corresponding to the pre-conversion processing unit 14. In addition, the user can select the post-conversion process by touching the area corresponding to the post-conversion process unit 22.

The display unit 18 displays a plurality of reading resolutions as candidates for reading resolutions. Candidates for reading resolution are 300 × 300, 600 × 600, 1200 × 1200. The user of the image reading device 10 can select the reading resolution from the reading resolutions. For example, the user can select 300 × 300 as the reading resolution of the reading unit 12. When performing the scanning process, the scanning unit 12 scans the document at the selected scanning resolution and generates the target image data. After that, the target image data is transmitted from the communication unit 16 to the communication unit 26 of the information processing device 20.

The display unit 18 displays the candidate size of the original. Here, the candidates for the document size are A3, A4, and A5. The user of the image reading device 10 selects the size of the original from the candidates for the original size. For example, if the size of the document is A4, the user selects A4 as the size of the document. When performing the scanning process, the scanning unit 12 scans the document with the selected size and generates the target image data.

The display unit 18 displays the orientation of the document. Here, the orientation of the document is portrait or landscape. When the orientation of the document is vertical, the longitudinal direction of the document is set so as to extend in the main scanning direction of the reading unit 12. When the orientation of the document is horizontal, the longitudinal direction of the document is set so as to extend in the sub-scanning direction of the reading unit 12. For example, if the longitudinal direction of the document is arranged along the main scanning direction, the user selects the orientation of the document as portrait. When performing the scanning process, the scanning unit 12 scans the document in the area of the selected orientation and size to generate the target image data.

The display unit 18 displays the output destination of the character code data. The character code data converted from the target image data in the information processing device 20 is transmitted to the designated output destination. Here, the character code data is output by e-mail to a predetermined address.

As described above, the post-conversion processing unit 22 in the information processing apparatus 20 is not charged according to its use, while the pre-conversion processing unit 14 may be charged according to its use. In this case, if the past recognition rate of the post-conversion processing unit 22 is relatively high in order to prevent an increase in cost, the recognition rate is relatively high even if the post-conversion processing unit 22 converts the image data of the original document this time. There is a high probability that it will increase. In this case, the display unit 18 may display the pre-conversion processing unit 14 in gray out so that the pre-conversion processing unit 14 is not selected.

FIG. 9C is a schematic diagram showing a display screen of the display unit 18 when workflow 1 is selected. FIG. 9 (c) is similar to FIG. 9 (b) except for the selected workflow and average recognition rate, and thus duplicate description will be omitted.

In FIG. 9C, the average recognition rate of the pre-conversion processing unit 14 is 85%, and the average recognition rate of the post-conversion processing unit 22 is 80%. As described above, in the “company A invoice” of workflow 1, the average recognition rate of the post-conversion processing unit 22 is relatively high. Therefore, there is a high possibility that the post-conversion processing unit 22 can convert the image data of the original into character data with a high recognition rate without using the pre-conversion processing unit 14. Therefore, the display unit 18 displays the pre-conversion processing unit 14 in gray out. As a result, the user of the image reading device 10 selects the post-conversion processing unit 22 instead of the pre-conversion processing unit 14, so that the cost can be suppressed.

Next, the information processing method by the image reading device 10 of the present embodiment will be described with reference to FIGS. 1 and 8 to 10. FIG. 10 is a flow chart of an information processing method of the image reading device 10 of the present embodiment.

First, in step S202, the image reading device 10 displays a display screen for reading and converting the original. Specifically, when the user of the image reading device 10 inputs to the input unit 18a to start the reading conversion process, the display unit 18 displays a display screen for the reading conversion process. For example, the display unit 18 displays the display screen shown in FIG. 9A.

In step S204, the user of the image reading device 10 selects a specific workflow among the display screens for the reading conversion process.

In step S206, the communication unit 16 sends a request to the information processing device 20 to read information about a particular workflow.

In step S208, the communication unit 16 receives information about a specific workflow from the information processing device 20. For example, the communication unit 16 receives the average recognition rate for a specific workflow.

In step S210, the display unit 18 displays information about a particular workflow. For example, the display unit 18 displays the display screen shown in FIG. 9B.

In step S212, the control unit 17 determines whether or not the user's designation for the conversion process has been input to the input unit 18a. When it is determined that there is no input in the input unit 18a (No in step S212), the process returns to step S212 and waits until the input unit 18a receives an input.

When the control unit 17 determines that there is an input in the input unit (Yes in step S212), the process proceeds to step S214.

In step S214, the reading unit 12 reads the original according to the input from the input unit 18a and generates the target image data. When the pre-processing conversion process is selected at the time of input, the pre-conversion processing unit 14 performs the pre-conversion process and generates the character code data RCD from the target image data OG.

In step S216, the communication unit 16 transmits the target image data OG to the information processing device 20. When the character code data RCD is generated, the communication unit 16 transmits the character code data RCD together with the target image data OG to the information processing device 20. As described above, the information processing method by the image reading device 10 is completed.

In this way, the image reading device 10 can specify the pre-conversion process or the post-conversion process. After that, when the character code data RCD is not transmitted, the information processing apparatus 20 converts the target image data OG into the character code data OCD. For example, the information processing device 20 converts the target image data into character code data as described above with reference to FIG. Therefore, the user of the image reading device 10 can convert the original into character code data according to the user's request.

In the above description with reference to FIGS. 8 to 10, the storage unit 27s has stored the pre-recognition rate and the post-recognition rate, but the present embodiment is not limited to this. The storage unit 27s may store the matching rate between the character code data RCD by the pre-conversion processing unit 14 and the character code data OCD by the post-conversion processing unit 22.

Hereinafter, the information processing system 100 of the present embodiment will be described with reference to FIG. FIG. 11 is a schematic diagram of the information processing system 100 of the present embodiment. The information processing system 100 of FIG. 11 has the same configuration as the information processing system 100 described above with reference to FIG. 8, except that the information processing apparatus 20 further includes a comparison unit 25. Therefore, duplicate description will be omitted in order to avoid redundancy.

The information processing device 20 further includes a comparison unit 25 in addition to the post-conversion processing unit 22, the communication unit 26, the control unit 27, and the storage unit 27s. When the character code data CD1 and the character code data CD2 are generated, the comparison unit 25 compares the character code data CD1 with the character code data CD2. The comparison unit 25 generates a match rate between the character code data CD1 and the character code data CD2 based on the comparison result. When the character code data CD1 is equal to the character code data CD2, the match rate is 100%. When the character code data CD1 is completely different from the character code data CD2, the match rate is 0%.

The storage unit 27s stores the match rate information 27v. Further, the storage unit 27s may store a threshold value for determining the match rate. The match rate information may be displayed on the display unit 18 of the image reading device 10.

FIG. 12 is a schematic view showing a display screen of the display unit 18 when a workflow is selected. As shown in FIG. 12, the display unit 18 displays a display screen for setting conversion processing information, reading resolution, document size, document orientation, and output destination of character code data. The display screens of FIGS. 12 (a) and 12 (b) are the displays shown in FIGS. 9 (b) and 9 (c), except that the match rate information is displayed in the conversion processing information. Similar to the screen. Therefore, duplicate description will be omitted in order to avoid redundancy.

FIG. 12A is a schematic diagram showing a display screen of the display unit 18 when the workflow 7 is selected. As shown in FIG. 12A, match rate information is displayed as conversion processing information. Here, the match rate information indicates the match rate between the character code data CD1 and the character code data CD2 when the documents related to the past transportation expense settlement are read. In FIG. 12A, the concordance rate is 98%.

FIG. 12B is a schematic diagram showing a display screen of the display unit 18 when workflow 1 is selected. As shown in FIG. 12B, match rate information is displayed as conversion processing information. Here, the match rate information indicates the match rate between the character code data CD1 and the character code data CD2 when the documents related to the past invoice of company A are read. In FIG. 12B, the concordance rate is 100%. In this case, it is understood that, at least for the past invoices of Company A, the post-conversion process by the post-conversion processing unit 22 is sufficient, and the pre-conversion process by the pre-conversion processing unit 14 is unnecessary. In this way, the user of the image reading device 10 can determine whether or not it is meaningful to use the pre-conversion processing unit 14 instead of the post-conversion processing unit 22 from the viewpoint of the match rate.

As described above, when the match rate is 100%, it is not necessary to use the pre-conversion processing unit 14. Therefore, as shown in FIG. 12B, the display unit 18 may display the pre-conversion processing unit 14 in gray out so that the pre-conversion processing unit 14 is not selected. When the match rate is higher than the match rate threshold value, the display unit 18 may display the pre-conversion processing unit 14 in grayout.

According to the present embodiment, the user of the image reading device 10 can specify an information processing unit for converting the target image data of the original in the image reading device 10. In the above description, the information processing unit designated by the image reading device 10 has converted the target image data into character code data, but the present embodiment is not limited to this. The information processing unit designated by the image reading device 10 converts the target image data into character code data and uses it as output, while the information processing unit not specified by the image reading device 10 converts the target image data into character code data. It may be converted.

In the above description with reference to FIGS. 1 to 12, the information processing apparatus 20 has converted the image data into character code data, but the present embodiment is not limited to this. The information processing device 20 may be capable of extracting and processing a two-dimensional code of image data.

Further, in the above description with reference to FIGS. 1 to 12, the information processing device 20 receives the target image data OG in which the original is read by the image reading device 10, but the present embodiment is not limited to this. The information processing device 20 may receive the target image data OG from another device. For example, the device that transmits the target image data to the information processing device 20 may be a fax device, or another information processing device such as a personal computer (Personal Computer: PC) or a smartphone (Smart Phone). .. Further, the information processing device 20 may process the image data attached to the e-mail. Alternatively, the information processing device 20 may process the image data received via fax communication.

Next, the information processing system of the present embodiment will be described with reference to FIGS. 1 and 13. FIG. 13 is a schematic diagram of the information processing system 100 of the present embodiment.

The information processing device 20 may receive the target image data OG from the multifunction device, the server, or the information processing terminal. Further, the information processing device 20 may receive the target image data OG as an e-mail.

The information processing device 20 can convert the target image data OG into character code data and can extract and read the two-dimensional code. The information processing device 20 stores the converted character code data and the data indicated by the read two-dimensional code. Further, the information processing apparatus 20 may store the converted character code data and the data indicated by the read two-dimensional code as metadata. For example, the data format may be any of XML, PDF, document creation software, spreadsheet software and presentation software.

The information processing device 20 may store the processed data in a predetermined storage element. For example, the information processing device 20 may store the processed data in the storage element of the information processing device 20. Alternatively, the information processing device 20 may output the processed data to an external device that can store the processed data. Alternatively, the information processing device 20 may transmit the processed data as an e-mail to an external device. For example, the information processing device 20 may transmit to an external database or clout storage. Alternatively, the information processing device 20 may transmit the processed data to the image reading device 10 that generated the image data.

Further, the workflow of the information processing device 20 may be set in the image reading device 10. In this case, the application installed in the image reading device 10 can be used.

Further, in the above description with reference to FIGS. 1 to 13, the information processing apparatus 20 has converted the image data into character code data, but the present embodiment is not limited to this. The information processing device 20 may convert the character code data into another character code data. Alternatively, the information processing device 20 may add an electronic signature to the character code data.

The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to the above-described embodiment, and can be implemented in various aspects without departing from the gist thereof. In addition, various inventions can be formed by appropriately combining the plurality of components disclosed in the above embodiments. For example, some components may be removed from all the components shown in the embodiments. In addition, components across different embodiments may be combined as appropriate. The drawings are schematically shown mainly for each component for easy understanding, and the thickness, length, number, spacing, etc. of each component shown are actually shown for the convenience of drawing creation. May differ from. Further, the material, shape, dimensions, etc. of each component shown in the above-described embodiment are merely examples, and are not particularly limited, and various changes can be made without substantially deviating from the effects of the present invention. is there.

The present invention relates to an information processing system and has industrial applicability.

10 Image reader 20 Information processing device 100 Information processing system

Claims (5)

An image reader that reads the original and generates the target image data,
An information processing system including an information processing device that processes the target image data.
The image reading device includes a pre-conversion processing unit capable of converting image data into character code data.
The information processing device includes a post-conversion processing unit capable of converting image data into character code data.
The information processing device
When the character code data obtained by converting the target image data by the pre-conversion processing unit is received from the image reading device, the post-conversion processing unit does not convert the target image data into the character code data.
An information processing system in which the post-conversion processing unit converts the target image data into character code data when the character code data obtained by converting the target image data by the pre-conversion processing unit is not received from the image reading device. The information processing system according to claim 1, wherein the pre-conversion processing unit converts the image data into the character code data with a higher recognition rate than the post-conversion processing unit. The information processing system according to claim 1 or 2, wherein the pre-conversion processing unit is set so that the usage fee increases according to the usage amount. The information processing system according to any one of claims 1 to 3, wherein the post-conversion processing unit is set so that the usage fee does not change according to the usage amount. The post-conversion processing unit
The first conversion processing unit that can convert image data to character code data,
A second conversion processing unit that can convert image data to character code data,
The information processing system according to any one of claims 1 to 4, wherein the first conversion processing unit or the second conversion processing unit includes a selection unit for selecting whether to convert the target image data into a character code. ..

Images