JP6201635B2 - Image processing system, image processing apparatus, and information processing terminal - Google Patents

Description

  The present invention relates to an image processing system including an image processing apparatus having a scanner function and an information processing terminal, and more particularly to a technique for performing image processing on image data obtained by scanning a document and loading the image data into the information processing terminal.

An image processing apparatus such as a copying machine has a scanner for reading a document image, and a copy mode for printing an image on a recording sheet based on the read image data, or a predetermined format for image data read without printing. It has a scan mode to convert and save.
In this scan mode, there is a configuration in which a data storage destination and a data output format can be selected (for example, Patent Document 1).

The image processing apparatus described in Patent Literature 1 can select a storage area in the apparatus, a USB memory, a personal computer connected via a network, and the like as an output format as a data storage destination in the scan mode. A word processor format such as PDF, JPEG, or MS-WORD is selectable.
In particular, when a USB memory is selected as the storage destination, data can be taken into the personal computer via the USB memory, so that there is an advantage that the data does not flow on the network and the network load can be reduced.

JP 2011-71578 A

  However, in the scan mode, when a USB memory is selected as the storage destination, the user cannot scan the document image until the document image is read and data in a predetermined format is generated and stored in the USB memory. I have to wait beside me. In particular, when a character region is extracted from image data and image processing such as text conversion by OCR processing is required as in a word processor format, the waiting time is increased correspondingly and stress is given to the user. There is a problem. In this case, the quality of the read image cannot be confirmed immediately. When the image quality is poor, the user changes the scan mode setting (for example, resolution, gradation, etc.) and reloads the document, so there is a desire to check the image quality as soon as possible.

  The present invention has been made in view of the above-described problems, and captures data obtained by scanning a document into an information processing terminal such as a personal computer via a portable storage medium such as a USB memory. It is an object of the present invention to provide an image processing system, an image processing apparatus, and an information processing terminal that can confirm the quality of a read image earlier than the prior art and that can reduce the network load.

  In order to achieve the above object, an image processing system according to the present invention includes an image processing apparatus having a scanner function, and an information processing terminal connected to the image processing apparatus via a network so as to communicate with each other. An image processing system for generating a file of a predetermined format from image data obtained by scanning, wherein the image processing device includes first image processing means for compressing and converting the image data to generate first intermediate data , Second image processing means for extracting a character region from one of the image data and the first intermediate data and performing image processing different from the first image processing means to generate second intermediate data Writing means for writing the first intermediate data to a portable storage medium; and the second intermediate data to the information processing terminal via a network. The information processing terminal obtains the second intermediate data transmitted from the image processing apparatus and the reading means for reading out the first intermediate data from the portable storage medium. A data acquisition unit; a third image processing unit that generates the file of the predetermined format by combining the first and second intermediate data; and a display unit that displays the first intermediate data. To do.

  Here, the image processing apparatus has storage means for storing a file generation program for generating the file of the predetermined format from the first and second intermediate data, and the file generation program And the third image processing means acquires and executes the file generation program from the portable storage medium in the information processing terminal, whereby a file of a predetermined format is written. It is desirable to have a configuration that generates

In addition, it is preferable that the writing unit is configured not to perform the writing operation of the file generation program when the file generation program is already written in the portable storage medium.
The image processing apparatus includes a selection unit that allows a user to select a file of a predetermined format generated from image data from a plurality of types, and the first to third images corresponding to the selected format file. It is desirable that the image processing executed by the processing means is switched.

  Here, when the PDF file with text having a layer of image data and search text data is included in the plurality of types of files, and the PDF file with text is selected through the selection unit, The first image processing means generates image data of a PDF file as first intermediate data, and the second image processing means performs OCR processing on the character area extracted from the PDF file, Text data as intermediate data is generated, and the third image processing unit is configured to paste the text data layer to the image data layer of the PDF file to generate the PDF file with text. it can.

Further, in the plurality of types of format file contains high-compression PDF file, if the high-compression PDF file via said selection means is selected, said first image processing means, a first intermediate Image data of a PDF file as data is generated, and the second image processing means performs binarization processing on the character area extracted from the PDF file, and the character area as second intermediate data High compression data can be generated, and the third image processing means can replace the character area data in the PDF file image data with the high compression data.

Further, in the plurality of types of format file contains the described tagged files in a markup language, when the tagged file through the selection means is selected, said first image processing means The image data of the PDF file as the first intermediate data is generated, and the second image processing means performs the OCR process on the character area extracted from the PDF file, and the text data as the second intermediate data Is generated, cut out coordinate data for cutting out an area other than the character area of the PDF file is acquired and included in the second intermediate data, and the third image processing means is included in the second intermediate data. Based on the extracted coordinate data, the image data of the area other than the character area is cut out from the PDF file, and the cut-out image data, The text data included in the second intermediate data by adding a predetermined tag may be configured to generate a tagged file.

  The image processing apparatus has storage means for storing the second intermediate data, and the writing means sends information related to a storage destination of the second intermediate data together with the first intermediate data to the portable type. The information processing terminal has storage location information acquisition means for acquiring information on the storage location of the second intermediate data from the portable storage medium, and the data acquisition means However, the second intermediate data may be requested from the image processing apparatus based on the obtained information regarding the storage destination.

Here, the information processing terminal is a portable terminal, and includes a connection unit for connecting to the image processing apparatus without a network, and an internal storage unit used as the portable storage medium. The first intermediate data can be written in the internal storage means in a state where the first intermediate data is connected to the image processing apparatus without going through a network.
In addition, the image processing apparatus includes an access information acquisition unit that acquires information for accessing the portable terminal via the network when writing the first intermediate data to the internal storage unit of the portable terminal. and, pre-Symbol to access the portable terminal based on the information acquired by the access information acquiring means, a second intermediate data generated can be configured to send.

  The image processing apparatus according to the present invention has a scanner function and is communicably connected to an information processing terminal via a network, and compresses and converts image data obtained by scanning a document to obtain a first intermediate First image processing means for generating data, and second image processing for extracting character regions from the first intermediate data and generating second intermediate data by performing image processing different from the first image processing means Means, writing means for writing the first intermediate data to a portable storage medium, and transmission means for transmitting the second intermediate data to the information processing terminal via a network. Features.

An information processing terminal according to the present invention includes a first intermediate for compressing and converting the image data from image data obtained by scanning a document with a scanner function , performing image processing, and generating a file of a predetermined format. Generating data, extracting a character area from one of the image data and the first intermediate data, performing image processing different from the image processing, and generating a file of the predetermined format An image processing apparatus comprising: means for generating second intermediate data; means for writing the first intermediate data to a portable storage medium; means for transmitting the second intermediate data to a network; Read means connected to be communicable and reading the first intermediate data written in the portable storage medium, and via a network Data acquisition means for acquiring second intermediate data transmitted from the image processing apparatus, image processing means for generating a file of a predetermined format by combining the first and second intermediate data, and the first And display means for displaying intermediate data.

  In the image processing system configured as described above, the first intermediate data generated by compressing and converting the image data in the image processing apparatus is taken into the information processing terminal via the portable storage medium, and the first intermediate data The second intermediate data generated by extracting the character area from the image data is transmitted to the information processing terminal via the network, and the information processing terminal generates a file of a predetermined format by combining the first and second intermediate data. It becomes the composition which is done.

According to this configuration, since only the second intermediate data of the first intermediate data and the second intermediate data is transmitted to the information processing terminal via the network, both intermediate data are transmitted via the network. Compared with the case of transmitting to the information processing terminal, the network load can be reduced.
In addition, the user does not have to wait by the image processing apparatus until the second intermediate data is generated. When the first intermediate data is generated and written to the portable storage medium, the portable It becomes possible to take away with the storage medium. Thereafter, the user can read the first intermediate data at the information processing terminal, display it on the display means, and check it, so that the image quality can be checked earlier than before.

It is the schematic which shows the structure of the image processing system which concerns on this Embodiment. 2 is a block diagram illustrating a configuration of each control unit in an MFP and a personal computer constituting an image processing system. FIG. It is a figure which shows an example of the screen which selects the destination which sends the scanned data. It is a figure which shows an example of the screen which selects an output format. 2 is a diagram illustrating an example of a program related to format conversion stored in a ROM included in an MFP. FIG. It is a figure for demonstrating the outline | summary of a scan toUSB process. It is a flowchart which shows the content of a scan toUSB process. It is a flowchart which shows the content of the file production | generation process of a predetermined format. It is a figure which shows an example of the file name of 1st and 2nd intermediate data. It is a figure for demonstrating the content of 2nd intermediate data. FIG. 6 is a sequence diagram showing cooperation between the MFP and a personal computer via a USB memory. It is the schematic which shows the structure of the image processing system which concerns on a modification.

(1) Overall Configuration Hereinafter, an embodiment of an image processing system according to the present invention will be described with reference to the drawings.
FIG. 1 is a schematic diagram showing a configuration of an image processing system according to the present embodiment. A color multifunction peripheral 1 (hereinafter referred to as “MFP 1”) as an image processing apparatus, a personal computer 2, and a network connecting them. (LAN4) is shown.

The MFP 1 includes a printer unit 10, a paper feeding unit 20, a scanner unit 30, an operation panel 40, and a control unit 50 as main components, and executes a print job from an external terminal such as a personal computer 2 connected via the LAN 4. It has a function of receiving instructions and executing printing, and a function of executing various jobs such as scanning, copying, and faxing.
The scanner unit 30 feeds and conveys the original set on the original placement table 31 one by one, reads the original image, and generates image data (scanning).

The printer unit 10 prints on a recording sheet conveyed from the paper feeding unit 20 based on image data read by the scanner unit 30 or image data sent together with a print job from an external terminal (copying, printing). .
The paper feeding unit 20 feeds the recording sheets stored in the paper feeding cassette one by one and transports them to the printer unit 10 in a timely manner.

The operation panel 40 is arranged on the upper part of the printer unit 10 at an easy-to-operate position. The operation panel 40 includes a touch panel type liquid crystal display, operation buttons, and the like, and receives job execution instructions such as scan, copy, and fax from the user, and displays job execution results and the like.
The control unit 50 comprehensively controls the printer unit 10, the paper feeding unit 20, the scanner unit 30, and the operation panel 40.

Further, the MFP 1 has a USB interface (I / F) unit 55 for connecting the USB memory 3 (nonvolatile memory). For example, image data obtained by scanning a document is transferred to the USB I / F unit 55. Via the USB memory 3, so-called scan-to-USB function.
The personal computer 2 has a USB interface (I / F) unit 205 and can capture image data generated by the MFP 1 via the USB memory 3.
(2) Configuration of Control Units of MFP and Personal Computer FIG. 2 is a block diagram showing the configuration of each control unit in the MFP and personal computer.

First, the control unit 200 of the personal computer 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a hard disk 204, the USB I / F unit 205, and a communication I / F unit 206. , Etc.
The CPU 201 executes an operation system (OS), application programs, and the like. The ROM 202 is a storage that stores various programs executed by the CPU 201. A RAM 203 is a work area when the CPU 201 executes a program. The hard disk 204 is a non-volatile storage medium and stores programs and various data installed by the user. The communication I / F unit 206 is an interface such as a LAN card or a LAN board for connecting to a LAN.

The control unit 50 of the MFP 1 includes a CPU 51, a ROM 52, a RAM 53, a hard disk 54, the USB I / F unit 55, a communication I / F unit 56, and the like.
The CPU 51 executes a program for controlling the printer unit 10, the paper feeding unit 20, the scanner unit 30, and the operation panel 40. The ROM 52 is a storage that stores various programs executed by the CPU 51. The RAM 53 is a work area when the CPU 51 executes a program. In the hard disk 54, a plurality of storage areas (BOX) for storing scanned data are set.

When the MFP 1 is turned on and activated, the CPU 51 reads the program from the ROM 52 and displays a mode selection screen (not shown) for selecting a scan, copy, and fax mode on the operation panel 40.
When the scan mode is selected by the user, the CPU 51 selects a setting screen (not shown) for resolution, gradation and the like at the time of scanning, and a destination (save destination) to which the data obtained by scanning is sent to the operation panel 40 A screen 41 (FIG. 3) for selecting an output format and a screen 42 (FIG. 4) for selecting an output format are displayed in order to accept selection by the user.

As shown in FIG. 3, a personal computer, an FTP server, a USB memory, and a BOX for which file sharing is set by the SMB (Server Message Block) protocol can be selected as a destination.
As shown in FIG. 4, PDF (Portable Document Format), JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), searchable PDF, compact PDF, OOXML (Office Open Extensible Markup Language) are available as output formats. It is configured to be selectable.

PDF, JPEG, and TIFF are generated by compressing RAW data (image data) obtained by scanning a document by a known compression technique (PDF compression, JPEG compression, TIFF compression).
A searchable PDF is a PDF with a text layer that enables character search. The image data of the PDF is subjected to a known layout analysis process to extract a character area to be converted into a text (OCR process). Then, the data is generated by superimposing the data on the character area of the PDF image data (image layer) as a layer.

A compact PDF is a PDF with a reduced file size while maintaining image quality. Like a searchable PDF, a character area is extracted from a PDF image data and subjected to a known binarization process. Generated by highly compressing the region.
OOXML is an office suite file format based on markup language XML, which extracts text, graphics, photos, and other areas from image data (for example, PDF), and converts text areas into text. Based on the specifications (known) of OOXML, each region is generated with an appropriate tag.

  Hereinafter, image processing for generating PDF, JPEG, or TIFF image data from RAW data is referred to as “first image processing”. Further, image processing that extracts a character region from image data that has undergone first image processing and performs OCR, binarization, etc. on the extracted character region is referred to as “second image processing”. A process of generating searchable PDF, compact PDF, or OOXML by combining data generated by image processing (each also referred to as “first and second intermediate data D1, D2”) is referred to as “third image processing”. . In the case of OOXML, the second image processing includes extraction of non-character areas such as figures and photographs from image data, and processing for generating tags of character areas and non-character areas.

FIG. 5 is a diagram illustrating an example of a program related to format conversion stored in the ROM 52 of the MFP 1.
As shown in the figure, the ROM 52 includes programs P1 to P3 that generate PDF, JPEG, and TIFF image data (first intermediate data D1) from raw data, a layout analysis program P4 that extracts areas such as characters, A combination of OCR processing, binarization processing, tag generation programs P5 to P7, and first and second intermediate data D1 and D2 for generating second intermediate data D2 from the extracted region, Stored are programs Pa to Pc for generating files of compact PDF and OOXML.

The CPU 51 reads and executes a corresponding program from the ROM 52 in accordance with the selected output format.
On the other hand, the personal computer 2 has a program for displaying the image data (PDF, JPEG, TIFF) installed on the hard disk 204 (not shown) (for example, Acrobat Reader for PDF display).

(3) Scan to USB processing In “scan to USB processing” when a USB memory is selected as the destination, the user must wait by the MFP 1 until data is stored in the USB memory. When a file in a format that requires image processing (second image processing) is output, the waiting time is significantly increased, which causes stress on the user. In addition, during this time, it is inconvenient that the quality of the image data obtained by the first image processing cannot be confirmed.

Therefore, in the present embodiment, in the scan-to-USB process, the above first to first processes are performed so as to reduce the network load while shortening the waiting time of the user and enabling the quality check of the image data to be performed as soon as possible. The third image processing is configured to be shared between the MFP 1 and the personal computer 2.
FIG. 6 is a diagram for explaining the outline of the scan-to-USB process in the present embodiment. In the figure, a case where searchable PDF is output is illustrated.

As shown in FIG. 6, in the present embodiment, the MFP 1 is configured to perform the first and second image processing X1, X2, and the personal computer 2 is configured to perform the third image processing X3.
The MFP 1 delivers the first intermediate data D1 generated by the first image processing X1 to the personal computer 2 via the USB memory 3, and the second intermediate data D2 (text data) generated by the second image processing is transferred to the LAN 4 To the personal computer 2 via. After acquiring the first and second intermediate data D1 and D2, the personal computer 2 performs a third image processing X3 to generate a file in a predetermined format (here, a searchable PDF).

As a result, when the first image processing X1 is completed, the user removes the USB memory 3 from the MFP 1 and returns to the personal computer 2 (or a nearby personal computer) and scans the image data (first image). 1 intermediate data D1) can be displayed and confirmed.
Here, the second intermediate data D2 is transmitted to the personal computer 2 via the LAN 4. However, the second intermediate data D2 is text data and is compared with the first intermediate data D1 serving as image data. Since the data size is small, the network load can be reduced as compared with the case where the first intermediate data D1 is transmitted via the LAN 4.

Hereinafter, the processing on the MFP 1 side is referred to as “scan to USB processing”, and the processing on the personal computer 2 side is referred to as “predetermined format file generation processing”.
FIG. 7 is a flowchart showing the contents of the “scan to USB process” executed by the MFP 1.
This control is performed as a subroutine of a main flowchart (not shown) for controlling the entire MFP 1.

  The control unit 50 of the MFP 1 accepts designation of the scan-to-USB mode by selecting a USB memory as a data storage destination in the scan mode from the operation panel 40 (step S101), and the USB I / F unit 55 receives the USB memory. 3 is connected (step S102: Yes), the output format selection screen 42 (FIG. 4) is displayed on the operation panel 40 (step S103). If the USB memory 3 is not connected (step S102: No), the output format selection screen 42 is displayed after waiting for the connection.

Thereafter, the control unit 50 determines whether a format that requires image processing (second image processing) on the character area (here, searchable PDF, compact PDF, OOXML) is selected as the output format. The process is switched (step S104).
First, when a format (PDF, JPEG, TIFF) that does not require image processing for a character area is selected (step S104: No), the control unit 50 reads one document set on the document table 31. The RAW data is generated by scanning out each time (step S113), and the first image processing is executed (step S114). The image data generated by the first image processing is stored in the USB memory 3 (step S115).

The first image processing is performed by reading and executing a program (any one of P1 to P3 in FIG. 5) stored in the ROM 52 for generating the selected format data.
The file name of the image data when stored in the USB memory 3 is not particularly limited, and can be created mechanically using the date and time stored in the USB memory 3 (see FIG. 9).

Subsequently, the control unit 50 displays a message “USB memory can be removed” on the operation panel 40 (step S116), and returns to the main flowchart (not shown).
By viewing this message, the user can remove the USB memory 3 from the MFP 1 and return to his or her personal computer 2 or display and confirm image data obtained by scanning on a nearby personal computer.

  Even when a format that requires image processing for the character area is selected (step S104: Yes), first, the control unit 50 feeds and scans the original set on the original placement table 31 one by one. (Step S105), the first image processing is executed (step S106), and the generated image data (first intermediate data D1) is stored in the USB memory 3 (step S107). Up to this point, the processing is the same as steps S113 to S115, but the subsequent processing is different.

  That is, after that, the file name and storage location information of the second intermediate data D2 to be generated in the subsequent step S111 (second image processing) and the first and second intermediate data D1 and D2 are selected in combination. A program (one of Pa to Pc in FIG. 5) for generating a file of the formatted format is written and stored in the USB memory 3 (steps S108 and S109). Here, the second intermediate data acquisition program Pd (FIG. 5) is written and stored in the USB memory 3 together with the program (any one of Pa to Pc) (see also FIG. 6).

The second intermediate data acquisition program Pd is a program for acquiring the second intermediate data D2 from the MFP 1 via the network based on the file name and storage location information of the second intermediate data D2. This is to reduce the user load when acquiring the second intermediate data D2 from the personal computer 2.
The file name of the second intermediate data D2 is not particularly limited. For example, “No2” is added to the file name of the first intermediate data D1 to form the file name of the second intermediate data D2. It does not matter (see FIG. 9). In this way, the user can easily grasp the correspondence between the first intermediate data D1 and the second intermediate data D2 from the file name.

The storage location information is, for example, the IP address of the MFP 1, the folder path of the hard disk 54 that stores the second intermediate data D2, and the like, and is used when acquiring the second intermediate data D2 via the LAN 4. .
After step S109, a message “USB memory can be removed” is displayed on the operation panel 40 (step S110). At this time, the user can remove the USB memory 3 from the MFP 1 and return to his / her personal computer 2 or display and confirm image data obtained by scanning on a nearby personal computer.

Subsequently, the control unit 50 executes second image processing (step S111), saves the generated second intermediate data D2 with the file name in the storage destination (step S112), and is not illustrated. Return to the main flowchart.
In the second image processing, for the first intermediate data D1 (stored in the RAM 53) generated in step S106, first, an area such as a character is extracted by executing the layout analysis program P4 (see FIG. 5). Then, the program (one of P5 to P7 in FIG. 5) for creating the second intermediate data D2 is executed from the extracted area.

FIG. 10 is a diagram for explaining the contents of the second intermediate data D2 generated by the second image processing.
As shown in the figure, in the case of searchable PDF, the second intermediate data D2 is composed of character data (text data) and extracted coordinate data (text data) of a character region extracted and cut out. . Here, the “cutout coordinate data” is coordinate data indicating the relative position of the outline of the character area extracted from the image data (for example, PDF) within the corresponding page of the image data, and is analyzed by layout analysis. Output by the program P4.

The second intermediate data D2 in the case of a compact PDF is composed of binarized character area data (binary data) and character area cut-out coordinate data.
The second intermediate data D2 in the case of OOXML is composed of text data with a tag including character data and cut-out coordinate data of a non-character area such as a figure or a photograph. The “tag” here is set based on a predetermined criterion by the tag generation program P7. Here, instead of the link destination information of the image of the non-character area such as a figure or a photograph, the cut-out coordinate data of each area is described in the tag.

This completes the “scan to USB process”.
(4) Predetermined Format File Generation Process FIG. 8 is a flowchart showing the contents of the “predetermined format file generation process” executed by the personal computer 2.
When the USB memory 3 storing the file generation program (any one of Pa to Pc in FIG. 5) having a predetermined format is connected to the USB I / F unit 205, the control unit 200 of the personal computer 2 is connected (step S201: Yes). First, a program for displaying the first intermediate data from the hard disk 204 (here, Acrobat Reader) is started, and the first intermediate data D1 is read from the USB memory 3 and displayed on the display 210 (FIG. 6) ( Step S202).

At the same time, an icon 220 (FIG. 6) for starting the second intermediate data acquisition program Pd is displayed on the display 210.
The user looks at the image data (first intermediate data D1) displayed on the display 210 and confirms whether the image quality is good. If there is no particular problem, the user clicks the icon 220 to obtain the second intermediate data. Along with the acquisition of D2, it is possible to instruct generation of a file in a predetermined format.

  When the control unit 200 accepts an acquisition instruction for the second intermediate data D2 through the click of the icon 220 (step S203: Yes), the control unit 200 activates the second intermediate data acquisition program Pd and stores the second intermediate data acquisition program Pd. The file name and storage location information of the intermediate data D2 of No. 2 are read (step S204), and then the MFP 1 is requested to transmit the second intermediate data D2 based on the storage location information (step S205).

Thereafter, if the second intermediate data D2 is sent and received from the MFP 1 (step S206: Yes), the control unit 200 combines the first and second intermediate data D1 and D2 and has the selected format. A program for generating a file (any one of Pa to Pc) is activated to execute the third image processing (step S207).
The file of the predetermined format generated by the third image processing is displayed on the display 210 and stored in the hard disk 204 (step S208), and the process returns to the main flowchart (not shown).

  In the third image processing, when generating a searchable PDF file, the control unit 200 generates a PDF text layer from the character data of the second intermediate data D2 by executing the searchable PDF generation program Pa. A searchable PDF is generated by superimposing the text layer on the image layer of the first intermediate data D1 based on the cut coordinate data of the character area.

  When generating a compact PDF file, the control unit 200 executes the character in the first intermediate data D1 based on the extracted coordinate data of the character area of the second intermediate data D2 by executing the compact PDF generation program Pb. A compact PDF is generated by extracting the area and replacing the extracted character area data with the binarized character area data included in the second intermediate data D2.

  When generating the OOXML file, the control unit 200 extracts image data from the first intermediate data D1 based on the extracted coordinate data described in the tag by executing the OOXML generation program Pc. The data is stored in a predetermined data storage destination (for example, a storage folder created in the hard disk 204), and OOXML is generated by describing the storage destination as a link destination instead of the cut-out coordinate data in the tag.

This completes the “predetermined format file generation process”.
FIG. 11 is a sequence diagram showing how the “scan to USB process” of the MFP 1 and the “file generation process of a predetermined format” of the personal computer 2 are linked via the USB memory 3.
In the figure, the processes after the execution of the scan in the MFP 1 (step S105) are shown. Each process shown in FIG. 11 is the same as the process of the flowcharts shown in FIGS. 7 and 8, and therefore, the same step numbers are given here and the description thereof is omitted.

  In the present embodiment, the control unit 50 of the MFP 1 functions as a first image processing unit that generates the first intermediate data D1 when executing step S106 in FIG. 7, and executes step S111 in FIG. Sometimes it functions as a second image processing means for generating the second intermediate data D2. Further, the control unit 50 functions as a writing means for writing to the portable storage medium (USB memory 3) when executing step S107 in FIG. 7, and in step S206 in FIG. When the second intermediate data D2 is transmitted to), it functions as a transmission means.

  The control unit 200 of the personal computer 2 functions as a reading unit that reads the first intermediate data D1 when executing step S202 of FIG. 8, and the second intermediate data D2 when executing step S206 of FIG. 8 and functions as third image processing means for generating a file in a predetermined format when step S207 of FIG. 8 is executed. Further, when the control unit 200 executes step S204 in FIG. 8, it functions as a storage location information acquisition unit that acquires information related to the storage location of the second intermediate data.

<Modification>
The present invention is not limited to the above-described embodiment, and the following modifications can be considered.
(1) In the above embodiment, the USB memory is used as the portable storage medium. However, the present invention is not limited to this.

For example, a memory card such as an SD card can be used. In this case, a memory card is added to the screen for selecting a destination shown in FIG.
In addition, a built-in memory of a mobile terminal such as a smartphone or a PDA can be used.
FIG. 12 is a diagram for explaining a configuration when a smartphone is used.
A smartphone 5 shown in the figure is connected to a router (not shown) on the LAN 4 by Wi-Fi, and is communicably connected to the MFP 1 via a wireless LAN and a wired LAN.

Note that when acquiring the first intermediate data generated by the MFP 1, the Wi-Fi connection is temporarily canceled to reduce the network load, and the local connection (for example, Bluetooth ( (Registered trademark) connection).
In this case, it is configured such that a Bluetooth-connected terminal can be selected on the screen for selecting a destination shown in FIG. Then, scanning by the MFP 1 is executed in a state where the smartphone 5 and the MFP 1 are connected via Bluetooth, and the generated first intermediate data D1 is written and stored in the nonvolatile built-in memory of the smartphone 5.

At this time, as in the above embodiment, the file name and storage location information of the second intermediate data D2 may be written in the built-in memory, but here, as soon as the MFP 1 generates the second intermediate data D2, The second intermediate data D2 is transmitted to the smartphone 5 via the network.
Specifically, for example, in the MFP 1, when the control unit 50 writes the first intermediate data D 1 in the smartphone 5, the MAC address of the smartphone 5 is acquired and stored in the RAM 53 or the hard disk 54. When the intermediate data D2 of 2 is generated, the IP address of the smartphone 5 can be acquired by a RARP (Reverse Address Resolution Protocol) command and transmitted via the network.

As a result, the user does not need to confirm whether or not the second intermediate data D2 has been generated. As soon as the second intermediate data D2 is produced, the user can immediately create a file in the predetermined format (searchable PDF in FIG. 12). Can be generated and acquired.
The local connection is not limited to the Bluetooth connection. For example, an infrared connection, a Wi-Fi Direct connection, or a wired connection via a USB cable may be used.

(2) In the above embodiment, the second intermediate data D2 generated by the MFP 1 is temporarily stored in the hard disk 54 and transmitted if requested by the personal computer 2. However, the present invention is not limited to this. Absent.
For example, as in the modification example (1), when the second intermediate data D2 is generated, the personal computer 2 may transmit the second intermediate data D2. In the destination selection screen 42 in FIG. 4, the first intermediate data D1 and the second intermediate data D2 can be individually selected, and the USB memory 3 is set as the destination of the first intermediate data D1. By selecting the personal computer 2 as the destination of the second intermediate data D2, the second intermediate data D2 can be transmitted to the personal computer 2 as soon as the second intermediate data D2 is generated.

(3) In the above embodiment, a configuration has been described in which a file generation program (Pa to Pc in FIG. 5) of a predetermined format is written into the USB memory 3 and introduced into the personal computer 2 via the USB memory 3. Not what you want.
For example, the user may operate the personal computer 2 to access the ROM 52 of the MFP 1 and obtain a file generation program of a predetermined format. In this way, the waiting time of the user can be shortened by the amount that writing of the file generation program to the USB memory 3 becomes unnecessary.

(4) In the above embodiment, the configuration is shown in which the program Pd for obtaining the second intermediate data D2 is written in the USB memory 3 and introduced into the personal computer 2 via the USB memory 3. However, the present invention is not limited to this. Absent.
For example, the user may operate the personal computer 2 to access the ROM 52 of the MFP 1 and acquire the second intermediate data acquisition program Pd. In this case as well, the waiting time of the user can be shortened because the second intermediate data acquisition program Pd need not be written to the USB memory 3.

  The acquisition of the second intermediate data D2 is not limited to the configuration of automatic acquisition by a program. For example, the user can operate the personal computer 2 to manually acquire the second intermediate data D2. It doesn't matter. The user can access and acquire the MFP 1 based on the file name and storage location information of the second intermediate data D2 stored in the USB memory 3.

(5) Although the above embodiment has been described on the assumption that the program for displaying the first intermediate data is installed in the hard disk 204 of the personal computer 2 in advance, the present invention is not limited to this configuration.
For example, even with widely used image formats such as PDF, JPEG, and TIFF, a program for displaying the image is not always installed on the user's personal computer. Therefore, the MFP 1 uses the first intermediate data. When writing D1 to the USB memory 3, a program for displaying the first intermediate data D1 may be written to the USB memory 3 together. This saves the user the trouble of searching for or downloading a program for displaying images on the Internet.

(6) In the above embodiment, the personal computer 2 first displays and confirms the first intermediate data D1, and then obtains the second intermediate data D2 to generate a file of a predetermined format. However, the present invention is not limited to this.
For example, when the user can predict the image quality of the first intermediate data D1 to some extent from the resolution, gradation, etc. specified when the scan mode is set, the first intermediate data D1 is displayed. The step of confirming (step S202 in FIG. 8) may be skipped, and a file having a predetermined format may be generated.

  Specifically, for example, a selection screen (program) for selecting whether to display the first intermediate data D1 or to generate a file of a predetermined format is prepared and written to the USB memory 3 together with the file generation program and the like. When the USB memory 3 is connected to the personal computer 2, the user can select whether or not to display the first intermediate data D1 by configuring the selection screen to be automatically displayed (Autorun function). can do.

  (7) In the above embodiment, the data obtained by one scan and each program for generating a file are written in the USB memory 3 and a file in a predetermined format is generated in the personal computer. Thereafter, when the scanned data is written to the same USB memory 3, each program for generating a file may not be written to the USB memory 3 if the output format is the same.

  In this case, a plurality of file names and storage destination information of the first intermediate data D1 and the second intermediate data D2 are stored in the USB memory 3, so that the first intermediate data D1 on the personal computer 2 side is stored. It is desirable to select the first intermediate data D1 and the second intermediate data D2 to be selected when displaying, acquiring the second intermediate data D2, and generating a file of a predetermined format.

  On the other hand, when the output format is different in the above, the corresponding file generation program is written in the USB memory 3, and the user can select and start the file generation program in the output target format on the personal computer 2 side. . For example, if a selection screen (program) for selecting one program from a plurality of file generation programs is prepared, it is easy for the user to select and the convenience can be improved.

  Further, for example, in a personal computer, after a file of a predetermined format is generated by the third image processing, the data stored in the USB memory 3 (the file names of the first intermediate data D1 and the second intermediate data D2, the storage destination) Information and programs for generating files) may be deleted. When the next scanned data is written to the USB memory 3 by the erasure, it is not necessary to determine whether or not the corresponding file generation program is written to the USB memory 3, and the first intermediate data on the personal computer side. Since it is not necessary to select D1 from a plurality, it is possible to simplify the control.

(8) In the above embodiment, the second intermediate data D2 is generated by extracting a region such as a character from the first intermediate data D1 and performing predetermined image processing. For example, the second intermediate data D2 may be generated from RAW data obtained by scanning a document.
(9) In the above embodiment, the description has been given using the so-called sheet-through scan mode configuration in which the document set on the document placement table 31 is fed out and scanned one by one. However, the present invention is not limited to this. For example, the present invention can be applied to a mirror scan mode in which an original is placed on a platen glass and scanned.

(10) In the above embodiment, a color multifunction peripheral is used as the image processing apparatus. However, the scope of the present invention is not limited to this, and the present invention is applicable to a monochrome multifunction peripheral, a color scanner, a monochrome scanner, and the like. Can do.
Further, the contents of the above-described embodiment and modification examples may be combined as much as possible.

  The image processing system according to the present invention is useful as a technique for reducing the network load when capturing image data obtained by scanning a document into an information processing terminal and enabling quick confirmation of image quality. is there.

1 MFP
2 PC 3 USB memory 4 Network 10 Printer unit 20 Paper feed unit 30 Scanner unit 40 Operation panel 50 Control unit 200 Control unit 210 Display

Claims (12)

An image processing apparatus having an image processing apparatus having a scanner function and an information processing terminal connected to the image processing apparatus through a network so as to generate a file in a predetermined format from image data obtained by scanning a document A processing system,
The image processing apparatus includes:
First image processing means for compressing and converting the image data to generate first intermediate data;
A second image processing means for extracting a character region from one of the image data and the first intermediate data, and performing image processing different from the first image processing means to generate second intermediate data; ,
Writing means for writing the first intermediate data to a portable storage medium;
Transmission means for transmitting the second intermediate data to the information processing terminal via a network,
The information processing terminal
Reading means for reading first intermediate data from the portable storage medium;
Data acquisition means for acquiring second intermediate data transmitted from the image processing device;
Third image processing means for generating a file of the predetermined format by combining the first and second intermediate data;
An image processing system comprising: display means for displaying the first intermediate data. The image processing apparatus has storage means for storing a file generation program for generating a file of the predetermined format from the first and second intermediate data,
The file generation program is written to the portable storage medium by the writing means,
2. The information processing terminal according to claim 1, wherein the third image processing unit generates a file of a predetermined format by acquiring and executing the file generation program from the portable storage medium. The image processing system described. The image processing according to claim 2, wherein the writing unit does not perform a writing operation of the file generation program when the file generation program is already written in the portable storage medium. system. The image processing apparatus includes a selection unit that allows a user to select a predetermined format file generated from image data from a plurality of types.
2. The image processing system according to claim 1, wherein image processing executed by the first to third image processing units is switched corresponding to a file of a selected format. The PDF file with text having a layer of image data and search text data is included in the files of the plurality of types of formats,
When a PDF file with text is selected via the selection means, the first image processing means generates image data of a PDF file as first intermediate data,
The second image processing means performs OCR processing on the character region extracted from the PDF file, and generates text data as second intermediate data;
5. The image processing system according to claim 4, wherein the third image processing unit pastes a text data layer to an image data layer of the PDF file to generate the PDF file with text. 6. Among the plurality of types of files, a highly compressed PDF file is included,
If high-compression PDF file via said selection means is selected, the first image processing unit generates image data of the PDF file as first intermediate data,
The second image processing means performs binarization processing on the character region extracted from the PDF file, and generates highly compressed data of the character region as second intermediate data;
5. The image processing system according to claim 4, wherein the third image processing unit replaces data in a character area in the image data of the PDF file with the highly compressed data. Among the plurality of types of files, a tagged file written in a markup language is included,
When a tagged file through the selection means is selected, the first image processing unit generates image data of the PDF file as first intermediate data,
The second image processing means performs OCR processing on the character area extracted from the PDF file, generates text data as second intermediate data, and cuts out an area other than the character area of the PDF file. Obtaining the output coordinate data and including it in the second intermediate data;
The third image processing means cuts out image data of an area other than a character area from the PDF file based on the cut-out coordinate data included in the second intermediate data, the cut-out image data, and the second image data 5. The image processing system according to claim 4, wherein a tagged file is generated by adding a predetermined tag to text data included in the intermediate data. The image processing apparatus has storage means for storing the second intermediate data,
The writing means is configured to write information related to a storage destination of the second intermediate data together with the first intermediate data to the portable storage medium,
The information processing terminal has storage location information acquisition means for acquiring information related to the storage location of the second intermediate data from the portable storage medium,
8. The image processing according to claim 1, wherein the data acquisition unit requests the second intermediate data from the image processing device based on the obtained information on the storage destination. system. The information processing terminal is a portable terminal, and has a connection means for connecting to the image processing apparatus without going through a network, and an internal storage means used as the portable storage medium,
The image processing system according to any one of claims 1 to 7, wherein the first intermediate data is written in the internal storage unit in a state where the image processing apparatus is connected to the internal storage unit without going through a network. The image processing apparatus includes an access information acquisition unit that acquires information for accessing the portable terminal via a network when writing the first intermediate data in the internal storage unit of the portable terminal . the image processing system according to claim 9, before Symbol accessing the portable terminal based on the information acquired by the access information acquiring means, and transmits the second intermediate data generated. An image processing apparatus that has a scanner function and is communicably connected to an information processing terminal via a network,
First image processing means for compressing and converting image data obtained by scanning a document to generate first intermediate data;
A second image processing unit that extracts a character region from the first intermediate data and performs image processing different from the first image processing unit to generate second intermediate data;
Writing means for writing the first intermediate data to a portable storage medium;
An image processing apparatus comprising: a transmission unit configured to transmit the second intermediate data to the information processing terminal via a network. The image data is compressed and converted from image data obtained by scanning a document with a scanner function , image processing is performed, and first intermediate data for generating a file of a predetermined format is generated. Means for extracting a character region from any one of the first intermediate data and the first intermediate data, performing image processing different from the image processing, and generating second intermediate data for generating the file of the predetermined format An information processing terminal connected to the image processing apparatus including means for writing the first intermediate data in a portable storage medium and means for transmitting the second intermediate data to a network, and capable of communicating via the network Because
Reading means for reading the first intermediate data written in the portable storage medium;
Data acquisition means for acquiring second intermediate data transmitted from the image processing apparatus via a network;
Image processing means for generating a file of a predetermined format by combining the first and second intermediate data;
An information processing terminal comprising display means for displaying the first intermediate data.

Images