JP2019110514A - Image processing apparatus, image processing system, method, and program - Google Patents

Abstract

To make it possible to flexibly apply various settings and image processing to an image obtained by scanning a document.SOLUTION: One embodiment of the invention is an image processing apparatus comprising: at least a body having a scanner; and an operating unit operating the body, wherein the operating unit includes: an input unit for inputting setting information and an instruction to read a document with the scanner; a storage control unit that, when the setting information is input, stores at least the setting information in a storage area of the operating unit; a request unit that, when the execution of reading is input, requests the body to read the document with the scanner; and a processing unit that, after acquiring from the body a scanned image read in response to the request, applies processing to the scanned image on the basis the setting information stored in the storage area.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing system, a method, and a program.

  Conventionally, when scanning a document, the user sets the color, resolution, and the like when reading the document using an operation unit provided in an image processing apparatus (scanner, MFP, etc.). The image processing apparatus reads an image of a document based on settings set by the user, and outputs the data.

  There is a disclosure of a technique for processing and outputting an image at the time of scanning. For example, there is disclosed a technology in which documents such as a plurality of business cards are placed, read together, cut out of a business card image and skewed and output (see Patent Document 1).

  However, when scanning a special document such as a small document, an application that can flexibly cope with various usage scenes and usages of the user is required, but various settings and image processing can be flexibly made in response to such various usages. Could not do.

  The present invention has been made in view of the above, and provides an image processing apparatus, an image processing system, a method, and a program capable of flexibly performing various settings and image processing on an image obtained by scanning a document. To aim.

  In order to solve the problems described above, an image processing apparatus according to an embodiment of the present invention has at least a main body having a scanner and an operation unit for operating the main body. The operation unit stores at least the setting information in a storage area of the operation unit when the setting information and an input unit for inputting an instruction to read a document by the scanner and the setting information is input. After a storage control unit, a request unit requesting the main body to read the document by the scanner when the reading execution is input, and a scanned image read in response to the request are acquired from the main body, And a processing unit that performs processing on the scan image based on the setting information stored in the storage area.

  According to the present invention, it is possible to flexibly apply various settings and image processing to an image obtained by scanning a document.

FIG. 1 is a schematic explanatory view of image processing performed by an image processing apparatus (or an image processing system) according to the embodiment. FIG. 2 is a diagram showing an appearance configuration of the MFP shown as an example of the “image processing apparatus” according to the first embodiment. FIG. 3 is a diagram showing an example of the hardware configuration of the MFP. FIG. 4 is a view showing an example of functions exhibited by the main body and the operation panel. FIG. 5 is a diagram illustrating an example of a plurality of APIs by operation type provided by the Web API service unit. FIG. 6 is a diagram showing an example of a setting screen for setting setting values of image processing. FIG. 7 is a diagram showing an example of an action setting screen for setting a process to be executed by the main body. FIG. 8 is a view showing an example of a file type setting screen for setting a file type to be output. FIG. 9 is a view showing an example of a setting confirmation screen for confirming the setting. FIG. 10 is a diagram showing an example of the transmission destination setting screen for setting the transmission destination of the output image. FIG. 11 is a view showing an example of a preview screen for previewing an image before output after image processing. FIG. 12 is a diagram showing an example of the process flow of the operation panel. FIG. 13 is a diagram illustrating an example of a processing flow of image processing. FIG. 14 is a diagram showing an example of procedures of image processing when the filter processing is set to OFF and when the filter processing is set to ON. FIG. 15 is a sequence diagram showing an example of the operation of the entire MFP. FIG. 16 is an explanatory diagram of image processing when scanning is performed in a closed state in the operation panel according to the first modification. FIG. 17 is a view showing an example of the file type setting screen according to the second modification. FIG. 18 is a diagram illustrating an example of the overall operation of the MFP according to the second modification. FIG. 19 is a diagram illustrating an example of the operation of the image processing system according to the second embodiment.

  Hereinafter, embodiments of an image processing apparatus, an image processing system, a method, and a program according to the present invention will be described in detail with reference to the attached drawings. In the following, examples of application to an MFP (Multifunction Peripheral) will be shown as the “image processing apparatus” and the “image processing system”.

  The image processing apparatus according to the embodiment has at least a main body having a scanner and an operation unit for operating the main body. An operation unit, an input unit for inputting setting information and an instruction to read an original with a scanner, and a storage control unit for storing at least setting information in a storage area of the operation unit when the setting information is input; A request unit that requests the main unit to read an original by the scanner when read execution is input, and a scanned image read according to the request are acquired from the main unit and stored in a storage area for the scanned image. And a processing unit that performs processing based on the setting information. The following image processing apparatus is one variation, and is not limited to this.

  FIG. 1 is a schematic explanatory view of image processing performed by an image processing apparatus (or an image processing system) according to the embodiment. In FIG. 1, the main body controller A1, the application A2, the input key A3, the setting area A4, the scanner A5, the image area A6, the plotter A7, and the network processing unit A8 are mainly involved in image processing. And show. The plotter A7 may be excluded from the configuration of the image processing apparatus (or image processing system) according to the embodiment. Also, there may be cases where functions other than the plotter A7 can be included in the configuration.

  As shown in FIG. 1, for example, a main body controller A1, a scanner A5, an image area A6, a plotter A7, and a network processing unit A8 are provided in the main body 10 of the MFP, and an application A2, an input key A3 and a setting area A4 is provided with the operation unit 20 for operating the main body 10 of the MFP. The network processing unit A8 may be provided on the operation unit 20 side, or may be provided on both the main unit 10 of the MFP and the operation unit 20.

  The main body controller A1 is a controller of the main body 10 of the MFP. The application A2 is an application that operates on the operation unit 20 side, performs image processing and the like on a read image D1 described later, and outputs an output image D2. The input key A3 is a part of the "input unit", and the operation unit 20 receives an input such as an operation from the user. The input key A3 is, for example, a hardware key provided in the operation unit 20, a software key provided by the application A2 on the operation screen, or the like. The setting area A4 is a storage area for storing setting information B1 indicating an output form of an image. The scanner A5 is a scanner (also referred to as a “reading scanner”) that reads an image of a document. Reading of a document by the scanner A5 is also referred to as "scanning" or "scanning". The image area A6 is a storage area for storing a read image D1 (also referred to as a "scanning image", a "scan image", or an "original scan image") read by the scanner A5. The plotter A7 is an example of the "image forming unit", and forms the output image D2 of the application A2 on a recording medium such as a recording sheet. The network processing unit A8 transmits the output image D2 of the application A2 to another device on the network.

  In the configuration shown in FIG. 1, first, the user performs an input operation with the input key A3 to set setting information B1 indicating an output form of the read image D1 in the setting area A4 of the application A2, and instructs start of scanning. (S1). That is, the setting information B1 is input by the input operation of the input key A3, and the instruction and the execution of the scanning are input. In response to the instruction to start the scanning, the application A2 transmits a request C1 to the main controller A1 (S2). The request C1 requests execution of scanning for taking over the read image D1. Although the same applies to the following, “take-up” corresponds to “acquisition”.

  When the main body controller A1 receives the request C1, the main body controller A1 sends a signal to the scanner A5 to execute document reading (S3), and stores the read image D1 output from the scanner A5 in the image area A6 (S4). When the document reading is completed, the main controller A1 reads the read image D1 from the image area A6 (S5), and delivers the read image D1 to the application A2 as a response C2 to the request C1 (S6).

  The application A2 performs image processing on the read image D1 acquired from the main body 10 based on the setting information B1 of the setting area A4, and generates an output image D2 (S7). Thereafter, the user operates the input key A3 to instruct output (S8).

  In response to the output instruction, the application A2 transmits a request C3 for instructing the main body controller A1 to output based on the setting information B1 (S9). When the main body controller A1 receives the request C3, the main body controller A1 outputs an output image D2 to the plotter A7 (or the network processing unit A8) of the output destination corresponding to the request C3 (S10).

First Embodiment
FIG. 2 is a diagram showing an appearance configuration of the MFP shown as an example of the “image processing apparatus” according to the first embodiment. The “image processing apparatus” may have at least a scanning function, but here, an MFP having a scanning function and a printing function (an example of an “image forming function”) is shown. Further, an MFP in which the main body 10 and the operation unit 20 are integrated is shown.

  The main unit 10 of the MFP 1 shown in FIG. 2 forms an image (also referred to as “print”) on a scanner unit 10-1 which scans (also referred to as “read”) a document, and a recording medium such as recording paper. It has a unit 10-2. These operate under the control of the controller on the main body 10 side. The scanner unit 10-1 corresponds to the scanner A5, the image forming unit 10-2 corresponds to the plotter A7, and the controller on the main body 10 side corresponds to the main controller A1. Further, an image area A6 is provided in an HDD (Hard Disk Drive) 103 (see FIG. 3) described later.

  The scanner unit 10-1 includes an ADF (Auto Document Feeder) 10-1a, a scanner 10-1b, and the like. The ADF 10-1a is an example of a document pressing plate provided openably and closably on the contact glass 10-1 c surface, which is a reading surface of a document, so as to allow exposure and light shielding of the contact glass 10-1 c surface. By lifting one side of the ADF 10-1a upward, the surface of the contact glass 10-1c is exposed. In this open state, the original is directly placed on the exposed contact glass 10-1c (placement). be able to. When the document is placed and the lifted ADF 10-1a is lowered and closed in the closed state, the ADF 10-1a functions as a pressing plate and can block the light of the external light source.

  The scanner 10-1b is configured below the contact glass 10-1c, and an image of a document is placed on an illumination device, a CCD (Charge Coupled Device) system or a CMOS (Complementary MOS) system image sensor, or an image sensor. It has an optical system for imaging. The scanner 10-1b illuminates a document or document pressing plate (specifically, a back cover located on the back of the document) through the contact glass 10-1c by the illumination device, and reflected light from the document surface or back cover (reading Light) converts the light imaged on the image sensor through an optical system into an electrical signal (RAW image).

  The image forming unit 10-2 includes an optical writing device, a tandem-type image forming unit, a transfer belt, a fixing device, and the like, and thereby, the toner on the recording paper supplied from the lower recording paper supply cassette. Etc. to form an image.

  The operation panel 20 is an example of the operation unit 20, and includes an application A2 (see FIG. 1) and a setting area A4 (see FIG. 1). The application A2 receives an operation from the user, instructs the main body 10 to execute a function, or sets setting information B1 in the setting area A4. For example, when the start button for scanning is pressed, the application A2 requests the controller of the main body 10 to execute the scanning. In addition, the operation panel 20 receives the original scan image D1 obtained by the scanning from the main body 10, performs image processing and the like according to the setting information B1 of the setting area A4 to the original scan image D1, and outputs after processing The image D2 is output to the output destination set in the setting information B1. Depending on the output destination of the output image D2, for example, the application A2 requests execution of printing to the main body 10, or instructs storage in a storage medium or transmission to another device. The operation panel 20 is connected in a short distance communication with the controller on the main body 10 side by wire or wireless, transmits an operation signal to the controller on the main body 10 side via the communication path 30 (see FIG. 3) It exchanges data such as requests, responses, and images with the controller.

  In the first embodiment, as an example of a mode in which the operation panel 20 uses the function of the main body 10, the main body 10 provides the function with an API (Application Programming Interface), and the operation panel 20 operates the API. By doing this, the form of performing the functions of the main body 10 such as scanning and printing is shown.

  Also, "API" indicates one using Web API as an example. Unless otherwise specified below, "API" shall be "Web API (mostly REST Web API)". The Web API for REST (Representational State Transfer) includes GET (acquisition), POST (registration), PUT (update), and DELETE (deletion) methods, and a request ("Request using a Uniform Resource Locator (URL) to specify a resource. (Also referred to as “request data”) from the operation panel 20 to the Web (World Wide Web) server implemented in the controller of the main unit 10, and from the Web server in the operation panel 20, responses (both “response” and “response data”) It is received in JSON (JavaScript (registered trademark) Object Notation), XML (Extensible Markup Language), etc.

(Hardware configuration)
FIG. 3 is a diagram showing an example of the hardware configuration of the MFP 1. As shown in FIG. 3, the controller on the main unit 10 side is a first CPU, a central processing unit (CPU) 100, a read only memory (ROM) 101, a random access memory (RAM) 102, and an HDD 103. A communication I / F 104, a connection I / F 105, and an engine 106 are included. The respective units are connected to one another via a system bus 107.

  The CPU 100 is a central processing unit that executes arithmetic processing and control processing. The CPU 100 reads various programs stored in the ROM 101, the HDD 103, and the like into the RAM 102, executes arithmetic processing and control processing, and so on to control the main body 10 in an integrated manner.

  The ROM 101 is a non-volatile memory that stores fixed programs (for example, BIOS (Basic Input / Output System)). The RAM 102 is a volatile memory that the CPU 100 uses as a work area or the like in various processing. The HDD 103 is an auxiliary storage device that stores various programs, data, and the like. The various programs include an OS (Operating System) dedicated to a multifunction peripheral, web server software, a web API, and the like. The HDD 103 also has an image area A6 for storing the original scan image D1 (see FIG. 1) of the document obtained by the scanning.

  The communication I / F 104 is an interface (for example, Ethernet (registered trademark) board) for connecting the main unit 10 to a communication network such as a LAN (Local Area Network) or a VPN (Virtual Private Network).

  The connection I / F 105 is an interface for near field communication such as USB (Universal Serial Bus) standard that is connected to the operation panel 20 via the communication path 30 for communication. The connection with the operation panel 20 is not limited to USB. The communication path 30 is not limited to wired and may be wireless.

  The engine 106 is an engine such as a scanner 10-1b (see FIG. 2) configured in the scanner unit 10-1 (see FIG. 2) or a plotter configured in the image forming unit 10-2 (see FIG. 2). is there. The scanner 10-1b irradiates light to the document on the contact glass 10-1c (see FIG. 2), and converts the reflected light into an electric signal by the RGB color sensor of the CCD system or the CMOS system. The signal converted into the electrical signal is subjected to signal amplification and A / D conversion, compressed by a JPEG (jay peg) compression unit, and output as a digital signal (JPEG image). The JPEG image is an example of the original scan image D1.

  The operation panel 20 illustrated in FIG. 3 includes a CPU 200, which is a second CPU provided separately from the main unit 10, a ROM 201, a RAM 202, a flash memory 203, a communication I / F 204, a connection I / F 205, and a touch panel 206. , An LCD (Liquid Crystal Display) 207, and an SD 208. The respective units are mutually connected via a system bus 209.

  The CPU 200 is a central processing unit that executes arithmetic processing and control processing. The CPU 200 reads various programs stored in the ROM 201, the flash memory 203, and the like into the RAM 202, executes arithmetic processing and control processing, and controls the entire operation panel 20 in a centralized manner.

  The ROM 201 is a non-volatile memory that stores a fixed program (for example, a BIOS or the like). The RAM 202 is a volatile memory used by the CPU 200 as a work area or the like in various processing. A setting area A4 in which setting information B1 (see FIG. 1) is saved is allocated to part of the RAM 202. The flash memory 203 is an auxiliary storage device that stores a general-purpose OS (such as Android (registered trademark) OS) different from the main unit 10 and an application A2 (such as an Android application) that is operated by the CPU 200 under the general-purpose OS. . The setting information B1 of the setting area A4 is stored in the flash memory 203, and is read out to the setting area A4 from next time and used. The general-purpose OS of the operation panel 20 operates independently of the multifunction machine-specific OS of the main body 10. The application A2 is stored in the flash memory 203 as an application that operates under the general-purpose OS of the operation panel 20. The application A2 is an application that can be added on a general-purpose OS.

  The communication I / F 204 is an interface for connecting the operation panel 20 to a communication network such as a LAN or a VPN.

  The connection I / F 205 is an interface for near field communication such as USB standard, which is communicably connected to the main body 10 via the communication path 30.

  The touch panel 206 is a touch sensor that detects the touch position of the screen of the LCD 207 by the operator and notifies the CPU 200 of information (position information) of the touch position. In addition to the touch panel 206, a hardware key for notifying the CPU 200 of an input value, a command, and the like may be provided.

  The LCD 207 is an example of a display unit. The LCD 207 has a liquid crystal display screen, and displays the screen information output by the CPU 200 on the liquid crystal display screen. In addition to the liquid crystal, the display means may use another display method such as organic EL (Electro Luminescence).

  An SD 208 is an interface of the SD memory card. The SD memory card is used as a storage destination of an output image D2 subjected to image processing and the like on the past setting information B1 and the operation panel 20. A removable storage medium other than the SD memory card may be used.

(Functional configuration)
In the first embodiment, the main body 10 of the MFP 1 and the operation panel 20 operate independently by separate operating systems (OS for the multi-functional peripheral and the general-purpose OS, respectively). The application A2 of the operation panel 20 operates the main body 10 by the Web API of the main body 10 under the operating system of the operation panel 20.

  The main body 10 exerts various functions by the CPU 100 reading programs stored in the ROM 101, the HDD 103, etc. to the RAM 102 and sequentially executing the programs. In addition, the operation panel 20 performs various functions by the CPU 200 reading programs stored in the ROM 201, the flash memory 203, and the like to the RAM 202 and sequentially executing the programs.

  FIG. 4 is a view showing an example of functions exerted by the main body 10 and the operation panel 20. The operation panel 20 in FIG. 4 mainly shows functions related to the application A2.

  As shown in FIG. 4, the main unit 10 includes a connection control unit 11, a communication control unit 12, a storage control unit 13, a request response unit 14, a WebAPI service unit 15, a reading scanner control unit (scanner control unit) 16, and a plotter control unit Demonstrate features such as 17.

  The connection control unit 11 controls the connection I / F 105 to establish communication with the operation panel 20, and transmits and receives data to and from the operation panel 20.

  The communication control unit 12 controls the communication I / F 104 to establish communication with a designated communication destination, and transmits and receives data to and from the communication destination. The communication control unit 12 and the communication I / F 104 correspond to the network processing unit A8 (see FIG. 1).

  The storage control unit 13 manages the storage area of the memory (ROM 101, RAM 102, HDD 103), writes a program or data to the memory, and reads a program or data from the memory. The original scan image D1 is stored in the image area A6 of the HDD 103. In this example, “original scan image” refers to a JPEG image generated by engine 106.

  The request response unit 14 performs HTTP (Hypertext Transfer Protocol) communication with the operation panel 20. The request response unit 14 processes request data included in the received data in this communication. When an API is designated as the request data, the request response unit 14 obtains the processing result through the API of the Web API service unit 15.

  The Web API service unit 15 provides various APIs. The request response unit 14 and the Web API service unit 15 are implemented as a Web server provided on the main body 10 side of the MFP 1.

  The reading scanner control unit 16 controls the scanner 10-1b through the engine 106 to obtain the original scan image D1. The plotter control unit 17 controls the plotter through the engine 106.

  The operation panel 20 exerts functions such as a connection control unit 21, a communication control unit 22, a storage control unit 23, an input receiving unit 24, a display control unit 25, an image processing unit 26, a request unit 27 and an output unit 28.

  The connection control unit 21 controls the connection I / F 205 to establish communication with the main body 10, and transmits and receives data to and from the main body 10. For example, the connection control unit 21 transmits a request or data to the connection control unit 11 of the main body 10, and receives data in response to the request.

  The communication control unit 22 controls the communication I / F 204 to establish communication with the communication destination, and transmits and receives data to and from the communication destination.

  The storage control unit 23 manages the storage area of the memory (ROM 201, RAM 202, flash memory 203), writes a program or data to the memory, and reads a program or data from the memory. In a part of the storage area of the RAM 202, a setting area A4, a work area for converting the original scan image (read image) D1, and the like are secured.

  The input receiving unit 24 is a part of the “input unit”, and receives information on a touch position from the touch panel 206 to receive an input of an operation instruction.

  The display control unit 25 causes the LCD 207 to display screen information.

  The image processing unit 26 receives the setting of the setting information B1 from various screens, and performs image processing or the like of the setting on the original scan image D1 received from the main body 10. Specifically, the image processing unit 26 causes the display control unit 25 to display various screens on the LCD 207, and sets the settings accepted by the input acceptance unit 24 on those screens to the setting area A4 of the RAM 202 through the storage control unit 23. Save as information B1, that is, store it. Further, the image processing unit 26 instructs the scanning of the document through the request unit 27, takes out the original scan image D1 generated by the scanning from the main body 10, and performs image processing and the like according to the setting information B1.

  The request unit 27 performs HTTP communication with the request response unit 14 of the main body 10. Specifically, the request unit 27 throws a request based on the user's input accepted by the UI (User Interface) to the Web server (including the request response unit 14 and the Web API service) of the main body 10 using the HTTP client. The request unit 27 selectively designates an API of the Web API service unit 15 in the HTTP communication, and receives an execution processing result by the selected API.

  The output unit 28 outputs an output image D2 obtained by image processing or the like of the image processing unit 26 in accordance with the setting of the setting information B1. For example, when printing in the main body 10 is designated in the setting information B1, the printing of the output image D2 is requested to the main body 10 through the request unit 27. Further, when a predetermined output destination on the network is designated in the setting information B1, transmission of the output image D2 to the output destination is requested to the main body 10 through the request unit 27. When the SD memory card is designated, the output image D2 is output to the SD memory card attached to the operation panel 20. When the network processing unit A8 (communication I / F 204 or the like) is provided on the operation panel 20 as in this configuration, transmission to a predetermined output destination on the network can be performed by the network processing unit A8 of the main unit 10. You may transmit using network processing part A8 of the operating panel 20, without utilizing. The details will be described in the operation of the image processing system shown as the second embodiment.

  In the functional configuration according to the first embodiment, the image processing unit 26 causes the display control unit 25 to display various screens on the LCD 207, and the storage control unit 23 displays the settings accepted by the input acceptance unit 24 on those screens. Through the setting area A4 of the RAM 202 as setting information B1. That is, the image processing unit 26 includes a function as a “setting unit”. Further, the image processing unit 26 instructs the scanning of the document through the request unit 27, takes out the original scan image D1 generated by the scanning from the main body 10, and performs image processing and the like according to the setting information B1. That is, the image processing unit 26 also includes a function as a "processing unit". In addition to the image processing unit 26, the output unit 28 and the like also include a function as a "processing unit".

  FIG. 5 is a diagram showing an example of a plurality of APIs by operation type provided by the Web API service unit 15. As shown in FIG. As shown in FIG. 5, the Web API service unit 15 provides an image reading API 15-1, an image forming API 15-2, an image transmission API 15-3, and the like.

(Screen configuration of operation panel 20)
Subsequently, the screen configuration of the operation screen displayed by the application A2 on the operation panel 20 (LCD 207) will be described. The document image shown below is an image in which a receipt, a business card or the like is a document. Note that various operators such as a selection box operated by the user, a check box, and a button as described below are examples of the input key A3 (see FIG. 1).

  6 to 10 are diagrams showing an example of the configuration of a setting screen for setting the setting information B1. FIG. 6 shows an example of a setting screen 1100 for setting setting values of image processing. The setting screen 1100 includes a color selection box 1111, a resolution selection box 1112, a density selection box 1113, a page size selection box 1114, a Duplex selection box 1115, a format selection box 1116, a rotation direction selection box 1117, and an interval. It has a selection box 1118 and a filter check box 1119. Each selection box displays a selection list by pull-down or the like, allows the user to select a setting from the selection list, accepts a set value specified from the list, and displays the set value in the selection box. The check box receives on or off of the displayed item, switches on and off each time designated by the user, and displays a check mark when it is on.

  The color selection box 1111 is a selection box for receiving set colors such as color and monochrome. The resolution selection box 1112 is a selection box for receiving the setting of the resolution. A density selection box 1113 is a selection box for receiving settings of densities such as dark and light. The page size selection box 1114 is a selection box for receiving a set size such as “A4” or “B5”. The Duplex selection box 1115 is a selection box for receiving double-sided printing settings. A format selection box 1116 is a selection box for receiving settings of an image format such as PDF (Portable Document Format) or JPEG. The rotation direction selection box 1117 is a selection box that receives the setting of the rotation direction such as vertical or horizontal. An interval selection box 1118 is a selection box for receiving settings of image arrangement intervals of a plurality of document images.

  Also, a filter check box 1119 is a check box for receiving whether to set the image filter on or off.

  The setting screen 1100 is provided with an input set 1121 for receiving an input of a storage destination for loading a past setting stored in a storage medium such as an SD memory card or a site on the Internet. In this input set 1121, the user specifies the save destination of the past settings, the file name, etc., and loads the settings from the designated SD memory card or the site on the Internet, etc. It can also be reflected in a check box or the like.

  In addition, on the setting screen 1100, a save button 1131 for receiving an instruction to save the setting accepted on the setting screen 1100 as setting information B1 in the setting area A4 and a cancel for receiving an instruction to restore the change made on the setting screen 1100 A button 1132 is provided.

  Further, the setting screen 1100 is provided with a log output button 1141 for receiving an instruction to output the setting accepted on the setting screen 1100 to a predetermined storage medium such as an SD memory card. When the log output button 1141 is pressed, the setting accepted on the setting screen 1100 is stored in a predetermined storage medium such as an SD memory card with the set file name.

  The setting screen 1100 also includes a home button 1151 for returning to the home screen, a stop button 1152 for stopping all jobs, and the like. These buttons are appropriately provided on other screens to be described later, and are assigned the same numbers.

  FIG. 7 shows an example of a setting screen (action setting screen 1200) for setting a process (action) to be executed by the main body 10. The action setting screen 1200 has a copy button 1201, a scan button 1202, and a copy & scan button 1203 as an example of setting buttons for processing to be executed by the main body 10. Here, three types of buttons are shown as the setting buttons, but the type and number of buttons may be changed as appropriate according to the function of the main body 10.

  The copy button 1201 is an input button for receiving settings to execute copying in the main body 10. In this example, “copy” uses the scanner function and the print function of the main body 10. Specifically, the image of the document is read by the scanner 10-1b, and an output image D2 obtained by applying image processing and the like to the read image D1 by the operation panel 20 is output by a plotter. The scan button 1202 is an input button for receiving settings for executing a scan on the main body 10. In this setting, an output image D2 obtained by reading an image of a document by the scanner 10-1b and performing image processing and the like by the operation panel 20 on the read image D1 is stored in a storage medium such as an SD memory card or other device on the network. Send. The copy and scan button 1203 is an input button for receiving settings for executing both the copy process and the scan process.

  Further, the action setting screen 1200 is provided with a switching button 1153 for calling the setting screen 1100. By pressing the switching button 1153, the setting screen 1100 is displayed.

  FIG. 8 shows an example of a setting screen (file type setting screen 1300) for setting the file type to be output. The file type setting screen 1300 has a single button 1301, a multiple page button 1302, and a single page multiple button 1303 as an example of the file type of the output image D2. In this example, three types of buttons are shown as file type setting buttons, but the types of buttons and the number of buttons may be changed as appropriate.

  The single button 1301 is an input button for receiving settings for generating a single file. Here, "single file" refers to an image file containing one original image. The multiple page button 1302 is an input button for receiving settings for generating multiple pages. Here, "multiple page" refers to an aggregation of multiple single files into one file. The single page multiple button 1303 is an input button for receiving settings for generating a single page multiple file. Here, "single page multiple" refers to an image file containing a plurality of original images.

  In addition, the file type setting screen 1300 is provided with a back button 1305. A return button 1305 is a button for receiving an instruction to return to the previous screen. Note that the return button 1305 is provided as appropriate, with the same numbers assigned to the other screens.

  FIG. 9 shows an example of the setting confirmation screen 1400 for confirming the setting. In the setting confirmation screen 1400, the user confirms the setting of the setting information B1 in the setting area A4, and instructs the start of the processing of the action if there is no need to change the setting.

  The setting confirmation screen 1400 has an area 1410 and an area 1420 as a confirmation area of the setting information B1. An area 1410 is an area for displaying settings selected on the action setting screen 1200 and the file type setting screen 1300. An area 1420 is an area for displaying the setting value set on the setting screen 1100. In the area 1420, changes in each set value can also be received.

  The setting confirmation screen 1400 further includes a transmission destination setting button 1411. When scan or copy & scan is selected on the action setting screen 1200, a transmission destination to which the output image D2 is to be transmitted is set. When the transmission destination setting button 1411 is pressed, the transmission destination setting screen 1500 (see FIG. 10) to which the SFTP (SSH File Transfer Protocol) button is added is displayed, and the transmission destination is selected on the transmission destination setting screen 1500.

  The setting confirmation screen 1400 has a start button 1430 in the area on the right side of the screen. The start button 1430 is a button for receiving an instruction to start processing of various actions in response to a pressing operation from the user.

  The icon 1440 is an icon indicating media connected to the operation panel 20.

  FIG. 10 shows an example of a setting screen (transmission destination setting screen 1500) for setting the transmission destination of the output image D2. The transmission destination setting screen 1500 has an SMB (Server Message Block) button 1501, an FTP (File Transfer Protocol) button 1502, an Email button 1503, and a USB button 1504 as buttons for setting a transmission destination. In this example, four types of buttons are shown as the setting buttons of the transmission destination, but the types of buttons and the number of buttons may be changed as appropriate.

  The SMB button 1501 is a button for receiving settings for setting the transmission destination as an SMB folder. The FTP button 1502 is a button for receiving settings for setting the transmission destination as an FTP folder. An Email button 1503 is a button for receiving settings for setting the transmission destination as an Email address. A USB button 1504 is an input button for receiving a setting of using a USB memory as a transmission destination.

  FIG. 11 is a view showing an example of a preview screen for previewing an image before output after image processing. A preview screen 1600 shown in FIG. 11 is a display screen after processing of a process started based on the setting when the start button 1430 of the setting confirmation screen 1400 (see FIG. 9) is pressed.

  The preview screen 1600 has an image display area 1610 for displaying an image before output. Also, it has a file name box 1620 for displaying the file name of the image before output. FIG. 11 shows an image including two receipts and having a file name “BaseImageName_001” as an example of an image before output. This image is an image synthesized by cutting out two receipt areas from the original scan image D1 by image processing to be described later. In FIG. 11, each receipt area in the image is indicated by a broken line for the sake of explanation. The file name may be automatically assigned a unique number, or the user may assign an arbitrary value. In the vicinity of the image display area 1610, an enlargement / reduction operator 1630 for enlarging and reducing the image is provided. The image before output is enlarged or reduced in the image display area 1610 in accordance with the operation of the enlargement button and reduction button of the enlargement / reduction operator 1630.

  A delete button 1640 provided on the preview screen 1600 is a button for receiving an instruction to delete an image displayed in the image display area 1610. The delete button 1640 may receive an instruction to delete the data of the image being displayed in the image display area 1610, or the specification of a partial area of the image in the image display area 1610 is received by the user's touch operation or the like. The delete button 1640 may receive an instruction to replace data for replacing the area designated by the user with a predetermined color (for example, a background color). In the former case, one page of image data having two receipt images displayed in the image display area 1610 will be erased in this example, but in the latter case, the user can start with the user from among these two receipts. Data such as a designated receipt area or a light mixed area other than the receipt area is replaced with the designated color.

  A next button 1650 provided on the preview screen 1600 is a button for receiving a display switching instruction to display an image of the next order out of a series of images before output in the image display area 1610.

  Furthermore, on the preview screen 1600, an output (Send) button 1660 is provided in the area on the right side of the screen. The output button 1660 is a button for receiving an output instruction to the output destination set in the setting information B1 by a pressing operation from the user.

(Operation explanation)
Subsequently, the operation of the entire MFP 1 will be described. First, processing executed by the operation panel 20 will be described, and thereafter, processing of the entire MFP 1 including the main body 10 will be described. Note that various screens in FIGS. 6 to 11 are appropriately referred to in the description of the processing.

(Operation of operation panel 20)
FIG. 12 is a diagram showing an example of the process flow of the operation panel 20. As shown in FIG. FIG. 12 shows a process flow of the application A2 of the operation panel 20 after the system of the MFP 1 is activated and the general-purpose OS of the operation panel 20 is activated.

  First, the application A2 displays the setting screen 1100 (see FIG. 6) at the time of first use activation (S11), and accepts various operation inputs by the user on the setting screen 1100 (S12). At the time of this operation input, the application A2 appropriately updates the display of the setting screen 1100 according to the operation content.

  For example, when an operation of reading out past setting information is performed, the application A2 displays the read out setting as the setting designated for selection in each selection box. In addition, when each selection box is operated, the list is displayed by pull-down etc. in the selection box, and when one selection is selected from the list, it is displayed as the setting designated in the selection box. .

  After receiving such a setting operation, the application A2 receives pressing of the save button 1131 and the cancel button 1132 of the setting screen 1100, and performs processing corresponding to the pressed button (S13). When the save button 1131 is pressed, the application A2 saves the setting of the setting screen 1100 in the setting area A4. When the cancel button 1132 is pressed, the application A2 discards the setting input by the user on the setting screen 1100.

  The process of displaying the setting screen 1100 at startup and setting the setting information is a process performed only at the time of first use startup, and from the second activation time, the application A2 performs the process from step S11 to step S13. The process is started from step S14. Therefore, from the second time, the setting information set at the time of the first use activation is used as the setting information B1.

  The application A2 then displays the action setting screen 1200 (S14).

  Subsequently, the application A2 receives an operation input (in one example, a selection input) on the function of the main body 10 used by the user (that is, the process to be executed by the main body 10) in the action setting screen 1200 (S15). For example, when one of the selection buttons of the process to be executed by the main unit 10, for example, the scan button 1202 is pressed by the user on the action setting screen 1200, the application A2 is set as a setting for the main unit 10 to execute the process. Accept. The setting is to be written to setting information B1 of setting area A4. Although illustration of the process is omitted because the description of the process is complicated, when the switching button 1153 is pressed on the action setting screen 1200, the application A2 displays the setting screen 1100, and another setting screen 1100 is displayed. It becomes possible to receive the setting of the setting information.

  When one of the selection buttons is received in the action setting screen 1200, the application A2 then displays the file type setting screen 1300 (S16), and the operation input for the file type in the file type setting screen 1300 (in one example, selection input) ) Is received (S17). For example, when one of the file type selection buttons, for example, the single button 1301 is pressed by the user on the file type setting screen 1300, the application A2 applies the file type pointed to by the pressed button to the read image D1. Accept as a type setting. Note that this setting is to be written to the setting information B1 of the setting area A4.

  Subsequently, the application A2 displays the setting confirmation screen 1400, and receives inputs of various buttons on the setting confirmation screen 1400 (S18).

  Then, when the start button 1430 is pressed on the setting confirmation screen 1400 (S19: Yes determination), the application A2 performs the process from step S40. The process from step S40 will be described later.

  When the transmission destination setting button 1411 is pressed (S19: No determination, S20: Yes determination), the application A2 displays the transmission destination setting screen 1500 (S21), and the operation input of the transmission destination on the transmission destination setting screen 1500 (S21) In one example, the selection input is accepted (S22). For example, when one of the transmission destination selection buttons, for example, the Email button 1503 and the like is pressed by the user on the transmission destination setting screen 1500, the application A2 transmits the transmission destination indicated by the pressed button to the output image D2. Accept as a destination setting. After receiving the transmission destination, the process returns to the process from step S18.

  The application A2 is pressed when the display button (setting change button) of each setting value indicated in the area 1420 in the setting confirmation screen 1400 is pressed (S19: No determination, S20: No determination, S30: Yes determination) The change of the set value of the button is accepted, and the changed set value is set (S31). After setting, the process returns to step S19. The application A2 repeats the determination from step S19 when the pressing of the setting change button is not received on the setting confirmation screen 1400 (S19: No determination, S20: No determination, S30: No determination). Although illustration of the process is omitted to avoid the explanation becoming complicated, when the return button 1305 is pressed in the setting confirmation screen 1400, the application A2 sets the file type setting screen 1300 one before. When the back button 1305 is pressed on the file type setting screen 1300, the action setting screen 1200 is displayed. When the return button 1305 is pressed in this way, the application A2 performs the process in the above-described flow from the returned screen.

  Next, the process from step S40 when the start button 1430 is pressed on the setting confirmation screen 1400 will be described.

  When the application A2 receives a process execution instruction by pressing the start button 1430 by the user, the application A2 first requests the main body 10 to execute a scan (S40). Application A2 sends to the main unit 10 the setting values for scanning (setting values for color, resolution, density, page size, image format, etc.) in the request, but always transmits the JPEG settings in color Do. Thereby, the main body 10 always generates an image with the same setting.

  After requesting execution of the scan to the main body 10, the application A2 takes the read image D1 generated from the document by the main body 10 from the document from the image area A6 of the main body 10 to the operation panel 20 and develops the image in the work area of the RAM 202 (S41).

  Then, the application A2 performs image processing or the like on the image of the work area according to the setting of the post-processing of the setting information B1. First, the application A2 performs image processing (S42). The image processing is, for example, extraction of a receipt area or correction of the inclination of the extracted receipt image. Details of this image processing will be described later with reference to FIG.

  After the image processing, the application A2 performs output pre-processing ("size check", "arrangement processing", "color conversion processing"). In the size check, the application A2 determines whether the image size after image processing is not oversize (S43). Specifically, the application A2 determines for each receipt image whether the size of the extracted receipt falls within the size of the image to be output.

  If the size is over (S43: No), the application A2 displays an error screen (S60), and retries the process from step S18. In this case, the user separates the document and places it on the surface of the contact glass 10-1c or the like, and then performs the operation again from the setting confirmation screen 1400.

  If the data after the image processing is not oversized (S43: Yes), the application A2 performs the arrangement processing (S44), the color conversion processing (S45), and displays the processed image on the preview screen 1600 (S46) ).

  Here, the arrangement process is a process based on the setting of the file type of the output image D2 in the setting information B1. With this arrangement processing, the application A2 compares each image with an image file while comparing the total value of dimensions such as the width of each image of each receipt area and the receipt interval (set value of the image arrangement interval) with the set size. Perform processing to arrange. For example, when “single page multiple” is set, the application A2 rotates each image of each receipt area obtained by the above-mentioned image processing according to the setting of vertical and horizontal rotation of the setting information B1, and further, after rotating them. The images are arranged in a fixed order according to the setting of the image arrangement interval, and stored in one image file. If the image does not fit in one image file, the application A2 puts the images in the remaining receipt area in another image file. If the image does not fit in the image, the application A2 similarly puts the image of the remaining receipt area in another image file. The application A2 repeats this arrangement process until all the images in each receipt area are arranged.

  The color conversion process is a process of converting the setting of the color set in the setting information B1. In this example, since a color image is always obtained from the main body 10, for example, when monochrome is set, the application A2 converts the color image into a monochrome image.

  As described above, an image (image before output) after the arrangement processing and the color conversion processing are performed is displayed on the preview screen 1600.

  When the application A2 receives the pressing of the delete button 1640 on the preview screen 1600 (S47: Yes determination), the application A2 deletes the image displayed in the image display area 1610 from the series of plural images arranged by the arrangement processing. (S48). The image to be deleted is, for example, an image in which a fluorescent lamp or the like appears on the original scan image D1 and a receipt is not cut out correctly. Such a phenomenon occurs, for example, when filter processing is not performed in image processing to be described later. For such an image, the user presses the next button 1650 on the preview screen 1600 to sequentially switch the images displayed in the image display area 1610, and presses the delete button 1640 when the target image is displayed. Is deleted by If an image to be deleted is included, pressing the delete button 1640 deletes only that image. When the application A2 receives deletion of all of a series of images by pressing the delete button 1640, the application A2 displays an error although not shown, and then returns to step S18.

  If the application A2 does not receive the pressing of the delete button 1640 (S47: No), the application A2 determines whether the output button 1660 is pressed (S49). If the output button 1660 is not pressed (S49: No), the application A2 returns to the determination of step S47.

  When the image (image file) which is not deleted remains and the output button 1660 is pressed (S49: Yes determination), the application A2 executes a series of images (image file) based on the setting of the setting information B1, for example Convert to an image format such as PDF (registered trademark) and perform output processing.

  In the output process of the example shown in FIG. 12, when the setting of the process of the action is copy (S 50: Yes determination), the application A 2 requests the main body 10 to use the image forming (printing) function of the main body 10. , Request printing (S51). At this time, the application A2 inputs a copy job to the main body 10 and transmits an output image D2 after processing of the operation panel 20.

  If the setting of the action processing is scan (S50: No), the application A2 transmits the output image D2 to the transmission destination specified on the transmission destination setting screen 1500 (S52). When the setting of the process of the action is copy & scan, the application A2 performs both processes of step S51 and step S52.

  After completion of these processes, the application A2 displays completion information indicating completion of output (S53), saves or clears the setting information B1 of the setting area A4, and ends the present process. After this processing ends, the initial screen is displayed and the process waits until there is an input from the user.

  FIG. 13 is a diagram showing an example of the processing flow of the image processing shown in step S42 of FIG. The application A2 performs image processing on the read image D1 set in the image area A6 according to the setting information B1 of the setting area A4.

  Specifically, the application A2 determines whether or not the filter setting of the setting information B1 is on (S42-1), and an image suitable for the surrounding environment of the scanning according to the filter setting of the setting information B1. Apply processing

  For example, when the setting of the filter is on (S42-1: Yes determination), the application A2 performs an image extraction process including a filter process on the read image D1 of the image area A6 (S42-2). The image extraction process including the filter process is the procedure of the image process shown in FIG. 14B, and the information of light such as a fluorescent lamp reflected in the read image D1 is eliminated by the filter process, and the boundary of the document image is displayed. Let stand and cut out.

  On the other hand, when the setting of the filter is off (S42-1: No determination), the application A2 performs an image extraction process not including the filter process (S42-3). The image extracting process not including the filtering process is a procedure of the image processing shown in FIG. 14A. Since there is no reflection of light such as a fluorescent lamp, the document image is cut out by a simple procedure.

  After clipping of the document image, the application A2 performs tilt correction processing to correct the tilt of the clipped document image (S42-4). This is processing for correcting the inclination of the image generated when scanning is performed in a state where the original on the surface of the contact glass 10-1c is inclined. Since the receipt and the name card are light, especially when there is no back pressure on the contact glass 10-1c, the contact glass 10-1c is inclined on the contact glass 10-1c. When a plurality of receipts, business cards, and the like are arranged on the contact glass 10-1c, they are inclined in different directions. By this inclination correction process, even when each document is inclined, the inclination is corrected one by one.

(Image processing on operation panel 20)
Subsequently, image processing to be performed on the read image D1 taken by the operation panel 20 from the main body 10 will be described. Here, a read image including an original image of each of a plurality of receipts is taken as an example in the case where scanning is performed by arranging a plurality of receipts as originals on the surface of the contact glass 10-1c in the scanner unit 10-1. The image processing of D1 will be described.

  In general, the receipts are printed in black on the rolled white receipt paper with the print information and cut with a margin at the end of the print. The receipt has white margins of a sufficient width at the edges of the four sides, and the print information is imprinted in the print area surrounded by those margins. When scanning a document having such a white edge, the following method may be considered.

  The method is a method of scanning with the ADF 10-1a open. The user arranges and places a plurality of receipts as a document on the surface of the contact glass 10-1c, and lowers the ADF 10-1a to a closed state. Then, a plurality of receipts are scanned in a closed state sandwiched by the contact glass 10-1 c surface and the ADF 10-1 a. In this case, since the edge of the document (in this example, the receipt) is white and the back cover of the ADF 10-1a is often white, both the reading light reflected at the edge of the receipt and the reading light reflected by the back cover are It is difficult to detect the boundary (edge) of the receipt area from the read image D1 detected as white of the same color and scanned. Therefore, scanning is performed with the ADF 10-1a open. That is, a plurality of receipts are scanned in the open state without being pinched by the contact glass 10-1 c surface and the ADF 10-1 a. In this case, since there is no back cover on the back of the receipt, the reading light does not return from the back cover, and the background image of the receipt becomes dark.

  By the way, depending on the installation environment of the MFP 1, when the ADF 10-1a is used in the open state, light such as a light of a ceiling (as an example, a fluorescent light) may be reflected in the read image D1. In this case, it may not be possible to accurately cut out (extract) the receipt from the read image D1, but this is dealt with in the present embodiment by including filtering in the image processing.

  FIG. 14 is a diagram showing an example of procedures of image processing when the filter processing is set to OFF and when the filter processing is set to ON. In an environment where there is no light reflection such as a fluorescent lamp, the filter processing is set to be off, and in an environment where there is light reflection such as a fluorescent lamp, the filter processing is set to be on. In any case, in this example, the receipt image is extracted by recognizing the boundary between the receipt area (receipt image area) and the image area other than the receipt. Note that the on / off setting of the filtering process may be appropriately performed on the setting screen 1100. For example, the user may perform scanning each time, or a serviceman or the like may set as an initial value when installing the MFP 1 or the like.

  FIG. 14A shows an example of the procedure of the image processing when the setting of the filter processing is off. First, the operation panel 20 receives the original scan image (read image) D1 shown in the state 1 from the main body 10. The original scan image D1 in the state 1 is an image showing a state in which scanning is performed in a state where three receipts are arranged on the surface of the contact glass 10-1c. Backgrounds other than receipts become dark due to the environment where there is no light reflection such as fluorescent light. Although the original scan image D1 is a monochrome image, the original scan image D1 is an RGB color image in this example.

  The application A2 performs binarization / boundary extraction processing on the original scan image D1 and generates image information shown in the state 2. In this process, the application A2 first binarizes the original scan image D1. Specifically, the application A2 represents a pixel whose luminance value is darker than the reference value as a black pixel value, and represents a pixel brighter than the reference value as a white pixel value. Subsequently, the application A2 performs boundary extraction processing on the binarized image. In this case, since each of the three receipts is white and the background is black, the boundaries between the receipt areas are accurately extracted as shown in state 2 by extracting the white and black boundaries. can do.

  After extracting the boundaries of each receipt, the application A2 cuts out three receipt areas from the original scan image D1 at the positions of the respective boundaries. State 3 represents an image image of each of the three receipts after cutting out three receipt areas from the original scan image D1. The application A2 adds an identification code to each image, and then performs an arrangement process of arranging each image in an image file according to the setting.

  FIG. 14B shows an example of the procedure of the image processing when the setting of the filter processing is on. First, the operation panel 20 receives the original scan image (read image) D1 shown in the state 1 from the main body 10. The original scan image D1 in the state 1 is an RGB color image when scanning is performed in a state where three receipts are arranged on the surface of the contact glass 10-1c as in FIG. 14A. Since the scanning is performed in the environment where the fluorescent light is reflected, the fluorescent light is reflected in the background and the area of the light becomes bright. The fluorescent light becomes white near the center, but the outside of the fluorescent light becomes green and the like due to the influence of the reflection from the fluorescent light cover.

  For the original scan image D1, the application A2 performs gray scale processing and noise removal to generate image information shown in the state 2, and subsequently generates image information shown in the state 3 from the state 2 by boundary extraction. At this stage, as shown in the state 3, lines other than the edge of the receipt are extracted in the same white as a boundary line in the area where the fluorescent light is reflected. Therefore, the application A2 further performs binarization and noise removal from the state 3 to erase the boundary lines other than the receipt, and generates the image information shown in the state 4. At this stage, boundaries other than receipts will be substantially erased, but as shown in state 4, even the boundaries of receipts will be partially cut away, so application A2 will use a rectangular boundary connection due to the increase of white areas. Image information shown in state 5 is generated. Thereby, as shown in the state 5, the boundary of receipts becomes clear, and the application A2 cuts out each receipt area from the original scan image D1 at the boundary position, and obtains an image of each of the three receipts shown in the state 6. .

  The filter processing added to FIG. 14B is an example, and the number of times of the filter processing, the combination of the filter processing, the method of the filter processing, and the like may be changed as appropriate.

  As described above, in an environment where white light such as a fluorescent lamp is reflected in the background in particular, an erroneous determination that the white light reflection area is erroneously identified as a receipt area is likely to occur. As a result, the boundary extraction accuracy of the receipt is increased, and the erroneous determination is suppressed. Therefore, it is possible to reduce an error image generated in receipt clipping.

(Operation of the entire MFP 1)
FIG. 15 is a sequence diagram showing an example of the operation of the entire MFP 1. Since the process flow in the operation panel 20 has already been described in detail, the process on the operation panel 20 side will be briefly described here, and cooperation between the operation panel 20 and the main body 10 will be described in detail.

  First, the application A2 of the operation panel 20 receives the setting (S101), and saves the setting received there as setting information B1 in the setting area A4 of the operation panel 20 (S102).

  Subsequently, application A2 of operation panel 20 receives depression of start button 1430 for processing in main unit 10 (S103), and when the start button 1430 is pressed by the user, part of setting information B1 is acquired from setting area A4 (S104), and sends a request for image reading to the main unit 10 (S105).

  In the main body 10, the Web API service unit 15 strikes the image reading API 15-1 based on the image reading request transmitted from the operation panel 20, and causes the reading scanner control unit 16 to execute the image reading (S106, S107). The read image D1 read by this execution is stored in the image area A6 of the main body 10 (S108).

  When the image reading is completed (S109), the Web API service unit 15 acquires the read image D1 from the image area A6 (S110), and transmits the acquired read image D1 to the operation panel 20 of the request source through the request response unit 14. (S111).

  When the application A2 of the operation panel 20 receives the read image D1 from the main body 10 by this transmission, the remaining settings are acquired from the setting information B1 of the operation panel 20 (S112), and the read image D1 is taken according to the settings A process etc. are applied (S113).

  After the image processing, the application A2 of the operation panel 20 previews the image after the image processing on the preview screen 1600 (S114).

  Then, in the preview screen 1600, the application A2 accepts the pressing of the output button 1660 (S115), and converts it into the set image format by the pressing of the output button 1660 by the user (S116).

  Furthermore, when the copy is designated in the setting information B1, the application A2 transmits the processed image D2 to the main body 10 together with the request for image formation (S117). In this case, in the main body 10, the Web API service unit 15 strikes the image formation API 15-2 based on the above request, and causes the plotter control unit 17 to execute image formation (printing) (S118, S119).

  When the scan is designated in the setting information B1, the application A2 transmits the image transmission request and the processed output image D2 to the main body 10 based on the setting of the transmission destination (S120). In this case, in the main unit 10, the Web API service unit 15 strikes the image transmission API 15-3 based on the above request, and causes the communication control unit 12 of the main unit 10 to execute transmission of the output image D2 (S121, S122).

  In the present embodiment, an example in which the scanning setting is fixed in the main body 10 of the MFP 1 has been described. However, some setting values included in a request for the operation panel 20 to request the main body 10 to execute scanning Alternatively, the main body 10 may read the resolution, the density, the page size, the image format, and the like so that the main body 10 generates an image with the setting. In this case, in the operation panel 20, part of the processing included in the image processing and the like can be omitted. As described above, in the MFP according to the present embodiment, a part of setting information is transmitted to the main body, and in the setting, the main body performs scanning processing, and on the operation unit side, the scanned image is taken over. It is also possible to use the remaining image processing etc. according to the remaining settings of.

  Further, the original scan image obtained by fixing the settings in the main body 10 can be accumulated in the main body 10. Therefore, other users can share the original scan image on the main body 10, which has been read by a certain user. For example, each original user can designate the original scan image on the operation panel 20 and take it up, and the taken original scan image can be used to perform image processing and the like with unique settings set on the operation panel 20 by each user.

  As described above, in the present embodiment, it is possible to take an image (original scan image) obtained by scanning from an original by the operation panel 20 and flexibly apply various settings, image processing, and the like. Further, even in the case where image processing of different settings for different users is performed on the same document on the operation panel 20, the load on the main body can be reduced without increasing the number of times of scanning of the document on the main body.

  Further, for example, a plurality of receipts can be read collectively to easily extract receipt images, and at the same time, output in accordance with the user's request can be performed.

  Also, by not using the push-down plate, scanning can be easily performed simply by arranging the receipt on the reading surface of the scanner. Receipts are smaller than ordinary manuscripts, and have various shapes such as long ones. When such receipts are read together, the reading method and the output method differ depending on the user. As described above, it is possible to execute scanning with the scanner pressing plate (original pressing plate) open, so in this embodiment, the user who wants to execute the scan with the pressing plate open is lowered to perform scanning. It is possible to accept an operation for each of the users who want to execute.

  Further, even if the background of the scanned image is black, the border between the receipt area and the area other than the receipt can be recognized, so that the receipt image can be extracted accurately.

  Further, since the application can be added on the general-purpose OS of the operation unit, even if a new image processing function is added, the update can be easily performed.

(Modification 1)
10 shows a modified example of image processing performed by the operation panel 20. Here, a modified example of image processing in the operation panel 20 when scanning is performed with the ADF 10-1a closed in the main body 10 is shown.

  As described in the first embodiment, when the ADF 10-1a is closed and scanning is performed, the edge of the receipt and the background become the same color (white) in the image, making it difficult to extract the edge of the receipt. . In such a case, a black area included in the original scan image D1 is recognized as a character area, and a rectangular frame surrounding the black area (character area) is set in the original scan image D1. Cut out the image of

  FIG. 16 is an explanatory view showing a modified example of image processing when scanning is performed in the closed state. FIG. 16 shows an original scan image D1 obtained by arranging three receipts and simultaneously scanning them in the closed state. In each receipt, the print information is contained in the print range of the receipt, and the four sides outside the print range have white margins. When these are scanned in the closed state, the application A2 binarizes the original scan image D1 and groups black areas (character areas) from the image and detects the smallest rectangular frame surrounding them. . The grouping of the black regions is performed, for example, according to the distance between the respective regions, the density, and the like. The settings such as the distance between areas and the degree of density are set to values such that the entire print area is grouped by one receipt. The rectangular broken line frame shown in FIG. 16 is an example of the rectangular frame. The solid rectangular frame is the actual edge of each receipt. The cutout of the image of each receipt from the original scan image D1 is performed at the border of the rectangular frame having a width obtained by adding a predetermined margin to the outside of the print area with reference to the rectangular broken line frame.

  In the first modification, it is possible to prevent a document such as a receipt from being rounded by closing the document, that is, lowering the document pressing plate and holding the receipt between the reading surface and the document pressing plate. In addition, it is possible to prevent reflection at the time of scanning of the light above the MFP. Furthermore, even if the background of the scanning image becomes white, the boundary is recognized based on the character area, so that the receipt image can be extracted accurately.

  The setting of whether to scan the ADF 10-1a in the open state or in the closed state in the main body 10 is, for example, a setting item 1100 indicating whether the opened state or the closed state is displayed on the operation panel 20. It accepts by input from the user by When the setting item indicating whether the open state or the closed state is provided in the setting screen 1100, the application A2 performs the image processing on the original scan image D1 according to the setting in the setting screen 1100, so if the setting is the closed state, The image processing in the closed state is selected, and the processing is executed. When setting items indicating the open state or the closed state are provided in the preview screen 1600, all images are deleted because an image cut out by the image processing performed based on the initial setting has an error in the cutout position. Then, the change of the setting item indicating the open state or the closed state is received, and the application A2 processes the original scan image D1 by the image processing of the changed setting.

(Modification 2)
The modification for rearranging each original image such as a receipt which is cut out from the original scan image D1 by the operation panel 20 will be described. In the embodiment, after the application A2 processes the original scan image D1 with the operation panel 20, the application A2 performs a process such as the order in which each original image such as a receipt cut out from the original scan image D1 is cut out. Perform placement processing to arrange in the image file in a row. In this modification, the process of application A2 includes a process of rearranging the order of arrangement of each original image such as a receipt based on the result of OCR (optical character recognition) of print information included in the original image. . For example, the receipt shows information such as the date and time issued, information indicating the facility used (store name, hotel name etc.), information indicating the purpose of use (meal, accommodation, taxi etc.), payment amount Information is included. The application A2 of the modification 2 receives the setting of the arrangement order based on these from the user, rearranges the images of the respective receipts in the setting, and arranges the images in the image file.

  FIG. 17 is a view showing a modification of the file type setting screen 1300. As shown in FIG. The file type setting screen 1300 shown in FIG. 17 includes selection boxes 1311 such as date order, amount order, use facility order, use purpose order, and the like. The application A2 displays in the selection box 1311 a list of candidates in the order of arrangement, such as the order of date, the order of money, the order of facilities, the order of purpose of use, and accepts any arrangement order from the list.

  FIG. 18 is a diagram illustrating an example of an operation sequence of the entire MFP 1 according to the second modification. In the second modification, the operation panel 20 requests the processing to the OCR processing unit 30 of the external server on the network, receives the processing result, and rearranges the order. Here, portions described in the embodiment will be briefly described, and portions different from the embodiment will be described in detail.

  As shown in FIG. 18, first, the application A2 of the operation panel 20 receives a setting input for the setting information B1 from the user (S201), and saves the setting in the setting area A4 (S202). Here, in addition to the settings described in the embodiment, the setting of the order of arrangement such as the order of dates and the order of amounts is also accepted.

  Then, when the application A2 receives pressing of the scanning start button 1430 from the user, the application A2 requests the main body 10 to execute scanning (S205), and when the main body 10 finishes scanning, the read image D1 is taken out of the main body 10 ( S211).

  Then, the application A2 requests the OCR processing unit 30 to perform the OCR processing, and transmits the read image D1 to be subjected to the OCR processing to the OCR processing unit 30 (S212).

  The OCR processing unit 30 subjects the read image D1 to the requested OCR processing (S213), and transmits the processing result (text data) of the OCR processing to the operation panel 20 of the request source (S214).

  Upon acquiring the processing result of the OCR processing, the application A2 of the operation panel 20 acquires the setting from the setting area A4 (S215), and according to the setting, performs the image processing on the read image D1 as described in the embodiment. Then, each original image such as a receipt is cut out from the read image D1 (S216).

  Thereafter, the application A2 of the operation panel 20 rearranges the document images based on the result of the OCR processing of the read image D1 according to the setting of the arrangement order received in step S202 (S220). For example, when the original is a receipt, and the setting of the arrangement order is date order, the receipt images are rearranged in date order from the respective receipt images and the print information of each receipt included in the result of the OCR processing.

  Thereafter, the application A2 of the operation panel 20 performs arrangement processing, color conversion processing, image format conversion, output processing, and the like according to the settings of the setting information B1. For example, images are arranged in an image file in date order, color converted to monochrome, image format converted to PDF, and printed on the main unit 10 (or transmission to a designated device on a network) (S221). As a result, the main unit 10 executes printing (or transmission to a designated device on the network) (S222).

  In this modification, as an example of the order of rearrangement of document images, the rearrangement items in the case of rearrangement of receipts are shown, but the items of rearrangement may be set appropriately according to the type of document image. .

Second Embodiment
In the first embodiment, the aspect (an example of the aspect of the image processing apparatus) of the MFP in which the main body and the operation unit are integrated is described. However, the main body 10 of the MFP 1 may be provided as an image processing system that cooperates with a user's information processing apparatus such as a tablet terminal or a smartphone that functions as the operation apparatus of the MFP 1 as well as the combination with the operation panel 20 of the MFP 1 .

  In this case, the software of the Web client and the application A2 are installed in the information processing apparatus of the user, and the application A2 is executed on the information processing apparatus of the user. Also in this case, the user operates the Web API of the main unit 10 from the information processing apparatus of the user to request the main unit 10 to execute scanning, and the read image D1 picked up from the main unit 10 is requested by the request on the information processing apparatus. An information processing apparatus which is an operation apparatus of the MFP 1 and performs various functions such as image processing of setting contents individually set by the user and transmitting the output image D2 after the processing to printing or another apparatus Realize on top.

  In such an image processing system, an information processing apparatus such as a smart phone is often provided with a communication function (such as communication I / F 204) such as WiFi. Therefore, in such an image processing system, transmission of the output image D2 obtained by processing in the information processing apparatus is not performed using the communication function (communication I / F 104 etc.) on the main body 10 side, and the communication function of the information processing apparatus It is also possible to use this for the designated device on the network.

  Further, the output image D2 can be output not only to the device on the network but also to a storage medium (for example, an SD memory card or a USB memory) attached to the information processing device.

  FIG. 19 is a diagram showing an example of the operation of the image processing system in the case where the output image D2 is transmitted to the designated destination by the communication function on the information processing apparatus side. FIG. 19 illustrates the information processing apparatus as the operation panel 20. In addition, an operation different from that of the embodiment is mainly shown, and illustration of the other similar operation is omitted.

  As shown in FIG. 19, after converting the image format, the application A2 outputs transmission data including the output image D2 obtained thereby to the communication I / F 204 (S130). The communication I / F 204 transmits the transmission data to the address of the transmission destination designated as the transmission data (S131).

  Programs executed by the image processing apparatus and the information processing apparatus according to each embodiment and each modification are files in an installable format or an executable format, and are CD-ROM, flexible disk (FD), CD-R, and DVD. It is recorded and provided in a computer readable recording medium such as (Digital Versatile Disk).

  In addition, the program executed by the image processing apparatus and the information processing apparatus according to each embodiment or each modification may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. You may configure. In addition, the program executed by the image processing apparatus or the information processing apparatus of each embodiment or each modification may be provided or distributed via a network such as the Internet.

  Further, the program of each embodiment or each modification may be provided by being incorporated in advance in a ROM or the like.

  An example of a usage scene of an application shown in each embodiment and each modification will be described. Note that this application can be used even in other usage scenes and business operations.

(1) For example, when there are a large number of receipts for settlement, the user starts the application (application A2) of the operation panel on the operation panel for operating the MFP, and from the scanning of the document to the output of the document image on the setting screen A series of processes specific to the user (such as cutting out of the original image from the original scan image, skew correction, sorting, arrangement processing, image format conversion, etc.) are performed. Then, the user arranges a large number of receipts on the scanner (on the contact glass surface) of the MFP main body, and presses the start button for setting processing on the screen of the operation panel. Then, a receipt image read by the scanner is previewed in the form of settings on the operation panel. For example, an image etc. in which a large number of receipts randomly placed on the contact glass surface are closely spaced and aligned are displayed. The user deletes an image that needs rereading from the screen displayed as a preview, and presses the output button. By this operation, the image image of the remaining image is printed out from the plotter of the MFP main body, or output as data to the designated folder.

(2) In addition, by installing the application A2 on a smartphone or the like, the user can operate the MFP using the Web API of the MFP main body from each smartphone. Therefore, it is also possible to take over the original scan image of the MFP main body with each smartphone or the like, and flexibly perform a series of processes from image processing to output with various settings for each user in each smartphone.

  Therefore, processing of reading a plurality of receipts at once, cutting out the image of each receipt from the entire image, and printing and outputting the file is much easier, and user work such as form submission at the time of expense settlement is remarkable. It is reduced.

A1 Controller A2 Application A3 Input key A4 Setting area A5 Scanner A6 Image area A7 Plotter A8 Network processing unit B1 Setting information C1, C3 Request C2 Response D1 Scanned image (original scan image)
D2 output image 10 main body 11 connection control unit 12 communication control unit 13 storage control unit 14 request response unit 15 WebAPI service unit 16 reading scanner control unit 17 plotter control unit 20 operation panel (operation unit)
Reference Signs List 21 connection control unit 22 communication control unit 23 storage control unit 24 input reception unit 25 display control unit 26 image processing unit 27 request unit 28 output unit

Japanese Patent Application Laid-Open No. 2002-010059

Claims (20)

An image processing apparatus comprising at least a main body having a scanner and an operation unit for operating the main body,
The operation unit is
An input unit for inputting setting information and an instruction for reading a document by the scanner;
A storage control unit that stores at least the setting information in a storage area of the operation unit when the setting information is input;
A request unit for requesting the main body to read the document by the scanner when the reading execution is input;
A processing unit that, after acquiring a scan image read in response to the request from the main body, processing the scan image based on the setting information stored in the storage area;
An image processing apparatus comprising: The main body includes a first OS, and a scanner control unit operating under the first OS to control the scanner.
The operation unit has a second OS different from the first OS, and at least the input unit and the processing unit are applications operating under the second OS.
The image processing apparatus according to claim 1, The setting information includes a setting used when reading a document by the scanner, and a setting of post-processing to be performed on a scanned image acquired by the processing unit in the operation unit.
The image processing apparatus according to claim 1, When the operation unit requests the main body to read an original by the scanner, the operation unit transmits the setting used when the original is read by the scanner among the setting information.
The image processing apparatus according to claim 3, characterized in that: Among the setting information, the setting of post-processing to be performed on the scan image acquired by the processing unit on the operation unit includes the color setting of the image and the setting of the format format of the image,
The processing unit performs color conversion processing based on the color setting and image format conversion processing based on the setting of the format on the scanned image.
The image processing apparatus according to claim 3, characterized in that: The post processing is
Extraction processing for extracting an original image from the scanned image;
Arrangement processing for arranging a document image extracted by the extraction processing in an image file;
including,
The image processing apparatus according to any one of claims 3 to 5, characterized in that: The extraction process is
Including filtering to highlight the boundaries of the original image when light from an external light source is reflected in the scanned image;
The image processing apparatus according to claim 6, characterized in that: The processing unit is
When the user performs a deletion operation on the document image extracted from the scan image, the document image on which the deletion operation is performed is deleted.
The image processing apparatus according to claim 6 or 7, wherein further,
The body is
Having an image forming unit for forming an image;
The image forming unit forms an image of the processed image of the operation unit when the image forming request is issued from the request unit.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The processing unit is
When the use function of the main body is set to copying in the setting information, the request unit requests the main body to form the image;
When the use function of the main body is set to scan in the setting information, the processed image is output to a storage medium as a file, or the request unit requests the image transmission to the main body.
The image processing apparatus according to claim 9, characterized in that: The operation unit performs a request for reading of a document by the scanner to the main body and acquisition of the scanned image from the main body using a Web API of the main body.
The image processing apparatus according to any one of claims 1 to 10, characterized in that: The placement process is
Rearranging the order of arrangement of document images extracted by the extraction process based on the OCR result of the scanned image;
The image processing apparatus according to claim 6, characterized in that: The application of the operation unit requests the main body to read the plurality of receipts placed on the reading surface of the scanner as a document by the user.
The body generates a scanned image including receipt images of the plurality of receipts;
The application of the operation unit extracts each receipt image of the plurality of receipts from the scan image acquired from the main body, and prints or transmits each receipt image of the plurality of receipts based on the setting information Do output including save,
The image processing apparatus according to claim 2, characterized in that: After placing the plurality of receipts on the scanner, the user lowers the document pressing plate of the scanner and sandwiches the plurality of receipts between the reading surface and the document pressing plate to execute reading.
The application extracts each receipt image of the plurality of receipts from the scanned image by recognizing a character area in the scanned image.
The image processing apparatus according to claim 13, characterized in that: When the plurality of receipts are placed on the scanner, reading is performed without pinching the plurality of receipts between the reading surface and the document pressing plate while raising the document pressing plate of the scanner.
The application extracts each receipt image of the plurality of receipts from the scan image by recognizing the boundary between the area of each receipt in the scan image and the area other than the area of each receipt.
The image processing apparatus according to claim 13, characterized in that: The application is an application that can be added on a general-purpose OS of the operation unit, which is independent of a multifunction peripheral OS included in the main body.
The image processing apparatus according to claim 2, 14 or 15, characterized in that: An image processing system comprising: at least an image processing apparatus having a scanner; and an information processing apparatus capable of communicating with the image processing apparatus and functioning as an operation apparatus for operating the image processing apparatus,
The information processing apparatus is
An input unit for inputting setting information and an instruction for reading a document by the scanner;
A storage control unit that stores at least the setting information in a storage area of the information processing apparatus when the setting information is input;
A request unit for requesting the image processing apparatus to read the document by the scanner when the reading execution is input;
A processing unit that, after acquiring a scan image read in response to the request from the image processing apparatus, processing the scan image based on the setting information stored in the storage area;
An image processing system characterized by having. The processing unit is
When the use function of the image processing apparatus is set to scan in the setting information, the communication function of the information processing apparatus transmits an image of the processed image.
The image processing system according to claim 17, characterized in that. A method of processing an image in an operation unit capable of communicating with an image processing apparatus having a scanner, comprising:
Accepting setting information and an input of reading execution of an original to a scanner of the image processing apparatus;
Storing at least the setting information in a storage area of the operation unit when the setting information is input;
Requesting the image processing apparatus to read the document by the scanner when the reading execution is input;
Applying a process to the scanned image based on the setting information stored in the storage area after acquiring a scanned image read in response to the request from the image processing apparatus;
Method including. In the computer of the operation unit capable of communicating with the image processing apparatus,
An input unit that receives setting information and an input for performing reading of a document on a scanner of the image processing apparatus;
A storage control unit that stores at least the setting information in a storage area of the operation unit when the setting information is input;
A request unit for requesting the image processing apparatus to read the document by the scanner when the reading execution is input;
A processing unit that, after acquiring a scan image read in response to the request from the image processing apparatus, processing the scan image based on the setting information stored in the storage area;
Program to make it work.