JP6520503B2 - Image processing apparatus, image processing system, image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing system, and an image processing program.

  In recent years, image processing apparatuses such as printers and facsimiles used for outputting digitized information and scanners used for digitizing originals have become indispensable devices.

  Among such image processing apparatuses, an image processing apparatus having a plurality of application software (hereinafter referred to as “application”) for performing various processing such as image processing and control processing is known (for example, a patent) Reference 1).

  However, in the conventional image processing apparatus, since the user has to select an application necessary for causing the image processing apparatus to perform processing, the user takes time and effort to select an application, which is inconvenient. There is.

  The present invention has been made to solve such problems, and its object is to improve the convenience of an image processing apparatus.

In order to solve the above problems, according to one aspect of the present invention, there are provided a plurality of image input units for inputting image data, an attribute acquisition unit for acquiring an attribute of the input image data, and a plurality of image input units. Among the plurality of application software, the image data input from among the plurality of application software is determined based on a determination unit that determines one image input unit to which the image data has been input, and the acquired attribute and the one image input unit. And an application selection unit that selects application software to be processed.

  According to the present invention, the convenience of the image processing apparatus can be improved.

It is a figure which shows the operation | use form of the image processing system which concerns on embodiment of this invention. FIG. 2 is a block diagram schematically showing the hardware configuration of the MFP according to the embodiment of the present invention. FIG. 3 is a block diagram schematically showing a software configuration of the MFP according to the embodiment of the present invention. FIG. 2 is a block diagram schematically showing a functional configuration of the MFP according to the embodiment of the present invention. It is a figure which shows an example of the application selection condition list which concerns on embodiment of this invention. It is a figure for demonstrating the function of the slip reading application which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for describing processing when an MFP according to an embodiment of the present invention automatically selects an application for processing or handling an input image. It is a figure which shows the example of a display of the application selection screen to the operation panel which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for describing processing when an MFP according to an embodiment of the present invention automatically selects an application for processing or handling an input image. FIG. 10 is a sequence diagram for describing processing when an MFP according to an embodiment of the present invention automatically selects an application for processing or handling an input image. It is a figure which shows an example of the installation package which concerns on embodiment of this invention. It is a figure showing an example of application selection conditions concerning an embodiment of the present invention. FIG. 6 is a sequence diagram for explaining processing when the MFP according to the embodiment of the present invention newly installs an application. It is a figure which shows the example of a display of the uninstallation screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the uninstallation screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the uninstallation screen to the operation panel which concerns on embodiment of this invention. It is a figure showing an example of application selection conditions concerning an embodiment of the present invention. FIG. 6 is a sequence diagram for explaining processing when the MFP according to the embodiment of the present invention uninstalls an application. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure showing an example of application selection conditions concerning an embodiment of the present invention. FIG. 8 is a sequence diagram for explaining processing when the MFP according to the embodiment of the present invention changes the feature amount of the application selection condition. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure which shows the example of a display of the feature-value change screen to the operation panel which concerns on embodiment of this invention. It is a figure showing an example of application selection conditions concerning an embodiment of the present invention. FIG. 10 is a sequence diagram for explaining processing when the MFP according to the embodiment of the present invention returns the feature amount of the application selection condition to an initial value.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, an operation mode of the image processing system according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an operation mode of the image processing system according to the present embodiment.

  As shown in FIG. 1, the image processing system according to the present embodiment is an MFP (Multi Function Peripheral: MFP) 1-1, 1-2, 1-3,..., 1-n (n is a natural number) , The network 5 to which the file server 2 is connected, and the network 6 to which the client terminals 3-1, 3-2, 3-3,..., 3-m (m is a natural number) are connected. Are connected via a public line 7 such as the Internet or a telephone line.

  Hereinafter, when it is not necessary to distinguish MFPs 1-1, 1-2, 1-3,..., 1-n, they are collectively referred to as MFP1. Also, in the following, when it is not necessary to distinguish between the client terminals 3-1, 3-2, 3-3,..., 3-m, they are collectively referred to as the client terminal 3.

  Note that the number of MFPs 1 and client terminals 3 connected to the networks 4 and 6 is an example, and a large-scale system in which more of these are connected may be used. Further, a plurality of networks to which different MFPs 1 are connected may be connected to the file server 2 and the client terminal 3 via the public line 7.

  In addition, a plurality of networks to which different client terminals 3 are connected may be connected to the MFP 1 and the file server 2 via the public line 7. Further, the MFP 1, the file server 2 and the client terminal 3 may be connected on the same network.

  Also, the networks 4, 5, 6 are limited networks such as an office LAN (Local Area Network), for example, and the MFP 1, the file server 2 and the client terminal 3 are connected to the public line 7 via their respective LANs. Although connected, it is also possible to adopt a mode in which the public line 7 is directly connected.

  Also, the networks 4, 5, 6 may be, for example, Ethernet (registered trademark), USB (Universal Serial Bus), Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity) (registered trademark), FeliCa (registered trademark), IEEE. (The Institute of Electrical and Electronics Engineers) It may be realized by a network using an interface such as a standard.

  The MFP 1 is an example of an image processing apparatus, and is a multifunction peripheral that can be used as a printer, a facsimile, a scanner, and a copier. The file server 2 is a shared server existing on the network, and manages files such as image data.

  The client terminal 3 is an information processing terminal operated by a user, and is realized by an information processing apparatus such as a PC (Personal Computer). The client terminal 3 may be realized by a portable information terminal such as a PDA (Personal Digital Assistant), a smartphone, or a tablet terminal.

  In the image forming system configured as described above, the user can operate the MFP 1 directly or use the MFP 1 by giving an instruction to the MFP 1 via the client terminal 3.

  Next, the hardware configuration of the MFP 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram schematically showing the hardware configuration of the MFP 1 according to the present embodiment.

  As shown in FIG. 2, the MFP 1 according to the present embodiment includes a main body 10 capable of realizing various functions such as a copy function, a scanner function, a facsimile function, and a printer function, and an operation unit 20 for receiving user operations. In the present embodiment, receiving the user's operation is a concept including receiving information (such as a signal indicating a coordinate value of the screen) input according to the user's operation.

  The main body 10 and the operation unit 20 are connected so as to be able to communicate with each other via a dedicated communication path 8. As an interface of the communication path 8, Ethernet (registered trademark), USB (Universal Serial Bus), Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity) (registered trademark), FeliCa (registered trademark), PCIe (Peripheral Component Interconnect) Interfaces such as Express) and IEEE (The Institute of Electrical and Electronics Engineers) standards are used.

  The main unit 10 performs an operation according to the operation accepted by the operation unit 20, but can also communicate with an external device such as the client terminal 3, and may perform an operation according to an instruction received from the external device. It is possible.

  The main body 10 includes a central processing unit (CPU) 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a hard disk drive (HDD) 14, a communication I / F 15, an operation unit connection I / F 16, an engine unit An external connection I / F 18 is connected via a system bus 19.

  The CPU 11 is an arithmetic unit and controls the operation of the entire main body 10. The CPU 11 controls the entire operation of the main unit 10 by executing a program stored in the ROM 12 or the HDD 14 using the RAM 13 as a work area (work area) to control the copy function, the scanner function, the fax function, and the printer described above. Implement various functions such as functions.

  The ROM 12 is a read only non-volatile storage medium, and stores programs such as firmware. The RAM 13 is a volatile storage medium capable of high-speed reading and writing of information, and is used as a work area when the CPU 11 processes information.

  The HDD 14 is a non-volatile storage medium capable of reading and writing information, and stores various data such as image data, and various programs such as an operating system (OS), various control programs, and application software.

  The communication I / F 15 is an interface for connecting the main unit 10 to the network 4. The operation unit connection I / F 16 is an interface for the main body 10 to mutually communicate with the operation unit 20 through the communication path 8, and is registered with Ethernet (registered trademark), USB, Bluetooth (registered trademark), Wi-Fi Interfaces such as trademarks, FeliCa (registered trademark), PCIe, and IEEE standards are used.

  The engine unit 17 is hardware for performing processing other than general-purpose information processing and communication for realizing the copy function, the scanner function, the fax function, and the printer function. For example, the engine unit 17 includes a scanner as an image reading unit that scans and reads an image of a document, a plotter as an image forming unit that performs printing on a sheet material such as a sheet, and a facsimile unit that performs facsimile communication.

  The engine unit 17 can also be provided with a specific option such as a finisher for sorting printed sheet materials, or an ADF (Auto Documen Feeder) for automatically transporting a document.

  The external connection I / F 18 is an interface for the main unit 10 to communicate with another device, and is Ethernet (registered trademark), USB, Bluetooth (registered trademark), Wi-Fi registered trademark, FeliCa (registered trademark), PCIe An interface such as IEEE standard is used.

  In such a hardware configuration, a program stored in a storage medium such as the ROM 12 or the HDD 14 is read to the RAM 13 and the CPU 11 performs an operation according to the program loaded to the RAM 13 to configure a software control unit. A combination of the software control unit configured as described above and hardware configures a functional block that implements the function of the main body 10 of the MFP 1 according to the present embodiment.

The operation unit 20 is configured by connecting the CPU 21, ROM 22, RAM 23, flash memory 24, communication I / F 25, main body connection I / F 26, operation panel 27, and external connection I / F 28 through the system bus 29. There is.

  The CPU 21 is an arithmetic unit and controls the operation of the entire operation unit 20. The CPU 21 executes a program stored in the ROM 22 or the flash memory 24 using the RAM 23 as a work area (work area), thereby controlling the overall operation of the operation unit 20 and displaying the state of the MFP 1, or A screen corresponding to the user operation is displayed on the operation panel 27.

  The ROM 22 is a read-only non-volatile storage medium, and stores programs such as firmware. The RAM 23 is a volatile storage medium capable of high-speed reading and writing of information, and is used as a work area when the CPU 21 processes information.

  The flash memory 24 is a non-volatile storage medium capable of reading and writing information, and stores various data such as image data, and various programs such as an operating system (OS), various control programs, and application software.

The communication I / F 25 is an interface for connecting the operation unit 20 to the network 4. The main body connection I / F 26 is an interface for the operation unit 20 to mutually communicate with the main body 10 via the communication path 8, and is Ethernet (registered trademark), USB, Bluetooth (registered trademark), Wi-Fi registered trademark Interfaces such as FeliCa (registered trademark), PCIe, and IEEE standards are used.

  The operation panel 27 is a visual user interface for the user to confirm the state of the MFP 1 and is realized by a display device such as a liquid crystal display (LCD) or an output device such as a light emitting diode (LED).

  That is, the operation panel 27 receives various types of input according to the user's operation, and various types of information, for example, information corresponding to the received operation, information indicating the operation status of the MFP 1, information indicating the setting state, etc. indicate. In the present embodiment, the operation panel 27 is configured of a liquid crystal display (LCD) equipped with a touch panel function, but is not limited to this.

  For example, the operation panel 27 may be configured of an organic EL display device equipped with a touch panel function. Furthermore, in addition to or instead of this, the operation panel 27 may be configured by an operation unit such as a hardware key or a display unit such as a lamp.

  The external connection I / F 28 is an interface for the operation unit 20 to communicate with another device, and is Ethernet (registered trademark), USB, Bluetooth (registered trademark), Wi-Fi registered trademark, FeliCa (registered trademark), An interface such as PCIe or IEEE standard is used.

  In such a hardware configuration, a program stored in a storage medium such as the ROM 22 or the flash memory 24 is read to the RAM 23, and the CPU 21 performs an operation according to the program loaded to the RAM 23 to configure a software control unit. Ru. The combination of the software control unit configured as described above and hardware configures a functional block that implements the function of the operation unit 20 of the MFP 1 according to the present embodiment.

  Next, the software configuration of the MFP 1 according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram schematically showing the software configuration of the MFP 1 according to the present embodiment.

  As shown in FIG. 3, the main body 10 includes an application layer 101, a service layer 102, and an OS layer 103. The actual state of the application layer 101, the service layer 102, and the OS layer 103 is various software stored in the ROM 12, the HDD 14, and the like. Various functions of the main unit 10 are realized by the CPU 11 executing these software.

  Software of the application layer 101 is application software (hereinafter referred to as “application”) for operating hardware resources and providing predetermined functions. Examples of the application include a copy application for providing a copy function, a scanner application for providing a scanner function, a fax application for providing a fax function, and a printer application for providing a printer function.

  The software of the service layer 102 is software that is interposed between the application layer 101 and the OS layer 103, and provides the application with an interface for using the hardware resources of the main unit 10. Specifically, it is software for providing a function of accepting an operation request for hardware resources and arbitrating the operation request. As the operation request accepted by the service layer 102, a request such as reading by a scanner or printing by a plotter can be considered.

  The function of the interface by the service layer 102 is provided not only to the application layer 101 of the main body 10 but also to the application layer 201 of the operation unit 20. That is, the application of the application layer 201 of the operation unit 20 can also realize the function using the hardware resources of the main body 10, for example, the engine unit 17, via the interface function of the service layer 102.

  The software of the OS layer 103 is basic software (OS: operating system) for providing a basic function to control the hardware provided in the main body 10. The software of the service layer 102 converts a request for using hardware resources from various applications into a command interpretable by the OS layer 103 and passes the command to the OS layer 103. Then, when the command is executed by the software of the OS layer 103, the hardware resource performs an operation according to the request of the application.

  Further, the operation unit 20 includes an application layer 201, a service layer 202, and an OS layer 203 as in the main body 10. The actual state of the application layer 201, the service layer 202, and the OS layer 203 is various software stored in the ROM 22, the flash memory 24, and the like. Various functions of the operation unit 20 are realized by the CPU 21 executing the software.

  However, the functions provided by the application of the application layer 201 and the types of operation requests that can be accepted by the service layer 202 are different from those on the main body 10 side. The application of the application layer 201 may be software for operating hardware resources of the operation unit 20 to provide a predetermined function, but mainly functions of the main body 10, for example, a copy function, a scanner function, The software is software for providing a function of a user interface (UI) for performing operations and displaying related to the fax function and the printer function.

  In the MFP 1 according to the present embodiment, the software of the OS layer 103 on the main body 10 side and the software of the OS layer 203 on the operation unit 20 are different from each other in order to maintain the independence of the functions. That is, the main body 10 and the operation unit 20 operate independently of each other in different operating systems. For example, it is also possible to use Linux (registered trademark) as the software of the OS layer 103 on the main body 10 side and use Android (registered trademark) as the software of the OS layer 203 on the operation unit 20 side.

  As described above, in the MFP 1 according to the present embodiment, since the main body 10 and the operation unit 20 operate with different operating systems, communication between the main body 10 and the operation unit 20 is performed by inter-process communication in a common apparatus. Instead, it is performed as communication between different devices. An operation (command communication) of transmitting information (instruction content from the user) received by the operation unit 20 to the main body 10, an operation of notifying the operation unit 20 of an event by the main body 10, and the like correspond to this.

  In the MFP 1 according to the present embodiment, when the operation unit 20 performs command communication to the main body 10, the function of the main body 10 can be used. Further, the event notified from the main unit 10 to the operation unit 20 includes an execution status of an operation in the main unit 10, contents set on the main unit 10 side, and the like.

  Further, in the MFP 1 according to the present embodiment, since the power supply to the operation unit 20 is performed from the main unit 10 via the communication path 8, the power control of the operation unit 20 is the power control of the main unit 10. Separately, it can be done independently.

  Next, the functional configuration of the MFP 1 according to the present embodiment will be described with reference to FIG. FIG. 4 is a block diagram schematically showing a functional configuration of the MFP 1 according to the present embodiment.

  As shown in FIG. 4, in the MFP 1 according to the present embodiment, the operation unit 20 includes an application software 204, an application selection unit 205, an image analysis unit 206, an application selection condition storage unit 207, an application selection condition change unit 208, and an application selection. A condition acquisition unit 209, an input control unit 210, and a display control unit 211 are provided.

  The application software 204 is various application software for processing or handling the image input to the MFP 1, and the image input to the MFP 1 is processed by the image processing unit 109, the image output unit (print) 110 of the main body 10, The function is realized using the image output unit (mail transmission) 111 and the image output unit (folder transmission) 112.

  The application selection unit 205 automatically selects from the application software 204 application software suitable for processing or handling the image input to the MFP 1. In the present embodiment, automatic selection processing of an application by the application selection unit 205 is one of the gist.

  The image analysis unit 206 analyzes an image input to the MFP 1 in the main body 10 in order to provide the application selection unit 205 with a determination material when the application selection unit 205 automatically selects an application.

  The application selection condition storage unit 207 stores a list of application selection conditions (hereinafter, referred to as “application selection condition list”) as a determination material when the application selection unit 205 automatically selects an application. The application selection condition storage unit 207 is realized by a non-volatile storage medium such as the ROM 22 or the flash memory 24. This application selection condition is defined for each application software.

  Here, the application selection condition list will be described with reference to FIG. FIG. 5 is a diagram showing an example of the application selection condition list according to the present embodiment. As shown in FIG. 5, in the application selection condition list according to the present embodiment, a feature amount is associated with each feature item such as a feature location, a feature type, and a feature detail, for each application.

  The feature amount at the feature point indicates the position and size of the feature in the image. The feature amount in the feature type indicates what feature the feature in the image is, for example, QR code (registered trademark), a barcode, characters, graphics, and the like. The feature amount in the feature details specifically indicates what feature is specifically included in the image, for example, if the feature type is a character, what character string it is.

  Then, when an image is input to MFP 1, application selection unit 205 processes the input image when the feature amount in the image matches the feature amount of any application in the application selection condition list. Select as an application to handle That is, when an image is input to the MFP 1, the application selecting unit 205 selects an application that has a correspondence with the feature amount of the image as an application that processes or handles the input image.

  As described above, when the feature amount in the input image matches the feature amount of any application in the application selection condition list, the MFP 1 according to the present embodiment processes or handles the input image. One of the points is that it is configured to be selected as an app.

  In the example illustrated in FIG. 5, the application selection unit 205 has an image in which a QR code (registered trademark) having a size of width 20 and height 20 is embedded at the position of X coordinate: 10, Y coordinate: 10. When it is input to the MFP 1, the slip reading application is selected as an application that processes or handles the image.

  Further, in the example illustrated in FIG. 5, the application selection unit 205 causes the MFP 1 to display an image in which a barcode having a size of width 40 and height 20 is embedded at the position of X coordinate: 90, Y coordinate: 10. When it is input, the automatic marking application is selected as an application that processes or handles the image.

  Further, in the example shown in FIG. 5, the application selection unit 205 embeds a character string “Mark Sheet” of a size of width: 40, height: 10 at the position of X coordinate: 180, Y coordinate: 10 When an existing image is input to the MFP 1, the mark sheet reading application is selected as an application that processes or handles the image.

  The application selection condition changing unit 208 changes the application selection condition stored in the application selection condition storage unit 207. When a new application is installed in the MFP 1, the application selection condition acquisition unit 209 acquires the application selection condition of the application from the installation package of the application.

  The input control unit 210 receives a user operation on the operation panel 27 and gives an instruction to each unit according to the received operation. The display control unit 211 displays information on the operation panel 27.

  Further, as shown in FIG. 4, in the MFP 1 according to the present embodiment, the main body 10 includes an image input unit (scanner) 104, an image input unit (facsimile reception) 105, an image input unit (network) 106, and an image input unit An external device 107, an input image storage unit 108, an image processing unit 109, an image output unit (print) 110, an image output unit (mail transmission) 111, an image output unit (folder transmission) 112, and an image conversion unit 113.

  An image input unit (scanner) 104 inputs an image to the MFP 1 by optically reading an original. An image input unit 105 (facsimile reception) inputs an image received by facsimile to the MFP 1. An image input unit (network) 106 inputs an image transmitted via the network 4 to the MFP 1. An image input unit (external device) 107 inputs an image to the MFP 1 from an external device such as a USB memory or an SD card connected to the external connection I / F 18 or the external connection I / F 28.

  The input image storage unit 108 stores an image input by the image input unit (scanner) 104, the image input unit (facsimile reception) 105, the image input unit (network) 106, and the image input unit (external device) 107. The input image storage unit 108 is realized by a non-volatile storage medium such as the HDD 14.

  An image processing unit 109 performs image processing on an image input by an image input unit (scanner) 104, an image input unit (facsimile reception) 105, an image input unit (network) 106, and an image input unit (external device) 107.

  An image output unit (print) 110 is based on an image input by an image input unit (scanner) 104, an image input unit (facsimile reception) 105, an image input unit (network) 106, and an image input unit (external device) 107. Do printing.

  An image output unit (mail transmission) 111 includes an image input unit (scanner) 104, an image input unit (facsimile reception) 105, an image input unit (network) 106, and an image input unit (external device) 107 as a network. Send email via 4

  An image output unit (folder transmission) 112 is based on the image input by the image input unit (scanner) 104, the image input unit (facsimile reception) 105, the image input unit (network) 106, and the image input unit (external device) 107. The file server 2 is caused to create a folder hierarchy, and the images are transmitted to the file server 2 and stored according to the created folder hierarchy.

  The image conversion unit 113 transmits an image input unit (scanner) 104, an image input unit (facsimile reception) 105, and an image in order to pass only the information necessary for image analysis by the image analysis unit 206 to the image analysis unit 206. The image input unit (network) 106 converts the image input by the image input unit (external device) 107 and delivers the converted image to the image analysis unit 206.

  For example, after the image conversion unit 113 performs image conversion such as reducing the resolution of the image, compressing the image, or cutting out only the area necessary for image analysis by the image analysis unit 206, the image conversion unit 206 Hand over.

  As described above, in the present embodiment, the reason for delivering an image to the image analysis unit 206 after performing image conversion by the image conversion unit 113 is that the main unit 10 and the operation unit 20 communicate via the communication path 8 If the image size is large, the delivery of the image becomes a bottleneck, which affects the processing performance.

  That is, since the MFP 1 according to the present embodiment is software in which the image analysis unit 206 and the image conversion unit 113 operate on different hardware, the image conversion unit is intended to minimize the amount of communication therebetween. After the image conversion is performed in 113, the converted image is sent to the image analysis unit 206.

  The functions of the respective units of the MFP 1 are realized by the CPU 11 or 21 executing programs stored in the storage device, for example, the ROM 12, the HDD 14, the ROM 22, the flash memory 24 or the like, but is not limited thereto. For example, at least a part of the functions of each unit of the MFP 1 may be realized by a dedicated hardware circuit, such as a semiconductor integrated circuit.

  Further, although the MFP 1 according to the present embodiment is configured such that the main body 10 and the operation unit 20 operate independently of each other in different operating systems, the present invention is not limited thereto. For example, the main body 10 and the operation unit 20 And may be configured to operate with the same operating system.

  Further, the program executed by the MFP 1 according to the present embodiment is a file of an installable format or an executable format, and is a CD-ROM (Compact Disc-ROM), a flexible disc (Flexible Disc), a CD-R, a DVD It may be configured to be provided by being recorded in a computer readable recording medium such as a Digital Versatile Disk) -ROM, a DVD-R, a Universal Serial Bus (USB) memory, and an SD card.

  Also, the program executed by the MFP 1 according to the present embodiment may be configured to be provided or distributed via a network such as the Internet, and non-volatiles such as the ROM 12, the ROM 22, the HDD 14, the flash memory 24 and the like. It may be configured to be provided in a state of being incorporated in advance in a sex recording medium.

  In MFP 1 configured in this way, one of the points according to the present embodiment is that when an image is input by the image input unit, the image is analyzed to extract a feature amount, and the feature amount is an application selection condition When the feature amount of any of the applications in the list is matched, the application is automatically selected as an application that processes or handles the input image.

  For example, when the image input unit (scanner) 104 reads an original and inputs an image, the MFP 1 according to the present embodiment has a width of 20 at the position of X coordinate: 10, Y coordinate: 10 in the image. Height: When a QR code (registered trademark) of 20 sizes is embedded, it is recognized that the read document is a slip with a QR code (registered trademark), and the slip is used as an application to process or handle the image Automatically select the reading application.

  Further, in MFP 1 configured in this way, one of the other points according to the present embodiment is based on the input source of the input image, that is, based on which image input unit has input the image. , To automatically select an application that processes or handles the image.

  For example, when the document is read by the image input unit (scanner) 104 and an image is input, the MFP 1 according to the present embodiment automatically selects a scanner application as an application that processes or handles the image.

  With such a configuration, the MFP 1 according to the present embodiment automatically performs an application that is highly likely to process or handle an input image, or an application suitable for processing or handling an input image. It is possible to narrow down and present it to the user. Therefore, the MFP 1 according to the present embodiment can reduce the time and effort when the user selects the application software, and can improve the convenience for the user.

  Further, since the MFP 1 according to the present embodiment is configured to automatically select the application based on the feature amount of the input image, the application processing or handling the image processes the image having the feature amount. In the case of an application specialized for, it is possible to improve the accuracy of automatic selection.

  In the MFP 1 according to the present embodiment, the CPU 11 or 21 executes the image processing program stored in the storage device, for example, the ROM 12, the HDD 14, the ROM 22, the flash memory 24, etc. Processing is realized.

  Next, the function of the slip reading application according to the present embodiment will be described with reference to FIG. FIG. 6 is a diagram for explaining the function of the slip reading application according to the present embodiment.

  As shown in FIG. 6, when the MFP 1 reads a slip with a QR code (registered trademark), an appropriate folder hierarchy and a slip image file on the file server 2 are based on the QR code (registered trademark) information. Create Then, the MFP 1 stores the created slip image file in accordance with the created folder hierarchy.

  In the example shown in FIG. 6, the folder hierarchy is in the order of “distributed company code”, “delivery date”, and “customer CD”, but the hierarchical order of folders and the number of hierarchies are arbitrary. Also, the user can set an arbitrary item for the item to be the folder name.

  Further, in the example shown in FIG. 6, the file names are "cargo No.", "order acceptance No.", and "inquiry No", but the user can arbitrarily set this naming rule. Further, in the example shown in FIG. 6, the format of the slip image file is in the JPG format, but the user can arbitrarily set the format of the image file.

  Then, the MFP 1 according to the present embodiment reads a document and recognizes that it is a slip with a QR code (registered trademark), and then automatically starts the slip reading application and executes the processing until it is processed. Is one of the abstracts.

  That is, when the MFP 1 according to the present embodiment reads a document in a state in which a specific application is not selected, the MFP 1 checks whether there is a QR code (registered trademark) in the characteristic portion of the document. It is determined that the document is a target document of the reading application, and the slip reading application is automatically activated to perform processing.

  With such a configuration, the MFP 1 according to the present embodiment automatically performs an application that is highly likely to process or handle an input image, or an application suitable for processing or handling an input image. It is possible to narrow down and present the candidate to the user. Therefore, the MFP 1 according to the present embodiment can reduce the time and effort when the user selects the application software, and can improve the convenience for the user.

  Further, since the MFP 1 according to the present embodiment is configured to automatically select the application based on the feature amount of the input image, the application processing or handling the image processes the image having the feature amount. In the case of an application specialized for, it is possible to improve the accuracy of automatic selection.

  Next, processing when the MFP 1 according to the present embodiment automatically selects an application for processing or handling an input image will be described with reference to FIGS. 7, 9, and 10. FIGS. 7, 9, and 10 are sequence diagrams for describing processing when the MFP 1 according to the present embodiment automatically selects an application for processing or handling an input image.

  As shown in FIG. 7, first, upon receiving a scan execution operation by the user (S 701), the application selection unit 205 requests the image input unit (scanner) 104 to execute a document scan. (S702)

  When the image input unit (scanner) 104 receives a scan execution request from the application selection unit 205, it executes document reading (S703), and when document reading is completed, notifies the application selection unit as a scan execution response to that effect. (S704).

  When the application selection unit 205 receives a scan execution response from the image input unit (scanner) 104, the application selection unit 205 reads the application selection condition from the application selection condition storage unit 207 (S705), and sends an image analysis request to the image analysis unit 206 S706). At this time, the application selection unit 205 passes the read application selection condition to the image analysis unit 206.

  When receiving the image analysis request from the application selection unit 205, the image analysis unit 206 sends an image acquisition request to the image conversion unit 113 (S707).

  At this time, the image analysis unit 206 determines a parameter (hereinafter, referred to as “image analysis parameter”) for acquiring information necessary for the image analysis from the application selection condition, and the image analysis parameter is an image. Pass it to the converter 113. For example, the image analysis unit 206 determines, as an image analysis parameter, information of an area in which a feature is to be embedded, that is, parameters such as feature amount information and an image resolution.

  As described above, the MFP 1 according to the present embodiment performs processing of image delivery between the main unit 10 and the operation unit 20 by passing the image to the image analysis unit 206 after performing image conversion by the image conversion unit 113. It is possible to improve the speed.

  In addition, as described above, the MFP 1 according to the present embodiment performs image conversion by the image conversion unit 113 and then delivers the image to the image analysis unit 206 to pinpoint information necessary for image analysis using the image analysis unit. Since it can be passed to 206, it is possible to improve the analysis accuracy by the image analysis unit 206.

  When receiving the image acquisition request from the image analysis unit 206, the image conversion unit 113 sends an image acquisition request to the image input unit (scanner) 104 (S708).

  When the image input unit (scanner) 104 receives the image acquisition request from the image conversion unit 113, the image input unit (scanner) delivers the document image read in S703 to the image conversion unit 113 as an image acquisition response (S709).

  When the image conversion unit 113 acquires an image from the image input unit (scanner) 104 (S710), the image conversion unit 113 converts the image acquired from the image input unit (scanner) 104 according to the image analysis parameters received from the image analysis unit 206. (S711), and passes the image after image conversion to the image analysis unit 206 as an image acquisition response (S712).

  When acquiring the converted image from the image conversion unit 113 (S713), the image analysis unit 206 analyzes the converted image with reference to the application selection condition received from the application selection unit 205 (S714), and uses the analysis result as an image analysis response. The application selection unit 205 is notified (S 715).

  When the application selection unit 205 receives an analysis result from the image analysis unit 206, an application suitable for processing or handling the image input to the image input unit (scanner) 104 in S703 from the application software 204 according to the analysis result. Are automatically narrowed down and candidates are selected (S716).

  For example, a QR code (registered trademark) of a size of 20 in width and 20 in height is embedded at the position of X coordinate: 10, Y coordinate: 10 of the image input to the image input unit (scanner) 104 In this case, the image analysis unit 206 notifies the application selection unit 205 of that effect as the analysis result.

  Then, the application selection unit 205 automatically narrows down an application suitable for processing or handling the image input to the image input unit (scanner) 104, and automatically selects a slip reading application and a scanner application as the candidates. As shown in FIG. 8, the operation panel 27 is presented to the user as an application selection screen. FIG. 8 is a view showing a display example of an application selection screen on the operation panel 27 according to the present embodiment.

  As described above, the MFP 1 according to the present embodiment automatically selects an application that processes or handles the image based on the feature amount extracted from the input image, and based on the input source of the input image. That is, it is configured to automatically select an application that processes or handles the image based on which image input unit has input the image. That is, in the present embodiment, the application selection unit 205 functions as an attribute acquisition unit, and the feature amount and the input source of the image are acquired as the attribute of the image data.

  Then, when the user performs a slip reading application selection operation on the application selection screen shown in FIG. 8, the application selecting unit 205 receives the selection operation (S901), and requests the slip processing application 204c for the slip processing. (S902). That is, in the present embodiment, the application selection unit 205 functions as an application selection operation reception unit.

  As described above, when a plurality of applications for processing or handling the input image are selected, the MFP 1 according to the present embodiment receives a user operation for selecting one of the applications. Is configured. With the MFP 1 according to the present embodiment configured as described above, the user can select a desired application, and convenience can be improved.

  When the slip reading application 204c receives a slip processing request from the application selecting unit 205, the slip reading application 204c sends an image processing request to the image processing unit 109 (S903).

  When the image processing unit 109 receives an image processing request from the slip reading application 204c, the image processing unit 109 sends an image acquisition request to the image input unit (scanner) 104 (S904).

  Upon receiving the image acquisition request from the image processing unit 109, the image input unit (scanner) 104 delivers the document image read in S703 to the image processing unit 109 as an image acquisition response (S905).

When the image processing unit 109 acquires an image from the image input unit (scanner) 104 (S 906), the image processing is performed on the acquired image (S 907). The slip reading application 204c is notified (S908).

  When the slip reading application 204c receives the image processing response from the image processing unit 109, it sends a folder transmission request to the image output unit (folder transmission) 114 (S909).

  When the image output unit (folder transmission) 114 receives a folder transmission request from the slip reading application 204c, the image output unit 114 sends an image acquisition request to the image processing unit 109 (S910).

  When the image processing unit 109 receives an image acquisition request from the image output unit (folder transmission) 114, the image processing unit 109 delivers an image processed as an image acquisition response to the image output unit (folder transmission) 114 (S911).

  When the image output unit (folder transmission) 114 acquires the image-processed image from the image processing unit 109, an appropriate folder hierarchy and a slip image file are created on the file server 2, and the created folder hierarchy is created according to the created folder hierarchy. The slip image file is stored (S912).

  On the other hand, as shown in FIG. 10, when the user performs a cancel operation on the application selection screen shown in FIG. 8, the application selection unit 205 receives the cancel operation (S1001), and the image input unit (scanner) 104 An image discard request is issued (S1002).

  When receiving the image discarding request from the application selecting unit 205, the image input unit (scanner) 104 discards the image read in S703 (S1003).

  Next, processing when the MFP 1 according to the present embodiment newly installs an application will be described with reference to FIGS. FIG. 11 is a diagram showing an example of an installation package according to the present embodiment. FIG. 12 is a diagram showing an example of application selection conditions according to the present embodiment. FIG. 13 is a sequence diagram for explaining the process when the MFP 1 according to the present embodiment newly installs an application.

  As shown in FIG. 11, the installation package of the application A includes the application selection condition of the application A. Then, when such an application A is installed, the MFP 1 adds the application selection condition of the application A to the record of the application selection condition list stored in the application selection condition storage unit 207, as shown in FIG.

  At this time, as shown in FIG. 13, first, when the application selection condition changing unit 208 receives an installation operation by the user (S1301), the application selection condition changing unit 208 issues an application selection condition acquisition request to the application selection condition acquisition unit 209 (S1302) .

  When the application selection condition acquisition unit 209 receives an application selection condition acquisition request from the application selection condition changing unit 208, the application selection condition acquisition unit 209 acquires the application selection condition from the installation package (S1303), and selects the application as the application selection condition acquisition response. Delivery to the condition change unit 208 (S1304).

  When the application selection condition changing unit 208 acquires the application selection condition from the application selection condition acquisition unit 209 (S1305), the application selection condition changing unit 208 adds the application selection condition to the record of the application selection condition list stored in the application selection condition storage unit 207. (S1306).

  As described above, when newly installing an application, the MFP 1 according to the present embodiment adds the application selection condition of the application to the application selection condition list stored in the application selection condition storage unit 207. It is possible to use the app as the developer intended.

  Next, processing when the MFP 1 according to the present embodiment uninstalls an application will be described with reference to FIGS.

  14 to 16 are diagrams showing display examples of the uninstall screen on the operation panel 27 according to the present embodiment. FIG. 17 is a diagram showing an example of application selection conditions according to the present embodiment. FIG. 18 is a sequence diagram for explaining processing when the MFP 1 according to the present embodiment uninstalls an application. FIGS. 14 to 17 show an example in which the application A is selected as the application to be uninstalled.

  When the user performs an operation to select an application to be uninstalled in the uninstall screen shown in FIG. 14, the MFP 1 displays a screen to make the user confirm that the selected application should be uninstalled, as shown in FIG. indicate.

  Then, when the user performs a confirmation operation on the confirmation screen, MFP 1 executes an uninstall process of the selected application, and as shown in FIG. 16, the application selection condition of the application is stored in application selection condition storage unit 207. Delete from the stored records of the application selection condition list. As a result, as shown in FIG. 17, the uninstalled application is not displayed in the application list.

  At this time, as shown in FIG. 18, first, when the input control unit 210 receives a display operation of the uninstall screen by the user (S1801), the input control unit 210 requests the display control unit 211 to display the uninstall screen (S1802). ).

  When the display control unit 211 receives a display request for the uninstall screen from the input control unit 210, the display control unit 211 displays an uninstall screen as shown in FIG. 14 on the operation panel 27 (S1803).

  When the input control unit 210 receives an application selection operation by the user on the uninstall screen (S1804), the input control unit 210 requests the display control unit 211 to display a confirmation screen (S1805).

  When the display control unit 211 receives a display request for a confirmation screen from the input control unit 210, the display control unit 211 displays a confirmation screen as shown in FIG. 15 on the operation panel 27 (S1806).

  When the input control unit 210 receives a confirmation operation by the user on the confirmation screen (S1807), the input control unit 210 requests the application selection condition changing unit 208 to delete the application selection condition (S1808).

  When the application selection condition changing unit 208 receives an application selection condition deletion request from the input control unit 210, the application selection condition changing unit 208 deletes the application selection condition of the application from the records of the application selection condition list stored in the application selection condition storage unit 207 ( S1809).

  As described above, when the MFP 1 according to the present embodiment uninstalls an application, unnecessary information is deleted because the application selection condition of the application is deleted from the application selection condition list stored in the application selection condition storage unit 207. It becomes possible to delete.

  Next, processing when the MFP 1 according to the present embodiment changes the feature amount of the application selection condition stored in the application selection condition storage unit 207 will be described with reference to FIGS.

  19 to 21 are views showing display examples of the feature amount change screen on the operation panel 27 according to the present embodiment. FIG. 22 is a diagram showing an example of application selection conditions according to the present embodiment. FIG. 23 is a sequence diagram for explaining processing when the MFP 1 according to the present embodiment changes the feature amount of the application selection condition. FIGS. 19 to 22 show, as an example, the case where the feature details of the automatic marking application are selected as the feature quantities to be changed.

  When the user performs the selection operation of the feature amount to be changed on the feature amount change screen shown in FIG. 19, MFP 1 selects candidate feature amounts for the feature item to which the selected feature amount belongs, as shown in FIG. Display a selection candidate screen for presenting to the user. FIGS. 19 and 20 show an example in which the feature details of the automatic marking application are set to the barcode in the initial value (default).

  Then, when the user performs the selection operation of the feature amount on the selection candidate screen, as shown in FIG. 21, MFP 1 features a feature of the application selection condition list stored in application selection condition storage unit 207. The feature amount selected on the amount change screen is changed to the feature amount selected on the selection candidate screen. As a result, as shown in FIG. 22, the application selection condition list after the feature amount change is displayed.

  At this time, as shown in FIG. 23, first, when the input control unit 210 receives a display operation of the feature amount change screen by the user (S 2301), the input control unit 210 requests the display control unit 211 to display the feature amount change screen. (S2302).

  When the display control unit 211 receives a display request for the feature amount change screen from the input control unit 210, the display control unit 211 reads the application selection condition list from the application selection condition storage unit 207 (S2303), and based on the read application selection condition list. The feature amount change screen as shown in FIG. 6 is displayed on the operation panel 27 (S2304).

  When the input control unit 210 receives the selection operation of the feature amount by the user on the feature amount change screen (S2305), the input control unit 210 requests the display control unit 211 to display the selection candidate screen (S2306). That is, in the present embodiment, the input control unit 210 functions as an application selection condition change operation receiving unit.

  When the display control unit 211 receives a display request for the selection candidate screen from the input control unit 210, the display control unit 211 displays the selection candidate screen as shown in FIG. 20 on the operation panel 27 (S2307).

  When the input control unit 210 receives the selection operation of the feature amount by the user on the selection candidate screen (S2308), the input control unit 210 sends a feature amount change request to the application selection condition changing unit 208 (S2309).

  When the application selection condition change unit 208 receives the feature amount change request from the input control unit 210, the application selection condition change unit 208 selects the feature amounts of the application selection condition list stored in the application selection condition storage unit 207 on the feature amount change screen. The feature amount is changed to the feature amount selected on the selection candidate screen. (S2310).

  As described above, the MFP 1 according to the present embodiment can customize the function for each user because the user can change the feature amount of the application selection condition list stored in the application selection condition storage unit 207. Is possible.

  Next, processing when the MFP 1 according to the present embodiment returns the feature amount of the application selection condition stored in the application selection condition storage unit 207 to the initial value will be described with reference to FIGS. 24 to 28.

  FIGS. 24 to 26 are diagrams showing display examples of the feature amount change screen on the operation panel 27 according to the present embodiment. FIG. 27 is a diagram showing an example of application selection conditions according to the present embodiment. FIG. 28 is a sequence diagram for explaining processing when the MFP 1 according to the present embodiment returns the feature amount of the application selection condition to the initial value. In FIG. 24 to FIG. 27, the case where the automatic marking application is selected as an application whose feature value is returned to the initial value is shown as an example.

  When the user performs an operation for selecting an application to be returned to the initial value on the feature amount change screen shown in FIG. 24, MFP 1 causes the user to return the feature amount of the selected application to the initial value, as shown in FIG. Display a confirmation screen for confirmation.

  Then, when the user performs a confirmation operation on the confirmation screen, as shown in FIG. 26, MFP 1 displays the feature amount change screen of the feature amounts of the application selection condition list stored in application selection condition storage unit 207. Return the feature value of the selected application to the initial value. As a result, as shown in FIG. 27, the application selection condition list after the feature amount initialization is displayed.

  At this time, first, the input control unit 210 performs the same processing as S2301 to S2304. Then, as shown in FIG. 28, when the input control unit 210 receives an application selection operation by the user on the feature amount change screen (S2801), the input control unit 210 requests the display control unit 211 to display a confirmation screen (S2802). ).

  When the display control unit 211 receives a display request for a confirmation screen from the input control unit 210, the display control unit 211 displays a confirmation screen as shown in FIG. 25 on the operation panel 27 (S2803).

  When the input control unit 210 receives a confirmation operation by the user on the confirmation screen (S2804), the input control unit 210 issues an initial value change request to the application selection condition changing unit 208 (S2805).

  When the application selection condition changing unit 208 receives an initial value change request from the input control unit 210, the application selection condition changing unit 208 makes an initial value acquisition request to the application selection condition acquiring unit 209 (S2806).

  Upon receiving the initial value acquisition request from the application selection condition changing unit 208, the application selection condition acquisition unit 209 acquires the initial value of the application selection condition of the application from the installation package of the application selected in S2801 (S2807), The initial value is delivered to the application selection condition changing unit 208 as an initial value acquisition response (S2808).

  When the application selection condition changing unit 208 acquires the initial value of the application selection condition from the application selection condition acquisition unit 209 (S2809), the feature of the application selection condition list stored in the application selection condition storage unit 207 is a feature The feature amount of the application selected on the amount change screen is changed to the acquired initial value. (S2810).

  As described above, the MFP 1 according to the present embodiment can return the feature amount of the application selection condition list stored in the application selection condition storage unit 207 to the initial value by a simple operation, which is convenient. It is possible to improve the

  As described above, when an image is input by the image input unit, the MFP 1 according to the present embodiment analyzes the image and extracts the feature amount, and the feature amount is any one of the application selection condition list, as described above. One of the gist is that the application is configured to be automatically selected as an application that processes or handles the input image when it matches the feature amount of the application.

  For example, when the image input unit (scanner) 104 reads an original and inputs an image, the MFP 1 according to the present embodiment has a width of 20 at the position of X coordinate: 10, Y coordinate: 10 in the image. Height: When a QR code (registered trademark) of 20 sizes is embedded, it is recognized that the read document is a slip with a QR code (registered trademark), and the slip is used as an application to process or handle the image Automatically select the reading application.

  In addition, the MFP 1 according to the present embodiment automatically selects an application that processes or handles the image based on the input source of the input image, that is, based on which image input unit inputs the image. One of the points is that it is configured.

  For example, when the document is read by the image input unit (scanner) 104 and an image is input, the MFP 1 according to the present embodiment automatically selects a scanner application as an application that processes or handles the image.

  With such a configuration, the MFP 1 according to the present embodiment automatically performs an application that is highly likely to process or handle an input image, or an application suitable for processing or handling an input image. It is possible to narrow down and present it to the user. Therefore, the MFP 1 according to the present embodiment can reduce the time and effort when the user selects the application software, and can improve the convenience for the user.

  Further, since the MFP 1 according to the present embodiment is configured to automatically select the application based on the feature amount of the input image, the application processing or handling the image processes the image having the feature amount. In the case of an application specialized for, it is possible to improve the accuracy of automatic selection.

1 MFP
2 file server 3 client terminal 4 network 5 network 6 network 7 public line 8 channel 10 main unit 11 CPU
12 ROM
13 RAM
14 HDD
15 Communication I / F
16 Operation unit connection I / F
17 Engine section 18 External connection I / F
19 system bus 20 operation unit 21 CPU
22 ROM
23 RAM
24 Flash Memory 25 Communication I / F
26 Main unit connection I / F
27 Operation panel 28 External connection I / F
29 system bus 101 application layer 102 service layer 103 OS layer 104 image input unit (scanner)
105 Image input unit (facsimile reception)
106 Image Input Unit (Network)
107 Image Input Unit (External Device)
108 input image storage unit 109 image processing unit 110 image output unit (print)
111 Image output unit (mail transmission)
112 Image output unit (folder transmission)
113 image conversion unit 201 application layer 202 service layer 203 OS layer 204 application software 205 application selection unit 206 image analysis unit 207 application selection condition storage unit 208 application selection condition change unit 209 application selection condition acquisition unit 210 input control unit 210
211 Display control unit

JP, 2005-269619, A

Claims (10)

A plurality of image input units for inputting image data;
An attribute acquisition unit that acquires an attribute of the input image data;
A determination unit that determines one image input unit to which the image data is input among the plurality of image input units;
And an application selection unit for selecting application software for processing the input image data among a plurality of application software based on the acquired attribute and the one image input unit. Image processing device. The information indicating the application software selected based on the attribute and the information indicating the application software selected based on the one image input unit are displayed, and a user operation for selecting any application software is received. The image processing apparatus according to claim 1, comprising an application selection operation receiving unit. An image analysis unit that analyzes feature amounts of features included in the input image data;
The image processing apparatus according to claim 1, wherein the attribute acquisition unit acquires the analyzed feature amount as the attribute. And an image conversion unit that performs processing for reducing the resolution or processing for compressing the input image data,
The image processing apparatus according to claim 3, wherein the image analysis unit analyzes the feature amount based on the converted image data.   The application selection unit is configured as application software for processing the input image data, application software whose application selection condition defined for each of the plurality of application softwares is in correspondence with the acquired attributes. The image processing apparatus according to any one of claims 1 to 4, wherein the image processing apparatus is selected.   The application selection condition changing unit is configured to add the application selection condition defined in the installed application software to the application selection condition list in which the application selection condition is associated with each of the plurality of application software. The image processing apparatus according to claim 5. An application selection condition acquiring unit for acquiring an application selection condition defined in the application software from an installation package of the application software to be installed;
7. The image processing apparatus according to claim 6, wherein the application selection condition changing unit adds the acquired application selection condition to the application selection condition list.   The image processing apparatus according to claim 6, further comprising an application selection condition change operation receiving unit that receives a user operation for changing the application selection condition in the application selection condition list. A plurality of image input units for inputting image data;
An attribute acquisition unit that acquires an attribute of the input image data;
A determination unit that determines one image input unit to which the image data is input among the plurality of image input units;
And an application selection unit for selecting application software for processing the input image data among a plurality of application software based on the acquired attribute and the one image input unit. Image processing system. A plurality of input steps for inputting image data;
An acquisition step of acquiring an attribute of the input image data;
A determination step of determining one input step in which the image data is input among the plurality of input steps;
Selecting the application software for processing the input image data among the plurality of application software based on the acquired attribute and the one input step; and causing the information processing apparatus to execute Image processing program to be.