JP7346937B2 - Information processing device, information processing method, program, image forming system - Google Patents

Description

The present invention relates to an information processing device, an information processing method, a program, and an image forming system.

2. Description of the Related Art Conventionally, application programs (hereinafter also referred to as applications) have been developed for image forming apparatuses such as multifunction peripherals (MFPs) to implement various image processing functions such as printing and scanning.

The image forming apparatus has an application (also called middleware) that includes a group of APIs for a third vendor or the like to develop an application that provides a UI (user interface) related to image processing (for example, Patent Document 1). Third-party vendors and the like can easily develop applications that provide UIs related to image processing by using the middleware API group.

However, middleware for image forming apparatuses can only operate on the platform of the image forming apparatus, and has not been deployed on other platforms (for example, information processing apparatuses such as smart devices).

Therefore, it has been difficult for developers of applications for information processing devices to create or customize applications for the information processing device to instruct the image forming device to perform jobs such as printing and scanning.

Therefore, an object of an embodiment of the present invention is to easily develop an application for operating an image forming apparatus.

In order to solve the above problems, an embodiment of the present invention includes an application that receives an image processing instruction for an image forming apparatus, a printing framework that instructs the image forming apparatus to execute the image processing, and the application. and a function providing application that, when called from , instructs the printing framework to execute the image processing to the image forming apparatus.

According to an embodiment of the present invention, it is possible to easily develop an application for operating an image forming apparatus.

1 is a diagram illustrating an example of the overall configuration of an image forming system according to an embodiment. 1 is a diagram illustrating an example of a hardware configuration of an image forming apparatus according to an embodiment. FIG. 2 is a diagram illustrating an example of a hierarchical structure of software groups included in the operating device and main body device of the image forming apparatus according to the present embodiment. FIG. 2 is a diagram showing an example of software installed in the image forming apparatus according to the present embodiment. 1 is a diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. FIG. 1 is a diagram illustrating an example of software installed in an information processing device and an image forming device according to the present embodiment. FIG. 2 is a diagram illustrating an example of functional blocks of a function providing application according to the present embodiment. FIG. 3 is a sequence diagram showing an example of image processing according to the present embodiment. FIG. 3 is a diagram illustrating an example of a settings screen for making print settings according to the present embodiment. FIG. 3 is a diagram showing an example of a screen for selecting an image forming apparatus according to the present embodiment. FIG. 3 is a diagram illustrating an example of a settings screen for making print settings according to the present embodiment. FIG. 3 is a sequence diagram showing an example of image processing according to the present embodiment. FIG. 3 is a diagram illustrating an example of a screen for selecting a printing framework according to the present embodiment. FIG. 3 is a sequence diagram showing an example of image processing according to the present embodiment. It is a figure showing an example of an error screen concerning this embodiment.

Embodiments of the present invention will be described below with reference to the drawings.

<Example of overall configuration>
FIG. 1 is a diagram showing an example of the overall configuration of an image forming system 1 according to the present embodiment. As shown in FIG. 1, an image forming system 1 according to an embodiment of the present invention includes one or more image forming apparatuses 10 and one or more information processing apparatuses 20. Further, the image forming apparatus 10 and the information processing apparatus 20 can be communicably connected via an arbitrary network 30.

The image forming apparatus 10 is an electronic device such as a multifunction device. Note that the image forming apparatus 10 is not limited to a multifunction device, but may also be an output device such as a PJ (Projector), an IWB (Interactive White Board: a whiteboard with an electronic blackboard function that allows mutual communication), and a digital signage. , HUD (Head Up Display) devices, industrial machinery, manufacturing equipment, imaging devices, sound collection devices, medical equipment, network appliances, notebook PCs (Personal Computers), mobile phones, smartphones, tablet terminals, game consoles, PDAs (Personal Digital Assistant), digital camera, wearable PC, or desktop PC.

The information processing device 20 is a PC (personal computer), a smartphone, a tablet terminal, or the like. As will be described later, the information processing device 20 is used to instruct the image forming device 10 to perform jobs such as printing and scanning. For example, the information processing device 20 is a mobile terminal owned by a user of the image forming device 10.

Note that the configuration of the image forming system 1 shown in FIG. 1 is an example, and other configurations may be used.

<Example of hardware configuration of image forming apparatus 10>
FIG. 2 is a diagram showing an example of the hardware configuration of the image forming apparatus 10 according to the present embodiment. As shown in FIG. 2, an image forming apparatus 10 according to an embodiment of the present invention includes an operating device 11 and a main body device 12.

The operating device 11 selects an image processing function to be executed by the main unit 12, inputs various setting values to execute the image processing function, inputs an execution instruction to start executing the image processing function, and switches display screens. etc., is used when the user performs various operations.

The main body device 12 executes various processes such as image processing functions in response to various user operations on the operating device 11 .

As shown in FIG. 2, the operating device 11 of the image forming apparatus 10 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. Further, the operating device 11 includes a flash memory 114, an operating panel 115, a connection I/F 116, and a communication I/F 117. These pieces of hardware are interconnected via a bus 118.

The CPU 111 is an arithmetic device that controls the entire operating device 11 by executing various programs stored in the ROM 112 or the flash memory 114 using the RAM 113 as a work area.

The ROM 112 is a nonvolatile semiconductor memory (storage device) that can retain data even when the power is turned off. The RAM 113 is a volatile semiconductor memory (storage device) that temporarily holds programs and data.

The flash memory 114 is a nonvolatile storage device, and stores various programs executed by the CPU 111 (for example, a program for implementing the present embodiment) and various data.

The operation panel 115 is used when the user performs various operations. The operation panel 115 also displays various screens and the like to the user.

The connection I/F 116 is an interface for communicating with the main device 12 via the communication path 13. For the connection I/F 116, for example, an interface of the USB (Universal Serial Bus) standard is used.

The communication I/F 117 is an interface for communicating with other devices. For example, a Wi-Fi standard wireless LAN (Local Area Network) is used for the communication I/F 117.

Similarly, the main unit 12 of the image forming apparatus 10 includes a CPU 121, a ROM 122, and a RAM 123. The main device 12 also includes an HDD (Hard Disk Drive) 124, an image processing engine 125, a connection I/F 126, and a communication I/F 127. These pieces of hardware are interconnected via a bus 128.

The CPU 121 is a calculation device that controls the entire main device 12 by executing various programs stored in the ROM 122 or the HDD 124 using the RAM 123 as a work area.

The ROM 122 is a nonvolatile semiconductor memory (storage device) that can retain data even when the power is turned off. The RAM 123 is a volatile semiconductor memory (storage device) that temporarily holds programs and data.

The HDD 124 is a non-volatile storage device, and stores various programs executed by the CPU 121 (for example, a program implementing the present embodiment) and various data.

The image processing engine 125 is hardware that performs image processing to realize various image processing functions such as a print function, a scan function, a copy function, and a FAX function.

The image processing engine 125 includes, for example, a plotter that prints on a sheet material such as paper, a scanner that optically reads a document to generate image data, and a FAX communication device that performs FAX communication. Further, the image processing engine 125 may include, for example, a finisher that sorts printed sheet materials, an ADF (automatic document feeder) that automatically feeds documents, and the like.

The connection I/F 126 is an interface for communicating with the operating device 11 via the communication path 13. For example, a USB standard interface is used for the connection I/F 126.

The communication I/F 127 is an interface for communicating with other devices. For example, a wireless LAN based on the Wi-Fi standard is used for the communication I/F 127.

The image forming apparatus 10 according to this embodiment has the hardware configuration shown in FIG. 2, so that it can implement various processes described below.

Although FIG. 2 shows an example of a configuration in which the image forming apparatus 10 includes the operating device 11, the configuration is not limited to this, and as described later, information processing of a tablet terminal, a smartphone, a mobile phone, a PDA, etc. The device 20 can function as an operating device for the image forming device 10. That is, these information processing devices 20 can control the image forming device 10 by communicating with the image forming device 10 via the communication I/F 117 of the operating device 11 or the communication I/F 127 of the main device 12. can.

<Hierarchical structure of software group of image forming apparatus 10>
FIG. 3 is a diagram showing an example of a hierarchical structure of software groups included in the operating device 11 and main device 12 of the image forming apparatus 10 according to the present embodiment.

FIG. 3 shows the hierarchical structure of the software group included in the operating device 11 and the hierarchical structure of the software group included in the main device 12.

As shown in FIG. 3, the main device 12 includes an application layer 101, a service layer 102, and an OS layer 103. The application layer 101, the service layer 102, and the OS layer 103 are actually various software stored in the ROM 122, HDD 124, or the like. Various functions are provided by the CPU 121 executing these software.

The software of the application layer 101 is application software (in the following description, it may be simply referred to as "application") for operating hardware resources to provide predetermined functions. Examples of applications include a copy application for providing a copy function, a scanner application for providing a scanner function, a FAX application for providing a facsimile function, a printer application for providing a print function, and the like.

The software of the service layer 102 is software that is interposed between the application layer 101 and the OS layer 103 and provides an interface for the application to use the hardware resources provided in the main device 12. Specifically, it is software for providing functions of accepting operation requests for hardware resources and arbitrating the operation requests. The operation request accepted by the service layer 102 is, for example, a request for reading with a scanner or printing with a plotter.

Note that the interface function by the service layer 102 is provided not only to the application layer 101 of the main device 12 but also to the application layer 201 of the operating device 11. That is, the application layer 201 (application) of the operating device 11 can also realize functions using the hardware resources (for example, the image processing engine 125) of the main device 12 via the interface function of the service layer 102.

The software of the OS layer 103 is basic software (operating system) for providing basic functions to control the hardware included in the main device 12. The software in the service layer 102 converts hardware resource usage requests from various applications into commands that can be interpreted by the OS layer 103 and passes them to the OS layer 103. Then, by executing the commands by the software of the OS layer 103, the hardware resources operate according to the requests of the application.

Similarly, the operating device 11 has an application layer 201 and an OS layer 203. The application layer 201 and OS layer 203 included in the operating device 11 also have the same hierarchical structure as the main device 12 side. However, the types of operation requests that can be accepted by the functions provided by the applications in the application layer 201 are different from those on the main device 12 side. The application of the application layer 201 is software for operating the hardware resources included in the operating device 11 to provide predetermined functions. For example, it is software for providing a UI (user interface) function for operating and displaying functions of the main device 12 (copy function, scanner function, facsimile function, printer function).

Further, in this embodiment, in order to maintain functional independence, the software of the OS layer 103 on the main device 12 side and the software of the OS layer 203 on the operating device 11 side are different from each other. As an example, Linux (registered trademark) is provided as the software for the OS layer 103 on the main device 12 side, and Android (registered trademark) is provided as the software for the OS layer 203 on the operating device 11 side. As a result, the main body device 12 and the operating device 11 operate independently of each other using different operating systems.

By operating the main device 12 and the operating device 11 on separate operating systems, communication between the main device 12 and the operating device 11 is performed not as communication between processes within a common device, but as communication between different devices. It will be done. This includes an operation (command communication) in which input received by the operating device 11 (instruction content from the user) is transmitted to the main device 12, an operation in which the main device 12 notifies the operating device 11 of an event, and the like. Here, the functions of the main device 12 can be used by the operating device 11 communicating commands to the main device 12. Furthermore, the events notified from the main device 12 to the operating device 11 include the execution status of operations in the main device 12, contents set on the main device 12 side, and the like.

<Software provided in the image forming apparatus 10>
FIG. 4 shows an example of software installed in the image forming apparatus 10 according to this embodiment. As described above, the main device 12 is divided into an application layer 101, a service layer 102, and an OS layer 103. Among these, the application layer 101 stores an application that controls the image processing engine 125 shown in FIG. 2 to perform document reading control, printing control, etc. Specifically, the application layer 101 stores a copy application 141, a scanner application 142, a printer application 143, and a FAX application 144. The copy application 141 to the FAX application 144 are standard job execution function applications.

Further, the service layer 102 stores various programs corresponding to processing commonly performed by each application, such as an energy saving management program (energy saving management program) 151, a memory management program 152, and an engine control program 153. The service layer 102 performs processing common to each application, such as energy saving management and memory management.

In contrast, the operating device 11 is divided into an application layer 201 and an OS layer 203. The difference between the main device application and the operating device application is that the main device application controls the functions of the image forming apparatus 10 such as reading and printing by controlling the image processing engine, etc., whereas the operating device application controls the functions of the image forming apparatus 10 such as reading and printing. Performs UI control. That is, a user's operation is received by displaying a screen on the operating device application, and the main device application controls the image processing engine based on the user's operation.

There may be multiple operating device applications that implement the same function. This is a case where the UI design (appearance) or the installed functions are different even though the functions are the same. In the example of FIG. 4, as an example, the operating device 11 includes a first copy reception application 131 and a second copy reception application 132. The second copy reception application 132 has fewer functions than the first copy reception application 131, and has a simpler UI appearance.

Similar to the relationship between the first copy reception application 131 and the second copy reception application 132, there is a vendor application 137 developed by a developer vendor for, for example, a scanner application. Further, in order to simplify the development of the vendor application 137, a function providing application 136 is provided that provides the vendor and the like with the same functions as the first copy reception application 131 to FAX reception application 135 of the operating device 11.

That is, the application layer 201 of the operating device 11 stores an application that accepts user operations via a user interface. Specifically, the application layer 201 includes a home application 130, a first copy reception application 131, a second copy reception application 132, a scanner reception application 133, a printer reception application 134, a FAX reception application 135, and a function provision application 136. and vendor application 137 are stored. The function providing application 136 is an example of an image processing program. Furthermore, the function providing application 136 is stored in a storage unit such as the ROM 112, RAM 113, or flash memory 114 of the operating device 11, as an example.

The home application 130 displays a main screen (initial screen) on which icons and the like for specifying desired operations are arranged. Then, the application specified by the user through the icon operation is activated. The first copy acceptance application 131 is an application that accepts a user's copy operation via an operation button and a setting button. The second copy reception application 132 mainly displays frequently used operation buttons and setting buttons, thereby reducing the number of displayed operation buttons and setting buttons compared to the first copy reception application 131. This is an application designed to improve functionality and operability. The scanner reception application 133 is an application that accepts a user's scanner operation via an operation button, a setting button, or the like. The printer reception application 134 is an application that accepts a user's scanner operation via an operation button, a setting button, or the like. The FAX reception application 135 is an application that accepts facsimile transmission/reception operations from the user via operation buttons, setting buttons, and the like.

The function providing application 136 provides the vendor and the like with the same functions as the first copy reception application 131 to FAX reception application 135 of the operating device 11 in order to facilitate the development of the vendor application 137 as described above.

That is, when the function providing application 136 is an application corresponding to the scanner application 142, for example, it provides the vendor with a function of displaying a user interface such as a normal operation menu and a setting menu. Further, if the function providing application 136 is an application corresponding to the printer application 143, for example, it provides the vendor with a function of displaying a user interface such as a normal operation menu and a setting menu.

As described above, the operating device 11 of the image forming apparatus 10 is provided with a function providing application 136 for providing the same functions as the first copy receiving application 131 to FAX receiving application 135 to vendors and the like. An API (Application Programming Interface) that realizes the functions of the function providing application 136 is made available to the developer of the vendor application 137.

<Example of hardware configuration of information processing device 20>
FIG. 5 is a diagram showing an example of the hardware configuration of the information processing device 20 according to the present embodiment.

As shown in FIG. 5, the information processing device 20 includes an input device 31, a display device 32, an external I/F 33, a RAM 34, a ROM 35, a CPU 36, a communication I/F 37, and an auxiliary storage device 38. have Each of these pieces of hardware is communicably connected via a bus 39.

The input device 31 is, for example, a keyboard, a mouse, a touch panel, etc., and is used by the user to input various operations. The display device 32 is, for example, a display, and displays the processing results of the information processing device 20.

External I/F 33 is an interface with an external device. The external device includes a recording medium 33a and the like. The information processing device 20 can read from and write to the recording medium 33a and the like via the external I/F 33.

Examples of the recording medium 33a include a flexible disk, a CD (Compact Disc), a DVD (Digital Versatile Disk), an SD memory card (Secure Digital memory card), and a USB (Universal Serial Bus) memory card.

The RAM 34 is a volatile semiconductor memory that temporarily holds programs and data. The ROM 35 is a nonvolatile semiconductor memory that can retain programs and data even when the power is turned off. The ROM 35 stores, for example, OS settings, network settings, and the like.

The CPU 36 is an arithmetic device that reads programs and data from the ROM 35, the auxiliary storage device 38, etc. onto the RAM 34, and executes processing.

The communication I/F 37 is an interface for connecting the information processing device 20 to the network 30. The auxiliary storage device 38 is, for example, an HDD or an SSD, and is a nonvolatile storage device that stores programs and data. The programs and data stored in the auxiliary storage device 38 include, for example, an OS and application programs that implement various functions on the OS.

<Software provided in the information processing device 20 and the image forming device 10>
FIG. 6 is a diagram showing an example of software provided in the information processing device 20 and the image forming device 10 according to the present embodiment. In this embodiment, the information processing device 20 such as a tablet terminal, smartphone, mobile phone, PDA, etc. can function as an operating device for the image forming device 10. That is, these information processing devices 20 can control the image forming device 10 by communicating with the image forming device 10 via the communication I/F 117 of the operating device 11 or the communication I/F 127 of the main device 12. can.

As described above, the operating device 11 of the image forming apparatus 10 stores the vendor application 137 and the function providing application 136.

On the other hand, the information processing device 20 stores a vendor application 137 that is the same as the vendor application of the image forming device 10 . In this manner, in this embodiment, the image forming apparatus 10 can be operated by the common vendor application 137 between the operating device 11 and the information processing apparatus 20.

Further, the information processing device 20 stores a function providing application 171 for facilitating the development of the vendor application 137. An API (Application Programming Interface) that realizes the functions of the function providing application 171 is made available to the developer of the vendor application 137. The function providing applications 171 and 136 have a UI (user interface) layer, a logic layer for constructing logic such as job execution, and an API (application programming interface) layer. (In other words, the information processing apparatuses 20 and image forming apparatuses 10 with multiple OSs) are the same, and the logic layer and API layer are the same between multiple types of devices (that is, the information processing apparatuses 20 and image forming apparatuses 10 with multiple OSs). ) is different. In other words, while the UI layer provides a similar UI screen between multiple types of devices, the logic layer and API layer allow each device to internally execute different processes and issue image processing instructions. , it is possible to provide a common sense of operation for users. Specifically, when each image processing instruction is sent from the information processing device 20 of a different OS to the image forming device 10, and when the image processing instruction is sent from the operation device 11 of the image forming device 10 to the main device 12, It is possible to standardize the user's operational feeling.

Additionally, basic software (operating system) 172 is stored in the information processing device 20 .

The function providing application 171 of the information processing device 20 may be an application for each OS 172 (for example, Android, iOS, etc.) of the information processing device 20, or may be multi-platform compatible (compatible with multiple types of OS 172). It's okay.

<Function of function providing application 171>
FIG. 7 is a diagram showing an example of functional blocks of the function providing application 171 according to the present embodiment. The CPU 36 of the information processing device 20 executes the function providing application 171 stored in a storage unit such as the ROM 35, the RAM 34, or the auxiliary storage device 38, thereby controlling the reception unit 161, storage control unit 162, and switching shown in FIG. section 163, transmission section 164, setting processing section 165, and display control section 166.

The receiving unit 161 receives a command corresponding to an input operation performed by the user via the input device of the information processing device 20, and also receives an execution result obtained by requesting the main device 12 to execute the command. .

The storage control unit 162 reads or stores information corresponding to an application that has requested a screen display from a storage unit such as the ROM 35, RAM 34, or auxiliary storage device 38, for example.

The switching unit 163 switches the screen displayed on the display device of the information processing device 20 in response to the user's operation of the input device of the information processing device 20.

The transmitter 164 transmits a request for executing a desired operation to the main device 12 .

The setting processing unit 165 performs setting processing such as notifying the vendor application 137 of setting contents set by the user via the setting screen.

The display control unit 166 controls the display of the main screen, setting screen, etc. on the display device of the information processing device 20.

In this example, the receiving section 161 to the display control section 166 are realized by software, but some or all of the receiving section 161 to the display control section 166 may be realized by hardware such as an IC (Integrated Circuit). It may be realized by

Further, the function providing application 171 may be provided as an installable or executable file recorded on a computer readable recording medium such as a CD-ROM or a flexible disk (FD). Further, it may be provided by being recorded on a computer readable recording medium such as a CD-R, a DVD (Digital Versatile Disk), a Blu-ray Disc (registered trademark), or a semiconductor memory. Further, the function providing application 171 may be provided by being installed via a network such as the Internet. Furthermore, the function providing application 171 may be provided by being pre-installed in a ROM or the like within the device.

<Processing details>
Next, the operation of the function providing application 171 will be explained.

<First processing example>
FIG. 8 is a sequence diagram showing an example of image processing (for example, printing) according to this embodiment. FIG. 8 is a sequence diagram showing the flow of operations of the function providing application 171 of the information processing device 20 when printing is executed by the vendor application 137.

In step S1, vendor application 137 is activated. The vendor application 137 is an application for receiving image processing instructions for the image forming apparatus 10. The user operates an icon displayed on the display device of the information processing device 20 to instruct startup of the vendor application 137. An instruction signal instructing to start vendor application 137 is transmitted to vendor application 137. Thereby, the vendor application 137 displays the main screen on the display device of the information processing device 20.

When making print settings, the user operates a print setting button displayed on the main screen. As a result, a signal indicating that the print setting button has been operated is supplied to the vendor application 137.

In step S2, when the vendor application 137 receives a signal indicating that the print settings button has been operated, it calls the print settings API for the function providing application 171.

In step S3, the setting processing unit 165 of the function providing application 171 generates a setting screen for making print settings. The display control unit 166 of the function providing application 171 displays the generated setting screen on the display device of the information processing device 20. FIG. 9 is a diagram illustrating an example of a setting screen for making print settings. As illustrated in FIG. 9, the setting processing unit 165 generates a setting screen including icons corresponding to various setting items related to printing and a setting completion button to be operated when setting is completed.

In step S4, when the user operates an icon corresponding to a desired setting item among the icons corresponding to various setting items displayed on the setting screen, a signal indicating the setting item operated by the user is generated. is supplied to the function providing application 171. The function providing application 171 receives, from the receiving unit 161, a signal indicating the setting item operated by the user.

In step S5, the function providing application 171 uses the switching unit 163 to switch the screen to the setting screen of the setting item operated by the user. Then, the function providing application 171 causes the display control unit 166 to display the switched setting screen on the display device of the information processing device 20. In this manner, in this embodiment, the print settings top screen and the detailed settings screens transitioned from the print settings top screen are all realized by the function providing application 171. Note that part of the print settings top screen and detailed settings screens that transition from the print settings top screen may be implemented by the vendor application 137.

In step S6, the receiving unit 161 of the function providing application 171 receives a signal indicating that the setting completion button has been operated, as well as setting content information indicating the setting content set by the user.

In step S7, the transmitter 164 of the function providing application 171 transmits the received setting content information to the vendor application 137. The vendor application 137 updates the setting content information stored in a storage unit such as the ROM 35, RAM 34, or auxiliary storage device 38 with the received setting content information.

In step S8, after storing the setting information, the vendor application 137 displays the main screen on the display device of the information processing device 20.

In step S9, when printing is to be executed, the user operates the print execution button displayed on the main screen. As a result, a signal indicating that the print execution button has been operated is supplied to the vendor application 137.

In step S10, when the vendor application 137 receives a signal indicating that the print execution button has been operated, it calls the print execution API for the function providing application 171. Further, the vendor application 137 reads the above-mentioned setting content information from the storage section and sends it to the function providing application 171.

In step S11, the transmitter 164 of the function providing application 171 starts the print framework 173 of the information processing device 20. The printing framework 173 is a program, such as Google Cloud Print, Air Print, Mopria, etc., that instructs the information processing device 20 to execute printing.

The printing framework 173 may be provided using a plug-in module program that is plugged into the OS 172 or the like of the information processing device 20. Plug-in modules are provided to the information processing device 20 for each standard of the printing framework 173. Each application included in the information processing device 20, for example, a file viewing application, a file editing application, a browser application, an email application, an SNS application, etc., directly connects to the standard-compliant image forming device 10 via a plug-in module. It is possible to issue instructions for image processing (scanning, copying, printing, etc.) via communication or the Internet. The information processing apparatus 20 may have a plurality of plug-in modules of the printing framework 173 for different standards. The plug-in module is provided to the information processing device 20 by obtaining it from the website of each standard as an individual application, or by being included as an OS module when updating the OS 172 of the information processing device 20, and is provided to the information processing device 20. It becomes usable from 20 applications. Note that if one or more printing frameworks 173 are plugged in or registered in the OS 172 of the information processing device 20, the OS 172 stores and manages the names and identification information of the printing frameworks 173, so the printing frameworks 173 can be accessed from applications, etc. When the work 173 is called, the OS 172 can display a list of the names and the like of the print framework 173. Note that it can also be said that the OS 172 has one printing framework, and that the printing framework has plug-in modules for each of a plurality of standards.

Furthermore, multiple printing frameworks 173 may be provided for each standard as web applications on the Internet without being added to the information processing apparatus 20. In this case, the information processing apparatus 20 uses a web browser or a web collaboration application included in the information processing apparatus 20 to access the image forming apparatus 10 that has been pre-registered in a web application or the like via a web application (printing framework) via the Internet. It is possible to issue an image processing instruction to at least one of the image forming apparatus 10 compliant with the standard and the image forming apparatus 10 compliant with the standard.

In step S12, the printing framework 173 or the OS 172 of the information processing apparatus 20 having a plug-in of the printing framework 173 generates a screen for selecting an image forming apparatus 10 such as a multifunction peripheral. The print framework 173 displays the generated screen on the display device of the information processing device 20. FIG. 10 is a diagram showing an example of a screen for selecting the image forming apparatus 10. When the user selects a multifunction device to actually print on such a screen and presses a selection button, a print request is issued to the selected multifunction device. When the user registers a multifunction device in the initial settings of the print framework 173, a list of registered multifunction devices is displayed on the screen shown in FIG. Alternatively, in S11, the printing framework 173 is activated, and the information processing apparatus 20 searches for an image forming apparatus 10 connected to a network such as WiFi via wireless communication, and the image forming apparatus 10 (multifunction device) detected as a result of the search is machines) may be displayed in a list as shown in FIG.

Note that the function providing application 171 may display a screen as shown in FIG. 11 before the print framework 173 screen as shown in FIG. 10 is displayed. In FIG. 11, a print setting screen is displayed, and the user can freely change the settings. After changing the settings, by pressing the start button, the multifunction peripheral selection screen shown in FIG. 10 is displayed. Whether or not to display a screen such as that shown in FIG. 11 can be specified by a parameter when the vendor application 137 calls the function providing application 171.

In step S13, the printing framework 173 transmits the setting information and the print execution request to the main unit 12 of the image forming apparatus 10.

In step S14, the main device 12 controls the print function of the image processing engine 125 based on the setting information. As a result, the actual printing operation is executed.

Note that the storage control unit 162 of the function providing application 171 stores the setting content information input by the user via the input device of the information processing device 20 in the storage unit described above, and calls the print execution API from the vendor application 137. When this is performed, the storage control unit 162 of the function providing application 171 may read the setting content information from the storage unit and transmit it to the main device 12.

In this manner, the function providing application 171 receives a user's instruction via the vendor application 137 on the information processing device 20, and passes the instruction to the printing framework 173, thereby transmitting an instruction to perform image processing to the image forming device 10. can be sent to.

<Second processing example>
FIG. 12 is a sequence diagram showing an example of image processing according to this embodiment. FIG. 12 shows a case where there are multiple printing frameworks in the <first processing example>. Hereinafter, points different from the <first processing example> will be explained.

Steps S1 to S10 are the same as in the <first processing example>.

In step S11, the transmitter 164 of the function providing application 171 instructs the OS 172 of the information processing device 20 to start the print framework 173. As described above, the printing framework 173 is a program, such as Google Cloud Print, Air Print, Mopria, etc., that instructs the information processing device 20 to execute printing.

In step S12, the OS 172 generates a screen for selecting a printing framework. The OS 172 displays the generated screen on the display device of the information processing device 20. FIG. 13 is a diagram illustrating an example of a screen for selecting a print framework. When the user selects a printing framework to actually use on such a screen and presses a selection button, the selected printing framework is activated.

In other words, when the information processing device 20 has one or more printing frameworks 173 and the application 137 of the information processing device 20 issues an instruction to execute image processing via the function providing application 171, the information processing device 20 , a selection screen as shown in FIG. 13 for accepting the selection of the printing framework 173 can be displayed.

Note that the function providing application 171 may start one print framework specified in advance among a plurality of print frameworks.

In step S13, the OS 172 activates the selected printing framework.

In step S14, the selected printing framework 173 generates a screen for selecting an image forming apparatus 10 such as a multifunction peripheral. The selected printing framework 173 displays the generated screen on the display device of the information processing device 20.

In other words, when one printing framework is selected on the selection screen for accepting the selection of the printing framework 173 as shown in FIG. A selection screen for accepting the selection of the image forming apparatus 10 can be displayed.

In step S15, the selected print framework 173 transmits the setting information and a print execution request to the main unit 12 of the image forming apparatus 10.

In step S16, the main device 12 controls the print function of the image processing engine 125 based on the setting information. As a result, the actual printing operation is executed.

<Third processing example>
FIG. 14 is a sequence diagram showing an example of image processing according to this embodiment. FIG. 14 shows a case where job information is acquired in the <first processing example>. Hereinafter, points different from the <first processing example> will be explained. Note that job information may also be acquired in the <second processing example>.

Steps S1 to S14 are the same as in the <first processing example>.

In step S15, the function providing application 171 acquires information indicating the status of the image processing (for example, printing) job from the main device 12. For example, information indicating the status of a job is obtained from an MIB (Management Information Base) or the like.

In step S16, if an error is obtained as information indicating the job status, the function providing application 171 notifies the vendor application 137 of the error.

In step S17, the vendor application 137 displays an error screen as shown in FIG. 15 on the display device of the information processing device 20.

Each function of the embodiments described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Single Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules.

The present invention is not limited to the above-described specifically disclosed embodiments, and various modifications and changes can be made without departing from the scope of the claims.

1 Image forming system 10 Image forming device 20 Information processing device 30 Network 11 Operating device 12 Main device 101 Application layer 102 Service layer 103 OS layer 201 Application layer 203 OS layer 130 Home application 131 First copy reception application 132 Second copy Reception application 133 Scanner reception application 134 Printer reception application 135 FAX reception application 136 Function providing application 137 Vendor application 141 Copy application 142 Scanner application 143 Printer application 144 FAX application 151 Energy saving management 152 Memory management 153 Engine control 161 Receiving section 162 Storage control section 163 Switching unit 164 Transmitting unit 165 Setting processing unit 166 Display control unit 171 Function providing application 172 OS
173 Printing Framework

Japanese Patent Application Publication No. 2014-150320

Claims (9)

an application that receives image processing instructions for the main unit of the image forming apparatus;
a printing framework that instructs a main unit of the image forming apparatus to execute the image processing;
a function providing application that, when called from the application, causes the printing framework to instruct the main unit of the image forming apparatus to execute the image processing ;
The operating device of the image forming apparatus has a function providing application that instructs the main unit of the image forming apparatus to execute image processing when called from the application included in the operating device of the image forming apparatus, and the operating device of the information processing apparatus An information processing apparatus , wherein a UI layer of a function providing application and a UI layer of a function providing application of an operating device of the image forming apparatus are the same. According to claim 1, the function providing application causes one printing framework selected from a plurality of printing frameworks to instruct a main unit of the image forming apparatus to execute the image processing. The information processing device described. The function providing application acquires information indicating the status of the image processing job from the main unit of the image forming apparatus, and notifies the application of the acquired information indicating the status of the image processing job. The information processing device according to item 1 or 2. The information processing device is a mobile terminal owned by a user of the image forming device,
The function providing application is
receiving instructions from a user via the application on the mobile terminal;
The information processing apparatus according to any one of claims 1 to 3 , wherein the instruction to execute the image processing is transmitted to a main unit of the image forming apparatus by passing the instruction to the printing framework. The information processing device has one or more printing frameworks,
2. The method according to claim 1, wherein when the application of the information processing device instructs execution of the image processing via the function providing application, the information processing device displays a selection screen that accepts selection of the printing framework. 4. The information processing device according to any one of 4 . If one printing framework is selected on the selection screen for accepting the selection of the printing framework, the selected printing framework accepts the selection of the image forming apparatus to which execution of the image processing is requested. The information processing device according to claim 5 , which displays a selection screen. an application of the information processing device receiving an image processing instruction for a main unit of the image forming device;
When the function providing application of the information processing apparatus is called from the application, causing a printing framework to instruct a main body of the image forming apparatus to execute the image processing;
The printing framework includes a step of instructing a main unit of the image forming apparatus to execute the image processing ,
The operating device of the image forming apparatus has a function providing application that instructs the main unit of the image forming apparatus to execute image processing when called from the application included in the operating device of the image forming apparatus, and the information processing apparatus A UI layer of a function providing application and a UI layer of a function providing application of an operating device of the image forming apparatus are the same. In the information processing device,
When called from an application that accepts an image processing instruction to the main unit of an image forming apparatus, a print framework that instructs the main unit of the image forming apparatus to execute the image processing is sent to the main unit of the image forming apparatus . A function providing application that instructs execution of the image processing,
providing a user interface displayed by the application;
The operating device of the image forming apparatus has a function providing application that instructs the main unit of the image forming apparatus to perform image processing when called from the application included in the operating device of the image forming apparatus, and the information processing apparatus A UI layer of the function providing application and a UI layer of the function providing application of the operating device of the image forming apparatus are the same . An image forming system including an image forming device and an information processing device,
The information processing device includes:
an application that receives image processing instructions for the main unit of the image forming apparatus;
a printing framework that instructs the main unit of the image forming apparatus to execute the image processing; when called from the application, the print framework instructs the main unit of the image forming apparatus to execute the image processing; It has a function providing application that gives instructions,
The operating device of the image forming apparatus has a function providing application that instructs the main unit of the image forming apparatus to execute image processing when called from the application included in the operating device of the image forming apparatus, and the information processing apparatus An image forming system , wherein a UI layer of a function providing application and a UI layer of a function providing application of an operating device of the image forming apparatus are the same .

Images