JP2016067057A - Information processing system, screen display method, and image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system or the like, configured to display an operation screen suitable for the characteristics of a display device.SOLUTION: An information processing system 10 includes an image processing apparatus 20, and an information terminal device 50. The image processing apparatus 20 includes: holding means 126 for holding screen definition information for displaying an operation screen relating to a distribution flow, for each of one or more distribution flows defined in advance; screen definition information transmission means 142 which transmits the screen definition information to the information terminal device 50; operation information receiving means 140 which receives a request to execute the distribution flow made on the information terminal device 50 via the operation screen; and execution control means 134 which controls execution of the distribution flow, based on setting information set on a second device, with respect to input data input to a first device. The information terminal device 50 includes display means 152 and operation information transmission means 172.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a user interface of an image processing apparatus, and more particularly, to an information processing system, a screen display method, and an image processing apparatus for displaying an operation screen adapted to the characteristics of a display device.

  In recent years, image processing apparatuses with various specifications have been provided, from those equipped with small display devices such as a four-row liquid crystal display (LCD) to those equipped with large color display devices such as WVGA (Wide Video Graphics Array). Yes. In the background as described above, a unified user interface (hereinafter referred to as UI) definition file is created in order to cope with various specifications and future function expansion, and this is performed on the image processing apparatus side. A technique for constructing and displaying an operation screen reflecting display characteristics and functional characteristics of a display device included in the display device according to a UI definition file is known.

  For example, Japanese Patent No. 4539293 (Patent Document 1) obtains characteristic information of an operation panel of a multifunction peripheral in a program operating on the multifunction peripheral in each multifunction peripheral of the document distribution system, and matches the characteristic information of the panel. A technique for performing UI display is disclosed. Japanese Patent Application Laid-Open No. 2011-186789 (Patent Document 2) discloses a technique for correcting and using original screen definition data for defining an operation screen for using a distribution flow including one or more processes for an electronic document in a document distribution system. Is disclosed. In the prior art of Patent Document 2, the part that defines the display content that changes depending on the performance in the received original screen definition data is corrected according to the capability information that describes the performance provided by itself, and the distribution flow An operation screen corresponding to the screen definition data after correction is displayed on the operation panel when using.

  With the above-described function of performing UI construction on the image processing apparatus side, a UI suitable for each operation panel can be provided using a unified UI definition file. For example, on an operation panel with a high resolution, a GUI (graphical user interface) that allows the user to intuitively understand the operation method can be realized using an image or a chart as shown in FIG. . On the other hand, a CUI (character user interface) capable of a minimum operation as shown in FIG. 16B can be realized even on an operation panel having a low resolution.

  Japanese Patent Laid-Open No. 2009-188582 (Patent Document 3) is known as another technique for unifying UI screens of a plurality of image forming apparatuses. In Patent Document 3, an extended UI device having a touch panel type liquid crystal display device is externally attached to each image forming apparatus, and a LAN is configured by combining these with a server via a communication medium. Refers to a technique for acquiring an HTML file and displaying a UI screen on a touch panel.

  However, the above-described conventional technology is not sufficient in the following points. The conventional techniques of Patent Document 1 and Patent Document 2 described above cannot provide a sufficient UI in an image processing apparatus that includes only an operation panel with extremely inferior drawing performance, thus reducing user convenience. In addition, in an image processing procedure that does not include the display device itself, it is not possible to configure a part of the functions of the document distribution system so that user convenience is reduced. That is, since the prior arts in Patent Document 1 and Patent Document 2 are related to UI operations on the operation panel provided in the multifunction peripheral, only the above-described operation panel having extremely inferior drawing ability is provided. It could not cope with the case where the device itself was not provided.

  Further, in the prior art referred to in Patent Document 3, the extended UI device displays an average UI screen of a plurality of image forming apparatuses, is not scalable, and has a large number of workflows and operation screens. It could not be applied to a user-defined document distribution system.

  The present invention has been made in view of the above-described problems in the prior art, and the present invention displays the operation screen of the first device on the second device connected via the network. It is an object of the present invention to provide an information processing system, a screen display method, and an image processing apparatus that enable an input operation from the first apparatus to the first apparatus.

  In order to solve the above problems, the present invention provides an information processing system having the following features. The information processing system includes a first device that controls execution of a distribution flow that distributes input data, and a second device that is connected to the first device via a network. The first device includes, for each of the one or more predefined delivery flows, a holding unit that holds screen definition information for displaying an operation screen related to the delivery flow, and a screen for the second device. A screen definition information transmitting means for transmitting definition information; an operation information receiving means for receiving an execution request for the distribution flow made via the operation screen on the second device; and the first information in response to the execution request. An execution control means for controlling the execution of the distribution flow based on the setting information set on the second apparatus, which is a distribution flow for the input data input to the apparatus. The second device includes a display unit that displays an operation screen based on the received screen definition information, an operation reception unit that receives an operation performed via the operation screen, and an operation received by the operation reception unit. Operation information transmitting means for transmitting an execution request to the first device in response to an execution instruction operation requesting the execution.

  According to the above configuration, in the information processing system, an operation screen for operating the first device is displayed on the second device side connected to the first device via the network, and the second device Thus, it is possible to perform an input operation on the first device. Therefore, regardless of the drawing performance of the first device, the function provided by the first device can be called from the second device using the operation screen.

1 is a diagram illustrating a network environment of a document distribution system according to a first embodiment. FIG. FIG. 2 is a hardware configuration diagram of (A) a multifunction machine and (B) an information terminal device according to the first embodiment. FIG. 3 is a functional block diagram realized in the document distribution system according to the first embodiment. The flowchart which shows the screen display operation process which the information terminal device by 1st Embodiment performs. FIG. 3 is a sequence diagram showing a screen display operation process executed between the multifunction machine and the information terminal device according to the first embodiment. The sequence diagram which shows the screen display operation process performed between the multifunctional machine and information terminal device by other embodiment. The figure which illustrates the (A) initial screen and (B) remote operation panel screen of a remote operation panel displayed on the display part of an information terminal device. The figure which illustrates the data structure of screen definition information by a 1st embodiment. The functional block diagram implement | achieved in the document delivery system of 2nd Embodiment. FIG. 10 is a sequence diagram illustrating a screen display operation process executed between the multifunction machine and the information terminal device according to the second embodiment. The figure which illustrates the data structure of the capability information by 2nd Embodiment. The figure which illustrates the remote operation panel screen displayed on the display part of an information terminal device. The sequence diagram (1/2) which shows the screen display operation process performed between a multifunction machine and an information terminal device in 3rd Embodiment. The sequence diagram (2/2) which shows the screen display operation process performed between a multifunction machine and an information terminal device in 3rd Embodiment. The figure explaining the network environment of the document delivery system by other embodiment. 4A and 4B are diagrams illustrating a (A) GUI screen and a (B) CUI screen displayed on an operation panel of the multifunction machine.

  Hereinafter, although embodiment of this invention is described, embodiment of this invention is not limited to embodiment described below. In the embodiment described below, as an example of an image processing system including an image processing device (first device) and a program installed in an information terminal device (second device), a multifunction machine and an information terminal A description will be given using a document distribution system including a program for realizing the apparatus.

  FIG. 1 is a diagram for explaining a network environment of a document distribution system according to the first embodiment. A document distribution system 10 shown in FIG. 1 includes multifunction peripherals 20, 40, an information terminal device 50, and a management terminal device 80 that are connected to each other via a network 12. The network 12 is not particularly limited, but is wired or wireless by a LAN (Local Area Network) such as TCP / IP (Transmission Control Protocol / Internet Protocol) or Ethernet (registered trademark), or a WAN (Wide Area Network). Or a mixed network of these.

  The multifunction machines 20 and 40 are image processing apparatuses that provide various image processing services such as copying, scanning, printing, and facsimile. The multifunction device 20 exemplifies a multifunction device equipped with an operation panel including a display device such as a four-row liquid crystal LCD or WVGA. On the other hand, the multifunction device 40 exemplifies a multifunction device equipped with an operation panel that does not include a display device or has only limited drawing performance. Note that the image processing apparatus is not limited to the exemplified multifunction machine, and other various apparatuses that handle images, such as a copying machine, a printing machine, a scanner apparatus, a facsimile apparatus, and a printer apparatus.

  In the present embodiment, the multifunction machines 20 and 40 operate as image input devices in the document distribution system 10. That is, in response to an operation by the operator, the multi-function devices 20 and 40 put an input image such as a scanned image, an image received by printing, an image received by facsimile on a predetermined distribution flow, perform predetermined processing, and perform predetermined processing. Deliver to the destination.

  The management terminal device 80 is a terminal operated by a system administrator, and provides various management tools for managing the document distribution system 10. Examples of the various management tools include a document distribution flow design tool that defines a document distribution flow and defines each operation screen for using the document distribution flow. The document distribution flow is defined as a series of processing flows including input, intermediate processing (as appropriate), and output, and various operation screens for using the document distribution flow in accordance with the definition of the document distribution flow. Is defined.

  As input in the document distribution flow, scan input, facsimile reception and input of a stored image file of the multifunction device 20 (a scanned image read in advance, a print image received in advance, a facsimile received image received in advance, etc.) Etc.). Examples of the output include e-mail transmission, network shared folder storage, registration in a document management system, and the like. Examples of the intermediate processing include various image processing such as OCR (Optical Character Recognition) processing and frame removal processing. For example, in the case of a flow in which a scanned input document is distributed by e-mail, the operation screen is a screen for selecting scanning conditions such as screen resolution and color mode, and a distribution destination address.

  In the document distribution system 10 according to the present embodiment, the document distribution flow is described in the flow definition information, and the operation screen is described in the screen definition information. The flow definition information and the screen definition information are distributed from the management terminal device 80 to the multifunction devices 20 and 40 via the network 12. The MFPs 20 and 40 that have received the flow definition information and the screen definition information store the flow definition information and the screen definition information, respectively, so that the document distribution flow can be used. Note that the screen definition information may be configured as a single file describing a plurality of operation screens transitioning to each other, or may be configured as a file for each operation screen. Similarly, the flow definition information may be configured as a single file describing a plurality of distribution flows, or may be configured as a file for each distribution flow.

  In the present embodiment, the drawing performance of each multifunction device may be different. However, preparing screen definition information for all types of multifunction peripherals is not appropriate from the viewpoint of the workload of the system administrator and from the viewpoint of future expandability. Therefore, the management tool according to the present embodiment configures screen definition information to be distributed as the same file. Then, in each of the multifunction devices 20 and 40, an operation screen that conforms to the drawing performance of the operation panel included in each multifunction device is constructed according to the screen definition information. As a result, even if the same file is used, a GUI capable of intuitive operation is displayed on the operation panel of the multifunction device having sufficient drawing performance, while the operation panel of the multifunction device not having sufficient drawing performance. A simple CUI can be displayed on the top.

  The multifunction machines 20 and 40 according to the present embodiment each provide a remote operation function for remotely operating the multifunction machine from an external information terminal device via the network 12. The information terminal device 50 is executing the program of the present embodiment, is connected to a remote operation function of a multifunction peripheral (for example, 20), and displays a remote operation panel on the display device of the information terminal device 50. The information terminal device 50 also accepts an input operation to the remote operation panel via the input device of the information terminal device 50, thereby enabling remote operation of the multifunction device 20.

  Hereinafter, the hardware configuration of the multifunction peripheral and the information terminal device according to the first embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating a hardware configuration of (A) the multifunction machine and (B) the information terminal device according to the first embodiment. 2A (which will be described below with reference to the multifunction device 20 as a representative) includes a control unit 22 including a CPU (Central Processing Unit), a RAM (Random Access Memory), and the like. Main memory 24. The multi-function device 20 further includes an auxiliary storage unit 26 such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), an external storage device I / F unit 28, and a network I / F such as a NIC (Network Interface Card). Part 30, engine part 32, and operation panel part 34.

  The auxiliary storage unit 26 stores image data, document data, programs, font data, form data, and the like, and stores control programs such as an OS and software for controlling the multifunction device 20, various system information, and various setting information. Store. The external storage device I / F unit 28 is an interface device for connecting to an external storage medium such as a USB flash memory, SmartMedia (registered trademark), SD memory card (registered trademark), or the like. The network I / F unit 30 is an interface device that connects the multifunction machine 20 to the network 12.

  The engine unit 32 includes a plotter engine such as an electrophotographic system and a scanner engine such as a CCD (Charge Coupled Device) system or a CIS (Contact Image Sensor) system, and inputs and prints images in a required document distribution flow. Run the output. The operation panel unit 34 appropriately includes a display device such as a liquid crystal display and an input device such as a hard key or a touch panel. The operation panel unit 34 provides a user interface for receiving input of various instructions from the operator of the multifunction machine 20. The multifunction device 20 reads various programs from the auxiliary storage unit 26 and develops them in a work space provided by the main storage unit 24, thereby realizing each functional unit and each process described below under the control of the control unit 22.

  The information terminal device 50 is configured as a general-purpose computer device such as a desktop, laptop, or mobile personal computer, a smart phone, a tablet computer, or a portable information terminal such as a PDA (Personal Digital Assistance). An information terminal device 50 shown in FIG. 2B includes a control unit 52 including a single-core or multi-core CPU, a main storage unit 54 such as a RAM, an auxiliary storage unit 56 including an HDD and an SSD, and an external storage device I. / F unit 58 and network I / F unit 60 are included.

  The information terminal device 50 further includes an input unit 62 and a display unit 64, and provides a user interface for receiving input of various instructions from the operator of the information terminal device 50. The input unit 62 includes input devices such as a mouse, a keyboard, and a touch panel. The display unit 64 includes a display device such as an LCD display or an organic EL (Electro-Luminescence) display. The information terminal device 50 reads an OS or a program for realizing the information terminal device from the auxiliary storage unit 56 and develops the program in a work space provided by the main storage unit 54, thereby being described later under the control of the control unit 52. Each functional unit and each process to be realized are realized. The management terminal device 80 can also employ the same configuration as the information terminal device 50.

  The document distribution system 10 according to the first embodiment provides a remote operation function for using a document distribution flow by remotely connecting the information terminal device 50 to a multifunction peripheral (for example, 20). Hereinafter, the details of the remote operation function in the document distribution system 10 according to the first embodiment will be described with reference to FIGS. FIG. 3 is a diagram illustrating functional blocks implemented in the document distribution system according to the first embodiment. The functional blocks shown in FIG. 3 are realized on the information terminal device 50 by executing a function block 120 implemented on a multifunction peripheral (hereinafter, representatively described with reference to the multifunction peripheral 20). Function block 150.

  The functional block 120 of the multifunction machine 20 includes a remote communication unit 122, a remote operation panel providing unit 124, a screen definition information holding unit 126, and a flow execution control unit 134. The multifunction device 20 illustrated in FIG. 3 includes an operation panel that performs UI display. The functional block 120 further includes a UI construction unit 128, a UI display unit 130, and a UI operation reception unit 132.

  The remote communication unit 122 controls the network I / F unit 30 shown in FIG. 2A and manages communication with the external information terminal device 50. The remote operation panel providing unit 124 provides a remote operation function for remotely operating the multi-function device 20 from the external information terminal device 50. The screen definition information holding unit 126 is provided with a storage area of the storage device, and distributes screen definition information distributed from the management terminal device 80 to define an operation screen for using functions available from the multifunction machine 20. Hold. The flow execution control unit 134 calls a function (distribution flow) in response to the execution request, and each of the document distribution flows requested for execution according to the flow definition information distributed from the management terminal device 80 together with the screen definition information. Control execution of processing.

  The UI construction unit 128 reads the screen definition information held in the screen definition information holding unit 126, and in accordance with the description, the drawing performance of the display device of the MFP 20 (screen resolution, number of colors, usable GUI components, etc.) Build an operation screen that conforms to The UI display unit 130 displays the constructed operation screen on the display device of the operation panel unit 34. The UI operation receiving unit 132 receives an input operation performed on the operation screen via the operation panel unit 34 of the multifunction machine 20. The UI operation accepting unit 132 holds the setting information input via the operation screen, and further, in response to pressing of a hard key start key or the like, sends an execution request together with the setting information to the flow execution control unit 134. Issue. In the case of a multifunction peripheral that cannot display a UI, the UI construction unit 128, the UI display unit 130, and the UI operation reception unit 132 are not provided.

  The flow execution control unit 134 illustrated in FIG. 3 can accept an execution request from the operation panel unit 34 of the multifunction machine 20 and can also accept an execution request from an external remote operation panel. More specifically, the remote operation panel providing unit 124 includes an operation information receiving unit 140 and a screen definition information transmitting unit 142. The screen definition information transmission unit 142 transmits the screen definition information held in the screen definition information holding unit 126 to the information terminal device 50 connected to the remote operation function of the multifunction machine 20. The operation information receiving unit 140 receives setting information input via the remote operation panel from the information terminal device 50 connected to the remote operation function of the multifunction machine 20. The operation information receiving unit 140 further receives an execution request made using the remote operation panel, and issues an execution request to the flow execution control unit 134 together with the setting information.

  The functional block 150 of the information terminal device 50 includes a remote communication unit 152 that controls the network I / F unit 60 shown in FIG. 2B and manages communication with the external multifunction device 20, and a remote operation panel unit 154. Including. The remote operation panel unit 154 is an application for using a remote operation function provided by the external multifunction device 20, and the program is installed in the information terminal device 50 in advance. More specifically, the remote operation panel unit 154 includes a screen definition information receiving unit 160, a screen definition information holding unit 162, a UI construction unit 164, a UI display unit 166, a UI operation receiving unit 168, and setting information holding. Unit 170 and operation information transmission unit 172.

  The screen definition information receiving unit 160 receives the screen definition information from the screen definition information transmitting unit 142 of the multifunction machine 20, and the screen definition information holding unit 162 holds the received screen definition information. The UI construction unit 164 reads the screen definition information held in the screen definition information holding unit 162, and constructs an operation screen suitable for the drawing performance of the display unit 64 of the information terminal device 50 according to the description. The UI display unit 166 displays the constructed operation screen on the display unit 64. The UI operation reception unit 168 receives an input operation performed on the operation screen via the input unit 62. The UI operation accepting unit 168 holds the setting information input via the operation screen in the setting information holding unit 170. The UI operation reception unit 168 further calls the operation information transmission unit 172 in response to the start key operation on the remote operation panel. In response to the call, the operation information transmission unit 172 reads the setting information held in the setting information holding unit 170, and transmits an execution request to the connection destination multifunction device 20 together with the read setting information.

  Hereinafter, details of processing executed between the information terminal device 50 and the multifunction device 20 in the remote operation function according to the first embodiment will be described with reference to FIGS. FIG. 4 is a flowchart illustrating screen display operation processing executed by the information terminal device 50 according to the first embodiment. The process shown in FIG. 4 starts from step S100. In step S101, the information terminal device 50 receives an instruction to start an operation on the remote operation panel from the operator. The operation start instruction on the remote operation panel can be given from the screen illustrated in FIG. 7A provided by the remote operation panel unit 154.

  FIG. 7A illustrates an initial screen 200 of the remote operation panel displayed on the display unit 64 of the information terminal device 50. The initial screen 200 is a screen for selecting a connection destination multifunction peripheral to start operation of the remote operation panel, and includes a message display 202, a connection destination management button 204, and connection destination designation buttons 206a and 206b. . The connection destination management button 204 is a button for receiving an instruction to call a management screen for registering or deleting a connection destination candidate MFP. In the embodiment to be described, it is assumed that the multifunction peripheral as a connection destination candidate is pre-registered by designating an IP (Internet Protocol) address or the like. The connection destination designation button 206 is a button for selecting a connection destination from pre-registered candidates and receiving an operation start instruction.

  When an operation (such as clicking or tapping) is performed on the connection destination designation button 206 shown in FIG. 7A, the information terminal device 50 accepts an instruction to start an operation on the remote operation panel designating the corresponding multifunction peripheral. Referring to FIG. 4 again, in step S102, the information terminal device 50 transmits an operation start request to the multi-function device designated as the connection destination (hereinafter described as the multi-function device 20 designated). . In step S <b> 103, the information terminal device 50 receives the screen definition information returned from the multifunction device 20 in response to the operation start request by the screen definition information receiving unit 160 and stores it in the screen definition information holding unit 162. In step S104, the information terminal device 50 uses the UI construction unit 164 to construct an operation screen according to the description of the received screen definition information, and in step S105, the UI display unit 166 displays the constructed operation screen.

  FIG. 7B illustrates a remote operation panel screen 220 displayed on the display unit 64 of the information terminal device 50. The remote operation panel screen 220 shown in FIG. 7B includes a disconnect button 222, an operation screen display area 224, and a start button 226 that provides the function of the start key of the multifunction machine 20. The disconnect button 222 is a button for receiving an instruction to disconnect the remote operation. A screen 220 illustrated in FIG. 7B illustrates a flow selection screen for selecting a document distribution flow, and an operation screen (flow selection screen) constructed according to the screen definition information is displayed in the operation screen display area 224. Is displayed.

  The operation screen shown in FIG. 7B includes a title display 230, various buttons 232, 234, 236, and a tab 238. In the example shown in FIG. 7B, the “PDF” tab 238a is selected, and the distribution flow setting screen registered in association with the “PDF” tab 238a is displayed in the screen area corresponding to the selected tab. One or more buttons 240a to 240d for calling are arranged. In the screen area of the “PDF” tab 238a, scroll buttons 242 and 244 for switching the button group of the distribution flow to be displayed are arranged. In the example of FIG. 7B, the first page is displayed and the scroll button 242 is deactivated.

  FIG. 8 is a diagram illustrating a data structure of screen definition information according to the first embodiment. FIG. 8 shows part of the screen definition information corresponding to the operation screen shown in FIG. Specifically, FIG. 8 shows a description regarding a “Refresh” button 232, a “Language” button 234 and a “Job Log” button 236. As illustrated in FIG. 8, the screen definition information is a mapping that associates the layout information that defines the display position and display size of the GUI component in the operation screen with the internal processing called in response to the operation and operation on the GUI component. Information.

  Referring back to FIG. 4, in step S <b> 106, the information terminal device 50 accepts a user operation performed on the remote operation panel screen 220 by the UI operation accepting unit 168. In step S107, the information terminal device 50 determines the user operation, and branches the process according to the type of event caused by the user operation. Events by user operations can be broadly classified into transition events, setting events, and execution events. The transition event is an operation event that induces a screen transition. For example, an operation such as a click on a button 240 for calling a setting screen for a specific distribution flow illustrated in FIG. The setting event is an operation event for performing a setting related to a function, and includes a selection operation and an input operation using the GUI component on the setting screen described above. The execution event is an operation event that requests execution of a function, and can include an operation such as a click on the start button 226 on the remote operation panel screen 220.

  If it is determined in step S107 that the event is a transition event (transition), the process branches to step S108, and the process according to the transition operation is executed. In step S108, the information terminal device 50 updates the operation screen display area 224 through the UI display unit 166, and displays the operation screen of the transition destination. After step S108, the process loops to step S106 to wait for the next user operation on the updated operation screen.

  On the other hand, if it is determined in step S107 that the event is a setting event instead of an execution event (setting), the process branches to step S109, and a process corresponding to the setting operation is executed. In step S <b> 109, the information terminal device 50 stores setting information describing the content selected or input using the GUI component by the UI operation receiving unit 168 in the setting information holding unit 170. After step S109, the process loops to step S106 to wait for the next user operation on the displayed operation screen.

  On the other hand, if it is determined in step S107 that the event is an execution event (execution), the process branches to step S110, and the process according to the execution operation is executed. In step S <b> 110, the information terminal device 50 transmits an execution request together with the setting information to the connection destination multifunction peripheral 20 by the operation information transmission unit 172. In step S111, the information terminal device 50 receives an execution result that is responded to the execution request from the multi-function device 20, and displays an execution result such as a completion notification for the user in step S112. After step S112, the process branches again to step S106, and transitions to the initial flow selection screen shown in FIG. 7B, for example.

  FIG. 5 is a sequence diagram showing a screen display operation process executed between the multifunction device 20 and the information terminal device 50 according to the first embodiment. The process shown in FIG. 5 starts from step S201. In step S201, the information terminal device 50 receives an operation start instruction from the operator for the remote operation panel. In step S202, the information terminal device 50 transmits an operation start request message to the IP address of the multi-function device 20 designated as the connection destination. In step S203, the multifunction device 20 transmits the screen definition information held by itself to the information terminal device 50 in response to the operation start request message. In step S204, the information terminal device 50 constructs an operation screen (UI construction) according to the received screen definition information, and in step S205 displays the constructed operation screen (UI display).

  In step S206, the information terminal device 50 receives a screen transition operation from the operator. In step S207, in response to the transition event generated by the screen transition operation, the information terminal device 50 performs screen updating by displaying a portion corresponding to the transition destination screen in the screen definition information (UI update). Here, an operation screen for selecting various attributes in the distribution flow is displayed by screen transition.

  In step S208, the information terminal device 50 receives a setting operation from the operator. In step S209, the information terminal device 50 stores the setting information input via the operation screen. In step S208 and step S209, for example, setting of various attribute values of scanning conditions and selection of a delivery destination, such as designation of scan resolution, designation of double side or single side, is performed.

  In step S210, the information terminal device 50 accepts an execution instruction operation on the remote operation panel. As an execution instruction operation, on the remote operation panel screen 220 shown in FIG. 7B, a click on the start button 226, a double click, a tap operation, a shortcut key operation associated with a command for calling an execution request, an execution request Multi-touch gestures associated with commands that call. In step S211, the information terminal device 50 transmits an execution request to the multi-function device 20 together with the setting information stored in step S209.

  On the side of the multifunction device 20 that has received the execution request, each process in the called distribution flow is executed. In the example of FIG. 5, the multi-function device 20 executes scanning according to the scan condition specified in the setting information in step S212, and specifies in the setting information to the distribution destination specified in the setting information in step S213. The distribution process is executed by the distributed method. In step S <b> 214, the multifunction machine 20 transmits the execution result of the distribution flow process to the information terminal device 50. Here, it is assumed that all processing in the distribution flow has been successfully completed. In step S215, the information terminal device 50 displays the received execution result on the display unit 64, and ends this process.

  In the embodiment described with reference to FIG. 5, the screen definition information is provided as a single file describing a plurality of operation screens, and the screen transition is included in the screen definition information acquired in advance. The description has been given assuming that this is done by drawing and updating the transition destination screen according to the description of the corresponding part. Then, on the information terminal device 50 side, the screen transition is appropriately performed using the screen definition information of the single file, and the setting contents made on one or more operation screens are collectively transmitted to the multifunction device 20 side together with the execution request. It was supposed to be. However, the transmission method of the operation content performed between the information terminal device 50 and the multifunction device 20 is not limited to the method illustrated in FIG.

  FIG. 6 is a sequence diagram showing a screen display operation process according to another embodiment executed between the multi-function device 20 and the information terminal device 50. In the embodiment shown in FIG. 6, the screen definition information is configured as a file for each operation screen, and the operation content is transmitted from the information terminal device 50 to the multifunction device 20 side each time. The process shown in FIG. 6 is started from step S301.

  In step S301, the information terminal device 50 receives an operation start instruction from the operator. In step S <b> 302, the information terminal device 50 transmits an operation start request message to the designated multifunction device 20. In step S303, in response to the operation start request message, the multi-function device 20 transmits screen definition information describing the operation screen currently displayed on the operation panel unit 34 of the multi-function device 20 to the information terminal device 50. . In step S304, the information terminal device 50 constructs an operation screen according to the received screen definition information, and displays the constructed operation screen (UI construction / display).

  In step S305, the information terminal device 50 receives a screen transition operation from the operator. In step S306, the information terminal device 50 transmits a screen transition request message to the multifunction device 20 in response to the transition event generated by the screen transition operation. In step S307, in response to the screen transition request message, the multi-function device 20 executes screen transition from the currently displayed operation screen. In step S308, the information terminal device 50 displays screen definition information describing the transition destination screen. Send to. In step S309, the information terminal device 50 reconstructs the operation screen according to the received screen definition information describing the transition destination screen, and redisplays the constructed operation screen (UI reconstruction / redisplay).

  In step S310, the information terminal device 50 receives a setting operation from the operator. In step S <b> 311, the information terminal device 50 transmits a setting request message including setting information to the multifunction device 20 in response to the setting event generated by the setting operation. In step S312, the multi-function device 20 stores the passed setting information.

  In step S313, the information terminal device 50 accepts an execution instruction operation. In step S <b> 314, the information terminal device 50 transmits an execution request to the multifunction device 20. On the side of the multifunction device 20 that has received the execution request, each process in the called distribution flow is executed. In the example of FIG. 6, in step S315, the multi-function device 20 performs scanning under the scan conditions specified in the setting information stored in step S312. In step S316, the MFP 20 satisfies the conditions specified in the setting information. And execute the distribution process. After the execution result is appropriately transmitted and displayed, this processing ends.

  According to the first embodiment described above, in the document distribution system 10, the UI for operating the multifunction device 20 is displayed on the display unit 64 of the information terminal device 50 connected to the multifunction device 20 via the network 12. It is possible to perform an input operation on the multi-function device 20 from the input unit 62 of the information terminal device 50. Therefore, even if the multifunction device is equipped with an operation panel unit (including a device that does not include the display device itself) that has only limited drawing performance for UI display, the drawing performance of the display device included in the multifunction device is improved. Regardless, the operation screen can be displayed in a suitable form on the information terminal device 50, and the function provided by the multifunction device can be called from the information terminal device 50.

  In the above-described embodiment, the operation screen displayed on the information terminal device 50 side has been described as being constructed in a form that matches the drawing performance of the display unit 64 included in the information terminal device 50. Hereinafter, a second embodiment in which the operation screen can be modified according to the functional characteristics of the multifunction device 20 will be described. In addition, since 2nd Embodiment is equipped with the structure substantially the same as 1st Embodiment, it demonstrates below centering on difference.

  The details of the remote operation function in the document distribution system according to the second embodiment will be described below with reference to FIGS. FIG. 9 is a diagram illustrating functional blocks implemented in the document distribution system according to the second embodiment. A functional block 300 shown in FIG. 9 includes a functional block 320 implemented on the multifunction device 20 and a functional block 350 implemented on the information terminal device 50.

  Similar to the first embodiment, the functional block 320 of the MFP 20 includes a remote communication unit 322, a remote operation panel providing unit 324, a screen definition information holding unit 326, a UI construction unit 328, a UI display unit 330, and UI operation reception. A unit 332 and a flow execution control unit 334, and further includes a capability information holding unit 336. The capability information holding unit 336 holds capability information that describes the functional characteristics of the multifunction device 20. The capability information describes the presence / absence of functional characteristics as exemplified in FIG. 11, and is prepared according to the specifications of the multifunction device 20 in advance, for example.

  The UI construction unit 328 reads the screen definition information held in the screen definition information holding unit 326 and the capability information held in the capability information holding unit 336, and builds an operation screen according to the description. Similarly to the first embodiment, the remote operation panel providing unit 324 according to the second embodiment includes an operation information receiving unit 340 and a screen definition information transmitting unit 342, and further includes a capability information transmitting unit 344. . The capability information transmission unit 344 transmits the capability information held in the capability information holding unit 336 to the information terminal device 50 connected to the remote operation function.

  The functional block 350 of the information terminal device 50 includes a remote communication unit 352 and a remote operation panel unit 354. As in the first embodiment, the remote operation panel unit 354 includes a screen definition information receiving unit 360, a screen definition information holding unit 362, a UI construction unit 364, a UI display unit 366, a UI operation receiving unit 368, and a setting information holding unit. 370 and an operation information transmitting unit 372, and further includes a capability information receiving unit 374 and a capability information holding unit 376.

  The capability information receiving unit 374 receives the capability information transmitted from the capability information transmitting unit 344 of the multifunction device 20, and the capability information holding unit 376 holds the received capability information. The UI construction unit 364 reads the screen definition information held in the screen definition information holding unit 362 and the capability information held in the capability information holding unit 376, and in accordance with the description, the display unit of the information terminal device 50 In addition to conforming to the 64 drawing performance, an operation screen is constructed by reflecting the functional characteristics of the multifunction device 20 (such as a scan resolution and paper size that can be set). The UI display unit 366 displays the constructed operation screen on the display unit 64.

  FIG. 12 illustrates a remote operation panel screen displayed on the display unit 64 of the information terminal device 50. FIG. 12A illustrates an operation screen constructed without using capability information, and FIG. 12B illustrates an operation screen constructed using the capability information illustrated in FIG. 11.

  In the screen 250 shown in FIG. 12A, all options including 150 dpi are displayed in the resolution option group 252. On the other hand, in the screen 260 shown in FIG. 12B, the option 256 of 150 dpi is hidden in the resolution option group 262 in accordance with the description of “scanresolution.150 dpi = false” in the capability information. Similarly, regarding the option groups 254 and 264 in the document direction, all the options including “from the right” 258a and “from the bottom” 258b are displayed on the screen 250 shown in FIG. On the other hand, on the screen 260 shown in FIG. 12B, only two options “from the left” and “from the top” are displayed.

  FIG. 10 is a sequence diagram illustrating a screen display operation process executed between the multi-function device 20 and the information terminal device 50 according to the second embodiment. The process shown in FIG. 10 starts from step S401. In step S401, the information terminal device 50 accepts an operation start instruction from the operator. In step S <b> 402, the information terminal device 50 transmits an operation start request message to the connection destination multifunction device 20. In step S <b> 403, the multi-function device 20 transmits screen definition information to the information terminal device 50. In step S404, the information terminal device 50 further transmits a capability information request message to the multi-function device 20. In step S <b> 405, the multifunction device 20 transmits its capability information to the information terminal device 50 in response to the capability information request message.

  In step S406, the information terminal device 50 constructs an operation screen (UI construction) according to the received screen definition information and capability information, and in step S407 displays the constructed operation screen (UI display). The subsequent processing is the same as the processing flow shown in steps S206 to S215 shown in FIG.

  According to the second embodiment described above, in the document distribution system, it is possible to display an operation screen reflecting the functional characteristics of the multifunction device on the information terminal device 50 side and perform an input operation of the multifunction device 20. Become. In the operation screen according to the second embodiment, since the options corresponding to the functional characteristics that the MFP does not have are hidden, it is preferable that the operator mistakenly select the functional characteristics options that the MFP 20 does not have. Can be prevented.

  In the first and second embodiments described above, there is no particular restriction regarding the input operation via the operation panel unit 34 being operated from the information terminal device 50 side. On the other hand, while operating from the information terminal device 50 side, it may be desirable to perform exclusive operations such as limiting input operations via the operation panel unit 34 of the multifunction machine 20. Hereinafter, a third embodiment in which an input operation via the operation panel unit 34 included in the multifunction device 20 is limited in response to a request for starting an exclusive operation from the information terminal device 50 will be described. In addition, since 3rd Embodiment is equipped with the structure substantially the same as 1st Embodiment, it demonstrates below centering on difference.

  In the following, details of processing executed between the information terminal device 50 and the multifunction device 20 in the remote operation function according to the third embodiment will be described with reference to FIGS. 13 and 14. 13 and 14 are sequence diagrams illustrating screen display operation processing executed between the multifunction device 20 and the information terminal device 50 in the third embodiment. The processes shown in FIGS. 13 and 14 are started from step S501.

  In step S501, the information terminal device 50 receives an operation start instruction from the operator. In the present embodiment, the above instruction is an instruction for requesting to restrict an input operation via an operation panel unit included in the connection destination multifunction peripheral. In step S <b> 502, the information terminal device 50 transmits an operation start request message to the connection destination multifunction device 20. In step S <b> 503, the multi-function device 20 transmits screen definition information to the information terminal device 50.

  In step S504, the information terminal device 50 further transmits a multifunction device lock request message to the multifunction device 20. In step S <b> 505, the multifunction device 20 executes a lock process for restricting an input operation via the operation panel unit 34 of the multifunction device 20 in response to the multifunction device lock request message. In step S506, the multi-function device 20 activates a lock release timer set with a predetermined expiration time. The unlock timer estimates that the connection with the information terminal device is disconnected when an idle state in which no operation is performed from the remote operation panel continues for a certain period of time, and an input operation via the operation panel unit 34 is performed. This is a timer for releasing the restriction. On the other hand, the information terminal device 50 constructs an operation screen (UI construction) according to the received screen definition information in step S507, and displays the constructed operation screen (UI display) in step S508.

  The processing flow shown in steps S509 to S512 is the same as the processing in steps S206 to S209 shown in FIG. In step S513, the information terminal device 50 receives an execution instruction operation from the operator. In step S514, the information terminal device 50 transmits an execution request together with the setting information to the multi-function device 20. The MFP 20 that has received the execution request executes a scan in step S515, and executes a distribution process in step S516. When the execution request is made, at least the idle state is not set. In step S517, the multi-function device 20 resets the lock release timer operated in step S506.

  In step S518, the information terminal device 50 receives an operation end instruction from the operator. The above instruction is an instruction for requesting the restriction of the input operation via the operation panel unit 34 of the multifunction machine 20 to be released. In step S519, the information terminal device 50 transmits a lock release request message to the multi-function device 20. In step S520, the multi-function device 20 releases the lock in response to the unlock request message, and releases the restriction on the input operation via the operation panel unit 34 of the multi-function device 20. In step S521, the multi-function device 20 releases the lock timer. Stop.

  When the counter expires in step S522, the multi-function device 20 releases the lock in step S523, releases the restriction on the input operation via the operation panel unit 34 of the multi-function device 20, and in step S524, releases the lock. Stop the timer.

  According to the third embodiment described above, in the document distribution system, when an input operation of the multifunction device 20 is performed from the information terminal device 50 side, operations from the operation panel unit of the multifunction device 20 can be restricted. As a result, it is possible to prevent a situation in which the information terminal device 50 is operated by itself from the multifunction device 20 side during operation. Further, the restriction of the input operation via the operation panel unit 34 included in the multi-function device 20 is that the preset time has elapsed or an explicit request for releasing the restriction is received from the information terminal device 50. To be released. Therefore, it is possible to suitably prevent the operation of the multifunction device 20 from being restricted for a long time even when no one is operating on the information terminal device 50 side.

  In the above-described embodiments, a document distribution system including a multifunction peripheral, an information terminal device, and a management terminal device connected to each other via a network has been described as an example. However, the configuration of the document distribution system is not particularly limited, and a server for managing a plurality of multifunction peripherals can be set up as shown in FIG. 15 according to the system scale. In the document distribution system 500 according to the embodiment shown in FIG. 15, the multi-function peripherals 520 and 540 receive the above-described screen definition information and flow definition information from the management terminal device 580 via the document distribution server 590. The multifunction peripherals 520 and 540 operate as an image input device in the document distribution flow, and can cause the document distribution server 590 to bear some processing with a high load in the flow.

  As described above, according to the embodiments described above, the operation screen of the image processing device is displayed on the information terminal device connected via the network, and the input operation to the image processing device can be performed from the information terminal device. An image processing system, an information terminal device, a screen display method, and a program can be provided.

  The functional unit can be realized by a computer-executable program written in a legacy programming language such as an assembler, C, C ++, C #, Java (registered trademark), an object-oriented programming language, or the like. EPROM, flash memory, flexible disk, CD-ROM, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, Blu-ray disc, SD card, MO, etc. Can be distributed through.

  Although the embodiments of the present invention have been described so far, the embodiments of the present invention are not limited to the above-described embodiments, and those skilled in the art may conceive other embodiments, additions, modifications, deletions, and the like. It can be changed within the range that can be done, and any embodiment is included in the scope of the present invention as long as the effects of the present invention are exhibited.

DESCRIPTION OF SYMBOLS 10,500 ... Document delivery system, 12,512 ... Network, 20, 40, 520, 540 ... Multifunction device, 22 ... Control part, 24 ... Main memory part, 26 ... Auxiliary memory part, 28 ... External storage device I / F , 30 ... Network I / F part, 32 ... Engine part, 34 ... Operation panel part, 50, 550 ... Information terminal device, 52 ... Control part, 54 ... Main storage part, 56 ... Auxiliary storage part, 58 ... External storage Device I / F unit, 60 ... Network I / F unit, 62 ... Input unit, 64 ... Display unit, 80, 580 ... Management terminal device, 100, 120, 150, 300, 320, 350 ... Functional block, 122, 322 ... Remote communication unit, 124, 324 ... Remote operation panel providing unit, 126, 326 ... Screen definition information holding unit, 128, 328 ... UI construction unit, 130, 330 ... UI display unit, 13 332: UI operation accepting unit 140, 340 Operation information receiving unit 142 342 Screen definition information transmitting unit 134 334 Flow execution control unit 152 352 Remote communication unit 154 354 Remote operation Panel section, 160, 360 ... screen definition information receiving section, 162, 362 ... screen definition information holding section, 164, 364 ... UI construction section, 166, 366 ... UI display section, 168, 368 ... UI operation receiving section, 170, 370 ... Setting information holding unit, 172, 372 ... Operation information transmitting unit, 200 ... Initial screen, 202 ... Message display, 204 ... Connection destination management button, 206 ... Connection destination designation button, 220, 250, 260 ... Remote operation panel screen , 222 ... Disconnect button, 224 ... Operation screen display area, 226 ... Start button, 230 ... Title display, 232 234, 236, 240 ... button, 238 ... tab, 242, 244 ... scroll button, 252, 254, 262, 264 ... option group, 256, 258 ... option, 336 ... capability information holding unit, 344 ... capability information Transmission unit, 374... Capability information receiving unit, 376... Capability information holding unit, 590.

Japanese Patent No. 4539293 JP 2011-186789 A JP 2009-188582 A

Claims (12)

An information processing system comprising: a first device that controls execution of a distribution flow that distributes input data that is input; and a second device that is connected to the first device via a network.
The first device includes:
Holding means for holding screen definition information for displaying an operation screen related to the distribution flow for each of the one or more distribution flows defined in advance;
Screen definition information transmitting means for transmitting the screen definition information to the second device;
Operation information receiving means for receiving an execution request for the distribution flow made via the operation screen on the second device;
In response to the execution request, the distribution flow for the input data input to the first device, the execution controlling the execution of the distribution flow based on setting information set on the second device Control means, and
The second device includes:
Display means for displaying the operation screen based on the received screen definition information;
Operation accepting means for accepting an operation performed via the operation screen;
Operation information transmission means for transmitting the execution request to the first device in response to an execution instruction operation for requesting execution of the distribution flow from the operation received by the operation reception means;
Information processing system. The operation information transmitting means includes
The setting information related to the execution of the distribution flow is transmitted to the first device from the operation received by the operation receiving unit.
The information processing system according to claim 1. The second apparatus includes a recording unit that records the setting information set according to the setting operation of the setting information from the operation received by the operation receiving unit.
The display means includes
Based on the received screen definition information, display the operation screen for setting the setting information,
The operation information transmitting means includes
In response to an execution instruction operation for requesting execution of the distribution flow from the operation received by the operation receiving unit, the setting information recorded by the recording unit and the execution request are sent to the first device. Send to
The information processing system according to claim 2. The display means includes
Based on the received screen definition information, display the operation screen for setting the setting information,
The operation information transmitting means includes
From the operation received by the operation receiving means, a setting request for the setting information is transmitted to the first device according to the setting operation of the setting information.
The information processing system according to claim 2. The display means includes
Based on the received screen definition information, display the operation screen for selecting a distribution flow,
The operation information transmitting means includes
In response to a selection operation for selecting the distribution flow from the operation received by the operation reception unit, a screen transition request for displaying the operation screen related to the selected distribution flow is sent to the first device. Send
The screen definition information transmitting means includes
In response to the screen transition request, out of the screen definition information held in the holding unit, the screen definition information for displaying the operation screen corresponding to the selected distribution flow is displayed on the first device. Send to
The information processing system according to any one of claims 1 to 4. The screen definition information transmitting means includes
The screen definition information for displaying the plurality of operation screens for performing operations from setting of the setting information regarding the distribution flow to an execution request is transmitted in response to a request from the second device,
The second device includes:
Based on the screen definition information, the screen transition between the plurality of operation screens for performing the operation from the setting information setting to the execution request is performed, and the screen transition is instructed from the operation received by the operation receiving unit. In response to the operation, the screen definition information is not requested to the first device.
The information processing system according to claim 1 or 2. The holding means is
Holds flow definition information that defines the delivery flow,
The execution control means includes
Control execution of each process of the distribution flow based on the flow definition information and the setting information.
The information processing system according to any one of claims 1 to 6. A screen display method executed between a first device for controlling execution of a distribution flow for distributing input data and a second device connected to the first device via a network. ,
The first device holding screen definition information for displaying an operation screen related to the distribution flow for each of the one or more predefined distribution flows;
The first device transmitting the screen definition information to the second device;
The second device displaying the operation screen based on the received screen definition information;
The second device accepting an operation performed via the operation screen;
The second device transmitting the execution request to the first device in response to an execution instruction operation requesting execution of the distribution flow from the operation received in the receiving step;
The first device receiving a request to execute the distribution flow made via the operation screen on the second device;
The first apparatus is the distribution flow for the input data input to the first apparatus in response to the execution request, and the distribution based on the setting information set on the second apparatus Controlling the execution of the flow;
Including the screen display method. Information processing including a first device that controls execution of a distribution flow that distributes input data that is input, and a program that is mounted and executed on a second device that is connected to the first device via a network A system,
The first device includes:
Holding means for holding screen definition information for displaying an operation screen related to the distribution flow for each of the one or more distribution flows defined in advance;
Screen definition information transmitting means for transmitting the screen definition information to the second device;
Operation information receiving means for receiving an execution request for the distribution flow made via the operation screen on the second device;
In response to the execution request, the distribution flow for the input data input to the first device, the execution controlling the execution of the distribution flow based on setting information set on the second device Control means, and
The program executes the second device,
Display means for displaying the operation screen based on the received screen definition information;
An operation accepting unit that accepts an operation performed through the operation screen, and an operation instruction operation that requests execution of the distribution flow from the operation accepted by the operation accepting unit. , A program for causing an operation information transmission unit to transmit the execution request,
Information processing system. A screen executed between a first device that controls execution of a distribution flow that distributes input data and a second device that connects to the first device via a network and executes a program Display method,
The first device holding screen definition information for displaying an operation screen related to the distribution flow for each of the one or more predefined distribution flows;
The first device transmitting the screen definition information to the second device;
The first device receiving a request to execute the distribution flow made via the operation screen on the second device;
The first apparatus is the distribution flow for the input data input to the first apparatus in response to the execution request, and the distribution based on the setting information set on the second apparatus Controlling the execution of the flow,
The program is stored in the second device.
Displaying the operation screen based on the received screen definition information;
Receiving an operation performed via the operation screen;
A program for causing the first device to execute the step of transmitting the execution request to the first device in response to an execution instruction operation for requesting execution of the distribution flow from the operation received in the receiving step.
Screen display method. An image processing apparatus that controls execution of a distribution flow for distributing an input image that has been input,
A connection means for connecting via a network with an information processing apparatus having a display means for displaying a screen;
Holding means for holding, for each of the one or more distribution flows, flow definition information that defines the distribution flow and screen definition information for displaying an operation screen related to the distribution flow;
Screen definition information transmitting means for transmitting the screen definition information to the second device;
Operation information receiving means for receiving an execution request for the distribution flow made via the operation screen displayed on the display means of the second device;
In response to the execution request, execution of the distribution flow for the input image input to the first device, setting information set on the second device, and the flow held in the holding unit And an execution control means for controlling based on the definition information. For each of the one or more distribution flows, via a network and a first information processing apparatus that holds flow definition information that defines the distribution flow and screen definition information for displaying an operation screen related to the distribution flow An image processing apparatus that controls execution of a distribution flow that connects and distributes input input images,
Connection means for connecting to a second information processing apparatus having a display means for displaying a screen via a network;
Screen definition information transmitting means for transmitting the screen definition information received from the first information processing apparatus to the second information processing apparatus;
Operation information receiving means for receiving an execution request for the distribution flow made via the operation screen displayed on the display means of the second device;
The distribution flow for the input data input to the first device in response to the execution request, the distribution based on the setting information set on the second device and the flow definition information Execution control means for controlling the execution of the flow;
An image processing apparatus.