JP6252028B2 - Image processing system, image processing apparatus, and remote screen display control program - Google Patents

Description

  The present invention relates to an image processing system including an image processing device such as an MFP (Multi Function Peripherals) which is a multifunction digital multifunction peripheral, and a mobile terminal device such as a smartphone or a tablet terminal capable of remotely operating the image processing device, The present invention relates to an image processing apparatus and a remote screen display control program.

  In recent years, portable terminal devices such as smartphones and tablet terminals can store digitized documents, and can browse and edit documents regardless of time and place. In addition, a file edited by the portable terminal device can be transmitted to an image processing apparatus such as the MFP, and the image processing apparatus can execute processing such as printing or saving. Furthermore, a file composed of image data of a document read by the scanner unit of the image processing apparatus can be transmitted to the mobile terminal device, and can be edited by the mobile terminal device.

  However, it is necessary to operate the mobile terminal device and the image processing device separately, and there is a problem that the operation becomes complicated.

  Therefore, recently, an operation screen on the image processing apparatus side for using the functions of the image processing apparatus is displayed as a remote screen on the display unit of the mobile terminal device, so that the image processing device can be operated cooperatively from the mobile terminal device. A cooperation system between an image processing device and a portable terminal device has been proposed. In this system, the remote screen on the image processing device side displayed on the display unit of the mobile terminal device is displayed based on the screen data transmitted from the image processing device.

  That is, information indicating that an operation has been performed is transmitted from the mobile terminal device to the image processing device, and the image processing device creates the next screen data based on this information, and transmits this screen data to the mobile terminal device. The mobile terminal device updates and displays the remote screen based on the screen data.

  By the way, the network bandwidth of the mobile terminal device is limited by communication with the image processing device, and when the operation screen display data is transferred from the image processing device to the mobile terminal device, a remote screen is displayed on the display unit of the mobile terminal device. For example, it takes about 450 μs. The screen transition time of the display unit of the image processing apparatus itself is about three times slower than the screen transition time of about 150 μS, and there is a problem that an operator who has a quick button operation feels that the responsiveness is poor and the operability is low.

  In Patent Document 1, in the image display process in which a low-resolution image is displayed first and then a high-resolution image is displayed, the desired image can be quickly reached even when the images are selected one after another. An image display device capable of performing the above is disclosed.

JP 2011-06953 A

  However, the technique described in Patent Document 1 is not a technique based on a system that displays the operation screen of the image processing apparatus as a remote screen on the portable terminal device. For this reason, it takes time for the remote screen, which is the operation screen of the image processing device, to be displayed on the display unit of the portable terminal device. It was not possible to provide a solution to this problem.

  The present invention has been made in view of such circumstances, and displays a remote screen, which is an operation screen of the image processing device, on the mobile terminal device, and remotely controls the image processing device from the mobile terminal device. In particular, it is an object of the present invention to provide an image processing system that does not cause poor responsiveness even for an operator who has a quick button operation, and further provides an image processing apparatus and a display control program for a remote screen.

The above problem is solved by the following means.
(1) An image processing system comprising an image processing device and a portable terminal device capable of remotely operating the image processing device, wherein the image processing device can display an operation screen for operating the device itself and means, and transmission means for transmitting the operation screen display data for displaying the operation screen to the portable terminal apparatus to the portable terminal device, the portable terminal apparatus, the operation from the image processing apparatus receiving means for receiving the screen display data, the display means and display control means for displaying on said display means an operation screen of the image processing apparatus as a remote screen based on the received operation screen display data by said receiving means when the transmission for transmitting the operation information when the user performs an operation on the remote screen displayed on said display means the image processing apparatus to the image processing apparatus Includes a stage, the said image processing apparatus further includes a receiving unit that receives the operation information from the portable terminal device, an operation upon the display means on the displayed the remote screen of the portable terminal device Based on the operation information received from the mobile terminal device, whether or not the user is an operation expert is determined from the interval until the operation is accepted after the remote screen is displayed on the display means of the mobile terminal device. When it is determined by the operation expert determination means that determines that the user is not an operation expert by the operation expert determination means, the resolution of the operation screen display data to be transmitted to the mobile terminal device is the first When the resolution is set and it is determined that the user is an operation expert, the operation screen display data is more relative than the first resolution as the resolution of the operation screen display data. And a resolution setting means for setting a lower second resolution, said transmitting means of said image processing apparatus, the operation screen display of the said set by the resolution setting means first resolution or the second resolution An image processing system characterized by transmitting data to the portable terminal device.
(2) An image processing system including an image processing device and a portable terminal device capable of remotely operating the image processing device, wherein the image processing device can display an operation screen for operating the device itself Means for transmitting operation screen display data for displaying the operation screen on the mobile terminal device to the mobile terminal device, wherein the mobile terminal device receives the operation from the image processing device. Receiving means for receiving screen display data, display means, and display control means for displaying the operation screen of the image processing device as a remote screen on the display means based on the operation screen display data received by the receiving means And transmission for transmitting operation information to the image processing apparatus when a user performs an operation on the remote screen of the image processing apparatus displayed on the display means. The image processing apparatus further performs an operation on the remote screen displayed on the receiving unit that receives the operation information from the portable terminal device and the display unit of the portable terminal device Whether the user is an operation expert or not is determined from an operation log based on the operation log based on the operation information received from the portable terminal device, and the user is not an operation expert by the operation expert determination unit. If it is determined, the first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and if the user is determined to be an operation expert, the operation screen Resolution setting means for setting a second resolution that is relatively lower than the first resolution as the resolution of the display data, and the transmission means of the image processing apparatus comprises: Image processing system and transmitting the operation screen display data of the first resolution or the second resolution set by the resolution setting unit to the portable terminal device.
(3) An image processing system including an image processing device and a portable terminal device capable of remotely operating the image processing device, wherein the image processing device can display an operation screen for operating the device itself Means for transmitting operation screen display data for displaying the operation screen on the mobile terminal device to the mobile terminal device, wherein the mobile terminal device receives the operation from the image processing device. Receiving means for receiving screen display data, display means, and display control means for displaying the operation screen of the image processing device as a remote screen on the display means based on the operation screen display data received by the receiving means And transmission for transmitting operation information to the image processing apparatus when a user performs an operation on the remote screen of the image processing apparatus displayed on the display means. The image processing apparatus further includes a receiving unit that receives the operation information from the portable terminal device, a user setting unit that sets a user who is an operation expert, and the display unit of the portable terminal device The operation expert determination means for determining whether or not the user who has operated the remote screen displayed on the screen corresponds to the operation expert set by the user setting means If the user is determined not to be an operator by the operation expert determination means, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user Is determined to be a skilled user, a second resolution relatively lower than the first resolution is set as the resolution of the operation screen display data. Resolution setting means, wherein the transmission means of the image processing device receives the operation screen display data having the first resolution or the second resolution set by the resolution setting means. An image processing system, wherein
(4) After the operation expert determination unit of the image processing apparatus determines that the user is an operation expert, the screen operation is started after the display of the remote screen displayed on the display unit of the portable terminal device is completed. If the time until the time is long, or if an operation for returning to the previous screen is performed without performing other operations after the display of the remote screen is completed, the resolution setting means stores the operation screen display data. 4. The image processing system according to any one of items 1 to 3, wherein the resolution is changed from the second resolution to the first resolution.
(5) When the resolution setting is changed from the second resolution to the first resolution, the transmission unit of the image processing apparatus transmits the selection screen display data that allows the user to select whether or not to change the resolution. 5. The image processing system according to any one of the preceding items 1 to 4, wherein the resolution setting unit changes the resolution setting only when the resolution is changed by the user when the user permits the change of the resolution.
(6) A resolution switching button is displayed on the remote screen displayed on the display unit of the portable terminal device, and the resolution setting unit switches the resolution when the user selects the resolution switching. An image processing system according to any one of the above.
(7) Display means capable of displaying an operation screen for operating the device itself and operation screen display data for displaying the operation screen as a remote screen on a portable terminal device capable of remotely operating the device itself Transmission means for transmitting to the terminal device, receiving means for receiving operation information when the user performs an operation on the remote screen displayed on the portable terminal device from the portable terminal device, and the portable terminal device The remote screen is displayed on the mobile terminal device based on the operation information received from the mobile terminal device as to whether or not the user who performed the operation on the displayed remote screen is a skilled user. After that, when it is determined that the user is not an operation expert by the operation expert determination means that determines from the interval until the operation is accepted, and the operation expert determination means Sets a first resolution as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and if the user is determined to be a skilled user, the resolution of the operation screen display data Resolution setting means for setting a second resolution that is relatively lower than the first resolution, and the transmission means sets the first resolution or the second resolution set by the resolution setting means. An image processing apparatus, wherein the operation screen display data of resolution is transmitted to the portable terminal device.
(8) Display means capable of displaying an operation screen for operating the own device and operation screen display data for displaying the operation screen as a remote screen on a portable terminal device capable of remotely operating the own device. Transmission means for transmitting to the terminal device, receiving means for receiving operation information when the user performs an operation on the remote screen displayed on the portable terminal device from the portable terminal device, and the portable terminal device Operation expert determination means for determining whether or not a user who has performed an operation on the displayed remote screen is an operation expert from an operation log based on the operation information received from the mobile terminal device, and the operation If it is determined by the expert determination means that the user is not an operator expert, the resolution of the operation screen display data to be transmitted to the portable terminal device is the first resolution. And when the user is determined to be an expert in operation, a resolution for setting a second resolution relatively lower than the first resolution as the resolution of the operation screen display data Setting means, and the transmission means transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting means to the portable terminal device. An image processing apparatus.
(9) Display means capable of displaying an operation screen for operating the device itself, and display data for operation screen display for displaying the operation screen as a remote screen on a portable terminal device capable of remotely operating the device itself A transmission means for transmitting to the terminal device; a receiving means for receiving operation information from the portable terminal device when a user performs an operation on the remote screen displayed on the portable terminal device; User setting means for setting a user, and whether the user who has operated the remote screen displayed on the mobile terminal device is an operation expert or not, to the operation expert set by the user setting means When it is determined that the user is not an operation expert by the operation expert determination unit that determines whether or not it corresponds, the operation expert determination unit, When the first resolution is set as the resolution of the operation screen display data to be transmitted to the band terminal device, and it is determined that the user is an operation expert, the resolution of the operation screen display data is the first resolution. Resolution setting means for setting a second resolution relatively lower than the first resolution, and the transmission means has the first resolution or the second resolution set by the resolution setting means. An image processing apparatus that transmits operation screen display data to the portable terminal device.
(10) When the time from the completion of display of the remote screen displayed on the mobile terminal device to the screen operation becomes longer after the user is determined by the operation expert determination means as the operation expert, Alternatively, when an operation for returning to the previous screen is performed without performing another operation after the display of the remote screen is completed, the resolution setting means changes the resolution of the operation screen display data from the second resolution to the second resolution. 10. The image processing device according to any one of items 7 to 9, wherein the image processing device is changed to the first resolution.
(11) When the resolution setting is changed from the second resolution to the first resolution, the transmission means transmits selection screen display data for allowing the user to select whether or not to change the resolution to the portable terminal device. The image processing apparatus according to any one of Items 7 to 10, wherein the resolution setting unit changes the resolution setting only when the user permits the change of the resolution.
(12) A resolution switching button is displayed on the remote screen displayed on the mobile terminal device, and the resolution setting unit is any one of the preceding items 7 to 11 in which the resolution is switched when the user selects resolution switching. The image processing apparatus described.
(13) a transmission step of transmitting operation screen display data for displaying an operation screen for operating the own device as a remote screen to a mobile terminal device capable of remotely operating the own device; A receiving step of receiving operation information from the mobile terminal device when a user performs an operation on the remote screen displayed on the mobile terminal device, and an operation on the remote screen displayed on the mobile terminal device Based on the operation information received from the mobile terminal device, it is determined from the interval until the operation is accepted after the remote screen is displayed on the mobile terminal device, based on the operation information received from the mobile terminal device. And when the user is determined not to be an operation expert in the operation expert determination step and the operation expert determination step, When the first resolution is set as the resolution of the operation screen display data to be transmitted to the terminal device, and the user is determined to be an expert in operation, the first resolution is set as the resolution of the operation screen display data. A resolution setting step of setting a second resolution that is relatively lower than the resolution of the image processing device, and causing the computer of the image processing apparatus to execute the first resolution set in the resolution setting step or the transmission step A remote screen display control program for causing the computer to execute a process of transmitting the operation screen display data of the second resolution to the mobile terminal device.
(14) a transmission step of transmitting operation screen display data for displaying an operation screen for operating the own device as a remote screen to a mobile terminal device capable of remotely operating the own device; A receiving step of receiving operation information from the mobile terminal device when a user performs an operation on the remote screen displayed on the mobile terminal device, and an operation on the remote screen displayed on the mobile terminal device In the operation expert determination step for determining from the operation log based on the operation information received from the mobile terminal device whether or not the user who performed the operation is an operation expert, the user is skilled in operation in the operation expert determination step. If it is determined that the user is not a user, the first resolution is set as the resolution of the operation screen display data transmitted to the portable terminal device. And, when it is determined that the user is an operation expert, a resolution setting step of setting a second resolution relatively lower than the first resolution as the resolution of the operation screen display data; Is executed by the computer of the image processing apparatus, and in the transmission step, the operation screen display data having the first resolution or the second resolution set in the resolution setting step is transmitted to the portable terminal device. A display control program for a remote screen for causing the computer to execute.
(15) a transmission step of transmitting operation screen display data for displaying an operation screen for operating the device as a remote screen on a mobile terminal device capable of remotely operating the device; A receiving step of receiving operation information when the user performs an operation on the remote screen displayed on the mobile terminal device from the mobile terminal device, a user setting step of setting a user who is an operation expert, Operation skill for determining whether or not a user who has performed an operation on the remote screen displayed on the mobile terminal device is an operation expert according to whether or not the user is an operation expert set in the user setting step And when the user is determined not to be an operation expert in the operator determination step and the operation expert determination step, A first resolution is set as the resolution of the operation screen display data to be transmitted to the apparatus, and when it is determined that the user is an operation expert, the first resolution is set as the resolution of the operation screen display data. A resolution setting step of setting a second resolution that is relatively lower than the resolution; and causing the computer of the image processing apparatus to execute the resolution, and in the transmission step, the first resolution or the first resolution set in the resolution setting step A remote screen display control program for causing the computer to execute processing for transmitting the operation screen display data having a resolution of 2 to the mobile terminal device.

According to the invention described in item (1) above, when a remote screen that is an operation screen of the image processing device is displayed on the mobile terminal device and the image processing device is remotely operated from the mobile terminal device, the display of the mobile terminal device is displayed. After the remote screen is displayed on the display means of the mobile terminal device based on the operation information received from the mobile terminal device, whether or not the user who has operated the remote screen displayed on the means is an experienced operator From the interval until the operation is accepted, the image processing apparatus determines. When it is determined that the user is not an operation expert, the first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and when it is determined that the user is an operation expert. The second resolution that is relatively lower than the first resolution is set, and the operation screen display data having the set first or second resolution is transmitted to the portable terminal device.

  That is, when it is determined that the user operating the mobile terminal device is a skilled user, operation screen display data having a relatively low resolution is transmitted to the mobile terminal device. Compared with the case where display data is transmitted, the time from the start of transmission until it is displayed on the mobile terminal device can be shortened. For this reason, an image processing system that does not cause a person skilled in the operation of the button to feel poor responsiveness. In addition, since the operation expert knows the positions of the buttons and the like on the operation screen, there is no problem even if the display screen does not have a high resolution.

The determination whether the user is the operation skilled person and based on the received operation information from the portable terminal device, after the remote screen is displayed on the display unit of the portable terminal device, the distance to accept an operation Therefore, it is more reliably determined whether or not the user is an operation expert.

According to the invention described in the above item ( 2 ), whether or not the user is an operation expert is determined from the operation log based on the operation information received from the mobile terminal device. It is determined whether or not.

According to the invention described in ( 3 ) above, whether or not the user is an operation expert is determined based on whether or not the user corresponds to an operation expert set by the user setting means. It is determined whether or not the person is an operation expert.

According to the invention described in the preceding paragraph ( 4 ), even when it is determined that the user is an experienced operator, when the time from the completion of the display of the remote screen to the screen operation becomes long, or the remote screen When an operation for returning to the previous screen is performed without performing another operation after the display is completed, the resolution is switched as if the user is not a skilled operator.

According to the invention described in the above item ( 5 ), the intention of the user can be reflected when switching the resolution.

According to the invention described in the preceding item ( 6 ), the user can switch the resolution by operating the resolution switching button displayed on the remote screen.

According to the invention described in the preceding item ( 7 ), when it is determined that the operating user of the mobile terminal device is an operation expert, operation screen display data having a relatively low resolution is transmitted to the mobile terminal device. Therefore, it is possible to shorten the time from the start of transmission until the operation screen display data is displayed on the mobile terminal device as compared with the case where operation screen display data having a relatively high resolution is transmitted. For this reason, an image processing apparatus that does not cause a person skilled in button operation to feel poor responsiveness.

The determination whether the user is the operation skilled person and based on the received operation information from the portable terminal device, after the remote screen is displayed on the display unit of the portable terminal device, the distance to accept an operation Therefore, it is more reliably determined whether or not the user is an operation expert.

According to the invention described in item ( 8 ) above, whether or not the user is an operation expert is determined from the operation log based on the operation information received from the mobile terminal device. It is determined whether or not.

According to the invention described in the preceding item ( 9 ), since it is determined whether or not the user is an operation expert set by the user setting means, it is determined whether or not the user is an operation expert. It is determined whether or not the person is an operation expert.

According to the invention described in the preceding item ( 10 ), even when it is determined that the user is an experienced operator, when the time from the completion of the display of the remote screen to the screen operation becomes long, or the remote screen When an operation for returning to the previous screen is performed without performing another operation after the display is completed, the resolution is switched as if the user is not a skilled operator.

According to the invention described in the preceding item ( 11 ), the intention of the user can be reflected when the resolution is switched.

According to the invention described in the preceding item ( 12 ), the user can switch the resolution by operating the resolution switching button displayed on the remote screen.

According to the invention described in any one of ( 13 ) to (15) above, when the operation user of the mobile terminal device determines that the user is an operation expert, operation screen display data having a relatively low resolution is carried. Processing to be transmitted to the terminal device can be executed by the computer of the image processing device.

1 is a configuration diagram of an image processing cooperation system in which a mobile terminal device according to an embodiment of the present invention is used. It is a block diagram which shows the electrical structure of an image processing apparatus and a portable terminal device. It is a block diagram which shows the firmware structure of an image processing apparatus and a portable terminal device. It is a figure which shows the relationship between each software of an image processing apparatus and a portable terminal device. It is a figure which shows the state in which the operation screen of the image processing apparatus produced with the image processing apparatus is displayed on the display part of a portable terminal device as a remote screen. It is a flowchart which shows operation | movement of an image processing apparatus. It is a flowchart which shows operation | movement of a portable terminal device. It is a flowchart which shows the detail of the expert determination process in the flowchart of FIG. It is a flowchart which shows the other example of an expert determination process. It is a flowchart which shows the further another example of an expert determination process. It is a flowchart which shows the further another example of an expert determination process. It is a flowchart which shows the further another example of an expert determination process. It is a figure which shows the selection screen of the resolution change permission / inhibition displayed on the portable terminal device. It is a figure in which the resolution setting button is displayed in the operation screen displayed on the portable terminal device. FIG. 15 is a diagram showing a screen that transitions when a resolution setting button is pressed on the screen of FIG. 14.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a configuration diagram of an image processing system in which a mobile terminal device according to an embodiment of the present invention is used.

  The image processing system includes an image processing device 1 and a mobile terminal device 2, and the image processing device 1 and the mobile terminal device 2 can be connected to each other via a wireless LAN router 3 and a network 4. . Note that the image processing apparatus 1 and the portable terminal apparatus 2 can be connected to each other by a USB interface or the like, but in this embodiment, description will be made assuming that they are connected to each other by wireless communication.

  In this embodiment, the above-described MFP having a copy function, a print function, a scan function, a facsimile function and the like is used as the image processing apparatus 1. Hereinafter, the image processing apparatus is also referred to as an MFP. The mobile terminal device is also referred to as a mobile terminal.

  FIG. 2 is a block diagram showing an electrical configuration of the MFP 1 and the portable terminal 2.

  The MFP 1 includes a CPU 101, ROM 102, RAM 103, scanner unit 104, print unit 105, storage unit 106, operation panel unit 107, WIFI (Wireless Fidelity) module 109, LAN (Local Area Network) controller 110, USB interface (USB I / F). 111 etc. are provided.

  The CPU 101 performs overall control of the entire MFP 1 by operating according to an operation program stored in the ROM 102 or the like. For example, in addition to controlling various functions of the MFP 1, in this embodiment, on the basis of a request from the mobile terminal 2, operation screen display data for displaying the operation screen of the own device on the mobile terminal 2 is carried. In response to a user operation performed on the terminal 2 or on the mobile terminal 2 side, operation screen display data to be executed or displayed next is transmitted to the mobile terminal 2.

  The ROM 102 is a memory that stores an operation program of the CPU 101, and the RAM 103 is a memory that provides a work area when the CPU 101 operates according to the operation program.

  The scanner unit 104 reads an image of a document set on a platen glass (not shown) or a document set on an automatic document feeder (not shown) and outputs image data as electronic data.

  The print unit 105 prints image data of a document read by the scanner unit 104 or print data transmitted from the portable terminal 2 or the like on a sheet.

  The storage unit 106 stores various data, applications, and the like, and uses a hard disk device or the like. In particular, in this embodiment, display data for various operation screens displayed on the operation panel unit 107 is stored, and display data for operation screens corresponding to user operations is called from the storage unit 106 by the CPU 101. Displayed on the operation panel unit 107 or transmitted to the portable terminal 2. A plurality of files such as a document file composed of image data read by the scanner unit 104 and a document file transmitted from an external apparatus are also stored.

  The operation panel unit 107 operates the MFP 1 and displays a message or the like to the user. As shown in FIG. 5, a key unit 107a having a mechanical hardware key (hereinafter also referred to as an external key), A display unit 107b including a touch panel such as a liquid crystal is provided. In this embodiment, the external key is a start key 121, a stop key 122, a reset key 123, an ID key 124 for shifting to an authentication screen, a home key 125 for shifting to a default screen, and a shift to a power saving mode. A sub power key 126, a numeric key 127, and the like are provided. The outer keys are not limited to these, and may include a preview key, a guide key, an enlarged display key, a utility key, a job mode switching key, and the like.

  The WIFI module 109 is an interface for wireless connection with the portable terminal 2, and the LAN controller 110 controls communication with an external device such as a personal computer or another MFP.

  The USB interface 111 is an interface for wired connection with the portable terminal 2.

  On the other hand, a smart phone, a tablet terminal, electronic paper, etc. are used for the portable terminal 2. FIG. The portable terminal 2 includes a CPU 201, a RAM 202, a storage unit 203, a display unit 204a, an operation unit 204b, a WIFI module 205, a LAN controller 206, a USB interface 207, file processing units 208a and 208b, a cooperation unit 209, and the like.

  The CPU 201 controls the entire mobile terminal 2 in an integrated manner, and operates according to an OS (Operating System) that is basic software, a cooperative application, or a general-purpose application described later.

  The RAM 202 is a memory serving as a work area when the CPU 201 operates according to an operation program.

  The storage unit 203 stores various data, applications, and the like, and a hard disk device or the like is used. In this embodiment, programs such as operation screen display data, basic OS, cooperative application, and general-purpose application transmitted from the MFP 1 are stored. In the following description, an application is also simply referred to as an application.

  The display unit 204a is a device such as a liquid crystal, and the operation unit 204b is a touch panel provided on the display unit 204a and capable of touch input operation. The touch operation is usually performed by a gesture operation that defines the operation content according to the number of touched fingers and the movement of the fingers. As an example of the gesture operation, a flick operation for scrolling (page advance or page back), a pinch-in operation for instructing image scaling (enlargement or reduction), rotation, etc., a pinch-out operation, etc. can be exemplified. .

  The WIFI module 205 is an interface for wirelessly connecting the mobile terminal 2 to the MFP 1, and the LAN controller 206 controls communication with an external device such as a user terminal. The USB interface 207 is an interface for connecting the portable terminal device 2 to the MFP 1 by wire.

  The file processing units 208a and 208b perform processing such as file editing, transfer, or mail delivery. Hereinafter, both the file processing units 208a and 208b are referred to as a file processing unit 208.

  The cooperation unit 209 is for enabling the functions of the MFP 1 to be used in order to smoothly perform the function cooperation between the MFP 1 and the portable terminal 2. Specifically, operation screen display data for reproducing the same operation screen as the operation screen displayed on operation panel unit 107 of MFP 1 in order to use the copy function, print function, scan function, facsimile function, etc. of MFP 1 Is received from the MFP 1 and the operation screen is displayed on the display unit 204 as a remote screen or when the user presses an operation button or the like displayed on the remote screen, the coordinates of the operation position on the screen are detected and operated. Information is sent to the MFP 1. The MFP 1 analyzes the coordinates of the operation position, identifies the user's operation instruction, and executes an operation according to the operation instruction.

  The function of the file processing unit 208 is realized by the CPU 201 executing a general-purpose application. In other words, the general-purpose application is software for realizing the file processing unit 208 that processes various files. For example, a file editing application, an application having a function of distributing a file by e-mail, and a function of storing a file on the web Various kinds of applications such as an application that the user has can be used.

  The cooperation unit 209 realizes these functions when the CPU 201 executes the cooperation application described above. That is, the cooperation application is software for achieving smooth function cooperation between the MFP 1 and the mobile terminal 2. In addition, file transfer and download can be performed between the cooperative app and the general-purpose app.

  FIG. 3 is a block diagram illustrating firmware configurations of the MFP 1 and the portable terminal 2.

  The MFP 1 includes an operation panel (application) 121 and an open API (Open Application Program Interface) 122 in the application layer, and includes a common API (Common API) 125 and a panel display image generation unit 126 in the common API layer. The hardware-dependent layer includes a panel screen generation unit 123, a panel control unit 124, a portable terminal control unit 127, and the like.

  In addition, the kernel layer includes a panel input control unit 129, a panel LCD control unit 130, a JPEG coder driver 131, and the like, and a device layer includes an operation panel unit 107, a USB interface unit 111, a JPEG compression unit 133, a WIFI module 109, and the like. I have.

  Panel screen generation unit 123 generates screen data on the MFP 1 side displayed on operation panel unit 107 when a cooperative operation is performed from portable terminal 2. At this time, it is determined whether or not the user who operates the mobile terminal 2 is an operation expert. If the user is an operation expert, the second resolution which is relatively lower than the first resolution which is the resolution in the normal mode. Create screen data with resolution. If it is an operation expert, screen data will be produced with the 1st resolution by normal mode. It should be noted that the determination as to whether the user is an operation expert may be performed anywhere.

  The panel control unit 124 controls the communication state with the operation panel unit 107 and the like, and the portable terminal control unit 127 controls an interface and the like for communicating with the portable terminal 2 during the cooperation process with the portable terminal 2. .

  The panel input control unit 129 performs control related to operation input of the operation panel unit 107, and the panel LCD control unit 130 performs display control of the display unit 107 b of the operation panel unit 107. The JPEG compression unit 133 JPEG-compresses operation screen display data, soft key display data, drawer key display data, and the like transmitted from the mobile terminal control unit 127 via the JPEG coder driver 131. The compressed data is transmitted to the mobile terminal 2 via the USB interface 111 and the WIFI module 109.

  On the other hand, the mobile terminal 2 includes an application layer including various applications such as an image display application 221, a display image generation application 222, a JPEG expansion application 223, and a browser 224, a platform layer including various managers 225, 226, and the like. An OS layer including various libraries 227 and a kernel 228 and hardware 229 are included.

  The JPEG decompression application 223 decompresses the compressed data transmitted from the MFP 1.

  The display image generation application 222 generates an image to be displayed on the display unit 204 of the mobile terminal 2.

  The image display application 221 uses the operation screen display data transmitted from the MFP 1 and expanded by the JPEG expansion application 223 to create an operation screen of the MFP 1 as a remote screen and display it on the display unit 204.

  In this embodiment, the image display application 221, the display image generation application 222, and the JPEG expansion application 223 are configured as a part of functions realized by the cooperation application.

  Next, processing when the MFP 1 and the portable terminal 2 are operated in cooperation will be described.

  A user wirelessly connects the portable terminal 2 to the MFP 1 via a network and tries to operate the portable terminal 2 and the MFP 1 in cooperation. The cooperation operation between the portable terminal 2 and the MFP 1 is started when the user starts a cooperation application installed in the portable terminal 2.

  FIG. 4 shows the relationship between the software of the MFP 1 and the portable terminal 2. The left side shows the software on the MFP 1 side and the right side shows the software on the portable terminal 2.

  The cooperative application of the mobile terminal 2 is located between the OS of the mobile terminal 2 and the application software that is general-purpose software, and receives data from the MFP 1, processes the received data, user operation information, and the mobile terminal 2. Side operation screen display data can be acquired, and the acquired data can be transmitted to the MFP 1 as necessary. In other words, the cooperation software of the mobile terminal 2 includes user operation reception processing on the mobile terminal 2 side such as calling of an application, operation screen display data reception / display processing of the MFP 1 (mobile terminal side operation screen processing), and cooperation operation related Execute processing etc. The linked operation related processing includes communication with the MFP 1 of operation information indicating the contents of the operation.

  On the other hand, when the OS on the MFP 1 and the application software for the MFP 1 are all in-house designed / customized and all necessary information can be obtained, the cooperative application of the MFP 1 may not be located between the OS and the application software. Necessary information may be obtained by communicating with the OS and application software while being independent of the OS and application software. The cooperative application of the MFP 1 executes user operation reception processing on the MFP 1 side such as calling of an application, transmission processing of MFP side screen data to the portable terminal 2 (MFP side operation screen processing), cooperative operation related processing, and the like. As the cooperative operation-related processing, reception / execution processing of operation information from the portable terminal 2 and the like can be cited.

  When the user selects the cooperation operation icon displayed on the display unit 204 of the mobile terminal 2 and instructs MFP cooperation, the cooperation software of the mobile terminal 2 communicates with the registered MFP 1, and the cooperation software of the MFP 1 is executed. Call and request acquisition of operation screen display data. Thereby, the cooperative operation mode is started, and the operation screen on the MFP side is displayed on the display unit 105a of the MFP 1 and the display unit 204 of the portable terminal 2. Note that the screen display on the display unit 105a of the MFP 1 may not be performed.

  Next, the operation of the image processing cooperation system shown in FIG. 1 will be described.

  Now, as shown in FIG. 5, the operation screen D1 of the MFP 1 created by the MFP 1 is displayed on the display unit 204a of the portable terminal 2 as a remote screen. When the operation button on the operation screen D1 is operated, information indicating the coordinates operated from the mobile terminal 2 is transmitted to the MFP 1, and the MFP 1 analyzes the coordinate information to create a next screen corresponding to the operation, Execute.

  At this time, the MFP 1 determines whether or not the operation user of the portable terminal 2 is an operation expert, and changes the resolution according to whether or not the operation user is an operation expert to create remote screen display data.

  FIG. 6 is a flowchart showing the operation of the MFP 1 as described above. This operation is executed by the CPU 101 of the MFP 1 operating according to an operation program stored in the ROM 102 or the like.

  In step S01, an acquisition request for screen data from the portable terminal 2 is waited. If there is an acquisition request (YES in step S01), the second resolution is set in step S02, and the operation screen display is performed with the set resolution. Create data.

  Next, after the created operation screen display data is transmitted to the portable terminal 2 in step S03, it is determined whether or not the operation information is received from the portable terminal 2 in step S04. If not received (NO in step S04), it waits for reception. When received (YES in step S04), in step S05, the operation information is analyzed to check whether the operation information is an operation indicating the end of the remote operation. If the remote operation is ended (YES in step S05), the process is performed. finish. If it is not the end of the remote operation (NO in step S05), an expert determination process is performed in step S06. This process is a process for determining whether or not the user operating the portable terminal 2 is an operation expert such as a service person, for example. Details will be described later.

  Next, when it is determined in step S07 that the user operating the mobile terminal 2 is an operation expert as a result of the expert determination process (YES in step S07), the second resolution is set in step S08. The display data for transitioning to the next operation screen is created in accordance with the operation information while maintaining it, and then the process returns to step S03 and the created data is transmitted to the portable terminal 2.

  On the other hand, if it is determined in step S07 that the user operating the mobile terminal 2 is not a skilled user (NO in step S07), the resolution setting is changed from the second resolution to the first resolution in step S09. The display data for transitioning to the next operation screen according to the operation information is created, and then the process returns to step S03 and the created data is transmitted to the portable terminal 2.

  Here, the first resolution is the same high resolution as the conventional one, and the second resolution is a relatively lower resolution than the first resolution. When the operation screen display data created at the first resolution is wirelessly transmitted to the portable terminal 2, it takes time from the start of transmission until it is displayed as a remote screen. Is not good.

  Therefore, when it is determined that the user of the mobile terminal 2 is an operation expert (simply referred to as an expert), the operation screen display data is created while maintaining the second resolution with a low resolution, and the mobile terminal 2 Send to. Since the resolution is low, the transmission processing time is shortened, and the time until the remote screen image is displayed on the portable terminal 2 based on the operation screen display data is shortened. Will improve. The remote screen is a display screen with a low resolution. However, since the expert recognizes the button arrangement and the like, even if the resolution is low, there is almost no influence on the operability.

  On the other hand, when the user of the mobile terminal 2 is not an operation expert, since the first high resolution is set, a remote screen with a high resolution is displayed on the mobile terminal 2 and an operation with few operation errors is possible. .

  In this embodiment, the second resolution is set as the first resolution, and when it is determined that the user is not a skilled operator, the first resolution is switched to the first resolution. However, the first resolution is the first resolution. A resolution of 1 may be set, and when it is determined that the user is an operation expert, the second resolution may be switched to a low resolution.

  FIG. 7 is a flowchart showing the operation of the mobile terminal 2. This operation is executed by the CPU 201 of the mobile terminal 2 operating according to a cooperation application or the like.

  In step S21, a screen acquisition request is transmitted to MFP 1, and in step S22, reception of operation screen display data from MFP 1 is awaited (NO in step S22). When received (YES in step S22), in step S23, a remote screen is displayed on the display unit 204a based on the received data, and then in step S24, it is determined whether or not an operation has been performed by the user on the operation screen. If no operation is made (NO in step S24), the operation waits. When an operation is performed (YES in step S24), it is checked in step S25 whether or not the operation is to end the operation. If the operation is ended (YES in step S25), the MFP 1 is notified of the operation end, and the MFP 1 is remotely controlled. End the operation.

  If the operation has not ended (NO in step S25), operation information is transmitted to MFP 1 in step S26, and the process returns to step S22.

  FIG. 8 is a flowchart showing details of the expert determination process in the flowchart of FIG.

  In step S0601, the operation interval (operation time) from the display completion to the operation is obtained from the operation information received from the mobile terminal 2, and whether the operation interval is shorter than a predetermined threshold (eg, 0.45 seconds) in step S0602. Judging. Whether the operation interval is short may be determined with respect to an average value of each operation interval from the start of the user's operation, or may be determined with an average value including past operation intervals of the user. Note that the threshold value may be changed. The user's past operation intervals are stored in the storage unit 106 as an operation log.

  If the operation interval is long (NO in step S0602), it is determined in step S0603 that the person is not an expert. In this case, the operation screen display data is created at the first resolution which is a high resolution. If the operation interval is short (YES in step S0602), it is determined in step S0604 that the user is an expert. In this case, the operation screen display data is created at the second resolution which is a low resolution.

  In this manner, since it is determined whether or not the user is an operation expert based on the operation interval, it can be easily and reliably determined whether or not the user is an expert.

  FIG. 9 is a flowchart showing another example of the expert determination process.

  In step S0611, the past display count of the screen to be created next is obtained from the operation log of the operation information received from the portable terminal 2 for the user. Data such as operation logs and past display histories are stored in the storage unit 106 and the like.

  In step S0612, it is determined whether the image is displayed a plurality of times. It may be determined whether the number of display times exceeds a certain number. If it is not displayed more than once (NO in step S0612), it is determined in step S0613 that the person is not an expert. In this case, the operation screen display data is created at the first resolution which is a high resolution. If it is displayed more than once (YES in step S0612), it is determined in step S0614 that the person is an expert. In this case, the operation screen display data is created at the second resolution which is a low resolution.

  As described above, since it is determined whether or not the user is an operation expert based on the past operation log of the user, it can be easily and surely determined whether or not the user is an expert.

  FIG. 10 is a flowchart showing still another example of the expert determination process. In this example, the administrator or the like of the MFP 1 can set a user who is an operation expert, and whether or not the user is an expert is determined based on whether or not the user corresponds to the set operation expert.

  In step S0621, a setting value in which whether or not the user is an operation expert is acquired from, for example, the storage unit 106 or the like.

  Next, in step S0622, it is determined whether or not the user is set as an expert. If it is not set as an expert (NO in step S0622), it is determined in step S0623 that the person is not an expert. In this case, the operation screen display data is created at the first resolution which is a high resolution. If it is set as an expert (YES in step S0622), it is determined in step S0624 that the person is an expert. In this case, the operation screen display data is created at the second resolution which is a low resolution.

  As described above, since it is determined whether or not the user is an operation expert based on the setting of whether or not the user is an expert, it is possible to easily and reliably determine whether or not the user is an expert.

  FIG. 11 is a flowchart showing still another example of the expert determination process.

  In step S0631, the operation interval from the display completion to the operation is obtained based on the operation information received from the mobile terminal 2, and in step S0602, the operation interval is longer than the average value of the previous operation intervals or the previous operation interval by a certain amount or more. Determine if it has become.

  If the operation interval becomes longer (YES in step S0632), it is determined that the user is not used to operating the screen, and in step S0633, it is determined that the user is not an expert. In this case, the operation screen display data is created at the first resolution which is a high resolution. If the operation interval is not long (NO in step S0632), it is determined in step S0634 that the user is an expert. In this case, the operation screen display data is created at the second resolution which is a low resolution.

  In this manner, since it is determined whether or not the user is an operation expert based on whether or not the operation interval has become longer, it can be easily and reliably determined whether or not the operator is an expert.

  FIG. 12 is a flowchart showing still another example of the expert determination process.

  In step S0641, it is determined from the operation information received from the portable terminal 2 whether or not the return button has been operated without any operation after the operation screen is displayed.

  When the return button is operated (YES in step S0641), it is determined that the user is not used to operating the screen, and in step S0642, the user is determined not to be an expert. In this case, the operation screen display data is created at the first resolution which is a high resolution. If the return button has not been operated (NO in step S0642), it is determined in step S0643 that the person is an expert. In this case, the operation screen display data is created at the second resolution which is a low resolution.

  As described above, since it is determined whether or not the user is an operation expert based on whether or not the return button is operated without any operation after the operation screen is displayed, it can be easily and surely determined whether or not the user is an expert.

  In the above embodiment, after it is determined that the person is an expert and the second resolution is set, if it is determined that the person is not an expert, the resolution setting is automatically changed to the first resolution which is a high resolution. Although it is changed, if it is determined that the user is not an expert after being determined to be an expert and the second resolution is set, the user is inquired about whether or not the resolution can be changed, and the user permits the resolution to be changed. Only in such a case, the first resolution may be changed.

  In this case, if the MFP 1 determines that the user is an expert and sets the second resolution, and then determines that the MFP 1 is not an expert, the MFP 1 displays selection screen display data for allowing the user to select whether or not to change the resolution. Send. Based on this data, the portable terminal 2 displays a selection screen D2 as shown in FIG. 13 on the display unit 204a. In addition to the message “Do you want to increase the resolution?”, This screen includes a “Yes” button and a “No” button. Only when the user presses the “Yes” button, the MFP 1 switches to the first resolution and creates the next operation screen display data. Even a non-expert user may desire a low-resolution screen with better responsiveness than a high-resolution screen, and can reflect such user's intention.

  Further, as shown in FIG. 14, a resolution setting button 300 may be arranged in the operation screen D <b> 3 displayed on the mobile terminal 2. When the user presses this button 300, as shown in FIG. 15, a resolution selection screen on which selection buttons 301 for each resolution of “high”, “medium”, and “low” are displayed together with a message “Please set resolution”. The transition is made to D4. And it is good also as a structure which can set a resolution by a user's intention when a user presses any button 301.

  Instead of providing a selection button 301 for each resolution of “high”, “medium”, and “low”, one resolution setting button is provided, and each time this button is pressed, “high”, “medium”, and “low” are provided. The resolutions may be selected in order.

  Further, the resolution setting is not limited to three settings of “high”, “medium”, and “low”, and may be two resolution settings of “high” and “low”, and is divided into four or more. A configuration that can be set is also possible, and it is desirable to have a configuration that allows three or more settings and allows the user to set the resolution step by step.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Portable terminal device 101 CPU
102 ROM
107b Display unit 201 CPU
202 RAM
203 Storage Unit 204a Display Unit 204b Operation Unit 209 Cooperation Unit

Claims (15)

An image processing system comprising an image processing device and a portable terminal device capable of remotely operating the image processing device,
The image processing apparatus includes:
Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting the operation screen display data for displaying the operation screen to the portable terminal apparatus to the portable terminal device,
With
The portable terminal device
Receiving means for receiving the operation screen display data from the image processing device;
Display means;
Display control means for displaying on said display means an operation screen of the image processing apparatus as a remote screen based on the received operation screen display data by said receiving means,
Transmission means for transmitting the operation information when the user performs an operation on the remote screen of the image processing apparatus displayed on the display unit in the image processing apparatus,
With
The image processing apparatus further includes:
Receiving means for receiving the operation information from the portable terminal device;
The portable terminal device user the performed operation on the remote screen displayed on the display means, on the basis of whether the operation skilled in the operation information received from the portable terminal device, said mobile terminal After the remote screen is displayed on the display unit of the apparatus, an operation expert determination unit that determines from an interval until an operation is received;
When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
Said transmitting means of said image processing apparatus, an image and transmits the operation screen display data of the first resolution or the second resolution set by the resolution setting unit to the portable terminal device Processing system. An image processing system comprising an image processing device and a portable terminal device capable of remotely operating the image processing device,
The image processing apparatus includes:
Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting operation screen display data for displaying the operation screen on the mobile terminal device to the mobile terminal device;
With
The portable terminal device
Receiving means for receiving the operation screen display data from the image processing device;
Display means;
Display control means for displaying the operation screen of the image processing apparatus as a remote screen on the display means based on the operation screen display data received by the receiving means;
Transmitting means for transmitting operation information to the image processing apparatus when a user performs an operation on the remote screen of the image processing apparatus displayed on the display means;
With
The image processing apparatus further includes:
Receiving means for receiving the operation information from the portable terminal device;
It is determined from the operation log based on the operation information received from the mobile terminal device whether or not the user who has operated the remote screen displayed on the display means of the mobile terminal device is an operation expert. Operation expert judgment means,
When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
The transmission unit of the image processing device transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting unit to the portable terminal device. Processing system. An image processing system comprising an image processing device and a portable terminal device capable of remotely operating the image processing device,
The image processing apparatus includes:
Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting operation screen display data for displaying the operation screen on the mobile terminal device to the mobile terminal device;
With
The portable terminal device
Receiving means for receiving the operation screen display data from the image processing device;
Display means;
Display control means for displaying the operation screen of the image processing apparatus as a remote screen on the display means based on the operation screen display data received by the receiving means;
Transmitting means for transmitting operation information to the image processing apparatus when a user performs an operation on the remote screen of the image processing apparatus displayed on the display means;
With
The image processing apparatus further includes:
Receiving means for receiving the operation information from the portable terminal device;
User setting means for setting a user who is an expert in operation;
Whether the user who has operated the remote screen displayed on the display unit of the portable terminal device is an operation expert or not corresponds to the operation expert set by the user setting unit An operation expert determination means for determining by:
When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
The transmission unit of the image processing device transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting unit to the portable terminal device. Processing system. The time from the completion of display of the remote screen displayed on the display means of the portable terminal device to the screen operation after the user is determined to be an operation expert by the operation expert determination unit of the image processing apparatus When the display of the remote screen is completed, or when an operation for returning to the previous screen is performed without performing other operations after the display of the remote screen is completed, the resolution setting means sets the resolution of the operation screen display data to the The image processing system according to claim 1, wherein the second resolution is changed to the first resolution. When the resolution setting is changed from the second resolution to the first resolution, the transmission unit of the image processing apparatus sends selection screen display data for allowing the user to select whether or not to change the resolution. The image processing system according to claim 1, wherein the resolution setting unit changes the resolution setting only when the transmission is permitted and the user permits the change of the resolution. Display a resolution switching button on the remote screen displayed on the display means of the mobile terminal device;
The image processing system according to claim 1, wherein the resolution setting unit switches the resolution when the user selects switching of the resolution. Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting operation screen display data for displaying the operation screen as a remote screen on a mobile terminal device capable of remotely operating the own device;
Receiving means for receiving operation information from the portable terminal device when a user performs an operation on the remote screen displayed on the portable terminal device;
Based on the operation information received from the mobile terminal device, it is determined whether the user who has operated the remote screen displayed on the mobile terminal device is an operation expert or not. An operation expert determination means for determining from an interval until an operation is accepted after the screen is displayed;
  When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
The image processing apparatus, wherein the transmission unit transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting unit to the portable terminal device. Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting operation screen display data for displaying the operation screen as a remote screen on a mobile terminal device capable of remotely operating the own device;
Receiving means for receiving operation information from the portable terminal device when a user performs an operation on the remote screen displayed on the portable terminal device;
Operation expert determination that determines whether a user who has performed an operation on the remote screen displayed on the mobile terminal device is an operation expert from an operation log based on the operation information received from the mobile terminal device Means,
When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
The image processing apparatus, wherein the transmission unit transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting unit to the portable terminal device. Display means capable of displaying an operation screen for operating the device;
Transmitting means for transmitting operation screen display data for displaying the operation screen as a remote screen on a mobile terminal device capable of remotely operating the own device;
Receiving means for receiving operation information from the portable terminal device when a user performs an operation on the remote screen displayed on the portable terminal device;
User setting means for setting a user who is an expert in operation;
Operation for determining whether or not a user who has performed an operation on the remote screen displayed on the mobile terminal device is an operation expert, according to whether or not the user is an operation expert set by the user setting unit Expert judgment means;
When the operation expert determination means determines that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates If it is determined that the user is an expert, a resolution setting unit that sets a second resolution relatively lower than the first resolution as the resolution of the operation screen display data;
With
The image processing apparatus, wherein the transmission unit transmits the operation screen display data having the first resolution or the second resolution set by the resolution setting unit to the portable terminal device. After the operation expert determination means determines that the user is an operation expert, when the time from display completion of the remote screen displayed on the portable terminal device to screen operation becomes longer, or the remote When an operation for returning to the previous screen without any other operation is performed after the display of the screen is completed, the resolution setting means changes the resolution of the operation screen display data from the second resolution to the first resolution. The image processing apparatus according to claim 7, wherein the image processing apparatus is changed to a resolution. When changing the resolution setting from the second resolution to the first resolution, the transmission means transmits selection screen display data for allowing the user to select whether or not to change the resolution to the mobile terminal device. The image processing apparatus according to claim 7, wherein the resolution setting unit changes the setting of the resolution only when the change of the resolution is permitted. Display a resolution switching button on the remote screen displayed on the mobile terminal device,
The image processing apparatus according to claim 7, wherein the resolution setting unit switches the resolution when the user selects switching of the resolution. A transmission step of transmitting operation screen display data for displaying an operation screen for operating the device itself as a remote screen to a mobile terminal device capable of remotely operating the device;
A receiving step of receiving, from the portable terminal device, operation information when a user performs an operation on the remote screen displayed on the portable terminal device;
Based on the operation information received from the mobile terminal device, it is determined whether the user who has operated the remote screen displayed on the mobile terminal device is an operation expert or not. An operation expert determination step for determining from an interval until an operation is accepted after the screen is displayed,
  If it is determined in the operation expert determination step that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates A resolution setting step of setting a second resolution relatively lower than the first resolution as the resolution of the operation screen display data when it is determined that the user is an expert;
Is executed by the computer of the image processing apparatus,
In the transmission step, a remote screen for causing the computer to execute a process of transmitting the operation screen display data having the first resolution or the second resolution set in the resolution setting step to the portable terminal device Display control program. A transmission step of transmitting operation screen display data for displaying an operation screen for operating the device itself as a remote screen to a mobile terminal device capable of remotely operating the device;
A receiving step of receiving, from the portable terminal device, operation information when a user performs an operation on the remote screen displayed on the portable terminal device;
Operation expert determination that determines whether a user who has performed an operation on the remote screen displayed on the mobile terminal device is an operation expert from an operation log based on the operation information received from the mobile terminal device Steps,
If it is determined in the operation expert determination step that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates A resolution setting step of setting a second resolution relatively lower than the first resolution as the resolution of the operation screen display data when it is determined that the user is an expert;
Is executed by the computer of the image processing apparatus,
In the transmission step, a remote screen for causing the computer to execute a process of transmitting the operation screen display data having the first resolution or the second resolution set in the resolution setting step to the portable terminal device Display control program. A transmission step of transmitting operation screen display data for displaying an operation screen for operating the device itself as a remote screen to a mobile terminal device capable of remotely operating the device;
A receiving step of receiving, from the portable terminal device, operation information when a user performs an operation on the remote screen displayed on the portable terminal device;
A user setting step for setting a user who is an expert in operation;
Operation for determining whether or not a user who has performed an operation on the remote screen displayed on the mobile terminal device is an operation expert according to whether or not the user is an operation expert set in the user setting step Expert judgment step;
If it is determined in the operation expert determination step that the user is not an operation expert, a first resolution is set as the resolution of the operation screen display data to be transmitted to the mobile terminal device, and the user operates A resolution setting step of setting a second resolution relatively lower than the first resolution as the resolution of the operation screen display data when it is determined that the user is an expert;
Is executed by the computer of the image processing apparatus,
In the transmission step, a remote screen for causing the computer to execute a process of transmitting the operation screen display data having the first resolution or the second resolution set in the resolution setting step to the portable terminal device Display control program.

Images