JP2019016349A - Information processing apparatus, remote control system, and program - Google Patents

Abstract

To remotely control an information processing apparatus, while displaying a control screen of the information processing apparatus to be remotely controlled commonly on a display device of a remote control terminal that remotely controls the information processing apparatus, and prevent the details displayed in performing specific processing and displayed on one of the screens from being seen on the other of the screens.SOLUTION: An information processing apparatus 10 comprises: display means 204 that displays a control screen; transmission means 221 that, when receiving remote control executed by an external remote control terminal 40, transmits an image of the control screen displayed on the display means 204 to the remote control terminal 40; and display control means 222 that, when remote control satisfying a preset condition is executed, performs control of transmitting the image of the control screen to the remote control terminal 40 by using the transmission means 221 and not displaying the control screen on the display means 204.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, a remote control system, and a program.

  In Patent Document 1, when a plurality of devices share the same screen, if information that cannot be transmitted is recognized in the information displayed on the screen, the information is not transmitted. A screen sharing method is disclosed in which a related application is terminated, the application is converted into an icon, or another image information is drawn on the icon.

JP 2011-060000 A

  The present invention is displayed when performing a specific process when performing remote operation while displaying the operation screen of an information processing device to be remotely operated on a display device of a remote operation terminal that remotely operates the information processing device. The purpose is to prevent the content displayed on one screen from being viewed on the other screen.

The present invention according to claim 1
Display means for displaying an operation screen;
A transmission means for transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When a remote operation that satisfies a preset condition is executed, an image of the operation screen is transmitted to the remote operation terminal using the transmission unit, while the operation screen is displayed to the display unit. Display control means for performing non-display control; and
Is an information processing apparatus.

  The present invention according to claim 2 is characterized in that the display control means displays an image different from the image of the operation screen transmitted to the remote operation terminal when a remote operation satisfying a preset condition is executed. The information processing apparatus according to claim 1, wherein the display unit performs display control.

  According to a third aspect of the present invention, when the display control unit executes a remote operation that is permitted only to a person having administrator authority as a remote operation that satisfies the preset condition, the remote control is performed. The information processing apparatus according to claim 2, wherein control is performed to display on the display unit a screen different from the image of the operation screen transmitted to the operation terminal.

  The present invention according to claim 4 is characterized in that the display control unit transmits the operation screen to the remote operation terminal from the start to the end of the operation mode permitted only to a person having administrator authority. The information processing apparatus according to claim 3, wherein control is performed to display an image different from the first image on the display unit.

  The present invention according to claim 5 makes it impossible for the display control means to visually recognize the contents of the operation screen transmitted to the remote operation terminal device when a remote operation satisfying a preset condition is executed. The information processing apparatus according to claim 1, wherein control is performed to display the processed image on the display unit.

  According to a sixth aspect of the present invention, when the display control unit executes a remote operation that is permitted only to a person having administrator authority as a remote operation that satisfies the preset condition, the remote control is performed. The information processing apparatus according to claim 5, wherein control is performed to display on the display means an image in which the content of the operation screen transmitted to the operation terminal is not visible.

  The present invention according to claim 7 is characterized in that the display control means transmits the operation screen transmitted to the remote operation terminal from the start to the end of the operation mode permitted only to a person having administrator authority. The information processing apparatus according to claim 6, wherein control is performed to display on the display means an image in which the contents of the image cannot be visually recognized.

The present invention according to claim 8 provides:
A remote operation terminal having first display means for displaying an image of the received operation screen, and input operation means;
A second display means for displaying an operation screen;
A transmission unit that transmits an image of an operation screen displayed on the second display unit to the remote operation terminal when accepting a remote operation by the remote operation terminal;
When a remote operation satisfying a preset condition is executed, an image of the operation screen can be transmitted to the remote operation terminal, while the operation screen is displayed on the second display means An information processing apparatus having display control means for performing control,
Is a remote control system.

The present invention according to claim 9 provides:
In the computer constituting the information processing apparatus,
Displaying an operation screen on the display means;
A step of transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
A step of performing control not to display the operation screen on the display means while transmitting an image of the operation screen to the remote operation terminal when a remote operation satisfying a preset condition is executed. When,
It is a program that executes

The present invention according to claim 10 provides:
Display means for displaying an operation screen;
A transmission means for transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When an operation for displaying the operation screen including the concealment target information on the display unit is executed, the concealment target information included in the operation screen is not displayed on at least one of the display unit and the remote operation terminal. As described above, the information processing apparatus includes display control means for performing display control of the image on the operation screen.

  In the present invention according to claim 11, when the display control unit performs an operation for causing the display unit to display an operation screen including the concealment target information, the concealment target information included in the operation screen is The information processing apparatus according to claim 10, wherein display control of an image of the operation screen is performed so as not to be displayed on the remote operation terminal.

  According to the twelfth aspect of the present invention, the display control means may not be able to discriminate when the concealment target information that is not displayed on the remote operation terminal in the operation screen changes to a display state different from the initial display state on the operation screen. The information processing apparatus according to claim 11, wherein display control is performed so as to be possible.

  According to a thirteenth aspect of the present invention, when the display control unit performs an operation for causing the display unit to display an operation screen including concealment target information, the display control unit includes information other than the concealment target information included in the operation screen. The information processing apparatus according to claim 10, wherein display control of an image of the operation screen is performed so that display information of the operation screen is displayed on the remote operation terminal.

  According to the fourteenth aspect of the present invention, in the case where the display control unit is to perform an operation of inputting the concealment target information as an operation for causing the display unit to display an operation screen including the concealment target information. The information processing apparatus according to claim 10, wherein the display control is performed.

  The present invention according to claim 15 comprises a receiving means for receiving a concealment release instruction for displaying the concealment target information when the concealment target information included in the operation screen is not displayed on the remote operation terminal. When the reception unit receives a concealment release instruction for the concealment target information that is not displayed on the operation terminal, the transmission unit displays the concealment target information by transmitting an instruction to release the concealment of the concealment target information The information processing apparatus according to claim 10, wherein the information processing apparatus is enabled.

  According to a sixteenth aspect of the present invention, the display control unit generates concealment instruction information for concealing the concealment target information and transmits the concealment instruction information together with the image of the operation screen. When receiving a concealment release instruction for information, the display control unit generates concealment release information for releasing the concealment of the concealment target information, and the transmission unit transmits the concealment release information to the remote operation terminal device, The information processing apparatus according to claim 15, wherein the concealment target information is in a displayable state.

  According to a seventeenth aspect of the present invention, in the display control unit, the concealment target information is set to a display state different from the initial display state in accordance with a concealment degree set in advance for each concealment target information. Alternatively, the information processing apparatus according to 17.

The present invention according to claim 18 provides:
A remote operation terminal having first display means for displaying an image of the received operation screen, and input operation means;
A second display means for displaying an operation screen;
A transmission unit that transmits an image of an operation screen displayed on the second display unit to the remote operation terminal when accepting a remote operation by the remote operation terminal;
When an operation for displaying the operation screen including the concealment target information on the second display unit is performed, the concealment target information included in the operation screen includes at least the first display unit and the second display unit. And a display control unit that performs display control of an image of the operation screen so that the display unit is not displayed on any one of the display units.

The present invention according to claim 19 provides:
In the computer constituting the information processing apparatus,
Displaying an operation screen on the display means;
A step of transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When an operation for displaying an operation screen including concealment target information on the display unit is performed, the concealment target information included in the operation screen is at least in one of the display unit and the remote operation terminal. And a step of performing display control of the image on the operation screen so as not to be displayed.

  According to the first aspect of the present invention, when the remote operation is performed while the operation screen of the remotely operated information processing apparatus is shared and displayed on the display device of the remote operation terminal that remotely operates the information processing apparatus, It is possible to provide an information processing apparatus that prevents the content displayed on one screen displayed in performing the process from being viewed on the other screen.

  According to the second aspect of the present invention, in the display device of the information processing apparatus that is remotely operated by an external remote operation terminal, it is possible to prevent the operation content remotely operated by the remote operation terminal from being displayed.

  According to the third aspect of the present invention, it is possible to prevent an operation content that is permitted only to a person having administrator authority from being displayed on the operation screen of the information processing apparatus.

  According to the fourth aspect of the present invention, it is possible to prevent the operation content from being displayed on the operation screen of the information processing apparatus during the operation mode permitted only to a person having administrator authority.

  According to the fifth aspect of the present invention, in the display device of the information processing apparatus that is remotely operated by an external remote operation terminal, the operation content remotely operated by the remote operation terminal is visually recognized from the operation screen of the information processing apparatus. It can be impossible.

  According to the sixth aspect of the present invention, it is possible to make the operation content permitted only to a person having administrator authority invisible from the operation screen of the information processing apparatus.

  According to the seventh aspect of the present invention, it is possible to make the operation content invisible from the operation screen of the information processing apparatus during an operation mode permitted only to a person having administrator authority.

  According to the eighth aspect of the present invention, when remote operation is performed while the operation screen of the remotely operated information processing apparatus is shared and displayed on the display device of the remote operation terminal that remotely operates the information processing apparatus, Thus, it is possible to provide a remote control system that prevents the content displayed on one screen displayed in performing the process from being viewed on the other screen.

  According to the ninth aspect of the present invention, when remote operation is performed while an operation screen of an information processing device to be remotely operated is shared and displayed on a display device of a remote operation terminal for remotely operating the information processing device, It is possible to provide a program for operating the computer of the information processing apparatus so as to prevent the content displayed on one screen displayed in performing the process from being viewed on the other screen.

  According to the tenth aspect of the present invention, when remote operation is performed while displaying the operation screen of an information processing device that is remotely operated on a display device of a remote operation terminal that remotely operates the information processing device, It is possible to provide an information processing apparatus that prevents at least a part of the content displayed on one screen displayed in performing the process from being viewed on the other screen.

  According to the eleventh aspect of the present invention, it is possible to prevent the concealment target information included in the operation screen from being discriminated on the remote operation terminal side.

  According to the present invention of claim 12, it is possible to prevent the concealment target information included in the operation screen from being discriminated on the remote operation terminal side.

  According to the thirteenth aspect of the present invention, it is possible to prevent the concealment target information included in the operation screen from being discriminated on the remote operation terminal side.

  According to the present invention of claim 14, it is possible to prevent the concealment target information included in the operation screen from being discriminated on the remote operation terminal side when an operation for inputting the concealment target information is about to be executed.

  According to the fifteenth aspect of the present invention, when a concealment release instruction is input on either the information processing apparatus side or the remote operation terminal side, the concealment target information on which the concealment release instruction is given is determined on the remote operation terminal side. Can be possible.

  According to the present invention of claim 16, when a concealment release instruction is input, the remote control terminal side simply transmits the concealment release instruction without transmitting information related to the concealment target information. Information can be discriminated.

  According to the seventeenth aspect of the present invention, it is possible to determine the degree of concealment of each information on the information processing apparatus side and the remote operation terminal side.

  According to the eighteenth aspect of the present invention, when remote operation is performed while the operation screen of an information processing device to be remotely operated is shared and displayed on a display device of a remote operation terminal for remotely operating the information processing device, It is possible to provide a remote control system that prevents at least a part of the content displayed on one screen displayed in performing the process from being viewed on the other screen.

  According to the nineteenth aspect of the present invention, when remote operation is performed while the operation screen of the remotely operated information processing apparatus is shared and displayed on the display device of the remote operation terminal that remotely operates the information processing apparatus, It is possible to provide a program for operating the computer of the information processing apparatus so as to prevent at least a part of the content displayed on one screen displayed in performing the process from being viewed on the other screen.

It is the schematic which shows an example of the remote control system 10 in one Embodiment of this invention. 1 is a hardware configuration diagram of an image forming apparatus 20 according to an embodiment of the present invention. 2 is a functional block diagram of an image forming apparatus 20 according to an embodiment of the present invention. FIG. It is a hardware block diagram of the remote control terminal 40 in one Embodiment of this invention. It is a functional block diagram of the remote control terminal 40 in one Embodiment of this invention. 4 is a flowchart illustrating an operation flow of the image forming apparatus 20 when the image forming apparatus 20 is remotely operated by the remote operation terminal 40 according to the embodiment of the present invention. 6 is a diagram showing an example of an operation screen 700 displayed on the display device 204 during normal operation of the image forming apparatus 20 according to an embodiment of the present invention. FIG. 6 is a diagram showing an example of a remote operation request screen 800 displayed on the display device 204 of the image forming apparatus 20 according to an embodiment of the present invention. FIG. In an embodiment of the present invention, a screen 900 displayed on the display device 204 of the image forming apparatus 20 when the remote operation by the remote operation terminal 40 is an operation that satisfies a preset condition (FIG. 9A). And FIG. 9 is a diagram showing an example of an operation screen 950 (FIG. 9B) displayed on the display device 405 of the remote operation terminal 40. In one embodiment of the present invention, a screen 1000 displayed on the display device 204 of the image forming apparatus 20 when the remote operation by the remote operation terminal 40 is not an operation that satisfies a preset condition (FIG. 10A). And FIG. 10 is a diagram illustrating an example of an operation screen 1050 (FIG. 10B) displayed on the display device 405 of the remote operation terminal 40. It is a functional block diagram of the remote control terminal 40 in 2nd Embodiment of this invention. 6 is a flowchart showing a flow of operations of the image forming apparatus 20 according to the second embodiment of the present invention. FIG. 13 is a flowchart of a portion subsequent to the “B” and “D” portions of FIG. 12 showing a flow of operations of the image forming apparatus 20 in the second embodiment of the present invention. 4 is an example of a destination selection screen 1400 displayed on the display device 204 of the image forming apparatus 20. 3 is an example of a detailed display screen 1500 displayed on the display device 204 of the image forming apparatus 20. It is an example of a concealed detail display screen 1600 displayed on the display device 204 of the image forming apparatus 20. 10 is an example of a masked detailed information display screen 1700 displayed on the display device 204 of the image forming apparatus 20. 6 is an example of a permission confirmation screen 1800 displayed on the display screen 204 of the image forming apparatus 20. It is a flowchart which shows the flow of operation | movement of the remote control terminal 40 in 2nd Embodiment. It is an example of the concealment cancellation disapproval screen 2100 displayed on the display device 405 of the remote operation terminal 40 in the second embodiment. 12 is a flowchart illustrating an operation flow of the image forming apparatus 20 according to the third embodiment. 14 is an example of a concealment release confirmation screen 2200 displayed on the display screen 204 of the image forming apparatus 20 in the third embodiment. It is a flowchart which shows the flow of operation | movement of the remote control terminal 40 in 3rd Embodiment. FIG. 20 is a diagram showing an example of a preceding confirmation screen 2400 displayed on the display screen 204 of the image forming apparatus 20 in the fourth embodiment.

[First Embodiment]
Embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram illustrating an example of a remote control system 10 according to the present embodiment. As shown in FIG. 1, the remote control system 10 includes an image forming apparatus 20 and a remote operation terminal 40 connected to the image forming apparatus 20 via a network 30.

  The image forming apparatus 20 is installed in a customer's office 50, for example, and is usually used by a user 60 who performs business in the office 50. On the other hand, the remote operation terminal 40 is installed, for example, in a service center 70 operated by a management company of the image forming apparatus 20 and is operated by an operator / service engineer (remote operator 80). The user 60 contacts the service center by operating an operation panel (to be described later) of the image forming apparatus 20 or making a phone call when a failure occurs or when a desired operation is requested. The service engineer remotely operates the image forming apparatus 20 from the remote operation terminal 40 and performs necessary operations.

  FIG. 2 shows a hardware configuration of the image forming apparatus 20. The image forming apparatus 20 includes a control microprocessor 201, a memory 202, a storage device 203, a display device 204, an input device 205, a communication interface 206, and an image forming unit 207, and is connected to a system bus 208.

  The control microprocessor 201 controls and supervises the operation of each unit of the image forming apparatus 20 by executing a control program stored in the storage device 203.

  The memory 202 includes print image data printed by the image forming unit 207 of the image forming apparatus 20, remote control information transmitted from the remote control terminal 40, image data of an operation screen transmitted to the remote control terminal 40, and the like. Is temporarily stored.

  The storage device 203 is configured by a hard disk (HDD) or a solid state drive (SDD), a control program for controlling each part of the image forming apparatus 20, image data of an operation screen displayed on the display device 204, and an operation Authority information, various set values, for example, information such as print density and paper settings are stored.

  The display device 204 displays an image on the operation screen of the image forming apparatus 20 and includes a liquid crystal display.

  The input device 205 is configured by a touch panel arranged on the display device 204, and the user 60 selects an operation to be executed by touching the screen while viewing the operation screen displayed on the display device 204. Or enter the required information. The display device 204 and the input device 205 constitute an operation panel of the image forming apparatus 20 of the present embodiment, and are arranged in the same place as the liquid crystal display and the touch panel provided on the upper surface as described above. It is good also as a structure provided, and it is good also as a structure provided in a separate place like a liquid crystal display and the key and button arrange | positioned adjacent to it.

  The communication interface 206 performs communication control for connecting the image forming apparatus 20 and the remote operation terminal 40 via the network 30 for communication.

  The image forming unit 207 includes an image reading device and a printing device (each not shown). The image reading device is a scanner for reading an image on a medium such as paper. The printing apparatus prints an image read by the image reading apparatus on another medium such as paper, but a detailed description of these configurations is omitted.

  Next, the functional configuration of the image forming apparatus 20 of the present embodiment will be described with reference to FIG. FIG. 3 is a functional block diagram of the image forming apparatus 20 of the present embodiment. By executing the control program stored in the storage device 203 of the image forming apparatus 20 in the control microprocessor 201, the image forming apparatus 20 has a communication control unit 221, a display control unit 222, a remote control as shown in FIG. It functions as an operation receiving unit 223, an operation authority monitoring unit 224, and various operation execution units 225.

  The communication control unit 221 receives remote control information transmitted from the remote operation terminal 40 and temporarily stores the information in the memory 202. Further, the communication control unit 221 will be described later according to image data of an operation screen displayed on the input device 205 of the image forming apparatus 20 or remote operation of the remote operation terminal 40 when accepting remote operation by the remote operation terminal 40. The operation screen image data generated by the display control unit 222 is transmitted to the remote operation terminal 40.

  When the user 60 operates the input device 204, the display control unit 222 generates an operation screen corresponding to the operation and displays it on the display device 204. Further, when the remote operation of the image forming apparatus 20 is executed by the remote operation terminal 40, the display control unit 222 displays on the display device 204 according to the remote control information transmitted from the remote operation terminal 40. To generate image data of an operation screen. Alternatively, when the input device 205 is operated by a remote operation receiving unit 223 described later, the display control unit 222 generates image data of an operation screen to be displayed on the display device 204 according to the operation.

  Further, when the remote operation is being executed, the display control unit 222 determines whether the remote operation satisfies a preset condition, and the remote operation that satisfies the preset condition is executed. In addition, an image of the generated operation screen is transmitted to the remote operation terminal 40 via the communication control unit 221, while an operation screen generated in response to the remote operation is transmitted to the display device 204. Control to not display the image.

  Specifically, the display control unit 222 performs control to display an image different from the image on the operation screen on the display device 204 when a remote operation that satisfies a preset condition is executed. For example, the display control unit 222 acquires the image data of the alternative screen stored in the storage device 203 and displays it on the display device 204. Alternatively, the display control unit 222 displays, on the display device 204, an image in which the content of the operation screen transmitted to the remote operation terminal 40 is not visible when a remote operation that satisfies a preset condition is executed. You may make it perform control to display.

  Note that the remote operation that satisfies a preset condition refers to a case where a remote operation that is permitted only to a person having administrator authority is executed. For example, this includes processing from when a person having administrator authority logs in to the administrator authority mode of the image forming apparatus 20 until logging out. In that case, the display control unit 222 controls the display device 204 to display a screen different from the image of the operation screen transmitted to the remote operation terminal 40 or the content of the operation screen transmitted to the remote operation terminal 40. The display device 204 is controlled to display an image that cannot be visually recognized. These controls are executed from the start to the end of the operation mode that is permitted only to those who have administrator authority.

  The remote operation reception unit 223 transmits a remote operation request to the remote operation terminal 40 via the communication control unit 221 when the user 60 operates the input device 205 and selects an operation for requesting the remote operation. To do. Then, the login information transmitted from the remote operation terminal 40 is received, and if the login information is correct, the remote operation of the own apparatus by the remote operation terminal 40 is accepted. In addition, the remote operation receiving unit 223 interprets the remote control information transmitted from the remote operation terminal 40 when operating the remote operation, and operates the input device 205 according to the information.

  The operation authority monitoring unit 224 monitors the operation of the input device 205 by the user 60 or the operation of the input device 205 performed by the remote operation receiving unit 223, and the operation is permitted only to those who have administrator authority. Determine whether the operation. When the operation authority monitoring unit 224 determines that the operation is permitted only to the user 60 who needs the administrator authority, the display control unit 222 displays the authentication request screen. Notify Also, the authentication information input directly or remotely by the user 60 or the remote operator 80 operating the remote operation terminal 40 via the input device 205 is authenticated. If the authentication information is correct, the operation mode of the image forming apparatus 20 is changed. The display control unit 222 is notified of the transition to the administrator authority mode and the transition to the administrator authority mode. When the user 60 or the remote operator 80 performs an operation from the administrator authority mode, the operation authority monitoring unit 224 shifts the operation mode of the image forming apparatus 20 from the administrator authority mode to the normal mode. At the same time, the display control unit 222 is notified that the administrator authority mode has ended and the normal mode has been entered. The operation authority monitoring unit 224 may be regarded as having shifted to the administrator authority mode from the time when the authentication request screen is displayed.

  When the input device 205 is operated directly by the user 60 or indirectly by remote operation by the remote operator 80, the various operation execution unit 225 executes various functions according to the operation. These functions include, for example, image scanning, image copying, change of various setting values of the image forming apparatus 20 (for example, print density, paper setting, etc.), firmware update of the image forming apparatus, menu addition, application Includes additional programs.

  Next, with reference to FIGS. 4 and 5, the remote control terminal 40 constituting the remote control system 10 of the present embodiment will be described. FIG. 4 is a diagram illustrating a hardware configuration of the remote operation terminal 40. As shown in FIG. 4, the remote operation terminal 40 includes a CPU 401, a memory 402, a storage device 403, a communication interface 404, a display device 405, and an input device 406, each connected to a system bus 407.

  The CPU 401 controls and controls the operation of each unit of the remote operation terminal 40 based on the control program stored in the storage device 403.

  The memory 402 temporarily stores image data of the operation screen of the image forming apparatus 20 received by the remote operation terminal 40 and information on the remote operation request. The memory 402 temporarily stores remote control information generated by a remote control unit described later.

  The storage device 403 includes a hard disk (HDD) and a solid state drive (SDD), and stores a control program for controlling each unit of the remote operation terminal 40 and an application program for remotely operating the image forming apparatus 20. Is done.

  The communication interface 404 performs communication control for performing communication by connecting the remote operation terminal 40 and the image forming apparatus 20 via the network 30.

  The display device 405 is a liquid crystal monitor, and the remote operation request screen transmitted from the image forming device 20, the connection setting screen for starting the remote operation, and the image forming device 20 are remotely operated from the remote operation terminal 40. The image data of the operation screen generated in the image forming apparatus 20 during the process is displayed.

  The input device 406 is a keyboard, a mouse, and a touch pad. The remote operator 80 operates the input device 406 while visually recognizing an image displayed on the display device 405, whereby the remote operation terminal 40 is changed to an image forming device. The image forming apparatus 20 is remotely operated.

  FIG. 5 is a functional block diagram of the remote operation terminal 40. As shown in FIG. 5, the remote operation terminal 40 functions as a login unit 421 and a remote control unit 422 by executing a control program stored in the storage device 403 in the CPU 401.

  When receiving the remote operation request transmitted from the image forming apparatus 20, the login unit 421 displays a login screen on the display device of the user interface 404 and requests the remote operator 80 to input login information. At the same time, when login information is input by the input device 406, the login information is transmitted to the image forming apparatus 20.

  The remote control unit 422 remotely controls the image forming apparatus 20 using the input device 406, and selects the location of the input device 205 of the image forming apparatus 20 according to the operation of the input device, or Remote control information such as what character is input is generated and transmitted to the image forming apparatus 20 via the network 30.

  Next, the flow of operations in the image forming apparatus 20 of the remote control system 10 of this embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing an operation flow of the image forming apparatus 20 at the time of remote operation by the remote operation terminal 40.

  In step S <b> 601, the image forming apparatus 20 accepts a normal operation by the user 60. The normal operation is, for example, when the user 60 operates the input device 205 while viewing the operation screen displayed on the display device 204 of the image forming apparatus 20, and the display control unit 222 responds to the operation. An operation screen image is generated and displayed on the display device 205, and various operation execution units 225 execute various operations according to the operation. The normal operation includes, for example, image scanning, image copying, and changing various setting values of the image forming apparatus 20 (for example, print density, paper setting, etc.).

  Here, FIG. 7 is a diagram illustrating an example of an operation screen 700 displayed on the display device 204 during normal operation of the image forming apparatus 20. The operation screen 700 displays a plurality of menus, for example, icons 710 such as “scan image”, “copy”, and “setting”. When the user 60 of the image forming apparatus 20 selects a desired menu icon 710 while viewing the operation screen 700 displayed on the display device 204, the various operation execution units 225 have functions corresponding to the selected menu, That is, image scanning, image copying, changing of various setting values of the image forming apparatus 20 (for example, print density, paper setting, etc.) are executed. The operation screen 700 also displays a “remote operation request” menu icon 720 to be described later.

  In step S <b> 602, the remote operation receiving unit 223 determines whether the user 60 has operated the input device 205 to make a remote operation request to the remote operation terminal 40. If it is determined that a remote operation request has not been made, the process returns to step S601 to continue to accept normal operations and continue to execute the corresponding processing. On the other hand, if it is determined in step S602 that a remote operation request has been made, the process proceeds to step S603.

  Here, FIG. 8 is a diagram illustrating an example of a remote operation request screen 800 displayed on the display device 204 of the image forming apparatus 20. The remote operation request screen 800 is displayed when the user 60 of the image forming apparatus 20 selects the “remote operation request” menu icon 720 from the menu of FIG. May be generated and displayed by the user, or may be automatically displayed on the operation screen when an error or the like occurs during normal operation by the user 60 of the image forming apparatus 20, or displayed on the operation screen when an error occurs. An icon of “remote operation request” may be displayed and displayed on the display device 204 when the user 60 selects it.

  As shown in FIG. 8, on the remote operation request screen 800, for example, a confirmation message 810 such as “Connect to the service center and request remote operation. Are you sure?”, “Accept” icon 820, “Cancel” An icon 830 is displayed. When the user 60 selects the “acknowledge” icon 820, the process proceeds to step S603 in FIG. If the user 60 selects the “stop” icon 830, the process returns to step S601 in FIG.

  In step S <b> 603, the remote operation receiving unit 223 transmits a remote operation request to the remote operation terminal 40 via the communication control unit 221. When the remote operation terminal 40 receives this remote operation request, the login unit 421 of the remote operation terminal 40 displays a login screen on the display device of the user interface 404 and requests the remote operator 80 to input login information. When the remote operator 80 inputs login information by operating the input device 406, the login information is transmitted to the image forming apparatus 20.

  In step S604, the remote operation receiving unit 223 of the image forming apparatus 20 authenticates the login information received from the remote operation terminal 40. If the login information is correct, the remote apparatus accepts the remote operation by the remote operation terminal 40. .

  In step S <b> 605, the remote operation receiving unit 223 determines whether or not to end the remote operation of the image forming apparatus 20 by the remote operation terminal 40. Specifically, when a logout process request transmitted from the login unit 421 of the remote operation terminal 40 is received, it is determined that the remote operation is to be ended. If the remote operation receiving unit 223 determines to end the remote operation, the process proceeds to step S606. In step S606, the remote operation accepting unit 223 makes the remote operation of the own apparatus unacceptable by the remote control unit 422 of the remote operation terminal 40, returns to step S601, and the normal operation by the user 60 of the image forming apparatus 20 is performed. Accept the operation. In step S605, when the remote operation receiving unit 223 determines that the remote operation of the own device by the remote operation terminal 40 is not finished, the process proceeds to step S607.

  In step S607, the display control unit 222 of the image forming apparatus 20 generates an operation screen image. The generated operation screen image corresponds to an operation when the remote operation receiving unit 223 of the information processing device 20 operates the input device 205 according to the remote control information transmitted from the remote control unit 422 of the remote operation terminal 40. It is an image of the operation screen.

  In step S <b> 608, the communication control unit 221 transmits the image data of the operation screen generated by the display control unit 222 to the remote operation terminal 40. When the image data of the operation screen is received by the remote operation terminal 40, the remote control unit 422 displays the received image data of the operation screen on the display device 405.

  In step S609, the remote operator 80 who operates the remote operation terminal 40 operates the input device 406 while visually recognizing the image displayed on the display device 405, thereby remotely operating the input device 205 of the image forming apparatus 20. Do.

  In step S610, the display control unit 222 determines whether the remote operation of the input device 204 by the remote operation terminal 40 satisfies a preset condition. This setting condition is assumed to be stored in the storage device 203 of the information processing apparatus 20. The remote operation that satisfies the preset conditions includes, for example, an operation that is permitted only to a person having administrator authority, specifically, from logging in to the administrator authority mode of the image forming apparatus 20 until logging out. This process is included. At this time, the operation authority monitoring unit 224 of the image forming apparatus 20 monitors the remote operation with respect to the input device 205, and whether the operation is an operation permitted only to a person having administrator authority (processing operation during login). Judge whether or not. If the operation satisfies a preset condition, the process proceeds to step S611. If the operation does not satisfy a preset condition, the process proceeds to step S612.

  In step S611 (that is, when the remote operation satisfies a predetermined condition), the display control unit 222 does not display the generated image data of the operation screen on the display device 204 of the image forming apparatus 20. . Instead, the display control unit 222 acquires the image data of the substitute image stored in the storage device 203 and causes the display device 204 to display it. Accordingly, at this time, the screen displayed on the display device 204 of the image forming apparatus 20 and the screen displayed on the display device 405 of the remote operation terminal 40 are different. Alternatively, image processing for making the operation screen invisible can be performed on the image data, and the image data of the operation screen processed so as not to be visible can be displayed on the display device 204. Specifically, mosaic processing or blurring processing is performed on the operation screen to process the image into an invisible image. Thereafter, the process returns to step S605, and the processes of steps S605 to S611 or steps S605 to S612 are performed until the remote operation of the image forming apparatus 20 by the remote operation terminal 40 is completed.

  9 is displayed on the display device 204 of the image forming apparatus 20 when the display control unit 222 determines that the remote operation performed by the remote operation terminal 40 is an operation that satisfies a preset condition. It is a figure which shows an example of the screen 900 (FIG. 9 (A)) and the operation screen 950 (FIG. 9 (B)) displayed on the display device 405 of the remote control terminal 40. As shown in FIG. 9A, on the screen 900 displayed on the display device 204 of the image forming apparatus 20, a message 910 “Currently being remotely operated by an operator of the service center” is displayed. The user 60 who has directly operated the image forming apparatus 20 can visually recognize what operation is being performed on the image forming apparatus 20 by the remote operation terminal 40 through the display device 204 of the image forming apparatus 20. I can't do it. On the other hand, as shown in FIG. 9B, an operation screen 950 that is not displayed on the display device 204 of the image forming apparatus 20 is displayed on the display device 405 of the remote operation terminal 40, and the remote operation terminal 40 is operated remotely. While viewing the operation screen 950, the operator 80 can perform operations permitted only to those who have administrator authority, such as firmware update, menu addition, and new application addition processing.

  In step S610, when the display control unit 222 determines that the remote operation by the remote operation terminal 40 does not satisfy the preset condition, the process proceeds to step S612, and the display control unit 222 is generated in step S612. The image data of the operation screen is displayed on the display device 204 of the image forming apparatus 20. At this time, the operation screen displayed on the display device 204 of the image forming apparatus 20 and the operation screen displayed on the display device 405 of the remote operation terminal 40 are the same. Thereafter, the process returns to step S605, and the processes of steps S605 to S611 or steps S605 to S612 are performed until the remote operation of the image forming apparatus 20 by the remote operation terminal 40 is completed.

  Here, FIG. 10 is displayed on the display device 204 of the image forming apparatus 20 when the display control unit 222 determines that the remote operation performed by the remote operation terminal 40 is not an operation that satisfies a preset condition. It is a figure which shows an example of the screen 1000 (FIG. 10 (A)) and the operation screen 1050 (FIG. 10 (B)) displayed on the display device 405 of the remote control terminal 40. As shown in FIG. 10A, on the screen 1000 displayed on the display device 204 of the image forming apparatus 20, for example, settings for paper supply / discharge and settings for print quality are displayed.

  Further, as shown in FIG. 10B, the display device 405 of the remote operation terminal 40 displays an operation screen 1050 similar to that displayed on the display device 204 of the image forming apparatus 20, and remote operation is performed. The remote operator 80 who operates the terminal 40 visually recognizes the operation screen 1050, and performs operations that are permitted to those other than those having administrator authority, for example, operations for changing various setting values such as print density and paper settings. It can be carried out.

  In the above embodiment, the image forming apparatus is exemplified as the information processing apparatus remotely operated by the remote operation terminal. However, the present invention is not limited to this embodiment, and the personal information processing apparatus is a personal information processing apparatus. The present invention can also be applied to other information processing apparatuses including a display device and an input device such as a computer and other industrial machines.

  In those information processing apparatuses, as described in the above embodiment, when the information processing apparatus is remotely operated by a remote operation terminal, an administrator authority mode or the like that is permitted only to a person having administrator authority, etc. While an operation that satisfies a preset condition is being performed, the actual operation screen is not visible on the display device of the information processing apparatus.

  In the above embodiment, the preset condition has been described as being stored in the storage device 203 of the information processing apparatus 20, but this condition is set and stored in the remote operation terminal 40 and satisfies the condition. It is good also as a structure which notifies to the information processing apparatus 20 when operation is performed.

  Furthermore, in the above-described embodiment, the processing from logging in to the administrator authority mode of the image forming apparatus 20 until logging out is described as a preset condition. The process for displaying a login screen for inputting an ID, a password, etc. may be included in the preset condition.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. The remote control system 10 of the second embodiment is the same as the remote control system 10 of the first embodiment except for the configuration of the remote control terminal 40 except for the functions of the remote operation terminal 40. Are described using the same reference numerals, and a detailed description of the components is omitted.

  FIG. 11 is a functional block diagram of the remote control terminal 40 in the second embodiment of the present invention. As illustrated in FIG. 11, the remote operation terminal 40 executes a control program stored in the storage device 403 in the CPU 401, thereby obtaining a login unit 421A, a remote control unit 422A, a display control unit 423A, and a concealment information determination unit 424A. Function.

  When the login unit 421A receives a remote operation request transmitted from the image forming apparatus 20, the login unit 421A displays a login screen on the display device of the user interface 404 and requests the remote operator 80 to input login information. At the same time, when login information is input by the input device 406, the login information is transmitted to the image forming apparatus 20.

  The remote control unit 422A remotely controls the image forming apparatus 20 using the input device 406, and selects the location of the input device 205 of the image forming apparatus 20 according to the operation of the input device, or Remote control information such as what character is input is generated and transmitted to the image forming apparatus 20 via the network 30.

  The display control unit 423 </ b> A performs image control to display the operation screen image transmitted from the image forming apparatus 20 on the display device 405 of the remote operation terminal 40. As will be described later, when receiving mask information from the image forming apparatus 20, the display control unit 423 </ b> A combines the mask image with the image on the operation screen according to the mask information and displays the mask image on the display device 405. . Further, when there is an instruction to cancel concealment, image control for removing the mask image is performed.

  The concealment information determination unit 424A determines whether or not the concealment information is included in the image of the operation screen received from the image forming apparatus 20, or the concealment level set in the concealment target information. Further, it is determined whether or not the display part of the concealment target information that has been concealed has been selected by the remote operator 80.

  FIGS. 12 and 13 are flowcharts showing the operation flow of the image forming apparatus 20 in the second embodiment, and FIG. 13 is a portion following the “B” and “D” portions of FIG. In step S <b> 1201, the image forming apparatus 20 accepts a normal operation by the user 60. The normal operation is, for example, an operation screen (for example, an operation screen 700 as shown in FIG. 7 described in the first embodiment) displayed on the display device 204 of the image forming apparatus 20 by the user 60. When the input device 205 is operated while visually recognizing, the display control unit 222 generates an operation screen image corresponding to the operation and displays it on the display device 205, and various operation execution units 225 perform various operations according to the operation. Performing the operations. The normal operation includes, for example, image scanning, image copying, and changing various setting values of the image forming apparatus 20 (for example, print density, paper setting, etc.).

  In step S <b> 1202, the remote operation accepting unit 223 determines whether the user 60 has operated the input device 205 to make a remote operation request to the remote operation terminal 40. If it is determined that a remote operation request has not been made, the process returns to step S1201 to continue to accept normal operations and continue to execute the corresponding processing. On the other hand, if it is determined in step S1202 that a remote operation request has been made, the process advances to step S1203.

  Here, the remote operation request screen displayed on the display device 204 of the image forming apparatus 20 is displayed when the “remote operation request” menu icon 720 is selected from the menu of FIG. 7 described in the first embodiment. Since it is generated and displayed by the instruction of the remote operation receiving unit and the display control unit 222 and is the same as that shown in FIG. 8, detailed description thereof is omitted. When the user 60 selects the “acknowledge” icon 820 on the remote operation request screen 800 of FIG. 8, the process advances to step S1203, and the remote operation acceptance unit 223 sends a remote operation request to the remote operation terminal 40 and a communication control unit. 221 is transmitted.

  In step S1204, the remote operation receiving unit 223 of the image forming apparatus 20 authenticates the login information received from the remote operation terminal 40. If the login information is correct, the remote operation receiving unit 223 determines that the apparatus can accept remote operation by the remote operation terminal 40. To do.

  In step S <b> 1205, the remote operation receiving unit 223 determines whether or not to end the remote operation of the image forming apparatus 20 by the remote operation terminal 40. Specifically, when a logout process request transmitted from the login unit 421 of the remote operation terminal 40 is received, it is determined that the remote operation is to be ended. If the remote operation receiving unit 223 determines to end the remote operation, the process proceeds to step S1206. In step S1206, the remote operation receiving unit 223 makes the remote operation of the own apparatus by the remote control unit 422A of the remote operation terminal 40 unacceptable, and returns to step S1201 ((A) in FIG. 12). The normal operation by 20 users 60 is accepted. In step S1205, when the remote operation receiving unit 223 determines that the remote operation of the own device by the remote operation terminal 40 is not finished, the process proceeds to step S1207.

  In step S1207, the display control unit 222 of the image forming apparatus 20 generates an image of the operation screen. The generated operation screen image corresponds to an operation when the remote operation receiving unit 223 of the information processing device 20 operates the input device 205 according to the remote control information transmitted from the remote control unit 422 of the remote operation terminal 40. It is an image of the operation screen. For example, a destination selection screen 1400 as shown in FIG. 14 is generated. 14, the user 60 operates the input device 205 of the image forming apparatus 20, for example, an “image scan” icon 710 as illustrated in FIG. 7, and icons such as “mail transmission” and “destination selection” (not illustrated). 6 is an example of a destination selection screen 1400 that is displayed on the display device 204 of the image forming apparatus 20.

  The destination selection screen 1400 includes a confirmation message 1410 “Please select a mail destination” and a destination list display field 1420. The destination list display column 1420 includes a plurality of destination display units 1420A, 1420B,..., Each displaying a plurality of destinations stored in the storage device 203 of the image forming apparatus 20. Each destination includes a registration number such as “0001” and “0002”, and a destination name such as “XX Corporation” and “ΔΔ Trading”. Further, each of the destination display units 1420A and 1420B includes detailed display icons 1430A, 1430B... (Hereinafter referred to as 1430 when collectively referred to).

  In step S1208, the display control unit 222 extracts display elements included in the operation screen generated in step S1207. Here, the display elements are each element constituting the operation screen. For example, in the case of the destination selection screen 1400 in FIG. 14, a display message 1410, a destination display column 1420, a detailed display icon 1430, and the like.

  In step S1209, the display control unit 222 determines whether or not concealment target information is included in the extracted display element. It is assumed that which display element corresponds to the concealment target information is set in advance by the user 60 or the administrator of the image processing apparatus 20 and stored in the storage device 203. The display control unit 222 extracts the name of the extracted display element and determines whether the name corresponds to a preset display element. For example, in the second embodiment, it is assumed that information of the telephone number itself is set as the concealment target information. In the case of the destination selection screen 1400 shown in FIG. 14, since the display element of the telephone number is not included, it is determined that the concealment target information is not included, and the process proceeds to step S1210.

  In step S1210, the display control unit 222 displays the image of the operation screen generated in step S1207 (here, the image of the destination confirmation screen 1400) on the display device 204 of the image forming apparatus 20, and the communication control unit 221 The image of the operation screen is transmitted to the remote terminal device 40, and the process proceeds to step S1217.

  If it is determined in step S1209 that the extracted display element includes the concealment target information, the process advances to step S1211. For example, when the detailed display icon is selected in FIG. 14 described above, a detailed information display screen 1500 as shown in FIG. 15 is generated. The detail display screen 1500 includes a destination name display field 1510, a mail address display field 1520, a telephone number display field 1530, and an affiliation display field 1540. Since the display element of the detailed information display screen 1500 includes the telephone number, it is determined in step S1209 that the concealment target information is included. At this time, the image on the detailed display screen 1500 is not displayed on the display device 204 of the image forming apparatus 20.

  In step S1211, the display control unit 222 determines the concealment level set in the concealment target information included in the operation screen. Here, the concealment level refers to personal information such as an email address, telephone number, address, and password, the host name of the host computer to which the image forming apparatus 20 is connected, the IP address, user information related to authentication, job memory, etc. This is set by the administrator or user 60 of the image forming apparatus 20 with respect to the confidential information, and is classified according to the level to which the remote operation terminal 40 should be hidden. For example, in the second embodiment, there are three levels of concealment levels: “always concealed”, “confirm each time”, and “not concealed”. For example, in the second embodiment, it is assumed that the telephone number information is set to a concealment level of “always concealment” or “confirm every time”. Note that the concealment level “Do not conceal” is executed as processing when the concealment target information is not included in step S1209. Therefore, in the following description, the concealment level is “always concealment” and “confirm each time”. The process will be described.

  If it is determined in step S1211 that the concealment level of the concealment target information is “always concealment”, the process proceeds to step S1212, and the display control unit 222 displays the image so that the concealment target information part as shown in FIG. 16 is not displayed. The processed concealed detail display screen 1600 is generated. As shown in FIG. 16, in the concealed detail display screen 1600, the phone number information portion whose concealment level is set to “always concealed” differs from the initial display state in the detail display screen 1600. A concealment processing portion 1610 that has become indistinguishable due to the display state is included. In the concealment processing portion 1610, processing such as shading processing, painting processing, mosaic processing, and blurring processing is performed on the portion of the concealment target information on the initial operation screen. Alternatively, the concealment processing portion 1610 may be replaced with other information, such as a display of another message such as “hidden”.

  In subsequent step S1213, the operation screen image including the concealment processing part generated in step S1212 is displayed on the display device 204 of the image forming apparatus 20, and the communication control unit 221 displays the operation screen image in the remote operation terminal 40. The process proceeds to step S1217.

  If it is determined in step S1211 that the concealment level set in the concealment target information included in the operation screen is “confirm every time”, the process proceeds to step S1214. In step S1214, the display control unit 222 generates masking information corresponding to the position where the concealment level is set to “confirm every time”, in the second embodiment, the position where the telephone number is displayed on the operation screen. To do. The mask information includes a name (for example, a telephone number) representing the concealment target information and coordinate information (x1, y1, x2, y2) of the mask image generated for concealing the concealment information.

  In step S <b> 1215, the display control unit 222 superimposes the mask image generated based on the mask information generated in step S <b> 1214 on the operation screen image generated in step S <b> 1207. The image is displayed on the display device 204 (hereinafter referred to as mask processing). FIG. 17 shows an example of a detailed information display screen 1700 subjected to mask processing. On the masked detailed information display screen 1700, the masked portion 1710 is displayed in a different display state compared to other portions, for example, the portion is filled with a mask image having a different color from the surrounding portions. ing.

  When the user 60 of the image forming apparatus 20 touches the mask image portion of the operation screen displayed on the display device 204 with a finger or the like, the mask image disappears and the concealment information that is hidden by the mask image, that is, the telephone A process in which a number is displayed and can be visually recognized by the user 60 may be performed by the display control unit 222 (this process is an operation of only the image forming apparatus 20, and the mask image is displayed on the remote operation terminal 40. It is not erased and the concealment information is not visible).

  In step S1216, the communication control unit 221 transmits the operation screen image generated in step S1207 and the mask information generated in step S1214 to the remote operation terminal 40, and the process proceeds to step S1217.

  In step S 1217, the remote operator 80 who operates the remote operation terminal 40 operates the input device 406 while visually recognizing the image displayed on the display device 405, thereby remotely operating the input device 205 of the image forming apparatus 20. Do. Then, the remote operation receiving unit 223 of the image forming apparatus 20 operates the input device 205 of the image forming apparatus 20 instead of the user 60 according to the remote operation information transmitted from the remote operation terminal 40, and executes various operations. The unit 225 executes various functions according to the operation of the input device 205.

  In step S <b> 1218, the operation authority monitoring unit 224 determines whether a concealment release request has been received from the remote operation terminal 40. The concealment release request includes at least the name of specific concealment target information. If the concealment release request has not been received, the process returns to step S1205, and it is determined whether or not to accept the remote operation. On the other hand, if it is determined in step S1218 that a concealment release request has been received, the process advances to step S1219.

  In step S1219, the display control unit 222 generates a permission confirmation screen 1800 as illustrated in FIG. 18 and displays the permission confirmation screen 1800 on the display device 204. The user 60 of the image forming apparatus 20 permits or cancels the concealment release request. Judge whether or not. In the permission confirmation screen 1800 shown in FIG. 18, a confirmation message 1810 such as “There is a concealment release request. Do you want to permit?” And “permit” or “not permit” are included in the concealment target information portion for which the request for concealment is cancelled. The selection icon 1820 is displayed, and the selection by the user 60 is awaited.

  If it is determined in step S1219 that the user 60 has permitted the concealment release request, that is, if the user 60 has selected the “permitted” icon among the selection icons 1820 on the permission confirmation screen 1800, the process proceeds to step S1220. In step S <b> 1220, the communication control unit 221 transmits a concealment release instruction to the remote operation terminal 40. This concealment release instruction includes the name of the concealment target information whose concealment is to be released. At the same time, the display control unit 222 deletes the mask image of the concealment target information part so that the concealment information that has been concealed is displayed and can be visually recognized by the user 60. Note that the concealment release instruction may include the coordinate information (x1, y1, x2, y2) of the mask image in addition to the name of the concealment target information for performing the concealment release. Or only the coordinate information of the mask image may be sufficient. Thereafter, the process returns to step S1205.

  On the other hand, if it is determined in step S1219 that the user 60 does not permit the concealment release request, that is, if the user 60 selects the “not permitted” icon among the selection icons 1820 on the permission confirmation screen 1800, display control is performed. The unit 222 deletes the confirmation message 1810 and the confirmation icon 1820 displayed on the permission confirmation screen 1800, returns to the image display of the masked detailed information display screen 1700 of FIG. 17, and proceeds to step S1221. In step S1221, the communication control unit 221 transmits a concealment cancellation non-permission instruction to the remote control terminal 40, and the process returns to step S1205.

  FIG. 19 is a flowchart showing an operation flow of the remote control terminal 40 in the second embodiment. In step S 1901, the remote operation terminal 40 receives an image of the operation screen from the image forming apparatus 20 through the communication interface 404 and temporarily stores it in the memory 402. At the same time, when the mask information is received together with the image of the operation screen from the image forming apparatus 20, the mask information is also temporarily stored in the memory 402.

  In step S1902, the concealment information determination unit 424A determines whether mask information is received together with the image of the operation screen. If it is determined that the received information does not include mask information, the process advances to step S1903, and the display control unit 423A displays the operation screen image received from the image forming apparatus 20 on the display device 405, and the process advances to step S1906. move on. If an operation screen image that does not include concealment information is received, the image displayed on the display device 405 is the same as the destination selection screen 1400 shown in FIG. On the other hand, when the operation screen image including the concealment information is received, the image displayed on the display device 405 is the same as the concealed detailed information display screen 1600 as shown in FIG. .

  If the operation screen includes concealment information, the concealment process has already been performed on the image received by the remote operation terminal 40, and therefore the remote operation terminal 40 simply displays the received image as it is.

  On the other hand, in step S1902, if the concealment information determination unit 424A determines that the mask information is received together with the operation screen image, the process advances to step S1904. In step S1904, the display control unit 423A combines the operation screen image received from the image forming apparatus 20 with the mask image generated based on the mask information, and in step S1905, combines the operation screen and the mask image. The displayed masked operation screen image is displayed on the display device 405. For example, a masked detailed information display screen 1700 as shown in FIG. 17 is displayed on the display device 405. In the detailed information display screen 1700 of FIG. 17, a mask image 1710 is synthesized and displayed in a portion corresponding to the telephone number display field 1530 of the detailed display screen 1500 of FIG. 15, and the telephone number is not visible.

  In subsequent step S 1906, the remote control unit 422 A generates remote control information according to the operation of the input device 406 by the remote operator 80 of the remote operation terminal 40 and transmits it to the image forming apparatus 20 via the network 30.

  In step S1907, the concealment information determination unit 424A determines the location where mask processing is performed by the operation of the input device 406 by the remote operator 80, that is, the rectangular range represented by the coordinates (x1, y1, x2, y2) of the mask image. It is determined whether any of the locations has been selected. If it is determined that the portion where the mask processing has been performed has not been selected, the process proceeds to step S1908. In step S1908, the remote control unit 422A determines whether to end the remote operation of the image forming apparatus 20 by the remote operation terminal 40 or not. Determine whether.

  If it is determined in step S1908 that the remote operation is to be terminated, the login unit 421A executes a logout process, disconnects the connection between the remote operation terminal 40 and the image forming apparatus 20, and ends the process. On the other hand, if it is determined not to end the remote operation, the process returns to step S1901 to continue the remote operation of the image forming apparatus 20.

  On the other hand, in step S1907, when the concealment information determination unit 424A determines that the portion where the mask process has been performed by the operation of the input device 406 by the remote operator 80 is selected, the process proceeds to step S1909, and the remote control unit 422A The name of the concealment target information at the location where the mask processing is performed is extracted, and a concealment release request for requesting the concealment release for the concealment target information is transmitted to the image forming apparatus 20. This concealment release request includes at least the name of the concealment target information.

  At this time, the display control unit 423A displays the name of the concealment target information on the display device 405 and confirms whether to request the user 60 of the image forming apparatus 20 to cancel concealment of the concealment target information. A confirmation screen (not shown) may be generated and displayed on the display device 405. When the remote operator 80 of the remote operation terminal 40 selects an icon such as “Request” on the confirmation screen, the remote control unit 422A transmits the above-described concealment release request to the image forming apparatus 20. May be.

  As already described in steps S1218 and S1219 described above, when the image forming apparatus 20 receives this concealment release request, the image forming apparatus 20 displays a permission confirmation screen 1800 as shown in FIG. 204, and requests permission for a concealment release request by the user 60 of the image forming apparatus 20.

  In step S1910, the concealment information determination unit 424A of the remote operation terminal 40 determines whether a concealment release instruction or a concealment release non-permission instruction for the concealment release request has been received from the image forming apparatus 20. If a concealment release instruction is received, the process advances to step S1911. In step S1911, the display control unit 423A of the remote operation terminal 40 performs a process of deleting the mask image from the mask-processed image and cancels the concealment by displaying the mask image on the display device 405.

  Note that the concealment release instruction includes the name of the concealment target information whose concealment is to be released. Alternatively, mask information combined with concealment target information to be concealed, for example, coordinate information (x1, y1, x2, y2) of the mask image may be included. Since the image on the operation screen after the release of concealment has already been stored in the memory 402 of the image forming apparatus 40, it is sufficient to simply delete the mask image. At this time, the image displayed on the display device 405 is the same as the detailed information display screen 1500 displayed in FIG. 17, and the telephone number information previously hidden by the mask image is displayed in the telephone number display field 1730. Is displayed. The process returns to step S1908 to determine the end of the remote operation.

  In step S1910, when the concealment information determination unit 424A determines that the concealment cancellation non-permission instruction has been received from the image forming apparatus 20, the process proceeds to step S1912, and the display control unit 423A causes the user 60 of the image forming apparatus 20 to perform the process. A message indicating that the display of the masked portion information is not permitted is generated and displayed on the display device 405. FIG. 20 is a diagram illustrating an example of the concealment release disapproval screen 2100 displayed on the display device 405 of the remote operation terminal 40. On the concealment release disapproval screen 2000, the masked portion 2010 is left as it is, and a concealment disapproval message dialog 2020 such as “Concealment release was not permitted” is displayed. Next, the process returns to step S1908 to determine the end of the remote operation.

  In the second embodiment, the user 60 of the image forming apparatus 20 instructs whether or not to cancel the concealment when receiving the concealment release request from the remote operation terminal 40. Therefore, even if the user 60 of the image forming apparatus 20 selects a masked portion on the display screen when the concealment release request has not been received, the information concealed there is simply stored in the image forming apparatus 20. It is only displayed on the display device 204 and not displayed on the display device 405 of the remote operation terminal 40. On the other hand, in the following third embodiment, when the user 60 of the image forming apparatus 20 selects a masked portion on the display screen, whether or not the mask processing portion is visible on the remote operation terminal 40 side. Can be selected by the user 60 of the image forming apparatus 20.

[Third Embodiment]
FIG. 21 is a flowchart showing an operation flow of the image forming apparatus 20 in the third embodiment. Since the image forming apparatus 20 and the remote operation terminal 40 in the third embodiment are the same as those in the second embodiment, detailed descriptions of the configuration and functions of each unit are omitted. Also, the operation of the image forming apparatus 20 is the same as the processing in step S1201 to step S1217 in FIG. 12 described in the second embodiment since the processing before step S2101 in FIG. 21 is the same as the processing in this portion. The process after step S2101 in FIG.

  First, it is assumed that the display device 204 of the image forming apparatus 20 displays a masked detailed information display screen 1700 as described in FIG. 17 of the second embodiment. In step S2101, the various operation execution units 225 of the image forming apparatus 20 determine whether the user 60 of the image forming apparatus 20 has selected the masked portion 1710 of the detailed information display screen 1700. When it is determined that the user 60 has not selected the masked portion, the process in the third embodiment is terminated, and the process after step 1217 in FIG. 13 in the second embodiment described above, that is, the remote operation terminal The operation which accepted the remote operation by 40 is executed.

  If it is determined in step S2101 that the user 60 has selected the masked portion, in step S2102, the display control unit 222 generates a concealment cancellation confirmation screen 2200 as shown in FIG. To display. On the concealment confirmation cancellation screen 2200, a confirmation message 2210 such as “Do you want to cancel concealment” and a selection icon 2220 such as “permit” and “cancel” are displayed on the masked portion selected by the user 60, Waiting for selection by user 60.

  If it is determined in step S2103 that the permission for concealment cancellation has been selected by the operation authority monitoring unit 224, that is, if the user 60 selects the “permission” icon among the selection icons 2220 on the concealment cancellation confirmation screen 2200, The process proceeds to step S2104. In step S2104, the communication control unit 221 transmits a concealment release instruction to the remote operation terminal 40, and the display control unit 222 displays the concealed concealment information by deleting the mask image of the concealment target information portion. In such a state, it can be visually recognized by the user 60. Next, the processing in the third embodiment is ended, and the processing after step 1217 in FIG. 13 in the second embodiment described above, that is, the operation that accepts the remote operation by the remote operation terminal 40 is executed.

  On the other hand, in step S <b> 2103, when the user 60 does not cancel the concealment, that is, when the user 60 selects the “cancel” icon among the selection icons 2220 on the concealment cancellation confirmation screen 2200, the display control unit 222 displays the concealment cancellation confirmation screen 2200. The confirmation message 2210 and the confirmation icon 2220 displayed in FIG. 17 are erased, the display returns to the image display of the masked detailed information display screen 1700 in FIG. 17, the processing in the third embodiment is terminated, and the second described above. The processing after step 1217 in FIG. 13 in the embodiment, that is, the operation that accepts the remote operation by the remote operation terminal 40 is executed.

  Next, the flow of operation in the remote operation terminal 40 of the third embodiment will be described with reference to FIG. In step S <b> 2301, the remote operation terminal 40 receives an image of the operation screen from the image forming apparatus 20 through the communication interface 404 and temporarily stores it in the memory 402. At the same time, when the mask information is received together with the image of the operation screen from the image forming apparatus 20, the mask information is also temporarily stored in the memory 402.

  In step S2302, the concealment information determination unit 424A determines whether mask information is received together with the image of the operation screen. If it is determined that the received information does not include mask information, the process advances to step S2303, and the display control unit 423A displays the operation screen image received from the image forming apparatus 20 on the display device 405, and the process advances to step S2306. move on. If an operation screen image that does not include concealment information is received, the image displayed on the display device 405 is the same as the destination selection screen 1400 shown in FIG.

  On the other hand, in step S2302, if the concealment information determination unit 424A determines that the mask information is received together with the operation screen image, the process advances to step S2304. In step S2304, the display control unit 423A combines the operation screen image received from the image forming apparatus 20 with the mask image generated based on the mask information, and in step S2305, combines the operation screen and the mask image. The displayed masked operation screen image is displayed on the display device 405. For example, a masked detailed information display screen 1700 as shown in FIG. 17 is displayed on the display device 405.

  In step S <b> 2306, the remote control unit 422 </ b> A generates remote control information in response to the operation of the input device 406 by the remote operator 80 of the remote operation terminal 40 and transmits it to the image forming apparatus 20 via the network 30.

  In step S2307, the concealment information determination unit 424A determines whether a mask image concealment release instruction has been received from the image forming apparatus 20. If it is determined that the concealment release instruction has not been received, the process advances to step S2309. If it is determined that the concealment release instruction has been received, the process advances to step S2308, and the display control unit 423A of the remote operation terminal 40 performs a process of deleting the mask image for which the concealment release instruction has been issued from the mask processed image, The concealment is canceled by displaying on the display device 405. At this time, the image displayed on the display device 405 is the same as the detailed information display screen 1500 displayed in FIG. 15, and the telephone number previously hidden by the mask image is displayed in the telephone number display field 1530. Information is displayed.

  In step S2309, the remote control unit 422A determines whether or not the remote operation of the image forming apparatus 20 by the remote operation terminal 40 is to be terminated. If it is determined that the remote operation is to be terminated, the login unit 421A executes a logout process, disconnects the connection between the remote operation terminal 40 and the image forming apparatus 20, and ends the process. On the other hand, if it is determined not to end the remote operation, the process returns to step S2301, and the remote operation of the image forming apparatus 20 is continued.

[Fourth Embodiment]
In the second embodiment, the image forming apparatus 20 confirms whether or not to perform the concealment canceling process for the masked part when the remote control terminal 40 requests the image forming apparatus 20 to cancel the concealment. The example in the case where it performed with respect to the user 60 of this was demonstrated. In the third embodiment, when the user 60 of the image forming apparatus 20 selects the masked portion, the user 60 is confirmed whether or not to perform the concealment release processing for the portion. Was. However, the user 60 may be inquired in advance as to whether or not to perform the concealment release processing for the concealment target information whose concealment level is set to “confirm every time”.

  In this case, it is assumed that a destination selection screen 1400 as shown in FIG. 14 is displayed on the display device 204 of the image forming apparatus 20. At this time, when the detail display icon 1430 is selected by the user 60 of the image forming apparatus 20 or the remote operator 80 of the remote operation terminal 40, in the second and third embodiments, as shown in FIG. In this fourth embodiment, before displaying the detailed information display screen 1500, the display control unit 222 of the image forming apparatus 20 displays the preceding confirmation screen as shown in FIG. 2400 is displayed.

  The advance confirmation screen 2400 includes a confirmation message 2410 that asks whether or not to confirm whether or not to allow display of masked concealment information on a detail display screen that will be displayed in the future, and “Omit” or “Do not omit”. And a selection icon 2420. When the user 60 selects the “omitted” selection icon 2420, the following operation is executed in the subsequent processing.

  For example, when the remote operator 80 of the remote operation terminal 40 selects the masked concealment information portion as in the second embodiment, the permission confirmation screen 2000 as shown in FIG. 20 is displayed. The user 60 of the image forming apparatus 20 is not asked again whether or not to cancel the concealment. Instead, the display control unit 222 deletes the mask image, and displays an image of the detailed information display screen 1500 as shown in FIG. 15 on the display device 204 of the image forming apparatus 20 and on the display device 405 of the remote operation terminal 40. The same screen should be reflected.

  Similarly, when the user 60 of the image forming apparatus 20 selects the masked concealment information portion as in the third embodiment, the concealment release confirmation screen 2200 described with reference to FIG. 22 is displayed. Thus, the user 60 of the image forming apparatus 20 is not asked again whether or not to cancel the concealment. Instead, the display control unit 222 deletes the mask image, and displays the image of the detailed information screen 1500 as shown in FIG. 15 on the display device 204 of the image forming apparatus 20 and also on the display device 405 of the remote operation terminal 40. Make sure that the same screen is reflected.

  In the fourth embodiment, the concealment cancellation confirmation screen 2200 is displayed when an operation for displaying the detail display screen (that is, an operation for selecting the “detail display” icon 1630 in FIG. 16) is performed. . The present invention is not limited to the above example. For example, when a login button is selected, a user name and password input screen and a soft keyboard are displayed, and the information is displayed using the displayed soft keyboard. However, it is also possible to display a screen for confirming the same as the preceding confirmation screen before displaying the screen. Alternatively, the confirmation screen may be a selection screen for permitting or hiding display of subsequent operations. When concealment is selected on the confirmation screen, the name of the concealment target information and the mask image information are transmitted to the image forming apparatus 40.

  In the second to fourth embodiments, an example in which the remote operator 80 of the remote operation terminal 40 can perform a remote operation and the “detailed display” icon 1430 on the destination confirmation screen 1400 of FIG. 14 can be selected will be described. did. However, when a displayed icon is selected and the information to be displayed is included in the information to be displayed next, the icon may not be selected on the remote operation terminal 40. In that case, the operator 80 of the remote operation terminal 40 proceeds to display the next detailed display screen by selecting the icon on the image forming apparatus 20 side with respect to the user 60 of the image forming apparatus 20 by telephone or the like. It is necessary to ask verbally.

  In Embodiments 2 to 4 above, one piece of concealment target information such as a telephone number is included in the screen, and the concealment level of either “always concealment” or “confirm every time” for the concealment target information. The case where is set was explained. However, the present invention is not limited to the above example, and includes a plurality of concealment target information within the screen, for example, a mail number, a business office name, a department name, etc. in addition to a telephone number. Either a “constantly concealed” or “confirmed each time” concealment level may be set for the information.

  In the second to fourth embodiments, information defined by the user 60 of the image forming apparatus 20 (for example, personal information such as an email address, a telephone number, an address, and a password) among the information stored in the image forming apparatus 20 is used. In addition, an example has been described in which the host name of the host computer to which the image forming apparatus 20 is connected, the IP address, user information related to authentication, and confidential information such as a job memory) are concealed information. However, the present invention is not limited to the above example, and the operation itself for displaying the confidential information is set as concealment target information, and the icons, item names, and operations for displaying or executing the information are also concealed. It may be processed so that it is not displayed.

  Further, a connection operation for connecting the image forming apparatus 20 to another device or device, for example, a collation operation to an external authentication server, a connection operation to an external storage (including a USB memory), or other connections connected via a network. Connection operation to a computer, for example, ScanToPC or SMB (Server Message Block) connection operation is set as concealment target information, and icons, item names, and operations for displaying or executing such information are not concealed and displayed. It may be.

  Further, information stored in the image forming apparatus 20 after the factory shipment of the image forming apparatus 20, for example, a document name of a print job may be set as concealment target information. In the second to fourth embodiments, the case where the concealment level is set in advance has been described. However, the operation authority monitoring unit 224 may allow the user 60 of the image forming apparatus 20 to set the concealment level at an arbitrary time. Good. Further, although there are usually a plurality of users of the image forming apparatus 20, the concealment level for each concealment target information may be set according to each user. In this case, the respective concealment target information is displayed / hidden at the concealment level set for the user 60 used when the remote operation is performed.

  In the above example, the example in which the display method of the concealment portion is different between the case where the concealment level is “always concealment” and the case where “confirm each time” is described, but the present invention is not limited to the above example. It is not limited. Even if the concealment level is different, the information to be concealed may be concealed with the same display method that is different from other places that are not concealed, and in addition to the same image processing, “hidden”, “ The user 60 or the remote operator 80 may be able to recognize that the concealment level is different by displaying the message “permission is required” superimposed.

  In the above example, the concealment target portion whose concealment level is “always concealed” is processed on the image forming apparatus 20 side, and the remote operation terminal 40 side is the image of the operation screen that has already been concealed. An example of receiving and displaying a message has been described. However, the present invention is not limited to the above example, and the mask for concealing the concealment target part is also concealed for the concealment target part whose concealment level is “always concealment” as in the case where the concealment level is “confirm every time”. An image is formed in the image forming apparatus 20, the operation screen image and mask image information are transmitted to the remote operation terminal 40, the mask image is synthesized with the operation screen on the remote operation terminal 40 side, and the concealment target portion May be concealed. In this case, in the remote operation terminal 40, it is necessary to determine whether the concealment level set for each display element is “always concealment”, “every concealment”, or “no concealment”.

DESCRIPTION OF SYMBOLS 10 Remote control system 20 Image forming apparatus 30 Network 40 Remote operation terminal 50 Office 60 User 70 Service center 80 Remote operator 201 Microprocessor 202 Memory 203 Memory | storage device 204 Display apparatus 205 Input apparatus 206 Communication interface 207 Image formation part 208 System bus 221 Communication control unit 222 Display control unit 223 Remote operation reception unit 224 Operation authority monitoring unit 225 Various operation execution units 401 CPU
402 Memory 403 Storage device 404 Communication interface 405 Display device 406 Input device 407 System bus 421, 421A Login unit 422, 422A Remote control unit 423A Display control unit 424A Concealment information determination unit

Claims (19)

Display means for displaying an operation screen;
A transmission means for transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When a remote operation that satisfies a preset condition is executed, an image of the operation screen is transmitted to the remote operation terminal using the transmission unit, while the operation screen is displayed to the display unit. Display control means for performing non-display control; and
An information processing apparatus comprising:   The display control means performs control to display an image different from the image of the operation screen transmitted to the remote operation terminal on the display means when a remote operation satisfying a preset condition is executed. The information processing apparatus according to claim 1 to be performed.   The display control unit is configured to transmit the operation screen to the remote operation terminal when a remote operation that is permitted only to a person having administrator authority is executed as a remote operation satisfying the preset condition. The information processing apparatus according to claim 2, wherein control is performed to display on the display means a screen that is different from the first image.   The display control means displays the image different from the image of the operation screen transmitted to the remote operation terminal during the period from the start to the end of the operation mode permitted only to those having administrator authority. The information processing apparatus according to claim 3, wherein display control is performed on the means.   The display control unit displays, on the display unit, an image in which the content of the operation screen transmitted to the remote operation terminal device is not visible when a remote operation satisfying a preset condition is executed. The information processing apparatus according to claim 1, wherein control for displaying is performed.   The display control unit is configured to transmit the operation screen to the remote operation terminal when a remote operation that is permitted only to a person having administrator authority is executed as a remote operation satisfying the preset condition. The information processing apparatus according to claim 5, wherein control is performed to display on the display means an image in which the contents of the image cannot be viewed.   The display control means is an image in which the content of the operation screen transmitted to the remote operation terminal is invisible during the period from the start to the end of the operation mode permitted only to a person having administrator authority. The information processing apparatus according to claim 6, wherein control is performed to display on the display means. A remote operation terminal having first display means for displaying an image of the received operation screen, and input operation means;
A second display means for displaying an operation screen;
A transmission unit that transmits an image of an operation screen displayed on the second display unit to the remote operation terminal when accepting a remote operation by the remote operation terminal;
When a remote operation satisfying a preset condition is executed, an image of the operation screen can be transmitted to the remote operation terminal, while the operation screen is displayed on the second display means An information processing apparatus having display control means for performing control,
With remote control system. In the computer constituting the information processing apparatus,
Displaying an operation screen on the display means;
A step of transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
A step of performing control not to display the operation screen on the display means while transmitting an image of the operation screen to the remote operation terminal when a remote operation satisfying a preset condition is executed. When,
A program that executes. Display means for displaying an operation screen;
A transmission means for transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When an operation for displaying the operation screen including the concealment target information on the display unit is executed, the concealment target information included in the operation screen is not displayed on at least one of the display unit and the remote operation terminal. An information processing apparatus comprising: display control means for performing display control of the image on the operation screen.   The display control unit prevents the concealment target information included in the operation screen from being displayed on the remote operation terminal when an operation for causing the display unit to display an operation screen including the concealment target information is performed. The information processing apparatus according to claim 10, wherein display control of the image on the operation screen is performed.   The display control means performs display control on the operation screen so that the concealment target information that is not displayed on the remote operation terminal becomes indistinguishable due to a different display state from the initial display state on the operation screen. The information processing apparatus according to claim 11.   When the display control unit performs an operation to display an operation screen including concealment target information on the display unit, display information other than the concealment target information included in the operation screen is displayed on the remote operation terminal. The information processing apparatus according to claim 10, wherein display control of an image of the operation screen is performed so that the operation screen is displayed.   The display control unit performs the display control when an operation for inputting the concealment target information is performed as an operation for displaying an operation screen including the concealment target information on the display unit. Information processing apparatus in any one of 13 thru | or 13. When the concealment target information included in the operation screen is not displayed on the remote operation terminal, a reception unit that accepts a concealment release instruction to display the concealment target information,
When the accepting unit accepts a concealment release instruction for concealment target information that is not displayed on the remote control terminal, the transmission unit transmits the instruction to release the concealment of the concealment target information, thereby the concealment target information The information processing apparatus according to claim 10, wherein the information is displayed. The display control means generates concealment instruction information for concealing the concealment target information and makes it transmittable together with the image of the operation screen.
When the concealment release instruction for the concealment target information is received by the accepting unit, the display control unit generates concealment release information for canceling the concealment of the concealment target information,
The information processing apparatus according to claim 15, wherein the transmission unit transmits the concealment release information to the remote control terminal device so that the concealment target information can be displayed.   The information processing apparatus according to claim 15 or 17, wherein the display control unit changes the concealment target information from a display state different from an initial display state according to a concealment degree set in advance for each concealment target information. A remote operation terminal having first display means for displaying an image of the received operation screen, and input operation means;
A second display means for displaying an operation screen;
A transmission unit that transmits an image of an operation screen displayed on the second display unit to the remote operation terminal when accepting a remote operation by the remote operation terminal;
When an operation for displaying the operation screen including the concealment target information on the second display unit is performed, the concealment target information included in the operation screen includes at least the first display unit and the second display unit. A remote control system comprising: an information processing apparatus having display control means for performing display control of an image of the operation screen so as not to be displayed on any one of the display means. In the computer constituting the information processing apparatus,
Displaying an operation screen on the display means;
A step of transmitting an image of an operation screen displayed on the display means to the remote operation terminal when accepting a remote operation by an external remote operation terminal;
When an operation for displaying an operation screen including concealment target information on the display unit is performed, the concealment target information included in the operation screen is at least in one of the display unit and the remote operation terminal. And a step of performing display control of the image of the operation screen so as not to be displayed.

Images