JP2024059615A - Information processing device, remote control system, and program - Google Patents

Abstract

[Problem] When remotely operating an information processing device while sharing and displaying the operation screen of the information processing device on the display device of a remote control terminal that remotely operates the information processing device, the present invention prevents information to be concealed that is included in the operation screen that is displayed when performing a specific process from being identified on the remote control terminal side.
[Solution] The information processing device 10 comprises a display means 204 for displaying an operation screen, a transmission means 221 for transmitting an image of the operation screen displayed on the display means 204 to the remote control terminal 40 when remote control is accepted from an external remote control terminal, and a display control means 222 for controlling the display of the image of the operation screen so that the information to be concealed included in the operation screen is not displayed on the remote control terminal 40 when an operation is executed to display an operation screen including information to be concealed on the display means 204.
[Selected Figure] Figure 1

Description

The present invention relates to an information processing device, a remote control system, and a program.

Patent document 1 discloses a screen sharing method in which, when multiple devices share the same screen, if unsendable information is recognized among the information displayed on the screen, the application related to that information is closed, the application is iconized, or other image information is drawn on the icon so that the information is not sent.

JP 2011-060000 A

The present invention aims to prevent information to be concealed, which is included in the operation screen displayed when performing a specific process, from being identified on the remote control terminal side when remotely controlling an information processing device while the operation screen of the remotely controlled information processing device is shared and displayed on the display device of the remote control terminal that remotely controls the information processing device.

An information processing device according to a first aspect includes:
a transmission means for transmitting an image of an operation screen to be displayed on the display means to an external remote control terminal when the remote control terminal receives remote control;
The device further includes a display control means for controlling the display of an image of the operation screen so that, when an operation is executed to display an operation screen including information to be concealed on the display means, the information to be concealed included on the operation screen is not displayed on the remote control terminal.

In the information processing device according to the second aspect, in the information processing device according to the first aspect, the display control means performs display control so that the information to be concealed that is not displayed on the remote control terminal becomes indistinguishable on the operation screen by changing its display state from the initial display state on the operation screen.

In the information processing device according to the third aspect, when an operation is performed to cause the display means to display an operation screen including information to be concealed, the display control means controls the display of the image of the operation screen so that display information other than the information to be concealed included in the operation screen is displayed on the remote control terminal.

In the information processing device according to the fourth aspect, in the information processing device according to any one of the first to third aspects, the display control means performs the display control when an operation to input information to be concealed is to be executed as an operation to cause the display means to display an operation screen including information to be concealed.

The information processing device according to the fifth aspect is an information processing device according to any one of the first to fourth aspects, and includes a receiving means for receiving an unconcealment instruction to display the concealment target information when the concealment target information included in the operation screen is not displayed on the remote control terminal, and when the receiving means receives an unconcealment instruction for the concealment target information that is not displayed on the remote control terminal, the transmission means transmits an instruction to unconceal the concealment of the concealment target information, thereby making the concealment target information displayable.

In the information processing device according to the sixth aspect, in the information processing device according to the fifth aspect, the display control means generates concealment instruction information for concealing the information to be concealed and makes it possible to transmit the information together with the image of the operation screen, and when the reception means receives an instruction to unconceal the information to be concealed, the display control means generates unconcealment information for unconcealing the information to be concealed, and the transmission means transmits the unconcealment information to the remote operation terminal, making it possible to display the information to be concealed.

In the information processing device according to the seventh aspect, in the information processing device according to the fifth or sixth aspect, the display control means changes the display state of the information to be concealed from the initial display state according to the degree of concealment preset for each piece of information to be concealed.

An information processing device according to an eighth aspect includes:
a remote control terminal having a first display means for displaying an image of the received operation screen and an input operation means;
a transmitting means for transmitting an image of an operation screen to be displayed on a second display means to the remote control terminal when the remote control terminal receives a remote operation;
The present invention provides a remote control system comprising: an information processing device having a display control means for controlling the display of an image of an operation screen so that, when an operation is performed to display an operation screen including information to be concealed on the second display means, the information to be concealed included on the operation screen is not displayed on the second display means.

An information processing device according to a ninth aspect includes:
A computer constituting an information processing device includes:
transmitting an image of an operation screen to be displayed on the display means to an external remote control terminal when the remote control is accepted;
When an operation is performed to display an operation screen including information to be concealed on the display means, the program executes a step of controlling the display of an image of the operation screen so that the information to be concealed included in the operation screen is not displayed on the remote control terminal.

According to the first aspect, when remotely operating an information processing device while sharing and displaying an operation screen of the remotely operated information processing device on a display device of a remote control terminal that remotely controls the information processing device, it is possible to provide an information processing device that prevents information to be concealed that is included in the operation screen displayed when performing a specific process from being identified on the remote control terminal side.

According to the second aspect, it is possible to prevent the information to be concealed that is included in the operation screen from being identified on the remote control terminal side.

According to the third aspect, it is possible to prevent information to be concealed that is included in the operation screen from being identified on the remote control terminal side.

According to the fourth aspect, when an operation to input information to be concealed is attempted, the information to be concealed contained in the operation screen can be prevented from being identified on the remote control terminal side.

According to the fifth aspect, when an instruction to unconceal is input on either the information processing device side or the remote control terminal side, it is possible to make it possible to identify the information to be concealed that has been instructed to be unconcealed on the remote control terminal side.

According to the sixth aspect, when an instruction to remove concealment is input, the information to be concealed can be identified on the remote control terminal side by simply sending the instruction to remove concealment without sending any information related to the information to be concealed.

According to the seventh aspect, it becomes possible to determine the degree of concealment of each piece of information on the information processing device side and the remote control terminal side.

According to the eighth aspect, when remotely controlling an information processing device while the operation screen of the remotely controlled information processing device is shared and displayed on the display device of the remote control terminal that remotely controls the information processing device, it is possible to provide a remote control system that prevents information to be concealed that is included in the operation screen displayed when performing a specific process from being identified on the remote control terminal side.

According to the ninth aspect, when remotely operating an information processing device while sharing and displaying an operation screen of the remotely operated information processing device on a display device of a remote control terminal that remotely controls the information processing device, it is possible to provide a program that operates a computer of the information processing device so as to prevent information to be concealed that is included in the operation screen displayed when performing a specific process from being identified on the remote control terminal side.

1 is a schematic diagram illustrating an example of a remote control system 10 according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a hardware configuration of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram of an image forming apparatus 20 according to an embodiment of the present invention. FIG. 2 is a hardware configuration diagram of a remote control terminal 40 according to an embodiment of the present invention. FIG. 2 is a functional block diagram of a remote control terminal 40 according to an embodiment of the present invention. 5 is a flowchart showing a flow of operations of the image forming apparatus 20 when the image forming apparatus 20 is remotely controlled by the remote control terminal 40 in one embodiment of the present invention. FIG. 7 is a diagram showing an example of an operation screen 700 displayed on the display device 204 during normal operation of the image forming apparatus 20 according to an embodiment of the present invention. FIG. 8 is a diagram showing an example of a remote operation request screen 800 displayed on the display device 204 of the image forming apparatus 20 according to an embodiment of the present invention. In one embodiment of the present invention, a figure showing an example of a screen 900 (FIG. 9(A)) displayed on the display device 204 of the image forming apparatus 20 and an example of an operation screen 950 (FIG. 9(B)) displayed on the display device 405 of the remote control terminal 40 when remote operation by the remote control terminal 40 is an operation that satisfies preset conditions. In one embodiment of the present invention, a diagram showing an example of a screen 1000 ( FIG. 10(A) ) displayed on the display device 204 of the image forming apparatus 20 and an example of an operation screen 1050 ( FIG. 10(B) ) displayed on the display device 405 of the remote control terminal 40 when remote operation by the remote control terminal 40 does not satisfy a preset condition. FIG. 11 is a functional block diagram of a remote control terminal 40 according to a second embodiment of the present invention. 10 is a flowchart showing the flow of operations of an image forming apparatus 20 according to a second embodiment of the present invention. 13 is a flowchart showing the flow of operations of an image forming apparatus 20 according to a second embodiment of the present invention, continuing on from parts "B" and "D" in FIG. 12. 14 is an example of a destination selection screen 1400 displayed on the display device 204 of the image forming apparatus 20. 15 is an example of a detailed information display screen 1500 displayed on the display device 204 of the image forming apparatus 20. 16 is an example of a detailed information display screen 1600 after concealment processing, which is displayed on the display device 204 of the image forming apparatus 20. 17 is an example of a masked detailed information display screen 1700 displayed on the display device 204 of the image forming apparatus 20. 18 is an example of a permission confirmation screen 1800 displayed on the display device 204 of the image forming apparatus 20. 10 is a flowchart showing a flow of operations of a remote control terminal 40 according to the second embodiment. 21 is an example of a concealment release non-permission screen 2100 displayed on the display device 405 of the remote control terminal 40 in the second embodiment. 13 is a flowchart showing the flow of operations of an image forming apparatus 20 according to a third embodiment. 22 is an example of a concealment release confirmation screen 2200 displayed on a display device 204 of an image forming apparatus 20 in the third embodiment. 13 is a flowchart showing a flow of operations of a remote control terminal 40 according to the third embodiment. FIG. 24 is a diagram showing an example of a prior confirmation screen 2400 displayed on a display device 204 of an image forming apparatus 20 in the fourth embodiment.

[First embodiment]
An embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a schematic diagram showing an example of a remote control system 10 of the present embodiment. As shown in Fig. 1, the remote control system 10 includes an image forming apparatus 20 and a remote operation terminal 40 connected to the image forming apparatus 20 via a network 30.

The image forming device 20 is installed, for example, in a customer's office 50, and is used by a user 60 who normally works in the office 50. On the other hand, the remote control terminal 40 is installed, for example, in a service center 70 operated by a management company of the image forming device 20, and is operated by an operator/service engineer (remote operator 80). When a malfunction occurs or when the user 60 wants to request a desired operation, the user 60 contacts the service center by operating the operation panel (described later) of the image forming device 20 or by making a phone call, and the operator/service engineer remotely operates the image forming device 20 from the remote control terminal 40 and performs the required operation.

Figure 2 shows the hardware configuration of the image forming device 20. The image forming device 20 includes a control microprocessor 201, a memory 202, a storage device 203, a display device 204, an input device 205, a communication interface 206, and an image forming unit 207, and is connected to a system bus 208.

The control microprocessor 201 controls and manages the operation of each part of the image forming device 20 by executing a control program stored in the storage device 203.

The memory 202 temporarily stores print image data printed by the image forming unit 207 of the image forming device 20, remote control information transmitted from the remote control terminal 40, image data of the operation screen to be transmitted to the remote control terminal 40, etc.

The storage device 203 is composed of a hard disk drive (HDD) or a solid state drive (SDD), and stores a control program for controlling each part of the image forming device 20, image data of the operation screen displayed on the display device 204, operation authority information, and various setting values, such as print density and paper settings.

The display device 204 displays the image of the operation screen of the image forming device 20 and is composed of a liquid crystal display.

The input device 205 is configured with a touch panel arranged on the display device 204, and the user 60 can select the operation to be performed or input the necessary information by touching the screen while viewing the operation screen displayed on the display device 204. The display device 204 and the input device 205 constitute the operation panel of the image forming device 20 of this embodiment, and may be arranged in the same place, such as a liquid crystal display and a touch panel arranged on its upper surface as described above, or may be arranged in separate places, such as a liquid crystal display and keys and buttons arranged adjacent to it.

The communication interface 206 performs communication control to connect and communicate between the image forming device 20 and the remote control terminal 40 via the network 30.

The image forming unit 207 includes an image reading device and a printing device (neither shown). The image reading device is a scanner for reading images on a medium such as paper. The printing device prints the image read by the image reading device onto another medium such as paper, but a detailed description of the configuration of these devices will be omitted.

Next, the functional configuration of the image forming device 20 of this embodiment will be described with reference to FIG. 3. FIG. 3 is a functional block diagram of the image forming device 20 of this embodiment. By executing a control program stored in the storage device 203 of the image forming device 20 in the control microprocessor 201, the image forming device 20 functions as a communication control unit 221, a display control unit 222, a remote operation receiving unit 223, an operation authority monitoring unit 224, and a various operation execution unit 225, as shown in FIG. 3.

The communication control unit 221 receives remote control information transmitted from the remote control terminal 40 and temporarily stores the information in the memory 202. When the remote control terminal 40 accepts remote control, the communication control unit 221 transmits to the remote control terminal 40 image data of an operation screen displayed on the input device 205 of the image forming apparatus 20, or image data of an operation screen generated by the display control unit 222 (described later) in response to the remote control of the remote control terminal 40.

When the user 60 operates the input device 205, the display control unit 222 generates an operation screen corresponding to the operation and displays it on the display device 204. When the image forming device 20 is remotely operated by the remote operation terminal 40, the display control unit 222 generates image data of the operation screen to be displayed on the display device 204 in response to remote control information transmitted from the remote operation terminal 40. Alternatively, when the input device 205 is operated by the remote operation acceptance unit 223 described later, the display control unit 222 generates image data of the operation screen to be displayed on the display device 204 in response to the operation.

Furthermore, when this remote operation is being executed, the display control unit 222 determines whether the remote operation satisfies a preset condition, and when a remote operation that satisfies the preset condition is executed, the display control unit 222 transmits an image of the generated operation screen to the remote operation terminal 40 via the communication control unit 221, while controlling the display device 204 not to display the image of the operation screen generated in response to the remote operation.

Specifically, when a remote operation that satisfies a preset condition is executed, the display control unit 222 controls the display device 204 to display an image different from the image of the operation screen. For example, the display control unit 222 acquires image data of an alternative screen stored in the storage device 203 and displays it on the display device 204. Alternatively, the display control unit 222 may control the display device 204 to display an image that makes the contents of the operation screen transmitted to the remote operation terminal 40 invisible when a remote operation that satisfies a preset condition is executed.

Note that a remote operation that satisfies a preset condition refers to a case where a remote operation that is permitted only to a person with administrator authority is executed. For example, this includes the processing from when a person with administrator authority logs in to the administrator authority mode of the image forming device 20 until he or she logs out. In this case, the display control unit 222 controls the display device 204 to display a screen different from the image of the operation screen transmitted to the remote operation terminal 40, or controls the display device 204 to display an image in which the contents of the operation screen transmitted to the remote operation terminal 40 are not visible. Note that these controls are executed from the start to the end of the operation mode that is permitted only to a person with administrator authority.

When the user 60 operates the input device 205 and selects an operation to request remote operation, the remote operation acceptance unit 223 transmits a remote operation request to the remote operation terminal 40 via the communication control unit 221. Then, it receives login information transmitted from the remote operation terminal 40, and if the login information is correct, it makes the remote operation of its own device by the remote operation terminal 40 available for acceptance. Furthermore, when accepting remote operation, the remote operation acceptance unit 223 interprets the remote control information transmitted from the remote operation terminal 40, and operates the input device 205 according to that information.

The operation authority monitoring unit 224 monitors the operation of the input device 205 by the user 60 or the operation of the input device 205 performed by the remote operation receiving unit 223, and judges whether the operation is permitted only to a person having administrator authority. If the operation authority monitoring unit 224 judges that the operation is permitted only to the user 60 who requires administrator authority, it notifies the display control unit 222 to display an authentication request screen. It also authenticates the authentication information input directly or remotely via the input device 205 by the user 60 or the remote operator 80 who operates the remote operation terminal 40, and if the authentication information is correct, it transitions the operation mode of the image forming apparatus 20 to the administrator authority mode and notifies the display control unit 222 that the operation mode has been transitioned to the administrator authority mode. In addition, when an operation is performed by the user 60 or the remote operator 80 to exit the administrator authority mode, the operation authority monitoring unit 224 transitions the operation mode of the image forming apparatus 20 from the administrator authority mode to the normal mode, and notifies the display control unit 222 that the administrator authority mode has been terminated and the operation mode has been transitioned to the normal mode. Note that the operation authority monitoring unit 224 may be configured to consider the transition to administrator authority mode as occurring from the time the authentication request screen is displayed.

When the input device 205 is operated directly by the user 60 or indirectly by remote operation by the remote operator 80, the various operation execution unit 225 executes various functions according to the operation. These functions include, for example, scanning an image, copying an image, changing various setting values of the image forming device 20 (e.g., print density, paper settings, etc.), updating the firmware of the image forming device, adding menus, adding application programs, etc.

Next, the remote control terminal 40 constituting the remote control system 10 of this embodiment will be described with reference to Figures 4 and 5. Note that Figure 4 is a diagram showing the hardware configuration of the remote control terminal 40. As shown in Figure 4, the remote control terminal 40 includes a CPU 401, a memory 402, a storage device 403, a communication interface 404, a display device 405, and an input device 406, each of which is connected to a system bus 407.

The CPU 401 controls the operation of each part of the remote control terminal 40 based on the control program stored in the storage device 403.

The memory 402 temporarily stores image data of the operation screen of the image forming device 20 received by the remote operation terminal 40 and information on the remote operation request. The memory 402 also temporarily stores remote control information generated by a remote control unit described later.

The storage device 403 is composed of a hard disk drive (HDD) or a solid state drive (SDD), and stores control programs for controlling each part of the remote control terminal 40 and application programs for remotely controlling the image forming device 20.

The communication interface 404 performs communication control to connect the remote control terminal 40 and the image forming device 20 via the network 30 and communicate with each other.

The display device 405 is a liquid crystal monitor that displays a screen for a remote operation request sent from the image forming device 20, a connection setting screen for starting remote operation, and image data for an operation screen generated in the image forming device 20 when the image forming device 20 is being remotely operated from this remote operation terminal 40.

The input device 406 is a keyboard, a mouse, and a touch pad. The remote operator 80 operates these input devices 406 while visually checking the image displayed on the display device 405, thereby connecting the remote control terminal 40 to the image forming device 20 and remotely operating the image forming device 20.

Figure 5 is a functional block diagram of the remote control terminal 40. As shown in Figure 5, the remote control terminal 40 functions as a login unit 421 and a remote control unit 422 by executing a control program stored in the storage device 403 in the CPU 401.

When the login unit 421 receives a remote operation request sent from the image forming device 20, it displays a login screen on the display device 405 of the user interface and requests the remote operator 80 to input login information, and when login information is input by the input device 406, it transmits the login information to the image forming device 20.

The remote control unit 422 remotely controls the image forming device 20 using the input device 406, and generates remote control information, such as which location on the input device 205 of the image forming device 20 was selected or what characters were input, in response to the operation of the input device, and transmits this information to the image forming device 20 via the network 30.

Next, the flow of operations in the image forming device 20 of the remote control system 10 of this embodiment will be described with reference to FIG. 6. FIG. 6 is a flowchart showing the flow of operations in the image forming device 20 when remotely controlled by the remote control terminal 40.

In step S601, the image forming device 20 accepts normal operations by the user 60. This normal operation includes, for example, when the user 60 operates the input device 205 while visually checking the operation screen displayed on the display device 204 of the image forming device 20, the display control unit 222 generates an image of an operation screen corresponding to the operation and displays it on the display device 204, and the various operation execution unit 225 executes various operations corresponding to the operation. In addition, normal operations include, for example, scanning an image, copying an image, and changing various setting values of the image forming device 20 (for example, print density, paper settings, etc.).

Here, FIG. 7 is a diagram showing an example of an operation screen 700 displayed on the display device 204 during normal operation of the image forming device 20. The operation screen 700 displays a plurality of menus, such as icons 710 for "image scanning," "copying," and "settings." When the user 60 of the image forming device 20 selects the icon 710 for the desired menu while visually checking the operation screen 700 displayed on the display device 204, the various operation execution unit 225 executes the function corresponding to the selected menu, that is, scanning an image, copying an image, changing various setting values of the image forming device 20 (for example, print density, paper settings, etc.). The operation screen 700 also displays a menu icon 720 for "remote operation request," which will be described later.

In step S602, the remote operation acceptance unit 223 judges whether or not the user 60 has operated the input device 205 to make a remote operation request to the remote operation terminal 40. If it is judged that a remote operation request has not been made, the process returns to step S601, where normal operations are continued to be accepted and the corresponding processing is continued. On the other hand, if it is judged in step S602 that a remote operation request has been made, the process proceeds to step S603.

Here, FIG. 8 is a diagram showing an example of a remote operation request screen 800 displayed on the display device 204 of the image forming device 20. This remote operation request screen 800 may be generated and displayed by the instruction and display control unit 222 of the remote operation acceptance unit 223 when the user 60 of the image forming device 20 selects the "remote operation request" menu icon 720 from the menu in FIG. 7, or may be automatically displayed on the operation screen when an error or the like occurs during normal operation by the user 60 of the image forming device 20, or may be displayed on the display device 204 by displaying a "remote operation request" icon on the operation screen when an error occurs and selecting it by the user 60.

As shown in FIG. 8, the remote operation request screen 800 displays a confirmation message 810 such as "Connect to the service center and request remote operation. Are you sure?", an "Agree" icon 820, and a "Cancel" icon 830. If the user 60 selects the "Agree" icon 820, the process proceeds to step S603 in FIG. 6. If the user 60 selects the "Cancel" icon 830, the process returns to step S601 in FIG. 6.

In step S603, the remote operation receiving unit 223 transmits a remote operation request to the remote operation terminal 40 via the communication control unit 221. When the remote operation terminal 40 receives this remote operation request, the login unit 421 of the remote operation terminal 40 displays a login screen on the display device 405 of the user interface and requests the remote operator 80 to input login information. When the remote operator 80 inputs login information by operating the input device 406, the login information is transmitted to the image forming apparatus 20.

In step S604, the remote control acceptance unit 223 of the image forming device 20 authenticates the login information received from the remote control terminal 40, and if the login information is correct, makes the image forming device ready to accept remote control from the remote control terminal 40.

In step S605, the remote operation acceptance unit 223 determines whether or not to end the remote operation of the image forming apparatus 20 by the remote operation terminal 40. Specifically, when a logout process request transmitted from the login unit 421 of the remote operation terminal 40 is received, the remote operation acceptance unit 223 determines to end the remote operation. When the remote operation acceptance unit 223 determines to end the remote operation, the process proceeds to step S606. In step S606, the remote operation acceptance unit 223 makes it impossible to accept remote operation of the image forming apparatus 20 by the remote control unit 422 of the remote operation terminal 40, returns to step S601, and accepts normal operation by the user 60 of the image forming apparatus 20. When the remote operation acceptance unit 223 determines in step S605 that the remote operation of the image forming apparatus 20 by the remote operation terminal 40 will not end, the process proceeds to step S607.

In step S607, the display control unit 222 of the image forming device 20 generates an image of an operation screen. The image of the generated operation screen is an image of an operation screen corresponding to the operation performed when the remote operation receiving unit 223 of the image forming device 20 operates the input device 205 in response to the remote control information transmitted from the remote control unit 422 of the remote operation terminal 40.

In step S608, the communication control unit 221 transmits image data of the operation screen generated by the display control unit 222 to the remote control terminal 40. When the image data of the operation screen is received by the remote control terminal 40, the remote control unit 422 displays the received image data of the operation screen on the display device 405.

In step S609, the remote operator 80 who is operating the remote control terminal 40 remotely operates the input device 205 of the image forming device 20 by operating the input device 406 while visually checking the image displayed on the display device 405.

In step S610, the display control unit 222 judges whether the remote operation of the input device 205 by the remote operation terminal 40 satisfies a preset condition. It is assumed that the preset condition is stored in the storage device 203 of the image forming device 20. The remote operation that satisfies the preset condition includes, for example, an operation that is permitted only to a person with administrator authority, specifically, a process from logging in to the administrator authority mode of the image forming device 20 to logging out. At this time, the operation authority monitoring unit 224 of the image forming device 20 monitors the remote operation of the input device 205 and judges whether the operation is an operation that is permitted only to a person with administrator authority (a processing operation during login). If the operation satisfies the preset condition, the process proceeds to step S611, and if the operation does not satisfy the preset condition, the process proceeds to step S612.

In step S611 (i.e., when the remote operation satisfies a predetermined condition), the display control unit 222 prevents the image data of the generated operation screen from being displayed on the display device 204 of the image forming device 20. Instead, the display control unit 222 acquires image data of the substitute image stored in the storage device 203 and displays it on the display device 204. Therefore, at this time, the screen displayed on the display device 204 of the image forming device 20 and the screen displayed on the display device 405 of the remote operation terminal 40 will be different. Alternatively, the image data may be subjected to image processing to make the operation screen invisible, and the image data of the operation screen processed to make it invisible may be displayed on the display device 204. Specifically, the operation screen may be subjected to mosaic processing or blurring processing to process it into an image that is invisible. Thereafter, the process returns to step S605, and the processes of steps S605 to S611 or steps S605 to S612 are performed until the remote operation of the image forming device 20 by the remote operation terminal 40 is completed.

9A and 9B are diagrams showing an example of a screen 900 (FIG. 9A) displayed on the display device 204 of the image forming device 20 when the display control unit 222 judges that the remote operation performed by the remote control terminal 40 is an operation that satisfies a preset condition, and an example of an operation screen 950 (FIG. 9B) displayed on the display device 405 of the remote control terminal 40. As shown in FIG. 9A, the screen 900 displayed on the display device 204 of the image forming device 20 displays a message 910 saying "Currently being remotely operated by an operator at the service center." The user 60 who was directly operating the image forming device 20 cannot see through the display device 204 of the image forming device 20 what specific operation is being performed on the image forming device 20 by the remote control terminal 40. On the other hand, as shown in FIG. 9B, an operation screen 950 that is not displayed on the display device 204 of the image forming device 20 is displayed on the display device 405 of the remote control terminal 40, and the remote operator 80 who operates the remote control terminal 40 can view this operation screen 950 and perform operations that are permitted only to those with administrator authority, such as updating firmware, adding menus, and adding new applications.

If the display control unit 222 determines in step S610 that the remote operation by the remote control terminal 40 does not satisfy the preset conditions, the process proceeds to step S612, where the display control unit 222 displays image data of the generated operation screen on the display device 204 of the image forming device 20. At this time, the operation screen displayed on the display device 204 of the image forming device 20 and the operation screen displayed on the display device 405 of the remote control terminal 40 are the same. Thereafter, the process returns to step S605, and the processes of steps S605 to S611 or steps S605 to S612 are repeated until the remote operation of the image forming device 20 by the remote control terminal 40 is completed.

Here, FIG. 10 shows an example of a screen 1000 (FIG. 10(A)) displayed on the display device 204 of the image forming device 20 when the display control unit 222 determines that the remote operation performed by the remote operation terminal 40 is not an operation that satisfies the preset conditions, and an example of an operation screen 1050 (FIG. 10(B)) displayed on the display device 405 of the remote operation terminal 40. As shown in FIG. 10(A), the screen 1000 displayed on the display device 204 of the image forming device 20 displays, for example, settings regarding paper feed and ejection and settings regarding print quality.

Also, as shown in FIG. 10(B), the display device 405 of the remote control terminal 40 displays an operation screen 1050 similar to that displayed on the display device 204 of the image forming device 20, and the remote operator 80 who operates the remote control terminal 40 can view this operation screen 1050 and perform operations that are permitted to persons other than those with administrator authority, such as changing various setting values such as print density and paper settings.

In the above embodiment, an image forming device is described as an example of an information processing device remotely operated by a remote control terminal, but the present invention is not limited to this embodiment and can be applied to other information processing devices equipped with a display device and an input device, such as personal computers and other industrial machines.

In these information processing devices, as described in the above embodiment, when the information processing device is remotely operated by a remote control terminal, the actual operation screen is not visible on the display device of the information processing device while an operation that satisfies a preset condition, such as an administrator authority mode that is permitted only to a person with administrator authority, is being performed.

In the above embodiment, the preset conditions are described as being stored in the storage device 203 of the image forming device 20. However, the conditions may be set and stored in the remote control terminal 40, and the image forming device 20 may be notified when an operation that satisfies the conditions is performed.

Furthermore, in the above embodiment, the process from logging in to the administrator authority mode of the image forming device 20 to logging out has been described as a pre-set condition, but the above pre-set condition may also include a process in which a login screen is displayed to input an administrator ID, password, etc., when a remote operator attempts to log in.

[Second embodiment]
Next, a second embodiment of the present invention will be described with reference to Figures 11 to 21. Note that, compared to the remote control system 10 of the first embodiment, the remote control system 10 of the second embodiment has the same configuration except for the function of the remote operation terminal 40, so the same components will be described using the same reference numerals, and detailed description of the components will be omitted.

Fig. 11 is a functional block diagram of a remote control terminal 40 in the second embodiment of the present invention. As shown in Fig. 11, the remote control terminal 40 functions as a login unit 421A, a remote control unit 422A, a display control unit 423A, and a hidden information determination unit 424A by executing a control program stored in a storage device 403 in a CPU 401.

When the login unit 421A receives a remote operation request sent from the image forming device 20, it displays a login screen on the display device 405 of the user interface and requests the remote operator 80 to input login information, and when login information is input by the input device 406, it transmits the login information to the image forming device 20.

The remote control unit 422A remotely controls the image forming device 20 using the input device 406, and generates remote control information, such as which location on the input device 205 of the image forming device 20 was selected or what characters were input, in response to the operation of the input device, and transmits this information to the image forming device 20 via the network 30.

The display control unit 423A performs image control to display the image of the operation screen transmitted from the image forming device 20 on the display device 405 of the remote operation terminal 40. Furthermore, when the display control unit 423A receives mask information from the image forming device 20, as described below, it composites a mask image onto the image of the operation screen in accordance with the mask information and displays it on the display device 405. Furthermore, when an instruction to remove the concealment is given, it performs image control to remove the mask image.

The concealed information determination unit 424A determines whether or not concealed information is included in the image of the operation screen received from the image forming device 20, or the concealment level set for the information to be concealed. It also determines whether or not the display portion of the concealed information to be concealed has been selected by the remote operator 80.

12 and 13 are flow charts showing the flow of operations of the image forming apparatus 20 in the second embodiment, and FIG. 13 is a part following the parts "B" and "D" in FIG. 12. In step S1201, the image forming apparatus 20 accepts normal operations by the user 60. This normal operation includes, for example, when the user 60 operates the input device 205 while visually checking an operation screen (for example, the operation screen 700 as shown in FIG. 7 described in the first embodiment) displayed on the display device 204 of the image forming apparatus 20, the display control unit 222 generates an image of the operation screen according to the operation and displays it on the display device 204, and the various operation execution unit 225 executes various operations according to the operation. In addition, the normal operation includes, for example, scanning an image, copying an image, and changing various setting values of the image forming apparatus 20 (for example, print density, paper setting, etc.).

In step S1202, the remote operation acceptance unit 223 judges whether or not the user 60 has operated the input device 205 to make a remote operation request to the remote operation terminal 40. If it is judged that a remote operation request has not been made, the process returns to step S1201, where normal operations are continued to be accepted and the corresponding processing is continued. On the other hand, if it is judged in step S1202 that a remote operation request has been made, the process proceeds to step S1203.

The remote operation request screen displayed on the display device 204 of the image forming device 20 is generated and displayed by the instruction and display control unit 222 of the remote operation acceptance unit when the "remote operation request" menu icon 720 is selected from the menu of FIG. 7 described in the first embodiment above, and is similar to that shown in FIG. 8, so detailed description will be omitted. When the user 60 selects the "Agree" icon 820 on the remote operation request screen 800 in FIG. 8, the process proceeds to step S1203, where the remote operation acceptance unit 223 transmits a remote operation request to the remote operation terminal 40 via the communication control unit 221.

In step S1204, the remote control acceptance unit 223 of the image forming device 20 authenticates the login information received from the remote control terminal 40, and if the login information is correct, makes the image forming device 20 in a state in which it can accept remote control from the remote control terminal 40.

In step S1205, the remote operation acceptance unit 223 judges whether or not to end the remote operation of the image forming apparatus 20 by the remote operation terminal 40. Specifically, when a logout process request transmitted from the login unit 421 of the remote operation terminal 40 is received, the remote operation acceptance unit 223 judges to end the remote operation. When the remote operation acceptance unit 223 judges to end the remote operation, the process proceeds to step S1206. In step S1206, the remote operation acceptance unit 223 makes it impossible to accept remote operation of the image forming apparatus 20 by the remote control unit 422A of the remote operation terminal 40, and returns to step S1201 ((A) of FIG. 12), and accepts normal operation by the user 60 of the image forming apparatus 20. When the remote operation acceptance unit 223 judges that the remote operation of the image forming apparatus 20 by the remote operation terminal 40 will not end in step S1205, the process proceeds to step S1207.

In step S1207, the display control unit 222 of the image forming device 20 generates an image of an operation screen. The generated image of the operation screen is an image of an operation screen corresponding to the operation when the remote operation receiving unit 223 of the image forming device 20 operates the input device 205 in response to remote control information transmitted from the remote control unit 422 of the remote operation terminal 40. For example, a destination selection screen 1400 as shown in FIG. 14 is generated. FIG. 14 is an example of a destination selection screen 1400 displayed on the display device 204 of the image forming device 20 when the user 60 operates the input device 205 of the image forming device 20 and selects, for example, the "image scan" icon 710 as shown in FIG. 7 and icons such as "email send" and "destination selection" (not shown).

The destination selection screen 1400 is composed of a confirmation message 1410 saying "Please select an email destination," and a destination list display field 1420. The destination list display field 1420 is composed of multiple destination display fields 1420A, 1420B, etc., each of which displays multiple destinations stored in the storage device 203 of the image forming device 20. Each destination includes a registration number such as "0001" or "0002," and a destination name such as "XX Co., Ltd." or "△△ Trading." In addition, each destination display field 1420A, 1420B includes a detailed display icon 1430A, 1430B, etc. (hereinafter, collectively referred to as 1430).

In step S1208, the display control unit 222 extracts the display elements included in the operation screen generated in step S1207. Here, the display elements refer to the individual elements that make up the operation screen, and in the case of the destination selection screen 1400 in FIG. 14, for example, the display elements are the confirmation message 1410, the destination list display field 1420, the detailed display icon 1430, and the like.

In step S1209, the display control unit 222 determines whether the extracted display elements include information to be concealed. It is assumed that which display elements correspond to the information to be concealed is set in advance by the user 60 or the administrator of the image forming device 20 and stored in the storage device 203. The display control unit 222 extracts the name of the extracted display element and determines whether the name corresponds to the previously set display element. For example, in this second embodiment, it is assumed that the information of the telephone number itself is set as the information to be concealed. In the case of the destination selection screen 1400 shown in FIG. 14, since the display element of the telephone number is not included, it is determined that the information to be concealed is not included, and the process proceeds to step S1210.

In step S1210, the display control unit 222 displays the image of the operation screen generated in step S1207 (here, the image of the destination selection screen 1400) on the display device 204 of the image forming device 20, and the communication control unit 221 transmits the image of the operation screen to the remote control terminal 40, and the process proceeds to step S1217.

If it is determined in step S1209 above that the extracted display elements contain information to be concealed, the process proceeds to step S1211. For example, when the detailed display icon is selected in FIG. 14 above, a detailed information display screen 1500 as shown in FIG. 15 is generated. The detailed information display screen 1500 is composed of a destination name display field 1510, an email address display field 1520, a telephone number display field 1530, and an affiliation display field 1540. Since the display elements of this detailed information display screen 1500 contain telephone numbers, it is determined in step S1209 that the detailed information display screen 1500 contains information to be concealed. Note that at this point, the image of the detailed information display screen 1500 is not displayed on the display device 204 of the image forming device 20.

In step S1211, the display control unit 222 determines the concealment level set for the information to be concealed included in the operation screen. Here, the concealment level is set by the administrator or user 60 of the image forming device 20 for personal information such as email addresses, telephone numbers, addresses, and passwords, and confidential information such as the host name, IP address, user information related to authentication, and job memory of the host computer to which the image forming device 20 is connected, and is a level that indicates the degree to which the information is to be concealed from the remote operation terminal 40. For example, in the second embodiment, the concealment level has three levels: "always concealed," "check each time," and "not concealed." For example, in the second embodiment, the information on the telephone number is set to one of the concealment levels "always concealed" and "check each time." Note that the concealment level "not concealed" is executed as a process when the information to be concealed is not included in step S1209 above, so in the following description, the process when the concealment level is "always concealed" and "check each time" will be described.

If it is determined in step S1211 that the concealment level of the information to be concealed is "always concealed", the process proceeds to step S1212, where the display control unit 222 generates a concealed detailed information display screen 1600 in which image processing has been performed so that the information to be concealed is not displayed, as shown in FIG. 16. As shown in FIG. 16, the concealed detailed information display screen 1600 includes a concealed portion 1610 in which the portion of the telephone number information for which the concealment level is set to "always concealed" is in a different display state from the initial display state on the detailed information display screen 1600, making it impossible to distinguish. The concealed portion 1610 is processed by performing a process such as a shading process, a filling process, a mosaic process, or a blurring process on the portion of the information to be concealed on the initial operation screen. Alternatively, the concealed portion 1610 may be replaced with other information, for example, a display of another message such as "concealed".

In the next step S1213, an image of the operation screen including the concealed portion generated in step S1212 is displayed on the display device 204 of the image forming device 20, and the communication control unit 221 transmits the image of the operation screen to the remote control terminal 40, and the process proceeds to step S1217.

If it is determined in step S1211 that the concealment level set for the concealment target information included in the operation screen is "check each time", the process proceeds to step S1214. In step S1214, the display control unit 222 generates mask information corresponding to the position on the operation screen where the concealment target information with the concealment level set to "check each time", in this second embodiment, a telephone number, is displayed. This mask information includes a name representing the information to be concealed (e.g., a telephone number) and coordinate information (x1, y1, x2, y2) of a mask image generated to conceal the concealment information.

In step S1215, the display control unit 222 displays (hereinafter referred to as mask processing) on the display device 204 of the image forming device 20 a mask image generated based on the mask information generated in step S1214, superimposed on the image of the operation screen generated in step S1207. FIG. 17 shows an example of a masked detailed information display screen 1700. In the masked detailed information display screen 1700, the masked portion 1710 is displayed in a different display state compared to the other portions, for example, the masked portion is displayed filled with a mask image of a different color from the surrounding portions.

When the user 60 of the image forming device 20 touches the mask image portion of the operation screen displayed on the display device 204 with a finger or the like, the mask image disappears and the hidden information that was hidden by the mask image, i.e., the telephone number, is displayed and can be viewed by the user 60. This process is an operation of the image forming device 20 only, and the mask image is not erased on the remote control terminal 40 to make the hidden information visible.

In step S1216, the communication control unit 221 transmits the image of the operation screen generated in step S1207 and the mask information generated in step S1214 to the remote control terminal 40, and proceeds to step S1217.

In step S1217, the remote operator 80 operating the remote control terminal 40 operates the input device 406 while viewing the image displayed on the display device 405, thereby remotely operating the input device 205 of the image forming device 20. The remote operation receiving unit 223 of the image forming device 20 then operates the input device 205 of the image forming device 20 on behalf of the user 60 in response to the remote operation information transmitted from the remote control terminal 40, and the various operation executing unit 225 executes various functions in response to the operation of the input device 205.

In step S1218, the operation authority monitoring unit 224 determines whether or not a concealment removal request has been received from the remote operation terminal 40. The concealment removal request includes at least the name of the specific information to be concealed. If a concealment removal request has not been received, the process returns to step S1205, and a determination is made as to whether or not to end the acceptance of remote operations. On the other hand, if it is determined in step S1218 that a concealment removal request has been received, the process proceeds to step S1219.

In step S1219, the display control unit 222 generates a permission confirmation screen 1800 as shown in FIG. 18, displays it on the display device 204, and determines whether the unconcealment request is permitted or not permitted by the user 60 of the image forming device 20. Note that in the permission confirmation screen 1800 in FIG. 18, a confirmation message 1810 such as "There is a request to unconceal. Do you want to permit it?" and selection icons 1820 such as "Permit" and "Do not permit" are displayed in the portion of the concealment target information for which the unconcealment request is made, and a selection by the user 60 is awaited.

In step S1219, if it is determined that the user 60 has permitted the unconcealment request, that is, if the user 60 has selected the "permit" icon from among the selection icons 1820 on the permission confirmation screen 1800, the process proceeds to step S1220. In step S1220, the communication control unit 221 transmits an unconcealment instruction to the remote control terminal 40. This unconcealment instruction includes the name of the concealment target information to be unconcealed. At the same time, the display control unit 222 erases the mask image of the concealment target information portion, thereby displaying the hidden information that was hidden, so that it can be visually recognized by the user 60. Note that the unconcealment instruction may include the coordinate information (x1, y1, x2, y2) of the mask image in addition to the name of the concealment target information to be unconcealed. Alternatively, it may include only the coordinate information of the mask image. Thereafter, the process returns to step S1205.

On the other hand, if it is determined in step S1219 that the user 60 does not permit the unconcealment request, that is, if the user 60 selects the "Do not permit" icon among the selection icons 1820 on the permission confirmation screen 1800, the display control unit 222 erases the confirmation message 1810 and the selection icons 1820 displayed on the permission confirmation screen 1800, returns to displaying the masked image of the detailed information display screen 1700 in FIG. 17, and proceeds to step S1221. In step S1221, the communication control unit 221 transmits an instruction to not permit unconcealment to the remote control terminal 40, and returns to the processing of step S1205.

Figure 19 is a flowchart showing the flow of operations of the remote control terminal 40 in the second embodiment. In step S1901, the remote control terminal 40 receives an image of the operation screen from the image forming device 20 via the communication interface 404, and temporarily stores it in the memory 402. At the same time, if mask information is received from the image forming device 20 together with the image of the operation screen, the mask information is also temporarily stored in the memory 402.

In step S1902, the concealment information determination unit 424A determines whether or not mask information has been received along with the image of the operation screen. If it is determined that the received information does not include mask information, the process proceeds to step S1903, where the display control unit 423A displays the image of the operation screen received from the image forming device 20 on the display device 405, and the process proceeds to step S1906. Here, if an image of the operation screen that does not include concealment information has been received, the image displayed on the display device 405 will be the same as the destination selection screen 1400 as shown in FIG. 14. On the other hand, if an image of the operation screen that includes concealment information has been received, the image displayed on the display device 405 will be the same as the detailed information display screen 1600 that has been concealed as shown in FIG. 16.

When concealment information is included in the operation screen, the image received by the remote control terminal 40 has already been subjected to concealment processing, so the remote control terminal 40 simply displays the received image as is.

On the other hand, if the concealment information determination unit 424A determines in step S1902 that mask information has been received together with the image of the operation screen, the process proceeds to step S1904. In step S1904, the display control unit 423A composites a mask image generated based on the mask information onto the image of the operation screen received from the image forming device 20, and in the subsequent step S1905, displays an image of the masked operation screen, in which the operation screen and the mask image have been composited, on the display device 405. For example, a masked detailed information display screen 1700 as shown in FIG. 17 is displayed on the display device 405. In the detailed information display screen 1700 of FIG. 17, a mask image 1710 is composited and displayed in a portion corresponding to the telephone number display field 1530 of the detailed information display screen 1500 of FIG. 15, making the telephone number invisible.

In the next step S1906, the remote control unit 422A generates remote control information in response to the operation of the input device 406 by the remote operator 80 of the remote operation terminal 40, and transmits the information to the image forming device 20 via the network 30.

In step S1907, the concealment information determination unit 424A determines whether or not the location where masking was performed by the remote operator 80 operating the input device 406, that is, any location within the rectangular range represented by the coordinates (x1, y1, x2, y2) of the mask image, was selected. If it is determined that the location where masking was performed was not selected, the process proceeds to step S1908, where the remote control unit 422A determines whether or not to end remote operation of the image forming device 20 by the remote operation terminal 40.

If it is determined in step S1908 that the remote operation is to be terminated, the login unit 421A executes a logout process to disconnect the remote operation terminal 40 from the image forming device 20 and terminates the process. On the other hand, if it is determined that the remote operation is not to be terminated, the process returns to step S1901 and the remote operation of the image forming device 20 is continued.

On the other hand, if in step S1907 the concealed information determination unit 424A determines that a portion that has been masked has been selected by the remote operator 80 operating the input device 406, the process proceeds to step S1909, where the remote control unit 422A extracts the name of the information to be concealed from the portion where the masking has been performed, and transmits an unconcealment request to the image forming device 20 requesting that the information to be concealed be unconcealed. This unconcealment request includes at least the name of the information to be concealed.

At this time, the display control unit 423A may display the name of the information to be concealed on the display device 405, and may generate a confirmation screen (not shown) for confirming whether or not to request the user 60 of the image forming device 20 to unconceal the information to be concealed, and display the confirmation screen on the display device 405. When the remote operator 80 of the remote operation terminal 40 selects an icon such as "Request" on the confirmation screen, the remote control unit 422A may transmit the above-mentioned unconcealment request to the image forming device 20.

As already explained in steps S1218 and S1219 above, when the image forming device 20 receives this request to remove concealment, the image forming device 20 displays a permission confirmation screen 1800 as shown in FIG. 18 on the display device 204 of the image forming device 20, and requests permission for the request to remove concealment from the user 60 of the image forming device 20.

In step S1910, the concealment information determination unit 424A of the remote control terminal 40 determines whether an unconcealment instruction or an unconcealment non-permission instruction has been received from the image forming device 20 in response to the unconcealment request. If an unconcealment instruction has been received, the process proceeds to step S1911. In step S1911, the display control unit 423A of the remote control terminal 40 performs processing to erase the mask image from the masked image and displays it on the display device 405, thereby unconcealing the image.

The unconcealment instruction includes the name of the concealed information to be unconcealed. Alternatively, it may include mask information that has been combined with the concealed information to be unconcealed, for example, coordinate information of the mask image (x1, y1, x2, y2). Since the image of the operation screen after unconcealment has already been stored in memory 402 of remote control terminal 40, the process simply involves erasing the mask image. At this time, the image displayed on display device 405 becomes the same as detailed information display screen 1500 displayed in FIG. 17, and telephone number display field 1730 displays telephone number information that was previously hidden by the mask image. The process returns to step S1908, where it is determined whether remote control has ended.

If the concealed information determination unit 424A determines in step S1910 that an unconcealment disallowance instruction has been received from the image forming apparatus 20, the process proceeds to step S1912, where the display control unit 423A generates a message indicating that the display of the information of the masked portion has not been permitted by the user 60 of the image forming apparatus 20, and displays the message on the display device 405. FIG. 20 is a diagram showing an example of an unconcealment disallowance screen 2100 displayed on the display device 405 of the remote control terminal 40. In the unconcealment disallowance screen 2000, the masked portion 2010 remains as it is, and further, a unconcealment disallowance message dialog 2020 such as "Unconcealment not permitted" is displayed. Next, the process returns to step S1908, where it is determined whether the remote control is to be terminated.

In the second embodiment described above, the user 60 of the image forming device 20 instructs whether or not to remove the concealment at the time when the request to remove concealment is received from the remote control terminal 40. Therefore, even if the user 60 of the image forming device 20 selects a masked portion on the display screen when the request to remove concealment is not received, the information that was concealed there is simply displayed on the display device 204 of the image forming device 20, but is not displayed on the display device 405 of the remote control terminal 40. On the other hand, in the third embodiment described below, when the user 60 of the image forming device 20 selects a masked portion on the display screen, the user 60 of the image forming device 20 can select whether or not to make the masked portion visible on the remote control terminal 40 side.

[Third embodiment]
Fig. 21 is a flowchart showing the flow of the operation of the image forming apparatus 20 in the third embodiment. The image forming apparatus 20 and the remote control terminal 40 in the third embodiment are the same as those in the second embodiment, so detailed explanations of the configuration and functions of each unit will be omitted. In addition, the operation of the image forming apparatus 20 is the same as the processing of steps S1201 to S1217 in Fig. 12 described in the second embodiment, so explanations of this part of the processing will be omitted and only the processing after step S2101 in Fig. 21 will be explained.

First, it is assumed that the display device 204 of the image forming device 20 displays the masked detailed information display screen 1700 as described in FIG. 17 of the second embodiment. In step S2101, the various operation execution unit 225 of the image forming device 20 judges whether or not the user 60 of the image forming device 20 has selected the masked portion 1710 of the detailed information display screen 1700. If it is determined that the user 60 has not selected the masked portion, the process in the third embodiment is terminated, and the process from step 1217 in FIG. 13 in the second embodiment described above is executed, that is, the operation in response to the acceptance of remote operation by the remote operation terminal 40.

If it is determined in step S2101 that the user 60 has selected a masked portion, in step S2102 the display control unit 222 generates an unconcealment confirmation screen 2200 as shown in FIG. 22 and displays it on the display device 204. In the unconcealment confirmation screen 2200, a confirmation message 2210 such as "Do you want to unconceal?" and selection icons 2220 such as "Allow" and "Cancel" are displayed on the masked portion selected by the user 60, and the screen is waiting for a selection by the user 60.

In step S2103, if the operation authority monitoring unit 224 determines that permission to remove concealment has been selected, i.e., if the user 60 selects the "permit" icon among the selection icons 2220 on the removal of concealment confirmation screen 2200, the process proceeds to step S2104. In step S2104, the communication control unit 221 transmits an instruction to remove concealment to the remote control terminal 40, and the display control unit 222 erases the mask image of the information to be concealed, thereby displaying the hidden information that was previously hidden, so that it can be viewed by the user 60. Next, the process in the third embodiment is terminated, and the process from step 1217 in FIG. 13 in the second embodiment described above is executed, i.e., the operation in response to the acceptance of remote control by the remote control terminal 40 is executed.

On the other hand, in step S2103, if the user 60 does not unhide, that is, if the user 60 selects the "Cancel" icon among the selection icons 2220 on the unhide confirmation screen 2200, the display control unit 222 erases the confirmation message 2210 and the selection icons 2220 displayed on the unhide confirmation screen 2200, returns to displaying the masked image of the detailed information display screen 1700 in FIG. 17, terminates the processing in the third embodiment, and executes the processing from step 1217 onward in FIG. 13 in the second embodiment described above, that is, the operation of accepting remote control by the remote control terminal 40.

Next, the flow of operations in the remote control terminal 40 in this third embodiment will be described with reference to FIG. 23. In step S2301, the remote control terminal 40 receives an image of the operation screen from the image forming device 20 via the communication interface 404, and temporarily stores it in the memory 402. At the same time, if mask information is received from the image forming device 20 together with the image of the operation screen, the mask information is also temporarily stored in the memory 402.

In step S2302, the concealment information determination unit 424A determines whether or not mask information has been received along with the image of the operation screen. If it is determined that the received information does not include mask information, the process proceeds to step S2303, where the display control unit 423A displays the image of the operation screen received from the image forming device 20 on the display device 405, and the process proceeds to step S2306. Here, if an image of the operation screen that does not include concealment information has been received, the image displayed on the display device 405 will be the same as the destination selection screen 1400 as shown in FIG. 14.

On the other hand, if the concealment information determination unit 424A determines in step S2302 that mask information has been received along with the image of the operation screen, the process proceeds to step S2304. In step S2304, the display control unit 423A composites a mask image generated based on the mask information onto the image of the operation screen received from the image forming device 20, and in the subsequent step S2305, displays an image of the masked operation screen, in which the operation screen and the mask image have been composited, on the display device 405. For example, a masked detailed information display screen 1700 as shown in FIG. 17 is displayed on the display device 405.

In step S2306, the remote control unit 422A generates remote control information in response to the operation of the input device 406 by the remote operator 80 of the remote operation terminal 40, and transmits the information to the image forming device 20 via the network 30.

In step S2307, the concealment information determination unit 424A determines whether or not an instruction to unconceal the mask image has been received from the image forming device 20. If it is determined that an unconcealment instruction has not been received, the process proceeds to step S2309. If it is determined that an unconcealment instruction has been received, the process proceeds to step S2308, where the display control unit 423A of the remote control terminal 40 performs processing to erase the mask image for which the unconcealment instruction was given from the masked image, and displays it on the display device 405, thereby unconcealing it. Note that at this time, the image displayed on the display device 405 becomes the same as the detailed information display screen 1500 displayed in FIG. 15, and the telephone number display field 1530 displays telephone number information that was previously hidden by the mask image.

In step S2309, the remote control unit 422A determines whether or not to end the remote operation of the image forming device 20 by the remote operation terminal 40. If it is determined that the remote operation is to be ended, the login unit 421A executes a logout process to disconnect the remote operation terminal 40 from the image forming device 20 and ends the process. On the other hand, if it is determined that the remote operation is not to be ended, the process returns to step S2301 and the remote operation of the image forming device 20 continues.

[Fourth embodiment]
In the above-described second embodiment, an example has been described in which confirmation as to whether or not to perform the unconcealment process on the masked portion is made to the user 60 of the image forming apparatus 20 at the time when the remote control terminal 40 makes an unconcealment request to the image forming apparatus 20. Also, in the above-described third embodiment, confirmation is made with the user 60 as to whether or not to perform the unconcealment process on the masked portion at the time when the user 60 of the image forming apparatus 20 selects the masked portion. However, the user 60 may be inquired in advance as to whether or not to perform the unconcealment process on the concealment target information for which the concealment level is set to "confirm each time".

In this case, it is assumed that the display device 204 of the image forming device 20 displays a destination selection screen 1400 as shown in FIG. 14. At this time, when the user 60 of the image forming device 20 or the remote operator 80 of the remote control terminal 40 selects the details display icon 1430, the detailed information display screen 1500 as shown in FIG. 15 is subsequently displayed in the second and third embodiments described above. However, in this fourth embodiment, before displaying the detailed information display screen 1500, the display control unit 222 of the image forming device 20 displays a preliminary confirmation screen 2400 as shown in FIG. 24.

The advance confirmation screen 2400 includes a confirmation message 2410 asking whether to skip the confirmation of whether to allow the display of masked hidden information on the detailed display screen to be displayed later, and selection icons 2420 such as "Omit" and "Do not omit." If the user 60 selects the "Omit" selection icon 2420, the following operations are performed in the subsequent processing.

For example, as in the second embodiment described above, when the remote operator 80 of the remote control terminal 40 selects a portion of the masked hidden information, the unmasking disallowance screen 2000 as described in FIG. 20 is not displayed to ask the user 60 of the image forming device 20 whether or not to unmask. Instead, the display control unit 222 erases the mask image, displays an image of the detailed information display screen 1500 as shown in FIG. 15 on the display device 204 of the image forming device 20, and also causes a similar screen to be reflected on the display device 405 of the remote control terminal 40.

Similarly, when the user 60 of the image forming device 20 selects a portion of the masked hidden information as in the third embodiment, the unmasking confirmation screen 2200 as described in FIG. 22 is not displayed to ask the user 60 of the image forming device 20 whether or not to unmask. Instead, the display control unit 222 erases the mask image, displays an image of the detailed information display screen 1500 as shown in FIG. 15 on the display device 204 of the image forming device 20, and also causes the display device 405 of the remote control terminal 40 to reflect a similar screen.

In the fourth embodiment, when an operation to display the details display screen (i.e., an operation to select the "details display" icon 1630 in FIG. 16) is performed, the concealment release confirmation screen 2200 is displayed. The present invention is not limited to the above example. For example, when the login button is selected, a screen for inputting a user name and password and a soft keyboard are subsequently displayed, and the above information is input using the displayed soft keyboard. However, before the screen is displayed, a screen for confirmation similar to the above-mentioned preliminary confirmation screen may be displayed. Alternatively, the confirmation screen may be a selection screen for allowing or concealing the display of subsequent operations. If concealment is selected on the confirmation screen, the name of the information to be concealed and information on the mask image are transmitted to the image forming device 20.

In the above embodiments 2 to 4, an example has been described in which the remote operator 80 of the remote control terminal 40 performs remote operation and can select the "details display" icon 1430 on the destination selection screen 1400 in FIG. 14. However, if a displayed icon is selected and the next information to be displayed contains information to be concealed, the icon may be made unselectable on the remote control terminal 40. In this case, the operator 80 of the remote control terminal 40 must verbally or otherwise request, by telephone or otherwise, the user 60 of the image forming device 20 to select the icon on the image forming device 20 side to proceed to the display of the next details display screen.

In addition, in the above embodiments 2 to 4, a case has been described in which one piece of information to be hidden, such as a telephone number, is included on the screen, and either a "always hidden" or "check each time" concealment level has been set for the information to be hidden. However, the present invention is not limited to the above example, and multiple pieces of information to be hidden, such as an email address, business name, department name, etc. in addition to a telephone number, may be included on the screen, and either a "always hidden" or "check each time" concealment level may be set for each piece of information to be hidden.

Furthermore, in the above embodiments 2 to 4, an example was described in which information defined by the user 60 of the image forming device 20 (for example, personal information such as email address, telephone number, address, and password, and confidential information such as the host name, IP address, and user information related to authentication of the host computer to which the image forming device 20 is connected, and job memory) was set as information to be hidden from among the information stored in the image forming device 20. However, the present invention is not limited to the above example, and the operation to display the confidential information itself may be set as information to be hidden, and the icons, item names, and operations to display or execute the information themselves may also be hidden so that they are not displayed.

Furthermore, connection operations for connecting the image forming apparatus 20 to other equipment or devices, such as a matching operation with an external authentication server, a connection operation to an external storage (including a USB memory), and a connection operation to another computer connected via a network, such as a ScanToPC or SMB (Server Message Block) connection operation, may be set as information to be hidden, and icons, item names, and the operations themselves for displaying or executing such information may also be hidden so that they are not displayed.

In addition, information stored in the image forming device 20 after the image forming device 20 is shipped from the factory, such as the document name of a print job, may be set as information to be concealed. In the above embodiments 2 to 4, the concealment level is set in advance, but the operation authority monitoring unit 224 may allow the user 60 of the image forming device 20 to set it at any time. In addition, since there are usually multiple users of the image forming device 20, it may be possible to set the concealment level for each piece of information to be concealed according to each user. In that case, each piece of information to be concealed will be displayed/concealed at the concealment level set for the user 60 who is using the device when remote operation is being performed.

In the above example, the method of displaying the hidden portion is different depending on whether the hiding level is "always hidden" or "check each time," but the present invention is not limited to the above example. Even if the hiding level is different, the information to be hidden may be hidden using the same display method that is different from other non-hidden locations, or in addition to the same image processing, messages such as "hidden" or "user's permission required" may be superimposed to allow the user 60 or remote operator 80 to recognize that the hiding level is different.

In the above example, the image forming apparatus 20 processes the part to be hidden when the hiding level is "always hidden", and the remote control terminal 40 receives and displays the image of the operation screen that has already been hidden. However, the present invention is not limited to the above example. As with the case of the "check each time" hiding level, the image forming apparatus 20 may form a mask image to hide the part to be hidden when the hiding level is "always hidden", transmit the image of the operation screen and information on the mask image to the remote control terminal 40, and synthesize the mask image with the operation screen on the remote control terminal 40 side, so that the part to be hidden is hidden. In this case, it is necessary to determine whether the hiding level set for each display element is "always hidden", "concealed each time", or "not hidden" on the remote control terminal 40.

REFERENCE SIGNS LIST 10 Remote control system 20 Image forming device 30 Network 40 Remote operation terminal 50 Office 60 User 70 Service center 80 Remote operator 201 Microprocessor 202 Memory 203 Storage device 204 Display device 205 Input device 206 Communication interface 207 Image forming unit 208 System bus 221 Communication control unit 222 Display control unit 223 Remote operation acceptance unit 224 Operation authority monitoring unit 225 Various operation execution unit 401 CPU
402 Memory 403 Storage device 404 Communication interface 405 Display device 406 Input device 407 System bus 421, 421A Login unit 422, 422A Remote control unit 423A Display control unit 424A Concealed information determination unit

Claims (9)

a transmission means for transmitting an image of an operation screen to be displayed on the display means to an external remote control terminal when remote control is accepted from the external remote control terminal;
and a display control means for controlling the display of an image of the operation screen so that the information to be concealed included in the operation screen is not displayed on the remote control terminal when an operation is executed to display an operation screen including information to be concealed on the display means. The information processing device according to claim 1, wherein the display control means performs display control so that information to be concealed that is not displayed on the remote control terminal becomes indistinguishable on the operation screen by changing the display state on the operation screen from the initial display state. The information processing device according to claim 1, wherein the display control means controls the display of the image of the operation screen so that, when an operation is performed to display an operation screen including information to be concealed on the display means, display information other than the information to be concealed included on the operation screen is displayed on the remote control terminal. The information processing device according to any one of claims 1 to 3, wherein the display control means performs the display control when an operation to input information to be concealed is to be performed as an operation to cause the display means to display an operation screen including information to be concealed. a receiving means for receiving a concealment release instruction for displaying the concealment target information included in the operation screen when the concealment target information is not being displayed on the remote control terminal,
5. An information processing device according to claim 1, wherein when the receiving means receives an instruction to remove concealment for information to be concealed that is not displayed on the remote control terminal, the transmitting means makes the information to be concealed displayable by transmitting an instruction to remove the concealment of the information to be concealed. the display control means generates concealment instruction information for concealing the information to be concealed, and makes the information transmittable together with the image of the operation screen;
when the receiving means receives an unconcealment instruction for the concealment target information, the display control means generates unconcealment information for unconcealing the concealment target information,
6. The information processing apparatus according to claim 5, wherein said transmitting means transmits the concealment removal information to said remote control terminal, thereby making the concealed information displayable. The information processing device according to claim 5 or 6, wherein the display control means changes the display state of the information to be concealed from the initial display state according to a predetermined degree of concealment for each piece of information to be concealed. a remote control terminal having a first display means for displaying an image of the received operation screen and an input operation means;
a transmitting means for transmitting an image of an operation screen to be displayed on the second display means to the remote control terminal when the remote control terminal accepts remote control;
A remote control system comprising: an information processing device having: a display control means for controlling the display of an image of an operation screen so that, when an operation is executed to display an operation screen including information to be concealed on the second display means, the information to be concealed included on the operation screen is not displayed on the second display means. A computer constituting an information processing device includes:
transmitting an image of an operation screen to be displayed on the display means to an external remote control terminal when the remote control is accepted;
When an operation is performed to display an operation screen including information to be concealed on the display means, a step of controlling the display of an image of the operation screen so that the information to be concealed included on the operation screen is not displayed on the remote control terminal.