JP2008071312A - Remote monitored device, screen sharing method and screen sharing program between remote monitored device and remote monitoring device, and recording medium recording screen sharing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote monitored device preventing a leakage of confidential information to a remote monitoring device. <P>SOLUTION: The remote monitored device M1 allowing a remote monitoring device to display a display screen has a person detecting means PS1 detecting the presence of a person around the remote monitored device M1, and a communication control means TC1 controlling communication between the remote monitoring device and the remote monitored device M1 based on the detection result of the person detecting means PS1. The remote monitored device M1 has a device body part MB1 equipped with a body control part 212, and an operation panel part OP1 equipped with an operation panel control part 221 operated independently of the body control part 212. The remote monitoring device communicates with the device body part MB1 through the operation panel part OP1, and the communication control means TC1 intercepts communication between the operation panel part OP1 and the remote monitoring device when the person detecting means PS1 detects no person around the remote monitored device M1. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a remote monitoring device, a screen sharing method between the remote monitoring device and the remote device, a screen sharing program, and a recording medium on which the screen sharing program is recorded. A remote monitoring device for preventing confidential information from leaking indefinitely to a remote monitoring device (meaning a device for remote monitoring), and between the remote monitoring device and the remote monitoring device. The present invention relates to a screen sharing method, a screen sharing program, and a recording medium on which the screen sharing program is recorded.

  Conventionally, a remote operation device that performs remote operation of an operation target based on information from a remote controller is known (see, for example, Patent Document 1).

  Also, as a technology related to remote operation, the operation panel can be remotely operated from the operation panel by separating the operation panel and the device body and connecting them via a wireless local area network (LAN). A wireless interface connection operation panel with an improved degree is also known (see, for example, Patent Document 2).

  Furthermore, an operation screen of an MFP (Multi Function Printer) equipped with a server is displayed on a client terminal connected to the network, and the MFP is displayed via the virtual MFP operation screen displayed on the client terminal. There is also known an MFP system that remotely controls the system (for example, see Patent Document 3).

  The above-described technical group enables maintenance of the operation target and remote support of the operator who operates the operation target by remotely operating the operation target while monitoring the operation target.

  VNC (Virtual Network Computing) is known as a technology for remotely supporting a remote device while confirming an image displayed on the display of the remote device.

  FIG. 1 is a diagram for explaining the principle of operation of a VNC. A system equipped with a VNC has a screen on a PC (Personal Computer) (hereinafter referred to as a “remotely operated PC”) that is remotely operated. It has a shared server unit S, and has a screen sharing client unit C on a remotely operated PC (hereinafter referred to as “remote operation PC”).

  Regarding screen sharing, the screen sharing server unit S of the remotely operated PC includes an image data acquisition unit 11 and an image data transmission unit 12, and the screen sharing client unit C of the remote operation PC includes an image data receiving unit 15 and an image data receiving unit 15. A data display unit 16 is included.

  The image data acquiring unit 11 of the remotely operated PC acquires image data of a screen displayed on the display of the remotely operated PC, and the image data transmitting unit 12 uses this image data as the screen sharing client unit C of the remote operated PC. Send to. The image data receiving unit 15 of the remote operation PC receives image data transmitted from the remote operation PC, and the image data display unit 16 displays the received image data on the display of the remote operation PC.

  In this way, the screen of the remotely operated PC on which the screen sharing server unit S is activated can be shared on the remotely operated PC. Note that the size of image data may be compressed using a known compression technique or using difference data from the immediately preceding image data.

  On the other hand, regarding the input operation, the screen sharing server unit S of the remotely operated PC has an input event creation unit 13 and an input event receiving unit 14, and the screen sharing client unit C of the remote operation PC has an input event transmitting unit 17 and An input event acquisition unit 18 is included.

  The input event acquisition unit 18 of the remote operation PC acquires an input event signal generated by mouse or keyboard operation input on the remote operation PC, and the input event transmission unit 17 transmits the input event signal to the remote operation PC. To do.

  Further, the input event receiving unit 14 of the remotely operated PC receives an input event signal transmitted from the remote operated PC, and the input event creating unit 13 performs a pseudo operation on the remotely operated PC based on the received input event signal. Input event signal (the input event signal is originally generated by the input means attached to the remotely operated PC), and the input event signal is output to the control unit, and the corresponding input event is remotely operated. Run on PC.

As described above, the system equipped with the VNC can remotely operate the remotely operated PC while allowing the remote operator to confirm the image displayed on the remotely operated PC display at the remote location. Maintenance of the remotely operated PC and remote support of an operator who operates the remotely operated PC are enabled.
Japanese Patent No. 3469399 Specification JP 2002-366287 A JP 2005-057549 A

  However, all the above-mentioned patent documents mention the convenience of remote monitoring or remote operation, but do not mention the security of remote monitoring or remote operation. Therefore, for example, there is a case where confidential information displayed on the display of the remotely operated PC is displayed on the display of the remote operated PC without limitation, and leakage of confidential information occurs.

  In view of the above, the present invention provides a remote monitoring device with improved security, such as preventing leakage of confidential information from the remote monitoring device to the remote monitoring device, and the remote monitoring device and the remote monitoring device. A screen sharing method, a screen sharing program, and a recording medium on which the screen sharing program is recorded.

  In order to achieve the above object, a remotely-monitored device according to the first invention is a remotely-monitored device that causes a display screen of the remotely-monitored device to be displayed on the remote-monitoring device, and the periphery of the remotely-monitored device A person detecting means for detecting the presence or absence of the person, and a communication control means for controlling communication between the remote monitoring apparatus and the remote monitoring apparatus based on a detection result by the person detecting means. And

  The second invention is a remotely-monitored device according to the first invention, comprising an apparatus main body unit including a main body control unit, and an operation panel control unit that operates independently from the main body control unit. And an operation panel unit.

  The third invention is a remotely monitored device according to the second invention, wherein the remote monitoring device communicates with the device body via the operation panel unit, and the communication control means includes: When the person detection unit does not detect a person around the remote monitoring device, communication between the operation panel unit and the remote monitoring device is blocked.

  The fourth invention is a remotely monitored device according to the second invention, wherein the remote monitoring device communicates with the device body via the operation panel, and the communication control means includes: When the person detecting unit does not detect a person around the remote monitoring apparatus, communication between the operation panel unit and the apparatus main body is cut off.

  The fifth invention is a remotely monitored apparatus according to any one of the first to fourth inventions, wherein a screen generating means for generating a screen from a plurality of image data, and an attribute for setting an attribute of the image data Setting means, and the screen generation means generates a screen in which the image data set with a predetermined attribute value by the attribute setting means is invisible.

  A sixth invention is a remotely monitored apparatus according to any one of the first to fourth inventions, wherein screen generating means for generating a screen from a plurality of image data and the plurality of image data are separately provided. Storage means for storing in an area, wherein the screen generation means generates a screen in which the image data stored in the predetermined area of the storage means is invisible.

  A seventh invention is a remotely monitored apparatus according to any one of the first to fourth inventions, wherein a screen generating means for generating a screen from a plurality of image data, and drawing the image data in a video memory A plurality of drawing means, wherein the screen generation means generates a screen in which the image data drawn by the predetermined drawing means is invisible.

  An eighth invention is a remotely monitored apparatus according to any of the fifth to seventh inventions, wherein the screen generating means is arranged in the apparatus main body.

  A screen sharing method according to the ninth invention is a screen sharing method for sharing a display screen of a remote monitoring device with a remote monitoring device via a network, and detects the presence or absence of a person around the remote monitoring device. And a communication control step for controlling communication between the remote monitoring device and the remote monitoring device based on a detection result in the person detection step.

  A screen sharing program according to the tenth invention is a screen sharing program that causes a computer to execute the screen sharing method according to the ninth invention.

  A recording medium according to the eleventh invention is a computer-readable recording medium recording the program according to the tenth invention.

  By the above-described means, the present invention provides a remote monitoring device with improved security such as preventing leakage of confidential information from the remote monitoring device to the remote monitoring device, and the remote monitoring device and the remote monitoring device. A screen sharing method, a screen sharing program, and a recording medium on which the screen sharing program is recorded.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 2 is a functional block diagram showing an example of the configuration of a multi-function multi-function peripheral that is a remotely monitored apparatus according to the present invention.

  The multi-function multifunction device M1 includes an apparatus main body MB1, an operation panel unit OP1, a communication control unit TC1, and a person detection unit PS1, and is connected to the network from the communication I / F unit T1 of the operation panel unit OP1 via the communication control unit TC1. And remotely operated by a remote operation PC.

  The apparatus main body MB1 includes an image input unit 200, an image forming unit 201, an image input control unit 202, an image output control unit 203, a copy unit 204, a printer unit 205, a scan unit 206, a FAX unit 207, a hard disk 208, a RAM 209, and a communication. Unit 210, anti-operation panel communication unit 211, and main body control unit 212.

  The image input unit 200 is a unit for optically acquiring image data from a paper medium, and the image forming unit 201 is a unit for forming an image corresponding to the image data on the paper medium.

  The image input control unit 202 is a unit for controlling the image input unit 200, and the image output control unit 203 is a unit for controlling the image forming unit 201.

  The copy unit 204, the printer unit 205, the scan unit 206, and the FAX unit 207 are devices that execute the copy function, printer function, scanner function, and FAX function of the multi-function MFP M1, respectively.

  The hard disk 208 is a non-volatile storage device for storing images scanned by the scanning unit 206, and the RAM 209 is a volatile storage device for temporarily storing images scanned by the scanning unit 206.

  The communication unit 210 is a device for connecting the multi-function multifunction peripheral M1 to a LAN or a telephone line. Note that the communication unit 210 is not used for remote operation of the multi-function multifunction peripheral M1.

  The operation panel communication unit 211 is an interface for the apparatus main body unit MB1 to communicate with the operation panel unit OP1. For example, an instruction such as “2 copies in A4 size” is received from the operation panel unit OP1, or the scan unit This is used when transmitting the image data stored in the hard disk 208 in order to preview the image scanned in 206 on the display unit 224 of the operation panel OP1.

  The main body control unit 212 is a computer including a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), an NVRAM (Non-Volatile Random Access Memory), and the like, and operates the operation panel unit OP1. The apparatus main body MB1 is controlled independently of the panel control unit 221, and image input / output in the copy unit 204, printer unit 205, scan unit 206, and FAX unit 207 is controlled.

  The operation panel unit OP1 includes a main body communication unit 220, an operation panel control unit 221, an input processing unit 222, operation keys 223, a display unit 224, a coordinate detection unit 225, a screen generation unit G1, a screen sharing server unit S1, a communication I / It has F part T1.

  The main body communication unit 220 is an interface for the operation panel OP1 to communicate with the apparatus main body unit MB1.

  The operation panel control unit 221 is a computer including a CPU, RAM, ROM, NVRAM, and the like, and controls the operation panel unit OP1 independently of the main body control unit 212. As described above, since the main body control unit 212 of the apparatus main body unit MB1 and the operation panel control unit 221 of the operation panel unit OP1 are independent from each other, when one of them breaks down or is illegally accessed from the outside. Can be prevented from affecting the other.

  The input processing unit 222 is a means for processing an operation input to the operation panel unit OP1, and, for example, receives an input event signal from the operation key 223 or the coordinate detection unit 225, and contents of the operation input to the operation panel unit OP1. And a control signal is output to the operation panel control unit 221.

  The “input event signal” is a signal indicating the content of the operation input to the operation panel unit OP1, and includes, for example, the ID of the pressed operation key 223, the position coordinates pressed on the touch panel, and the like.

  The operation key 223 is a hardware switch such as a membrane switch or a toggle switch. For example, the operation key 223 includes a numeric key for setting the number of copies, a function key for selecting various functions such as a copy function and a scan function.

  The display unit 224 is a display device for displaying a set number of copies, selectable functions, and the like, such as a liquid crystal display provided with a touch panel, an organic EL (Electro-Luminescence) display, and the like.

  The screen generation unit G1 is means for generating image data of a display screen to be displayed on the display unit 224. For example, the image generation output by the operation panel control unit 221 based on the control signal output by the input processing unit 222 Image data is generated according to the signal. Thereafter, the screen generation unit G1 outputs the generated image data to the display unit 224 to display the display screen.

  Further, the screen generation unit G1 generates image data of a shared screen to be displayed on the display device of the remote operation PC.

  The “shared screen” is a screen in which the display screen displayed on the display unit 224 of the operation panel unit OP1 in the multi-function MFP M1 is virtually displayed on the display device of the remote operation PC, and the display screen is reproduced as it is. There are screens that have been reproduced and screens that have been reproduced by making a part of the display screen invisible.

  The coordinate detection unit 225 is a means for detecting a position coordinate on the touch panel pressed by the operator. For example, the coordinate detection unit 225 specifies a position coordinate based on a change in capacitance of the touch panel surface by a capacitance method, An input event signal including information on position coordinates is output to the input processing unit 222. Note that the touch panel may use another system such as a resistive film system or a surface acoustic wave system.

  The screen sharing server unit S1 and the communication I / F unit T1 are the same as the screen sharing server unit S and the communication I / F unit T mounted on the remotely operated PC in FIG. Sharing the display screen with the remote operation PC and emulating the operation keys 223 and the touch panel in the multi-function multifunction peripheral M1, the operation input on the remote operation PC is simulated as the operation input in the multi-function multifunction peripheral M1. Let it be processed.

  The screen sharing server unit S1 acquires the image data generated by the screen generation unit G1 by the image data acquisition unit 11, and is connected to the network by the image data transmission unit 12 via the communication I / F unit T1 and the communication control unit TC1. To the remote control PC.

  The screen sharing server unit S1 receives an input event signal generated by the remote operation PC by the input event receiving unit 14, and generates a pseudo input event signal for the input processing unit 222 by the input event generating unit 13. The corresponding input event is executed on the multi-function multifunction peripheral M1.

  The person detection unit PS1 is a means for detecting a person around the multi-function multi-function peripheral M1, and directly operates the multi-function multi-function peripheral M1 using, for example, a proximity sensor or a radar sensor using infrared rays, ultrasonic waves, radio waves, or the like. The operator is detected, or the surrounding person and the operator are detected by photographing the periphery of the multi-function multifunction peripheral M1 with a camera and processing the captured image.

  Further, the person detection unit PS1 may identify the operator by collating the image captured by the camera and the person image stored in the attached hard disk or the like by pattern matching processing. The person detection unit PS1 may use other authentication means such as fingerprint authentication or password input in order to identify a person.

  The person detection unit PS1 outputs a detection signal to the communication control unit TC1 when an operator is detected. Note that the person detection unit PS1 may output a non-detection signal to the communication control unit TC1 when no operator is detected, or may not output any signal.

  In addition, the person detection unit PS1 may output any signal to the communication control unit TC1 periodically (for example, in increments of 0.1 seconds). When the state changes (from the non-detection state to the detection state) Any of the signals may be output to the communication control unit TC1 only when the detection state is reached or when the detection state is changed to the non-detection state.

  Further, the person detection unit PS1 may include an IC card reader and detect an operator by inserting the IC card into the IC card reader.

  The communication control unit TC1 is means for receiving a signal from the person detection unit PS1 and controlling communication between the multi-function MFP M1 and the remote control PC. For example, the communication control unit TC1 receives a detection signal from the person detection unit PS1. Communication between the multi-function MFP M1 and the remote control PC is permitted when received, and communication between the multi-function MFP M1 and the remote control PC is received when a non-detection signal is received from the person detection unit PS1. Network router to be blocked.

  Note that the person detection unit PS1 and the communication control unit TC1 are independent of the device main body unit MB1 and the operation panel unit OP1, and even when the device main unit MB1 or the operation panel unit OP1 is illegally operated by a network intruder, The person detection unit PS1 or the communication control unit TC1 is prevented from being illegally operated, and the security is improved.

  The operation panel unit OP1 transmits image data from the communication I / F unit T1 to the communication control unit TC1 in order to share the display screen between the multi-function MFP M1 and the remote operation PC. For example, the image data is divided into packets in order to use TCP / IP, and is transmitted from the multi-function multifunction peripheral M1 to the remote operation PC via the network.

  When the communication control unit TC1 receives a detection signal from the person detection unit PS1, the communication control unit TC1 transfers the image data received from the communication I / F unit T1 of the operation panel unit OP1 to the remote operation PC, and from the person detection unit PS1 When the detection signal is received, the image data transmitted by the communication I / F unit T1 of the operation panel unit OP1 is blocked without being transferred to the remote operation PC.

  Next, a process in which the multi-function multifunction peripheral M1 controls communication with the remote control PC will be described with reference to FIG.

  First, the multi-function MFP M1 sends image data from the communication I / F unit T1 of the operation panel unit OP1 to the network (when the communication control unit TC1 receives image data from the communication I / F unit T1). The person detection unit PS1 detects whether or not there is a person in the vicinity (step ST1).

  When a person is detected around the multi-function multifunction peripheral M1 (YES in step ST1), the person detection unit PS1 outputs a detection signal to the communication control unit TC1, and the communication control unit TC1 that has received the detection signal receives the operation panel. Packet transfer from the unit OP1 to the network (remote control PC) is permitted (step ST2).

  In this case, the communication control unit TC1 is installed in the communication control unit TC1 to indicate to the outside that the image data has been transmitted over the network and the display screen has been shared between the multi-function MFP M1 and the remote control PC. The screen sharing LED (Light Emitting Diode) lamp is turned on (step ST3).

  On the other hand, when a person is not detected around the multi-function peripheral M1 (NO in step ST1), the person detection unit PS1 outputs a non-detection signal to the communication control unit TC1, and receives the non-detection signal. Prohibits packet transfer from the operation panel unit OP1 to the network (remote operation PC) (step ST4).

  In this case, the communication control unit TC1 turns on a warning indicator installed in the communication control unit TC1 or outputs an alarm from the alarm device (step ST5), and suspects unauthorized access to the multi-function MFP M1. Inform the outside that there is.

  With the above configuration, the multi-function multifunction peripheral M1 can prevent browsing of confidential documents and the like on an external remote control PC without limitation using the screen sharing function.

  The multi-function MFP M1 may be a device that prohibits remote operation from a remote operation PC and permits only remote monitoring, or is a device that has only a remote monitoring function without a remote operation function. It may be an OA device, a home appliance, an AV device, a ticket machine, a reservation machine, a mobile phone, or the like.

  In addition, the multi-function MFP M1 uses the VNC to share the display screen with the remote operation PC in real time, but updates the shared screen displayed on the remote operation PC at predetermined intervals (for example, 1 second). The shared screen may be updated only when the display screen is changed.

  Further, the remote operation PC may acquire the display screen at predetermined intervals (for example, every second) using the automatic reading function of JavaScript, for example, and may display the shared screen on the web browser.

  Next, a method for generating a display screen or a shared screen by the operation panel unit OP1 will be described. The operation panel unit OP1 is assumed to be an embedded device that employs Windows (registered trademark) XP Embedded as an OS (Operating System), for example.

  For example, the screen generation unit G1 of the operation panel unit OP1 generates a display screen in which a plurality of windows are arranged on the background image, displays the display screen on the multi-function multifunction peripheral M1, and displays the display screen on the remote operation PC. Display the corresponding shared screen.

  Further, the screen generation unit G1 changes the layer attribute of the window to make the predetermined window transparent (non-display state) and prevent the predetermined window from being browsed by the remote operation PC.

  “Layer attribute” is one of the properties of the window. By changing the layer attribute, the window can be made semitransparent or a predetermined color can be made transparent.

  The layer attribute is changed using Windows (registered trademark) XP Embedded API (Application Program Interface) which is an attribute setting means. For example, by adding WS_EX_LAYERED to the extended style of the window by the SetWindowLong function, or the SetLayeredAttributes function Or by using the UpdateLayeredWindow function.

  4 to 6 are diagrams for explaining processing for making a window non-displayable by changing a layer attribute.

  FIG. 4 is a diagram illustrating a configuration example of a virtual memory area that is a storage unit that stores image data (screen information) generated by the image generation unit G1, and includes a desktop drawing memory area R1 and a layer attribute window drawing memory area R2. Show. Note that the virtual memory area is disposed in the RAM of the operation panel control unit 221, for example.

  The “desktop drawing memory area” is a memory area in which the device context of the window displayed on the desktop screen is stored. The “layer attribute window drawing memory area” has a layer attribute in the Windows (registered trademark) OS. A memory area that stores the device context of a window.

  FIG. 5 is a diagram for explaining a method of using the desktop drawing memory area R1 and the layer attribute window drawing area R2.

  The OS combines the screen information in the desktop drawing memory area R1 and the screen information in the layer attribute window drawing area R2, and writes the combined screen information into a VRAM (Video RAM) by a display driver. The screen information written in the VRAM is displayed on the display device. Note that the screen information in the layer attribute window drawing region R2 includes information for realizing a special effect such as making a window transparent.

  The screen sharing server unit S1 transmits the screen information written in the desktop drawing memory area R1 to the screen sharing client unit C of the remote operation PC, and displays the shared screen on the display device of the remote operation PC.

  FIG. 6 is a diagram for explaining processing in which the image data acquisition unit 11 of the screen sharing server unit S1 acquires screen information.

  The image data acquisition unit 11 acquires only the screen information stored in the desktop drawing memory area R1, and does not acquire the screen information stored in the layer attribute window drawing area R2. Thereby, the screen information regarding the window with the layer attribute (for example, a window for previewing an image scanned by the scanning unit 206 or a window for displaying image data stored in the hard disk 208) is as follows. It is not combined with the screen information in the desktop drawing memory area R1.

  FIG. 7 is a diagram illustrating an example of a display screen displayed on the display unit 224 in the operation panel unit OP1 of the multi-function peripheral M1. FIG. 7 shows a state in which a window W for displaying a preview of the image scanned by the scanning unit 206 is displayed on the background image BG. The window W has a layer attribute, but the background image BG has no layer attribute.

  FIG. 8 is a diagram showing an example of a shared screen displayed on the display device of the remote operation PC, and is displayed as a result of the screen sharing server unit S1 acquiring the display screen shown in FIG. 7 in real time and transmitting it to the remote operation PC. Indicates a shared image.

  As shown in FIG. 8, the multi-function MFP M1 has screen attributes stored in a layer attribute window drawing area R2 different from the desktop drawing memory area R1 to which the layer attribute is given and the screen information of the background image BG is stored. The window W is not displayed on the shared screen.

  Next, another method for generating a display screen or a shared screen by the operation panel unit OP1 will be described.

  For example, the screen generation unit G1 of the operation panel unit OP1 generates a display screen in which a plurality of windows are arranged on the background image BG, displays the display screen on the multi-function multifunction peripheral M1, and displays the display screen on the remote operation PC. Display the shared screen corresponding to.

  For example, the screen generation unit G1 draws a window using a GDI (Graphic Driver Interface) installed in a Windows (registered trademark) OS as a drawing means, while overlay display by a graphic accelerator as another drawing means ( For example, a predetermined window (for example, a window for previewing an image scanned by the scanning unit 206 or a window for displaying image data stored in the hard disk 208) is drawn by using DirectDraw overlay display. Finally, the image data of the windows and the image data of the predetermined window are combined to generate a display screen.

  Accordingly, the screen generation unit G1 can display the predetermined window on the display unit 224 of the operation panel unit OP1 without storing the screen information of the predetermined window in the desktop drawing memory area R1, and as a result, all the windows are displayed. Can be displayed on the display unit 224 of the operation panel unit OP1.

  On the other hand, since the screen generation unit G1 does not store the screen information of the predetermined window in the desktop drawing memory area R1, the image data acquisition unit 11 of the screen sharing server unit S1 is a part of the screen information stored in the desktop drawing memory area R1. A shared screen that does not include a predetermined window in which screen information is not stored in the desktop drawing memory area R1 is displayed on the display device of the remote control PC.

  FIG. 9 is a diagram for explaining a drawing mechanism using GDI and DirectDraw. In general, various applications running on the Windows (registered trademark) OS generate screen information based on a GDI drawing command, and store the generated screen information in the desktop drawing memory area R1.

  In addition, various applications store the screen information stored in the desktop drawing memory area R1 by the display driver DDI unit in the VRAM.

  On the other hand, an application that draws a window using DirectDraw notifies the DirectDraw drawing command to the display driver DirectDraw unit, causes the display driver DirectDraw unit to generate screen information in the hardware image processing unit of the display adapter, and outputs the screen information to the VRAM. Remember me.

  Regardless of which means of the GDI drawing command or the DirectDraw drawing command is adopted, the display device of the remote control PC displays the shared screen based on the screen information stored in the VRAM.

  As described above, the multi-function peripheral M1 draws the window for previewing the image scanned by the scan unit 206 and the window for displaying the image data stored in the hard disk 208 using the DirectDraw drawing command. A window that may contain confidential information is not displayed on the display device of the remote control PC.

  As a result, examples of the display screen displayed on the display unit 224 in the operation panel unit OP1 of the multi-function MFP M1 and the shared screen displayed on the display device of the remote operation PC use the above-described layer attribute. Like FIG. 7, it becomes as shown in FIG. 7 and FIG.

  Next, a predetermined window discrimination process by the multi-function peripheral M1 will be described.

  For example, when the multifunction machine M1 does not display the window generated by the application for previewing the scanned image “Preview.exe” on the display device of the remote operation PC, “Preview.exe” is generated. The window is recognized by an identifier such as the window name “scan preview” or the window class “Viewclass”, and the predetermined window is not displayed on the display device of the remote operation PC.

  FIG. 10 is a flowchart showing a flow of processing for discriminating a window to be displayed on the display device of the remote control PC by the multi-function MFP M1.

  First, when generating a new image data (window), the screen generation unit G1 in the operation panel unit OP1 of the multi-function multifunction peripheral M1 determines whether to display the window on the display device of the remote operation PC. (Step ST11).

  When the window class of the newly generated window is “Viewclass” (YES in step ST11), the screen generation unit G1 determines that the window should not be displayed on the display device of the remote control PC, and generates the generated image data. Is stored in the layer attribute window drawing memory area R2, and the process is terminated.

  On the other hand, if the window class of the newly generated window is not “Viewclass” (NO in step ST11), the screen generation unit G1 determines that the window should be displayed on the display device of the remote control PC, and generates the window The stored image data is stored in the desktop drawing memory area R1, and then the screen data is acquired from the desktop drawing memory area R1 by the image data acquisition unit 11 (step ST12), and the acquired screen information is remotely transmitted by the image data transmission unit 12. The data is transmitted to the operation PC (step ST13), and the process is terminated.

  In addition to the window class, the screen generation unit G1 may determine whether to display on the display device of the remote operation PC based on the window name and the execution application name.

  Further, when the display area of the window generated by the application is fixed (for example, the display area of the window W in FIG. 7 is (200, 0), (200, 300), (300, 0)). , (300, 300) is fixed to a rectangular area defined by four XY coordinates.) By displaying a background image BG or the like in the display area, the preview image is displayed on the display device of the remote control PC. May not be displayed.

  In this case, when generating a new window, the screen generation unit G1 in the operation panel unit OP1 of the multi-function MFP M1 displays the window on the display device of the remote operation PC based on the area where the window is displayed. It is determined whether or not to perform.

  A newly generated window display area is a predetermined area (an area registered in advance by the multi-function multifunction peripheral M1 as an invisible area on the display device of the remote control PC, hereinafter referred to as a “sharing prohibited area”). In this case, the screen generation unit G1 determines that the window should not be displayed on the display device of the remote control PC, and stores the generated image data in the layer attribute window drawing memory area R2.

  On the other hand, when the display area of the newly generated window is not the sharing prohibition area, the screen generation unit G1 determines that the window should be displayed on the display device of the remote operation PC, and displays the generated image data on the desktop drawing. The screen information is stored in the memory area R1, and then the screen data is acquired from the desktop drawing memory area R1 by the image data acquisition unit 11, and the acquired screen information is transmitted to the remote operation PC by the image data transmission unit 12.

  The screen generation unit G1 does not make the above-described determination, so that the background image BG is always displayed in the sharing prohibited area so that confidential information such as a preview image is not displayed on the display device of the remote operation PC. It may be.

  Furthermore, when the display area of the window generated by the application fluctuates, the screen generation unit G1 notifies the application of the display area every time the display area of the window fluctuates, and the background image BG or the like is displayed in the notified display area. The preview image may not be displayed on the display device of the remote control PC.

  FIG. 11 explains the flow of processing for determining whether or not the screen generating unit G1 displays the window on the display device of the remote control PC when the display area of the window generated by the application fluctuates.

  First, the screen generation unit G1 displays information related to a display area (hereinafter referred to as “scheduled area”) of a window to be displayed by an activated application (for example, an application for previewing a scanned image). It is acquired (step ST21), and it is determined whether or not the scheduled area is different from the display area currently set as the sharing prohibition area (hereinafter referred to as “current area”) (step ST22).

  When the scheduled area is different from the current area (YES in step ST22), the screen generating unit G1 cancels the setting of the current area as the sharing prohibition area and newly sets the scheduled area as the sharing prohibition area (step ST23).

  When the scheduled area is equal to the current area (NO in step ST22), the screen generation unit G1 maintains the setting in which the current area is the sharing prohibition area as it is.

  Meanwhile, the screen generation unit G1 monitors the state of the activated application (step ST24), and updates the sharing prohibition area based on the relationship between the planned area and the current area until it is detected that the application has ended (step ST24). From step ST21 to step ST23).

  When it is detected that the application has ended (YES in step ST24), the screen generation unit G1 cancels the setting of the sharing prohibited area (step ST25), and the display screen displayed on the display unit 224 is displayed as it is on the remote control PC. Display on the device.

  Note that the screen generation unit G1 may monitor one or more applications.

  With the above configuration, even when the position of the window to be displayed by the application on the shared screen changes, the multi-function MFP M1 updates the sharing prohibited area every time the window position changes, and the sharing prohibited area Other areas can be displayed on the display area of the remote control PC while only the windows in the window are invisible.

  FIG. 12 is a functional block diagram showing another configuration example of the multi-function multi-function peripheral that is the remotely monitored apparatus according to the present invention.

  The multi-function multifunction device M2 includes an apparatus main body unit MB2, an operation panel unit OP2, a communication control unit TC2, and a person detection unit PS2, and is connected to a network via a communication I / F unit T2 of the operation panel unit OP2. Remotely operated by the operation PC.

  Compared with the multi-function multifunction device M1 in FIG. 2, the multi-function multifunction device M2 is different in that the communication control unit TC2 is disposed between the apparatus main body MB2 and the operation panel unit OP2. Common.

  The communication control unit TC2 is a means for receiving a signal from the person detection unit PS2 and controlling communication between the apparatus main body unit MB2 and the operation panel unit OP2. For example, the communication control unit TC2 receives a detection signal from the person detection unit PS2. When receiving, the communication between the device main body MB2 and the operation panel OP2 interconnected by the RS-232C standard serial cable is permitted, and when the non-detection signal is received from the person detection unit PS1, the device main body Communication between MB2 and operation panel unit OP2 is prohibited.

  Next, a process in which the multi-function multifunction peripheral M2 controls communication with the remote control PC will be described with reference to FIG.

  First, when the multi-function MFP M2 transmits a screen generation signal from the apparatus body MB2 to the operation panel unit OP2 (when the communication control unit TC2 receives a screen generation signal from the apparatus body MB2), the person detection unit It is detected by PS1 whether or not a person is present in the vicinity (step ST11).

  Here, the “screen generation signal” refers to a control signal for causing the screen generation unit G2 of the operation panel unit OP2 to generate a display screen.

  When a person is detected around the multi-function multifunction peripheral M2 (YES in step ST11), the person detection unit PS2 outputs a detection signal to the communication control unit TC2, and the communication control unit TC2 that has received the detection signal A screen generation signal is transferred from unit MB2 to operation panel unit OP2 (step ST12).

  In this case, the communication control unit TC2 is installed in the communication control unit TC2 to indicate that the image data is transmitted over the network and the display screen is shared between the multi-function MFP M2 and the remote control PC. The screen sharing LED lamp is turned on (step ST13).

  On the other hand, when a person is not detected around the multi-function peripheral M2 (NO in step ST11), the person detection unit PS2 outputs a non-detection signal to the communication control unit TC2, and receives the non-detection signal. Shuts off the screen generation signal from the apparatus main body MB2 to the operation panel OP2 (step ST14).

  In this case, the communication control unit TC2 turns on a warning indicator installed in the communication control unit TC2 or outputs an alarm from the alarm device (step ST15), and suspects unauthorized access to the multi-function MFP M2. Inform the outside that there is.

  In this case, since the screen generation signal is blocked by the communication control unit TC2, the multi-function MFP M2 does not display the display screen on the display unit 224 of the operation panel unit OP2, but there is a person around the multi-function MFP M2. There is no problem because it does not exist.

  With the above configuration, the multi-function multifunction peripheral M2 can prevent the confidential document or the like from being browsed by an external remote control PC without limitation using the screen sharing function.

  The apparatus body MB2 and the operation panel OP2 may be interconnected using TCP / IP, or may be interconnected using USB 2.0, PCI-Express, parallel communication, IEEE 1394, or the like. Good. The connection may be wired or wireless.

  FIG. 14 is a functional block diagram showing another configuration example of the multi-function multi-function peripheral that is the remotely monitored apparatus according to the present invention.

  The multi-function multifunction device M3 includes an apparatus main body MB3, an operation panel unit OP3, a communication control unit TC3, and a person detection unit PS3. A network is connected from the communication I / F unit T3 of the operation panel unit OP3 via the communication control unit TC3. And remotely operated by a remote operation PC.

  Compared with the multi-function multi-function peripheral M1 in FIG. 2, the multi-function multi-function peripheral M3 includes a screen generation unit G3 and a screen sharing server unit S3 arranged in the apparatus main body MB3, an image data reception unit 1401, a screen data transfer unit 1402, and The input event transfer unit 1403 is different in that it is arranged in the operation panel unit OP3, and is common in other points.

  The multi-function MFP M3 generates a display screen displayed on the display unit 224 of the operation panel unit OP3 in the apparatus main body unit MB3 by the screen generation unit G3, and generates the generated image data by the screen sharing server unit S3. Send to.

In this case, the relationship between the apparatus main body MB3 and the operation panel unit OP3 via the screen sharing server unit S3 is such that the multi-function MFP M1 (operation panel unit OP1) and the remote operation PC via the screen sharing server unit S1. (Refer to FIG. 2).
The image data receiving unit 1401 is a means for receiving the image data transmitted by the apparatus main body unit MB3, and corresponds to the screen sharing client unit C in the remote operation PC. The image data receiving unit 1401 displays a display screen on the display unit 224 based on the received image data.

  The screen data transfer unit 1402 is means for transferring the image data received by the image data receiving unit 1401 to the remote operation PC.

  The input event transfer unit 1403 is means for transferring input event information in the remote operation PC to the screen sharing server unit S3 of the apparatus main body unit MB3.

  With this configuration, the multi-function MFP M3 does not need to generate the image data related to the display screen displayed on the display unit 224 or the shared screen displayed on the display device of the remote control PC in the operation panel unit OP3, and the apparatus main body unit MB3. Since it is only necessary to transfer the image data received from the control unit OP3, the processing load on the operation panel unit OP3 can be reduced.

  The multi-function MFP M3 transmits image data assigned with a predetermined identifier from the apparatus main body MB3 to the operation panel unit OP3, and remotely transmits only image data assigned with the predetermined identifier to the image data transfer unit 1402. By transferring the information to the operation PC, the confidential information may not be displayed on the display device of the remote operation PC.

  For example, the multi-function MFP M3 assigns a transfer prohibition identifier to image data related to a window for previewing an image scanned by the screen generation unit G3, and assigns a transfer permission identifier to image data related to the background image BG. Only the image data related to the background image BG can be displayed on the display device of the remote operation PC by transmitting from the apparatus body MB3 to the operation panel OP3.

  As another means for determining whether transfer is possible, the multi-function MFP M3 may include a screen sharing server unit and a screen data transfer unit for each application.

  FIG. 15 is a functional block diagram showing another configuration example of the multi-function multi-function peripheral that is the remotely monitored apparatus according to the present invention.

  The multi-function multifunction device M4 includes an apparatus main body unit MB4, an operation panel unit OP4, a communication control unit TC4, and a person detection unit PS4, and is connected to a network via a communication I / F unit T4 of the operation panel unit OP4. Remotely operated by the operation PC.

  Compared with the multifunctional multifunction machine M3 in FIG. 14, the multifunctional multifunction machine M4 is different in that the communication control unit TC4 is disposed between the apparatus main body part MB4 and the operation panel part OP4. Common.

  With this configuration, the multi-function multifunction peripheral M4 does not need to cause the operation panel unit OP4 to generate image data related to the display screen displayed on the display unit 224 or the shared screen displayed on the display device of the remote operation PC, and the apparatus main body unit MB4. Therefore, the processing load on the operation panel unit OP4 can be reduced.

  In addition, since the multi-function MFP M4 controls communication between the apparatus main body MB4 that generates image data and the operation panel unit OP4, image data leaks even when the operation panel unit OP4 is illegally operated. Can be prevented and security can be further enhanced.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Other embodiments may be included.

  For example, in the above-described embodiment, the communication control unit and the person detection unit are arranged either between the apparatus main body unit and the operation panel unit or between the operation panel unit and the network. And a person detection unit may be arranged.

  In the above-described embodiment, the image data is generated by the screen generation unit arranged in either the apparatus main body unit or the operation panel unit. However, the operation panel unit generates image data related to confidential information, and other image data. May be generated by the apparatus main body, or image data related to confidential information may be generated by the apparatus main body, and other image data may be generated by the operation panel unit. In addition, only other image data generated by any of them may be displayed on the display device of the remote control PC to prevent leakage of confidential information.

It is a figure for demonstrating the operating principle of VNC. It is a functional block diagram (the 1) which shows the structural example of the remote monitoring apparatus which concerns on this invention. 4 is a flowchart illustrating a flow of processing in which a communication control unit controls communication between a multi-function multifunction peripheral and a remote control PC. It is a figure which shows the structural example of the virtual memory area which memorize | stores the image data which the image generation part produced | generated. It is a figure for demonstrating the usage method of a desktop drawing memory area and a layer attribute window drawing area. It is a figure for demonstrating the process in which the image data acquisition part of a screen sharing server part acquires screen information. 6 is a diagram illustrating an example of a display screen displayed on a display unit of an operation panel unit in a multi-function multifunction peripheral. FIG. It is a figure which shows the example of the share screen displayed on the display apparatus of remote control PC. It is a figure for demonstrating the drawing mechanism by GDI and DirectDraw. 10 is a flowchart showing a flow of processing for determining a window to be displayed on the display device of the remote control PC by the multi-function MFP. It is a flowchart which shows the flow of the process which determines whether a screen production | generation part displays a window on the display apparatus of remote control PC. It is a functional block diagram (the 2) which shows the structural example of the remote monitoring apparatus which concerns on this invention. It is a flowchart which shows the flow of the process in which a screen production | generation part determines whether a window is displayed on the display apparatus of remote control PC. It is a functional block diagram (the 3) which shows the structural example of the remote monitoring apparatus which concerns on this invention. It is a functional block diagram (the 4) which shows the structural example of the remote monitoring apparatus which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Image data acquisition part 12 Image data transmission part 13 Input event creation part 14 Input event reception part 15 Image data reception part 16 Image data display part 17 Input event transmission part 18 Input event acquisition part 200 Image input part 201 Image formation part 202 Image Input control unit 203 Image output control unit 204 Copy unit 205 Printer unit 206 Scan unit 207 FAX unit 208 Hard disk 209 RAM
210 communication unit 211 to operation panel communication unit 212 main body control unit 220 to main body communication unit 221 operation panel control unit 222 input processing unit 223 operation key 224 display unit 225 coordinate detection unit BG background image C screen sharing client unit G1 to G4 screen generation Part M1-M4 Multi-function MFP MB1-MB4 Main unit OP1-OP4 Operation panel part PS1-PS4 Person detection part R1 Desktop drawing memory area R2 Layer attribute window drawing memory area S, S1-S4 Screen sharing server part T, T1 ~ T4 Communication I / F part TC1 ~ TC4 Communication control part W Window

Claims (11)

A remote monitoring device for displaying a display screen of the remote monitoring device on the remote monitoring device;
A person detecting means for detecting the presence or absence of a person around the remote monitoring device;
Communication control means for controlling communication between the remote monitoring apparatus and the remote monitoring apparatus based on a detection result by the person detection means;
A remotely monitored apparatus characterized by comprising: An apparatus main body provided with a main body control unit;
An operation panel unit including an operation panel control unit that operates independently from the main body control unit;
The remotely monitored apparatus according to claim 1, comprising: The remote monitoring device communicates with the device main body through the operation panel unit,
The communication control unit cuts off communication between the operation panel unit and the remote monitoring device when the person detection unit does not detect a person around the remote monitoring device;
The remotely-monitored apparatus according to claim 2. The remote monitoring device communicates with the device main body through the operation panel unit,
The communication control unit cuts off communication between the operation panel unit and the apparatus main body when the person detection unit does not detect a person around the remote monitoring device;
The remotely-monitored apparatus according to claim 2. Screen generation means for generating a screen from a plurality of image data;
Attribute setting means for setting attributes of image data,
The screen generation means generates a screen in which the image data set with a predetermined attribute value by the attribute setting means is invisible;
The remote monitoring apparatus according to claim 1, wherein the remote monitoring apparatus is a remote monitoring apparatus. Screen generation means for generating a screen from a plurality of image data;
Storage means for storing the plurality of image data in separate areas,
The screen generation means generates a screen in which the image data stored in the predetermined area of the storage means is invisible;
The remote monitoring apparatus according to claim 1, wherein the remote monitoring apparatus is a remote monitoring apparatus. Screen generation means for generating a screen from a plurality of image data;
A plurality of drawing means for drawing image data in a video memory;
The screen generating means generates a screen in which image data drawn by a predetermined drawing means is invisible;
The remote monitoring apparatus according to claim 1, wherein the remote monitoring apparatus is a remote monitoring apparatus. The screen generating means is disposed in the apparatus main body.
The remote monitoring apparatus according to claim 5, wherein the remote monitoring apparatus is a remote monitoring apparatus. A screen sharing method for sharing a display screen of a remote monitoring device with a remote monitoring device via a network,
A person detection step for detecting the presence or absence of a person around the remote monitoring device;
A communication control step of controlling communication between the remote monitoring device and the remote monitoring device based on a detection result in the person detection step;
A screen sharing method characterized by comprising:   A screen sharing program for causing a computer to execute the screen sharing method according to claim 9.   The computer-readable recording medium which recorded the program of Claim 10.

Images