JP6413911B2 - Operation instruction system, operation instruction program, and operation instruction method - Google Patents

Description

  The present invention relates to an operation instruction system, an operation instruction program, and an operation instruction method in which an operator remotely instructs a user who operates a terminal device such as a printer.

  For example, a user who operates an image forming apparatus such as a printer may contact the operator by telephone or the like when the operation method is unknown, but it is difficult for the operator to give an appropriate operation instruction to the user by telephone or the like. There is a case.

  On the other hand, in Patent Document 1, an information processing apparatus on the operator side and an image forming apparatus on the user side are connected via a network, and an operation screen of the image forming apparatus on the user side is displayed on the information processing apparatus on the operator side. Technology is disclosed.

  On the operation screen on the operator side, a position to be operated by the user can be specified as an operation instruction. On the other hand, on the operation screen on the user side, a pointer is displayed at a position designated by the operator, and the operation instruction can be grasped.

  However, in Patent Document 1, an operation instruction input operation is troublesome because an operation screen of the image forming apparatus on the user side is displayed on the information processing apparatus on the operator side to input an operation instruction.

  Further, in Patent Document 1, since only a pointer as an operation instruction is shown on the operation screen on the user side, there is a possibility that the operator's operation instruction cannot be surely recognized by the user.

  Furthermore, there is a problem that it is difficult for the operator to grasp the user's operation content after the operation instruction.

JP 2006-140898 A

  The problem to be solved by the present invention is that the operator cannot easily and reliably give an operation instruction to the user, and the user's operation content cannot be confirmed.

The present invention includes a user-side system unit having a first terminal device operated by a user, an operator-side system unit having a second terminal device operated by an operator, and connected to the user-side system unit by a network; The user-side system unit and the operator-side system unit establish a connection as a counterpart system, and the operator-side system unit receives a first operation on the first terminal device and receives a first operation A first operation display unit that displays an operation screen; a first imaging unit that images the first operation display unit in response to the start of the first operation on the first operation display unit; In response to the start of the first operation on the first operation display unit, the first captured image of the first operation display unit by the first imaging unit is displayed on the user side system. A first image transmission unit that transmits to the second, which receives the second captured image transmitted from the user side system unit said received to the first operation display section
A second display control unit that displays the captured image and displays the second captured image that is being displayed in response to the start of the first operation on the first operation display unit, The user-side system unit receives a second operation on the second terminal device and displays a second operation screen, and a first imaging transmitted from the operator-side system unit An image is received, the received first captured image is displayed on the second operation display unit, and the first displayed image is displayed in response to the start of the second operation on the second operation display unit. A second display control unit that does not display the captured image, and the second operation in response to the start of the second operation on the second operation display unit.
A second imaging unit that captures the operation display unit, a second of said second operation display unit according to the second imaging unit in accordance with the start of the second operation in the second operation display section The main feature is an operation instruction system including a second image transmission unit that transmits the captured image to the operator system unit.

  According to the present invention, the start of the operation on the terminal device of the user side system unit and the operator side system unit is used as a trigger, and the actual operation on the terminal device of the own system unit is displayed on the counterpart system unit and confirmed with the user or the operator. Can be made.

  Therefore, it is possible to simply and reliably give an operation instruction to the user by the operator, and the operator can confirm the operation content by the user.

It is a conceptual diagram which shows the operation instruction | indication system which concerns on one Example of this invention. It is a block diagram which shows the detail of the terminal device of the operation instruction system of FIG. It is a flowchart which shows the flow of the operation instruction process by the operation instruction system of FIG.

  When a user or one of the operators starts the operation of the operation display unit on the terminal device in order to simply and surely instruct the user to perform an operation instruction and to confirm the user's operation content, the operation is performed. This was realized by displaying a captured image obtained by imaging the operation display unit in the operation display unit on the other side of the user and the operator.

[Configuration of operation instruction system]
FIG. 1 is a conceptual diagram showing an operation instruction system according to an embodiment of the present invention.

  The operation instruction system 1 is configured by connecting a user-side system unit 3 a and an operator-side system unit 3 b via a network 5. The user side system unit 3a is shown only for a single user, but can be provided for each of a plurality of users.

  The user-side system unit 3a is a set of devices having a terminal device 7a (hereinafter, also referred to as “user terminal device”) operated by a user, and is constructed at a place where the user terminal device 7a such as an office is installed. .

  The operator-side system unit 3b is a set of devices having a terminal device 7b (hereinafter sometimes referred to as “operator terminal device”) operated by an operator, and is constructed in a remote place such as a service center.

  In the present embodiment, the user terminal device 7a and the operator terminal device 7b themselves each include necessary devices to constitute the user side system unit 3a and the operator side system unit 3b. The user terminal device 7a and the operator terminal device 7b are image forming apparatuses such as printers and digital multi-function peripherals having the same configuration that are mutually partner terminal devices (partner system units).

  FIG. 2 is a block diagram showing details of the terminal device of the operation instruction system 1 of FIG. In FIG. 2, one of the user terminal device 7 a and the operator terminal device 7 b having the same configuration will be mainly described as the terminal device 7.

  The terminal device 7 includes a network communication unit 9, an operation display unit 11, an imaging unit 13, a voice input unit 15, a voice output unit 17, a storage unit 19, a control unit 21, and the like.

  The network communication unit 9 is a device that transmits and receives data via the network 5.

  The operation display unit 11 includes a screen unit 11a and hard keys 11b. The screen unit 11a is a touch panel screen, and displays an operation input by an operator and an operation state. The screen unit 11a of the present embodiment displays an operation screen 23 (see the user terminal device 7a in FIG. 1) and accepts an operation input from an operator (user or operator) by selecting the soft key 24. In addition, the screen unit 11a can display a captured image 25 described later (see the user terminal device 7a in FIG. 1).

  The hard key 11b is, for example, a group of buttons arranged around the screen unit 11a, and accepts an operator's operation input when pressed.

  The imaging unit 13 is an imaging device such as a CCD camera or a CMOS camera, and generates an image data by imaging the operation display unit 11 operated by an operator. The imaging range of the imaging unit 13 is a range including both the screen unit 11a and the hard key 11b, but can be changed as appropriate.

  The voice input unit 15 includes a microphone and generates voice data by voice input.

  The audio output unit 17 includes a speaker and outputs audio based on audio data.

  The storage unit 19 is a storage device including a ROM (Read Only Memory) that stores data and programs necessary for processing, a RAM (Random Access Memory) as a work area, an HDD (Hard Disk Drive) as an auxiliary storage device, and the like. is there.

  The control unit 21 is an arithmetic processing device such as a CPU (Central Processing Unit), and controls each unit of the terminal device 7 by executing a program. The control unit 21 of the present embodiment functions as a remote connection unit 27, an operation start monitoring unit 29, an imaging control unit 31, an image transmission unit 33, and a display control unit 35 by executing a program in the storage unit 19.

  The remote connection unit 27 realizes a remote connection function, accepts a remote connection request on the operation display unit 11, and performs remote connection between the terminal device 7 and the counterpart terminal device, that is, between the user terminal device 7a and the operator terminal device 7b. Establish a remote connection. By this remote connection, the operation start monitoring unit 29, the imaging control unit 31, the image transmission unit 33, and the display control unit 35 can function in each terminal device 7.

  The operation start monitoring unit 29 implements an operation start monitoring function, and monitors the start of an operation by the operator on the operation display unit 11. When the operation start is detected, the operation start monitoring unit 29 transmits an operation start notification to the counterpart terminal device which is the counterpart system unit.

  The start of the operation can be determined by a specific operation input on the operation display unit 11, such as a touch operation on the screen unit 11a of the operation display unit 11 or a depression of the hard key 11b.

  When the captured image 25 is displayed as will be described later, an “operation” button (hereinafter referred to as an “operation button 37 a”), which is a soft key displayed on the guide screen 37 including the captured image 25, is selected. The operation start monitoring unit 29 determines the start of the operation. The operation button 37a is used to input that the display of the captured image 25 is ended and the operation on the operation display unit 11 is started.

  In addition, the start of the first operation after the establishment of the remote connection can be notified by the operation start monitoring unit 29 upon receiving a notification that a guide button 24a (to be described later) has been selected on the counterpart terminal device. It is.

  The imaging control unit 31 realizes an imaging control function, and realizes an imaging function together with the imaging unit 13 by controlling imaging by the imaging unit 13. The imaging control unit 31 causes the imaging unit 13 to start capturing a moving image in response to the start of an operation by the operator on the operation display unit 11. The imaging control unit 31 according to the present exemplary embodiment starts the voice input by the voice input unit 15 together with the imaging by the imaging unit 13.

  Further, the imaging control unit 31 stops the imaging in the imaging unit 13 and the voice input by the voice input unit 15 when the operation on the operation display unit 11 is finished. This can be performed, for example, according to the operation start notification transmitted from the counterpart terminal device.

  The image transmission unit 33 realizes an image transmission function, and transmits the captured image 25 of the operation display unit 11 by the imaging unit 13 to the counterpart terminal device in response to the start of the operation on the operation display unit 11. Transmission of the captured image 25 is continuously performed by the counterpart terminal device.

  In transmitting the captured image 25, the image transmission unit 33 transmits audio data together with the image data of the captured image 25. However, the audio data can be omitted.

  The display control unit 35 realizes a display control function, receives the captured image 25 transmitted from the counterpart terminal device, and receives it on the operation screen 23 of the operation display unit 11 like the user terminal device 7a of FIG. The captured image 25 is displayed. In addition, the display control unit 35 outputs the sound received together with the captured image 25 by the sound output unit 17. Display of the captured image 25 and audio output are started in response to an operation start notification transmitted from the counterpart terminal device.

  In the example of FIG. 1, the operation screen 23 is displayed on the entire screen unit 11 a of the operation display unit 11 of the user terminal device 7 a, and the captured image 25 is displayed over a part of the operation screen 23. Further, the captured image 25 is arranged in the guide screen 37 in the example of FIG.

  The guide screen 37 is displayed in a pop-up by selecting a “guide” button (hereinafter referred to as “guide button 24 a”), which is one of the soft keys 24 on the operation screen 23. In this case, the display control unit 35 may transmit a notification that the guide button 24a has been selected to the counterpart terminal. The guide screen 37 can be automatically displayed in response to an operation start notification from the counterpart terminal device or the reception of the captured image 25.

  The guide screen 37 can be displayed on the entire screen unit 11a instead of the operation screen 23. The captured image 25 may be displayed directly on the operation screen 23 or instead of the operation screen 23 instead of being displayed in the guide screen 37.

  The display control unit 35 hides the displayed captured image 25 in response to the start of the operation by the operator on the operation display unit 11.

[Operation instruction processing]
FIG. 3 is a flowchart showing a flow of operation instruction processing by the operation instruction system 1 of FIG.

  Before starting the operation instruction process, a user who does not know the operation method makes an inquiry to the operator by telephone or the like. Through this inquiry, the operator makes the user make a remote connection from the user terminal device 7a to the operator terminal device 7b, or makes a remote connection from the operator terminal device 7b to the user terminal device 7a.

  When the remote connection between the user terminal device 7a and the operator terminal device 7b is thus established, the operation instruction process is started.

  In the operation instruction processing that has been started, in this embodiment, the operator first performs a model operation on the operator terminal device 7b, and the user terminal device 7a views a video of the model operation as the operation instruction. Let

  Next, the user and the operator are switched, and the user who has browsed the operation instruction operates on the user terminal device 7a, and the operator browses and confirms the operation video on the operator terminal device 7b.

  After that, the user and the operator are alternately switched as necessary, so that the operator can show the model and confirm the user's operation.

  In step S <b> 1, a determination is made of “has an operation on the operator terminal device started?”. That is, in the operator terminal device 7b, the operation start monitoring unit 29 determines whether or not the operator has started an operation on the operation display unit 11.

  This determination can be made based on, for example, a specific operation input on the operation display unit 11 of the operator terminal device 7b or a notification that the guide button 24a is selected on the user terminal device 7a.

  When the operation on the operator terminal device 7b is started, the operation start monitoring unit 29 transmits an operation start notification to the user terminal device 7a and proceeds to step S2 (YES), and when the operation is not started, The process of step S1 is repeated (NO).

  In step S2, “start imaging of the operation display unit of the operator terminal device” is executed. That is, in the operator terminal device 7b, the imaging control unit 31 causes the imaging unit 13 to start moving image imaging of the operation display unit 11. In the present embodiment, the imaging control unit 31 of the operator terminal device 7b causes the voice input unit 15 to start voice input (voice acquisition). As a result, it is possible to capture a moving image with sound of an operation by an operator as a model.

  Next, in step S3, “transmission of captured image to user terminal device” is executed. That is, in the operator terminal device 7b, the image transmission unit 33 continuously transmits the generated image data and audio data to the user terminal device 7a in response to the moving image capturing and audio input started in step S2.

  In step S4, “image display on user terminal device” is executed. That is, in the user terminal device 7a, the display control unit 35 receives an operation start notification, image data, and audio data transmitted from the operator terminal device 7b. In response to this, the user terminal device 7a displays the received captured image 25 in the guide screen 37 on the operation screen 23 of the operation display unit 11 as shown in FIG. Is output.

  Thereby, the user can browse the moving image with sound of the operation by the operator as a model on the user terminal device 7a, and can easily and reliably grasp the operation instruction of the operator. Therefore, the user can operate the user terminal device 7a in accordance with an operation instruction according to the operator's model.

  Since the captured image 25 is displayed in the guide screen 37 according to the present embodiment, the user terminal device 7a indicates that the user selects the guide button 24a on the operation screen 23 in advance or notifies the start of operation. It is necessary to display the guide screen 37 according to reception or the like. When the guide button 24a is selected in advance, if the notification is transmitted to the operator terminal device 7b, it can be used to determine the operation start on the operator terminal device 7b in step S1.

  After step S4 is completed in this way, in steps S5 to S8, the user (user terminal device 7a) and the operator (operator terminal device 7b) are switched, and the same processing as in steps S1 to S4 is performed.

  In step S <b> 5, a determination is made as to “has an operation on the user terminal device started”? That is, in the user terminal device 7a, the operation start monitoring unit 29 determines whether or not the user has started an operation on the operation display unit 11.

  This determination can be made, for example, based on whether or not the operation button 37a displayed on the guide screen 37 including the captured image 25 is selected.

  When the operation on the user terminal device 7a is started, the operation start monitoring unit 29 transmits an operation start notification to the operator terminal device 7b and proceeds to step S6 (YES), and when the operation is not started, The process of step S5 is repeated (NO).

  In step S <b> 6, “start imaging of the operation display unit of the user terminal device” is executed. Here, the display control unit 35 of the user terminal device 7a hides the guide screen 37 including the captured image 25 on the operation display unit 11 in response to the start of the operation. In the user terminal device 7a, the imaging control unit 31 causes the imaging unit 13 and the audio input unit 15 to start moving image imaging and audio input, respectively.

  Note that in the operator terminal device 7b, since the operation by the operator has been completed, the imaging control unit 31 stops moving image imaging and audio input by the imaging unit 13 and the audio input unit 15. These stops can be performed in response to an operation start notification from the user terminal device 7a.

  Next, in step S7, “transmission of the captured image to the operator terminal device” is executed. That is, in the user terminal device 7a, the image transmission unit 33 continuously transmits the image data and sound data of the captured image 25 generated in response to moving image capturing and sound input to the operator terminal device 7b.

  In step S8, “image display on the operator terminal device” is executed. That is, in the operator terminal device 7b, the display control unit 35 displays the captured image 25 in the guide screen 37 of the operation display unit 11 and from the audio output unit 17 in response to reception of the operation start notification, image data, and audio data. Output audio.

  Thereby, the operator can browse the moving image with sound of the operation by the user who has browsed the model on the operator terminal device 7b, and can easily and reliably grasp the operation content of the user. Therefore, the operator can confirm whether or not there is an error in the user's operation.

  When step S8 is completed in this way, the operation instruction process of this embodiment is completed.

  In addition, when an operator shows an example again, in step S5-S8, a user (user terminal device 7a) and an operator (operator terminal device 7b) may be simply replaced and processed.

  Also, in this embodiment, the explanation is given for the case where the operator first shows an example and then the user performs an operation according to the example. However, even if the user performs the operation first and then the operator shows the example after that. Good. In this case, in steps S1 to S8, the user (user terminal device 7a) and the operator (operator terminal device 7b) may be simply switched to perform the processing.

[Effect of Example 1]
As described above, the operation instruction system 1 according to the present embodiment includes the user terminal device 7a (user side system unit 3a) operated by the user and the operator terminal connected to the user terminal device 7a by the network 5 and operated by the operator. And a device 7b (operator side system unit 3b).

  The user terminal device 7a and the operator terminal device 7b have the same configuration as a partner terminal device (partner system unit), an operation display unit 11 that receives an operation on the terminal device and displays the operation screen 23, and an operation display An image capturing unit 13 that captures an image of the unit 11, an image transmission unit 33 that transmits a captured image 25 of the operation display unit 11 by the image capturing unit 13 to the counterpart terminal device in response to the start of an operation on the operation display unit 11, and a counterpart terminal device A display control unit 35 that receives the captured image 25 transmitted from the control unit 11 and displays the received captured image 25 on the operation display unit 11.

  Therefore, in this embodiment, for example, when an operator starts an operation on the operation display unit 11 of the operator terminal device 7b, an actual operation by the operator on the operation display unit 11 is performed on the operation display unit 11 of the user terminal device 7a. Can be displayed and viewed by the user.

  When the user starts an operation on the operation display unit 11 of the user terminal device 7a, an actual operation by the user on the operation display unit 11 of the user terminal device 7a is displayed on the operation display unit 11 of the operator terminal device 7b. Can be viewed by the operator.

  As described above, in this embodiment, the user terminal device 7a and the operator terminal device 7b are caused to display and confirm the actual operation in the own terminal device on the counterpart terminal device, triggered by the start of the operation in the own terminal device. Can do.

  Therefore, in this embodiment, it is possible to simply and reliably give an operation instruction to the user without using an additional display device or the like, and the operator can confirm the operation content by the user.

  In this embodiment, since the captured image 25 is displayed on the operation screen 23 of the operation display unit 11 or instead of the operation screen 23, the user looks at the captured image 25 as an operation instruction by the operator, The operation according to the operation instruction can be executed immediately without changing the setting. For this reason, a user's operation mistake can be reduced.

  In addition, since the captured image 25 includes both the screen unit 11a and the hard key 11b of the operation display unit 11, the operator can instruct the operation to the user more reliably, and the details of the operation by the user can be displayed. Can be confirmed.

  The operation instruction system 1 according to the present embodiment includes an imaging unit in which the user terminal device 7a (user-side system unit 3a) and the operator terminal device 7b (operator-side system unit 3b) are operated in response to the start of an operation on the operation display unit 11. 13 includes an imaging control unit 31 that starts imaging, and an image transmission unit 33 transmits a captured image 25 by the started imaging to a counterpart terminal device (a counterpart system unit). Therefore, in this embodiment, control can be performed easily and reliably.

  The operation instruction program according to the present embodiment is applied to the computer of the user terminal device 7a (user side system unit 3a) and the operator terminal device 7b (operator side system unit 3b). A transmission function, a display control function, and the like can be realized.

  The operation instruction method according to the present embodiment uses the imaging unit 13 as an imaging unit and the image transmission unit 33 in each of the user terminal device 7a (user-side system unit 3a) and the operator terminal device 7b (operator-side system unit 3b). This is an operation method of the operation instruction system 1 that is used as an image transmission unit and the display control unit 35 is used as a display control unit.

  Therefore, the operation instruction method can achieve the same effects as the operation instruction system 1.

  In the operation instruction system 1 of the above-described embodiment, the user terminal device 7a itself includes necessary devices such as the imaging unit 13 and the operation display unit 11 to configure the user side system unit 3a, and the operator terminal device 7b itself The operator side system unit 3b is configured with necessary equipment.

  However, the user-side system unit 3a and the operator-side system unit 3b are different from the user terminal device 7a and the operator terminal device 7b in the necessary devices such as the imaging unit 13 and the operation display unit 11 and are used as peripheral devices. You may comprise by connecting.

DESCRIPTION OF SYMBOLS 1 Operation instruction | indication system 3a User side system part 3b Operator side system part 5 Network 7 Terminal device 7a User terminal device 7b Operator terminal device 11 Operation display part 13 Imaging part 23 Operation screen 25 Captured image 27 Remote connection part 29 Operation start monitoring part 31 Imaging control unit 33 Image transmission unit 35 Display control unit

Claims (9)

A user side system unit having a first terminal device operated by a user;
An operator-side system unit connected to the user-side system unit via a network, having a second terminal device operated by an operator;
The user side system unit and the operator side system unit establish a connection with each other as a counterpart system,
The operator side system unit is
A first operation display unit that receives a first operation on the first terminal device and displays a first operation screen;
A first imaging unit that images the first operation display unit in response to the start of the first operation on the first operation display unit;
A first image of the first operation display unit by the first imaging unit is transmitted to the user-side system unit in response to the start of the first operation on the first operation display unit. An image transmission unit of
The second captured image transmitted from the user side system unit is received, the received second captured image is displayed on the first operation display unit, and the first operation display unit performs the first operation. A second display control unit that hides the second captured image being displayed in response to the start of the operation;
With
The user side system unit is:
A second operation display unit that accepts a second operation on the second terminal device and displays a second operation screen;
The first captured image transmitted from the operator side system unit is received, the received first captured image is displayed on the second operation display unit, and the second operation display unit performs the second operation. A second display control unit that hides the first captured image being displayed in response to the start of the operation;
A second imaging unit that images the second operation display unit in response to the start of the second operation on the second operation display unit;
Second transmitting a second captured image of the second operation display unit according to the second imaging unit in accordance with the start of the second operation in the second operation display section in the operator-side system part An image transmission unit of
An operation instruction system comprising: The operation instruction system according to claim 1,
The first captured image is displayed on the first operation screen or instead of the first operation screen,
The second captured image is displayed on the second operation screen or instead of the second operation screen.
An operation display system characterized by that. The operation display system according to claim 1 or 2,
The user-side system unit and the operator-side system unit include a first imaging control unit that causes the first imaging unit to start the imaging in response to the start of the operation on the first operation display unit,
The first image transmission unit transmits the first captured image by the started imaging to the other side of the user side system unit and the operator side system unit,
The user-side system unit and the operator-side system unit include a second imaging control unit that causes the second imaging unit to start the imaging in response to the start of the operation on the second operation display unit,
The second image transmission unit transmits a second captured image by the started imaging to the other side of the user side system unit and the operator side system unit,
An operation instruction system characterized by that. The operation display system according to any one of claims 1 to 3,
The first image transmission unit continuously transmits the first captured image to the operator side system unit,
The second image transmission unit continuously transmits the second captured image to the user-side system unit;
An operation instruction system characterized by that. The operation display system according to any one of claims 1 to 4,
The operator side system unit includes a first operation start monitoring unit that transmits a first operation start notification to the user side system unit in response to the start of the first operation.
The user side system unit includes a second operation start monitoring unit that transmits a second operation start notification to the operator side system in response to the start of the second operation,
The first operation display unit starts displaying the received second captured image in response to the second operation start notification,
The first imaging unit stops imaging of the first operation display unit in response to the second operation start notification,
The second operation display unit starts displaying the received first captured image in response to the first operation start notification,
The second imaging unit stops imaging of the second operation display unit in response to the first operation start notification.
An operation instruction system characterized by that. A user side system unit having a first terminal device operated by a user;
An operation support program for an operation support system having a second terminal device operated by an operator and comprising an operator side system unit connected to the user side system unit via a network,
The user side system unit and the operator side system unit establish a connection with each other as a counterpart system,
The operator side system unit is
A first operation display unit that receives a first operation on the first terminal device and displays a first operation screen;
In the computer of the operator side system unit,
A first imaging function for imaging the first operation display unit in response to the start of the first operation on the first operation display unit;
A first image transmitted from the first operation display unit by the first imaging function to the user-side system unit in response to the start of the first operation on the first operation display unit. An image transmission unit of
The second captured image transmitted from the user side system unit is received, the received second captured image is displayed on the first operation display unit, and the first operation display unit performs the first operation. A second display control function for hiding the second captured image being displayed in response to the start of the operation;
Realized,
The user side system unit is:
A second operation display unit that accepts a second operation on the second terminal device and displays a second operation screen;
In the computer of the user side system unit,
The first captured image transmitted from the operator side system unit is received, the received first captured image is displayed on the second operation display unit, and the second operation display unit performs the second operation. A second display control function for hiding the first captured image being displayed in response to the start of the operation;
A second imaging function for imaging the second operation display unit in response to the start of the second operation on the second operation display unit;
A second transmission image of the second operation display unit by the second imaging function is transmitted to the operator-side system unit in response to the start of the second operation on the second operation display unit. Image transmission function,
Realizing each
An operation instruction program characterized by that. An operation instruction program according to claim 6,
The operator side system unit includes a first operation start monitoring unit that transmits a first operation start notification to the user side system unit in response to the start of the first operation.
The user side system unit includes a second operation start monitoring unit that transmits a second operation start notification to the operator side system in response to the start of the second operation,
The first operation display unit starts displaying the received second captured image in response to the second operation start notification,
The first imaging function stops imaging of the first operation display unit in response to the second operation start notification,
The second operation display unit starts displaying the received first captured image in response to the first operation start notification,
The second imaging function stops imaging of the second operation display unit in response to the first operation start notification.
An operation instruction program characterized by that. A user side system unit having a first terminal device operated by a user;
An operator-side system unit connected to the user-side system unit via a network, having a second terminal device operated by an operator;
The user side system unit and the operator side system unit establish a connection with each other as a counterpart system,
The operator side system unit is
A first operation display unit that receives a first operation on the first terminal device and displays a first operation screen;
A first imaging unit that images the first operation display unit in response to the start of the first operation on the first operation display unit;
The first image transmission unit responds to the start of the first operation on the first operation display unit .
Transmitting a first captured image of the first operation display unit by one imaging unit to the user-side system unit;
A second display control unit that receives the second captured image transmitted from the user-side system unit, displays the received second captured image on the first operation display unit; and In response to the start of the first operation on the operation display unit, the second captured image being displayed is hidden,
The user side system unit is:
A second operation display unit that accepts a second operation on the second terminal device and displays a second operation screen;
The second display control unit receives the first captured image transmitted from the operator side system unit, displays the received first captured image on the second operation display unit, and In response to the start of the second operation on the operation display unit, the first captured image being displayed is hidden,
A second imaging unit that images the second operation display unit in response to the start of the second operation on the second operation display unit;
The second image transmission unit outputs the second captured image of the second operation display unit by the second imaging unit in response to the start of the second operation on the second operation display unit. To the side system part,
An operation instruction method characterized by the above. An operation instruction method according to claim 8, wherein
The operator side system unit includes a first operation start monitoring unit that transmits a first operation start notification to the user side system unit in response to the start of the first operation.
The user side system unit includes a second operation start monitoring unit that transmits a second operation start notification to the operator side system in response to the start of the second operation,
The first operation display unit starts displaying the received second captured image in response to the second operation start notification,
The first imaging unit stops imaging of the first operation display unit in response to the second operation start notification,
The second operation display unit starts displaying the received first captured image in response to the first operation start notification,
The second imaging unit stops imaging of the second operation display unit in response to the first operation start notification.
An operation instruction method characterized by the above.