JP2011018333A - Remote control system and processing method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a remote control system which a client terminal user and an operator use easily, and by which each remote operation, remote monitoring, remote teaching, etc. are performed smoothly.SOLUTION: A remote control server 1 receives an access request from a terminal 2, and receives screen data displayed in a display part provided in a self-terminal from the terminal 2. The remote control server 1 sequentially displays screens of the received screen data in a predetermined display part of its own device up to the number stored by means for storing the number of screens that are displayed. The remote control server obtains voice input and an image from each client terminal, and distributes the obtained voice and image to each client terminal.

Description

  The present invention relates to a remote control system for performing each remote operation, remote monitoring, class, and the like using a client terminal and a remote control server connected via a communication network, and a processing method therefor.

  In recent years, there has been a remote control system service that performs remote operations, remote monitoring, and lessons between remote operators and users by transmitting and receiving video, audio, and computer screen information between computers via a communication network. Implemented or proposed. Patent Document 1 is disclosed as a technique for performing remote control in a system that conducts classes via a communication network.

JP 2002-116684 A

  Here, this remote control system is expected to increase the number of companies, schools, cram schools, etc. that provide services such as remote control, remote monitoring, and classes, but are easy to use for client terminal operators and operators. Therefore, it is required to provide more advanced services by building a multifunctional remote control system.

  Accordingly, an object of the present invention is to provide a remote control system that can be easily used by a client terminal operator and an operator, and that can smoothly proceed with each remote operation, remote monitoring, class, and the like, and a processing method therefor.

  The present invention has been made to solve the above-described problems. (1) A remote control system in which a remote control server and a client terminal are connected via a communication network, wherein the remote control server Displayable number storage means for storing the number of screens of the client terminal that can be displayed on the display unit, and access request reception means for receiving an access request including at least attribute information of a client terminal operator who operates the client terminal from the client terminal Screen data receiving means for receiving screen data displayed on the display unit provided in the terminal from the client terminal, and storing the number of displayable screens of the received screen data on the predetermined display unit. Display processing means for sequentially displaying up to the number stored in the means, the client terminal or the previous The remote control server includes voice input receiving means for receiving voice input, video acquisition means for acquiring video, and voice input detection information notifying means for notifying voice input detection information when the voice input is received. And the remote control server includes distribution means for distributing the input audio and the acquired video to a predetermined client terminal when the audio input detection information is received.

  (2) Further, in the remote control system according to the present invention, the remote control server includes a plurality of the predetermined display units, and the display processing unit receives the designation of the screen of the client terminal. Only the displayed screen is displayed in the entire area of any one of the plurality of display units.

  (3) Further, according to the present invention, in the above-described remote control system, a screen fixed / non-fixed information storage in which the remote control server stores a code indicating whether the size of the screen of the client terminal is fixed or non-fixed. The display processing means reads a code indicating whether the screen size is fixed or non-fixed from the screen fixing / non-fixing information storage unit based on the received instruction, and reads the code Is a code indicating fixed, the size of the screen of the client terminal is fixed and displayed on the predetermined display unit by the number stored in the displayable number storage means, and the read code is unfixed. In the case of the reference numeral, each screen of the client terminal is displayed on the predetermined display unit based on a screen display rule.

  (4) Further, in the remote control system described above, the remote control server may include a code indicating whether or not the arrangement order is set in the predetermined display unit on the screen of the client terminal operator. Screen arrangement information storage means for storing, and the display processing means reads a code indicating whether the arrangement order is set or not from the screen arrangement information storage means based on the received instruction. In the case where there is a reference sign, the screen of the client terminal is displayed on the predetermined display unit based on an arrangement order automatic setting rule.

  (5) Further, according to the present invention, in the above-described remote control system, the remote control server includes screen priority output information storage means for storing the priority attribute information of the client terminal operator and display coordinates in association with each other. The display processing means is transmitted from the client terminal that made the access request when the attribute information of the client terminal operator included in the access request is recorded in the screen priority output information storage means. The screen data screen is preferentially displayed from the upper left.

  (6) In the remote control system described above, the remote control server may multiply the number of the predetermined display units by the number of screens of the client terminal that can be displayed on the one predetermined display unit. When the obtained number is less than the number of the accepted access requests, the displayable number changing means for rewriting and increasing the number stored in the displayable number storage means is provided.

  (7) According to the present invention, in the above-described remote control system, the remote control server transmits remote operation start request information to the client terminal and remote operation start request information is transmitted to the client terminal. An end notification means, and after the client terminal accepts the remote operation start request information, an input operation lock means for discarding instruction information input from the input means, and the remote operation end notice information are accepted. Thereafter, the apparatus includes a lock release unit that stops discarding the instruction information input from the input unit.

  (8) According to the present invention, in the remote control system described above, the client terminal includes connection permission information including information indicating permission for connection to hardware provided in the terminal and identification information of the terminal. Connection permission information notifying means for notifying, wherein the remote control server stores remote target terminal storage means for storing identification information of a client terminal that permits remote operation, and identification information of the client terminal included in the connection permission information. Determining whether or not it is recorded in the remote target terminal storage means, and, if recorded, connection determination means for connecting to the client terminal that transmitted the connection permission information. And

  (9) The present invention is characterized in that information indicating permission of connection to the hardware is recorded on a recording medium removable from the terminal.

  (10) In the remote control system described above, the remote control server includes application identification information transmitting means for transmitting an application activation instruction including application identification information to a client terminal, and has received the application activation instruction. The client terminal includes application execution means for simultaneously executing an application program specified by application identification information included in the application activation instruction.

  (11) Further, in the present invention, the application activation instruction includes a file name and an argument, and the application execution unit of the client terminal searches the storage unit of the terminal for the data of the file name, The program is read with the argument and the file name data, and the application program is executed.

  (12) Further, in the remote control system described above, the remote control server includes a handwritten character input receiving unit that receives input of handwritten characters, a character data conversion unit that converts the handwritten characters into character data, Character data display means for sequentially transmitting the converted character data to the client terminal, wherein the client terminal sequentially displays the received character data on a text editor displayed on the display unit of the terminal itself And.

  (13) Further, according to the present invention, in the above-described remote control system, the remote control server stores operation command specifying information storage means for storing a list of operation command specifying information for specifying each operation command input to the own device; Operation command recording means for reading the operation command specifying information corresponding to the operation command input to the own apparatus from the operation command specifying information storage means and sequentially recording it in the operation log storage means, and a predetermined display unit of the own apparatus Capture image recording means for sequentially recording captured images of the screen displayed on the captured image storage means at predetermined intervals, load information of the communication network connected to the own apparatus, and load information of each processing unit of the own apparatus Load information recording means for sequentially recording the information in the load information storage means, and reproducing means for reproducing the captured image. And butterflies.

  (14) According to the present invention, in the remote control system described above, the client terminal stores operation command specifying information storage means for storing a list of operation command specifying information for specifying each operation command input to the terminal. An operation command identification information reading unit that reads the operation command identification information corresponding to the operation command input to the terminal from the operation command identification information storage unit, and a captured image of a screen displayed on the display unit of the terminal itself are predetermined. Capture image acquisition means for acquiring at intervals, load information acquisition means for acquiring load information of a communication network connected to the own apparatus and load information of each processing unit of the own apparatus, the read operation command specifying information, and the Client terminal operation for transmitting the acquired captured image and the load information to the remote control server And a grayed information transmitting means, said remote control server is characterized by comprising a reproducing means for reproducing the captured image.

  (15) In the remote control system described above, the client terminal further includes an on-screen coordinate transmission unit that transmits the on-screen coordinates of the mouse pointer displayed on the display unit of the terminal to the remote control server. The remote control server is configured to display a display position storage means for storing a display position of the screen for each client terminal on the predetermined display unit, and to display the screen of the client terminal that has transmitted the in-screen coordinates. And a mouse displayed on the display position of the predetermined display unit based on the display position of the predetermined display unit and the coordinates in the screen. And an enlargement display processing means for enlarging and displaying a predetermined range based on the pointer.

  (16) According to the present invention, in the above-described remote control system, the client terminal reads environment setting information indicating various program operation settings of its own terminal from the storage unit and transmits the environment setting information to the remote control server. The remote control server includes a support staff access destination recording unit that records an access destination of the support staff terminal corresponding to the environment setting information, and the support staff based on the environment setting information transmitted from the client terminal. A communication connection unit configured to read the access destination of the support person from the access destination recording unit and to connect communication between the read access destination and the client terminal which has transmitted the environment setting information.

  (17) According to the present invention, in the above-described remote control system, a management server is connected to the communication network, and the management server includes identification information of a client terminal operator who operates the client terminal, and a remote control server. According to a combination with the identification information of the operator who operates, the remote control server comprises a restriction item storage means for storing restriction item information when remotely operating the client terminal, the remote control server, When an instruction for remote operation of the client terminal is received, it is recorded in the restriction item storage means in association with the combination of the identification information of the client terminal to be remotely operated and the identification information of the operator who operates the own device. A restriction item acquisition means for acquiring the restriction item information, and based on the acquired restriction item information. Te, characterized in that and an operation command specifying means for specifying the operation commands that can be sent to the remote operation target of the client terminal.

  (18) According to the present invention, in the above-described remote control system, the remote control server transmits keyboard image display instruction information for prompting the client terminal to display a keyboard image, keyboard image display instruction means, Key identification display instruction information notifying means for transmitting key identification display instruction information, including key identification information and identification display information to be added to the key, wherein the terminal stores a keyboard image. And keyboard image display means for reading the keyboard image from the keyboard image storage means on the basis of the reception of the keyboard image display instruction information and displaying it on a display unit, and the key identification information included in the key identification display instruction information The key in the displayed keyboard image is identified based on the Characterized in that it comprises a key image changes display means changes display on the basis of the identification information adding keys to the keys, the.

  (19) Further, according to the present invention, in the above-described remote control system, the remote control server performs a remote operation on the client terminal in association with the identification information of the client terminal of the remote operation target or the voice transmission destination. Corresponding time recording means for recording the recorded time or time for transmitting the voice in the corresponding time storage means, and displaying the total time recorded in the corresponding time storage means on the predetermined display unit for each identification information of the client terminal Response time display means, and warning information output means for outputting warning information when the total time exceeds a preset reference response time.

  (20) The present invention is also a processing method in a remote control system in which a remote control server and a client terminal are connected via a communication network, wherein the displayable number storage means of the remote control server includes a predetermined display unit. Storing the number of screens of the client terminal that can be displayed on the remote control server, wherein the access request accepting means of the remote control server accepts an access request including at least attribute information of a client terminal operator who operates the client terminal from the client terminal, The screen data receiving means of the remote control server accepts screen data displayed on the display section of the client terminal from the client terminal, and the display processing means of the remote control server is on the predetermined display section. Number to store the screen of the received screen data in the displayable number storage means And the client terminal operator attribute storage means of the remote control server stores the user name of the client terminal operator, the identification information of the client terminal, and the access destination of the client terminal in association with each other, and The screen sharing permission receiving unit of the control server receives the screen sharing permission information including the identification information of the own terminal from the client terminal, and the user name reading unit of the remote control server transmits the screen sharing permission information. The name is read from the client terminal operator attribute storage means based on the identification information, and the access destination reading means of the remote control server acquires the identification information of other client terminals that perform screen sharing, and these client terminals The access destination of the client terminal operator attribute storage means Read, the screen data distribution means of the remote control server synthesizes the read user name with the screen data of the client terminal that has transmitted the screen sharing permission information, and distributes to the read access destination To do.

  (21) Further, in the processing method described above, the present invention provides that the remote control server includes a plurality of the predetermined display units, and the display processing unit receives the designation of the screen of the client terminal. Only the designated screen is displayed in the entire area of any one of the plurality of display units.

  (22) Further, in the processing method described above, the screen fixing / non-fixing information storage unit of the remote control server stores a code indicating whether the screen size of the client terminal is fixed or non-fixing. Then, the display processing means reads a code indicating whether the screen size is fixed or non-fixed from the screen fixing / non-fixing information storage means based on the received instruction, and the read code is fixed. Is a code indicating that the screen of the client terminal is fixed and displayed on the predetermined display unit by the number stored in the displayable number storage means, and the read code indicates non-fixed In this case, each screen of the client terminal is displayed on the predetermined display unit based on a screen display rule.

  (23) Further, according to the present invention, in the processing method described above, the screen arrangement information storage means of the remote control server is either set with or without setting the arrangement order in the predetermined display section of the screen of the client terminal operator. The display processing unit reads the code indicating whether the arrangement order is set or not from the screen arrangement information storage unit based on the received instruction, and reads the code. In the case of the presence of “”, the screen of the client terminal is displayed on the predetermined display unit based on an arrangement order automatic setting rule.

  (24) Furthermore, in the processing method described above, the screen priority output information storage unit of the remote control server stores the priority attribute information of the client terminal operator and display coordinates in association with each other, When the attribute information of the client terminal operator included in the access request is recorded in the screen priority output information storage unit, the display processing unit transmits screen data transmitted from the client terminal that has made the access request. The screen is preferentially displayed from the upper left.

  (25) According to the present invention, in the processing method described above, the displayable number changing means of the remote control server can display the screen of the client terminal that can be displayed on the predetermined display unit in the number of the predetermined display units. When the number obtained by multiplying the number is less than the number of the received access requests, the number stored in the displayable number storage unit is rewritten and increased.

  (26) In the processing method described above, the remote operation start request unit of the remote control server transmits remote operation start request information to the client terminal, and the input operation lock unit of the client terminal includes After receiving the remote operation start request information, discard the instruction information input from the input means, the remote operation end notification means of the remote control server transmits the remote operation end notification information, and unlocks the client terminal After receiving the remote operation end notification information, the means stops discarding the instruction information input from the input means.

  (27) Further, in the above processing method, the present invention provides that the connection permission information notifying means of the client terminal includes information indicating permission for connection to the hardware provided in the terminal and identification information of the terminal. The remote target terminal storage means of the remote control server stores identification information of the client terminal that permits remote operation, and the connection determination means of the remote control server is included in the connection permission information Determining whether the identification information of the client terminal is recorded in the remote target terminal storage means, and if it is recorded, the connection to the client terminal that transmitted the connection permission information is performed. Features.

  (28) Further, in the above processing method according to the present invention, information indicating permission of connection to the hardware is recorded on a recording medium removable from the terminal. Remote control system.

  (29) Also, in the processing method described above, the present invention provides that the application identification information transmitting unit of the remote control server transmits an application activation instruction including application identification information to a client terminal and receives the application activation instruction. The application execution means of the terminal is characterized in that the application program specified by the application identification information included in the application activation instruction is executed all at once.

  (30) Further, in the processing method according to the present invention, the application activation instruction includes a file name and an argument, and the application execution unit of the client terminal stores the data of the file name in a storage unit of the own terminal And the application program is loaded with the argument and the data of the file name, and the application program is executed.

According to the present invention, the remote control server accepts an access request from a client terminal, and accepts screen data displayed on a display unit provided in the own terminal from a client terminal operator terminal. Then, the screens of the received screen data are sequentially displayed on a predetermined display unit up to the number stored in the displayable number storage unit. Thereby, since the operator who uses a remote control server can see the screen of a some client terminal at once, each remote operation, remote monitoring, and the service of a lesson form can be performed. Here, when sound is input from the client terminal to which the sound is input or the remote control server, it is possible to distribute the sound together with the video to each client terminal. As a result, each terminal using the remote control system can see the screen of the other terminal, and further, the sound and video are output, so that the state of the other client terminal operator can be grasped. Can do.

According to the invention, the display processing unit of the remote control server to display a screen of the terminal based on various rules on a predetermined screen, which makes it possible to perform smoothly the lectures by remote control system.

  According to the present invention, after the client terminal receives the remote operation start request information from the remote control server, the instruction information input from the input means is discarded, and the remote operation end notification information is received from the remote control server. After the acceptance, the discarding of the instruction information input from the input unit is stopped. As a result, when the client terminal is remotely operated using the remote control server, the client terminal operator operates the client terminal without permission, thereby delaying each remote operation, remote monitoring, course progress, etc. Can be prevented.

  According to the present invention, the remote control server receives the connection permission information from the client terminal, and determines whether or not the identification information of the client terminal included in the connection permission information is recorded in the remote target terminal storage means. If it is recorded, the connection to the client terminal that transmitted the connection permission information is made. As a result, it is possible to prohibit remote operation from a remote control server to a client terminal that is not permitted.

  According to the present invention, the remote control server transmits an application activation instruction to the client terminal, and the client terminal executes the application program specified by the application identification information included in the application activation instruction. Thereby, the program of the application designated as the remote control server can be executed simultaneously on the terminal using the remote control system.

  Moreover, according to this invention, a remote control server receives the input of a handwritten character, converts the handwritten character into character data, and transmits the converted character data to a client terminal sequentially. Then, the client terminal sequentially displays the received character data on a text editor displayed on the display unit of the terminal itself. Thereby, since the handwritten character input to the remote control server can be displayed on the text editor on the terminal side, the character input to the remote control server by the operator can be edited later.

  Further, according to the present invention, operation commands, screens, and load information input in the remote control server are recorded. Thereby, an unauthorized operation by the operator can be prevented. Further, according to the present invention, operation commands, screens, and load information input at the client terminal are recorded. Thereby, an unauthorized operation by the client terminal operator can be prevented. Moreover, since the recorded screen can be reproduced, it is possible to easily grasp the operation status of the operator or the client terminal operator by reproducing it at a later date.

  According to the present invention, the client terminal transmits the in-screen coordinates of the mouse pointer displayed on the display unit of the own terminal to the remote control server, and the remote control server transmits the mouse pointer on the screen of the client terminal. The area around the position is enlarged and displayed on a predetermined display unit. As a result, the screen of the client terminal is normally displayed in a small size on the monitor of the remote control server, so it is difficult to see, but this process allows the client terminal operator to easily grasp the location designated by the mouse pointer. .

  In addition, according to the present invention, only when audio is input from a client terminal or a remote control server to which audio is input, video acquired by that terminal or remote control server is distributed to other terminals. As a result, only the video of the speaker can be distributed to other terminals, so that the video of all the other terminals connected to the remote control server need not be displayed on the display unit.

  Further, according to the present invention, the support terminal to be connected to the terminal 2 is determined based on the environment setting information. Thereby, it is possible to correspond to an appropriate support person in the event of a failure. In addition, since an environment capable of supporting is constructed, the client terminal operator can easily contact the support staff.

  In addition, according to the present invention, a client terminal and a function that can be remotely operated are specified for each combination of a client terminal operator and a remote control server operator. Thereby, it is possible to limit the remote operation.

  In addition, according to the present invention, since the keys input on the operator side can be displayed on the terminal side, the client terminal operator can press the keys in an appropriate order, which is appropriate when pressing a plurality of keys. I will be able to explain.

  Further, since the corresponding time for each client terminal operator is measured, the time can be appropriately distributed with respect to guidance for each client terminal operator.

  In addition, since the remote control server and the terminal can control the amount of screen data to be distributed, the load can be divided and the system can be operated without stress.

It is a block diagram which shows the structure of a remote control system. It is a figure which shows the example of the connection management table which a data storage part memorize | stores. It is a figure which shows the example of the user attribute table which a data storage part memorize | stores. It is a figure which shows the example of the operator side monitor setting table which a data storage part memorize | stores. It is a figure which shows the flow of the screen display process in a remote control system. It is a figure which shows the processing flow at the time of delivering the screen of a terminal to another terminal. It is a figure which shows the processing flow of the input operation lock in a terminal. It is a figure which shows the example of the hardware management information table which the memory | storage part of a terminal memorize | stores. It is a figure which shows the example of the external media management information table which the memory | storage part of a terminal memorize | stores. It is a figure which shows the example of the remote permission user separate information table which the data storage part of a remote control server memorize | stores. It is a figure which shows the example of the remote operation management information table which the data storage part of a remote control server memorize | stores. It is a figure which shows the processing flow until the remote operation of a terminal is permitted. It is a figure which shows the processing flow at the time of synchronizing the application which a terminal uses. It is a figure which shows the flow of the process which displays the character which the operator input into the remote control server on a terminal. It is a figure which shows the example of the operation definition file which the remote control server hold | maintains at the data storage part. It is a figure which shows the example of the operation log file which the remote control server hold | maintains at the data storage part. It is a figure which shows the processing flow at the time of monitoring remote operation by an operator. It is a figure which shows the processing flow at the time of monitoring operation of the terminal by the client terminal operator at the time of remote control system connection. It is a figure which shows the example of the remote operation restriction item table which the management server hold | maintains at the data storage part. It is a figure which shows the processing flow at the time of restrict | limiting the remote operation of the terminal by an operator. It is a figure which shows the example of the display expansion setting information table which the remote control server hold | maintains at the data storage part. It is a figure which shows the processing flow at the time of enlarging and displaying on the monitor of a remote control server the part corresponding to the position of the mouse point which the client terminal operator designated on the terminal. It is a figure which shows the processing flow at the time of outputting the audio | voice and image | video acquired with the terminal with another terminal or a remote control server. It is a figure which shows the flow of the process which distributes the support request notified from the terminal for every content of support. It is a figure which shows the processing flow in the case of keyboard operation description. It is a figure which shows the processing flow at the time of managing the client terminal operator response time of an operator. It is a figure which shows the processing flow of the remote control server in charge of a self-study room, and a terminal.

Hereinafter, a remote control system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a remote control system according to the embodiment.
In this figure, reference numeral 1 is a remote control server, 2 is a client terminal operator's terminal, and 3 is a management server for managing the remote control server 1. The remote control server 1, the terminal 2, and the management server 3 are connected via a communication network.

  In the remote control server 1, reference numeral 101 denotes a communication processing unit that transmits and receives information to and from the terminal 2 via a communication network. Reference numeral 102 denotes a control unit that controls each processing unit of the remote control server 1. Reference numeral 103 denotes a screen processing unit that performs processing for displaying the screen of each terminal 2 on a predetermined monitor provided in the remote control server 1 based on the screen data transmitted from the terminal 2 of the client terminal operator. An application control processing unit 105 instructs the terminal 2 to execute an application program. Reference numeral 106 denotes a character data transmission processing unit that converts manually input characters input to the remote control server 1 into character data and transmits the character data to the terminal 2.

  Reference numeral 107 denotes a remote operation processing unit that performs remote operation processing from the remote control server 1 of the terminal 2. Reference numeral 108 denotes a log acquisition processing unit that acquires logs of various operations in the remote control server 1. Reference numeral 109 denotes a voice or video information from a microphone or camera provided in the remote control server 1 or a voice or video information transmitted from the terminal 2 to another terminal 2 or a monitor of its own device. It is a video / audio processing unit that outputs to a speaker. Reference numeral 110 denotes a support processing unit that performs processing for connecting to a terminal of a support person based on a support request from the terminal 2. A data storage unit 111 stores various data.

  In the terminal 2, reference numeral 201 denotes a communication processing unit that transmits and receives information to and from the remote control server 1. A control unit 202 controls each processing unit of the terminal 2. Reference numeral 203 denotes an operation lock processing unit that performs a process of locking and releasing an input operation in the terminal 2. An application processing unit 204 performs processing corresponding to each application. Reference numeral 205 denotes a mouse coordinate notification processing unit for notifying the remote control server 1 of the coordinates of the mouse pointer displayed on the monitor of the terminal 2 in the monitor. Reference numeral 206 denotes a log acquisition processing unit that acquires logs of various operations in the terminal 2. An environment setting information notification processing unit 207 transmits environment setting information indicating operation settings of various programs of the own terminal to the remote control server 1 based on an instruction from the client terminal operator. Reference numeral 208 denotes a remote operation permission unit that performs processing for permitting the remote control server 1 to perform remote operation of its own device. A text display processing unit 209 sequentially displays character data sent from the remote control server 1 using a text editor. Reference numeral 210 denotes a video / audio processing unit that transmits video / audio information input from a microphone or camera provided in the terminal 2 to the remote control server 1. Reference numeral 211 denotes a storage unit that stores various types of information.

  In this embodiment, the remote control system is used to remotely operate the remote control system when the client terminal operator and the operator who are remotely connected via the communication network perform each remote operation, remote monitoring, and class. Processing of the control server 1 and the terminal 2 will be described. In FIG. 1, there is one remote control server 1 and one terminal 2, but actually a plurality of terminals 2 are connected to the remote control server 1. There may also be a plurality of remote control servers 1. The remote control server 1 includes one or more monitors. And each process mentioned later at the time of performing each remote operation, remote monitoring, and class through a screen between the remote control server 1 and the terminal 2 via a communication network is performed.

FIG. 2 is a diagram illustrating an example of a connection management table stored in the data storage unit.
FIG. 3 is a diagram illustrating an example of a user attribute table stored in the data storage unit.
FIG. 4 is a diagram showing an example of the operator side monitor setting table stored in the data storage unit.
As shown in FIG. 2, in the connection management table a, a connection status code indicating whether or not the client terminal operator connects the terminal 2 to the remote control server 1 in association with the client terminal operator ID. (Connection: 1, no connection: 0), resolution of the monitor provided in the terminal 2 (vertical × horizontal [pixel]), line speed of the communication network used by the client terminal operator, and client terminal operator ID The IP address of the terminal 2 used by the client terminal operator, the ID of the monitor of the remote control server 1 on which the screen of the terminal 2 is displayed, the screen number indicating the display position of the screen on the monitor, and the like are recorded.
As shown in FIG. 3, the user attribute table b is associated with the client terminal operator ID and includes information such as name, residence area, electronic payment means information (credit card name, card number), EC usage history, and the like. Is recorded.
As shown in FIG. 4, the operator side monitor setting table c includes the number of monitors included in the remote control server 1, the upper limit number of screens that can be displayed on each monitor, fixed / non-fixed display size information, and the order of arrangement. Yes / No information (if yes: connection order, ID order, name order, credit card number order, residence area order, EC usage history order, etc.), priority client terminal operator ID, display individual settings Information such as nothing (if present: client terminal operator ID / upper left coordinates of screen) is recorded.

FIG. 5 is a diagram showing a flow of screen display processing in the remote control system.
Next, screen display processing in the remote control server of the remote control system will be described with reference to FIGS.
First, the client terminal operator instructs the terminal 2 to access the remote control server 1. Then, the control unit 202 transmits an access request including the client terminal operator ID to the remote control server 1 via the communication network (step S101). Further, the control unit 202 of the terminal 2 transmits the screen data output to the monitor of the own terminal together with the access request to the remote control server 1 (step S102). In the remote control server 1, when the control unit (access request accepting unit, screen data accepting unit) 102 accepts the access request, the control unit 102 notifies the screen processing unit 103 of the client terminal operator ID and instructs the screen processing. (Step S103). Next, the screen processing unit 103 counts the number of connected terminals 2 from the information of the connection status “connected” / “not connected” recorded in the connection management table of the database 111 (step S104). Further, the resolution, line speed, terminal 2 IP address, etc. of each terminal 2 are read from the connection management table a (step S105). Further, based on the ID of the connected client terminal operator, the attributes (name, residence area) of the client terminal operator are read from the user attribute table b (step S106).

  Further, the screen processing unit (display processing unit) 103 reads “the number of monitors included in the remote control server 1” and “the maximum number of screens that can be displayed on one monitor” from the operator side monitor setting table c (displayable number storage unit). "," Display size (fixed, non-fixed) "," Arrangement order (Yes, No) "," Priority client terminal operator ID "," Presence / absence of individual display settings "corresponding to the accessed client terminal operator ID Are read (step S107). Based on the information read from the connection management table a, the user attribute table b, and the operator-side monitor setting table c, the monitor of the remote control server 1 that displays the screen of the accessed terminal 2 by the processing described later, The display position is determined (step S108).

<Screen display processing A>
First, when the upper limit number of screens that can be displayed is m, the number of monitors included in the remote control server 1 is n, and the number of connections is x, the first monitor when the number of connections x is 1 ≦ x ≦ m, The monitor that displays the screen of the terminal 2 is determined as m <x ≦ 2m, and so on. The display position on the monitor is the first when the remainder of x ÷ m is “0”. When the position (for example, the upper left corner of the monitor) and the remainder of x ÷ m is “1”, the second position (left of the first position). When the value obtained by multiplying n and m is less than the value of x, the screen processing unit 103 displays “one monitor” recorded in the operator-side monitor setting table c (displayable number changing means). The upper limit number m of screens that can be displayed is increased by 1. Thereby, the monitor which displays the screen of the terminal 2, and its position can be determined. When the number of monitors is insufficient, the number of screens that can be displayed on one monitor is increased, so that the screens of the accessed terminals can be displayed without omission.

<Screen display processing B>
When the “display size” read from the operator side monitor setting table c (screen fixed / non-fixed information storage means) by the screen processing unit 103 is “fixed”, all of them have the same predetermined size, The screens are displayed on the monitor in order up to “the maximum number of screens that can be displayed on the monitor”. Further, when “display size” is “non-fixed”, “when an area for displaying a screen is left on one monitor, an already displayed screen is enlarged according to the size of the remaining area”. It is displayed based on the screen display rule program. Note that the screen display rule processing is not limited to this processing.

<Screen display processing C>
Further, when the setting of “arrangement order” read from the operator-side monitor setting table c (screen arrangement information storage unit) by the screen processing unit 103 is a code indicating “present”, for example, connection order, ID order, name order, The screens are displayed in order using any one of the arrangement order automatic setting rules such as the order of residence areas.

<Screen display processing D>
If the “display size” read from the operator side monitor setting table c by the screen processing unit 103 is information indicating “fixed” and the read “display individual setting” setting information indicates “present”, the client terminal The “screen upper left coordinates” associated with the operator ID and recorded in the operator side monitor setting table c are read, and the screen based on the screen data transmitted from the terminal 2 of the client terminal operator is displayed based on the coordinates. indicate.

<Screen display processing E>
When the ID of the accessed client terminal operator is included in the “priority client terminal operator ID” read from the operator side monitor setting table c (screen priority output information storage means) by the screen processing unit 103, The screen of the screen data transmitted from the terminal 2 of the client terminal operator is preferentially displayed from the upper left.

<Screen display processing F>
Further, the screen processing unit 103 displays the name information read from the user attribute table b at a predetermined position on the screen on the screen displayed on the monitor.

<Screen display processing G>
In addition, the screen processing unit 103 includes a plurality of monitors, and when the designation of any of the screens displayed on the monitor is accepted, only the screen is displayed in the entire area of the specific monitor for full screen display. Magnify and display.

FIG. 6 is a diagram illustrating a processing flow when a terminal screen is distributed to another terminal. Next, processing for distributing the screen of the terminal to the terminal of another client terminal operator will be described with reference to FIG.
First, when the client terminal operator instructs the terminal 2 to start screen sharing (step S201), the terminal 2 transmits information indicating screen sharing permission including the client terminal operator ID to the remote control server 1 (step S202). ). When the control unit 102 (screen sharing permission receiving unit) of the remote control server 1 receives the screen sharing permission information, the screen processing unit (user name reading unit, access destination reading unit, screen data distribution unit, user name display unit) Based on the client terminal operator ID 103 included in the screen sharing permission information 103, the name of the client terminal operator is read from the user attribute table b (client terminal operator attribute storage means) of the data storage unit 111 (step S203). . Further, the screen processing unit 103 acquires the IP address of another terminal 2 that performs screen sharing (step S204). This IP address is the IP address of each terminal 2 corresponding to the screen displayed on the monitor provided in the remote control server 1 (that is, the client terminal whose “connection status” is “connected” in the connection management table a) The IP address corresponding to the operator ID) may be all or a plurality of them, or may be included in advance in the screen sharing permission information transmitted from the terminal 2. Then, screen data obtained by synthesizing the read name is generated on the screen of the terminal 2 that transmitted the screen sharing permission information (step S205), and distributed to the IP address of the other terminal 2 (step S206). Then, the other distributed terminals 2 display the screen of the terminal 2 with the name of the client terminal operator who operates the terminal 2 that has transmitted the screen sharing permission information on the monitor. Thereby, it is possible to grasp which client terminal operator's screen is the screen of the other terminal to be displayed on each terminal 2.

FIG. 7 is a diagram showing a processing flow of input operation lock in the terminal.
Next, a process for locking an input operation at the terminal will be described with reference to FIG.
First, an operator using the remote control server 1 can remotely operate the terminal 2 using the remote control server 1. In the initial process of the remote operation, when the operator instructs the remote control server 1 to start the remote operation (step S301), the remote operation processing unit (remote operation start request means, remote operation end notification means) 107 is connected to the terminal 2. The remote operation is connected to (step S302). Then, the terminal 2 performs a remote operation connection (remote operation permission) from the remote control server 1 (step S303). Next, the remote operation permission unit 208 of the terminal 2 that has performed the remote operation connection is input to the operation lock processing unit (input operation lock unit, lock release unit) 203 from the subsequent input unit (mouse or keyboard). The instruction information is instructed to be discarded, and is set (step S304). When the input operation lock processing unit 203 locks the input operation, the input operation lock processing unit 203 notifies the remote control server 1 of the completion of the input operation lock (step S305). Then, when the remote operation processing unit 107 operates, a remote operation is started based on an instruction from the operator (step S306).

  When the remote operation is finished, when the operator instructs the remote control server 1 to that effect (step S307), the remote operation processing unit 107 transmits information indicating the end of the remote operation to the terminal 2 (step S308). . When the terminal 2 receives the information indicating the end of the remote operation, the operation lock processing unit 203 thereafter releases the lock of the input operation (step S309). With the above processing, when the remote operation of the terminal 2 is performed from the remote control server 1, the input operation to the terminal 2 by the client terminal operator can be locked. For example, each remote operation using the remote control system , To prevent remote operation, remote monitoring, and lessons from progressing smoothly due to the client terminal operator operating the screen without permission in remote monitoring and explanations through the screen. I can do it.

FIG. 8 is a diagram illustrating an example of a hardware management information table stored in the storage unit of the terminal.
FIG. 9 is a diagram showing an example of an external media management information table stored in the storage unit of the terminal.
As shown in FIG. 8, the hardware management information table A is a code indicating whether or not a CD-ROM or DVD-ROM is inserted in association with the ID of the CD-ROM drive or the ID of the DVD-ROM drive ( (Represented by 0, 1).
Also, as shown in FIG. 9, the external media management information table B is associated with IDs of removable devices such as USB memory flashes, and codes (0, 1) indicating whether or not those devices are connected to the terminal 2. Is represented).

FIG. 10 is a diagram showing an example of the remote authorized user individual information table stored in the data storage unit of the remote control server.
FIG. 11 is a diagram illustrating an example of a remote operation management information table stored in the data storage unit of the remote control server.
As shown in FIG. 10, the remote-permitted user individual information table d stores a code indicating whether the remote operation is permitted or not permitted in association with the client terminal operator ID. As shown in FIG. 11, the remote operation management information table e stores the ID of the client terminal operator who operates the terminal 2 on which the remote operation is performed.

FIG. 12 is a diagram illustrating a processing flow until the remote operation of the terminal is permitted. Next, a processing flow until the remote operation of the terminal is permitted will be described with reference to FIGS.
First, the operator instructs the remote control server 1 to perform a remote operation (step S401). At this time, the operator designates the terminal 2 to the remote control server 1 (for example, inputs the terminal ID), and the remote operation processing unit 107 of the remote control server 1 connects to the data storage unit 111 in association with the received terminal ID. The IP address recorded in the management table a is read. Then, the remote operation permission request information is transmitted to the terminal 2 of the IP address (step S402).

  When the terminal 2 receives the remote operation permission request information, the remote operation permission unit (connection permission information notifying unit) 208 uses the code indicating “inserted” in the hardware management information table held in the storage unit 211. The ID of the CD-ROM drive or DVD drive recorded in association with each other is read (step S403). Also, the remote operation permission unit 208 reads the device ID recorded in the external media management information table in association with the code indicating “connected” (step S404). Then, the hardware of the read ID is accessed to determine whether or not the remote operation permission key is recorded, and the remote operation permission key is read (step S405).

  Here, when using the remote control system, the client terminal operator who uses the remote control system stores the software storing the remote operation permission key from a vendor operating the remote control system in a medium such as a CD-ROM. It is distributed in the form. By using this, a remote control system can be used.

  Next, when the remote operation permission key is read, the remote operation permission unit 208 transmits remote operation permission information including information indicating that remote operation is permitted to the remote control server 1 and the client terminal operator ID. (Step S406). In the remote control server 1 that has received the remote operation permission information, the remote operation processing unit (connection determination unit) 107 performs the remote authorized user individual in the data storage unit 111 based on the client terminal operator ID included in the remote operation permission information. The information of “remote operation permission” or “remote operation not permitted” recorded in the information table d (remote target terminal storage means) is read (step S407). If “remote operation is not permitted”, the remote operation process is terminated. If it is “remote operation permission”, the client terminal operator ID is recorded in the remote operation management information table e of the data storage unit 111 (step S408). Then, the remote operation processing unit 107 connects the remote operation to the terminal 2 of the client terminal operator ID in order to start the remote operation (step S409).

FIG. 13 is a diagram illustrating a processing flow when synchronizing the application used by the terminal.
Next, a process for synchronizing an application used by a terminal will be described with reference to FIG.
First, the operator instructs the remote control server 1 to start an application used by the terminal 2 (step S501). Thereby, the application control processing unit (application identification information transmitting unit) 105 of the remote control server 1 identifies the identification information (for example, the name of the execution file) of the application used in the terminal 2, and the identification information of the application, Information on an application activation instruction including information on arguments when starting the application program is transmitted to the terminal 2 (step S502). Here, the terminal 2 that transmits the application start instruction information may be, for example, the terminal 2 whose “connection status” is “connected” in the connection management table a, or an operator inputs to the remote control server 1. The terminal 2 of the client terminal operator ID may be used.

Next, when the terminal 2 receives the information on the application activation instruction (step S503), the application processing unit (application execution means) 204 determines that the application processing unit (application execution means) 204 has received the application identification information contained in the application activation instruction information. The program of the application held in is searched (step S504). If the application program can be searched as a result of the search, the application program is executed by reading the argument included in the application activation instruction into the application program (step S505). The application processing unit 204 transmits error information to the remote control server 1 when the application program cannot be executed or other errors occur (step S506).
Thereby, if an operator designates an application from the remote control server 1, the same application can be activated simultaneously on the terminals 2 connected to the remote control server 1. Therefore, when each remote operation, remote monitoring, and class is performed using a remote control system, the activation of the application on the terminal is operated without requesting each client terminal operator to start the application verbally. It is possible to proceed with each remote operation, remote monitoring and class more smoothly.

FIG. 14 is a diagram showing a flow of processing for displaying characters input by the operator on the remote control server on the terminal. Next, with reference to FIG. 14, a process of displaying characters input by the operator on the remote control server on the terminal will be described.
First, an operator is provided in the remote control server 1 and inputs handwritten characters using an electronic pen or tablet (step S601). For example, the character input by the electronic pen or tablet may be the same as the method used in the existing PDA or the like, or the character input can be performed only by the electronic pen without using the tablet. This method may be used. Then, the character data transmission processing unit (handwritten character input receiving unit, character data converting unit, character data transmitting unit) 106 converts the input handwritten character into character data (step S602).

  The character data transmission processing unit 106 notifies the converted character data to, for example, the application program processing unit of the text editor, and thereby displays the text based on the converted character data on the monitor of the remote control server 1. Next, the character data transmission processing unit 106 sequentially transmits the converted character data to the terminal 2 (step S603). The destination terminal 2 may be the terminal 2 whose “connection status” is “connected” in the connection management table a, or the terminal of the client terminal operator ID input to the remote control server 1 by the operator. 2 may be sufficient.

Next, when the terminal 2 receives the character data (step S604), the text display processing unit (character data display means) 209 activates the text editor application program (step S605), and sequentially notifies the character data to the program. (Step S606). Then, the text editor application program sequentially displays characters (step S607).
Through the above processing, the handwritten characters input by the operator to the remote control server 1 are converted into character data, and the characters of the converted character data are sequentially displayed on the terminal 2 of the client terminal operator. Accordingly, the functions of the blackboard in each remote operation, remote monitoring, and class can be realized between the terminal 2 and the remote control server 1 via the communication network. Further, handwritten characters by the operator are converted as character data and displayed on the text editor on the terminal 2 side, so that subsequent text processing can be easily performed.

FIG. 15 is a diagram illustrating an example of an operation definition file held in the data storage unit by the remote control server.
FIG. 16 is a diagram illustrating an example of an operation log file held in the data storage unit by the remote control server.
As shown in FIG. 15, the operation definition file f (operation command specifying information storage means) stores an operation command executed when the remote control server 1 remotely operates the terminal 2 and a command identification code of the operation command. The remote control server 1 holds the operation definition file f in the data storage unit 111. As shown in FIG. 15, the operation log file g includes an “operation time” in which the operation command is executed and the terminal 2 is remotely operated, and an ID of the operation target user (that is, the operation target terminal 2 that performs the operation). ID of client terminal operator to be used ”,“ IP address ”of terminal 2 to be remotely operated,“ command identification code ”of executed operation command,“ identification information of application program ”operated by executed operation command, execution In response to the operation command, the application program processes a “file name” and a captured image of the monitor.

FIG. 17 is a diagram illustrating a processing flow when a remote operation by an operator is monitored. Next, processing for monitoring the remote operation of the operator who uses the remote control server will be described with reference to FIGS.
First, when the operator performs remote operation of the terminal 2 using the remote control server 1, the remote operation processing unit 107 includes a log acquisition processing unit (operation command recording unit, captured image recording unit, load information recording unit). Means) 108, the IP address of the terminal 2 that is operating remotely, the ID of the client terminal operator who operates the terminal 2, the identification information of the application program that is operating, the file name that the application program is to process, etc. Each log information is notified to the log acquisition processing unit 108. The remote operation processing unit 107 notifies the operation command input by the operator to the terminal 2, reads the command identification code of the operation command from the operation definition file f held in the database 111, and notifies the log acquisition processing unit 108. To do. Thereby, various log information is acquired (step S701). In addition, the log acquisition processing unit 108 captures a monitor screen when the operator is performing a remote operation with the remote control server 1 (step S702). Further, the log acquisition processing unit 108 acquires load information of the communication network connected to the own device and hardware load information (for example, CPU load factor) of the own device (step S703). The information received from the remote operation processing unit 107, the acquired load information, and the captured image are recorded in the operation log file g as an operation log (step S704).

Further, the remote control server 1 reproduces the captured image recorded in the operation log file based on the operation by the operator. First, the operator selects an operation log file recorded in the remote control server 1 (step S705) and instructs the operation log reproduction process (step S706). Then, the log reproduction processing unit 112 of the remote control server 1 reproduces the captured image recorded in the selected operation log file on the monitor in the order of the operation time (step S707).
With the above processing, the status of operating the terminal 2 using the remote control server 1 when the operator performs remote operation is left as a log. Thereby, an unauthorized operation of the terminal 2 or the like by the operator can be prevented. Further, since the captured image can be recorded and reproduced, the remote operation by the remote control server 1 of the operator can be easily confirmed as compared with the log information remaining in the text format.

FIG. 18 is a diagram showing a processing flow when monitoring the operation of the terminal by the client terminal operator when the remote control system is connected. Next, processing for monitoring the operation of the terminal by the client terminal operator when connected to the remote control system will be described with reference to FIG. It is assumed that the terminal 2 holds the operation definition file f and the operation log file g shown in FIGS. 15 and 16 in the storage unit 211.
First, the log acquisition processing unit (operation command specifying information reading unit, capture image acquisition unit, load information acquisition unit, client terminal operation log information transmission unit) 206 of the terminal 2 is connected to the remote control server 1 by its own terminal. If this is detected, the IP address of the own terminal, the ID of the client terminal operator who operates the own terminal, the identification information of the application program operated by the client terminal operator on the own terminal, and the file to which the application program processes Each log information of name is acquired (step S801).

  In addition, the log acquisition processing unit 208 acquires an operation command input by the client terminal operator, and reads the command identification code of the operation command from the operation definition file held in the storage unit 211 (step S802). Also, the log acquisition processing unit 208 captures a monitor screen when the client terminal operator is operating the terminal 2 (step S803). In addition, the log acquisition processing unit 208 acquires load information of the communication network connected to the own terminal and hardware load information (for example, CPU load factor) of the own terminal (step S804). Then, the log acquisition processing unit 208 performs a process of transmitting each acquired information to the remote control server 1 (step S805). Further, when receiving information on each log from the terminal 2, the remote control server 1 records the information in an operation log file for each terminal 2 (step S806).

Further, the log reproduction processing unit (reproduction means) 112 of the remote control server 1 reproduces the captured image of the terminal 2 recorded in the operation log file based on the operation by the operator. First, the operator selects an operation log file recorded in the remote control server 1 (step S807), selects the terminal 2 (step S808), and instructs an operation log reproduction process (step S809). Then, the log reproduction processing unit 112 of the remote control server 1 reproduces the captured images recorded in the operation log file of the selected terminal 2 in the order of the elapse of the operation time (Step S810).
Through the above processing, the status of the client terminal operator operating the terminal is left as a log. Thereby, an unauthorized operation of the terminal 2 by the client terminal operator can be prevented. For example, it is possible to prevent actions such as each remote operation, remote monitoring, and illegally saving information presented in a class as a file. Further, since the captured image can be recorded and reproduced, the operation of the terminal 2 of the client terminal operator can be easily confirmed as compared with the log information remaining in the text format.

  FIG. 19 is a diagram illustrating an example of a remote operation restriction item table held in the data storage unit by the management server. As shown in FIG. 19, the remote operation restriction item table h is an application of the terminal 2 that can be used by the operator for each combination of the ID of the client terminal operator who uses the terminal 2 and the ID of the operator who uses the remote control server 1. Identification information of the program, identification information of a function (for example, an operation command) in the application program, and the like are recorded.

FIG. 20 is a diagram showing a processing flow when the remote operation of the terminal by the operator is restricted. Next, processing for limiting the remote operation of the terminal by the operator will be described with reference to FIGS. 19 and 20.
First, the management server 3 holds a remote operation restriction item table h in a data storage unit (restriction item storage means). Registration of each piece of information in the remote operation restriction item table h may be performed by the administrator of the remote control system that operates the management server 3, or the client terminal operator accesses the management server 3 using the terminal 2. You may register by
When the operator instructs the remote control server 1 to start remote operation of the terminal 2, the remote operation processing unit 107 of the remote control server 1 causes the management server 3 to operate the client terminal that operates the remote operation target terminal 2. Information on the restriction item acquisition request including the ID of the operator and the ID of the operator who operates the remote control server 1 is transmitted (step S901). Then, the management server 3 associates with the combination of the operator ID and the client terminal operator ID, “application program identification information” registered in the remote operation restriction item table h, and “functions in the application program (such as operation commands). ) Identification item information ”is transmitted to the remote control server 1. Thereby, the remote control server 1 acquires information on the remote operation restriction item (step S902).

When the remote control server 1 receives information on the remote operation restriction item from the management server 3, the remote operation processing unit (restriction item acquisition means, operation command identification means) 107 performs "application program identification information" or "function in application program". Based on the restriction item information of “identification information (such as operation command)”, an operation command that can be transmitted to the remote operation target terminal 2 is specified (step S903). In other words, it is determined whether or not the operation command input from the operator and the identification information of the application program operated in the remote operation of the terminal 2 are included in the restriction item information, and thereby input from the operator. It is determined whether the operation command is discarded or transmitted to the terminal 2.
With the above processing, the remote operation that the administrator or client terminal operator does not permit cannot be performed by the operator using the remote control server 1, which is convenient in managing the remote control system.

  FIG. 21 is a diagram illustrating an example of a display enlargement setting information table held in the data storage unit by the remote control server. As shown in FIG. 21, the display enlargement setting information table i holds information on the monitor resolution and enlargement magnification for each terminal ID.

FIG. 22 is a diagram showing a processing flow when the portion corresponding to the position of the mouse point designated by the client terminal operator on the terminal is enlarged and displayed on the monitor of the remote control server.
Next, with reference to FIG. 21 and FIG. 22, a process for enlarging and displaying a portion corresponding to the position of the mouse point designated by the client terminal operator on the terminal on the monitor of the remote control server will be described.
First, when the client terminal operator moves the mouse pointer on the screen using the mouse provided on the terminal 2, the mouse coordinate notification processing unit (in-screen coordinate transmission means) 205 of the terminal 2 coordinates on the monitor. Is detected. Then, the mouse coordinate notification processing unit 205 transmits the detected coordinates to the remote control server 1 (step S1001).
When the remote control server 1 receives the coordinate information, the monitor ID recorded in the connection management table a (display position storage means) of the data storage unit 111 is associated with the IP address of the terminal 2 that transmitted the coordinates. And the screen number. Based on the read monitor ID and screen number, it is determined at which position of which monitor the remote control server 1 is equipped with which the screen of the terminal 2 that transmitted the coordinates is displayed (step S1002).

Next, the screen processing unit (enlarged display processing means) 103 of the remote control server 1 calculates the position of the mouse pointer in the screen area of the terminal 2 from the coordinates received from the terminal 2 (step S1003). For example, the screen area (for example, the coordinates of the four corners) on the monitor of the terminal 2 (the monitor provided in the remote control server 1) is detected, and the relative coordinates of the received coordinates in the screen area are calculated. As a result, the coordinates at which the mouse pointer is positioned on the monitor screen of the terminal 2 are calculated. Further, the screen processing unit 103 reads the resolution of the terminal 2 from the display enlargement setting table i. Then, on the monitor of the remote control server 1, a predetermined range based on the calculated position of the mouse pointer on the small screen of the terminal 2 is enlarged and displayed at the same ratio as the resolution of the terminal 2 (step S1004). ). In this enlargement display, the screen processing unit 103 may acquire enlargement magnification information from the display enlargement setting information table i and enlarge and display the position of the mouse pointer at the enlargement magnification ratio.
As a result, on the screen of the terminal 2 which is displayed small on the monitor of the remote control server 1, the position where the client terminal operator designates the mouse pointer can be enlarged and displayed. For example, the client terminal operator However, when a point on the screen where the user wants to receive a question in each remote operation, remote monitoring, or lesson is designated with a mouse pointer, the operator can easily understand which part he / she wants to receive.

FIG. 23 is a diagram showing a processing flow when audio and video acquired by a terminal are output by another terminal or a remote control server.
Next, with reference to FIG. 23, a description will be given of processing when audio and video acquired by a terminal are output by another terminal or a remote control server.
First, the terminal 2 and the remote control server 1 may be provided with both a microphone (audio input receiving means) and a camera (video acquisition means). The data storage unit 111 of the remote control server 1 includes the terminal 2 and the remote control server 1. By holding a camera management table in which an ID and a flag indicating whether a camera is provided are associated with each other, which terminal 2 is provided with a camera is managed. Then, the microphone and camera of the terminal 2 notify the input information to the video / audio processing unit (audio input detection information notifying unit) 210, and the video / audio processing unit 210 sends the video and audio information to the remote control server 1. Sending.

Here, when audio is input through the microphone in the terminal 2 (step S1101), the video / audio processing unit 210 transmits audio input detection information to the server 1 (step S1102). Then, in the remote control server 1, the video / audio processing unit (distribution means, voice input detection information notification means) 109 detects the ID of the terminal 2 that transmitted the voice input detection information, and associates it with the terminal ID in the camera management table. The recorded flag indicating whether or not the camera is provided is read, and thereby, it is determined whether or not the terminal 2 that has transmitted the voice input detection information is provided with the camera (step S1103). If a camera is provided, the video information and audio information transmitted from the terminal 2 are distributed to the other terminals 2, and the monitor and speaker provided in the own device are used to The video and audio transmitted from the terminal 2 are output (step S1104). In addition, the remote control server 1 includes a microphone and a camera in its own server, and when audio is input to the microphone, the video / audio processing unit 109 distributes the video acquired by the camera of its own server to the terminal 2.
With the above processing, only the screen of the client terminal operator who made the remark can be output to the monitor, so when there are many client terminal operators, it is not necessary to display all the video images of the client terminal operators. Thus, the display area of the monitor can be used efficiently.

FIG. 24 is a diagram illustrating a flow of processing for distributing the support request notified from the terminal for each support content.
Next, with reference to FIG. 24, a process for distributing the support request notified from the terminal by the remote control server for each support content will be described.
First, when the client terminal operator instructs the terminal 2 to inquire about user support (step S1201), the environment setting information notification processing unit (environment setting information transmitting unit) 207 stores environment setting information (for example, The information indicating the operation setting of the predetermined program, the identification information of the driver, and the like are read from the storage unit 211 of the own device (step S1202). Then, after receiving an instruction on whether or not to notify the environment setting information from the client terminal operator (step S1203), when transmitting, the environment setting information is transmitted to the remote control server 1 (step S1204). .

  When the remote control server 1 receives the environment setting information, the support processing unit (support access destination recording unit, communication connection unit) 110 transmits the question data to the terminal 2 through a Web page or the like, and is returned as a result. The level corresponding to the user is determined based on the information (step S1205). Next, failure analysis is performed based on the received environment setting information (step s1206), and the environment setting information and the analysis result are recorded in the data storage unit 111 (step S1207).

Next, the support processing unit 110 determines the terminal of the support person using the attribute information of the client terminal operator who operates the terminal 2 that has transmitted the environment setting information, the analysis result, and the environment setting information (step S1208). . Then, the IP address of the access point of the support person is read from the data storage unit 111, and the terminal 2 and the terminal of the support person are connected based on the IP address and the IP address of the terminal 2. (Step S1209). In addition, the support processing unit 110 notifies the support person in charge of the attribute information of the client terminal operator who operates the terminal 2 that has transmitted the environment setting information, the analysis result, and the environment setting information (step S1208).
As a result, the terminal 2 that made the support request can be connected to the terminal of the appropriate support person on the basis of the environment setting information of the terminal 2 and the analysis result thereof, thereby providing appropriate advice to the client terminal operator. Can be given.

FIG. 25 is a diagram showing a processing flow in explaining the keyboard operation.
Next, processing when the operator explains the keyboard operation using the remote control server will be described with reference to FIG.
First, when the operator inputs the ID of the terminal 2 and the keyboard image to the remote control server 1 to instruct keyboard image display (step S1301), the remote operation processing unit (keyboard image display instruction means, key identification) of the remote control server 1 is performed. (Display instruction information notifying means) 107 transmits keyboard image display instruction information for prompting display of a keyboard image to the terminal 2 of the ID that has received the input. Next, when the terminal 2 receives the keyboard image display instruction information, the keyboard display processing unit (keyboard image display unit, key image change display unit) 212 is recorded in advance in the storage unit (keyboard image storage unit) 211. Is displayed on the monitor (step S1302).
Next, when the operator instructs the keyboard operation, for example, an instruction for setting the remote key processing function of the remote operation processing unit 107 to operate is input to the remote control server 1. Then, the pressed key notification function of the remote operation processing unit 107 operates. When the operator presses a key on the keyboard (step S1303), the remote operation processing unit 107 includes a key including identification information of the pressed key and identification display information (for example, number and color information). The identification display instruction information is transmitted to the terminal 2 (step S1304).

Next, in the terminal 2 that has received the key identification display instruction information, the keyboard display processing unit 212 reads the key identification information and the identification display information included in the key identification display instruction information. Of the keys of the keyboard image on the monitor, the key specified by the key identification information is changed and displayed based on the identification display information (number and color information). For example, when the identification display information indicates a number, the number is displayed on the identified key. When the identification display information is information indicating a color, the specified key is displayed with a color. Then, in the order of the keys pressed by the operator, numbers corresponding to the corresponding keys are displayed or colored.
As a result, it is possible to visually tell the client terminal operator who does not know the operation which key on the keyboard should be pressed.

FIG. 26 is a diagram showing a processing flow when managing the client terminal operator response time of the operator.
Next, a process for managing the operator client terminal operator response time will be described with reference to FIG.
First, the remote operation processing unit 107 measures the corresponding time for remote operation of the terminal 2 for each terminal 2 (step S1401), and records the measured time in the corresponding time table of the data storage unit 111. The video / audio processing unit 109 also measures the corresponding time for transmission of audio to the terminal 2 for each terminal 2, and records the measured time in the corresponding time table of the data storage unit 111 (step S1402). That is, in this correspondence time table, the time of remote operation and the time of voice transmission are recorded in association with the information of the combination of the ID of the terminal 2 and the ID of the operator, and the total time is also recorded. . The operation type is also recorded. Here, the remote operation processing unit 107 monitors the total time. If the total time exceeds a preliminarily stored reference response time, warning information is displayed on the monitor of the remote control server 1. (Step S1403). Note that the corresponding time table may be held in the data storage unit of the management server 3.
Thereby, in a remote control system, when a plurality of client terminal operators are simultaneously instructed, a fair service can be performed. Moreover, appropriate time distribution according to the client terminal operator can be performed by setting the reference corresponding time.

FIG. 27 is a diagram illustrating a processing flow of the remote control server and the terminal in charge of the self-study room.
Next, processing of the remote control server and the terminal in charge of the study room will be described using FIG.
First, when the client terminal operator who operates the terminal 2 instructs the terminal 2 to enter the study room, the control unit 202 of the terminal 2 accesses the remote control server 1 in charge of the study room. Then, the remote operation processing unit 107 of the remote control server 1 in charge of the study room measures the stay time in the study room from the time when the study room is accessed (step S1501). Then, the remote operation processing unit 107 uses the measured stay time, the ID of the client terminal operator who operates the accessed terminal 2, and the ID of the own device (that is, the remote control server 1) in the self-study room of the data storage unit 111. It records in the management table (step S1502).
In addition, the remote operation processing unit 107 monitors the staying time, and determines whether or not the staying time exceeds the self-study room available time stored in advance in the own device (step S1503). If the staying time exceeds the self-repair room usage time, a message indicating that the stay has exceeded is notified to the terminal 2 and displayed on the monitor (step S1504). Thereby, the use of a self-study room can be limited by setting a time limit.

  In the screen data transmission described above, the remote control server 1 and the terminal 2 can control the amount of screen data and the distribution interval. For example, the screen processing unit 103 of the remote control server 1 and the control unit 202 of the terminal 2 may be configured such that the system resource load information in the own device <for example, network load information (for example, bps: bitpersecond), memory usage rate, CPU usage rate, etc. > Is detected (always monitored by the operating system). Then, the screen data is distributed at a screen data amount or a distribution interval determined for each combination of the load information and the usage rate of each item of the system resource load information. As a result, the system can be operated without stress when the network load or the load on the device itself is high. Further, the screen processing unit 103 of the remote control server 1 and the control unit 202 of the terminal 2 stop part or all of data communication when the load information, CPU usage rate, and memory usage rate of the communication network are high. You may do it. The information on the target to stop this data communication is recorded in advance in a table, for example.

  The above-mentioned terminal, remote control server, and management server have a computer system inside. The process described above is stored in a computer-readable recording medium in the form of a program, and the above process is performed by the computer reading and executing this program. Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Remote control server, 2 ... Terminal, 3 ... Management server

Claims (30)

A remote control system in which a remote control server and a client terminal are connected via a communication network,
The remote control server is
Displayable number storage means for storing the number of screens of the client terminal that can be displayed on a predetermined display unit;
An access request receiving means for receiving an access request including at least attribute information of a client terminal operator who operates the client terminal from the client terminal;
Screen data receiving means for receiving screen data displayed on a display unit provided in the terminal from the client terminal;
Display processing means for sequentially displaying the screen of the accepted screen data on the predetermined display section up to the number stored in the displayable number storage means;
The client terminal or the remote control server is
Voice input receiving means for receiving voice input;
Video acquisition means for acquiring video;
Voice input detection information notifying means for notifying voice input detection information when receiving the voice input;
The remote control server is
A distribution unit that distributes the input audio and the acquired video to a predetermined client terminal when the audio input detection information is received;
A remote control system comprising:   The remote control server is
  A plurality of the predetermined display units;
  The display processing means includes
  2. The remote control system according to claim 1, wherein only the designated screen is displayed in the entire area of any one of the plurality of display units by accepting designation of the screen of the client terminal. .   The remote control server is
  Screen fixed / non-fixed information storage means for storing a code indicating either fixed or non-fixed screen size of the client terminal;
  The display processing means includes
  When a code indicating either fixed or non-fixed size of the screen is read from the screen fixed / non-fixed information storage means based on the received instruction, and the read code is a code indicating fixed When the screen size of the client terminal is fixed and displayed in the predetermined display unit by the number stored in the displayable number storage means, and the read code is a code indicating non-fixed, the client The remote control system according to claim 1 or 2, wherein each of the screens of the terminals is displayed on the predetermined display unit based on a screen display rule.   The remote control server is
Screen arrangement information storage means for storing a code indicating whether or not the setting of the arrangement order in the predetermined display section of the screen of the client terminal operator is present;
  The display processing means includes
  Based on the received instruction, the code indicating whether the arrangement order is set or not is read from the screen arrangement information storage unit, and if the read code indicates the presence, the arrangement order automatic setting rule is set. Based on this, the screen of the client terminal is displayed on the predetermined display unit
The remote control system according to any one of claims 1 to 3, wherein   The remote control server is
  Screen priority output information storage means for storing the priority attribute information of the client terminal operator and display coordinates in association with each other;
  The display processing means includes
  When the attribute information of the client terminal operator included in the access request is recorded in the screen priority output information storage unit, the screen of the screen data transmitted from the client terminal that has made the access request is displayed from the upper left. Display with priority
  5. The remote control system according to claim 1, wherein the attribute information includes operation information of the client terminal, application, file usage information, in-file keyword, and the like.   The remote control server is
  When the number obtained by multiplying the number of the predetermined display units by the number of screens of the client terminal that can be displayed on one predetermined display unit is less than the number of the received access requests, the display is possible 6. The remote control system according to claim 1, further comprising a displayable number changing unit that rewrites and increases the number stored in the number storage unit.   The remote control server is
  Remote operation start request means for transmitting remote operation start request information to the client terminal;
  Remote operation end notification means for transmitting remote operation end notification information,
  The client terminal is
  After receiving the remote operation start request information, input operation lock means for discarding instruction information input from the input means,
  7. The apparatus according to claim 1, further comprising: a lock release unit that stops discarding the instruction information input from the input unit after receiving the remote operation end notification information. Remote control system.   The client terminal is
  Connection permission information notifying means for notifying connection permission information including information indicating permission of connection to hardware provided in the own terminal and identification information of the own terminal;
  The remote control server is
  Remote target terminal storage means for storing identification information of a client terminal that permits remote operation;
  It is determined whether or not the identification information of the client terminal included in the connection permission information is recorded in the remote target terminal storage unit, and if it is recorded, to the client terminal that transmitted the connection permission information. The remote control system according to claim 1, further comprising: a connection determination unit that performs connection of   Information indicating permission to connect to the hardware is a recording medium removable from the terminal.
The remote control system according to claim 8, wherein the remote control system is recorded on a body.   The remote control server is
  Application identification information transmitting means for transmitting an application activation instruction including application identification information to the client terminal;
  2. The application execution unit configured to simultaneously execute the application programs specified by the application identification information included in the application start instruction, wherein the client terminals that have received the application start instruction are simultaneously provided. The remote control system according to claim 9.   The application start instruction includes a file name and an argument,
  The application execution means of the client terminal retrieves the data of the file name from the storage unit of the own terminal, causes the application program to read the argument and the data of the file name, and executes the application program The remote control system according to claim 10.   The remote control server is
  A handwritten character input receiving means for receiving input of handwritten characters;
  Character data conversion means for converting the handwritten character into character data;
  Character data transmission means for sequentially transmitting the converted character data to the client terminal,
  The client terminal is
  The remote control system according to any one of claims 1 to 11, further comprising: character data display means for sequentially displaying the received character data on a text editor displayed on a display unit of the terminal itself. .   The remote control server is
  Operation command specifying information storage means for storing a list of operation command specifying information for specifying each operation command input to the device;
  An operation command recording means for reading the operation command specifying information corresponding to the operation command input to the own device from the operation command specifying information storing means and sequentially recording the operation command specifying information in the operation log storing means;
  Capture image recording means for sequentially recording captured images of a screen displayed on a predetermined display unit of the own apparatus in a captured image storage means at predetermined intervals;
  Load information recording means for sequentially recording load information of a communication network connected to the own apparatus and load information of each processing unit of the own apparatus in a load information storage means;
  The remote control system according to claim 1, further comprising: a reproducing unit that reproduces the captured image.   The client terminal is
  Operation command specifying information storage means for storing a list of operation command specifying information for specifying each operation command input to the terminal;
  An operation command specifying information reading unit that reads the operation command specifying information corresponding to the operation command input to the terminal from the operation command specifying information storage unit;
  Capture image acquisition means for acquiring a captured image of the screen displayed on the display unit of the terminal at predetermined intervals;
  Load information acquisition means for acquiring load information of a communication network connected to the own device and load information of each processing unit of the own device;
  Client terminal operation log information transmitting means for transmitting the read operation command specifying information, the acquired captured image and the load information to the remote control server,
  The remote control server is
  The remote control system according to claim 1, further comprising: a reproducing unit that reproduces the captured image.   The client terminal is
  In-screen coordinate transmission means for transmitting the in-screen coordinates of the mouse pointer displayed on the display unit of the terminal itself to the remote control server,
  The remote control server is
  Display position storage means for storing a display position in the predetermined display section of the screen for each client terminal;
  The predetermined display unit displaying the screen of the client terminal that has transmitted the in-screen coordinates, and the display position is read from the display range storage unit, and the display position of the predetermined display unit and the in-screen coordinates are The display apparatus according to claim 1, further comprising: an enlarged display processing unit that performs an enlarged display process on a predetermined range based on a mouse pointer displayed at the display position of the predetermined display unit. The remote control system according to any one of 14.   The client terminal is
  Environment setting information indicating various program operation settings of its own terminal is read from the storage unit, and includes environment setting information transmitting means for transmitting to the remote control server,
  The remote control server is
  A support staff access destination recording means for recording an access destination of a support staff terminal corresponding to the environment setting information;
  Based on the environment setting information transmitted from the client terminal, the support person's access destination is read from the support person's access destination recording means, and communication between the read access destination and the client terminal that has transmitted the environment setting information is performed. A communication connection means to connect;
The remote control system according to any one of claims 1 to 15, further comprising:   A management server is connected to the communication network;
  The management server is
  Restriction item information when remotely operating the client terminal from the remote control server according to a combination of identification information of the client terminal operator operating the client terminal and identification information of the operator operating the remote control server It has a restriction item storage means for storing,
  When the remote control server receives an instruction for remote operation of the client terminal, the remote control server is associated with a combination of identification information of the client terminal to be remotely operated and identification information of an operator who operates the own device, and the restriction Restriction item acquisition means for acquiring the restriction item information recorded in the item storage means;
  The operation command specifying means for specifying an operation command that can be transmitted to the remote operation target client terminal on the basis of the acquired restriction item information. Remote control system.   The remote control server is
  Keyboard image display instruction means for transmitting keyboard image display instruction information for prompting the client terminal to display a keyboard image;
  Key identification display instruction information notification means for transmitting key identification display instruction information, including identification information of the key of the keyboard image and identification display information to be added to the key,
  The terminal
  Keyboard image storage means for storing a keyboard image;
  Keyboard image display means for reading the keyboard image from the keyboard image storage means based on reception of the keyboard image display instruction information and displaying the keyboard image on a display unit;
  A key image change that identifies a key in the displayed keyboard image based on the identification information of the key included in the key identification display instruction information, and changes and displays the key based on information of the identification display that adds the identified key to the key Display means;
  The remote control system according to any one of claims 1 to 17, further comprising:   The remote control server is
  Corresponding time recording means for recording in the corresponding time storage means the time when the remote operation was performed on the client terminal or the time when the voice was transmitted in association with the identification information of the client terminal of the remote operation target or the voice transmission destination When,
  Corresponding time display means for displaying the total time recorded in the corresponding time storage means on the predetermined display unit for each identification information of the client terminal;
  The remote control according to any one of claims 1 to 18, further comprising warning information output means for outputting warning information when the total time exceeds a preset reference response time. system.   A processing method in a remote control system in which a remote control server and a client terminal are connected via a communication network,
  The displayable number storage means of the remote control server stores the number of screens of the client terminal that can be displayed on a predetermined display unit,
  The access request accepting means of the remote control server accepts an access request including at least attribute information of a client terminal operator who operates the client terminal from the client terminal;
  The screen data receiving means of the remote control server receives screen data displayed on the display unit of the client terminal from the client terminal,
  The display processing means of the remote control server sequentially displays the screen of the accepted screen data on the predetermined display unit up to the number stored in the displayable number storage means,
  The voice input accepting means of the client terminal or the remote control server accepts voice input,
  The video acquisition means of the client terminal or the remote control server acquires video,
  When the voice input detection information notifying means of the client terminal or the remote control server receives the voice input, the voice input detection information is notified,
  A processing method characterized in that when the distribution means of the remote control server receives the audio input detection information, the input audio and the acquired video are distributed to a predetermined client terminal.   The remote control server includes a plurality of the predetermined display units,
  The display processing means displays only the designated screen in the entire area of any one of the plurality of display units by receiving the designation of the screen of the client terminal.
21. A processing method according to claim 20, wherein:   The screen fixing / non-fixing information storage means of the remote control server stores a code indicating either fixing or non-fixing of the screen size of the client terminal,
  The display processing unit reads a code indicating whether the screen size is fixed or non-fixed from the screen fixed / non-fixed information storage unit based on the received instruction, and the read code indicates fixed. If the code is a code, the screen size of the client terminal is fixed and displayed on the predetermined display unit by the number stored in the displayable number storage means, and the read code is a code indicating non-fixed 22. The processing method according to claim 20, wherein each of the screens of the client terminal is displayed on the predetermined display unit based on a screen display rule.   The screen arrangement information storage means of the remote control server stores a code indicating whether or not the setting of the arrangement order in the predetermined display section of the screen of the client terminal operator is present,
  The display processing unit reads a code indicating whether the arrangement order is set or not from the screen arrangement information storage unit based on the received instruction, and when the read code indicates the presence, 23. The processing method according to claim 20, wherein a screen of the client terminal is displayed on the predetermined display unit based on an arrangement order automatic setting rule.   The screen priority output information storage means of the remote control server associates the client terminal operator's priority client terminal operation information, application information, file usage information, attribute information including file keywords, and display coordinates with each other. Remember,
  When the attribute information of the client terminal operator included in the access request is recorded in the screen priority output information storage unit, the display processing unit is a screen transmitted from the client terminal that has made the access request. Display the data screen with priority from the top left
The processing method according to any one of claims 20 to 23, wherein:   The displayable number changing means of the remote control server receives the number obtained by multiplying the number of the predetermined display units by the number of screens of the client terminal that can be displayed on the one predetermined display unit. 25. The processing method according to claim 20, wherein when the number is less than the number of access requests, the number stored in the displayable number storage unit is rewritten and increased.   The remote operation start request means of the remote control server transmits remote operation start request information to the client terminal,
  After the input operation lock means of the client terminal accepts the remote operation start request information, the instruction information input from the input means is discarded,
  The remote operation end notification means of the remote control server transmits remote operation end notification information,
  26. The lock release unit of the client terminal, after receiving the remote operation end notification information, cancels discarding of instruction information input from the input unit. The processing method as described in.   The connection permission information notifying means of the client terminal notifies connection permission information including information indicating permission to connect to hardware provided in the own terminal and identification information of the own terminal,
  The remote target terminal storage means of the remote control server stores identification information of a client terminal that permits remote operation,
  When the connection determination means of the remote control server determines whether or not the identification information of the client terminal included in the connection permission information is recorded in the remote target terminal storage means, 27. The processing method according to claim 20, wherein the connection to the client terminal that transmitted the connection permission information is performed.   28. The processing method according to claim 27, wherein information indicating permission to connect to the hardware is recorded on a recording medium removable from the terminal.   The application identification information transmitting means of the remote control server transmits an application activation instruction including application identification information to the client terminal,
  21. The application execution unit of the client terminal that has received the application activation instruction simultaneously executes an application program specified by application identification information included in the application activation instruction. 28. The processing method according to any one of 28.   The application start instruction includes a file name and an argument,
  The application execution means of the client terminal retrieves the data of the file name from the storage unit of the own terminal, causes the application program to read the argument and the data of the file name, and executes the application program 30. The processing method according to claim 29.