WO2013121714A1 - Remote consultation system - Google Patents

Remote consultation system Download PDF

Info

Publication number
WO2013121714A1
WO2013121714A1 PCT/JP2013/000448 JP2013000448W WO2013121714A1 WO 2013121714 A1 WO2013121714 A1 WO 2013121714A1 JP 2013000448 W JP2013000448 W JP 2013000448W WO 2013121714 A1 WO2013121714 A1 WO 2013121714A1
Authority
WO
WIPO (PCT)
Prior art keywords
peripheral device
terminal
consultant
consultation
configuration data
Prior art date
Application number
PCT/JP2013/000448
Other languages
French (fr)
Japanese (ja)
Inventor
和広 岡ノ上
寺崎 浩
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2013121714A1 publication Critical patent/WO2013121714A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/18Commands or executable codes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to a remote consultation system, a management device, a counselor terminal, a counselor terminal, a control method thereof, and a program.
  • the present invention relates to technology registered in a management apparatus.
  • Consists of a consulter terminal, a consultant terminal, and a management device Under the management of the management device, communication is established between the consulter terminal and the consultant terminal through the network, and the consultant who wishes to consult consults.
  • a remote consultation system for consulting with responders has been proposed or put into practical use.
  • Patent Document 1 discloses a system in which a video / audio compatible computer or the like is used as a counselor terminal and a counseling coordinator terminal, and the counselor and the counseling counselor make a consultation while recognizing each other's video and audio. Are listed.
  • Non-Patent Document 1 connects a consultant touch panel terminal to which peripheral devices such as a Web (World Wide Web) camera, a USB (Universal Serial Bus) handset, and a printer are connected, and a peripheral device such as a Web camera and a headset.
  • a remote consultation system is described in which a consultation support person terminal and a remote consultation server are connected through a network. According to this remote consultation system, counselors and counselors can actually see the same documents and screens while sharing information through various media such as video, audio, and application screens. You can proceed with the consultation in the same way. Sophisticated functions such as video switching and screen printing on the counselor terminal can be remotely operated from the counselor terminal side so that elderly people and counselors unfamiliar with computer operations can consult without stress. It has become.
  • the peripheral device configuration data held in the management device is updated according to the determination. It is necessary to keep.
  • the peripheral device This is because it is difficult to select a peripheral device to be remotely operated unless the usage of the device is determined. For example, when two web cameras are connected to the consultant terminal, one web camera is used as a camera that reflects the consultant's face, and the other web camera is used as a camera that reflects the data owned by the consultant. If so, it is possible to accurately select a camera for remote control.
  • peripheral device connected to the consultant terminal is targeted, not only the peripheral device connection work but also the use of the peripheral device and the peripheral on the management device are not limited to the person on the consultant terminal side. It is a natural way to have the device configuration data updated. However, with this method, it is necessary for a person with a certain level of specialized knowledge to go to the consultant terminal side. For this reason, it is desirable that a person with specialized knowledge can perform the work from the counseling person terminal side where the person exists nearby. However, it has been difficult to confirm from the counselor corresponding terminal side what kind of peripheral device is newly connected to the counselor terminal.
  • the object of the present invention is to solve the problem that it is difficult to determine the use of a peripheral device newly connected to a consultant terminal and to update the configuration data on the management device on the consultant terminal side It is to provide a remote consultation system.
  • a remote consultation system is as follows.
  • Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal
  • the above consultant terminal Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device
  • a peripheral device acquisition unit The peripheral device of its own terminal is activated according to the peripheral device input data request message received from the consultation responder terminal, and a peripheral device input data message including input data from the activated peripheral device is transmitted to the consultation responder terminal.
  • a peripheral device starting unit The management device Corresponding to the consultant terminal, a configuration data storage unit that stores peripheral device configuration data composed of the unique information and usage information representing the usage of the peripheral device; Among the specific information in the peripheral device search result message received from the consultant terminal, the peripheral device configuration including the specific information that does not exist in the peripheral device configuration data of the configuration data storage unit with the matching specific information
  • a peripheral device verification unit that creates data and stores it in the configuration data storage unit, and transmits an unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal;
  • a configuration data updating unit that updates the usage information in the peripheral device configuration data of the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal;
  • the above consultation support terminal is A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on a display device; The peripheral device input data request message designating the peripheral device selected from the list by
  • the management apparatus concerning the other form of this invention is: Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal
  • a configuration data storage unit that stores peripheral device configuration data composed of unique information that is information unique to the peripheral device and usage information that indicates the usage of the peripheral device
  • a peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and the matching among the unique information in the received peripheral device search result message
  • creating the peripheral device configuration data including the unique information that does not exist in the peripheral device configuration data of the configuration data storage unit and storing the peripheral device configuration data in the configuration data storage unit.
  • a peripheral device verification unit that transmits an unregistered peripheral device notification message including data to the consultation responder terminal;
  • the peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit according to the usage information included in the received peripheral device usage notification message
  • a configuration data update unit that updates the usage information in the configuration data is employed.
  • the consultation support person terminal concerning other forms of the present invention is as follows.
  • Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal
  • the consultation responder terminal In the above-mentioned consultation responder terminal in the remote consultation system that establishes communication between the above-mentioned consultant terminal and the above-mentioned consultation responder terminal, and realizes consultation between the above-mentioned consultant and the above-mentioned consultation support person , From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that are unique to the peripheral device connected to the consultant terminal is received and received.
  • a peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
  • the peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and from the peripheral device included in the peripheral device input data message received from the consultant terminal.
  • An application confirmation unit for displaying the input data on the display device;
  • the peripheral device usage notification message including the usage information of the peripheral device input from the operator is used to transmit to the management device.
  • the consultant terminal concerning the other form of this invention is: Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal
  • the consultant terminal in the remote consultation system that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant, Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device
  • a peripheral device activation unit that transmits a peripheral device input data message including input data from the peripheral device of the own terminal to the consultant terminal according to the peripheral device input data request message received from the consultant terminal. Take the configuration.
  • a remote consultation system control method includes: Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal A remote consultation system control method that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant,
  • the counselor terminal acquires specific information that is information specific to the peripheral device connected to the terminal upon the occurrence of a predetermined event, and the peripheral device search result message including the acquired specific information
  • the management device receives the peripheral device configuration data from a configuration data storage unit that stores peripheral device configuration data composed of the specific information and application information indicating the usage of the peripheral device, corresponding to the consultant terminal.
  • the peripheral device configuration data including the specific information that does not exist in the peripheral device configuration data is not included in the peripheral device configuration data among the specific information in the peripheral device search result message read and received from the consultant terminal. And storing the unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal.
  • the consultation responder terminal displays a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on the display device, and is selected from the list by the operator.
  • the peripheral device input data request message designating the peripheral device is transmitted to the consultant terminal,
  • the counselor terminal transmits a peripheral device input data message including input data from the peripheral device of the terminal according to the peripheral device input data request message received from the consultant terminal to the counselor terminal,
  • the consultant terminal displays the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device, and the peripheral device input from the operator.
  • Send a peripheral device usage notification message including the usage information to the management device A configuration is adopted in which the management device updates the usage information in the peripheral device configuration data in the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal.
  • a control method for a management apparatus is as follows. Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal And a control method for the management device in a remote consultation system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor Because A peripheral device search result message including the specific information of the peripheral device connected to the consultant terminal is received from the consultant terminal, Corresponding to the consultant terminal, the peripheral device is configured from a configuration data storage unit that stores peripheral device configuration data including unique information that is unique to the peripheral device and usage information that indicates the use of the peripheral device.
  • the peripheral device configuration data including the specific information whose matching specific information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit.
  • control method of the counselor terminal is as follows.
  • Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal Of the counselor terminal in the remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor.
  • a control method From the management device, an unregistered peripheral device notification message including peripheral device configuration data composed of unique information and usage information that is unique to the peripheral device connected to the consultant terminal, Displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the received unregistered peripheral device notification message on a display device; Sending the peripheral device input data request message specifying the peripheral device selected from the list by the operator to the consultant terminal, Displaying the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device; The peripheral device usage notification message including the usage information of the peripheral device input from the operator is transmitted to the management device.
  • control method of the consultant terminal is as follows.
  • Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal Control of the counselor terminal in a remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor
  • a method Acquire specific information that is specific to the peripheral device connected to the terminal when a predetermined event occurs, Send the peripheral device search result message including the acquired unique information to the management device,
  • a configuration is adopted in which a peripheral device input data message including input data from the peripheral device of its own terminal is transmitted to the consultant terminal according to the peripheral device input data request message received from the consultant terminal.
  • a program is Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal And the communication device is established between the counselor terminal and the counselor terminal, and the management device in the remote counseling system that realizes counseling between the counselor and the counselor is configured.
  • Computer A peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and the information specific to the peripheral device is received corresponding to the consultant terminal.
  • the peripheral device configuration data is read from a configuration data storage unit that stores peripheral device configuration data that includes specific information and usage information that indicates the usage of the peripheral device, and the unique device is included in the received peripheral device search result message.
  • the peripheral device configuration data including the unique information whose matching unique information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit, and the created peripheral device configuration data
  • a peripheral device verification unit that transmits an unregistered peripheral device notification message including The peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit according to the usage information included in the received peripheral device usage notification message
  • the configuration is such that it functions as a configuration data update unit that updates the usage information in the configuration data.
  • a program according to another embodiment of the present invention is Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal
  • the consultation support terminal in the remote consultation system that establishes communication between the consultant terminal and the consultation support terminal and realizes consultation between the consultant and the consultation support person.
  • Configure the computer From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that are unique to the peripheral device connected to the consultant terminal is received and received.
  • a peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
  • the peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and from the peripheral device included in the peripheral device input data message received from the consultant terminal.
  • An application confirmation unit for displaying the input data on the display device;
  • a configuration is adopted in which the peripheral device usage notification message including the usage information of the peripheral device input from the operator is made to function as a usage setting unit that transmits to the management device.
  • a program according to another embodiment of the present invention is Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal.
  • the above-mentioned consultant terminal is configured in a remote consultation system that establishes communication between the above-mentioned consultant terminal and the above-mentioned consultant terminal and realizes consultation between the above-mentioned consultant and the above-mentioned consultant.
  • the present invention has the configuration as described above, it is possible to determine the use of the peripheral device newly connected to the consultant terminal and update the configuration data on the management device on the consultant terminal side. is there.
  • FIG. 1 shows an example of the display screen of both terminals after switching the camera of a counselor terminal side by remote operation from the counselor terminal side during consultation in the remote consultation system concerning the 1st Embodiment of this invention.
  • It is a block diagram of the management apparatus in the remote consultation system concerning the 2nd Embodiment of this invention.
  • It is a block diagram of the counseling person terminal in the remote consultation system concerning the 3rd Embodiment of this invention.
  • FIG. 1 in the remote consultation system according to the first embodiment of the present invention, a consulter terminal 1, a consultant terminal 2, and a management device 3 are connected to each other through a network 4 so that they can communicate with each other.
  • a network 4 there is only one counselor terminal 1 and one counselor terminal 2, but there may be a plurality of each.
  • Consultant terminal 1 is a terminal used by a consultant who wishes to consult.
  • the consultation supporter terminal 2 is a terminal used by a consultation supporter who responds to a consultation.
  • the consultant terminal 1 and the consultant terminal 2 are configured by an information processing apparatus to which peripheral devices such as a Web camera, a USB handset, a printer, and a touch panel display are connected.
  • peripheral devices such as a Web camera, a USB handset, a printer, and a touch panel display are connected.
  • the hardware configuration of the consultant terminal 1 and the consultant terminal 2 need not be the same and may be different.
  • the management device 3 is a device having a function of relaying communication between the consulter terminal 1 and the consultant terminal 2.
  • the management device 3 establishes communication between the consultant terminal 1 and the consultation responder terminal 2 via the network 4 and realizes consultation between the consultant and the consultant.
  • the management device 3 is configured by an information processing device having a server function, for example.
  • the management device 3 is connected to a configuration data storage unit 6 that stores configuration data 5 of peripheral devices of the consulter terminal 1.
  • the configuration data of such peripheral devices is stored as the configuration data when it is necessary to distinguish the usage of each.
  • the unit 6 stores configuration data 5 of peripheral devices of the consulter terminal 1.
  • the configuration data of such peripheral devices is stored as the configuration data when it is necessary to distinguish the usage of each.
  • a plurality of web cameras are connected to the consultant terminal 1, and the configuration data of the web cameras are stored in the configuration data storage unit 6 in order to clarify the usage of each. .
  • FIG. 2 shows an example of data stored in the configuration data storage unit 6.
  • the configuration data storage unit 6 includes a consulter terminal ID (Identification) 7, the number of connected devices 8, and configuration data 5 of peripheral devices corresponding to the consulter terminal 1.
  • the counselor terminal ID 7 is information for identifying the counselor terminal 1 and is, for example, an IP address assigned to the counselor terminal 1.
  • the number of connected devices 8 is the number of peripheral devices (in this example, the number of cameras).
  • Peripheral device configuration data 5 includes unique information 5-1 and usage information 5-2.
  • the unique information 5-1 is desirably information that uniquely identifies a peripheral device. For example, in the case of a peripheral device connected to the consultant terminal 1 by a USB cable, it is desirable that information specific to the peripheral device acquired from a descriptor such as a device descriptor (Device Descriptor) of the peripheral device is included.
  • the unique information 5-1 is configured to include a vendor ID 5-11, a device ID 5-15, and a device code 5-13.
  • the unique information 5-1 is not limited to these, and other types of information may be included.
  • the unique information 5-1 includes the combination of the vendor ID 5-11, device ID 5-15, and device code 5-13 of the peripheral device to which the consultant terminal 1 is connected to its own terminal.
  • the allocation address 5-14 allocated to be unique is included. As will be described later, this assigned address 5-14 is used as a peripheral device ID for specifying a peripheral device connected to the consultant terminal in combination with the consulter terminal ID.
  • the usage information 5-2 is a character string indicating the usage of the peripheral device. For example, in the case of a Web camera that reflects materials owned by a consultant, a character string such as “document camera” is described. In addition, even if the same Web camera is used, a character string such as “face camera” is described as long as the camera reflects the face of the consultant.
  • the usage information 5-2 may include information other than the character string indicating the usage. For example, priority information indicating which is to be used preferentially may be included. For example, if a face camera is used at the start of consultation, the priority of the face camera is set higher than that of the document camera.
  • the consultant terminal 1 is turned off and stopped.
  • the consultation responder terminal 2 and the management device 3 are assumed to be powered on and operating.
  • a person who performs work on the side of the consultant terminal 1 is called an assistant, and a person who performs work on the side of the consultant terminal 2 is called an operator.
  • the assistant connects a web camera as a peripheral device to the consultant terminal 1 and turns on the power of the consultant terminal 1 (S1 in FIG. 3). For example, if one web camera is already connected to the consultant terminal 1 and another web camera is connected, the assistant can add the web camera to be added to the consultant terminal 1 through the USB cable, for example. After connecting to an arbitrary connection port and adjusting the shooting direction of the camera as necessary, the power of the consultant terminal 1 is turned on.
  • the interface for connecting the peripheral device to the terminal is not limited to USB, and may be arbitrary, such as IEEE 1394, Bluetooth, Thunderbolt, and the like.
  • the consultant terminal 1 searches for a connected peripheral device and acquires unique information from the connected peripheral device (S2). Specifically, the consultant terminal 1 acquires a device descriptor (Device Descriptor) and an interface descriptor (Interface Descriptor) from a connected peripheral device, and the USB Class Codes in the interface descriptor is 0Eh (video). For example, since the type of the peripheral device is a camera, the values of idVendor, idProduct, and iProduct are acquired from the device descriptor as the vendor ID, device ID, and device code. Also, the assigned address of the peripheral device is determined.
  • a device descriptor Device Descriptor
  • Interface Descriptor interface descriptor
  • the USB Class Codes in the interface descriptor is 0Eh (video).
  • the type of the peripheral device is a camera
  • the values of idVendor, idProduct, and iProduct are acquired from the device descriptor as the vendor ID, device ID, and device
  • the consultant terminal 1 sends a peripheral device search result message describing the unique information for each peripheral device composed of the acquired vendor ID, device ID, device code and the generated assigned address, and its own terminal ID. It is created and transmitted to the management apparatus 3 through the network 4 (S3).
  • the management device 3 When the management device 3 receives the peripheral device search result message from the consultant terminal 1, the management device 3 uses the peripheral device configuration data 5 stored in the configuration data storage unit 6 corresponding to the consultant terminal ID in the message. Each unique information 5-1 is read out and collated with the unique information for each peripheral device in the message (S4). Then, the management device 3 determines that there is no peripheral device whose use is unknown in the counselor terminal 1 if the unique information of both peripheral devices completely matches, and FIG. 3 relating to the update of the configuration data 5 of the peripheral device. Terminate the process.
  • the management device 3 continues the processing related to the update of the configuration data 5 of the peripheral device.
  • the management device 3 newly includes the unique information of the peripheral device in the peripheral device search result message and the usage information set to the NULL value.
  • the configuration data 5 is created and added to the configuration data storage unit 6 as configuration data corresponding to the consultant terminal ID (S5).
  • the management device 3 transmits a configuration change notification message including the consulter terminal ID to the consultant terminal 2 (S6).
  • the consultant terminal 2 When receiving the configuration change notification message, the consultant terminal 2 transmits a configuration content request message including the consulter terminal ID to the management device 3 in order to acquire the configuration data 5 of the consulter terminal 1 (S7).
  • the management device 3 receives this configuration content request message, the configuration data whose usage information is NULL among the configuration data 5 of the peripheral devices stored in the configuration data storage unit 6 corresponding to the consulter terminal ID.
  • An unregistered peripheral device notification message including 5 and the consulter terminal ID is transmitted to the consultant terminal 2 (S8).
  • Configuration data other than the configuration data 5 whose usage information is NULL may be included in the message and transmitted.
  • the consultant terminal 2 Upon receiving the unregistered peripheral device notification message, the consultant terminal 2 creates a list of peripheral devices on the side of the consultant terminal 1 from the peripheral device configuration data 5 and the consultant terminal ID included in the message, The information is displayed on the display device of the terminal 2 (S9). For example, the consultant terminal 2 displays a list of all or a part of the unique information in the configuration data 5 of the peripheral device and the contents of the usage information in association with each other. When the usage information is NULL, it is displayed so that it can be understood that the usage information is not set.
  • the operator of the consultant terminal 2 confirms the displayed list of peripheral devices. Then, the operator confirms input data obtained by the peripheral device as follows in order to determine the usage of the peripheral device whose use is unknown. First, the operator selects one peripheral device whose use is unknown from the peripheral device list, and requests the consultation responder terminal 2 to display the input data from the peripheral device on the display device of the terminal itself. In response to this request, the consultation responder terminal 2 first obtains the assigned address 5-14 from the configuration data of the peripheral device selected by the operator, and assigns this assigned address 5-14 and the terminal ID 7 of the consultant terminal 1 to each other. A peripheral device input data request message including the combined peripheral device ID is created and transmitted to the consultant terminal 1 through the management device 3 (S10).
  • S10 management device 3
  • the consultant terminal 1 receives the peripheral device input data request message from the consultation responder terminal 2 through the management device 2, the peripheral device specified by the peripheral device ID included in the message is not activated. Is activated (S11). Then, a peripheral device input data message including data obtained by the peripheral device is transmitted to the requesting consultation responder terminal 2 through the management device 3 (S12).
  • the peripheral device is a web camera
  • the peripheral device input data message includes a video signal photographed by the web camera.
  • the consultant terminal 2 Upon receiving the peripheral device input data message from the consultant terminal 1, the consultant terminal 2 displays it on the display device (S13).
  • the consultation responder terminal 2 reproduces the video signal and displays the video taken by the web camera on the screen of the display device.
  • the operator can determine the application of the web camera. For example, if the assistant's face appears in the camera image, it can be determined that the camera is used to show the consultant's face. Also, if paper on the desk is displayed in the camera image, it can be determined that the camera is used to display the materials owned by the consultant.
  • the operator inputs a character string indicating the determined use to the peripheral device selected from the peripheral device list, and requests the consultation responder terminal 2 to update the use information.
  • the consultant terminal 2 acquires the assigned address 5-14 from the configuration data of the peripheral device selected by the operator, the peripheral device ID obtained by combining the assigned address 5-14 and the terminal ID 7 of the consulter terminal 1, and the above
  • a peripheral device usage notification message including usage information in which a character string indicating the usage is set is created and transmitted to the management device 2 (S14).
  • the management device 2 When the management device 2 receives the peripheral device usage notification message, the management device 2 updates the usage information 5-2 in the configuration data 5 of the peripheral device specified by the peripheral device ID included in the message with the usage information included in the message. (S15).
  • the consultant terminal 1 executes the peripheral device search (S2) triggered by the occurrence of an event of power-on of the own terminal 1, but it can also be triggered by the occurrence of another event.
  • the counselor terminal 1 searches for a peripheral device when a peripheral device search request is input from an assistant, or when a peripheral device search request is input from a consultant.
  • the peripheral device search (S2) may be executed when the application program to be executed is activated.
  • the peripheral device in response to a single message called a peripheral device input data request message, if the peripheral device is not activated, a role for requesting activation of the peripheral device, and a role for requesting data obtained by the peripheral device,
  • the role may be divided into a plurality of messages including a message requesting activation of the peripheral device and a message requesting input data from the peripheral device.
  • the peripheral device connected to the consultant terminal 1 is activated when the terminal is turned on in step S1
  • the peripheral device has already been activated at the time of step S11. Can be omitted.
  • the usage information of one peripheral device is notified by one peripheral device usage notification message, but the usage information of a plurality of peripheral devices may be notified collectively by one peripheral device usage notification message.
  • the peripheral device usage notification message transmission (S14) is performed after S10 to S13 are repeated.
  • the management apparatus 3 may arbitrarily select a consultation responder terminal to be connected to the consultant terminal 1 for use determination and configuration data update. For example, a terminal that is most compatible with consultations from the consultant terminal in the past consultation history may be preferentially selected from the consultation supporter terminals that are in operation. If the number of consultations is the same, the consultation support terminal with the shortest operation time may be preferentially selected. Further, when the operation time is equal, the consultation support terminal having the smallest consultation support terminal ID may be preferentially selected.
  • the use of the peripheral device newly connected to the consultant terminal 1 and the update of the configuration data 5 on the management device 3 are performed on the consultant terminal 2 side. Can do. The reason is that the data obtained by the peripheral device with unknown use connected to the consultant terminal 1 is displayed on the display device of the consultant terminal 2 so that the operator can check it.
  • connection port for connecting the peripheral device it is not necessary to have a relationship between the connection port for connecting the peripheral device and the use of the peripheral device. It is only necessary to connect the peripheral device to an arbitrary connection port that exists in a place where there is no connection and is easy to connect.
  • an assistant is used in a method in which peripheral devices for a certain use are arranged in advance so as to connect to a specific connection port among a plurality of connection ports, and the use is determined from the connected ports. It is necessary to determine the correct port to connect to, and there may be a situation where a peripheral device cannot be connected due to a wall or the like.
  • the peripheral device for a certain use is determined to use a specific manufacturer among a plurality of manufacturers, and the peripheral device of the same manufacturer is used in the method of determining the use from the manufacturer of the peripheral device. It becomes difficult to reduce costs by using
  • the consultant terminal 1 is connected with two cameras, a face camera 11 that reflects the face of the consultant and a document camera 12 that reflects the materials owned by the consultant. It is assumed that a face camera 21 that reflects the face of the consultant is connected to the consultant terminal 2. Further, the screen of the display device of the consultant terminal 1 includes a document sharing area 13, a consultant terminal side video area 14, a consultant side video area 15, and a consultation button 16, and the consultant terminal 2 It is assumed that the screen of the display device includes a material sharing area 23, a consultation responder terminal side video area 24, a consultant terminal side video area 25, and an operation menu area 26.
  • the consultant turns on the consult button 16 when he / she has trouble operating the document displayed in the document sharing area 13 of the consulter terminal 1.
  • consultation button 16 When the consultation button 16 is turned on, consultation between the consultant and the consultant is started.
  • FIG. 5 shows a procedure from when the consultation button 16 is turned on until a session for consultation is established between the consulter terminal 1 and the consultant terminal 2 and consultation between the two is possible.
  • the consulter terminal 1 transmits a consultation session connection start request message to the management device 3 (S21).
  • the management apparatus 3 receives the consultation session connection start request message from the consultant terminal 1, the management apparatus 3 determines the consultation support terminal 2 that can be handled, and sets the terminal ID of the consultant terminal 1 to the determined consultation support terminal 2.
  • a consultation session connection request message is transmitted (S22).
  • the consultant terminal 2 Upon receiving the consultation session connection request message, the consultant terminal 2 receives the consulter terminal configuration data acquisition request message including the terminal ID of the consulter terminal 1 in order to acquire the configuration data 5 of the peripheral device of the consulter terminal 1. It transmits to the management apparatus 3 (S23). In response to this, the management device 3 sends a consultant terminal configuration data notification message including the peripheral device configuration data 5 stored in the configuration data storage unit 6 corresponding to the terminal ID of the consultant terminal 1 to the consultant terminal. 2 (S24).
  • the consultant terminal 2 creates a camera list on the consultant terminal side based on the peripheral device configuration data 5 included in the consulter terminal configuration data notification message (S25).
  • a list including the face camera 11 and the document camera 12 is created.
  • the character string displayed in this list the character string described in the usage information in the configuration data 5 is used. For example, when “Face Camera” is described in the usage information of the configuration data 5 corresponding to the face camera 11 and “Document Camera” is described in the usage information of the configuration data 5 corresponding to the document camera 12, FIG.
  • a consultant terminal side camera list as shown is created and displayed in the operation menu area 26.
  • the consultant terminal 2 transmits a connection preparation completion message to the management device 3 (S26), and the management device 3 transmits a connection preparation completion message to the consultant terminal 1 (S27).
  • a consultation session is established between the counselor terminal 1 and the counselor responder terminal 2, and the other party's voice and video are exchanged with each other through this session.
  • the face of the counselor is displayed in the counselor-side video area 15 of the counselor terminal 1 and is photographed by the face camera 21 of the counselor terminal 2.
  • the face of the counselor photographed by the face camera 11 of the counselor terminal 1 is displayed in the counselor-side video area 25 of FIG.
  • the same material as that displayed in the material sharing area 13 of the counselor terminal 1 is displayed in the material sharing area 23 of the consultant terminal 2.
  • the face of the counselor captured by the face camera 11 of the counselor terminal 1 is displayed in the counselor side video area 14 of the counselor terminal 1, and the counselor side video area 24 of the counselor terminal 2 is displayed. Displays the face of the counselor who is photographed by the face camera 21 of the counselor terminal 2.
  • the consultant will send the document to the consultant by voice through the handset. Is placed within the shooting range of the document camera 12. Then, the counselor selects the document camera 12 from the counselor terminal side camera list displayed in the operation menu 26 of the counselor terminal 2, and switches the camera on the counselor terminal side to the selected document camera 12. A request is input (for example, a switch button is operated).
  • the consultant terminal 2 when the consultant terminal 2 performs an operation for switching the camera on the consulter terminal side to the document camera 12 on the operation menu 26 (S31), the consultant terminal 2 is instructed to the management device 3.
  • a switching request message including the terminal ID of 1 and the peripheral device ID of the switching destination document camera 12 is transmitted (S32).
  • the management device 3 transmits a switching instruction message including the peripheral device ID of the switching destination document camera 12 to the consultant terminal 1 (S33).
  • the consultant terminal 1 When the consultant terminal 1 receives the switching instruction message, the consultant terminal 1 switches the video to be displayed in the consultant terminal side video area 14 of the consultant terminal 1 from the face camera 11 to the video of the document camera 12, and the consultant terminal 2 Is switched from the face camera 11 to the image of the document camera 12 (S34). Then, the switch completion message is transmitted to the consultation responder terminal 2 through the management device 3 (S35, S36).
  • the consultant terminal 2 Upon receiving the switching completion message, the consultant terminal 2 switches the video displayed in the consultant terminal side video area 25 of the consultant terminal 2 to the video of the document camera 12 sent from the consultant terminal 2 ( S37).
  • the counselor can check the content of the material presented by the counselor in the counselor terminal side video area 25.
  • the consultant can confirm the reflection of the material presented by himself / herself in the consultant terminal side video area 14.
  • the consultant can more accurately grasp the status of the consultant and provide more accurate advice. become. Specifically, by presenting a ticket held by a consultant at an airport or a station to the consultant, the consultant can receive appropriate on-site guidance from the consultant. Further, by presenting a cutout of newspapers and magazines held by a consultant at a shopping center or the like, and presenting purchased products to the consultant, the consultant can receive accurate product guidance from the consultant.
  • the management device 3 in the remote consultation system includes, as hardware, a communication interface unit (hereinafter referred to as a communication I / F unit) 301, an operation input unit 302, a screen.
  • a communication interface unit hereinafter referred to as a communication I / F unit
  • an operation input unit 302 a screen.
  • a display unit 303, a storage unit 304, and a processor 305 are included.
  • the communication I / F unit 301 includes a dedicated data communication circuit, and has a function of performing data communication with various devices such as the consulter terminal 1 and the consultant terminal 2 connected via a communication line.
  • the operation input unit 302 includes an operation input device such as a keyboard and a mouse, and has a function of detecting an operation by the administrator and outputting the operation to the processor 305.
  • the screen display unit 303 includes a screen display device such as an LCD (Liquid Crystal Display) or a PDP (Plasma Display Panel), and has a function of displaying various information such as a management menu on the screen according to an instruction from the processor 305. ing.
  • the processor 305 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 304P from the storage unit 304, thereby realizing various processing units by cooperating the hardware and the program 304P. have.
  • main processing units realized by the processor 305 there are a peripheral device verification unit 305A, a configuration data update unit 305B, and other functional units 305C.
  • Peripheral device verification unit 305A has functions related to procedures S4, S5, S6, and S8 described with reference to FIG. That is, the peripheral device verification unit 305A sets the unique information that matches the unique information in the peripheral device configuration data 304A of the consultant terminal among the unique information in the peripheral device search result message received from the consultant terminal 1 and the NULL value.
  • a function for creating peripheral device configuration data including set usage information, and the created peripheral device configuration data are stored in the peripheral device configuration data 304A of the consultant terminal of the storage unit 304, and the created peripheral device configuration data is And a function of transmitting an unregistered peripheral device notification message to the consultation responder terminal 2.
  • the configuration data update unit 305B has a function related to step S15 described with reference to FIG. That is, the configuration data update unit 305B has a function of updating the usage information in the peripheral device configuration data 304A of the consultant terminal according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal 2.
  • Other functional unit 305C has a function related to the procedure associated with the consultation described with reference to FIGS.
  • the consultation supporter terminal 2 of the remote consultation system includes, as hardware, a communication I / F unit 201, an operation input unit 202, a screen display unit 203, and a handset 204.
  • the communication I / F unit 201 includes a dedicated data communication circuit and has a function of performing data communication with various devices such as the consultant terminal 1 and the management device 3 connected via a communication line.
  • the operation input unit 202 includes an operation input device such as a keyboard, a mouse, or a touch sensor, and has a function of detecting an operation of an administrator and outputting the operation to the processor 207.
  • the screen display unit 203 includes a screen display device such as an LCD or a PDP, and has a function of displaying various information such as operation menus, materials, and camera images on the screen in accordance with instructions from the processor 207.
  • the handset 204 has a microphone function for inputting the voice of the counselor and a speaker function for outputting the voice of the counselor.
  • the face camera 205 has a function of photographing the face of the counselor.
  • the storage unit 206 includes a storage device such as a hard disk or a memory, and has a function of storing processing information and programs 206P necessary for various processes in the processor 206.
  • the program 206P is a program that implements various processing units by being read and executed by the processor 207, and can be read by an external device (not shown) or a computer via a data input / output function such as the communication I / F unit 201. It is read in advance from a storage medium (not shown) and stored in the storage unit 206.
  • the processor 207 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 206P from the storage unit 206, thereby realizing various processing units in cooperation with the hardware and the program 206P. have.
  • the main processing units realized by the processor 207 include a peripheral device list display unit 207A, a usage confirmation unit 207B, a usage setting unit 207C, and other functional units 207D.
  • Peripheral device list display unit 207A has functions related to steps S7 and S9 described with reference to FIG. That is, the peripheral device list display unit 207A creates a list of peripheral devices of the consultant terminal 1 corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device 3, and the created list. A function of displaying an operation menu including the display on the screen display unit 203.
  • the usage confirmation unit 207B has functions related to the procedures S10 and S13 described with reference to FIG. That is, when the consultation support person selects the peripheral device to be activated from the list in the operation menu displayed on the screen display unit 203 by the peripheral device list display unit 207A by the operation input unit 202, the usage confirmation unit 207B selects the peripheral device.
  • the application setting unit 207C has a function related to the procedure S14 described with reference to FIG. That is, the usage setting unit 207C has a function of transmitting to the management device 3 a peripheral device usage notification message including the peripheral device usage information input from the consultant and the consultant terminal ID.
  • Other function unit 207D has a function related to the procedure associated with the consultation described with reference to FIGS.
  • the consultant terminal 1 of the remote consultation system includes, as hardware, a communication I / F unit 101, an operation input unit 102, a screen display unit 103, a handset 104, Two cameras 105 and 106, a storage unit 107, and a processor 108 are included.
  • the communication I / F unit 101 includes a dedicated data communication circuit, and has a function of performing data communication with various devices such as the consultation support person terminal 2 and the management device 3 connected via a communication line.
  • the operation input unit 102 includes an operation input device such as a keyboard, a mouse, or a touch sensor, and has a function of detecting an operation by an administrator and outputting the operation to the processor 108.
  • the screen display unit 103 includes a screen display device such as an LCD or a PDP, and has a function of displaying various information such as consultation buttons, materials, and camera images on the screen in response to an instruction from the processor 108.
  • the handset 104 has a microphone function for inputting a voice of a consultant and a speaker function for outputting a voice of a counselor.
  • the face camera 105 has a function of photographing the face of the consultant.
  • the document camera 106 has a function as a document camera for copying materials owned by the consultant.
  • the storage unit 107 includes a storage device such as a hard disk or a memory, and has a function of storing processing information and programs 107P necessary for various processes in the processor 108.
  • the program 107P is a program that implements various processing units by being read and executed by the processor 108, and can be read by an external device (not shown) or a computer via a data input / output function such as the communication I / F unit 101. It is read in advance from a storage medium (not shown) and stored in the storage unit 107.
  • the processor 108 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 107P from the storage unit 107, thereby realizing various processing units in cooperation with the hardware and the program 107P. have.
  • main processing units realized by the processor 108 there are a peripheral device acquisition unit 108A, a peripheral device activation unit 108B, and other functional units 108C.
  • Peripheral device acquisition unit 108A has functions related to steps S2 and S3 described with reference to FIG. That is, the peripheral device acquisition unit 108A acquires unique information that is information unique to the peripheral device connected to the terminal upon the occurrence of a predetermined event, and the peripheral device search result including the acquired unique information A function of transmitting a message to the management apparatus 3;
  • Peripheral device activation unit 108B has functions related to procedures S11 and S12 described with reference to FIG. That is, the peripheral device activation unit 108B activates the peripheral device of its own terminal if it is not activated in accordance with the peripheral device input data request message received from the consultation responder terminal 2, and the peripheral device input data message including the input data from the peripheral device Is transmitted to the consultant terminal 2.
  • Other function unit 108C has a function related to the procedure associated with the consultation described with reference to FIGS.
  • the present invention is not limited to the above example, and various other additions and modifications can be made.
  • a web camera is used as a plurality of peripheral devices having the same function
  • the present invention is not limited to this.
  • the present invention can also be applied to a case where there are a plurality of microphones such as a microphone for inputting a consultant's voice and a microphone for inputting a reproduction sound of a recording machine owned by the consultant.
  • the peripheral device for input is not limited to the peripheral device for input, and may be a peripheral device for output.
  • the present invention can be applied to a case where a plurality of printers having different printing paper sizes and printing colors (monochrome and color) are included.

Abstract

A consultation provider terminal: receives an unregistered peripheral device notification message that contains peripheral device configuration data configured from unique information and application information, said unique information being information unique to a peripheral device connected to a consultation seeker terminal; and on a display device, displays a list of peripheral devices that correspond to the peripheral device configuration data contained in the received message. When an operator selects a peripheral device from the list, the consultation provider terminal: sends to the consultation seeker terminal, a peripheral device input data request message that specifies the selected peripheral device; and receives, and displays on the display device, input data for the peripheral device received from the consultation seeker terminal. The operator: determines the application of the peripheral device from the input data; and performs updating by sending to a management device, a peripheral device application notification message that contains application information for the peripheral device.

Description

遠隔相談システムRemote consultation system
 本発明は遠隔相談システム、管理装置、相談対応者端末、相談者端末、それらの制御方法、およびプログラムに関し、特に相談を希望する者が使用する相談者端末に接続される周辺装置の構成データを管理装置に登録する技術に関する。 The present invention relates to a remote consultation system, a management device, a counselor terminal, a counselor terminal, a control method thereof, and a program. The present invention relates to technology registered in a management apparatus.
 相談者端末と相談対応者端末と管理装置とから構成され、管理装置の管理の下に相談者端末と相談対応者端末との間でネットワークを通じて通信を確立し、相談を希望する相談者が相談対応者と相談を行う遠隔相談システムが提案ないし実用化されている。 Consists of a consulter terminal, a consultant terminal, and a management device. Under the management of the management device, communication is established between the consulter terminal and the consultant terminal through the network, and the consultant who wishes to consult consults. A remote consultation system for consulting with responders has been proposed or put into practical use.
 例えば特許文献1には、映像・音声対応コンピュータ等を相談者端末および相談対応者端末として使用し、相談者と相談対応者とが、互いに相手の映像と音声を認識しながら相談を行うシステムが記載されている。 For example, Patent Document 1 discloses a system in which a video / audio compatible computer or the like is used as a counselor terminal and a counseling coordinator terminal, and the counselor and the counseling counselor make a consultation while recognizing each other's video and audio. Are listed.
 また非特許文献1には、Web(World Wide Web)カメラ、USB(Universal SerialBus)ハンドセット、プリンタなどの周辺装置が接続された相談者用タッチパネル端末と、Webカメラ、ヘッドセットなどの周辺装置が接続された相談対応者端末と、遠隔相談サーバとがネットワークを通じて接続された遠隔相談システムが記載されている。この遠隔相談システムによれば、相談者と相談対応者とがお互いの映像、音声、アプリケーション画面など、様々なメディアによって情報を共有しながら、実際に対面して同じ書類や画面を見ているのと同じような感覚で相談を進めることができる。また、相談者端末側の映像の切替や画面の印刷など、やや高度な機能は相談対応者端末側から遠隔操作でき、高齢者やコンピュータ操作に不慣れな相談者でもストレスを与えることなく相談できるようになっている。 Non-Patent Document 1 connects a consultant touch panel terminal to which peripheral devices such as a Web (World Wide Web) camera, a USB (Universal Serial Bus) handset, and a printer are connected, and a peripheral device such as a Web camera and a headset. A remote consultation system is described in which a consultation support person terminal and a remote consultation server are connected through a network. According to this remote consultation system, counselors and counselors can actually see the same documents and screens while sharing information through various media such as video, audio, and application screens. You can proceed with the consultation in the same way. Sophisticated functions such as video switching and screen printing on the counselor terminal can be remotely operated from the counselor terminal side so that elderly people and counselors unfamiliar with computer operations can consult without stress. It has become.
特開2006-350758号公報JP 2006-350758 A
 ところで、相談者端末に同一機能を有する複数の周辺装置が接続されている場合、その各々の周辺装置の用途を決定し、その決定に従って管理装置に保持されている周辺装置構成データを更新しておく必要がある。その理由は、管理装置に保持されている周辺装置構成データ中の用途情報に基づいて、相談対応者端末側から遠隔操作の対象とする相談者端末側の周辺装置を選択するシステムでは、周辺装置の用途が定まっていないと遠隔操作の対象とする周辺装置の選択が困難になるためである。例えば、2台のwebカメラが相談者端末に接続されている場合、一方のwebカメラは相談者の顔を映すカメラ、他方のwebカメラは相談者の所有する資料を映すカメラとして用途を特定しておけば、遠隔操作の際のカメラの選択を的確に行うことができる。 By the way, when a plurality of peripheral devices having the same function are connected to the consultant terminal, the usage of each peripheral device is determined, and the peripheral device configuration data held in the management device is updated according to the determination. It is necessary to keep. The reason is that in the system that selects the peripheral device on the side of the consultant terminal to be remotely operated from the consultation responder terminal side based on the usage information in the peripheral device configuration data held in the management device, the peripheral device This is because it is difficult to select a peripheral device to be remotely operated unless the usage of the device is determined. For example, when two web cameras are connected to the consultant terminal, one web camera is used as a camera that reflects the consultant's face, and the other web camera is used as a camera that reflects the data owned by the consultant. If so, it is possible to accurately select a camera for remote control.
 相談者端末側に接続される周辺装置を対象とするのであるから、相談者端末側にいる人に、周辺装置の接続作業のみならず、その周辺装置の用途の決定、および管理装置上の周辺装置構成データの更新作業を行わせるのが自然なやり方である。しかし、この方法では、ある程度の専門的な知識を持った者が相談者端末側に出向く必要がある。このため、専門的な知識を持った者が身近に存在する相談対応者端末側から当該作業が行えることが望ましい。しかしながら、どのような用途の周辺装置が相談者端末に新たに接続されたのかを相談者対応端末側から確認するのは困難であった。 Since the peripheral device connected to the consultant terminal is targeted, not only the peripheral device connection work but also the use of the peripheral device and the peripheral on the management device are not limited to the person on the consultant terminal side. It is a natural way to have the device configuration data updated. However, with this method, it is necessary for a person with a certain level of specialized knowledge to go to the consultant terminal side. For this reason, it is desirable that a person with specialized knowledge can perform the work from the counseling person terminal side where the person exists nearby. However, it has been difficult to confirm from the counselor corresponding terminal side what kind of peripheral device is newly connected to the counselor terminal.
 本発明の目的は、相談者端末に新たに接続される周辺装置の用途の決定および管理装置上の構成データの更新作業を相談対応者端末側で実施するのは困難である、という課題を解決する遠隔相談システムを提供することにある。 The object of the present invention is to solve the problem that it is difficult to determine the use of a peripheral device newly connected to a consultant terminal and to update the configuration data on the management device on the consultant terminal side It is to provide a remote consultation system.
 本発明の一形態にかかる遠隔相談システムは、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおいて、
 上記相談者端末は、
 予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した上記固有情報を含む周辺装置サーチ結果メッセージを上記管理装置へ送信する周辺装置取得部と、
 上記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の上記周辺装置を起動し、起動した上記周辺装置からの入力データを含む周辺装置入力データメッセージを上記相談対応者端末へ送信する周辺装置起動部と
を有し、
 上記管理装置は、
 上記相談者端末に対応して、上記固有情報と上記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部と、
 上記相談者端末から受信した上記周辺装置サーチ結果メッセージ中の上記固有情報のうち、一致する上記固有情報が上記構成データ記憶部の上記周辺装置構成データに存在しない上記固有情報を含む上記周辺装置構成データを作成して上記構成データ記憶部に記憶すると共に、上記作成した上記周辺装置構成データを含む未登録周辺装置通知メッセージを、上記相談対応者端末へ送信する周辺装置照合部と、
 上記相談対応者端末から受信した上記周辺装置用途通知メッセージに含まれる上記用途情報に従って上記構成データ記憶部の上記周辺装置構成データにおける上記用途情報を更新する構成データ更新部と
を有し、
 上記相談対応者端末は、
 上記管理装置から受信した上記未登録周辺装置通知メッセージに含まれる上記周辺装置構成データに対応する上記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
 オペレータによって上記リストから選択された上記周辺装置を指定した上記周辺装置入力データ要求メッセージを上記相談者端末へ送信し、上記相談者端末から受信した上記周辺装置入力データメッセージに含まれる上記周辺装置からの上記入力データを上記表示装置に表示する用途確認部と、
 上記オペレータから入力された上記周辺装置の上記用途情報を含む上記周辺装置用途通知メッセージを上記管理装置へ送信する用途設定部と
を有する遠隔相談システム。
を有する。
A remote consultation system according to one aspect of the present invention is as follows.
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal In a remote consultation system that establishes communication between the consultant terminal and the consultation responder terminal, and realizes consultation between the consultant and the consultant,
The above consultant terminal
Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device A peripheral device acquisition unit,
The peripheral device of its own terminal is activated according to the peripheral device input data request message received from the consultation responder terminal, and a peripheral device input data message including input data from the activated peripheral device is transmitted to the consultation responder terminal. A peripheral device starting unit,
The management device
Corresponding to the consultant terminal, a configuration data storage unit that stores peripheral device configuration data composed of the unique information and usage information representing the usage of the peripheral device;
Among the specific information in the peripheral device search result message received from the consultant terminal, the peripheral device configuration including the specific information that does not exist in the peripheral device configuration data of the configuration data storage unit with the matching specific information A peripheral device verification unit that creates data and stores it in the configuration data storage unit, and transmits an unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal;
A configuration data updating unit that updates the usage information in the peripheral device configuration data of the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal;
The above consultation support terminal is
A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on a display device;
The peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and from the peripheral device included in the peripheral device input data message received from the consultant terminal A use confirmation unit for displaying the input data of the display on the display device;
A remote consultation system comprising: a usage setting unit that transmits the peripheral device usage notification message including the usage information of the peripheral device input from the operator to the management device.
Have
 また本発明の他の形態にかかる管理装置は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記管理装置において、
 上記相談者端末に対応して、上記周辺装置に固有な情報である固有情報と上記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部と、
 上記相談者端末から、上記相談者端末に接続されている上記周辺装置の上記固有情報を含む周辺装置サーチ結果メッセージを受信し、該受信した周辺装置サーチ結果メッセージ中の上記固有情報のうち、一致する上記固有情報が上記構成データ記憶部の上記周辺装置構成データに存在しない上記固有情報を含む上記周辺装置構成データを作成して上記構成データ記憶部に記憶すると共に、上記作成した上記周辺装置構成データを含む未登録周辺装置通知メッセージを、上記相談対応者端末へ送信する周辺装置照合部と、
 上記相談対応者端末から、上記周辺装置の上記用途情報を含む周辺装置用途通知メッセージを受信し、該受信した上記周辺装置用途通知メッセージに含まれる上記用途情報に従って上記構成データ記憶部の上記周辺装置構成データにおける上記用途情報を更新する構成データ更新部と
を有する、といった構成を採る。
Moreover, the management apparatus concerning the other form of this invention is:
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal In the above management device in the remote consultation system that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant,
Corresponding to the consultant terminal, a configuration data storage unit that stores peripheral device configuration data composed of unique information that is information unique to the peripheral device and usage information that indicates the usage of the peripheral device;
A peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and the matching among the unique information in the received peripheral device search result message And creating the peripheral device configuration data including the unique information that does not exist in the peripheral device configuration data of the configuration data storage unit and storing the peripheral device configuration data in the configuration data storage unit. A peripheral device verification unit that transmits an unregistered peripheral device notification message including data to the consultation responder terminal;
The peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit according to the usage information included in the received peripheral device usage notification message A configuration data update unit that updates the usage information in the configuration data is employed.
 また本発明の他の形態にかかる相談対応者端末は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談対応者端末において、
 上記管理装置から、上記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、該受信した未登録周辺装置通知メッセージに含まれる上記周辺装置構成データに対応する上記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
 オペレータによって上記リストから選択された上記周辺装置を指定した上記周辺装置入力データ要求メッセージを上記相談者端末へ送信し、上記相談者端末から受信した周辺装置入力データメッセージに含まれる上記周辺装置からの上記入力データを上記表示装置に表示する用途確認部と、
 上記オペレータから入力された上記周辺装置の上記用途情報を含む上記周辺装置用途通知メッセージを上記管理装置へ送信する用途設定部と
を有する、といった構成を採る。
Moreover, the consultation support person terminal concerning other forms of the present invention is as follows.
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal In the above-mentioned consultation responder terminal in the remote consultation system that establishes communication between the above-mentioned consultant terminal and the above-mentioned consultation responder terminal, and realizes consultation between the above-mentioned consultant and the above-mentioned consultation support person ,
From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that are unique to the peripheral device connected to the consultant terminal is received and received. A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
The peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and from the peripheral device included in the peripheral device input data message received from the consultant terminal. An application confirmation unit for displaying the input data on the display device;
The peripheral device usage notification message including the usage information of the peripheral device input from the operator is used to transmit to the management device.
 また本発明の他の形態にかかる相談者端末は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談者端末において、
 予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した上記固有情報を含む周辺装置サーチ結果メッセージを上記管理装置へ送信する周辺装置取得部と、
 上記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の上記周辺装置からの入力データを含む周辺装置入力データメッセージを上記相談対応者端末へ送信する周辺装置起動部と
を有する、といった構成を採る。
Moreover, the consultant terminal concerning the other form of this invention is:
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal In the consultant terminal in the remote consultation system that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant,
Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device A peripheral device acquisition unit,
A peripheral device activation unit that transmits a peripheral device input data message including input data from the peripheral device of the own terminal to the consultant terminal according to the peripheral device input data request message received from the consultant terminal. Take the configuration.
 また本発明の他の形態にかかる遠隔相談システムの制御方法は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムの制御方法であって、
 上記相談者端末が、予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した上記固有情報を含む周辺装置サーチ結果メッセージを上記管理装置へ送信し、
 上記管理装置が、上記相談者端末に対応して、上記固有情報と上記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から上記周辺装置構成データを読み出し、上記相談者端末から受信した上記周辺装置サーチ結果メッセージ中の上記固有情報のうち、一致する上記固有情報が上記周辺装置構成データに存在しない上記固有情報を含む上記周辺装置構成データを作成して上記構成データ記憶部に記憶すると共に、上記作成した上記周辺装置構成データを含む未登録周辺装置通知メッセージを、上記相談対応者端末へ送信し、
 上記相談対応者端末が、上記管理装置から受信した上記未登録周辺装置通知メッセージに含まれる上記周辺装置構成データに対応する上記周辺装置のリストを表示装置に表示すると共に、オペレータによって上記リストから選択された上記周辺装置を指定した上記周辺装置入力データ要求メッセージを上記相談者端末へ送信し、
 上記相談者端末が、上記相談対応者端末から受信した上記周辺装置入力データ要求メッセージに従って自端末の上記周辺装置からの入力データを含む周辺装置入力データメッセージを上記相談対応者端末へ送信し、
 上記相談対応者端末が、上記相談者端末から受信した上記周辺装置入力データメッセージに含まれる上記周辺装置からの上記入力データを上記表示装置に表示すると共に、上記オペレータから入力された上記周辺装置の上記用途情報を含む周辺装置用途通知メッセージを上記管理装置へ送信し、
 上記管理装置が、上記相談対応者端末から受信した上記周辺装置用途通知メッセージに含まれる上記用途情報に従って上記構成データ記憶部の上記周辺装置構成データにおける上記用途情報を更新する、といった構成を採る。
In addition, a remote consultation system control method according to another embodiment of the present invention includes:
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal A remote consultation system control method that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant,
The counselor terminal acquires specific information that is information specific to the peripheral device connected to the terminal upon the occurrence of a predetermined event, and the peripheral device search result message including the acquired specific information To the above management device,
The management device receives the peripheral device configuration data from a configuration data storage unit that stores peripheral device configuration data composed of the specific information and application information indicating the usage of the peripheral device, corresponding to the consultant terminal. The peripheral device configuration data including the specific information that does not exist in the peripheral device configuration data is not included in the peripheral device configuration data among the specific information in the peripheral device search result message read and received from the consultant terminal. And storing the unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal.
The consultation responder terminal displays a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on the display device, and is selected from the list by the operator. The peripheral device input data request message designating the peripheral device is transmitted to the consultant terminal,
The counselor terminal transmits a peripheral device input data message including input data from the peripheral device of the terminal according to the peripheral device input data request message received from the consultant terminal to the counselor terminal,
The consultant terminal displays the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device, and the peripheral device input from the operator. Send a peripheral device usage notification message including the usage information to the management device,
A configuration is adopted in which the management device updates the usage information in the peripheral device configuration data in the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal.
 また本発明の他の形態にかかる管理装置の制御方法は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記管理装置の制御方法であって、
 上記相談者端末から、上記相談者端末に接続されている上記周辺装置の上記固有情報を含む周辺装置サーチ結果メッセージを受信し、
 上記相談者端末に対応して、上記周辺装置に固有な情報である固有情報と上記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から上記周辺装置構成データを読み出し、
 上記受信した周辺装置サーチ結果メッセージ中の上記固有情報のうち、一致する上記固有情報が上記周辺装置構成データに存在しない上記固有情報を含む上記周辺装置構成データを作成して上記構成データ記憶部に記憶し、
 上記作成した上記周辺装置構成データを含む未登録周辺装置通知メッセージを、上記相談対応者端末へ送信し、
 上記相談者端末から、上記周辺装置の上記用途情報を含む周辺装置用途通知メッセージを受信し、
 該受信した上記周辺装置用途通知メッセージに含まれる上記用途情報に従って上記構成データ記憶部の上記周辺装置構成データにおける上記用途情報を更新する、といった構成を採る。
A control method for a management apparatus according to another embodiment of the present invention is as follows.
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal And a control method for the management device in a remote consultation system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor Because
A peripheral device search result message including the specific information of the peripheral device connected to the consultant terminal is received from the consultant terminal,
Corresponding to the consultant terminal, the peripheral device is configured from a configuration data storage unit that stores peripheral device configuration data including unique information that is unique to the peripheral device and usage information that indicates the use of the peripheral device. Read configuration data,
Among the specific information in the received peripheral device search result message, the peripheral device configuration data including the specific information whose matching specific information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit Remember,
Send the unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal,
A peripheral device usage notification message including the usage information of the peripheral device is received from the consultant terminal,
A configuration is adopted in which the usage information in the peripheral device configuration data in the configuration data storage unit is updated in accordance with the usage information included in the received peripheral device usage notification message.
 また本発明の他の形態にかかる相談対応者端末の制御方法は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談対応者端末の制御方法であって、
 上記管理装置から、上記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、
 上記受信した未登録周辺装置通知メッセージに含まれる上記周辺装置構成データに対応する上記周辺装置のリストを表示装置に表示し、
 オペレータによって上記リストから選択された上記周辺装置を指定した上記周辺装置入力データ要求メッセージを上記相談者端末へ送信し、
 上記相談者端末から受信した周辺装置入力データメッセージに含まれる上記周辺装置からの上記入力データを上記表示装置に表示し、
 上記オペレータから入力された上記周辺装置の上記用途情報を含む上記周辺装置用途通知メッセージを上記管理装置へ送信する、といった構成を採る。
In addition, the control method of the counselor terminal according to another aspect of the present invention is as follows.
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal Of the counselor terminal in the remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor. A control method,
From the management device, an unregistered peripheral device notification message including peripheral device configuration data composed of unique information and usage information that is unique to the peripheral device connected to the consultant terminal,
Displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the received unregistered peripheral device notification message on a display device;
Sending the peripheral device input data request message specifying the peripheral device selected from the list by the operator to the consultant terminal,
Displaying the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device;
The peripheral device usage notification message including the usage information of the peripheral device input from the operator is transmitted to the management device.
 また本発明の他の形態にかかる相談者端末の制御方法は、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談者端末の制御方法であって、
 予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、
 上記取得した上記固有情報を含む周辺装置サーチ結果メッセージを上記管理装置へ送信し、
 上記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の上記周辺装置からの入力データを含む周辺装置入力データメッセージを上記相談対応者端末へ送信する、といった構成を採る。
In addition, the control method of the consultant terminal according to another aspect of the present invention is as follows.
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal Control of the counselor terminal in a remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor A method,
Acquire specific information that is specific to the peripheral device connected to the terminal when a predetermined event occurs,
Send the peripheral device search result message including the acquired unique information to the management device,
A configuration is adopted in which a peripheral device input data message including input data from the peripheral device of its own terminal is transmitted to the consultant terminal according to the peripheral device input data request message received from the consultant terminal.
 また本発明の他の形態にかかるプログラムは、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記管理装置を構成するコンピュータを、
 上記相談者端末から、上記相談者端末に接続されている上記周辺装置の上記固有情報を含む周辺装置サーチ結果メッセージを受信し、上記相談者端末に対応して、上記周辺装置に固有な情報である固有情報と上記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から上記周辺装置構成データを読み出し、上記受信した周辺装置サーチ結果メッセージ中の上記固有情報のうち、一致する上記固有情報が上記周辺装置構成データに存在しない上記固有情報を含む上記周辺装置構成データを作成して上記構成データ記憶部に記憶すると共に、上記作成した上記周辺装置構成データを含む未登録周辺装置通知メッセージを、上記相談対応者端末へ送信する周辺装置照合部と、
 上記相談対応者端末から、上記周辺装置の上記用途情報を含む周辺装置用途通知メッセージを受信し、該受信した上記周辺装置用途通知メッセージに含まれる上記用途情報に従って上記構成データ記憶部の上記周辺装置構成データにおける上記用途情報を更新する構成データ更新部と
して機能させる、といった構成を採る。
A program according to another embodiment of the present invention is
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal And the communication device is established between the counselor terminal and the counselor terminal, and the management device in the remote counseling system that realizes counseling between the counselor and the counselor is configured. Computer
A peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and the information specific to the peripheral device is received corresponding to the consultant terminal. The peripheral device configuration data is read from a configuration data storage unit that stores peripheral device configuration data that includes specific information and usage information that indicates the usage of the peripheral device, and the unique device is included in the received peripheral device search result message. Among the information, the peripheral device configuration data including the unique information whose matching unique information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit, and the created peripheral device configuration data A peripheral device verification unit that transmits an unregistered peripheral device notification message including
The peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit according to the usage information included in the received peripheral device usage notification message The configuration is such that it functions as a configuration data update unit that updates the usage information in the configuration data.
 また本発明の他の形態にかかるプログラムは、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談対応者端末を構成するコンピュータを、
 上記管理装置から、上記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、該受信した未登録周辺装置通知メッセージに含まれる上記周辺装置構成データに対応する上記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
 オペレータによって上記リストから選択された上記周辺装置を指定した上記周辺装置入力データ要求メッセージを上記相談者端末へ送信し、上記相談者端末から受信した周辺装置入力データメッセージに含まれる上記周辺装置からの上記入力データを上記表示装置に表示する用途確認部と、
 上記オペレータから入力された上記周辺装置の上記用途情報を含む上記周辺装置用途通知メッセージを上記管理装置へ送信する用途設定部と
して機能させる、といった構成を採る。
A program according to another embodiment of the present invention is
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal The consultation support terminal in the remote consultation system that establishes communication between the consultant terminal and the consultation support terminal and realizes consultation between the consultant and the consultation support person. Configure the computer
From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that are unique to the peripheral device connected to the consultant terminal is received and received. A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
The peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and from the peripheral device included in the peripheral device input data message received from the consultant terminal. An application confirmation unit for displaying the input data on the display device;
A configuration is adopted in which the peripheral device usage notification message including the usage information of the peripheral device input from the operator is made to function as a usage setting unit that transmits to the management device.
 また本発明の他の形態にかかるプログラムは、
 相談を希望する相談者が使用する相談者端末と、上記相談に応じる相談対応者が使用する相談対応者端末と、上記相談者端末と上記相談対応者端末との間の通信を中継する管理装置とから構成され、上記相談者端末と上記相談対応者端末との間で通信を確立し、上記相談者と上記相談対応者との間の相談を実現する遠隔相談システムにおける上記相談者端末を構成するコンピュータを、
 予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した上記固有情報を含む周辺装置サーチ結果メッセージを上記管理装置へ送信する周辺装置取得部と、
 上記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の上記周辺装置からの入力データを含む周辺装置入力データメッセージを上記相談対応者端末へ送信する周辺装置起動部と
して機能させる、といった構成を採る。
A program according to another embodiment of the present invention is
Management device that relays communication between the consultant terminal used by the consultant who wishes to consult, the consultant terminal used by the consultant responding to the consultation, and the consultant terminal and the consultant terminal The above-mentioned consultant terminal is configured in a remote consultation system that establishes communication between the above-mentioned consultant terminal and the above-mentioned consultant terminal and realizes consultation between the above-mentioned consultant and the above-mentioned consultant. Computer
Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device A peripheral device acquisition unit,
According to the peripheral device input data request message received from the consultation responder terminal, the peripheral device input data message including the input data from the peripheral device of its own terminal is functioned as a peripheral device activation unit that transmits to the consultant terminal. Take the configuration.
 本発明は上述したような構成を有するため、相談者端末に新たに接続される周辺装置の用途の決定および管理装置上の構成データの更新作業を相談対応者端末側で実施することが可能である。 Since the present invention has the configuration as described above, it is possible to determine the use of the peripheral device newly connected to the consultant terminal and update the configuration data on the management device on the consultant terminal side. is there.
本発明の第1の実施形態にかかる遠隔相談システムのブロック図である。It is a block diagram of the remote consultation system concerning a 1st embodiment of the present invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける構成データ記憶部に記憶されるデータの例を示す図である。It is a figure which shows the example of the data memorize | stored in the structure data storage part in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける初期設定手順の一例を示す図である。It is a figure which shows an example of the initial setting procedure in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける相談者端末と相談対応者端末のカメラ構成と画面構成の一例を示す図である。It is a figure which shows an example of the camera structure and screen structure of a consultant terminal and a consultation responder terminal in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける相談開始手順の一例を示す図である。It is a figure which shows an example of the consultation start procedure in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける相談対応者端末の操作メニュー領域に表示される相談者端末側カメラリストの一例を示す図である。It is a figure which shows an example of the consulter terminal side camera list displayed on the operation menu area | region of the consultant terminal in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおける相談者端末と相談対応者端末の相談中の表示画面の一例を示す図である。It is a figure which shows an example of the display screen in the middle of consultation of the consultant terminal in the remote consultation system concerning the 1st Embodiment of this invention, and a consultation responder terminal. 本発明の第1の実施形態にかかる遠隔相談システムにおいて相談中に相談対応者端末側から遠隔操作により相談者端末側のカメラを切り替える手順の一例を示す図である。It is a figure which shows an example of the procedure which switches the camera by the side of a consultant terminal by remote operation from the side of a consultation supporter terminal during consultation in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第1の実施形態にかかる遠隔相談システムにおいて相談中に相談対応者端末側から遠隔操作により相談者端末側のカメラを切り替えた後の両端末の表示画面の一例を示す図である。It is a figure which shows an example of the display screen of both terminals after switching the camera of a counselor terminal side by remote operation from the counselor terminal side during consultation in the remote consultation system concerning the 1st Embodiment of this invention. 本発明の第2の実施形態にかかる遠隔相談システムにおける管理装置のブロック図である。It is a block diagram of the management apparatus in the remote consultation system concerning the 2nd Embodiment of this invention. 本発明の第3の実施形態にかかる遠隔相談システムにおける相談対応者端末のブロック図である。It is a block diagram of the counseling person terminal in the remote consultation system concerning the 3rd Embodiment of this invention. 本発明の第4の実施形態にかかる遠隔相談システムにおける相談者端末のブロック図である。It is a block diagram of the consultant terminal in the remote consultation system concerning the 4th Embodiment of this invention.
 次に本発明の実施の形態について図面を参照して詳細に説明する。
[第1の実施形態]
 図1を参照すると、本発明の第1の実施形態にかかる遠隔相談システムは、相談者端末1と相談対応者端末2と管理装置3とがネットワーク4を通じて相互に通信可能に接続されている。図1には、相談者端末1および相談対応者端末2はそれぞれ1台しか存在しないが、それぞれ複数台存在してよい。
Next, embodiments of the present invention will be described in detail with reference to the drawings.
[First embodiment]
Referring to FIG. 1, in the remote consultation system according to the first embodiment of the present invention, a consulter terminal 1, a consultant terminal 2, and a management device 3 are connected to each other through a network 4 so that they can communicate with each other. In FIG. 1, there is only one counselor terminal 1 and one counselor terminal 2, but there may be a plurality of each.
 相談者端末1は、相談を希望する相談者が使用する端末である。相談対応者端末2は、相談に応じる相談対応者が使用する端末である。相談者端末1および相談対応者端末2は、例えば、Webカメラ、USBハンドセット、プリンタ、タッチパネル型ディスプレイなどの周辺装置が接続された情報処理装置で構成される。相談者端末1と相談対応者端末2のハードウェア構成は同一である必要はなく、相違してよい。 Consultant terminal 1 is a terminal used by a consultant who wishes to consult. The consultation supporter terminal 2 is a terminal used by a consultation supporter who responds to a consultation. The consultant terminal 1 and the consultant terminal 2 are configured by an information processing apparatus to which peripheral devices such as a Web camera, a USB handset, a printer, and a touch panel display are connected. The hardware configuration of the consultant terminal 1 and the consultant terminal 2 need not be the same and may be different.
 管理装置3は、相談者端末1と相談対応者端末2との間の通信を中継する機能を有する装置である。管理装置3は、相談者端末1と相談対応者端末2との間にネットワーク4を介して通信を確立し、相談者と相談対応者との間の相談を実現する。管理装置3は、例えばサーバ機能を有する情報処理装置で構成される。 The management device 3 is a device having a function of relaying communication between the consulter terminal 1 and the consultant terminal 2. The management device 3 establishes communication between the consultant terminal 1 and the consultation responder terminal 2 via the network 4 and realizes consultation between the consultant and the consultant. The management device 3 is configured by an information processing device having a server function, for example.
 また管理装置3には、相談者端末1の周辺装置の構成データ5を記憶する構成データ記憶部6が接続されている。相談者端末1に接続される周辺装置のうち、同じ機能を有する周辺装置が複数台存在する等、その各々の用途を区別する必要がある場合、そのような周辺装置の構成データが構成データ記憶部6に記憶される。本実施形態では、相談者端末1に、複数のwebカメラが接続されており、その各々の用途を明確にするために、webカメラの構成データが構成データ記憶部6に記憶されるものとする。 Also, the management device 3 is connected to a configuration data storage unit 6 that stores configuration data 5 of peripheral devices of the consulter terminal 1. When there is a plurality of peripheral devices having the same function among the peripheral devices connected to the consultant terminal 1, the configuration data of such peripheral devices is stored as the configuration data when it is necessary to distinguish the usage of each. Stored in the unit 6. In the present embodiment, a plurality of web cameras are connected to the consultant terminal 1, and the configuration data of the web cameras are stored in the configuration data storage unit 6 in order to clarify the usage of each. .
 図2は構成データ記憶部6に記憶されているデータの例である。この例では、構成データ記憶部6は、相談者端末1に対応して、相談者端末ID(Identification)7と、接続機器数8と、周辺装置の構成データ5とから構成される。相談者端末ID7は、相談者端末1を識別するための情報であり、例えば相談者端末1に割り当てられたIPアドレスである。接続機器数8は、周辺装置の数(本例の場合、カメラの台数)である。 FIG. 2 shows an example of data stored in the configuration data storage unit 6. In this example, the configuration data storage unit 6 includes a consulter terminal ID (Identification) 7, the number of connected devices 8, and configuration data 5 of peripheral devices corresponding to the consulter terminal 1. The counselor terminal ID 7 is information for identifying the counselor terminal 1 and is, for example, an IP address assigned to the counselor terminal 1. The number of connected devices 8 is the number of peripheral devices (in this example, the number of cameras).
 周辺装置の構成データ5は、固有情報5-1と用途情報5-2とから構成される。固有情報5-1は、周辺装置を一意に識別する情報であることが望ましい。例えばUSBケーブルによって相談者端末1に接続される周辺装置であれば、その周辺装置が有するデバイスディスクリプタ(Device Descriptor)等のディスクリプタから取得される当該周辺装置固有の情報が含まれることが望ましい。本実施形態では、固有情報5-1は、ベンダーID5-11、機器ID5-15、およびデバイスコード5-13を含むように構成している。但し、固有情報5-1はこれらに限定されるものではなく、また、他の種類の情報が含まれていてもよい。本実施形態の場合、固有情報5-1には、相談者端末1が自端末に接続される周辺装置の上記ベンダーID5-11、機器ID5-15、およびデバイスコード5-13の組み合わせに対して一意になるように割り当てた割当アドレス5-14を含めている。この割当アドレス5-14は、後述するように、相談者端末IDと組み合わせて、相談者端末に接続される周辺装置を特定する周辺装置IDとして利用される。 Peripheral device configuration data 5 includes unique information 5-1 and usage information 5-2. The unique information 5-1 is desirably information that uniquely identifies a peripheral device. For example, in the case of a peripheral device connected to the consultant terminal 1 by a USB cable, it is desirable that information specific to the peripheral device acquired from a descriptor such as a device descriptor (Device Descriptor) of the peripheral device is included. In this embodiment, the unique information 5-1 is configured to include a vendor ID 5-11, a device ID 5-15, and a device code 5-13. However, the unique information 5-1 is not limited to these, and other types of information may be included. In the case of the present embodiment, the unique information 5-1 includes the combination of the vendor ID 5-11, device ID 5-15, and device code 5-13 of the peripheral device to which the consultant terminal 1 is connected to its own terminal. The allocation address 5-14 allocated to be unique is included. As will be described later, this assigned address 5-14 is used as a peripheral device ID for specifying a peripheral device connected to the consultant terminal in combination with the consulter terminal ID.
 用途情報5-2は、周辺装置の用途を示す文字列である。例えば、相談者が所有する資料を映すWebカメラであれば、例えば“書画カメラ”といった文字列が記述される。また同じWebカメラであっても、相談者の顔を映すカメラであれば、例えば“顔カメラ”といった文字列が記述される。用途情報5-2には、用途を示す文字列以外の情報が含まれていてもよい。例えば、何れを優先して使用するかを示す優先情報が含まれていてもよい。例えば、相談開始時に顔カメラを使用するのであれば、書画カメラよりも顔カメラの優先度を高くする。 The usage information 5-2 is a character string indicating the usage of the peripheral device. For example, in the case of a Web camera that reflects materials owned by a consultant, a character string such as “document camera” is described. In addition, even if the same Web camera is used, a character string such as “face camera” is described as long as the camera reflects the face of the consultant. The usage information 5-2 may include information other than the character string indicating the usage. For example, priority information indicating which is to be used preferentially may be included. For example, if a face camera is used at the start of consultation, the priority of the face camera is set higher than that of the document camera.
 次に、本実施形態の動作を説明する。 Next, the operation of this embodiment will be described.
<初期設定時の動作>
 まず、相談者端末1に新たに周辺装置(例ではwebカメラ)が接続された際に、その周辺装置の用途を決定し、周辺装置の構成データ5を更新する動作について説明する。
<Operation at initial setting>
First, the operation of determining the usage of the peripheral device and updating the configuration data 5 of the peripheral device when a new peripheral device (web camera in the example) is connected to the consultant terminal 1 will be described.
 前提として、相談者端末1は電源がオフされて停止しているものとする。他方、相談対応者端末2および管理装置3は電源がオンされており、稼働しているものとする。また、相談者端末1側で作業を行う者を補助者、相談対応者端末2側で作業を行う者をオペレータと呼ぶ。 As a premise, it is assumed that the consultant terminal 1 is turned off and stopped. On the other hand, the consultation responder terminal 2 and the management device 3 are assumed to be powered on and operating. A person who performs work on the side of the consultant terminal 1 is called an assistant, and a person who performs work on the side of the consultant terminal 2 is called an operator.
 まず、補助者は相談者端末1に周辺装置であるWebカメラを接続し、相談者端末1の電源をオンにする(図3のS1)。例えば、相談者端末1に既に1台のwebカメラが接続されており、さらに1台のwebカメラを接続するのであれば、補助者は、追加するwebカメラを例えばUSBケーブルを通じて相談者端末1の任意の接続ポートに接続し、必要に応じてカメラの撮影方向を調整した後、相談者端末1の電源をオンにする。なお、周辺装置を端末に接続するインターフェースはUSBに限定されず、IEEE1394、Bluetooth、Thunderbolt等、任意でよい。 First, the assistant connects a web camera as a peripheral device to the consultant terminal 1 and turns on the power of the consultant terminal 1 (S1 in FIG. 3). For example, if one web camera is already connected to the consultant terminal 1 and another web camera is connected, the assistant can add the web camera to be added to the consultant terminal 1 through the USB cable, for example. After connecting to an arbitrary connection port and adjusting the shooting direction of the camera as necessary, the power of the consultant terminal 1 is turned on. The interface for connecting the peripheral device to the terminal is not limited to USB, and may be arbitrary, such as IEEE 1394, Bluetooth, Thunderbolt, and the like.
 相談者端末1は、電源がオンされて稼働を開始すると、接続されている周辺装置をサーチ(探索)し、接続されている周辺装置から固有の情報を取得する(S2)。具体的には、相談者端末1は、接続されている周辺装置からデバイスディスクリプタ(Device Descriptor)とインターフェイスディスクリプタ(Interface Descriptor)とを取得し、インターフェイスディスクリプタ中のUSB Class Codesが0Eh(video)であれば、当該周辺装置の種類はカメラなので、デバイスディスクリプタからidVendor,idProduct,iProductの値をベンダーID、機器ID、デバイスコードとして取得する。また、当該周辺装置の割当アドレスを決定する。そして、相談者端末1は、上記取得したベンダーID、機器ID、デバイスコードと上記生成した割当アドレスとから構成される周辺装置毎の固有情報と自端末IDとを記述した周辺装置サーチ結果メッセージを作成し、ネットワーク4を通じて管理装置3へ送信する(S3)。 When the consultant terminal 1 is turned on and starts operating, the consultant terminal 1 searches for a connected peripheral device and acquires unique information from the connected peripheral device (S2). Specifically, the consultant terminal 1 acquires a device descriptor (Device Descriptor) and an interface descriptor (Interface Descriptor) from a connected peripheral device, and the USB Class Codes in the interface descriptor is 0Eh (video). For example, since the type of the peripheral device is a camera, the values of idVendor, idProduct, and iProduct are acquired from the device descriptor as the vendor ID, device ID, and device code. Also, the assigned address of the peripheral device is determined. Then, the consultant terminal 1 sends a peripheral device search result message describing the unique information for each peripheral device composed of the acquired vendor ID, device ID, device code and the generated assigned address, and its own terminal ID. It is created and transmitted to the management apparatus 3 through the network 4 (S3).
 管理装置3は、相談者端末1から周辺装置サーチ結果メッセージを受信すると、このメッセージ中の相談者端末IDに対応して構成データ記憶部6に記憶されている周辺装置の構成データ5から周辺装置毎の固有情報5-1を読み出し、上記メッセージ中の周辺装置毎の固有情報と照合する(S4)。そして、管理装置3は、双方の周辺装置の固有情報が完全に一致したならば、相談者端末1に用途不明な周辺装置は存在しないと判断し、周辺装置の構成データ5の更新に関する図3の処理を終了する。 When the management device 3 receives the peripheral device search result message from the consultant terminal 1, the management device 3 uses the peripheral device configuration data 5 stored in the configuration data storage unit 6 corresponding to the consultant terminal ID in the message. Each unique information 5-1 is read out and collated with the unique information for each peripheral device in the message (S4). Then, the management device 3 determines that there is no peripheral device whose use is unknown in the counselor terminal 1 if the unique information of both peripheral devices completely matches, and FIG. 3 relating to the update of the configuration data 5 of the peripheral device. Terminate the process.
 一方、管理装置3は、周辺装置サーチ結果メッセージ中の周辺装置の固有情報に一致する固有情報を有する構成データ5が存在しなければ、周辺装置の構成データ5の更新に関する処理を続行する。まず、管理装置3は、一致する固有情報が構成データ5に存在しなかった周辺装置に関して、周辺装置サーチ結果メッセージ中の周辺装置の固有情報とNULL値に設定した用途情報とから構成される新たな構成データ5を作成し、上記相談者端末IDに対応する構成データとして構成データ記憶部6に追加する(S5)。その際、一致する固有情報が周辺装置サーチ結果メッセージ中に存在しなかった既存の構成データ5が存在する場合、構成データ記憶部6から削除するか、或いは無効にする。そして、管理装置3は、相談者端末IDを含む構成変更通知メッセージを相談対応者端末2へ送信する(S6)。 On the other hand, if there is no configuration data 5 having unique information that matches the unique information of the peripheral device in the peripheral device search result message, the management device 3 continues the processing related to the update of the configuration data 5 of the peripheral device. First, regarding the peripheral device for which matching unique information does not exist in the configuration data 5, the management device 3 newly includes the unique information of the peripheral device in the peripheral device search result message and the usage information set to the NULL value. The configuration data 5 is created and added to the configuration data storage unit 6 as configuration data corresponding to the consultant terminal ID (S5). At this time, if there is existing configuration data 5 for which matching unique information does not exist in the peripheral device search result message, it is deleted from the configuration data storage unit 6 or invalidated. Then, the management device 3 transmits a configuration change notification message including the consulter terminal ID to the consultant terminal 2 (S6).
 相談対応者端末2は、構成変更通知メッセージを受信すると、相談者端末1の構成データ5を取得するために、相談者端末IDを含む構成内容要求メッセージを管理装置3へ送信する(S7)。管理装置3は、この構成内容要求メッセージを受信すると、相談者端末IDに対応して構成データ記憶部6に記憶された周辺装置の構成データ5のうち、用途情報がNULLになっている構成データ5と相談者端末IDとを含む未登録周辺装置通知メッセージを、相談対応者端末2へ送信する(S8)。用途情報がNULLになっている構成データ5以外の構成データもメッセージに含めて送信するようにしてもよい。 When receiving the configuration change notification message, the consultant terminal 2 transmits a configuration content request message including the consulter terminal ID to the management device 3 in order to acquire the configuration data 5 of the consulter terminal 1 (S7). When the management device 3 receives this configuration content request message, the configuration data whose usage information is NULL among the configuration data 5 of the peripheral devices stored in the configuration data storage unit 6 corresponding to the consulter terminal ID. An unregistered peripheral device notification message including 5 and the consulter terminal ID is transmitted to the consultant terminal 2 (S8). Configuration data other than the configuration data 5 whose usage information is NULL may be included in the message and transmitted.
 相談対応者端末2は、未登録周辺装置通知メッセージを受信すると、そのメッセージに含まれる周辺装置の構成データ5と相談者端末IDとから、相談者端末1側の周辺装置のリストを作成し、端末2の表示装置に表示する(S9)。例えば、相談対応者端末2は、周辺装置の構成データ5中の固有情報の全部あるいは一部のリストと、用途情報の内容とを対応付けて表示する。用途情報がNULLの場合、用途情報が設定されていないことが分かるように表示する。 Upon receiving the unregistered peripheral device notification message, the consultant terminal 2 creates a list of peripheral devices on the side of the consultant terminal 1 from the peripheral device configuration data 5 and the consultant terminal ID included in the message, The information is displayed on the display device of the terminal 2 (S9). For example, the consultant terminal 2 displays a list of all or a part of the unique information in the configuration data 5 of the peripheral device and the contents of the usage information in association with each other. When the usage information is NULL, it is displayed so that it can be understood that the usage information is not set.
 相談対応者端末2のオペレータは、表示された周辺装置のリストを確認する。そして、オペレータは、用途の不明な周辺装置の用途を決定するために、以下のようにして当該周辺装置で得られる入力データを確認する。まずオペレータは、周辺装置のリストから用途不明な周辺装置を一つ選択し、当該周辺装置からの入力データを自端末の表示装置に表示するよう相談対応者端末2に要求する。この要求に応じて、まず相談対応者端末2は、オペレータによって選択された周辺装置の構成データから割当アドレス5-14を取得し、この割当アドレス5-14と相談者端末1の端末ID7とを組み合わせた周辺装置IDを含む周辺装置入力データ要求メッセージを作成し、管理装置3を通じて相談者端末1へ送信する(S10)。 The operator of the consultant terminal 2 confirms the displayed list of peripheral devices. Then, the operator confirms input data obtained by the peripheral device as follows in order to determine the usage of the peripheral device whose use is unknown. First, the operator selects one peripheral device whose use is unknown from the peripheral device list, and requests the consultation responder terminal 2 to display the input data from the peripheral device on the display device of the terminal itself. In response to this request, the consultation responder terminal 2 first obtains the assigned address 5-14 from the configuration data of the peripheral device selected by the operator, and assigns this assigned address 5-14 and the terminal ID 7 of the consultant terminal 1 to each other. A peripheral device input data request message including the combined peripheral device ID is created and transmitted to the consultant terminal 1 through the management device 3 (S10).
 相談者端末1は、管理装置2を通じて相談対応者端末2から周辺装置入力データ要求メッセージを受信すると、そのメッセージに含まれる周辺装置IDで特定される周辺装置が起動されていなければ、当該周辺装置を起動する(S11)。そして、その周辺装置で得られるデータを含む周辺装置入力データメッセージを、管理装置3を通じて要求元の相談対応者端末2へ送信する(S12)。周辺装置がwebカメラの場合、周辺装置入力データメッセージにはwebカメラで撮影されたビデオ信号が含まれる。 When the consultant terminal 1 receives the peripheral device input data request message from the consultation responder terminal 2 through the management device 2, the peripheral device specified by the peripheral device ID included in the message is not activated. Is activated (S11). Then, a peripheral device input data message including data obtained by the peripheral device is transmitted to the requesting consultation responder terminal 2 through the management device 3 (S12). When the peripheral device is a web camera, the peripheral device input data message includes a video signal photographed by the web camera.
 相談対応者端末2は、相談者端末1から周辺装置入力データメッセージを受信すると、表示装置に表示する(S13)。周辺装置入力データメッセージにビデオ信号が含まれている場合、相談対応者端末2はビデオ信号の再生を行い、webカメラで撮影された映像を表示装置の画面に表示する。これによりオペレータは、webカメラの用途を決定することができる。例えば、カメラの映像に補助者の顔が映っていれば、相談者の顔を映すために使用するカメラと判断できる。またカメラの映像に机上に置かれた紙などが映っていれば、相談者が所有する資料を映すためのカメラと判断できる。 Upon receiving the peripheral device input data message from the consultant terminal 1, the consultant terminal 2 displays it on the display device (S13). When the peripheral device input data message includes a video signal, the consultation responder terminal 2 reproduces the video signal and displays the video taken by the web camera on the screen of the display device. As a result, the operator can determine the application of the web camera. For example, if the assistant's face appears in the camera image, it can be determined that the camera is used to show the consultant's face. Also, if paper on the desk is displayed in the camera image, it can be determined that the camera is used to display the materials owned by the consultant.
 次にオペレータは、周辺装置のリストから選択した上記周辺装置に対して上記決定した用途を示す文字列を入力し、用途情報を更新するよう相談対応者端末2に要求する。相談対応者端末2は、オペレータによって選択された周辺装置の構成データから割当アドレス5-14を取得し、この割当アドレス5-14と相談者端末1の端末ID7とを組み合わせた周辺装置IDと上記用途を示す文字列を設定した用途情報とを含む周辺装置用途通知メッセージを作成し、管理装置2へ送信する(S14)。 Next, the operator inputs a character string indicating the determined use to the peripheral device selected from the peripheral device list, and requests the consultation responder terminal 2 to update the use information. The consultant terminal 2 acquires the assigned address 5-14 from the configuration data of the peripheral device selected by the operator, the peripheral device ID obtained by combining the assigned address 5-14 and the terminal ID 7 of the consulter terminal 1, and the above A peripheral device usage notification message including usage information in which a character string indicating the usage is set is created and transmitted to the management device 2 (S14).
 管理装置2は、周辺装置用途通知メッセージを受信すると、そのメッセージに含まれる周辺装置IDで特定される周辺装置の構成データ5における用途情報5-2を、そのメッセージに含まれる用途情報で更新する(S15)。 When the management device 2 receives the peripheral device usage notification message, the management device 2 updates the usage information 5-2 in the configuration data 5 of the peripheral device specified by the peripheral device ID included in the message with the usage information included in the message. (S15).
 以上で、用途不明な一つの周辺装置の用途の決定とその構成データの更新とが完了したことになる。用途不明な他の周辺装置が存在する場合、上記S10~S15と同様な動作が繰り返される。 This completes the determination of the use of one peripheral device whose use is unknown and the update of its configuration data. When there are other peripheral devices whose use is unknown, the same operations as S10 to S15 are repeated.
 図3では、相談者端末1は、自端末1の電源オンという事象の発生を契機に、周辺装置サーチ(S2)を実行したが、他の事象の発生を契機とすることもできる。例えば、相談者端末1は、補助者から周辺装置のサーチ要求が入力されたことを契機に、あるいは相談対応者から周辺装置のサーチ要求が入力されたことを契機に、あるいは周辺装置のサーチを行うアプリケーションプログラムが起動されたことを契機に、周辺装置サーチ(S2)を実行してもよい。 In FIG. 3, the consultant terminal 1 executes the peripheral device search (S2) triggered by the occurrence of an event of power-on of the own terminal 1, but it can also be triggered by the occurrence of another event. For example, the counselor terminal 1 searches for a peripheral device when a peripheral device search request is input from an assistant, or when a peripheral device search request is input from a consultant. The peripheral device search (S2) may be executed when the application program to be executed is activated.
 また図3では、既存データとの照合(S4)で不一致が検出された場合、構成変更通知メッセージ送信(S6)と構成内容要求メッセージ送信(S7)という手順を踏んだ後、未登録周辺装置通知メッセージ送信(S8)が行われたが、構成変更通知メッセージ送信(S6)と構成内容要求メッセージ送信(S7)の手順を省略し、直ちに未登録周辺装置通知メッセージ送信(S8)を行うようにしてもよい。
 また図3では、周辺装置入力データ要求メッセージという一つのメッセージに対して、周辺装置が起動されていなければ当該周辺装置の起動を要求する役割と、その周辺装置で得られるデータを要求する役割とを持たせたが、周辺装置の起動を要求するメッセージと、当該周辺装置からの入力データを要求するメッセージとの複数のメッセージに役割分担させてもよい。また、相談者端末1に接続される周辺装置が、ステップS1における端末の電源オン時に起動するシステムでは、ステップS11の時点では周辺装置は既に起動しているので、周辺装置の起動を要求するメッセージは省略することができる。
In FIG. 3, when a mismatch is detected in the collation with existing data (S 4), notification of unregistered peripheral devices is performed after steps of configuration change notification message transmission (S 6) and configuration content request message transmission (S 7). Although message transmission (S8) has been performed, the procedure of configuration change notification message transmission (S6) and configuration content request message transmission (S7) is omitted, and unregistered peripheral device notification message transmission (S8) is immediately performed. Also good.
Also, in FIG. 3, in response to a single message called a peripheral device input data request message, if the peripheral device is not activated, a role for requesting activation of the peripheral device, and a role for requesting data obtained by the peripheral device, However, the role may be divided into a plurality of messages including a message requesting activation of the peripheral device and a message requesting input data from the peripheral device. Further, in the system in which the peripheral device connected to the consultant terminal 1 is activated when the terminal is turned on in step S1, the peripheral device has already been activated at the time of step S11. Can be omitted.
 また図3では、一つの周辺装置用途通知メッセージで一つの周辺装置の用途情報を通知したが、一つの周辺装置用途通知メッセージで複数の周辺装置の用途情報をまとめて通知するようにしてもよい。この場合、用途不明な複数の周辺装置が存在する場合、上記S10~S13が繰り返された後、周辺装置用途通知メッセージ送信(S14)が行われることになる。 Further, in FIG. 3, the usage information of one peripheral device is notified by one peripheral device usage notification message, but the usage information of a plurality of peripheral devices may be notified collectively by one peripheral device usage notification message. . In this case, when there are a plurality of peripheral devices whose use is unknown, the peripheral device usage notification message transmission (S14) is performed after S10 to S13 are repeated.
 また、相談対応者端末2が複数存在する場合、管理装置3が、用途の決定と構成データの更新のために相談者端末1に接続させる相談対応者端末を決定する方法は任意でよい。例えば稼働中の相談対応者端末のうち、過去の相談履歴で当該相談者端末からの相談に最も多く対応した端末を優先的に選択してよい。また相談回数が等しい場合は、稼働時間が最も少ない相談対応者端末を優先的に選択してよい。さらに稼働時間も等しい場合は、相談対応者端末IDが最も小さい相談対応者端末を優先的に選択してよい。 In addition, when there are a plurality of consultation responder terminals 2, the management apparatus 3 may arbitrarily select a consultation responder terminal to be connected to the consultant terminal 1 for use determination and configuration data update. For example, a terminal that is most compatible with consultations from the consultant terminal in the past consultation history may be preferentially selected from the consultation supporter terminals that are in operation. If the number of consultations is the same, the consultation support terminal with the shortest operation time may be preferentially selected. Further, when the operation time is equal, the consultation support terminal having the smallest consultation support terminal ID may be preferentially selected.
 このように本実施形態によれば、相談者端末1に新たに接続される周辺装置の用途の決定および管理装置3上の構成データ5の更新作業を、相談対応者端末2側で実施することができる。その理由は、相談者端末1に接続されている用途が不明な周辺装置で得られるデータを相談対応者端末2の表示装置に表示し、オペレータが確認できるようになっているためである。 As described above, according to the present embodiment, the use of the peripheral device newly connected to the consultant terminal 1 and the update of the configuration data 5 on the management device 3 are performed on the consultant terminal 2 side. Can do. The reason is that the data obtained by the peripheral device with unknown use connected to the consultant terminal 1 is displayed on the display device of the consultant terminal 2 so that the operator can check it.
 また本実施形態によれば、周辺装置を接続する接続ポートとその周辺装置の用途とに関係を持たせる必要がないため、補助者は、相談者端末1の接続ポートのうち、壁などの障害がなく接続し易い箇所に存在する任意の接続ポートに周辺装置を接続するだけでよい。これに対して、或る用途の周辺装置は複数存在する接続ポートのうちの特定の接続ポートに接続するように事前に取り決めておき、接続されているポートから用途を判断するやり方では、補助者は接続する正しいポートを判断する必要があり、また壁などが障害となって周辺装置が接続できない事態も発生し得ることになる。 Further, according to the present embodiment, it is not necessary to have a relationship between the connection port for connecting the peripheral device and the use of the peripheral device. It is only necessary to connect the peripheral device to an arbitrary connection port that exists in a place where there is no connection and is easy to connect. On the other hand, in a method in which peripheral devices for a certain use are arranged in advance so as to connect to a specific connection port among a plurality of connection ports, and the use is determined from the connected ports, an assistant is used. It is necessary to determine the correct port to connect to, and there may be a situation where a peripheral device cannot be connected due to a wall or the like.
 また本実施形態によれば、周辺装置のメーカとその周辺装置の用途とに関係を持たせる必要がないため、同一メーカの複数の周辺装置をそれぞれ異なる用途に使用することができる。これに対して、或る用途の周辺装置は複数存在するメーカのうちの特定のメーカのものを使用するように取り決めておき、周辺装置のメーカから用途を判断するやり方では、同一メーカの周辺装置を活用することによるコスト削減が困難になる。 Further, according to this embodiment, since it is not necessary to have a relationship between the manufacturer of the peripheral device and the use of the peripheral device, a plurality of peripheral devices of the same manufacturer can be used for different purposes. On the other hand, the peripheral device for a certain use is determined to use a specific manufacturer among a plurality of manufacturers, and the peripheral device of the same manufacturer is used in the method of determining the use from the manufacturer of the peripheral device. It becomes difficult to reduce costs by using
<相談時の動作>
 次に、相談者と相談対応者との間の相談時の動作について、周辺装置の構成データ5に含まれる用途情報の役割を中心に説明する。
<Operation during consultation>
Next, the operation at the time of consultation between the consultant and the consultant will be described focusing on the role of the usage information included in the configuration data 5 of the peripheral device.
 前提として、図4に示すように、相談者端末1には、相談者の顔を映す顔カメラ11と相談者が所有する資料を映す書画カメラ12との2台のカメラが接続されており、相談対応者端末2には、相談対応者の顔を映す顔カメラ21が接続されているものとする。また、相談者端末1の表示装置の画面には、資料共有領域13と、相談者端末側映像領域14と、相談対応者側映像領域15と、相談ボタン16とがあり、相談対応者端末2の表示装置の画面には、資料共有領域23と、相談対応者端末側映像領域24と、相談者端末側映像領域25と、操作メニュー領域26とが存在するものとする。 As a premise, as shown in FIG. 4, the consultant terminal 1 is connected with two cameras, a face camera 11 that reflects the face of the consultant and a document camera 12 that reflects the materials owned by the consultant. It is assumed that a face camera 21 that reflects the face of the consultant is connected to the consultant terminal 2. Further, the screen of the display device of the consultant terminal 1 includes a document sharing area 13, a consultant terminal side video area 14, a consultant side video area 15, and a consultation button 16, and the consultant terminal 2 It is assumed that the screen of the display device includes a material sharing area 23, a consultation responder terminal side video area 24, a consultant terminal side video area 25, and an operation menu area 26.
 相談開始前の時点では、相談者端末1の資料共有領域13に何らかの資料が表示されており、相談者はこの資料を閲覧している。この時点では、相談者端末1と相談対応者端末2とは接続されておらず、相談者端末側映像領域14と相談対応者側映像領域15には何も表示されておらず、また相談対応者端末2の資料共有領域23、相談対応者端末側映像領域24、相談者端末側映像領域25には何も表示されていない。 Before the start of consultation, some document is displayed in the document sharing area 13 of the consultant terminal 1, and the consultant is browsing this document. At this time, the consulter terminal 1 and the consultant terminal 2 are not connected, nothing is displayed in the consultant terminal side video area 14 and the consultant side video area 15, and the consultation service is supported. Nothing is displayed in the document sharing area 23, the consultant terminal side video area 24, and the consultant terminal side video area 25 of the person terminal 2.
 相談者は、相談者端末1の資料共有領域13に表示されている資料の操作で困ったことがあると、相談ボタン16をオンにする。この相談ボタン16のオン操作を契機に相談者と相談対応者との相談が開始される。 The consultant turns on the consult button 16 when he / she has trouble operating the document displayed in the document sharing area 13 of the consulter terminal 1. When the consultation button 16 is turned on, consultation between the consultant and the consultant is started.
 図5は、相談ボタン16がオンされてから、相談者端末1と相談対応者端末2との間に相談のためのセッションが確立し、両者の相談が可能になるまでの手順を示す。 FIG. 5 shows a procedure from when the consultation button 16 is turned on until a session for consultation is established between the consulter terminal 1 and the consultant terminal 2 and consultation between the two is possible.
 相談者端末1は、相談ボタン16がオンになると、相談セッション接続開始要求メッセージを管理装置3へ送信する(S21)。管理装置3は、相談者端末1から相談セッション接続開始要求メッセージを受信すると、対応可能な相談対応者端末2を決定し、決定した相談対応者端末2に対して相談者端末1の端末IDを含む相談セッション接続要求メッセージを送信する(S22)。 When the consultation button 16 is turned on, the consulter terminal 1 transmits a consultation session connection start request message to the management device 3 (S21). When the management apparatus 3 receives the consultation session connection start request message from the consultant terminal 1, the management apparatus 3 determines the consultation support terminal 2 that can be handled, and sets the terminal ID of the consultant terminal 1 to the determined consultation support terminal 2. A consultation session connection request message is transmitted (S22).
 相談セッション接続要求メッセージを受信した相談対応者端末2は、相談者端末1の周辺装置の構成データ5を取得するために、相談者端末1の端末IDを含む相談者端末構成データ取得要求メッセージを管理装置3へ送信する(S23)。これに応じて管理装置3は、相談者端末1の端末IDに対応して構成データ記憶部6に記憶されている周辺装置の構成データ5を含む相談者端末構成データ通知メッセージを相談対応者端末2へ送信する(S24)。 Upon receiving the consultation session connection request message, the consultant terminal 2 receives the consulter terminal configuration data acquisition request message including the terminal ID of the consulter terminal 1 in order to acquire the configuration data 5 of the peripheral device of the consulter terminal 1. It transmits to the management apparatus 3 (S23). In response to this, the management device 3 sends a consultant terminal configuration data notification message including the peripheral device configuration data 5 stored in the configuration data storage unit 6 corresponding to the terminal ID of the consultant terminal 1 to the consultant terminal. 2 (S24).
 相談対応者端末2は、相談者端末構成データ通知メッセージに含まれる周辺装置の構成データ5に基づいて、相談者端末側カメラリストを作成する(S25)。本例の場合、顔カメラ11と書画カメラ12とを含むリストが作成される。このリストに表示する文字列は、構成データ5中の用途情報に記述されている文字列が使用される。例えば、顔カメラ11に対応する構成データ5の用途情報に“顔カメラ”と記載され、書画カメラ12に対応する構成データ5の用途情報に“書画カメラ”と記載されている場合、図6に示すような相談者端末側カメラリストが作成され、操作メニュー領域26に表示される。 The consultant terminal 2 creates a camera list on the consultant terminal side based on the peripheral device configuration data 5 included in the consulter terminal configuration data notification message (S25). In the case of this example, a list including the face camera 11 and the document camera 12 is created. As the character string displayed in this list, the character string described in the usage information in the configuration data 5 is used. For example, when “Face Camera” is described in the usage information of the configuration data 5 corresponding to the face camera 11 and “Document Camera” is described in the usage information of the configuration data 5 corresponding to the document camera 12, FIG. A consultant terminal side camera list as shown is created and displayed in the operation menu area 26.
 その後、相談対応者端末2は、接続準備完了メッセージを管理装置3へ送信し(S26)、管理装置3は相談者端末1に対して接続準備完了メッセージを送信する(S27)。これにより、相談者端末1と相談対応者端末2との間に相談セッションが確立し、このセッションを通じて互いに相手端末の音声や映像などの交換が行われる。その結果、図7に示すように、相談者端末1の相談対応者側映像領域15に、相談対応者端末2の顔カメラ21で撮影される相談対応者の顔が表示され、相談対応者端末2の相談者側映像領域25に、相談者端末1の顔カメラ11で撮影される相談者の顔が表示される。また、相談対応者端末2の資料共有領域23に、相談者端末1の資料共有領域13に表示されているのと同じ資料が表示される。なお、相談者端末1の相談者側映像領域14には、相談者端末1の顔カメラ11で撮影されている相談者の顔が表示され、相談対応者端末2の相談対応者側映像領域24には、相談対応者端末2の顔カメラ21で撮影されている相談対応者の顔が表示される。 Thereafter, the consultant terminal 2 transmits a connection preparation completion message to the management device 3 (S26), and the management device 3 transmits a connection preparation completion message to the consultant terminal 1 (S27). As a result, a consultation session is established between the counselor terminal 1 and the counselor responder terminal 2, and the other party's voice and video are exchanged with each other through this session. As a result, as shown in FIG. 7, the face of the counselor is displayed in the counselor-side video area 15 of the counselor terminal 1 and is photographed by the face camera 21 of the counselor terminal 2. The face of the counselor photographed by the face camera 11 of the counselor terminal 1 is displayed in the counselor-side video area 25 of FIG. In addition, the same material as that displayed in the material sharing area 13 of the counselor terminal 1 is displayed in the material sharing area 23 of the consultant terminal 2. Note that the face of the counselor captured by the face camera 11 of the counselor terminal 1 is displayed in the counselor side video area 14 of the counselor terminal 1, and the counselor side video area 24 of the counselor terminal 2 is displayed. Displays the face of the counselor who is photographed by the face camera 21 of the counselor terminal 2.
 さて、相談者と相談対応者との相談中に、相談者が所有する何らかの資料を相談対応者が確認する必要がある場合、相談対応者は、相談者に対してハンドセットを通じた音声により、資料を書画カメラ12の撮影範囲に置くように指示する。そして、相談対応者は、相談対応者端末2の操作メニュー26に表示されている相談者端末側カメラリストから書画カメラ12を選択し、相談者端末側のカメラを上記選択した書画カメラ12に切替える要求を入力する(例えば切替ボタンを操作する)。 Now, during the consultation between the consultant and the consultant, if it is necessary for the consultant to check any material owned by the consultant, the consultant will send the document to the consultant by voice through the handset. Is placed within the shooting range of the document camera 12. Then, the counselor selects the document camera 12 from the counselor terminal side camera list displayed in the operation menu 26 of the counselor terminal 2, and switches the camera on the counselor terminal side to the selected document camera 12. A request is input (for example, a switch button is operated).
 相談対応者端末2は、図8に示すように、操作メニュー26上で相談者端末側のカメラを書画カメラ12に切替える操作が行われると(S31)、管理装置3に対して、相談者端末1の端末IDと切替先の書画カメラ12の周辺装置IDとを含む切替要求メッセージを送信する(S32)。これに応じて管理装置3は、相談者端末1に対して、切替先の書画カメラ12の周辺装置IDを含む切替指示メッセージを送信する(S33)。 As shown in FIG. 8, when the consultant terminal 2 performs an operation for switching the camera on the consulter terminal side to the document camera 12 on the operation menu 26 (S31), the consultant terminal 2 is instructed to the management device 3. A switching request message including the terminal ID of 1 and the peripheral device ID of the switching destination document camera 12 is transmitted (S32). In response to this, the management device 3 transmits a switching instruction message including the peripheral device ID of the switching destination document camera 12 to the consultant terminal 1 (S33).
 相談者端末1は、上記切替指示メッセージを受信すると、相談者端末1の相談者端末側映像領域14に表示する映像を、顔カメラ11から書画カメラ12の映像に切り替えると共に、相談対応者端末2へ送信しているカメラ映像を顔カメラ11から書画カメラ12の映像に切り替える(S34)。そして、切替完了メッセージを管理装置3を通じて相談対応者端末2へ送信する(S35、S36)。 When the consultant terminal 1 receives the switching instruction message, the consultant terminal 1 switches the video to be displayed in the consultant terminal side video area 14 of the consultant terminal 1 from the face camera 11 to the video of the document camera 12, and the consultant terminal 2 Is switched from the face camera 11 to the image of the document camera 12 (S34). Then, the switch completion message is transmitted to the consultation responder terminal 2 through the management device 3 (S35, S36).
 相談対応者端末2は、切替完了メッセージを受信すると、相談対応者端末2の相談者端末側映像領域25に表示する映像を、相談者端末2から送られてくる書画カメラ12の映像に切り替える(S37)。 Upon receiving the switching completion message, the consultant terminal 2 switches the video displayed in the consultant terminal side video area 25 of the consultant terminal 2 to the video of the document camera 12 sent from the consultant terminal 2 ( S37).
 以上により、図9に示すように、相談対応者は、相談者が提示した資料の内容を相談者端末側映像領域25で確認することができる。また、相談者は、自ら提示した資料の映り具合を相談者端末側映像領域14で確認することができる。このように遠隔相談を行う際に、相談者が保有する資料を相談対応者に提示することで、相談対応者が相談者の状況をより正確に把握することができ、より的確なアドバイスが可能になる。具体的には、空港や駅などで相談者が保有するチケットを相談対応者に提示することで、相談者は相談対応者から適切な構内案内等を受けることができる。またショッピングセンタなどで相談者が保有する新聞や雑誌の切抜き、購入した商品などを相談対応者に提示することで、相談者は相談対応者から的確な商品案内等を受けることができる。 As described above, as shown in FIG. 9, the counselor can check the content of the material presented by the counselor in the counselor terminal side video area 25. In addition, the consultant can confirm the reflection of the material presented by himself / herself in the consultant terminal side video area 14. When conducting remote consultations in this way, by presenting the materials held by the consultant to the consultant, the consultant can more accurately grasp the status of the consultant and provide more accurate advice. become. Specifically, by presenting a ticket held by a consultant at an airport or a station to the consultant, the consultant can receive appropriate on-site guidance from the consultant. Further, by presenting a cutout of newspapers and magazines held by a consultant at a shopping center or the like, and presenting purchased products to the consultant, the consultant can receive accurate product guidance from the consultant.
[第2の実施形態]
 本実施形態では、第1の実施形態にかかる遠隔相談システムに好適な管理装置3について説明する。
[Second Embodiment]
In the present embodiment, a management device 3 suitable for the remote consultation system according to the first embodiment will be described.
 図10を参照すると、本発明の第2の実施形態にかかる遠隔相談システムにおける管理装置3は、ハードウェアとして、通信インターフェース部(以下、通信I/F部という)301、操作入力部302、画面表示部303、記憶部304、およびプロセッサ305を有する。 Referring to FIG. 10, the management device 3 in the remote consultation system according to the second embodiment of the present invention includes, as hardware, a communication interface unit (hereinafter referred to as a communication I / F unit) 301, an operation input unit 302, a screen. A display unit 303, a storage unit 304, and a processor 305 are included.
 通信I/F部301は、専用のデータ通信回路からなり、通信回線を介して接続された相談者端末1および相談対応者端末2などの各種装置との間でデータ通信を行う機能を有している。操作入力部302は、キーボードやマウスなどの操作入力装置からなり、管理者の操作を検出してプロセッサ305に出力する機能を有している。画面表示部303は、LCD(Liquid Crystal Desplay)やPDP(Plasma Display Panel)などの画面表示装置からなり、プロセッサ305からの指示に応じて、管理メニューなどの各種情報を画面表示する機能を有している。 The communication I / F unit 301 includes a dedicated data communication circuit, and has a function of performing data communication with various devices such as the consulter terminal 1 and the consultant terminal 2 connected via a communication line. ing. The operation input unit 302 includes an operation input device such as a keyboard and a mouse, and has a function of detecting an operation by the administrator and outputting the operation to the processor 305. The screen display unit 303 includes a screen display device such as an LCD (Liquid Crystal Display) or a PDP (Plasma Display Panel), and has a function of displaying various information such as a management menu on the screen according to an instruction from the processor 305. ing.
 記憶部304は、ハードディスクやメモリなどの記憶装置からなり、プロセッサ305での各種処理に必要な処理情報やプログラム304Pを記憶する機能を有している。プログラム304Pは、プロセッサ305に読み込まれて実行されることにより各種処理部を実現するプログラムであり、通信I/F部301などのデータ入出力機能を介して外部装置(図示せず)やコンピュータ可読記憶媒体(図示せず)から予め読み込まれて記憶部304に保存される。記憶部304で記憶される主な処理情報として、相談者端末の周辺装置構成データ304Aがある。この相談者端末の周辺装置構成データ304Aは、図2に示されるデータと同じである。 The storage unit 304 includes a storage device such as a hard disk or a memory, and has a function of storing processing information and programs 304P necessary for various processes in the processor 305. The program 304P is a program that implements various processing units by being read and executed by the processor 305, and can be read by an external device (not shown) or a computer via a data input / output function such as the communication I / F unit 301. It is read in advance from a storage medium (not shown) and stored in the storage unit 304. As main processing information stored in the storage unit 304, there is peripheral device configuration data 304A of the consultant terminal. The peripheral device configuration data 304A of the consulter terminal is the same as the data shown in FIG.
 プロセッサ305は、CPUなどのマイクロプロセッサとその周辺回路を有し、記憶部304からプログラム304Pを読み込んで実行することにより、上記ハードウェアとプログラム304Pとを協働させて各種処理部を実現する機能を有している。プロセッサ305で実現される主な処理部として、周辺装置照合部305Aと構成データ更新部305Bとその他機能部305Cとがある。 The processor 305 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 304P from the storage unit 304, thereby realizing various processing units by cooperating the hardware and the program 304P. have. As main processing units realized by the processor 305, there are a peripheral device verification unit 305A, a configuration data update unit 305B, and other functional units 305C.
 周辺装置照合部305Aは、図3を参照して説明した手順S4、S5、S6、S8に関する機能を有する。すなわち周辺装置照合部305Aは、相談者端末1から受信した周辺装置サーチ結果メッセージ中の固有情報のうち、一致する固有情報が相談者端末の周辺装置構成データ304Aに存在しない固有情報とNULL値に設定した用途情報とを含む周辺装置構成データを作成する機能と、作成した周辺装置構成データを記憶部304の相談者端末の周辺装置構成データ304Aに記憶すると共に、上記作成した周辺装置構成データを含む未登録周辺装置通知メッセージを相談対応者端末2へ送信する機能とを有する。 Peripheral device verification unit 305A has functions related to procedures S4, S5, S6, and S8 described with reference to FIG. That is, the peripheral device verification unit 305A sets the unique information that matches the unique information in the peripheral device configuration data 304A of the consultant terminal among the unique information in the peripheral device search result message received from the consultant terminal 1 and the NULL value. A function for creating peripheral device configuration data including set usage information, and the created peripheral device configuration data are stored in the peripheral device configuration data 304A of the consultant terminal of the storage unit 304, and the created peripheral device configuration data is And a function of transmitting an unregistered peripheral device notification message to the consultation responder terminal 2.
 構成データ更新部305Bは、図3を参照して説明した手順S15に関する機能を有する。すなわち構成データ更新部305Bは、相談対応者端末2から受信した周辺装置用途通知メッセージに含まれる用途情報に従って相談者端末の周辺装置構成データ304Aにおける用途情報を更新する機能を有する。 The configuration data update unit 305B has a function related to step S15 described with reference to FIG. That is, the configuration data update unit 305B has a function of updating the usage information in the peripheral device configuration data 304A of the consultant terminal according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal 2.
 その他機能部305Cは、図5および図8を参照して説明した相談に伴う手順に関する機能を有している。 Other functional unit 305C has a function related to the procedure associated with the consultation described with reference to FIGS.
[第3の実施形態]
 本実施形態では、第1の実施形態にかかる遠隔相談システムに好適な相談対応者端末2について説明する。
[Third embodiment]
In the present embodiment, a consultation support terminal 2 suitable for the remote consultation system according to the first embodiment will be described.
 図11を参照すると、本発明の第3の実施形態にかかる遠隔相談システムの相談対応者端末2は、ハードウェアとして、通信I/F部201、操作入力部202、画面表示部203、ハンドセット204、顔カメラ205、記憶部206、およびプロセッサ207を有する。 Referring to FIG. 11, the consultation supporter terminal 2 of the remote consultation system according to the third embodiment of the present invention includes, as hardware, a communication I / F unit 201, an operation input unit 202, a screen display unit 203, and a handset 204. A face camera 205, a storage unit 206, and a processor 207.
 通信I/F部201は、専用のデータ通信回路からなり、通信回線を介して接続された相談者端末1および管理装置3などの各種装置との間でデータ通信を行う機能を有している。操作入力部202は、キーボードやマウスあるいはタッチセンサなどの操作入力装置からなり、管理者の操作を検出してプロセッサ207に出力する機能を有している。画面表示部203は、LCDやPDPなどの画面表示装置からなり、プロセッサ207からの指示に応じて、操作メニュー、資料、カメラの映像などの各種情報を画面表示する機能を有している。ハンドセット204は、相談対応者の音声などを入力するマイクロフォン機能と、相談者の音声などを出力するスピーカ機能とを有する。顔カメラ205は、相談対応者の顔などを撮影する機能を有する。 The communication I / F unit 201 includes a dedicated data communication circuit and has a function of performing data communication with various devices such as the consultant terminal 1 and the management device 3 connected via a communication line. . The operation input unit 202 includes an operation input device such as a keyboard, a mouse, or a touch sensor, and has a function of detecting an operation of an administrator and outputting the operation to the processor 207. The screen display unit 203 includes a screen display device such as an LCD or a PDP, and has a function of displaying various information such as operation menus, materials, and camera images on the screen in accordance with instructions from the processor 207. The handset 204 has a microphone function for inputting the voice of the counselor and a speaker function for outputting the voice of the counselor. The face camera 205 has a function of photographing the face of the counselor.
 記憶部206は、ハードディスクやメモリなどの記憶装置からなり、プロセッサ206での各種処理に必要な処理情報やプログラム206Pを記憶する機能を有している。プログラム206Pは、プロセッサ207に読み込まれて実行されることにより各種処理部を実現するプログラムであり、通信I/F部201などのデータ入出力機能を介して外部装置(図示せず)やコンピュータ可読記憶媒体(図示せず)から予め読み込まれて記憶部206に保存される。 The storage unit 206 includes a storage device such as a hard disk or a memory, and has a function of storing processing information and programs 206P necessary for various processes in the processor 206. The program 206P is a program that implements various processing units by being read and executed by the processor 207, and can be read by an external device (not shown) or a computer via a data input / output function such as the communication I / F unit 201. It is read in advance from a storage medium (not shown) and stored in the storage unit 206.
 プロセッサ207は、CPUなどのマイクロプロセッサとその周辺回路を有し、記憶部206からプログラム206Pを読み込んで実行することにより、上記ハードウェアとプログラム206Pとを協働させて各種処理部を実現する機能を有している。プロセッサ207で実現される主な処理部として、周辺装置リスト表示部207Aと用途確認部207Bと用途設定部207Cとその他機能部207Dとがある。 The processor 207 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 206P from the storage unit 206, thereby realizing various processing units in cooperation with the hardware and the program 206P. have. The main processing units realized by the processor 207 include a peripheral device list display unit 207A, a usage confirmation unit 207B, a usage setting unit 207C, and other functional units 207D.
 周辺装置リスト表示部207Aは、図3を参照して説明した手順S7、S9に関する機能を有する。すなわち周辺装置リスト表示部207Aは、管理装置3から受信した未登録周辺装置通知メッセージに含まれる周辺装置構成データに対応する相談者端末1の周辺装置のリストを作成する機能と、作成したリストを含む操作メニューを画面表示部203に表示する機能を有する。 Peripheral device list display unit 207A has functions related to steps S7 and S9 described with reference to FIG. That is, the peripheral device list display unit 207A creates a list of peripheral devices of the consultant terminal 1 corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device 3, and the created list. A function of displaying an operation menu including the display on the screen display unit 203.
 用途確認部207Bは、図3を参照して説明した手順S10、S13に関する機能を有する。すなわち用途確認部207Bは、周辺装置リスト表示部207Aが画面表示部203に表示した操作メニュー中の上記リストから相談対応者が操作入力部202の操作で起動対象の周辺装置選択すると、その周辺装置IDを含む周辺装置入力データ要求メッセージを管理装置3を通じて相談者端末1へ送信する機能と、それに応じて相談者端末1から受信した周辺装置入力データメッセージに含まれる周辺装置からの入力データを画面表示部203に表示する機能とを有する。 The usage confirmation unit 207B has functions related to the procedures S10 and S13 described with reference to FIG. That is, when the consultation support person selects the peripheral device to be activated from the list in the operation menu displayed on the screen display unit 203 by the peripheral device list display unit 207A by the operation input unit 202, the usage confirmation unit 207B selects the peripheral device. A function for transmitting a peripheral device input data request message including an ID to the consultant terminal 1 through the management device 3 and a screen displaying input data from the peripheral device included in the peripheral device input data message received from the consultant terminal 1 And a function of displaying on the display portion 203.
 用途設定部207Cは、図3を参照して説明した手順S14に関する機能を有する。すなわち用途設定部207Cは、相談対応者から入力された周辺装置の用途情報と相談者端末IDとを含む周辺装置用途通知メッセージを管理装置3へ送信する機能を有する。 The application setting unit 207C has a function related to the procedure S14 described with reference to FIG. That is, the usage setting unit 207C has a function of transmitting to the management device 3 a peripheral device usage notification message including the peripheral device usage information input from the consultant and the consultant terminal ID.
 その他機能部207Dは、図5および図8を参照して説明した相談に伴う手順に関する機能を有している。 Other function unit 207D has a function related to the procedure associated with the consultation described with reference to FIGS.
[第4の実施形態]
 本実施形態では、第1の実施形態にかかる遠隔相談システムに好適な相談者端末1について説明する。
[Fourth Embodiment]
In the present embodiment, a consultant terminal 1 suitable for the remote consultation system according to the first embodiment will be described.
 図12を参照すると、本発明の第4の実施形態にかかる遠隔相談システムの相談者端末1は、ハードウェアとして、通信I/F部101、操作入力部102、画面表示部103、ハンドセット104、2台のカメラ105、106、記憶部107、およびプロセッサ108を有する。 Referring to FIG. 12, the consultant terminal 1 of the remote consultation system according to the fourth embodiment of the present invention includes, as hardware, a communication I / F unit 101, an operation input unit 102, a screen display unit 103, a handset 104, Two cameras 105 and 106, a storage unit 107, and a processor 108 are included.
 通信I/F部101は、専用のデータ通信回路からなり、通信回線を介して接続された相談対応者端末2および管理装置3などの各種装置との間でデータ通信を行う機能を有している。操作入力部102は、キーボードやマウスあるいはタッチセンサなどの操作入力装置からなり、管理者の操作を検出してプロセッサ108に出力する機能を有している。画面表示部103は、LCDやPDPなどの画面表示装置からなり、プロセッサ108からの指示に応じて、相談ボタン、資料、カメラの映像などの各種情報を画面表示する機能を有している。ハンドセット104は、相談者の音声などを入力するマイクロフォン機能と、相談対応者の音声などを出力するスピーカ機能とを有する。顔カメラ105は、相談者の顔などを撮影する機能を有する。書画カメラ106は、相談者の所有する資料などを写す書画カメラとしての機能を有する。 The communication I / F unit 101 includes a dedicated data communication circuit, and has a function of performing data communication with various devices such as the consultation support person terminal 2 and the management device 3 connected via a communication line. Yes. The operation input unit 102 includes an operation input device such as a keyboard, a mouse, or a touch sensor, and has a function of detecting an operation by an administrator and outputting the operation to the processor 108. The screen display unit 103 includes a screen display device such as an LCD or a PDP, and has a function of displaying various information such as consultation buttons, materials, and camera images on the screen in response to an instruction from the processor 108. The handset 104 has a microphone function for inputting a voice of a consultant and a speaker function for outputting a voice of a counselor. The face camera 105 has a function of photographing the face of the consultant. The document camera 106 has a function as a document camera for copying materials owned by the consultant.
 記憶部107は、ハードディスクやメモリなどの記憶装置からなり、プロセッサ108での各種処理に必要な処理情報やプログラム107Pを記憶する機能を有している。プログラム107Pは、プロセッサ108に読み込まれて実行されることにより各種処理部を実現するプログラムであり、通信I/F部101などのデータ入出力機能を介して外部装置(図示せず)やコンピュータ可読記憶媒体(図示せず)から予め読み込まれて記憶部107に保存される。 The storage unit 107 includes a storage device such as a hard disk or a memory, and has a function of storing processing information and programs 107P necessary for various processes in the processor 108. The program 107P is a program that implements various processing units by being read and executed by the processor 108, and can be read by an external device (not shown) or a computer via a data input / output function such as the communication I / F unit 101. It is read in advance from a storage medium (not shown) and stored in the storage unit 107.
 プロセッサ108は、CPUなどのマイクロプロセッサとその周辺回路を有し、記憶部107からプログラム107Pを読み込んで実行することにより、上記ハードウェアとプログラム107Pとを協働させて各種処理部を実現する機能を有している。プロセッサ108で実現される主な処理部として、周辺装置取得部108Aと周辺装置起動部108Bとその他機能部108Cとがある。 The processor 108 has a microprocessor such as a CPU and its peripheral circuits, and reads and executes the program 107P from the storage unit 107, thereby realizing various processing units in cooperation with the hardware and the program 107P. have. As main processing units realized by the processor 108, there are a peripheral device acquisition unit 108A, a peripheral device activation unit 108B, and other functional units 108C.
 周辺装置取得部108A、図3を参照して説明した手順S2、S3に関する機能を有する。すなわち周辺装置取得部108Aは、予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、この取得した固有情報を含む周辺装置サーチ結果メッセージを管理装置3に送信する機能を有する。 Peripheral device acquisition unit 108A has functions related to steps S2 and S3 described with reference to FIG. That is, the peripheral device acquisition unit 108A acquires unique information that is information unique to the peripheral device connected to the terminal upon the occurrence of a predetermined event, and the peripheral device search result including the acquired unique information A function of transmitting a message to the management apparatus 3;
 周辺装置起動部108Bは、図3を参照して説明した手順S11、S12に関する機能を有する。すなわち周辺装置起動部108Bは、相談対応者端末2から受信した周辺装置入力データ要求メッセージに従って、自端末の周辺装置を未起動なら起動し、当該周辺装置からの入力データを含む周辺装置入力データメッセージを相談対応者端末2へ送信する機能を有する。 Peripheral device activation unit 108B has functions related to procedures S11 and S12 described with reference to FIG. That is, the peripheral device activation unit 108B activates the peripheral device of its own terminal if it is not activated in accordance with the peripheral device input data request message received from the consultation responder terminal 2, and the peripheral device input data message including the input data from the peripheral device Is transmitted to the consultant terminal 2.
 その他機能部108Cは、図5および図8を参照して説明した相談に伴う手順に関する機能を有している。 Other function unit 108C has a function related to the procedure associated with the consultation described with reference to FIGS.
[その他の実施形態]
 以上本発明の実施形態について説明したが、本発明は以上の例に限定されず、その他各種の付加変更が可能である。例えば、同一機能を有する複数の周辺装置としてwebカメラを挙げたが、それに限定されるものではない。例えば、相談者の音声等を入力するマイクロフォンと、相談者が保有する録音機の再生音を入力するマイクロフォンのように複数のマイクロフォンを有する場合にも適用できる。また入力用の周辺装置に限定されず、出力用の周辺装置であってもよい。例えば、印刷用紙のサイズや印刷色(白黒とカラー)の異なる複数のプリンタなどを有する場合などに適用できる。
[Other embodiments]
Although the embodiment of the present invention has been described above, the present invention is not limited to the above example, and various other additions and modifications can be made. For example, although a web camera is used as a plurality of peripheral devices having the same function, the present invention is not limited to this. For example, the present invention can also be applied to a case where there are a plurality of microphones such as a microphone for inputting a consultant's voice and a microphone for inputting a reproduction sound of a recording machine owned by the consultant. The peripheral device for input is not limited to the peripheral device for input, and may be a peripheral device for output. For example, the present invention can be applied to a case where a plurality of printers having different printing paper sizes and printing colors (monochrome and color) are included.
 なお、本発明は、日本国にて2012年2月15日に特許出願された特願2012-030465の特許出願に基づく優先権主張の利益を享受するものであり、当該特許出願に記載された内容は、全て本明細書に含まれるものとする。 The present invention enjoys the benefit of the priority claim based on the patent application of Japanese Patent Application No. 2012-030465 filed on February 15, 2012 in Japan, and is described in the patent application. The contents are all included in this specification.
1…相談者端末
2…相談対応者端末
3…管理装置
4…ネットワーク
5…周辺装置の構成データ
6…構成データ記憶部
DESCRIPTION OF SYMBOLS 1 ... Consulter terminal 2 ... Consultant terminal 3 ... Management apparatus 4 ... Network 5 ... Peripheral device configuration data 6 ... Configuration data storage part

Claims (20)

  1.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおいて、
     前記相談者端末は、
     予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した前記固有情報を含む周辺装置サーチ結果メッセージを前記管理装置へ送信する周辺装置取得部と、
     前記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の前記周辺装置からの入力データを含む周辺装置入力データメッセージを前記相談対応者端末へ送信する周辺装置起動部と
    を有し、
     前記管理装置は、
     前記相談者端末に対応して、前記固有情報と前記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部と、
     前記相談者端末から受信した前記周辺装置サーチ結果メッセージ中の前記固有情報のうち、一致する前記固有情報が前記構成データ記憶部の前記周辺装置構成データに存在しない前記固有情報を含む前記周辺装置構成データを作成して前記構成データ記憶部に記憶すると共に、前記作成した前記周辺装置構成データを含む未登録周辺装置通知メッセージを、前記相談対応者端末へ送信する周辺装置照合部と、
     前記相談対応者端末から受信した前記周辺装置用途通知メッセージに含まれる前記用途情報に従って前記構成データ記憶部の前記周辺装置構成データにおける前記用途情報を更新する構成データ更新部と
    を有し、
     前記相談対応者端末は、
     前記管理装置から受信した前記未登録周辺装置通知メッセージに含まれる前記周辺装置構成データに対応する前記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
     オペレータによって前記リストから選択された前記周辺装置を指定した前記周辺装置入力データ要求メッセージを前記相談者端末へ送信し、前記相談者端末から受信した前記周辺装置入力データメッセージに含まれる前記周辺装置からの前記入力データを前記表示装置に表示する用途確認部と、
     前記オペレータから入力された前記周辺装置の前記用途情報を含む前記周辺装置用途通知メッセージを前記管理装置へ送信する用途設定部と
    を有する遠隔相談システム。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal In the remote consultation system that establishes communication between the consultant terminal and the consultation responder terminal, and realizes consultation between the consultant and the consultant,
    The consultant terminal is
    Acquires specific information that is specific to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired specific information to the management device A peripheral device acquisition unit,
    A peripheral device activation unit that transmits a peripheral device input data message including input data from the peripheral device of the terminal according to the peripheral device input data request message received from the consultant terminal, to the consultant terminal;
    The management device
    Corresponding to the consultant terminal, a configuration data storage unit that stores peripheral device configuration data composed of the unique information and usage information indicating the usage of the peripheral device;
    Among the unique information in the peripheral device search result message received from the consultant terminal, the peripheral device configuration includes the unique information that does not exist in the peripheral device configuration data of the configuration data storage unit that matches the unique information A peripheral device verification unit that creates data and stores it in the configuration data storage unit, and transmits an unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal;
    A configuration data updating unit that updates the usage information in the peripheral device configuration data of the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal;
    The consultation support terminal is
    A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on a display device;
    The peripheral device input data request message specifying the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and the peripheral device included in the peripheral device input data message received from the consultant terminal A use confirmation unit that displays the input data of the display device,
    A remote consultation system comprising: a usage setting unit that transmits the peripheral device usage notification message including the usage information of the peripheral device input from the operator to the management device.
  2.  前記管理装置は、前記相談のために前記相談者端末を前記相談対応者端末に接続する際、前記相談者端末に対応して前記構成データ記憶部に記憶されている前記周辺装置構成データを前記相談対応者端末に送信する機能を有し、
     前記相談対応者端末は、前記管理装置から受信した前記周辺装置構成データ中の用途情報に基づいて、前記相談対応者端末から遠隔操作する前記周辺装置を選択するためのリストを作成して前記表示装置に表示する機能を有する
    請求項1に記載の遠隔相談システム。
    When the management device connects the consultant terminal to the consultation responder terminal for the consultation, the management device stores the peripheral device configuration data stored in the configuration data storage unit corresponding to the consulter terminal. It has a function to send to the consultation support terminal,
    The consultation responder terminal creates and displays a list for selecting the peripheral device to be remotely operated from the consultation responder terminal based on usage information in the peripheral device configuration data received from the management device The remote consultation system according to claim 1, which has a function of displaying on a device.
  3.  前記事象は、前記相談者端末の電源投入、および周辺装置探索要求入力の少なくとも一方である
    請求項1または2に記載の遠隔相談システム。
    The remote consultation system according to claim 1 or 2, wherein the event is at least one of power-on of the consultant terminal and a peripheral device search request input.
  4.  前記周辺装置は、USBインターフェースによって前記相談者端末に接続される
    請求項1乃至3何れかに記載の遠隔相談システム。
    The remote consultation system according to claim 1, wherein the peripheral device is connected to the consultant terminal via a USB interface.
  5.  前記周辺装置は、撮像装置である
    請求項1乃至4の何れかに記載の遠隔相談システム。
    The remote consultation system according to claim 1, wherein the peripheral device is an imaging device.
  6.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記管理装置において、
     前記相談者端末に対応して、前記周辺装置に固有な情報である固有情報と前記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部と、
     前記相談者端末から、前記相談者端末に接続されている前記周辺装置の前記固有情報を含む周辺装置サーチ結果メッセージを受信し、該受信した周辺装置サーチ結果メッセージ中の前記固有情報のうち、一致する前記固有情報が前記構成データ記憶部の前記周辺装置構成データに存在しない前記固有情報を含む前記周辺装置構成データを作成して前記構成データ記憶部に記憶すると共に、前記作成した前記周辺装置構成データを含む未登録周辺装置通知メッセージを、前記相談対応者端末へ送信する周辺装置照合部と、
     前記相談対応者端末から、前記周辺装置の前記用途情報を含む周辺装置用途通知メッセージを受信し、該受信した前記周辺装置用途通知メッセージに含まれる前記用途情報に従って前記構成データ記憶部の前記周辺装置構成データにおける前記用途情報を更新する構成データ更新部と
    を有する管理装置。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal In the management device in the remote consultation system that establishes communication between the consultant terminal and the consultant terminal, and realizes consultation between the consultant and the consultant,
    Corresponding to the consultant terminal, a configuration data storage unit that stores peripheral device configuration data including unique information that is unique to the peripheral device and usage information that indicates the usage of the peripheral device;
    A peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and the matching among the unique information in the received peripheral device search result message Creating the peripheral device configuration data including the unique information that does not exist in the peripheral device configuration data of the configuration data storage unit and storing the peripheral device configuration data in the configuration data storage unit, and creating the peripheral device configuration An unregistered peripheral device notification message including data, a peripheral device verification unit that transmits to the consultant terminal,
    A peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit is received according to the usage information included in the received peripheral device usage notification message A management apparatus comprising: a configuration data update unit that updates the usage information in the configuration data.
  7.  前記相談のために前記相談者端末を前記相談対応者端末に接続する際、前記相談者端末に対応して前記構成データ記憶部に記憶されている前記周辺装置構成データを前記相談対応者端末に送信する機能を有する
    請求項6に記載の管理装置。
    When connecting the consulter terminal to the consultant terminal for the consultation, the peripheral device configuration data stored in the configuration data storage unit corresponding to the consulter terminal is stored in the consultant terminal. The management apparatus according to claim 6, which has a transmission function.
  8.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談対応者端末において、
     前記管理装置から、前記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、該受信した未登録周辺装置通知メッセージに含まれる前記周辺装置構成データに対応する前記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
     オペレータによって前記リストから選択された前記周辺装置を指定した前記周辺装置入力データ要求メッセージを前記相談者端末へ送信し、前記相談者端末から受信した周辺装置入力データメッセージに含まれる前記周辺装置からの前記入力データを前記表示装置に表示する用途確認部と、
     前記オペレータから入力された前記周辺装置の前記用途情報を含む前記周辺装置用途通知メッセージを前記管理装置へ送信する用途設定部と
    を有する相談対応者端末。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal In the consultation responder terminal in the remote consultation system that establishes communication between the consultant terminal and the consultation responder terminal, and realizes consultation between the consultant and the consultation responder ,
    From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that is unique to the peripheral device connected to the consultant terminal is received and received. A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
    The peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and the peripheral device included in the peripheral device input data message received from the consultant terminal A use confirmation unit for displaying the input data on the display device;
    A consultation respondent terminal comprising: a usage setting unit that transmits the peripheral device usage notification message including the usage information of the peripheral device input from the operator to the management device.
  9.  前記管理装置から受信した前記周辺装置構成データ中の用途情報に基づいて、前記相談対応者端末から遠隔操作する前記周辺装置を選択するためのリストを作成して前記表示装置に表示する機能を有する
    請求項8に記載の相談対応者端末。
    Based on usage information in the peripheral device configuration data received from the management device, it has a function of creating a list for selecting the peripheral device to be remotely operated from the consultant terminal and displaying it on the display device The consultation responder terminal according to claim 8.
  10.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談者端末において、
     予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した前記固有情報を含む周辺装置サーチ結果メッセージを前記管理装置へ送信する周辺装置取得部と、
     前記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の前記周辺装置からの入力データを含む周辺装置入力データメッセージを前記相談対応者端末へ送信する周辺装置起動部と
    を有する相談者端末。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal In the counselor terminal in the remote consultation system that establishes communication between the counselor terminal and the counselor terminal, and realizes counseling between the counselor and the counselor,
    Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device A peripheral device acquisition unit,
    A consultant having a peripheral device activation unit for transmitting a peripheral device input data message including input data from the peripheral device of the terminal to the consultant terminal according to the peripheral device input data request message received from the consultant terminal Terminal.
  11.  前記周辺装置は、USBインターフェースによって接続される
    請求項10に記載の相談者端末。
    The consultant terminal according to claim 10, wherein the peripheral device is connected by a USB interface.
  12.  前記周辺装置は、撮像装置である
    請求項10または11に記載の相談者端末。
    The consultant terminal according to claim 10 or 11, wherein the peripheral device is an imaging device.
  13.  前記事象は、前記相談者端末の電源投入、および周辺装置探索要求入力の少なくとも一方である
    請求項10乃至13の何れかに記載の相談者端末。
    The consultant terminal according to any one of claims 10 to 13, wherein the event is at least one of power-on of the consultant terminal and a peripheral device search request input.
  14.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムの制御方法であって、
     前記相談者端末が、予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した前記固有情報を含む周辺装置サーチ結果メッセージを前記管理装置へ送信し、
     前記管理装置が、前記相談者端末に対応して、前記固有情報と前記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から前記周辺装置構成データを読み出し、前記相談者端末から受信した前記周辺装置サーチ結果メッセージ中の前記固有情報のうち、一致する前記固有情報が前記周辺装置構成データに存在しない前記固有情報を含む前記周辺装置構成データを作成して前記構成データ記憶部に記憶すると共に、前記作成した前記周辺装置構成データを含む未登録周辺装置通知メッセージを、前記相談対応者端末へ送信し、
     前記相談対応者端末が、前記管理装置から受信した前記未登録周辺装置通知メッセージに含まれる前記周辺装置構成データに対応する前記周辺装置のリストを表示装置に表示すると共に、オペレータによって前記リストから選択された前記周辺装置を指定した前記周辺装置入力データ要求メッセージを前記相談者端末へ送信し、
     前記相談者端末が、前記相談対応者端末から受信した前記周辺装置入力データ要求メッセージに従って自端末の前記周辺装置からの入力データを含む周辺装置入力データメッセージを前記相談対応者端末へ送信し、
     前記相談対応者端末が、前記相談者端末から受信した前記周辺装置入力データメッセージに含まれる前記周辺装置からの前記入力データを前記表示装置に表示すると共に、前記オペレータから入力された前記周辺装置の前記用途情報を含む周辺装置用途通知メッセージを前記管理装置へ送信し、
     前記管理装置が、前記相談対応者端末から受信した前記周辺装置用途通知メッセージに含まれる前記用途情報に従って前記構成データ記憶部の前記周辺装置構成データにおける前記用途情報を更新する
    遠隔相談システムの制御方法。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal A remote consultation system control method that establishes communication between the consultant terminal and the consultation responder terminal, and realizes consultation between the consultant and the consultation responder,
    The consultant terminal acquires unique information that is unique to the peripheral device connected to the terminal upon the occurrence of a predetermined event, and the peripheral device search result message including the acquired unique information To the management device,
    The management device receives the peripheral device configuration data from a configuration data storage unit that stores peripheral device configuration data composed of the specific information and usage information indicating the usage of the peripheral device, corresponding to the consultant terminal. Read and create the peripheral device configuration data including the unique information in which the unique information does not exist in the peripheral device configuration data among the unique information in the peripheral device search result message received from the consultant terminal And storing the unregistered peripheral device notification message including the created peripheral device configuration data to the consultation responder terminal.
    The consultation responder terminal displays a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message received from the management device on the display device, and selected from the list by an operator Transmitting the peripheral device input data request message designating the peripheral device to the consultant terminal;
    The counselor terminal transmits a peripheral device input data message including input data from the peripheral device of its own terminal to the consultant terminal according to the peripheral device input data request message received from the consultant terminal,
    The consultation responder terminal displays the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device, and the peripheral device input from the operator. Sending a peripheral device usage notification message including the usage information to the management device;
    A control method of a remote consultation system in which the management device updates the usage information in the peripheral device configuration data of the configuration data storage unit according to the usage information included in the peripheral device usage notification message received from the consultation responder terminal .
  15.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記管理装置の制御方法であって、
     前記相談者端末から、前記相談者端末に接続されている前記周辺装置の前記固有情報を含む周辺装置サーチ結果メッセージを受信し、
     前記相談者端末に対応して、前記周辺装置に固有な情報である固有情報と前記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から前記周辺装置構成データを読み出し、
     前記受信した周辺装置サーチ結果メッセージ中の前記固有情報のうち、一致する前記固有情報が前記周辺装置構成データに存在しない前記固有情報を含む前記周辺装置構成データを作成して前記構成データ記憶部に記憶し、
     前記作成した前記周辺装置構成データを含む未登録周辺装置通知メッセージを、前記相談対応者端末へ送信し、
     前記相談者端末から、前記周辺装置の前記用途情報を含む周辺装置用途通知メッセージを受信し、
     該受信した前記周辺装置用途通知メッセージに含まれる前記用途情報に従って前記構成データ記憶部の前記周辺装置構成データにおける前記用途情報を更新する
    管理装置の制御方法。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal The control method of the management device in the remote consultation system that establishes communication between the consultant terminal and the consultation responder terminal, and realizes consultation between the consultant and the consultant Because
    A peripheral device search result message including the specific information of the peripheral device connected to the consultant terminal is received from the consultant terminal,
    Corresponding to the consultant terminal, the peripheral device is configured from a configuration data storage unit that stores peripheral device configuration data that includes unique information that is unique to the peripheral device and usage information that indicates the use of the peripheral device. Read configuration data,
    Among the unique information in the received peripheral device search result message, the peripheral device configuration data including the unique information whose matching unique information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit Remember,
    An unregistered peripheral device notification message including the created peripheral device configuration data is transmitted to the consultant terminal,
    A peripheral device usage notification message including the usage information of the peripheral device is received from the consultant terminal,
    A management apparatus control method for updating the usage information in the peripheral device configuration data of the configuration data storage unit according to the usage information included in the received peripheral device usage notification message.
  16.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談対応者端末の制御方法であって、
     前記管理装置から、前記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、
     前記受信した未登録周辺装置通知メッセージに含まれる前記周辺装置構成データに対応する前記周辺装置のリストを表示装置に表示し、
     オペレータによって前記リストから選択された前記周辺装置を指定した前記周辺装置入力データ要求メッセージを前記相談者端末へ送信し、
     前記相談者端末から受信した周辺装置入力データメッセージに含まれる前記周辺装置からの前記入力データを前記表示装置に表示し、
     前記オペレータから入力された前記周辺装置の前記用途情報を含む前記周辺装置用途通知メッセージを前記管理装置へ送信する
    相談対応者端末の制御方法。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal Of the counselor terminal in the remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor A control method,
    From the management device, an unregistered peripheral device notification message including peripheral device configuration data composed of unique information and usage information that is unique to the peripheral device connected to the consultant terminal,
    Displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the received unregistered peripheral device notification message on a display device;
    Sending the peripheral device input data request message specifying the peripheral device selected from the list by an operator to the consultant terminal;
    Displaying the input data from the peripheral device included in the peripheral device input data message received from the consultant terminal on the display device;
    A method for controlling a consultation responder terminal that transmits the peripheral device usage notification message including the usage information of the peripheral device input from the operator to the management device.
  17.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談者端末の制御方法であって、
     予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、
     前記取得した前記固有情報を含む周辺装置サーチ結果メッセージを前記管理装置へ送信し、
     前記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の前記周辺装置からの入力データを含む周辺装置入力データメッセージを前記相談対応者端末へ送信する
    相談者端末の制御方法。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal Control of the counselor terminal in a remote counseling system that establishes communication between the counselor terminal and the counselor terminal and realizes counseling between the counselor and the counselor A method,
    Acquire specific information that is specific to the peripheral device connected to the terminal when a predetermined event occurs,
    Sending a peripheral device search result message including the acquired unique information to the management device;
    A method for controlling a counselor terminal that transmits a peripheral device input data message including input data from the peripheral device of its own terminal to the counselor terminal according to a peripheral device input data request message received from the counselor terminal.
  18.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記管理装置を構成するコンピュータを、
     前記相談者端末から、前記相談者端末に接続されている前記周辺装置の前記固有情報を含む周辺装置サーチ結果メッセージを受信し、前記相談者端末に対応して、前記周辺装置に固有な情報である固有情報と前記周辺装置の用途を表す用途情報とから構成される周辺装置構成データを記憶する構成データ記憶部から前記周辺装置構成データを読み出し、前記受信した周辺装置サーチ結果メッセージ中の前記固有情報のうち、一致する前記固有情報が前記周辺装置構成データに存在しない前記固有情報を含む前記周辺装置構成データを作成して前記構成データ記憶部に記憶すると共に、前記作成した前記周辺装置構成データを含む未登録周辺装置通知メッセージを、前記相談対応者端末へ送信する周辺装置照合部と、
     前記相談対応者端末から、前記周辺装置の前記用途情報を含む周辺装置用途通知メッセージを受信し、該受信した前記周辺装置用途通知メッセージに含まれる前記用途情報に従って前記構成データ記憶部の前記周辺装置構成データにおける前記用途情報を更新する構成データ更新部と
    して機能させるためのプログラム。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal The communication device is established between the counselor terminal and the counselor responder terminal, and constitutes the management device in the remote counseling system that realizes counseling between the counselor and the counselor Computer
    A peripheral device search result message including the unique information of the peripheral device connected to the consultant terminal is received from the consultant terminal, and information specific to the peripheral device is received corresponding to the consultant terminal. The peripheral device configuration data is read from a configuration data storage unit that stores peripheral device configuration data that includes specific information and usage information that indicates the usage of the peripheral device, and the unique device is included in the received peripheral device search result message. Among the information, the peripheral device configuration data including the unique information whose matching unique information does not exist in the peripheral device configuration data is created and stored in the configuration data storage unit, and the created peripheral device configuration data An unregistered peripheral device notification message including a peripheral device verification unit that transmits to the consultant terminal,
    A peripheral device usage notification message including the usage information of the peripheral device is received from the consultation responder terminal, and the peripheral device of the configuration data storage unit is received according to the usage information included in the received peripheral device usage notification message A program for functioning as a configuration data update unit that updates the usage information in configuration data.
  19.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談対応者端末を構成するコンピュータを、
     前記管理装置から、前記相談者端末に接続されている周辺装置に固有の情報である固有情報と用途情報とから構成される周辺装置構成データを含む未登録周辺装置通知メッセージを受信し、該受信した未登録周辺装置通知メッセージに含まれる前記周辺装置構成データに対応する前記周辺装置のリストを表示装置に表示する周辺装置リスト表示部と、
     オペレータによって前記リストから選択された前記周辺装置を指定した前記周辺装置入力データ要求メッセージを前記相談者端末へ送信し、前記相談者端末から受信した周辺装置入力データメッセージに含まれる前記周辺装置からの前記入力データを前記表示装置に表示する用途確認部と、
     前記オペレータから入力された前記周辺装置の前記用途情報を含む前記周辺装置用途通知メッセージを前記管理装置へ送信する用途設定部と
    して機能させるためのプログラム。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal The consultation responder terminal in the remote consultation system that establishes communication between the consultant terminal and the consultation responder terminal and realizes consultation between the consultant and the consultation responder. Configure the computer
    From the management device, an unregistered peripheral device notification message including peripheral device configuration data including unique information and usage information that is unique to the peripheral device connected to the consultant terminal is received and received. A peripheral device list display unit for displaying a list of the peripheral devices corresponding to the peripheral device configuration data included in the unregistered peripheral device notification message, on a display device;
    The peripheral device input data request message designating the peripheral device selected from the list by the operator is transmitted to the consultant terminal, and the peripheral device included in the peripheral device input data message received from the consultant terminal A use confirmation unit for displaying the input data on the display device;
    A program for functioning as a usage setting unit that transmits the peripheral device usage notification message including the usage information of the peripheral device input from the operator to the management device.
  20.  相談を希望する相談者が使用する相談者端末と、前記相談に応じる相談対応者が使用する相談対応者端末と、前記相談者端末と前記相談対応者端末との間の通信を中継する管理装置とから構成され、前記相談者端末と前記相談対応者端末との間で通信を確立し、前記相談者と前記相談対応者との間の相談を実現する遠隔相談システムにおける前記相談者端末を構成するコンピュータを、
     予め定められた事象の発生を契機に自端末に接続されている周辺装置に固有な情報である固有情報を取得し、該取得した前記固有情報を含む周辺装置サーチ結果メッセージを前記管理装置へ送信する周辺装置取得部と、
     前記相談対応者端末から受信した周辺装置入力データ要求メッセージに従って自端末の前記周辺装置からの入力データを含む周辺装置入力データメッセージを前記相談対応者端末へ送信する周辺装置起動部と
    して機能させるためのプログラム。
    A consultant terminal used by a consultant who wishes to consult, a consultant terminal used by a consultant who responds to the consultation, and a management device that relays communication between the consultant terminal and the consultant terminal The communication terminal between the counselor terminal and the counselor responder terminal is configured to configure the counselor terminal in the remote counseling system that realizes counseling between the counselor and the counselor cooperator. Computer
    Acquires unique information that is unique to the peripheral device connected to the terminal upon occurrence of a predetermined event, and transmits a peripheral device search result message including the acquired unique information to the management device A peripheral device acquisition unit,
    According to the peripheral device input data request message received from the consultation responder terminal, the peripheral device input data message including the input data from the peripheral device of its own terminal is caused to function as a peripheral device activation unit that transmits to the consultant terminal. program.
PCT/JP2013/000448 2012-02-15 2013-01-29 Remote consultation system WO2013121714A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012030465A JP5867138B2 (en) 2012-02-15 2012-02-15 Remote consultation system
JP2012-030465 2012-02-15

Publications (1)

Publication Number Publication Date
WO2013121714A1 true WO2013121714A1 (en) 2013-08-22

Family

ID=48983854

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/000448 WO2013121714A1 (en) 2012-02-15 2013-01-29 Remote consultation system

Country Status (2)

Country Link
JP (1) JP5867138B2 (en)
WO (1) WO2013121714A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6672588B2 (en) * 2014-02-19 2020-03-25 株式会社リコー Transmission system, method, program and system
CN104853136A (en) * 2015-05-29 2015-08-19 小米科技有限责任公司 Video communication method and device
JP6739837B2 (en) * 2016-03-17 2020-08-12 株式会社キャニオン・マインド program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07192047A (en) * 1992-11-30 1995-07-28 Hitachi Ltd Device operating management system
JPH11231927A (en) * 1998-02-17 1999-08-27 Toshiba Corp Monitor and control system
JP2002051314A (en) * 2000-08-02 2002-02-15 Hitachi Ltd Remote consultation terminal system
JP2008085493A (en) * 2006-09-26 2008-04-10 Oki Electric Ind Co Ltd Remote conversation system, device, and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07192047A (en) * 1992-11-30 1995-07-28 Hitachi Ltd Device operating management system
JPH11231927A (en) * 1998-02-17 1999-08-27 Toshiba Corp Monitor and control system
JP2002051314A (en) * 2000-08-02 2002-02-15 Hitachi Ltd Remote consultation terminal system
JP2008085493A (en) * 2006-09-26 2008-04-10 Oki Electric Ind Co Ltd Remote conversation system, device, and method

Also Published As

Publication number Publication date
JP2013167997A (en) 2013-08-29
JP5867138B2 (en) 2016-02-24

Similar Documents

Publication Publication Date Title
US9130862B2 (en) Information processing device using direct data access from cloud storage
JP5275883B2 (en) Client terminal linkage system, linkage server device, client terminal, client terminal linkage method
US10420011B2 (en) Communication system, transmission terminal, communication method, and medium
CN107172119A (en) The control method of information processor and information processor
US20120198098A1 (en) Apparatus and method for bidirectional pairing between devices
JP5867138B2 (en) Remote consultation system
JP6897214B2 (en) Information processing equipment, programs and information processing systems
RU2750623C1 (en) Wireless terminal, administration server, intent interpretation server, control method and program
JP2013082147A (en) Image forming system, image forming apparatus, and program
JP2015026917A (en) Communication device
JP6611550B2 (en) COMMUNICATION DEVICE, COMMUNICATION DEVICE CONTROL METHOD, AND PROGRAM
JP6568007B2 (en) Wearable terminal, communication method and program thereof
KR20190069247A (en) Electronic device for communication with external electronic device
JP6292202B2 (en) Image forming system, communication terminal, and program
JP2009288863A (en) Communication system, information holding device, management device and terminal device
JP2019079270A (en) System for interpretation support
JP2014167630A (en) Remote control unit, karaoke system, program, and song reservation method
EP3439311B1 (en) Image transmission equipment
JP6508379B2 (en) Information terminal
JP6841112B2 (en) Information processing equipment, programs and information processing systems
JP2005284743A (en) Virtual store system
JP6880790B2 (en) Processing equipment, service providers, screen display methods, and computer programs
WO2003105038A1 (en) On-line manual display system
JP6409412B2 (en) System, electronic device, and control program
JP2019036088A (en) Information processing device and control method thereof, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13749696

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13749696

Country of ref document: EP

Kind code of ref document: A1