JP5382191B2 - Communication method, master display device, slave display device, and communication system including them - Google Patents

Description

  The present invention relates to a communication method, a master display device, a slave display device, and a communication system including them.

  2. Description of the Related Art Conventionally, a communication system has been used in which personal computers as information terminal devices are interconnected via a network and materials and memos are shared electronically. For example, there is an electronic conference system in which a personal computer is connected by a network and a virtual conference is realized by sharing information such as a document, a display page position thereof, and a memo writing through the network. In such an electronic conference system, each site can be photographed with a camera and transmitted to both parties to create a sense of unity as a conference, or to send presentation screens of participants who are speaking. There was a way to proceed with proceedings.

  For example, Patent Document 1 includes a plurality of client computers, a server, and a network that connects these to each other, and exchanges utterance information and video information between the client computers, conference proceedings, and the like. An electronic conference system that displays the display screen in real time is disclosed.

  Patent Document 2 discloses a technique for providing a chat room by giving authority to a user who can participate in an information sharing space.

JP 2004-350134 A JP 2002-215553 A

  However, in the prior arts disclosed in Patent Document 1 and Patent Document 2, display of each client computer is performed while maintaining display information for structuring and displaying information exchanged between client computers on a display screen. Could not be synchronized.

  The present invention has been made in view of the above problems, and easily synchronizes structured display information obtained by structuring a plurality of pieces of fragment information each having display data between a plurality of display devices. It is an object to provide a communication method, a master display device, a slave display device, and a communication system including them.

  In order to achieve the above object, according to the communication method of the present invention, structured display information obtained by structuring a plurality of pieces of fragment information each having display data is transmitted via a network between a master display device and a slave display device. A communication method in a communication system that is shared by communication and performs the same display on the master display device and the slave display device based on the structured display information, wherein the master display device stores the structured display information When the fragment information to be configured is changed, a notification indicating that the fragment information has been changed and ID information for identifying the changed fragment information are transmitted to the slave display device. And

  According to the communication method having the above configuration, when the master display device changes the fragment information constituting the structured display information, the master display device indicates to the slave display device that the fragment information constituting the structured display information has been changed. A notification and ID information for identifying the changed fragment information are transmitted. Therefore, the slave display device can promptly ask the master display device whether or not the fragment information constituting the structured display information is changed when the fragment information constituting the structured display information is changed. In addition to knowing that the fragment information has been changed, it is possible to recognize which fragment information has been changed by the ID information. Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as that of the master display device can be shared in synchronization. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  In the communication method configured as described above, the fragment information may include the ID information, and the master display device may further transmit the changed fragment information to the slave display device.

  Furthermore, the slave display device may edit the structured display information based on the received fragment information and perform display based on the edited structured display information.

  By adopting such a configuration, the slave display device can quickly and reliably edit the structured display information and display the same display as the master display device when the fragment information constituting the structured display information is changed. can do. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  In the above configuration, the fragment information may have a hash value for confirming the identity of the content of the fragment information. By adopting such a configuration, since the identity of the content of the fragment information transmitted from the master display device to the slave display device can be confirmed by the hash value, the master display device and the slave display device have a plurality of The structured display information obtained by structuring the fragment information can be reliably synchronized, and the display based on the structured display information can be reliably synchronized.

  In the above configuration, the fragment information may include update date / time information indicating the latest date / time when the master display device changed the fragment information. By adopting such a configuration, it is possible to know the exact date and time when the fragment information is changed, so that the master display device and the slave display device can easily perform structured display information in which a plurality of fragment information is structured. The display based on the structured display information can be synchronized quickly and reliably.

  In the above configuration, the master display device and the slave display device may perform communication conforming to XMPP (eXtensible Messaging and Presence Protocol). XMPP is an XML-based protocol (communication protocol) that is being standardized and standardized by the XMPP (XMPP Standards Foundation) independent of the XMPP working group of the Internet Engineering Task Force (IETF). Use XMPP to dynamically control a wide range of applications, including instant messaging, presence ("what the other person is now"), multi-user chat, voice or videophone, collaborative work, content syndication, etc. In addition, real-time communication can be performed in a communication system such as the Internet. In XMPP, a plurality of extension protocols (XEP: XMPP Extension Protocol) according to each purpose are standardized.

  By adopting such a configuration, real-time messaging (information exchange) can be performed between the master display device and the slave display device, and the information displayed by the XMPP and the master display device have the ID information. Information displayed on the display unit and the display unit included in the slave display device can be easily and reliably associated with each other.

  In the above configuration, the information transmitted and received between the master display device and the slave display device may be an html file in which meta information is expanded. Here, the html file with expanded meta information is data in a format that can be expressed in html (Hyper Text Markup Language) compatible with XMPP-compliant communication (text data, image data, audio data, video data, etc.) have. In addition, meta information that is information (attribute information) related to the data may be included. The meta information includes attribute information corresponding to messaging by XMPP, such as ID information, access right information, user information, access model information, and location information. Here, the use of attribute information (ID information, access right information, user information, access model information, location information, etc.) corresponding to messaging by XMPP as meta information is called extension.

  With this configuration, if the data is expressed in html that is compatible with XMPP-compliant communication, all types of data that can be expressed in html between the master display device and the slave display device. Data (text data, image data, audio data, moving image data, etc.) can be transmitted and received, and the combination thereof is not limited.

  In the above configuration, the slave display device transmits the notification from the master display device to the slave display device when the master display device changes the fragment information to the master display device. A contract application is transmitted, and the master display device may conclude the contract with the slave display device. With such a configuration, when the fragment information constituting the structured display information is changed on the master display device, the slave display device can quickly know that the fragment information has been changed. . Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as the master display device can be shared. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  In order to achieve the above object, the master display device of the present invention shares structured display information formed by structuring a plurality of pieces of fragment information each having display data through communication with a slave display device via a network. A master display device that performs the same display as the slave display device based on the structured display information, and when the fragment information constituting the structured display information is changed, the slave display device And a communication unit for transmitting notification indicating that the fragment information has been changed and ID information for identifying the changed fragment information.

  According to the master display device having the above configuration, when the fragment information constituting the structured display information is changed, the slave display device is notified that the fragment information constituting the structured display information has been changed, and the change ID information for identifying the fragment information is transmitted. Therefore, when the fragment information constituting the structured display information is changed, it is possible to notify the slave display device that the fragment information has been changed quickly, and which fragment information is changed by the ID information. Can be recognized. Therefore, when the fragment information constituting the structured display information is changed, the slave display device that has received the notification and the ID information requests the master display device to transmit the changed fragment information quickly and reliably. The same structured display information as that of the master display device can be shared. Therefore, the master display device can easily synchronize the slave display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In the master display device configured as described above, the fragment information may include the ID information, and the communication unit may further transmit the changed fragment information to the slave display device.

  With this configuration, when the fragment information constituting the structured display information is changed, the changed fragment information can be transmitted to the slave display device. Therefore, when the fragment information constituting the structured display information is changed, the slave display device that has received the notification, the ID information, and the changed fragment information recognizes the fragment information changed by the ID information quickly and reliably. Thus, operations such as editing the structured display information can be performed. Therefore, the master display device can easily synchronize the slave display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In the master display device having the above-described configuration, the fragment information may have a hash value for confirming the identity of the content of the fragment information. By adopting such a configuration, the master display device can confirm the identity of the content of the fragment information transmitted to the slave display device by the hash value, so that the slave display device and the plurality of fragment information are structured. It is possible to reliably synchronize the structured display information that is formed, and to reliably synchronize the display based on the structured display information.

  In the master display device having the above-described configuration, the fragment information may include update date / time information indicating the latest date / time when the fragment information is changed. By adopting such a configuration, the master display device can know the exact date and time when the fragment information is changed, so that the slave display device and structured display information formed by structuring a plurality of pieces of fragment information can be easily performed. The display based on the structured display information can be synchronized quickly and reliably.

  Further, the master display device having the above-described configuration may perform communication based on XMPP with the slave display device. With such a configuration, the master display device can perform real-time messaging (information exchange) with the slave display device, and information that is messaged by XMPP, the master display device, and the slave display can be performed based on the ID information. Information displayed on the apparatus can be associated with the information simply and reliably.

  In the master display device having the above configuration, the information transmitted by the communication unit may be an html file in which meta information is expanded. By adopting such a configuration, if the master display device is data expressed in html that conforms to communication conforming to XMPP, the master display device can display everything in the html in the slave display device. Data (text data, image data, audio data, moving image data, etc.) can be transmitted, and the combination thereof is not limited.

  Further, in the master display device having the above configuration, when the fragment information is changed, a contract is made with the slave display device that the notification indicating that the fragment information has been changed is transmitted to the slave display device. It is good. With such a configuration, when the fragment information constituting the structured display information is changed, it is possible to promptly notify the slave display device that the fragment information has been changed. Therefore, when the master display device changes the fragment information constituting the structured display information, the slave display device that receives the notification requests the master display device to transmit the changed fragment information quickly and reliably. The same structured display information as that of the master display device can be shared. Therefore, the master display device can easily synchronize the slave display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In order to achieve the above object, the slave display device of the present invention shares structured display information formed by structuring a plurality of pieces of fragment information of individual display data through communication via a network with the master display device. And a slave display device that performs the same display as the master display device based on the structured display information, and when the master display device changes the fragment information constituting the structured display information, A communication unit is provided that receives from the master display device a notification indicating that the fragment information has been changed and ID information for identifying the changed fragment information.

  According to the slave display device having the above configuration, when the master display device changes the fragment information constituting the structured display information, the slave display device includes a notification indicating that the fragment information constituting the structured display information has been changed. The ID information for identifying the changed fragment information is received. Therefore, the slave display device can promptly ask the master display device whether or not the fragment information constituting the structured display information is changed when the fragment information constituting the structured display information is changed. In addition to knowing that the fragment information has been changed, it is possible to recognize which fragment information has been changed by the ID information. Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as the master display device can be shared. Therefore, the slave display device can easily synchronize the master display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In the slave display device configured as described above, the fragment information may include the ID information, and the communication unit may receive the changed fragment information from the master display device.

  Further, in the slave display device having the above-described configuration, a control unit that edits the structured display information based on the fragment information received by the communication unit, and a display unit that performs display based on the edited structured display information The display unit may display the display data included in the fragment information identified by the ID information.

  By adopting such a configuration, the slave display device can quickly and reliably edit the structured display information and display the same display as the master display device when the fragment information constituting the structured display information is changed. can do. Therefore, the slave display device can easily synchronize the master display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In the slave display device configured as described above, the fragment information may have a hash value for confirming the identity of the content of the fragment information. By adopting such a configuration, the slave display device can confirm the identity of the content of the fragment information received from the master display device by the hash value. The slave display device can reliably synchronize the master display device and structured display information formed by structuring a plurality of pieces of fragment information, and can reliably synchronize the display based on the structured display information.

  In the slave display device configured as described above, the fragment information may include update date / time information indicating the latest date / time when the fragment information is changed. With such a configuration, the slave display device can know the exact date and time when the fragment information is changed. Therefore, it is possible to easily synchronize the master display device and structured display information formed by structuring a plurality of pieces of fragment information, and it is possible to quickly and reliably synchronize the display based on the structured display information.

  In the slave display device having the above-described configuration, communication based on XMPP may be performed with the master display device. With such a configuration, the slave display device can perform real-time messaging (information exchange) with the master display device, and information displayed by the XMPP and the slave display device are displayed by the ID information. Information can be associated easily and reliably.

  In the slave display device configured as described above, the information transmitted by the communication unit may be an html file in which meta information is expanded. By adopting such a configuration, if the data is expressed in html that conforms to communication conforming to XMPP, the slave display device can receive all types of data (in the format that can be expressed in html) from the master display device ( Text data, image data, audio data, moving image data, etc.) and the combination thereof is not limited.

  In the slave display device having the above configuration, when the master display device changes the fragment information, a contract may be made with the master display device to receive the notification from the master display device. By adopting such a configuration, the slave display device can quickly know that the fragment information has been changed when the fragment information constituting the structured display information is changed in the master display device. . Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as the master display device can be shared. Therefore, the slave display device can easily synchronize the master display device with the structured display information formed by structuring a plurality of pieces of fragment information, and synchronizes the display based on the structured display information quickly and reliably. be able to.

  In order to achieve the above object, the communication system of the present invention includes a structured display in which the above-mentioned master display device and the above-described slave display device are structured by a plurality of pieces of fragment information each including display data. Information is shared by communication via a network, and based on the structured display information, the master display device and the slave display device perform the same display.

  According to the communication system configured as described above, when the master display device changes the fragment information constituting the structured display information, the master display device indicates to the slave display device that the fragment information constituting the structured display information has been changed. A notification and ID information for identifying the changed fragment information are transmitted. Therefore, the slave display device can promptly ask the master display device whether or not the fragment information constituting the structured display information is changed when the fragment information constituting the structured display information is changed. In addition to knowing that the fragment information has been changed, it is possible to recognize which fragment information has been changed by the ID information. Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as the master display device can be shared. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  In the communication system configured as described above, the master display device and the slave display device may perform communication conforming to XMPP. By adopting such a configuration, real-time messaging (information exchange) can be performed between the master display device and the slave display device, and the information displayed by the XMPP and the master display device have the ID information. Information displayed on the display unit and the display unit included in the slave display device can be easily and reliably associated with each other.

  Further, according to the present invention, when the master display device changes the fragment information constituting the structured display information, the master display device notifies the slave display device that the fragment information constituting the structured display information has been changed. ID information for identifying the changed fragment information is transmitted. Therefore, the slave display device can promptly ask the master display device whether or not the fragment information constituting the structured display information is changed when the fragment information constituting the structured display information is changed. In addition to knowing that the fragment information has been changed, it is possible to recognize which fragment information has been changed by the ID information. Therefore, when the fragment information constituting the structured display information is changed, the slave display device can perform an operation such as promptly and reliably requesting the master display device to transmit the changed fragment information. The same structured display information as the master display device can be shared. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  Further, according to the present invention, the slave display device can quickly and reliably edit the structured display information and display the same display as the master display device when the fragment information constituting the structured display information is changed. Can do. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do.

  Further, according to the present invention, since the identity of the content of the fragment information transmitted from the master display device to the slave display device can be confirmed by the hash value, the master display device and the slave display device have a plurality of pieces of fragment information. It is possible to reliably synchronize the structured display information obtained by structuring and to synchronize the display based on the structured display information.

  In addition, according to the present invention, since it is possible to know the exact date and time when the fragment information is changed, the master display device and the slave display device can easily synchronize structured display information formed by structuring a plurality of fragment information. The display based on the structured display information can be synchronized quickly and reliably.

  Further, according to the present invention, real-time messaging (information exchange) can be performed between the master display device and the slave display device, and information that is messaged by XMPP based on the ID information and the display unit included in the master display device And information displayed on the display unit of the slave display device can be simply and reliably associated with each other.

  In addition, according to the present invention, any data expressed in html that can be expressed in html between the master display device and the slave display device as long as the data is expressed in html compatible with communication conforming to XMPP ( (Text data, image data, audio data, moving image data, etc.) can be transmitted and received, and the combination thereof is not limited.

It is a figure which shows an example of the communication system of this invention. It is a block diagram which shows the structure of the multi-site electronic conference system in embodiment of this invention. It is a block diagram which shows the structure of the display apparatus in embodiment of this invention. It is a block diagram which shows the structure of the information terminal device in embodiment of this invention. It is a block diagram which shows the structure of the structured display information in the embodiment of the present invention. It is a figure for demonstrating the display screen based on structured display information in embodiment of this invention. It is a figure which shows an example of the actual display screen based on structured display information in embodiment of this invention. It is a figure which shows an example of the html fragment information expressed as an html file in the embodiment of the present invention. It is an operation | movement diagram for demonstrating the procedure in which a master display apparatus opens a virtual conference room in the multi-site electronic conference system in the embodiment of the present invention. It is an operation | movement diagram for demonstrating the procedure for an information terminal device to participate in the multi-site electronic conference system in embodiment of this invention. It is an operation | movement diagram for demonstrating the procedure in which each terminal device of the multi-site electronic conference system in embodiment of this invention shares structured display information. It is an operation | movement diagram for demonstrating the procedure in which the master display apparatus performs the preparation which synchronizes with a slave display apparatus in the multi-site electronic conference system of embodiment of this invention. FIG. 11 is an operation diagram for explaining a procedure for a master display device to set a payload in each XMPP node information in the multi-site electronic conference system according to the embodiment of the present invention. FIG. 10 is an operation diagram for explaining a procedure for identifying a structural correlation and attribute information of each XMPP node information by the slave display device in the multi-site electronic conference system according to the embodiment of the present invention. It is an operation | movement diagram for demonstrating the procedure in which a slave display apparatus subscribes to XMPP node information in the multi-site electronic conference system of embodiment of this invention. FIG. 6 is an operation diagram for explaining a procedure until information provided by the user terminal device G is displayed on a display unit of the display device in the multi-site electronic conference system according to the embodiment of the present invention. It is an operation | movement diagram for demonstrating the procedure in which attribute information is set to the XMPP node information for speech in the multi-site electronic conference system in embodiment of this invention, and the procedure in which the shown information is displayed. It is an operation | movement diagram for demonstrating the procedure in which the display screen of a master display apparatus and the display screen of a slave display apparatus synchronize in the multi-site electronic conference system of embodiment of this invention.

  The present invention will be described below with reference to the drawings. Examples of the communication system of the present invention include a multi-site electronic conference system used in a community such as a workplace or a school, a videophone between relatives in a remote place, an online meeting in a community, and the like. FIG. 1 is a diagram illustrating an example of a communication system according to the present invention. In FIG. 1, a plurality of virtual conference rooms (electronic conference systems) in remote locations are connected via a network 3 so that a plurality of users participating in the virtual conference can discuss and share opinions and materials. It shows a multi-site electronic conference system that can be presented. Hereinafter, a multi-site electronic conference system 1 as shown in FIG. 1 will be described as an example.

  The multi-site electronic conference system 1 of the present embodiment is a communication system in which a plurality of virtual conference rooms (electronic conference systems) at remote locations are connected via a network. FIG. 2 is a configuration diagram showing the configuration of the multi-site electronic conference system in the embodiment of the present invention. As shown in FIG. 2, in the multi-site electronic conference system 1, the electronic conference system 2a at the point a, the electronic conference system 2b at the point b, and the electronic conference system 2c at the point c are respectively connected to a network such as the Internet. 3 is connected.

  In the electronic conference system 2 at each point, the display device 10 and the information terminal device 20 are connected via a network 30. Note that there may be one information terminal device 20 or a plurality of information terminal devices 20 as shown in FIG. Further, a communicable terminal device other than the display device 10 and the information terminal device 20 may be connected.

  The display devices (10a, 10b, 10c) in the electronic conference systems (2a, 2b, 2c) at each point communicate via the network 3 and the network 30, respectively. In addition, as will be described later, the information terminal devices (20a, 20b, 20c) in the electronic conference systems (2a, 2b, 2c) at the respective locations are provided with a predetermined display device (for example, as described later, Communication is performed with the display device 10 a) in the electronic conference system 2 a via the network 3 and the network 30.

  Here, the network 3 that connects the electronic conference systems 2 at each point and the network 30 that connects the terminal devices in each electronic conference system 2 may be any communication medium that can communicate with each other. And a communication network such as WAN, the Internet, mobile radio using a wireless LAN or Femto base station, and a wireless communication network such as Bluetooth.

  The multi-site electronic conference system 1 is a multi-user communication system constructed using XMPP (eXtensible Messaging and Presence Protocol) described later. That is, between the display devices (10a, 10b, 10c), and between the predetermined display device 10a and the information terminal devices (20a, 20b, 20c) at each point via the network 3 and the network 30. Communication conforming to XMPP is performed. Therefore, the multi-site electronic conference system 1, as will be described later, between the display devices (10 a, 10 b, 10 c) or a predetermined display device 10 a and information terminal devices (20 a, 20 b, 20 c) at each point. And real-time messaging (information exchange) between them, and therefore, information such as comments, materials, and proceedings presented by each user can be transmitted and received in real time. In particular, between each of the display devices (10a, 10b, 10c), structured display information (first display information) formed by structuring a plurality of pieces of fragment information (second display information) having display data individually is provided in real time. Based on this structured display information, the display screens of opinions, materials, agenda, etc. presented by each user displayed on each display device (10a, 10b, 10c) can be synchronized. Details of the structured display information will be described later.

  Here, XMPP used in the multi-site electronic conference system 1 of this embodiment will be described. XMPP is an XML-based protocol (communication protocol) that is being standardized and standardized by XSF (XMPP Standards Foundation) independent of the XMPP working group of Internet Engineering Task Force (IETF). Use XMPP to dynamically control a wide range of applications, including instant messaging, presence ("what the other person is now"), multi-user chat, voice or videophone, collaborative work, content syndication, etc. In addition, real-time communication can be performed in a communication system such as the Internet. In XMPP, a plurality of extension protocols (XEP: XMPP Extension Protocol) according to each purpose are standardized.

  In the multi-site electronic conference system 1 of the present embodiment, various protocols (communication rules) defined in XMPP are used. Here, XEP-0030 (Service Discovery), XEP-0045 (Multi-User Chat), XEP-0060 (Publish-Subscribe) are particularly important protocols for understanding the multi-site electronic conference system 1 of the present embodiment. ), XEP-0071 (XHTML-IM) will be described.

  XEP-0030 (Service Discovery) is a protocol (communication protocol) that defines a function for detecting information. Hereinafter, it will be referred to as DISCO. In the multi-site electronic conference system 1 of the present embodiment, as will be described later, each terminal device (display device 10 and information terminal device 20) in the electronic conference system 2 at each point uses the DISCO to participate in the multi-site electronic conference system 1. The base electronic conference system 1 is searched.

  XEP-0045 (Multi-User Chat) is a protocol (communication that defines a multi-user chat function in which a plurality of users can exchange messages within a specific community (for example, a chat room) in a virtual space on a network. Terms). Hereinafter, it will be referred to as MUC. In addition to standard chat functions such as chat room topics and invitations to chat rooms, MUC provides a function to kick (forcibly move) and van (exile) users from chat rooms, and to chat room users. A function for controlling a chat room is defined by a function for appointing a role and an affiliate, which will be described later.

  A role is a temporary privilege level given to a user who uses chat. In MUC, roles such as “moderator” who can kick a user or delete his / her speech, “participant” who has the right to speak, and “visitor” who has no right to speak It is prescribed. In addition, the affiliate indicates the position of the user who uses the chat, and is given to the user as being permanently effective even after using the chat. In the MUC, as an affiliate, the “owner” who opened the chat room, the “administer” who manages and operates the chat room, the “member” who is the other user, and the kick The “exile” (outcast) etc. that are not allowed to re-enter the chat room.

  The multi-site electronic conference system 1 of this embodiment is operated using a multi-user chat function (hereinafter referred to as MUC function) compliant with this MUC.

  In addition, XEP-0060 (Publish-Subscribe) indicates that when information is changed in a terminal device on the information transmission side, the terminal device on the reception side sends the information to the terminal device on the information transmission side. A function for preliminarily signing (ie, subscribing to) a notification that a change has been made from the calling terminal device to the receiving terminal device, and the receiving terminal device at the receiving terminal device When a change is made to subscribed information from a terminal device, the originating terminal device changes the information to all receiving terminal devices that subscribe to the changed information. Is a protocol (communication protocol) that defines a function of transmitting a notification that a message has been added (that is, publishing). Hereinafter, it is referred to as “pubsub”.

  The multi-site electronic conference system 1 of the present embodiment realizes a communication system that synchronizes information in real time using a function conforming to the pubsub (hereinafter referred to as a pubsub function).

  XEP-0071 (XHTML-IM) is a protocol (communication protocol) that specifies the exchange of instant messages including lightweight text markup (tagging) using a subset of html. With this protocol, it is possible to set a message format that uses a narrow range of commonly used html elements, attributes, and style properties suitable for instant messaging. The multi-site electronic conference system 1 according to the present embodiment performs transmission / reception of information having extended attribute information described later in accordance with XEP-0071 (XHTML-IM).

  In the multi-site electronic conference system 1 according to the present embodiment, the above-described MUC function and pubsub function are changed from a predetermined display device of the display device 10 of the electronic conference system 2 at each point to another terminal device ( It is provided to the other display device 10 and the information terminal device 20) at each point. In the following, it is assumed that the display device 10a of the electronic conference system 2a at the point a provides the MUC function and the pubsub function to each terminal device (display device 10 and information terminal device 20) in the multi-site electronic conference system 1. . Hereinafter, the display device 10a at the point a is distinguished from the other display devices (10b, 10c) and is called a master display device, and the other display devices 10b, 10c are called slave display devices.

  Next, a specific configuration of the display device 10 (master display device 10a, slave display devices (10b, 10c)) in the multi-site electronic conference system 1 of the present embodiment will be described with reference to the drawings. FIG. 3 is a configuration diagram showing the configuration of the display device in the present embodiment. FIG. 3A is a configuration diagram showing the configuration of the master display device in the multi-site electronic conference system of this embodiment, and FIG. 3B is the slave display in the multi-site electronic conference system of this embodiment. It is a block diagram which shows the structure of an apparatus.

  The master display device 10a is the display device 10 in the electronic conference system 2a at the point a, and other terminal devices (slave display devices (10b, 10c), information terminal devices (20a, 20b, 20c) at each point) The display device performs communication via the network 3 and the network 30, and can perform communication conforming to XMPP. Further, as shown in FIG. 3A, the master display device 10a is structured by a plurality of pieces of fragment information each having display data, and at the same time, the opinions, materials, and agenda items presented to the multi-site electronic conference system 1 are displayed. A display unit 11a that performs display based on structured display information for displaying, etc., and other terminal devices (slave display devices (10b, 10c), information terminal devices (20a, 20b, 20c) at each point) A communication unit 12a that transmits and receives information, a storage unit 13a that stores information transmitted and received by the communication unit 12a and structured display information, a display of information on the display unit 11a, a transmission and reception operation of information on the communication unit 12a, and a storage unit And a control unit 14a for controlling information storage and reading operations in 13a. In addition, the control unit 14a edits the structured display information as necessary, information included in the structured display information (html fragment information to be described later, display data to be displayed on the display unit 11a included in the html fragment information, Meta information, etc.) is created and modified, and an html file described in html is created from the entire structured display information.

  In addition, the control unit 14a of the master display device 10a includes a MUC unit 15 that provides a MUC function to each terminal device (display device 10 and information terminal device 20) in the multi-site electronic conference system 1, and each terminal device (display device 10). , The information terminal device 20) includes a PubSub unit 16 that provides a pubsub function. In the multi-site electronic conference system 1 of this embodiment, only the master display device 10a provides the MUC function and the pubsub function to each terminal device (display device 10 and information terminal device 20) in the multi-site electronic conference system 1. Therefore, information (opinions, materials, etc.) presented to the virtual conference room (multi-site electronic conference system 1) from the information terminal devices (20a, 20b, 20c) at each point is processed by the master display device 10a. The

  Next, the slave display devices (10b, 10c) are the display devices 10 in the electronic conference systems 2b, 2c at the points b, c, and display that communicates with the master display device 10a via the network 3 and the network 30. It is an apparatus and can perform communication based on XMPP. In addition, as shown in FIG. 3B, the slave display devices (10b, 10c) are structured by a plurality of pieces of fragment information each having display data and are presented to the multi-site electronic conference system 1 A display unit (11b, 11c) that performs display based on structured display information for displaying materials, documents, proceedings, and the like, a communication unit (12b, 12c) that transmits / receives information to / from the master display device 10a, and a communication unit (12b, 12c) storage unit 13 for storing information transmitted / received and structured display information, display of information on display unit (11b, 11c), transmission / reception operation of information in communication unit (12b, 12c), storage unit (13b, 13c) and control units (14b, 14c) for controlling the information storage and reading operations. In addition, the control unit (14b, 14c) edits the structured display information and information included in the structured display information (the html fragment information described later and the display unit (11b, 14c) included in the html fragment information, as necessary. 11c) creation and correction of display data, meta information, etc.) and creation of an html file described in html from the entire structured display information.

  The master display device 10a and the slave display devices (10b, 10c) are both structured display information for displaying opinions, materials, proceedings, etc. presented to the multi-site electronic conference system 1 of the present embodiment. A DOM (Document Object Model) described later can be used. Here, DOM (Document Object Model) used in the master display device 10a and the slave display devices (10b, 10c) will be described. DOM is a standardized API (Application Program Interface) for html, XML (eXtensible Markup Language), etc., and is specified by W3C (World Wide Web Consortium). Also, by using DOM, it is possible to dynamically access programs and scripts and display the contents (text information, image information, audio information, etc.) and their structures (layout) without depending on the platform or language. And a style as an object, and also functions as an interface for controlling in a script language such as JavaScript (registered trademark). In general, it can be said that a Web page or an XML page displayed when using the Internet or the like is a document described in html or XML.

  Next, the configuration of the information terminal device 20 (information terminal devices (20a, 20b, 20c) at each point) in the multi-site electronic conference system 1 according to the present embodiment will be described. FIG. 4 is a configuration diagram showing the configuration of the information terminal device in the present embodiment. The information terminal device 20 is an information terminal device that communicates with the master display device 10a via the network 3 and the network 30, and performs communication conforming to XMPP.

  Further, as shown in FIG. 4, the information terminal device 20 includes a terminal communication unit 22 (communication unit) that transmits and receives information to and from the master display device 10 a, a display based on information received by the terminal communication unit 22, and a terminal input unit 25, a terminal display unit 21 (display unit) that displays information input to the terminal 25, a terminal storage unit 23 (storage unit) that stores information transmitted and received by the terminal communication unit 22, and transmission and reception operations and terminal storage in the terminal communication unit 22 The terminal control part 24 (control part) which controls the memory | storage of the information in the part 23, reading operation | movement, etc. and the terminal input part 25 (input part) for a user to input information are provided. Further, as will be described later, the terminal control unit 24 edits the html fragment information constituting the structured display information as necessary, and the information included in the html fragment information (display to be displayed on the display unit 11 of the display device 10). Data and meta information having information related to the display data). Examples of the information terminal device 20 include a portable terminal device such as a mobile phone or a PDA. However, the information terminal device 20 is not limited to these as long as the information terminal device has a communication function.

  In addition, the information terminal devices (20a, 20b, 20c) possessed by the electronic conference system at each point have multi-site electronic devices using MUC functions such as “moderator” and “participant”, respectively. A role indicating a temporary privilege level in the conference system 1 is assigned. Hereinafter, the information terminal device 20 to which the role of “moderator” is given will be described as the moderator terminal device 201, and the information terminal device 20 to which the role of “participant” is given will be described as the user terminal device 202. In the multi-site electronic conference system 1 according to the present embodiment, the affiliation of each information terminal device 20 is not mentioned, but the moderator terminal device 201 is an “owner” and an “administrator”. It is assumed that the user terminal device 202 has an affiliate and a “member” affiliate. It does not mention affiliations such as “visitors” and “outcasts”.

  In addition, the moderator terminal device 201 at each point manages information that is displayed on the master display device 10a from the information terminal device 20 at that point (that is, display data to be displayed on the display unit 11 of each display device 10). This is the terminal device 20. Further, the moderator terminal device 201 at each point is an ID (ID for identifying display data that is presented from the information terminal device 20 at that point to the master display device 10 a and displayed on the display unit 11 of each display device 10. Information), access right information and user information, which will be described later, can be created, and proceedings and management of the electronic conference system 2 at that point are performed.

  Next, opinions, documents, agendas, etc. presented to the multi-site electronic conference system 1 are displayed on the display unit 11a of the master display device 10a and the display units (11b, 11c) of the slave display devices (10b, 10c). Structured display information for this purpose will be described. This structured display information is structured information in which a plurality of pieces of fragment information each having display data have a structural correlation. The plurality of pieces of fragment information form a predetermined data structure, but the structure is not particularly limited, and may take a structure such as a tree structure. Hereinafter, each piece of information constituting the structured information is referred to as html fragment information. FIG. 5 is a configuration diagram showing a configuration of structured display information in the embodiment of the present invention. As shown in FIG. 5, in the structured display information, each html fragment information has a hierarchical correlation with the html fragment information n0 as a vertex. Here, in such a structure, html fragment information having a correlation one level higher than a certain html fragment information is called parent html fragment information, and is one level lower than a certain html fragment information. The html fragment information having a certain correlation is referred to as child html fragment information.

  The html fragment information constituting the structured display information has display data to be displayed on the display unit 11 of the display device 10. In addition, meta information that is information (attribute information) related to the display data may be included. FIG. 8 is a diagram showing an example of html fragment information expressed as an html file in the embodiment of the present invention. The html fragment information shown in FIG. 8 includes display data to be displayed on the display unit 11 of the display device 10 and meta information having information (attribute information) related to the display data.

  In FIG. 8, the display data included in the html fragment information is text data. However, other data such as image data, audio data, and moving image data that are expressed in html that is compatible with XMPP-compliant communication. All types of data that can be expressed in the html can be handled, and the combination is not limited.

  The html fragment information shown in FIG. 8 includes, as meta information, a unique ID (ID information) for identifying the html fragment information, and a position indicating the display position on the display screen 111 of the display data included in the html fragment information. Information, generation date / time information indicating the generation date / time of html fragment information, update date / time information indicating the latest date / time when the content of the html fragment information was updated, user information indicating a user who is the owner of the html fragment information, It is set for each user who uses the information terminal device 20 (moderator terminal device 201, user terminal device 202), and an access right to the html fragment information (that is, generation or change of information included in the html fragment information is permitted). The access right information indicating whether or not the content of the html fragment information is the same, and the html fragment information. Terminal device capable of scribing (the slave display devices (10b, 10c), the information terminal device 20) access model information indicating, and has a creator information. In addition, each html fragment information may include, as meta information, generation date / time information indicating the generation date / time of html fragment information, expiration date information indicating an expiration date of information included in the html fragment information, and the like.

  As described above, the html fragment information constituting the structured display information is an html file in which meta information is extended, and can be expressed in html (Hyper Text Markup Language) suitable for communication conforming to XMPP. It has display data (text data, image data, audio data, moving image data, etc.), and in addition, it can also have meta information which is information (attribute information) related to the display data. The extension here is attribute information (ID (ID information), location information, generation date / time information, user information, access right information, etc.) corresponding to messaging by XMPP as meta information of html fragment information. Hash value, access model information, etc.) are used.

  Here, the position information indicates the display position of the display data included in the html fragment information displayed in the corresponding information display frame on the display screen 111 of the display unit 11 of each display device 10. May be specified by absolute coordinates in the information display frame of the parent html fragment information, or may be arranged and displayed in accordance with the document flow in the information display frame of the parent html fragment information. . For example, when html fragment information is described enclosed in <div>, the display position is specified by absolute coordinates in the information display frame of the parent html fragment information, and html fragment information is enclosed in <par>. May be arranged and displayed in accordance with the document flow in the information display frame of the parent html fragment information.

  In this case, the display position of the display data included in each html fragment information is relative to the display position of the display data (or the corresponding information display frame) included in the parent html fragment information displayed on the display screen 111. Therefore, even if the display position of the information (or the corresponding information display frame) included in the parent html fragment information displayed on the display screen 111 is changed, the display data included in the parent html fragment information is displayed. The display position of the display data included in the html fragment information does not deviate from the display position of (or the corresponding information display frame), and the user can display the display included in each html fragment information at an appropriate display position on the display screen 111. Data can be displayed.

  In addition, in the html fragment information without the parent html fragment information (for example, html fragment information n0 in FIG. 5 described later), the display on the display screen 111 of the display unit 11 of each display device 10 indicated by the position information included in the meta information. The position may indicate absolute coordinates on the display screen 111, or may indicate a relative position with respect to position information of other display data (such as wallpaper) displayed on the display screen 111. Good.

  The access right information is an access right to html fragment information set for each user using the information terminal device 20 (moderator terminal device 201, user terminal device 202) (that is, information included in the html fragment information). Only the user who has been given access to the html fragment information has access to the html fragment information (the generation or modification of the information contained in the html fragment information). Etc.). With the access right information, the user to whom the access right is granted can access the html fragment information, browse display data and meta information included in the html fragment information, and change or modify the contents.

  Note that the access right to the parent html fragment information is also inherited by the child html fragment information. That is, a user who has not been granted access right in the access right information of the parent html fragment information does not have access right to the child html fragment information. In addition, the user to whom the access right is granted in the access right information of the parent html fragment information also has the access right to the child html fragment information. Here, it is assumed that the user specified as the owner in the user information included in the meta information of each html fragment information can generate child html fragment information of the html fragment information, and change or delete the contents thereof. Also good.

  The access model information will also be described in detail. Also, terminal devices that can subscribe to each html fragment information (slave display devices (10b, 10c), information terminal device 20) are permitted to subscribe to the html fragment information in the access model information. That is, only a terminal device that is permitted to make a contract in advance to transmit a notification notifying that when the html fragment information is changed. In this access model information, only the terminal devices included in the list (white list) designated in advance can be subscribed to “whitelist”, and the owner of the html fragment information subscribes to the html fragment information. For example, “authorize” in which permission or rejection is set for a terminal device that has received the request, “open” in which subscribing is permitted for all terminal devices, and the like are set.

  Next, a display screen displayed on the display unit of the display device based on structured display information composed of a plurality of html fragment information will be described. FIG. 6 is a view for explaining a display screen based on structured display information in the embodiment of the present invention. FIG. 7 is a diagram showing an example of an actual display screen based on structured display information in the embodiment of the present invention. As shown in FIGS. 6 and 7, each html fragment information corresponds to each information display frame on the display screen 111 of the display unit 11. Display data (for example, text data, image data, video data, audio data, etc.) included in each html fragment information is displayed in a corresponding information display frame.

  For example, on the display screen 111, the display data included in the html fragment information n0 is displayed in the information display frame N0. In the following, html fragment information that does not have parent html fragment information, such as html fragment information n0, is referred to as root html fragment information. In addition, the display data included in the html fragment information n1, n2, and n3, which are html fragment information (child html fragment information) in a layer below the html fragment information n0, is an information display frame N1, arranged in the information display frame N0, Displayed in N2 and N3, respectively. Also, display data included in the html fragment information n11 and n12 which are child html fragment information of the html fragment information n1 are displayed in the information display frames N11 and N12 arranged in the information display frame N1, respectively, and the html fragment information n2 Display data included in the html fragment information n21 which is child html fragment information is displayed in the information display frame N21 arranged in the information display frame N2, and html fragment information n31 and n32 which are child html fragment information of the html fragment information n3. , N33 are displayed in information display frames N31, N32, and N33 arranged in the information display frame N3, respectively. The display data included in the html fragment information n121 and n122 which are child html fragment information of the html fragment information n12 are displayed in the information display frames N121 and N122 arranged in the information display frame N12, respectively. Thus, on the display screen 111 of the display unit 11 based on the structured display information, the display data included in the child html fragment information is displayed in the information display frame arranged in the information display frame of the parent html fragment information. .

  Such structured display information (or html fragment information constituting the structured display information) is transmitted in real time between the master display device 10a and the slave display devices (10b, 10c). 10 (the master display device 10a and the slave display devices (10b, 10c)) can synchronize the display screen on the display unit 11.

  When the display data included in the html fragment information constituting the structured display information is changed, the control unit 14a of the master display device 10a edits the structured display information according to the changed content. . And the notification regarding the change of structured display information is transmitted from the PubSub section 16 of the master display device 10a to the slave display devices (10b, 10c). At this time, if necessary, the html fragment information whose contents are changed is also transmitted from the master display device 10a to the slave display devices (10b, 10c) together with the notification to control the slave display devices (10b, 10c). The units (14b, 14c) edit the structured display information based on the received html fragment information. In this manner, the changed html fragment information is transmitted in real time between the master display device 10a and the slave display devices (10b, 10c), so that each display device 10 (master display device 10a or slave display device) is transmitted. The display screen in the display unit 11 of the display device (10b, 10c) can be synchronized.

  Next, a specific operation of the multi-site electronic conference system 1 of the present embodiment will be described. First, the master display device 10a establishes a virtual conference room (multi-site electronic conference system 1) using the MUC function with the information terminal device 20 at any point by the MUC unit 15. FIG. 9 is an operation diagram for explaining a procedure for the master display device to open a virtual conference room in the multi-site electronic conference system according to the present embodiment. Here, a procedure will be described in which the master display device 10a establishes a virtual conference room (multi-site electronic conference system 1) using the MUC function with the moderator terminal device 201a at the point a.

  In step S101, the moderator terminal device 201a of the electronic conference system 2a at the point a transmits to the master display device 10a a request for opening a virtual conference room using the MUC function.

  In step S102, the master display device 10a replies that it has surely received the request from the moderator terminal device 201a.

  Next, in step S103, the moderator terminal device 201a transmits to the master display device 10a information to create setting information for opening a chat room.

  In step S104, the master display device 10a transmits data form information for creating setting information to the moderator terminal device 201a.

  In step S105, the moderator terminal device 201a creates setting information for establishing a chat room based on the data form information received from the master display device 10a, and transmits the created setting information to the master display device 10a.

  In step S106, the master display device 10a replies to the moderator terminal device 201a that the setting information has been received.

  Through the above steps, a virtual conference room (multi-site electronic conference system 1) using MUC between the master display device 10a and the moderator terminal device 201a at the point a, that is, the electronic conference system 2 at each point. A virtual conference room in which each information terminal device 20 in (i.e., the moderator terminal device 201 and the user terminal device 202 at each point) can participate is established.

  Next, a procedure for the information terminal device 20 to participate in the established virtual conference room (multi-site electronic conference system 1) will be described. FIG. 10 is an operation diagram for explaining a procedure for an information terminal device to participate in the multi-site electronic conference system according to the embodiment of the present invention. Here, as an example, a procedure in which the information terminal device 202G having the role of a user terminal device participates in a virtual conference room (that is, the multi-site electronic conference system 1) in the electronic conference system 2a at the point a will be described. . Hereinafter, the information terminal device 202G is referred to as a user terminal device G.

  In step S201, the user terminal device G (202G) is a virtual conference room established by the master display device 10a in accordance with a protocol (communication protocol) defined by DISCO (XMPP XEP-0030 (Service Discovery)). Search (multi-site electronic conference system 1). Thereby, the user terminal device G (202G) finds a virtual conference room (multi-site electronic conference system 1) opened by the master display device 10a.

  In step S202, the user terminal device G (202G) transmits to the master display device 10a that the user desires to participate in the virtual conference room (multi-site electronic conference system 1).

  In step S203, the master display device 10a transmits a message indicating permission to participate in the user terminal device G (202G).

  In step S204, the master display device 10a is connected to the pubbus unit 16 or other terminal devices (slave display devices (10b, 10c), user terminals already participating in the virtual conference room (multi-site electronic conference system 1). The information terminal device (20a, 20b, 20c)) at each point other than the device G (202G) is transmitted that there is a new occupant.

  Through the above steps S201 to 204, the user terminal device G (202G) can participate in the virtual conference room (multi-site electronic conference system 1) by communication using XMPP, and the virtual conference room (multiple The fact that the user terminal device G (202G) participates in the base electronic conference system 1) is transmitted to the information terminal devices (20a, 20b, 20c)) at each point other than the user terminal device G (202G).

  Next, a procedure in which each terminal device participating in a virtual conference room (multi-site electronic conference system 1) shares structured display information will be described. FIG. 11 is an operation diagram for explaining a procedure in which each terminal device of the multi-site electronic conference system according to the present embodiment shares structured display information.

  In step S301, the moderator terminal device 201a that has established a virtual conference room (multi-site electronic conference system 1) with the master display device 10a in steps S101 to S106 described above, the proceedings in the multi-site electronic conference system 1 and the like. Is generated on the display unit 11 of the display device 10. As described above, the structured display information created here has html fragment information having a structural correlation (such as a tree structure).

  In addition, the moderator terminal apparatus 201a assigns a unique ID (ID information) (that is, an ID (ID information) for identifying the html fragment information) to each html fragment information. In addition, the moderator terminal device 201a, for each html fragment information, as meta information, the attribute information as described above, that is, a position indicating the display position on the display screen 111 of the display data included in the html fragment information Information, generation date / time information indicating the generation date / time of html fragment information, update date / time information indicating the latest date / time when the content of the html fragment information was updated, user information indicating a user who is the owner of the html fragment information, The access right to the html fragment information (that is, the information possessed by the html fragment information) is set for each user using the information terminal device 20 (moderator terminal device 201a, user terminal device 202a) in the electronic conference system 2a at the point a. The access right information indicating whether or not to allow the creation or modification of the content) and the content of the html fragment information Hash values for the terminal device the html fragmentary information can subscribe (the slave display devices (10b, 10c), the information terminal device 20) access model information indicating, and creates and creator information. In addition, as meta information, generation date / time information indicating the generation date / time of html fragment information, expiration date information indicating the expiration date of information included in the html fragment information, and the like may be created.

  In step S302, the moderator terminal device 201a transmits the created html fragment information to the master display device 10a.

  In step S303, the master display device 10a performs syntax analysis of each received html fragment information, and creates html fragment information corresponding to each received html fragment information. In addition, the master display device 10a checks that the ID (ID information) for identifying the created html fragment information does not overlap with the IDs (ID information) of other html fragment information. Then, the master display device 10a creates structured structured display information composed of each html fragment information.

  In step S304, the master display device 10a further displays the structured display information formed by structuring each created html fragment information to other terminal devices (that is, the slave display devices (10b, 10c), the electronic information of each point. To the moderator terminal device 201 and the user terminal device 202) of the conference system 2.

  Next, a procedure for preparing for the master display device 10a to synchronize with the slave display devices (10b, 10c) using the pubsub function will be described. FIG. 12 is an operation diagram for explaining a procedure for the master display device to prepare for synchronization with the slave display device in the multi-site electronic conference system according to the embodiment of the present invention.

  In step 401, the MUC unit 15 of the master display device 10a transmits to the PubSub unit 16 a request to create XMPP node information corresponding to each html fragment information constituting the structured display information of the master display device 10a. To do.

  In step 402, the PubSub unit 16 of the master display device 10a creates XMPP node information corresponding to each html fragment information constituting the structured display information. The XMPP node information is an html file created so that the corresponding html fragment information can be transmitted from the communication unit 12a. Note that the XMPP node information is created in, for example, a volatile memory (not shown) included in the master display device 10a or the storage unit 13a.

  At this time, a unique ID (ID information) is given to these XMPP node information. The ID (ID information) for identifying each XMPP node information is the ID (ID ID) of the corresponding html fragment information. Information). By doing so, it is possible to identify the html fragment information constituting the structured display information and the corresponding XMPP node information without duplication using this ID (ID information). Thereby, the html fragment information and the XMPP node information constituting the structured display information can be used as a unit of information for controlling the access right for the users participating in the multi-site electronic conference system 1.

  In step S403, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 that XMPP node information has been created.

  The master display device 10a repeats the above steps S401 to S403 for the same number of times as the number of html fragment information (or corresponding XMPP node information) constituting the structured display information. XMPP node information corresponding to the html fragment information constituting the information is created.

  Next, the master display device 10a sets attribute information for each of the created XMPP node information. In step S404, the MUC unit 15 of the master display device 10a transmits to the PubSub unit 16 that attribute information is set in the XMPP node information.

  In step S405, the PubSub unit 16 of the master display device 10a transmits data form information for creating attribute information in the XMPP node information to the MUC unit 15.

  In step S406, based on the data form information received from the PubSub unit 16, the MUC unit 15 of the master display device 10a sets setting information for setting attribute information in the XMPP node information created in steps S401 to S403 described above. The created setting information is transmitted to the PubSub unit 16.

  In step S407, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 the fact that the setting information has been received.

  Then, the PubSub unit 16 of the master display device 10a repeats the above steps 404 to 407 as many times as the number of html fragment information (or corresponding XMPP node information) constituting the structured display information. By doing so, attribute information is set in each XMPP node information.

  Next, the master display device 10a transfers the information included in the html fragment information constituting the structured display information to the corresponding XMPP node information. FIG. 13 is an operation diagram for explaining a procedure in which the master display device sets a payload in each XMPP node information in the multi-site electronic conference system according to the embodiment of the present invention.

  In step S501, the MUC unit 15 of the master display device 10a transmits the contents of the html fragment information constituting the structured display information to the PubSub unit 16 as a payload together with an ID for identifying the html fragment information.

  In step S502, the PubSub unit 16 of the master display device 10a sets the received payload to the corresponding XMPP node information.

  In step S503, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 that the payload is set in the corresponding XMPP node information.

  The master display device 10a repeats the above steps S501 to S503 for the same number of times as the number of html fragment information (or corresponding XMPP node information) constituting the structured display information, and the html fragment information constituting each structured display information. Is transferred to the corresponding XMPP node information. At this time, the information included in the corresponding html fragment information may be included in the XMPP node information, but the information included in the corresponding html fragment information is referred to as the information included in the XMPP node information. Preferably it is. By doing so, it is possible to reduce the burden on the storage capacity of the volatile memory (not shown) and the storage unit 13a associated with the creation of the XMPP node information.

  As described above, preparations for synchronizing the display screens displayed on the display unit 10a of the master display device 10a and the display units (11b and 11c) of the slave display device 10 are completed based on the structured display information.

  Next, a procedure for the slave display devices (10b, 10c) to prepare for synchronizing the display screen with the master display device 10a will be described. As described above, in the present embodiment, display screen synchronization between the master display device 10a and the slave display devices (10b, 10c) is performed using the pubsub function. Here, for example, a procedure in which the slave display device 10b at the point b synchronizes the display screen with the master display device 10a will be described.

  First, the slave display device 10b has a structural correlation of each XMPP node information created by the PubSub unit 16 of the master display device 10a (that is, the structure of structured display information formed by each corresponding html fragment information), and Each XMPP node information and the attribute information that the corresponding html fragment information has as meta information are identified. FIG. 14 is an operation diagram for explaining a procedure in which the slave display device identifies the structural correlation and attribute information of each XMPP node information in the multi-site electronic conference system according to the embodiment of the present invention. Here, the master display device 10a and the slave display device 10b use DISCO (XMPP XEP-0030 (Service Discovery)).

  In step S601, the slave display device 10b transmits to the PubSub unit 16 of the master display device 10a information to search for the structural correlation of each XMPP node information. Regarding the structural correlation of each XMPP node information, the XMPP node information having a correlation one level higher than a certain XMPP node information is called parent XMPP node information, and one XMPP node information is 1 The XMPP node information having a correlation in the lower hierarchy is referred to as child XMPP node information. In step S601, for example, XMPP node information that does not have parent XMPP node information (hereinafter referred to as root XMPP node information), such as html fragment information n0 in FIG. 5, is to be identified.

  In step S602, the PubSub unit 16 of the master display device 10a transmits the result of identifying the root XMPP node information to the slave display device 10b. As a result, the slave display device 10b finds root XMPP node information (that is, root html fragment information).

  Next, the slave display device 10b further sequentially searches each XMPP node information of the master display device 10a, and identifies the structural correlation of each XMPP node information. In step S603, the slave display device 10b transmits to the PubSub unit 16 of the master display device 10a that the child XMPP node information of the root XMPP node information is searched.

  In step S604, the PubSub unit 16 of the master display device 10a transmits information identifying the child XMPP node information. As a result, the slave display device 10b finds child XMPP node information of the root XMPP node information.

  Then, the slave display device 10b identifies the same procedure as steps S603 to S604, with all the structural correlations of the XMPP node information (that is, the structure of the structured display information formed by the corresponding html fragment information). Repeat until you can. As described above, the slave display device 10b can identify the structural correlation of each XMPP node information of the master display device 10a.

  Next, the slave display device 10b sets attribute information for each XMPP node information. In step S606, the slave display device 10b transmits an inquiry to the PubSub unit 16 of the master display device 10a for attribute information setting information for the XMPP node information.

  In step S607, the PubSub unit 16 of the master display device 10a transmits attribute information setting information for the XMPP node information to the slave display device 10b.

  Steps S606 to S607 described above are repeated until the extended attribute information is set for all the XMPP node information.

  Next, the slave display device 10b will be described next with respect to a procedure for the slave display device 10b to subscribe to XMPP node information that the master display device has. FIG. 15 is an operation diagram for explaining a procedure in which the slave display device subscribes to the XMPP node information in the multi-site electronic conference system according to the embodiment of the present invention.

  In step S701, the slave display device 10b transmits to the PubSub section 16 of the master display device 10a that the XMPP node information of the master display device 10a is subscribed.

  In step S702, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 a notification that the slave display device 10b subscribes to each XMPP node information.

  Also, in step S703, the PubSub unit 16 of the master display device 10a notifies the slave display device 10b that it has received information to subscribe to each XMPP node information.

  Through the above steps S701 to S703, the slave display device 10b sends a notification from the master display device 10a to the slave display device 10b when the master display device 10a changes the html fragment information to the master display device 10a. The master display device 10a may conclude a contract with the slave display device 10b. With this configuration, when the html fragment information constituting the structured display information is changed on the master display device 10a, the slave display device 10b promptly confirms that the html fragment information has been changed. I can know. Therefore, when the html fragment information constituting the structured display information is changed, the slave display device 10b promptly and surely requests the master display device 10a to transmit the changed html fragment information. And the same structured display information as the master display device 10a can be shared. Therefore, the master display device 10a and the slave display device 10b can easily synchronize the structured display information obtained by structuring a plurality of html fragment information, and can quickly and reliably display based on the structured display information. Can be synchronized.

  Next, in step S704, the PubSub unit 16 of the master display device 10a further transmits a notification to the effect that each XMPP node information has been generated to the slave display device 10b together with the payload of each XMPP node information.

  Next, in step S705, the slave display device 10b creates structured display information based on the payload of each XMPP node information received from the PubSub unit 16 of the master display device 10a, and based on the created structured display information. The display is performed on the display unit 11b.

  As described above, the slave display device 10b at the point b can synchronize the display screen based on the structured display information structured with the master display device 10a. Further, by performing the same procedure for the slave display device 10c at another point c, it is possible to synchronize the display screen based on the structured display information structured with the master display device 10a.

  Next, a procedure until opinions, materials, etc. (display data) presented from the information terminal device 20 to the multi-site electronic conference system 1 are displayed on the display unit 11 of the display device 10 at each point will be described. Here, as an example, opinions and materials (display data) presented to the multi-site electronic conference system 1 by the user terminal device G (202G) in the electronic conference system 2a at the point a are displayed on the display unit 10 of the display device 10 at each point. 11 will be described. FIG. 16 is an operation diagram for explaining a procedure until information provided by the user terminal device G is displayed on the display unit of the display device in the multi-site electronic conference system according to the embodiment of the present invention. First, the user of the user terminal device G (202G), for example, is in a state in which opinions or materials (display data) should be presented to the multi-site electronic conference system 1, or a moderator terminal at the point a It is assumed that the user using the apparatus 201a is allowed to present opinions and materials (display data) directly offline or the like.

  In step S801, the moderator terminal device 201a at the point a receives html fragment information (hereinafter referred to as “display data”) for storing opinions and materials (display data) presented by the user terminal device G (202G) to the multi-site electronic conference system 1. This is called html fragment information for speech.). Here, the creation of the html fragment information for speech means that the information presented by the speaker (in this case, the user terminal device G (202G)) to the multi-site electronic conference system 1 is displayed on the display unit 11 of each display device 10. This means that an information display frame for doing so is arranged on the display screen 111.

  In addition, the moderator terminal device 201a gives a unique ID (ID information) (that is, an ID (ID information) for identifying the html fragment information for speech) to the created html fragment information for speech. In addition, the moderator terminal device 201a includes, as meta information, the above-described attribute information, that is, position information indicating a display position where display data stored in the html fragment information for speech is displayed on the display unit 11, The generation date / time information indicating the generation date / time of the utterance html fragment information, the update date / time information indicating the latest date / time when the content of the utterance html fragment information has been updated, and the user who is the owner of the html fragment information for comment. User information, set for each user using the information terminal device 20 (moderator terminal device 201a, user terminal device 202a) in the electronic conference system 2a at the point a, and the access right to the html fragment information for utterance (that is, utterance Access right information indicating whether or not the generation or change of information included in the html fragment information is permitted, and the html fragment information for speech Access model information and creator information indicating that the hash value for confirming the identity of the content and the html fragment information for speech can be subscribed (slave display devices (10b, 10c), information terminal device 20) And so on. Further, as meta information, generation date / time information indicating the generation date / time of the speech html fragment information, expiration date information indicating the expiration date of the information included in the speech html fragment information, and the like may be created. Then, the moderator terminal device 201a edits the structured structured display information so as to incorporate the speech html fragment information having the meta information.

  In step S802, the moderator terminal device 201a transmits the html fragment information for speech having the meta information to the MUC unit 15 of the master display device 10a.

  In step S803, the MUC unit 15 of the master display device 10a performs syntax analysis on the received utterance html fragment information, and creates html fragment information corresponding to the received utterance html fragment information. In addition, the master display device 10a checks that the ID (ID information) for identifying the created html fragment information does not overlap with the IDs (ID information) of other html fragment information. Then, the master display device 10a edits the structured display information structured to incorporate the created html fragment information.

  In step S804, the MUC unit 15 of the master display device 10a creates XMPP node information corresponding to the utterance html fragment information (hereinafter referred to as utterance XMPP node information) based on the edited structured display information. A request message is transmitted to the PubSub unit 16.

  In step 805, the PubSub unit 16 of the master display device 10a creates speech XMPP node information corresponding to the speech html fragment information. The XMPP node information for speech is an html file created so that the corresponding speech html fragment information can be transmitted from the communication unit 12a. Further, the XMPP node information for speech is created in, for example, a volatile memory (not shown) or the storage unit 13a of the master display device 10a.

  In step 806, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 that the XMPP node information for speech has been generated.

  Next, the MUC unit 15 of the master display device 10a displays the procedure for setting the attribute information in the XMPP node information for speech created by the PubSub unit 16, and the display data presented to the multi-site electronic conference system 1 The procedure up to will be described. FIG. 17 is an operation diagram for explaining a procedure for setting attribute information in the XMPP node information for speech and a procedure for displaying the presented information in the multi-site electronic conference system according to the embodiment of the present invention. is there.

  In step S901, the MUC unit 15 of the master display device 10a transmits to the PubSub unit 16 that attribute information is set in the XMPP node information for speech.

  In step S902, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 data form information for setting attribute information in the XMPP node information for speech.

  In step S903, the MUC unit 15 of the master display device 10a creates attribute information of the speech XMPP node information based on the data form information received from the PubSub unit 16, and transmits the created setting information to the PubSub unit 16.

  In step S904, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 that the setting information has been received.

  Through the above steps S901 to S904, the master display device 10a has attribute information (ID (ID information), position information, generation date and time information, user information) for the XMPP node information corresponding to the information display frame that the speaker can speak. Information, access right information, hash value, access model information, etc.). In particular, when a hash value is set as attribute information for the XMPP node information, the identity of the content of the fragment information transmitted from the master display device to the slave display device can be confirmed by the hash value. Therefore, the master display device and the slave display device can easily synchronize structured display information obtained by structuring a plurality of pieces of fragment information, and can quickly and reliably synchronize display based on the structured display information. Can do. If update date / time information is set as attribute information for XMPP node information, the exact date / time when the XMPP node information was updated can be known. Therefore, since the identity of the content of the fragment information transmitted from the master display device to the slave display device can be confirmed by the hash value, the master display device and the slave display device have a plurality of pieces of fragment information structured. The structured display information can be reliably synchronized, and the display based on the structured display information can be reliably synchronized.

  Next, in step S905, the MUC unit 15 of the master display device 10a connects the terminal devices (slave display devices (10b, 10c) and information terminal devices 20 (moderator terminal device 201, user terminal device 202)) at each point. The fact that the information display frame in which the information presented by the speaker (here, the user terminal device G (202G)) is displayed is arranged on the display screen 111 is transmitted together with the html fragment information for speech. The terminal device at each point edits the structured display information possessed by each terminal device based on the received html fragment information for speech.

  In step S906, display data to be presented to the virtual conference room (multi-site electronic conference system 1) is input from the terminal input unit 25 to the user terminal device G (202G). Further, the user terminal device G (202G) edits the speech html fragment information to add the input display data. Note that the ID (ID information) for identifying the speech html fragment information in which the input display data is stored is the ID of the speech html fragment information created in step S801 or the html fragment information created in step S803. (ID information). In addition, if the display data input to the user terminal device G (202G) is data expressed in html that is compatible with XMPP-compliant communication, such as text data, image data, audio data, and video data, All types of data that can be expressed in html can be handled, and there are no restrictions on the combinations.

  In step S907, the html fragment information edited in step S906 is transmitted to the MUC unit 15 of the master display device 10a.

  In step S908, the MUC unit 15 of the master display device 10a parses the html fragment information for speech received from the user terminal device G (202G), and the html for speech in which the display data input in step S906 is stored. User information and access right information included in the meta information of the fragment information are checked. If the two match, the structured display information of the master display device 10a is edited based on the received speech html fragment information. Specifically, the contents of the html fragment information corresponding to the speech html fragment information included in the structured display information of the master display device 10a are changed to incorporate the display data input in step S906. Then, the display data input to the user terminal device G (202G) is displayed on the display unit 11a based on the edited structured display information.

  Through the above procedure, information (such as remarks) presented to the virtual conference room by the user terminal device G (202G) is displayed on the display unit 11a of the master display device 10a.

  Next, a procedure in which the display screen of the master display device 10a and the display screen of the slave display devices (10b, 10c) are synchronized and the same display is performed will be described. FIG. 18 is an operation diagram for explaining a procedure in which the display screen of the master display device and the display screen of the slave display device are synchronized in the multi-site electronic conference system according to the embodiment of the present invention.

  In step 1001, the MUC unit 15 of the master display device 10a transmits the html fragment information changed in step S908 of FIG. 17 to the PubSub unit 16 together with an ID (ID information) for identifying the html fragment information. To do.

  In step S1002, the PubSub unit 16 of the master display device 10a identifies XMPP node information corresponding to the received html fragment information based on the received ID (ID information), and is identified based on the received html fragment information. Update the XMPP node information. That is, the content of the received html fragment information is transferred to the identified XMPP node information. At this time, the information included in the corresponding html fragment information may be included in the XMPP node information, but the information included in the corresponding html fragment information is referred to as the information included in the XMPP node information. Preferably it is. By doing so, it is possible to reduce the burden on the storage capacity of the volatile memory (not shown) and the storage unit 13a associated with the creation of the XMPP node information.

  Further, the PubSub unit 16 of the master display device 10a sets the content of the updated XMPP node information (that is, information included in the corresponding html fragment information) as a payload to be transmitted to the slave display devices (10b, 10c).

  In step S1003, the PubSub unit 16 of the master display device 10a transmits to the MUC unit 15 that the payload has been set.

  In step S1004, the PubSub unit 16 of the master display device 10a also notifies that the html fragment information constituting the structured display information has been changed, and the changed html fragment information (that is, in step 908 in FIG. 17). An ID (ID information) for identifying the generated html fragment information) is transmitted to the slave display devices 10b and 10c.

  By doing in this way, when the html fragment information (or corresponding XMPP node information) constituting the structured display information is changed, the master display device 10a has a structure for the slave display devices (10b, 10c). Notification indicating that the html fragment information (or corresponding XMPP node information) constituting the display information has been changed, and ID information for identifying the changed html fragment information (or corresponding XMPP node information) Send. Therefore, when the html fragment information (or the corresponding XMPP node information) constituting the structured display information is changed, the slave display devices (10b, 10c) change the html fragment information (or the structured display information). In addition, it is possible to quickly know that the html fragment information (or the corresponding XMPP node information) has been changed without inquiring of the master display device 10a whether the corresponding XMPP node information) has been changed. It is possible to recognize which html fragment information (or corresponding XMPP node information) has changed from the ID information. Therefore, the slave display device (10b, 10c) changes quickly and reliably with respect to the master display device 10a when the html fragment information (or the corresponding XMPP node information) constituting the structured display information is changed. For example, requesting transmission of the html fragment information (or corresponding XMPP node information), and sharing the same structured display information as the master display device. Therefore, the master display device 10a and the slave display devices (10b, 10c) can easily synchronize structured display information formed by structuring a plurality of html fragment information, and display based on the structured display information. It is possible to synchronize quickly and reliably.

  In addition, since the master display device and the slave display device perform communication conforming to XMPP (eXtensible Messaging and Presence Protocol), real-time messaging (information exchange) is performed between the master display device and the slave display device. In addition, it is possible to easily and reliably associate information that is messaged by XMPP and information that is displayed on the display unit included in the master display device or the display unit included in the slave display device, with the ID information.

  In step S1004, the PubSub unit 16 of the master display device 10a changes the html fragment information (or the corresponding XMPP node information) constituting the structured display information for the slave display devices (10b, 10c). In addition to the notification indicating this, the payload set in step S1002 may be further transmitted. Also, the slave display devices (10b, 10c) edit the structured display information based on the payload received from the PubSub unit 16 of the master display device 10a, and the structured display edited on the display units (11b, 11c). Display based on information may be performed. In this way, when the html fragment information (or the corresponding XMPP node information) constituting the structured display information is changed, the slave display device (10b, 10c) can quickly and surely display the structured display information. To display the same as the master display device 10a. Therefore, the master display device 10a and the slave display devices (10b, 10c) can easily synchronize structured display information formed by structuring a plurality of pieces of html fragment information (or corresponding XMPP node information). The display based on the structured display information can be quickly and reliably synchronized.

  As described above, the display screen of the master display device 10a and the display screen of the slave display devices (10b, 10c) can be synchronized and the same display can be performed.

  The present invention has been described above based on the embodiments. Note that the present invention is not limited to the above-described embodiment, and can be implemented by changing the configuration without departing from the spirit of the present invention. For example, in the above embodiment, XMPP XEP-0045 (Multi-User Chat) is used for the information exchange function of the multi-site electronic conference system 1, and XMP-XEP-0060 (XHTML-IM) is used for the information transmission / reception function. Utilizing this, html fragments (fragment information called html fragment information in the present invention) closer to a normal xhtml / xtml (Web) system are transmitted and received. However, in the multi-site communication system of the present invention, the display device 10, the moderator terminal device 201, and the user terminal device 202 in the electronic conference system 2 at each point are not limited to this, but via other XMPP communication servers. It is good also as what connects between.

  In the above-described embodiment, a plurality of terminal devices including the display device 10 and one or a plurality of information terminal devices 20 perform communication conforming to XMPP. However, the present invention is not limited to this. Absent. Communication conforming to a protocol (communication protocol) similar to XMPP may be performed.

  In the above-described embodiment, the XMPP node information has the same ID (ID information) as the ID (ID information) allocated to the html fragment information constituting the structured display information. If the fragment information ID (ID information) and the XMPP node information ID (ID information) do not overlap and correspond one-to-one, they may be converted to each other using a conversion table. Since it is possible, the MUC function and the PubSub function may be distributed. That is, the slave display device 10 may be provided with the MUC function and the PubSub function.

  In addition, it is understood by those skilled in the art that the embodiment described above is an exemplification, and that various modifications can be made to the combination of each component and each process, and it is within the scope of the present invention. .

  INDUSTRIAL APPLICABILITY The present invention can be used for a multi-site electronic conference system used in a community such as a workplace or school, a videophone between relatives in a remote place, an online meeting in a community, and the like.

1 Multi-site electronic conference system (communication system)
2, 2a, 2b, 2c Electronic conference system 3 Network 10 Display device 10a Master display device 10b, 10c Slave display device 11 Display unit 111 Display screen 12 Communication unit 13 Storage unit 14 Control unit 15 MUC unit 16 PubSub unit 20 Information terminal device 201, 201a, 201b, 201c Moderator terminal device 202, 202a, 202b, 202c, 202G User terminal device 21 Terminal display unit (display unit)
22 Terminal communication unit (communication unit)
23 Terminal storage unit (storage unit)
24 Terminal control unit (control unit)
25 Terminal input part (input part)
30 network

Claims (10)

A communication method in which a plurality of display devices and a plurality of information terminal devices communicate via a network,
The plurality of display devices include a master display device and a slave display device, and perform the same display based on first display information shared by communication via the network,
The plurality of information terminal devices include a moderator terminal device that manages display information displayed on the plurality of display devices,
The first display information includes a plurality of second display information forming a predetermined data structure,
The master display device is set for each user who uses the information terminal device, ID information for identifying the second display information, user information indicating a user who is the owner of the second display information, Receiving access right information indicating whether to permit generation and change of the second display information from the moderator terminal device;
The master display device changing the second display information identified by the ID information based on the user information and the access right information;
When the second display information is changed, the master display device identifies the changed second display information, a notification indicating that the second display information has been changed, and the second display information. Transmitting the ID information to the slave display device;
When the slave display device receives the notification from the master display device, the slave display device has the first display information of the slave display device based on the second display information and the ID information received from the master display device. Editing steps,
A communication method comprising: The plurality of information terminal devices further include a user terminal device that transmits the second display information to the master display device,
2. The communication method according to claim 1, further comprising a step in which the user terminal device transmits the second display information, the ID information, and the user information to the master display device.   In the step of changing the second display information, the master display device changes the second display information when a user indicated by the access right information matches a user indicated by the user information. The communication method according to claim 1 or 2.   The communication method according to claim 1, further comprising a step in which the slave display device performs display based on the edited first display information.   The second display information includes a hash value for confirming the identity of the content of the second display information, and update date / time information indicating the latest date / time when the master display device changed the second display information. The communication method according to claim 1, comprising at least one of the following. The slave display device transmitting to the master display device a request for a contract to transmit the notification from the master display device to the slave display device when the master display device changes the second display information; ,
The master display device concludes the contract with the slave display device;
The communication method according to claim 1, further comprising: A communication unit that communicates via a network with a display device including a slave display device, and a plurality of information terminal devices including a moderator terminal device that manages display information displayed on the display device;
A display unit for performing the same display as the display device based on the first display information shared with the display device;
With
The first display information includes a plurality of second display information forming a predetermined data structure,
The communication unit is set for each user who uses the information terminal device, ID information for identifying the second display information, user information indicating a user who is the owner of the second display information, When access right information indicating whether or not to permit generation and change of the second display information is received from the moderator terminal device,
Based on the user information and the access right information, the second display information identified by the ID information is changed,
The second display information changed to edit the first display information of the slave display device, a notification indicating that the second display information has been changed, and for identifying the second display information The master display device, wherein the ID information is transmitted from the communication unit to the slave display device.   When the communication unit further receives the second display information, the ID information, and the user information from user terminal devices further included in the plurality of information terminal devices, the second display information is changed. The master display device according to claim 7.   The master display device according to claim 7 or 8, wherein when the user indicated by the access right information matches the user indicated by the user information, the second display information is changed. A communication system in which a plurality of display devices and a plurality of information terminal devices communicate via a network,
The plurality of display devices include a master display device and a slave display device, and perform the same display based on first display information shared by communication via the network,
The plurality of information terminal devices include a moderator terminal device that manages display information displayed on the plurality of display devices,
The first display information includes a plurality of second display information forming a predetermined data structure,
The master display device is set for each user who uses ID information for identifying the second display information, user information indicating a user who is the owner of the second display information, and the information terminal device, When access right information indicating whether to permit generation and change of the second display information is received from the moderator terminal device, the ID information is identified based on the user information and the access right information. The second display information, the changed second display information, a notification indicating that the second display information has been changed, and the ID information for identifying the second display information. Send to the slave display device,
When the slave display device receives the notification from the master display device, the slave display device has the first display information of the slave display device based on the second display information and the ID information received from the master display device. A communication system characterized by editing.