WO2012032592A1 - マルチユーザ通信のためのシステム、方法及び装置 - Google Patents
マルチユーザ通信のためのシステム、方法及び装置 Download PDFInfo
- Publication number
- WO2012032592A1 WO2012032592A1 PCT/JP2010/065230 JP2010065230W WO2012032592A1 WO 2012032592 A1 WO2012032592 A1 WO 2012032592A1 JP 2010065230 W JP2010065230 W JP 2010065230W WO 2012032592 A1 WO2012032592 A1 WO 2012032592A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- data
- display
- terminal device
- user
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/027—Arrangements and methods specific for the display of internet documents
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/10—Use of a protocol of communication by packets in interfaces along the display data pipeline
Definitions
- the present invention relates to a communication method, a display device, a user terminal device, a moderator terminal device, and a multi-user communication system including them.
- a communication system in which a plurality of information terminal devices are interconnected by a network, and each user using the information terminal devices shares information transmitted and received through the network.
- a communication system that realizes a virtual conference room by connecting a plurality of personal computers via a network and sharing information such as materials, display page positions and memos via the network.
- Patent Document 1 discloses a technology that allows a large number of individuals participating in a meeting to share information displayed on a display device.
- data input from the input device is converted into a form that can be displayed on the display device and displayed on the display device.
- Patent Document 2 discloses an electronic conference system in which all users of a terminal device can see the same shared information.
- the client terminal when a client terminal receives a user operation input, the client terminal transmits the operation input to a server via a network, and the server converts the operation input into a texture of a 3D layer object arranged in the virtual space. Write and transmit video information to the client terminal. Then, the client terminal displays the video information transmitted from the server.
- text data having different transmission characteristics and data such as moving image data and audio data can be obtained without distinguishing the types of data transmitted and received between the devices. Are transmitted and received through the same communication path. However, in such a case, the data having different transmission characteristics interfere with each other and transfer fluctuations may occur, which may cause a problem that the data cannot be transferred accurately.
- the present invention has been made in view of the above-described problems, and its purpose is to transfer data transmitted from a plurality of users accurately, simply, efficiently, and to display a structured display on a display screen. It is an object of the present invention to provide a communication method, a display device, a user terminal device, a moderator terminal device, and a multi-user communication system including them.
- the communication method of the present invention is such that a plurality of users participate and display data transmitted from each information terminal device used by the plurality of users to the display device is displayed on the display unit of the display device.
- the information terminal device includes a user terminal device that transmits the display data to the display device, and a moderator terminal device that manages the display data, and the moderator terminal device is Transmitting first information having data ID information for identifying the display data and position information indicating a display position of the display data on the display unit to the display device via a network;
- a data communication path for transmitting the display data is established between the display device and the user terminal device, and the display device is configured to identify a communication path for identifying the data communication path.
- Second information including information and the data ID information is transmitted to the user terminal device via the network, and the user terminal device specifies the display data by the communication path identification information.
- the data is transmitted to the display device via a data communication path, and the display device displays the display data on the display unit based on the communication path identification information, the data ID information, and the position information.
- the display device in the communication method in which a plurality of users participate and display data presented from each information terminal device used by the users is displayed on the display unit of the display device, the display device includes: User terminal apparatus that transmits display data when receiving data ID information for identifying the display data and position information indicating a position for displaying the display data from the moderator terminal apparatus that manages the display data A data communication path other than the network is established between the display device and the display device. Then, the display device transmits communication path identification information for identifying the established data communication path to the user terminal device via the network. Accordingly, the user terminal device can transmit the display data to the display device via the data communication path specified by the communication path identification information.
- the display data is transmitted from the user terminal device to the display device via a dedicated data communication path different from the network. Therefore, even if the data transmitted / received through the network and the display data transmitted through the data communication path have different transmission characteristics from each other, they do not interfere with each other and transfer fluctuations in which the data transfer rate and the data reception interval vary. Etc. can be prevented. Therefore, it is possible to transfer the display data from the user terminal device to the display device accurately, simply and efficiently. Further, the display device can associate the display data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the display data at the display position indicated by the position information. Data can be displayed. Therefore, the display device can display and display the display data transmitted via the dedicated data communication path on the display screen of the display unit.
- the user using the moderator terminal device can display data transmitted from the user terminal device to the display device via a dedicated data communication path different from the network, based on the data ID information and the position information, The display position of the display data on the display unit of the display device can be managed reliably and simply.
- the data communication path is used by the terminal device other than the user terminal device or the display device, There is no possibility that display data transmitted and received through the data communication path is acquired or changed. Therefore, the security of data transfer via the data communication path can be further improved.
- the data communication path may be a logical communication path through which the display data is transmitted.
- the logical communication path is a logically viewed virtual communication line (logical line) of a physically viewed communication line. For example, even if there is physically one communication line, a plurality of logical lines can be set. Each logical line can perform different data communications.
- the display data may be multimedia data in a format other than text format.
- multimedia data in a format other than the text format such as moving image data and audio data is transmitted from the user terminal device to the display device through a dedicated data communication path different from the network. Therefore, even when data transmitted / received through the network (text data, etc.) and display data transmitted through the data communication path (multimedia data other than text format) have different transmission characteristics, they interfere with each other. Therefore, it is possible to prevent the occurrence of transfer fluctuations in which the data transfer speed and the data reception interval vary. Therefore, multimedia data in a format other than the text format can be transferred from the user terminal device to the display device more simply, efficiently and accurately.
- the display device can associate the multimedia data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the multimedia data at the display position indicated by the position information. Multimedia data can be displayed. Therefore, the display device can structure and display the multimedia data received via the dedicated data communication path on the display screen of the display unit.
- the moderator terminal device is set for each user who uses the data ID information, the position information, and the plurality of information terminal devices, and permits generation and change of the display data.
- the first information having access right information indicating whether or not to transmit is transmitted to the display device via the network, and the display device and a user terminal device used by a user indicated by the access right information In the meantime, the data communication path through which the display data is transmitted may be established.
- the moderator terminal device includes the first information including the data ID information, the position information, and user information indicating a user who is an owner of the display data.
- the data communication path for transmitting the display data is established between the display device and a user terminal device used by the user indicated by the user information. It may be a thing.
- the access right information transmitted from the moderator terminal device, or the direct data in which the display data is transmitted between the user terminal device used by the user indicated by the user information and the display device A communication path is established. Therefore, there is no need to create a mesh communication path network in order to share information between the display device and each information terminal device, and if necessary, the display device and the user terminal device that transmits display data It is only necessary to establish a direct data communication path between them. Further, the display device can associate the display data received from the data communication path with the position information by the data ID information, and can display the display data at the display position of the display unit indicated by the position information.
- the moderator terminal device can indicate to the display device the user terminal device to which the data communication path should be established, based on the access right information or user information transmitted to the display device, the display device and the user terminal device It is possible to control the establishment of the data communication path.
- the moderator terminal device is set for each user who uses the data ID information, the position information, and the plurality of information terminal devices, and generates and changes the display data.
- the first information having access right information indicating whether or not to permit and user information indicating a user who is the owner of the display data is transmitted to the display device via the network, and the display The apparatus may display the display data on the display unit based on the communication path identification information, the data ID information, the position information, the user information, and the access right information.
- the display device receives the display data received from the data communication path identified by the communication path identification information, the user information received from the moderator terminal apparatus by the data ID information, the access right information, A display unit that determines whether or not to display the display data identified by the data ID information based on the user information and the access right information, and indicates the display data by the position information Can be displayed at the display position. Therefore, the display data transferred from the user terminal device is managed by the data ID information, and the access right (that is, the access right) set for each of a plurality of users who use the information terminal device for the display data. Each display data displayed on the display unit of the display device is controlled according to whether or not the generation or change of the display data is permitted. Therefore, smooth communication according to each access right between a plurality of users is possible.
- the display device is configured such that when a user permitted to generate and change the display data indicated by the access right information matches a user indicated by the user information, the communication path
- the display data may be displayed on the display unit based on the identification information, the data ID information, and the position information.
- the display device is permitted to have a user who is the owner of the display data identified by the data ID information and an access right to the display data (that is, generation or change of the display data is permitted).
- the display data can be displayed on the display unit only when the user who has the same or not matches. That is, the display device specifies the display data received from the data communication path specified by the communication path identification information by the data ID information and displays the specified display data at the display position indicated by the position information. Therefore, smooth communication according to each access right between a plurality of users is possible.
- the communication method configured as described above may be a communication method in an electronic conference in which the plurality of users participate.
- each utterance (display data) presented in the virtual conference room (that is, the electronic conference system) can be reliably and easily managed by the data ID information, and the virtual conference
- the virtual conference room Depending on the access rights set for each of a plurality of participants (users) participating in the room (that is, whether the presentation (display data) is permitted to be displayed or modified), the virtual conference room
- the presented speech (display data) can be controlled. Therefore, a plurality of users participating in the virtual conference room can perform smooth communication according to their access rights.
- the display device and the information terminal device may perform communication conforming to XMPP (eXtensible Messaging and Presence Protocol).
- XMPP eXtensible Messaging and Presence Protocol
- XMPP is an XML-based protocol (communication protocol) that is being standardized and standardized by XSF (XMPP Standards Foundation) independent of the XMPP working group of IETF (Internet Engineering Task Force).
- XMPP runs a wide range of applications including instant messaging, presence ("what the person is now"), multi-person chat, voice or videophone, collaborative work, content syndication, generalized routing of XML data, etc.
- XEP XMPP Extension Protocol
- the data communication path is established between the display device and the user terminal device, and the display data is transmitted from the user terminal device to the display device via the data communication route.
- XEP-0166 is a protocol (communication protocol) that defines a function for establishing a communication path for transmitting and receiving data between two communicable terminal devices. Protocols related to Jingle include XEP-0167 (Jingle RTP Sessions) and XEP-0177 (Jingle Raw UDP Transport Method).
- XEP-0167 is a protocol (communication protocol) that defines a function for establishing a communication path for transmitting and receiving audio data, moving image data, and the like in a streaming format using RTP (Real-time Transport Protocol).
- XEP-0177 Jingle Raw UDP Transport Method
- UDP User Datagram Protocol
- the first information and the second information may be an html (Hyper Text Markup Language) file in which meta information is expanded.
- the html file with the expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is a data communication established between the display device and the user terminal device.
- the meta information includes attribute information corresponding to XMPP messaging such as data ID information, location information, communication path identification information, access right information, and user information.
- attribute information for example, data ID information, location information, communication path identification information, access right information, user information, etc.
- extension meta information.
- each piece of meta information (for example, data ID information, location information, communication path identification information, user information, access right information, etc.) included in the first information and the second information is transferred to the Web. It can be mapped to the description in the html format used in the browser. That is, each meta information (data ID information, location information, communication path identification information, user information, access right information, etc.) included in the first information and the second information can be associated with the display element of html. Therefore, messaging by XMPP can be linked to Web and html.
- the first information and the second information may be fragment information constituting display information for displaying on the display unit of the display device.
- the information terminal device moderator terminal device, user terminal device
- the display device can correct the display information for displaying on the display unit based on the received fragment information. That is, it is not necessary to transmit the entire display information.
- the display device of the present invention includes a display unit that displays display data, a plurality of information that includes a moderator terminal device that manages the display data, and a user terminal device that transmits the display data.
- a communication unit that communicates with a terminal device via a network; and the communication unit receives data ID information for identifying the display data from the moderator terminal device via the network; and
- a control unit that opens a data communication path through which the display data is transmitted to the user terminal device when receiving the first information including position information indicating the display position of the display data;
- the communication unit receives second information including communication path identification information for identifying the data communication path and the data ID information via the network.
- the display unit transmits the data communication path specified by the communication path identification information from the user terminal apparatus based on the communication path identification information, the data ID information, and the position information.
- the display data received by the communication unit is displayed.
- the display device receives data ID information for identifying the display data and position information indicating a position for displaying the display data from the moderator terminal device that manages the display data. Then, a data communication path different from the network is established between the user terminal device that transmits the display data and the display device. Then, the display device transmits communication path identification information for identifying the established data communication path to the user terminal device via the network. Accordingly, the user terminal device can transmit the display data to the display device via the data communication path specified by the communication path identification information. Thus, the display data is transmitted from the user terminal device to the display device via a dedicated data communication path different from the network.
- the display device can associate the display data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the display data at the display position indicated by the position information. Data can be displayed. Therefore, the display device can display and display the display data transmitted via the dedicated data communication path on the display screen of the display unit.
- the data communication path is used by the terminal device other than the user terminal device or the display device, There is no possibility that display data transmitted and received through the data communication path is acquired or changed. Therefore, the security of data transfer via the data communication path can be further improved.
- the data communication path may be a logical communication path through which the display data is transmitted.
- the display data may be multimedia data in a format other than a text format.
- multimedia data in a format other than text format such as moving image data and audio data is transmitted from the user terminal device to the display device
- the multimedia data is transmitted to the network. Is transmitted on another dedicated data communication path. Therefore, even when data transmitted / received through the network (text data, etc.) and display data transmitted through the data communication path (multimedia data other than text format) have different transmission characteristics, they interfere with each other. Therefore, it is possible to prevent the occurrence of transfer fluctuations in which the data transfer speed and the data reception interval vary.
- the display device can receive multimedia data in a format other than text, such as moving image data and audio data, from the user terminal device more easily and efficiently. Further, the display device can associate the multimedia data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the multimedia data at the display position indicated by the position information. Multimedia data can be displayed. Therefore, the display device can structure and display the multimedia data received via the dedicated data communication path on the display screen of the display unit.
- the communication unit is set for each user who uses the data ID information, the position information, and the plurality of information terminal devices from the moderator terminal device, and generates the display data.
- the control unit uses the user terminal device used by the user indicated by the access right information.
- the data communication path through which the display data is transmitted may be opened.
- the communication unit includes the data ID information, the position information, and user information indicating a user who owns the display data from the moderator terminal device.
- the control unit opens the data communication path through which the display data is transmitted with the user terminal device used by the user indicated by the user right information. It is good to do.
- the display device can directly access display information transmitted between the access right information transmitted from the moderator terminal device or the user terminal device used by the user indicated by the user information.
- a data communication path can be established. Therefore, there is no need to create a mesh communication path network in order to share information between the display device and each information terminal device, and if necessary, the display device and the user terminal device that transmits display data It is only necessary to establish a data communication path between them.
- the display device can associate the display data received from the data communication path with the position information by the data ID information, and can display the data at the display position indicated by the position information.
- the communication unit is set for each user who uses the data ID information, the position information, and the plurality of information terminal devices via the network from the moderator terminal device. And receiving the first information having access right information indicating whether or not to permit generation and change of the display data and user information indicating a user who is an owner of the display data, The unit may display the display data based on the communication path identification information, the data ID information, the position information, the user information, and the access right information.
- the display device receives the display data received from the data communication path identified by the communication path identification information, the user information received from the moderator terminal apparatus by the data ID information, the access right information, A display unit that determines whether or not to display the display data identified by the data ID information based on the user information and the access right information, and indicates the display data by the position information Can be displayed at the display position. Therefore, the display data transferred from the user terminal device is managed by the data ID information, and the access right (that is, the access right) set for each of a plurality of users who use the information terminal device for the display data. Each display data displayed on the display unit of the display device is controlled according to whether or not the generation or change of the display data is permitted. Therefore, smooth communication according to each access right between a plurality of users is possible.
- the display unit The display data may be displayed based on the identification information, the data ID information, and the position information.
- the display device is permitted to have a user who is the owner of the display data identified by the data ID information and an access right to the display data (that is, generation or change of the display data is permitted).
- the display data can be displayed on the display unit only when the user who has the same or not matches. That is, the display device specifies the display data received from the data communication path specified by the communication path identification information by the data ID information and displays the specified display data at the display position indicated by the position information. Therefore, smooth communication according to each access right between a plurality of users is possible.
- communication conforming to XMPP may be performed with the plurality of information terminal devices.
- the display device can perform real-time messaging (information exchange) with a plurality of information terminal devices (moderator terminal device, user terminal device), and use data ID information.
- the data that is messaged by XMPP and the data that is displayed on the display unit can be associated with each other easily and reliably.
- the control is performed in accordance with at least one of the rules of XMPP XEP-0166 (Jingle), XEP-0167 (Jingle RTP Sessions), and XEP-0177 (Jingle Raw UDP Transport).
- the unit may establish the data communication path with the user terminal device, and the communication unit may receive the display data from the user terminal device via the data communication path.
- the display data is transmitted via a data communication path different from the network. Since the data is transmitted, the display device can reliably receive the display data via the data communication path without being affected by the interruption of data transfer.
- the first information and the second information may be html files obtained by extending meta information.
- the html file with expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is transmitted through a data communication path established between the display device and the user terminal device.
- the meta information includes attribute information corresponding to XMPP messaging such as data ID information, location information, communication path identification information, access right information, and user information.
- attribute information data ID information, location information, communication path identification information, access right information, user information, etc.
- each piece of meta information (data ID information, position information, communication path identification information, user information, access right information, etc.) included in the first information and the second information can be stored on the Web browser. It can be mapped to the description in the html format used. That is, each meta information (data ID information, location information, communication path identification information, user information, access right information, etc.) included in the first information and the second information can be associated with the display element of html. Therefore, messaging by XMPP can be linked to Web and html.
- the first information and the second information may be fragment information constituting display information for displaying on the display unit.
- the display device can correct the display information for displaying on the display unit based on the received fragment information. That is, it is not necessary to transmit the entire display information. Accordingly, since information transmitted and received between the display device and a plurality of information terminal devices (moderator terminal device, user terminal device) can be made lighter, the time required for communication can be shortened. At the same time, it is possible to greatly reduce the burden on the network between the display device and a plurality of information terminal devices (moderator terminal device, user terminal device). Therefore, a plurality of users participating in communication can perform more convenient communication.
- the user terminal device includes a control unit that opens a data communication path for transmitting display data to be displayed on the display device to the display device, and a network from the display device to the network.
- a communication unit that transmits display data to the display device.
- a data communication path for transmitting display data different from the network is established between the user terminal apparatus and the display apparatus, and a communication path for identifying the data communication path
- the identification information is transmitted from the display device to the user terminal device.
- the user terminal device can transmit the display data to the display device via the data communication path specified by the communication path identification information.
- the user terminal device transmits display data to the display device via a dedicated data communication path different from the network. Therefore, even if the data transmitted / received through the network and the display data transmitted through the data communication path have different transmission characteristics from each other, they do not interfere with each other and transfer fluctuations in which the data transfer rate and the data reception interval vary. Etc. can be prevented. Therefore, it is possible to transfer the display data from the user terminal device to the display device accurately, simply and efficiently.
- the data communication path is used by the terminal device other than the user terminal device or the display device, There is no possibility that display data transmitted and received through the data communication path is acquired or changed. Therefore, the security of data transfer via the data communication path can be further improved.
- the data communication path may be a logical communication path for transmitting the display data to be displayed on the display device.
- the display data may be multimedia data in a format other than a text format.
- the multimedia data is transmitted to the network. Transmits on a separate dedicated data communication path. Therefore, even when data transmitted / received through the network (text data, etc.) and display data transmitted through the data communication path (multimedia data other than text format) have different transmission characteristics, they interfere with each other. Therefore, it is possible to prevent the occurrence of transfer fluctuations in which the data transfer speed and the data reception interval vary. Therefore, multimedia data in a format other than the text format can be transferred from the user terminal device to the display device more simply, efficiently and accurately.
- the user terminal device configured as described above may perform communication with the display device in conformity with XMPP.
- the user terminal device can perform real-time messaging (information exchange) with the display device, and the data ID information can be transmitted to the display device and the data that is messaged by XMPP.
- the display data to be transmitted can be simply and reliably associated with each other.
- the control unit opens the data communication path specified by the communication path identification information with the display device, and the communication unit sends the display data to the display device through the data communication path. It may be transmitted.
- the user terminal device can display data different from the network. Since the data is transmitted via the communication path, display data can be reliably transferred without being affected by interruption of data transfer.
- the second information may be an html file in which meta information is extended.
- the html file with expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is transmitted through a data communication path established between the display device and the user terminal device.
- It includes meta information that is information (attribute information) related to display data to be transferred.
- the meta information includes attribute information corresponding to messaging by XMPP such as data ID information and communication path identification information.
- each meta information (data ID information, communication path identification information, etc.) included in the second information can be mapped to the description in the html format used in the Web browser. . That is, each meta information (data ID information, communication path identification information, etc.) included in the second information can be associated with an html display element. Therefore, messaging by XMPP can be linked to Web and html.
- the second information may be fragment information constituting display information for displaying on the display device.
- the display device can correct the display information for displaying on the display unit based on the received fragment information. That is, it is not necessary to transmit the entire display information. Therefore, since the information transmitted from the user terminal device to the display device can be made lighter, the time required for communication can be shortened and the load on the network between the display device and the user terminal device can be reduced. Can be greatly reduced. Therefore, a plurality of users participating in communication can perform more convenient communication.
- the presenter terminal device of the present invention identifies the display data in the presenter terminal device that manages the display data transmitted from the user terminal device to the display device.
- the data ID information and the position information indicating the display position of the display data on the display unit of the display device, and the data ID information and the position information via the network to the display device.
- a communication unit that transmits first information including:
- the display data transferred from the user terminal device to the display device in a simple, efficient and accurate manner is associated with the position information by the data ID information, and further the display indicated by the position information.
- the display data is displayed at the display position of the display unit of the apparatus. Therefore, the user using the moderator terminal device can display and display the display data transmitted from the user terminal device to the display device via the data communication path on the display screen of the display unit of the display device. Further, display data transmitted from the user terminal device to the display device via a dedicated data communication path different from the network by the data ID information and the position information, and a display unit of the display device for the display data It is possible to reliably and easily manage the display position on the screen.
- the control unit is set for each user who uses a plurality of information terminal devices communicating with the display device, and indicates whether to permit generation and change of the display data
- the right information may be generated, and the first information may further include the access right information.
- control unit may generate user information indicating a user who is an owner of the display data, and the first information may further include the user information. Good.
- the moderator terminal device can indicate the user terminal device to which the data communication path should be opened by transmitting the access right information or the user information to the display device.
- the establishment of a data communication path between the display device and the user terminal device can be controlled.
- the display device can establish a data communication path with the access right information transmitted from the moderator terminal device or the user terminal device used by the user indicated by the user information. Therefore, there is no need to create a mesh communication path network in order to share information between the display device and each information terminal device, and if necessary, the display device and the user terminal device that transmits display data It is only necessary to establish a data communication path between them.
- the moderator terminal device configured as described above, communication with the display device in conformity with XMPP may be performed.
- the moderator terminal device can perform real-time messaging (information exchange) with the display device, and data displayed by XMPP and the display device based on the data ID information.
- the data displayed on the display unit can be simply and reliably associated with each other.
- the first information may be an html file in which meta information is extended.
- the html file with expanded meta information is data in a format that can be expressed in html (Hyper Text Markup Language) compatible with XMPP-compliant communication, and is opened between the display device and the user terminal device.
- Meta information that is information (attribute information) related to display data transferred through the transmitted data communication path.
- the meta information includes attribute information corresponding to XMPP messaging such as data ID information, location information, communication path identification information, access right information, and user information.
- each meta information (data ID information, location information, user information, access right information, etc.) included in the first information is described in the html format used in the Web browser. Can be mapped. That is, each meta information (data ID information, position information, user information, access right information, etc.) included in the first information can be associated with an html display element. Therefore, messaging by XMPP can be linked to Web and html.
- the first information may be fragment information constituting display information for displaying on the display unit of the display device.
- the moderator terminal device when the moderator terminal device generates or changes some information included in the display information for display on the display unit of the display device, only the fragment information including the information is displayed. If it transmits to a display apparatus, the display apparatus can correct the display information for displaying on a display part based on the fragment
- the multi-user communication system is configured such that a plurality of users participate and display data transmitted from each information terminal device used by the plurality of users to the display device described above is A multi-user communication system displayed on a display device, wherein the plurality of information terminal devices include the user terminal device described above and the moderator terminal device described above.
- the display device receives data ID information for identifying the display data and position information indicating a position for displaying the display data from the moderator terminal device that manages the display data
- the display device transmits the display data.
- a data communication path different from the network is opened between the user terminal device and the display device.
- the display device transmits communication path identification information for identifying the established data communication path to the user terminal device via the network. Accordingly, the user terminal device can transmit the display data to the display device via the data communication path specified by the communication path identification information.
- the display device can associate the display data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the display data at the display position indicated by the position information. Data can be displayed. Therefore, the display device can display and display the display data transmitted via the dedicated data communication path on the display screen of the display unit.
- the user using the moderator terminal device can display data transmitted from the user terminal device to the display device via a dedicated data communication path different from the network, based on the data ID information and the position information, The display position of the display data on the display unit of the display device can be managed reliably and simply.
- the data communication path is used by the terminal device other than the user terminal device or the display device, There is no possibility that display data transmitted and received through the data communication path is acquired or changed. Therefore, the security of data transfer via the data communication path can be further improved.
- the display data may be multimedia data in a format other than text format.
- multimedia data in a format other than text format such as moving image data and audio data is transmitted from the user terminal device to the display device
- the multimedia data is transmitted to the network. Is transmitted on another dedicated data communication path. Therefore, even when data transmitted / received through the network (text data, etc.) and display data transmitted through the data communication path (multimedia data other than text format) have different transmission characteristics, they interfere with each other. Therefore, it is possible to prevent the occurrence of transfer fluctuations in which the data transfer speed and the data reception interval vary. Therefore, multimedia data in a format other than the text format can be transferred from the user terminal device to the display device more simply, efficiently and accurately.
- the display device can associate the multimedia data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the multimedia data at the display position indicated by the position information. Multimedia data can be displayed. Therefore, the display device can structure and display the multimedia data received via the dedicated data communication path on the display screen of the display unit.
- the multi-user communication system configured as described above may be an electronic conference system.
- each utterance (display data) presented in the virtual conference room (that is, the electronic conference system) can be reliably and easily managed by the data ID information, and the virtual conference
- the virtual conference room Depending on the access rights set for each of a plurality of participants (users) participating in the room (that is, whether the presentation (display data) is permitted to be displayed or modified), the virtual conference room
- the presented speech (display data) can be controlled. Therefore, a plurality of users participating in the virtual conference room can perform smooth communication according to their access rights.
- the display device and the information terminal device may perform communication based on XMPP.
- real-time messaging information exchange
- data ID information data that is messaged by XMPP and display data displayed on the display unit of the display device can be associated with each other easily and reliably.
- a data communication path for transmitting the display data is established between the display device and the user terminal device, and the display data is transferred from the user terminal device to the display device via the data communication path. It may be transmitted.
- the display data is transmitted via a data communication path different from the network. Since the data is transmitted, the display data is reliably transferred via the data communication path without being affected by interruption of the data transfer.
- the display data is transmitted to the display device via a data communication path different from the network connecting the display device and the information processing device. Therefore, even if the data transmitted / received through the network and the display data transmitted through the data communication path have different transmission characteristics from each other, they do not interfere with each other and transfer fluctuations in which the data transfer rate and the data reception interval vary. Etc. can be prevented. Therefore, it is possible to transfer the display data from the user terminal device to the display device accurately, simply and efficiently. Further, the display device can associate the display data received from the data communication path specified by the communication path identification information with the position information by the data ID information, and further display the display data at the display position indicated by the position information. Data can be displayed. Therefore, the display device can display and display the display data transmitted via the dedicated data communication path on the display screen of the display unit.
- FIG. 1 is a conceptual diagram illustrating an example of a multi-user communication system according to the present invention.
- the multi-user communication system of the present invention integrates various types of information presented by each participant in real time and has a structure on a display screen when a plurality of participants send information. Display. Therefore, for example, it can be used for an electronic conference system in which a plurality of users participating in a virtual conference room can discuss and present opinions.
- an electronic conference system will be described as an example of the multi-user communication system of the present invention.
- FIG. 2 is a configuration diagram showing the configuration of the electronic conference system according to the embodiment of the present invention.
- the display device 10 and a plurality of information terminal devices 20 (201, 202a, 202b, 202c, 202d) communicate with each other via a network 30 (30a to 30e). Is going.
- the information terminal device 20 includes a moderator terminal device 201 and a user terminal device 202 which will be described later.
- each information terminal device 20 used by the plurality of users connects to the display device 10 via a data line 40 (data communication path) separate from the network 30.
- the display data to be transmitted is displayed on the display device 10.
- Display data (in particular, multimedia data in a format other than text format such as moving image data and audio data) presented to the electronic conference system 1 by each user participating in the electronic conference system 1 is displayed on the display device.
- each information terminal device 20 moderator terminal device 201, user terminal devices 202a to 202d
- a data line 40 40a to 40e
- the data lines 40a to 40e are logical communication paths established on physical communication lines through which the networks 30a to 30e are communicated. Therefore, when establishing a direct data line 40 for directly transmitting display data between the display device 10 and each information terminal device 20, it is not necessary to provide a physical communication line separately from the network 30.
- the logical communication path is a logically viewed virtual communication line (logical line) of a physically viewed communication line. For example, even if there is physically one communication line, a plurality of logical lines can be set, and different data communication can be performed for each logical line.
- the network 30 and the data line 40 are different logical lines through the same physical communication line.
- the electronic conference system 1 is constructed using XMPP (eXtensible Messaging and Presence Protocol) described later, and the display device 10 and the plurality of information terminal devices 20 perform communication conforming to XMPP. Therefore, in communication between the display device 10 and the plurality of information terminal devices 20, real-time messaging (information exchange) can be performed.
- XMPP eXtensible Messaging and Presence Protocol
- XMPP used in the electronic conference system 1 of this embodiment will be described.
- XMPP is an XML (eXtensible Markup Language) -based protocol (communication protocol) that is being standardized and standardized by XSF (XMPP Standards Foundation) independent of the XMPP working group of the Internet Engineering Task Force (IETF).
- XMPP runs a wide range of applications including instant messaging, presence ("what the person is now"), multi-person chat, voice or videophone, collaborative work, content syndication, generalized routing of XML data, etc.
- XEP XMPP Extension Protocol
- the electronic conference system 1 uses various protocols (communication rules) defined in XMPP.
- XEP-0030 Service Discovery
- XEP-0045 Multi-User Chat
- XEP-0071 Xhtml-IM
- XEP is important protocols for understanding the electronic conference system 1 of the present embodiment.
- -0166 Jingle
- XEP-0030 Service Discovery is a protocol (communication protocol) that defines a function for detecting information.
- DISCO communication protocol
- the information terminal device 20 searches for the electronic conference system 1 to participate by using this DISCO.
- XEP-0045 Multi-User Chat
- MUC multi-user chat function
- this protocol also allows users to kick (forcibly move) and ban (exile) and chat room users. It defines a model for controlling a chat room by a function for assigning roles and affiliations to be described later.
- a role is a temporary position or privilege level given to a user using chat.
- the MUC defines “moderator” who can delete a user's kick and its remarks, “participant” who has the right to speak, and “visitor” who has no right to speak. Yes.
- the affiliate is given to the user as being permanently effective even after using the chat.
- the “owner” who opened the chat room, the “administer” who manages and operates the chat room, the “member” who is the other user, and the chat room that has been kicked There are provisions for “outcasts” that are not allowed to re-enter.
- the electronic conference system 1 is operated using the XMPP protocol (communication protocol) as described above, in particular, a multi-user chat function based on MUC (XEP-0045).
- the MUC function is provided by the display device 10 as will be described later.
- XEP-0071 (Xhtml-IM) is a protocol (communication protocol) stipulated for exchanging instant messages including lightweight text markup (tagging) using a subset of html. With this protocol, it is possible to set a message format that uses a narrow range of commonly used html elements, attributes, and style properties suitable for instant messaging.
- the display device 10 and the information terminal device 20 in the electronic conference system 1 according to the present embodiment transmit and receive XMPP messages such as text data in accordance with a protocol (communication protocol) further expanded from XEP-0071 (Xhtml-IM). It is carried out.
- XEP-0166 is a protocol (communication protocol) that defines a function for establishing a communication path for transmitting and receiving data between two communicable terminal devices. Protocols related to Jingle include XEP-0167 (Jingle RTP Sessions) and XEP-0177 (Jingle Raw UDP Transport Method).
- XEP-0167 is a protocol (communication protocol) that defines a function for establishing a communication path for transmitting and receiving audio data, moving image data, and the like in a streaming format using RTP (Real-time Transport Protocol).
- XEP-0177 Jingle Raw UDP Transport Method
- UDP User Datagram Protocol
- Jingle XEP-0166 (Jingle) is referred to as Jingle.
- XEP-0167 Jingle RTP Sessions
- XEP-0177 Jingle Raw UDP Transport Method
- FIG. 3 is a configuration diagram showing the configuration of the display device in the embodiment of the present invention.
- the display device 10 performs communication conforming to XMPP with a plurality of information terminal devices 20 included in the electronic conference system 1.
- the display device 10 is structured display information for displaying information such as agenda that summarizes statements (display data) presented by the participants (information terminal device 20) of the electronic conference system 1 in a structured state.
- the drawing mechanism of html is used as the display information.
- the display device 10 includes a display unit 11 that displays display data, and a communication unit 12 that communicates with the information terminal device 20 (moderator terminal device 201, user terminal device 202) via the network 30. And a storage unit 13 for storing structured display information, information transmitted and received by the communication unit 12, and a control unit 14 for controlling the display unit 11, the communication unit 12, and the storage unit 13.
- the communication unit 12 includes a data ID (data ID information) for identifying display data, position information indicating a display position of display data on the display unit 11, and user information indicating a user who is the owner of the display data.
- Information (first information) that is set for each user who uses the plurality of information terminal devices 20 and has access right information indicating whether or not to allow generation and change of display data is displayed as the moderator terminal device Received from the network 201 via the network 30. Further, when the data line 40 for transmitting display data is opened between the display device 10 and the user terminal device 202, the communication unit 12 establishes a stream ID (communication path identification) for identifying the data line 40.
- Information (second information) including information) and data ID (data ID information) is transmitted to the user terminal device 202 via the network 30.
- the control unit 14 and the user terminal device 202 In between, a data line 40 (data communication path) through which display data is transmitted is opened.
- the information (first information) received from the moderator terminal device 201 includes access right information and user information. Therefore, the control unit 14 connects the data line 40 through which the display data is transmitted to the user terminal device 202 used by the user indicated by the access right information or user information received by the communication unit 12 from the moderator terminal device 201. Open.
- control unit 14 integrates display data received from each information terminal device 20 to generate and edit structured display information, information included in the structured display information (such as html fragment information, The meta-information such as data ID, position information, access right information, user information, etc.) is corrected, and a document described in html is created from the entire structured display information.
- the display unit 11 structures and displays the display data presented from each information terminal device 20 to the electronic conference system 1.
- the display unit 11 includes a plurality of pieces of fragment information each having display data structured, and a structured display for displaying opinions, materials, proceedings, and the like presented to the electronic conference system 1 Based on information (display information), structured display is performed.
- the display unit 11 is received by the communication unit 12 from the user terminal device 202 via the data line 40 specified by the stream ID based on the stream ID, data ID, and position information received from the moderator terminal device 201.
- the display data to be displayed is displayed. That is, the display unit 11 associates the display data received from the user terminal device 202 via the data line 40 specified by the stream ID with the communication unit 12 and the position information by the data ID, and is further specified by the data ID.
- the display data is displayed at the display position of the display unit 11 indicated by the position information.
- the display unit 11 includes a stream ID received from the moderator terminal device 201, a data ID, position information, user information indicating a user who is the owner of display data, and a user who uses a plurality of information terminal devices.
- Display data is displayed on the basis of access right information that is set for each and indicates whether to allow generation and change of display data. That is, when the user who is permitted to generate and change the display data indicated by the access right information matches the user indicated by the user information, the display unit 11 is based on the stream ID, the data ID, and the position information. Display the display data
- FIG. 4 is a configuration diagram showing the configuration of the information terminal device in the embodiment of the present invention.
- the information terminal device 20 includes a terminal display unit 21 (display unit) that displays data input by the user, and a terminal communication unit 22 (communication unit) that transmits and receives information to and from the display device 10. ), Terminal storage unit 23 (storage unit) for storing information transmitted / received by the terminal communication unit 22 and display data to be displayed on the display unit 11 of the display device 10, and transmission / reception operations and terminal storage unit 23 in the terminal communication unit 22.
- Terminal control unit 24 control unit for controlling storage and reading operations of information and terminal input unit 25 (input unit) for the user to input data. As will be described later, the terminal control unit 24 also edits or reconfigures the html fragment information constituting the structured display information and its meta information as necessary.
- Each information terminal device 20 has a role indicating a temporary privilege level in the electronic conference system 1 operated using the MUC function, such as “moderator” and “participant”. Is assigned.
- the affiliation of each information terminal device 20 is not mentioned, but the “moderator” is “owner” and “administrator”. Assume an affiliate, and a “participant” has a “member” affiliate. Also, “visitors” and “outcasts” are not mentioned.
- an information terminal device to which the role of “moderator” is given is referred to as the moderator terminal device 201, and an information terminal device to which the role of “participant” is given.
- the user terminal device 202 will be described.
- the moderator terminal device 201 is an information terminal device that performs proceedings in the electronic conference system 1 and manages display data displayed on the display unit 11 of the display device 10.
- the terminal control unit 24 of the moderator terminal device 201 uses a data ID (data ID information) for identifying each display data displayed on the display unit 11 of the display device 10 or each information terminal device 20 (that is, the moderator).
- Terminal device 201, user terminal device 202) access right information indicating an access right indicating whether or not to allow generation and change of display data for each user who uses the user, and user information indicating a user who owns the display data Etc. can be set.
- the terminal communication unit 22 transmits information (first information) including a data ID, position information, user information, access right information, and the like to the display device 10 via the network 30.
- the moderator terminal device 201 can also transmit display data to the display device 10 in the same manner as the user terminal device 202.
- the user terminal device 202 is the information terminal device 20 that transmits display data to the display device 10.
- the terminal control unit 24 negotiates with the display device 10 to open the data line 40, and In the meantime, apart from the network 30, a data line 40 for transmitting display data is opened.
- the user terminal device 202 transmits a data ID (data ID information) for identifying display data and a stream ID (communication path identification information) for identifying the data line 40 from the display device 10 via the network 30. Is received from the terminal communication unit 22 via the data line 40 (data communication path), the display data corresponding to the data ID is transmitted to the display device 10.
- the above-described establishment of the data line 40 and transmission of display data via the data line 40 are performed by XMPP XEP-0166 (Jingle), XEP-0167 (Jingle RTP Sessions), XEP-0177 (Jingle Raw UDP Transport). ) In accordance with at least one of the protocols (communication protocol).
- the structured display information is structured information for displaying information on the display unit 11 of the display device 10, in which a plurality of pieces of information have a structural correlation. Further, the structure is not particularly limited, and may take a tree structure or the like.
- each piece of information constituting the structured display information is referred to as html fragment information.
- FIG. 5 is a configuration diagram showing a configuration of structured display information in the embodiment of the present invention. As shown in FIG. 5, in the structured display information, each html fragment information has a hierarchical correlation with the html fragment information n0 as a vertex.
- the html fragment information that is one level higher than a certain html fragment information is called parent html fragment information
- the html fragment that is one level lower than a certain html fragment information is called child html fragment information.
- FIG. 6 is a view for explaining a display screen based on structured display information in the embodiment of the present invention.
- FIG. 7 is a diagram showing an example of an actual display screen based on structured display information in the embodiment of the present invention. As shown in FIG. 7, each information display frame on the display screen 111 of the display unit 11 corresponds to each html fragment information, and the display data (for example, text data, image data, video data, Audio data etc.) is displayed in the corresponding information display frame.
- the display data for example, text data, image data, video data, Audio data etc.
- the information that the html fragment information n0 has is displayed in the information display frame N0, and the html fragment information n1 and n2 that are the html fragment information (child html fragment information) in the hierarchy below the html fragment information n0. , N3 are displayed in information display frames N1, N2, and N3 arranged in the information display frame N0, respectively. Further, the information included in the html fragment information n11 and n12, which is the child html fragment information of the html fragment information n1, is displayed in the information display frames N11 and N12 arranged in the information display frame N1, respectively, and is a child of the html fragment information n2.
- the information included in the html fragment information n21 that is html fragment information is displayed in the information display frame N21 arranged in the information display frame N2, and the html fragment information n31, n32, and n33 that is child html fragment information of the html fragment information n3. Is displayed in information display frames N31, N32, and N33 arranged in the information display frame N3.
- Information included in the html fragment information n121 and n122 which are child html fragment information of the html fragment information n12 is displayed in the information display frames N121 and N122 arranged in the information display frame N12, respectively.
- the information included in the child html fragment information is displayed in the information display frame arranged in the information display frame of the parent html fragment information.
- each html fragment information constituting the structured display information has display data displayed on the display unit 11 of the display device 10.
- Examples of the display data included in each html fragment information include text data, image data, moving image data, audio data, and the like.
- Each html fragment information includes a unique data ID (data ID information) for identifying display data (that is, display data displayed on the display unit 11 of the display device 10) included in the html fragment information, and an html fragment.
- Position information indicating the display position of the display data included in the information (that is, display data displayed on the display unit 11 of the display device 10) on the display unit 11, and a user who is the owner of the display data included in the html fragment information
- User information access rights to html fragment information set for each user using the information terminal device 20 (moderator terminal device 201, user terminal device 202) (that is, generation or change of display data included in the html fragment information)
- the information terminal device 20 moderator terminal device 201, user terminal device 202
- the display position of the display data indicated by the position information may be specified by absolute coordinates in the information display frame of the parent html fragment information, or the document flow in the information display frame of the parent html fragment information. It is good also as what is arrange
- the user information included in the meta information of each html fragment information may indicate the owner of the html fragment information, and the user indicated by the user information is a child html fragment with respect to the html fragment information.
- Information may be generated or deleted.
- each html fragment information is an access right to display data included in the html fragment information set for each user who uses each information terminal device (that is, whether generation or change of display data is permitted). Only authorized users can access the access right information. With the access right information, the user to whom the access right is granted can access the html fragment information, browse display data and meta information included in the html fragment information, and change or modify the contents.
- the access right to the parent html fragment information is also inherited by the child html fragment information. That is, a user who has not been granted access right in the access right information of the parent html fragment information does not have access right to the child html fragment information.
- the user who is given the access right in the access right information of the parent html fragment information also has the access right to the child html fragment information.
- FIG. 8A to 8C show examples of html fragment information in this embodiment.
- FIG. 8A is a diagram showing an example in which html fragment information having text data is expressed as an html document.
- FIG. 8B is a diagram showing an example in which html fragment information having moving image data is expressed as an html document.
- FIG. 8C is a diagram showing an example in which html fragment information having audio data is expressed as an html document.
- position information indicating the display position of the moving image data displayed on the display unit 11 of the display device 10 or a unique data ID (data) for identifying the moving image data.
- ID information user information indicating a user who is the owner of this moving image data
- this html fragment information set for each user using the information terminal device 20 (moderator terminal device 201, user terminal device 202).
- Access right information indicating the access right is described.
- a unique stream ID (sid: communication path identification information) for identifying the data line 40 that transmits the moving image data to the display device 10 is described.
- FIG. 9 is an operation diagram for explaining a procedure for establishing the electronic conference system according to the embodiment of the present invention.
- the display device 10 establishes the electronic conference system 1 using the MUC function with the moderator terminal device 201.
- step S101 the moderator terminal device 201 of the electronic conference system 1 transmits to the display device 10 a request for opening a virtual conference room (chat room).
- step S102 the display device 10 issues a notification to the effect that the request has been received from the moderator terminal device 201.
- step S103 the moderator terminal device 201 notifies the display device 10 that setting information for opening a virtual conference room is to be created.
- step S104 the display device 10 transmits data form information for creating setting information to the moderator terminal device 201.
- step S ⁇ b> 105 the moderator terminal device 201 creates setting information for opening a virtual conference room based on the data form information received from the display device 10, and transmits the created setting information to the display device 10.
- step S106 the display device 10 notifies the moderator terminal device 201 that the setting information has been received.
- the establishment of the electronic conference system 1 between the display device 10 and the moderator terminal device 201 opens a virtual conference room in which a plurality of users using the information terminal device 20 can participate. Is done.
- FIG. 10 is an operation diagram for explaining a procedure for the information terminal device according to the embodiment of the present invention to participate in the electronic conference system.
- a procedure in which the user terminal device 202a participates in a virtual conference room that is, the electronic conference system 1 will be described.
- step S201 the user terminal device 202a searches for a virtual conference room (electronic conference system 1) opened by the display device 10 using XEP-0030 (Service Discovery), which is an XMPP protocol (communication protocol). . Thereby, the user terminal device 202a can discover the virtual meeting room (electronic conference system 1) opened by the display apparatus 10.
- XEP-0030 Service Discovery
- XMPP protocol communication protocol
- step S202 the user terminal device 202a requests the display device 10 to enter a virtual conference room (electronic conference system 1).
- step S203 the display device 10 transmits to the user terminal device 202a a notification to permit entry.
- step S ⁇ b> 204 the display device 10 newly enters the other information terminal devices (the moderator terminal device 201 and the other user terminal device 202) that have already entered the virtual conference room (electronic conference system 1). Send notification that there was.
- the user terminal device 202a can enter the virtual conference room (electronic conference system 1), and display device 10 and other information terminal devices (moderator terminal device 201 and other users).
- the terminal device 202) can communicate with XMPP.
- FIG. 11 is an operation diagram for explaining a procedure for initializing structured display information of the electronic conference system according to the embodiment of the present invention.
- step S301 the moderator terminal device 201 that has established a virtual conference room (electronic conference system 1) with the display device 10 in steps S101 to S107 described above displays the agenda and the like in the electronic conference system 1 on the display device 10.
- Structured display information to be displayed on the display unit 11 is created.
- the structured display information created here includes the html fragment information having a structural correlation (for example, a tree structure).
- the moderator terminal device 201 gives a unique data ID (that is, a data ID for identifying display data included in the html fragment information) to each html fragment information.
- the moderator terminal device 201 for each html fragment information, as meta information, the attribute information as described above, that is, a position indicating the display position on the display screen 111 of the display data included in the html fragment information Information, user information indicating a user who is an owner of html fragment information, and an html fragment set for each user using each information terminal device 20 (moderator terminal device 201, user terminal device 202)
- the access right information indicating the access right to the information (that is, whether or not the generation or change of information included in the html fragment information is permitted) is created.
- step S ⁇ b> 302 the moderator terminal device 201 transmits the created html fragment information to the display device 10.
- step S303 the display device 10 performs syntax analysis on each received html fragment information, and creates html fragment information corresponding to each received html fragment information. Further, the display device 10 checks that the data ID for identifying the created html fragment information does not overlap with the data IDs of other html fragment information. Then, the display device 10 creates structured structured display information including each piece of html fragment information.
- step S304 the display device 10 further transmits structured display information obtained by structuring each created html fragment information to each information terminal device (moderator terminal device 201, user terminal device 202).
- step S305 the display device 10 displays an initialization screen on the display unit 11 based on the initialized structured display information.
- the initialization process of the structured display information is completed, and the initialization screen is displayed on the display unit 11 of the display device 10 based on the structured display information.
- FIG. 12 is an operation diagram for explaining a procedure in which text data provided from the information terminal device according to the embodiment of the present invention is displayed on the display screen of the display device.
- the user of the user terminal device 202a is allowed to speak, for example, or directly allowed by the user of the moderator terminal device 201 offline.
- step S401 the moderator terminal device 201 creates html fragment information for speech necessary for the user terminal device 202a to speak in a virtual conference room (electronic conference system 1).
- the speech html fragment information created by the moderator terminal device 201 is incorporated into the structured display information, thereby displaying the speech (text data) presented by the speaker (in this case, the user terminal device 202a).
- the information display frame for this is set on the display screen 111 of the display unit 11 of the display device 10.
- the moderator terminal device 201 uses the terminal control unit 24 to assign a unique data ID for identifying text data included in the speech html fragment information to a data ID corresponding to the text data included in the other html fragment information. While creating so that it may not overlap, the positional information which shows the display position of the speech (data) which the speaker (user terminal device 202a) displayed on the display part 11 of the display apparatus 10 presents is produced. Furthermore, the moderator terminal device 201 uses user information indicating a user who owns the data stored in the html fragment information for speech and the information terminal device 20 (the moderator terminal device 201 and the user terminal device 202).
- This speech html fragment information is described as shown in FIG. 8A, for example. At this time, no text data is stored in the html fragment information for speech.
- step S402 the moderator terminal device 201 transmits the html fragment information for speech to the display device 10 via the network 30e.
- meta information such as data ID, user information, access right information, and position information indicating the display position of the text data displayed on the display unit 11 of the display device 10 is also transmitted to the display device 10 via the network 30e. Is done.
- the html fragment information for speech is an html file obtained by extending meta information.
- the html file with expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is related to text data transferred from the user terminal device 202a to the display device 10.
- Meta information that is information (attribute information) is included.
- the meta information includes attribute information corresponding to messaging by XMPP such as a data ID, location information, access right information, and user information.
- step S403 the display device 10 analyzes the syntax of the html fragment information for speech, and provides an information display frame that allows the speaker (in this case, the user terminal device 202a) to speak if the syntax is correct.
- step S ⁇ b> 404 the display device 10 further includes, in each information terminal device 20 (the user terminal device 202 including the moderator terminal device 201 and the user terminal device 202 a), an utterance html fragment including the data ID created in S ⁇ b> 401.
- Information is transmitted via the network 30 to notify the display screen 111 of the display unit 11 that an information display frame (in this case, an information display frame of the user terminal device 202a) that enables a speaker to speak is provided.
- step S405 a message (text data) to be presented by the user terminal device 202a to the virtual conference room (electronic conference system 1) is input from the terminal input unit 25.
- the text data input from the terminal input unit 25 is data stored in the speech html fragment information specified by the data ID.
- the user terminal device 202a edits the speech html fragment information so as to add the text data input from the terminal input unit 25 to the speech html fragment information.
- step S406 the user terminal device 202a transmits the html fragment information for speech having text data to the display device 10 via the network 30a.
- the user terminal device 202a also sends the data ID, user information, access right information, etc. of the speech html fragment information to the display device 10 via the network 30a as meta information of the speech html fragment information. Send.
- step S407 the display device 10 parses the html fragment information for speech received from the user terminal device 202a, and edits the structured display information based on the received html fragment information for speech. That is, the display device 10 determines whether or not the user who is given the access right to the speech html fragment information indicated by the access right information matches the user indicated by the user information. If the two match, the user using the user terminal device 202a is granted access rights to the utterance html fragment information (that is, generation or modification of data included in the utterance html fragment information). Therefore, the control unit 14 of the display device 10 edits the structured display information based on the received speech html fragment information.
- the display device 10 includes the data ID (data ID information) edited in S407 in each information terminal device 20 (the user terminal device 202 including the moderator terminal device 201 and the user terminal device 202a).
- the html fragment information for speech is transmitted via the network 30 to notify that the html fragment information for speech has been edited.
- step S409 the display device 10 displays the proceedings in the virtual conference room (electronic conference system 1) on the display unit 11 based on the edited structured display information.
- the display device 10 displays text data identified by the data ID on the display unit 11 based on the user information, the access right information, and the position information. That is, the display device 10 displays the text data stored in the html fragment information identified by the data ID at the display position on the display screen 111 indicated by the position information.
- FIG. 13 is an operation diagram for explaining a procedure for displaying multimedia data in a format other than the text format provided from the information terminal device according to the embodiment of the present invention on the display screen of the display device.
- the user of the user terminal device 202a is in a state where data should be presented, or that the user of the moderator terminal device 201 is allowed to directly present data offline, for example. To do.
- step S501 the moderator terminal apparatus 201 creates html fragment information for speech necessary for the user terminal apparatus 202a to speak (present data) in a virtual conference room (electronic conference system 1).
- the html fragment information for speech created by the moderator terminal device 201 is incorporated into the structured display information, thereby displaying the material (multimedia data) presented by the speaker (in this case, the user terminal device 202a).
- An information display frame for this purpose is set on the display screen 111 of the display unit 11 of the display device 10.
- the moderator terminal device 201 uses the terminal control unit 24 to transmit a unique data ID for identifying multimedia data included in the html fragment information for speech to data corresponding to the multimedia data included in the other html fragment information. While creating so that it may not overlap with ID, the positional information which shows the display position of the data (multimedia data) which the speaker (user terminal device 202a) displayed on the display part 11 of the display apparatus 10 presents is produced. Furthermore, the moderator terminal device 201 uses user information indicating a user who owns the data stored in the html fragment information for speech and the information terminal device 20 (the moderator terminal device 201 and the user terminal device 202). Create access right information that is set for each user and indicates the access right to the speech html fragment information (that is, whether or not to allow the creation or modification of multimedia data stored in the speech html fragment information), These are given to the html fragment information for speech as meta information.
- the html fragment information for speech includes multimedia data that the user terminal device 202a presents to the electronic conference system 1 in addition to the data ID, position information, user information, access right information, and the like.
- a stream ID (sid, communication path identification information) for identifying the data line 40a for transmitting is described. For example, when video data is presented, a ⁇ video /> tag is described as shown in FIG. 8B, and when audio data is presented, an ⁇ audio /> tag is described as shown in FIG. 8C.
- the tag describing the stream ID is expanded according to the type of multimedia data transmitted via the data line 40a.
- a tag describing the stream ID (for example, a ⁇ video /> tag as shown in FIG. 8B, FIG. 8C The ⁇ audio /> tag) does not describe the stream ID.
- step S502 the moderator terminal apparatus 201 displays the data ID, the user information, the access right information, and the display position of the multimedia data displayed on the display unit 11 of the display apparatus 10 on the display apparatus 10 via the network 30e.
- the html fragment information for speech (first information) having meta information such as the position information shown is transmitted.
- the html fragment information (first information) for speech may be an html file in which meta information is extended.
- the html file with the expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is a data line established between the display device 10 and the user terminal device 202a.
- the meta information includes attribute information corresponding to messaging by XMPP such as a data ID, location information, access right information, and user information.
- attribute information data ID information, location information, access right information, user information, etc.
- each meta information (data ID information, position information, user information, user information, Access right information) can be mapped to the description in the html format used in the Web browser. That is, each meta information (data ID information, position information, user information, access right information, etc.) included in the html fragment information for speech can be associated with the display element of html. Therefore, messaging by XMPP can be linked to Web and html.
- step S503 the display device 10 performs syntax analysis of the html fragment information for speech, and provides an information display frame that enables display of materials (multimedia data) presented by the user terminal device 202a if the syntax is correct.
- step S504 a tag describing a stream ID (for example, a ⁇ video /> tag as shown in FIG. 8B or an ⁇ audio /> tag as shown in FIG. 8C) is used when the html fragment information for speech is parsed.
- the display device 10 determines that multimedia data such as moving image data and audio data is transmitted from the user terminal device 202a based on the meta information of the html fragment information for speech, and the user terminal device 202a.
- setting for opening a data line 40a (data communication path) to which the multimedia data is transferred separately from the network 30a is started.
- the data line 40a is set up and opened in accordance with XMPP applied protocols XEP-0166 (Jingle), XEP-0167 (Jingle RTP Sessions), XEP-0177 (Jingle Raw UDP Transport), and the like.
- the display device 10 becomes the side that proposes the setting of the data line 40a, that is, the initiator of Jingle, and the user terminal device 202a accepts or rejects the setting of the data line 40a, that is, the side of Jingle. Become a responder.
- step S505 the display device 10 transmits to the user terminal device 202a via the network 30a that it proposes to open a data line 40a for transferring multimedia data.
- step 506 the user terminal device 202a transmits the confirmation of the proposal to the display device 10 via the network 30a.
- step 507 negotiation (negotiation) on the setting contents for establishing the data line 40a between the display terminal 10 and the user terminal device 202a is XEPP0166 (Jingle), which is an XMPP application protocol. It is performed according to XEP-0167 (Jingle RTP Sessions), XEP-0177 (Jingle Raw UDP Transport) and the like.
- the data line 40 can be set as an encrypted line.
- the user terminal device 202a determines whether to agree or reject the proposal for opening the data line 40a. In the present embodiment, it is assumed that the user terminal device 202a has determined to agree as a result of the negotiation.
- step S508 the user terminal device 202a transmits to the display device 10 via the network 30a that the user agrees to the setting proposal for the data line 40a.
- step S509 the display device 10 transmits to the user terminal device 202a that the agreement of the proposal has been confirmed via the network 30a. Then, a direct data line 40a capable of directly transferring data is opened between the display device 10 and the user terminal device 202a as shown in FIG.
- the data line 40a is a logical communication path established in a physical communication line through which the network 30a is communicated. Therefore, when establishing a direct data line 40a for directly transmitting display data between the display device 10 and the user terminal device 202a, it is not necessary to provide a physical communication line separately from the network 30a.
- the logical communication path is a logically viewed virtual communication line (logical line) of a physically viewed communication line. For example, even if there is physically one communication line, a plurality of logical lines can be set, and different data communication can be performed for each logical line.
- the network 30a and the data line 40a are different logical lines through the same physical communication line.
- step S510 the display device 10 does not overlap the stream ID (sid: communication path identification information) for identifying the data line 40a established with the user terminal device 202a with the stream IDs of other communication lines.
- the html fragment information for speech (second information) including the data ID and the stream ID as meta information is transmitted to each information terminal device 20 (moderator terminal device 201, user terminal device 202) via the network 30.
- the information display frame (in this case, the information display frame of the user terminal device 202a) for displaying the material (multimedia data) presented by the speaker on the display screen 111 of the display unit 11 is notified.
- the html fragment information (second information) for speech may be an html file in which meta information is extended.
- the html file with expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is a data communication established between the display device 10 and the user terminal device 202a. It includes meta information that is information (attribute information) related to display data transferred through a route.
- the meta information includes attribute information corresponding to messaging by XMPP such as data ID (data ID information) and stream ID (communication path identification information).
- each meta information (data ID, stream ID, etc.) included in the html fragment information for speech is changed to Web. It can be mapped to the description in the html format used in the browser. That is, each meta information (data ID, stream ID, etc.) included in the html fragment information for speech can be associated with the display element of html. Therefore, messaging by XMPP can be linked to Web and html.
- step S511 the user terminal device 202a prepares to transmit multimedia data to be presented to the virtual conference room (electronic conference system 1) to the display device 10 via the data line 40a specified by the stream ID. Do.
- step S512 the user terminal device 202a sends multimedia data to the display device 10 via the data line 40a specified by the stream ID, Jingle (XEP-0166), which is an XMPP application protocol, and related XMPP. Transfer is performed in a streaming system in accordance with regulations such as Jingle-RTP (XEP-0167) and Jingle-UDP (XEP-0177) which are application protocols.
- Jingle-RTP XEP-0167
- Jingle-UDP XEP-0177
- step S513 the control unit 14 of the display device 10 uses the data ID to transfer the multimedia data transferred by the streaming method from the data line 40a specified by the stream ID, using the location information, user information, and access right information. Associate with meta information such as At this time, the control unit 14 of the display device 10 determines whether or not the user to whom the access right indicated by the access right information is given matches the user indicated by the user information. If the two match, the user using the user terminal device 202a has access rights to the speech html fragment information in which the multimedia data is stored (that is, the multimedia data included in the speech html fragment information). Generation or modification) is permitted.
- the control unit 14 of the display device 10 stores the multimedia data stream-transferred from the data line 40 in the speech html fragment information, edits the structured display information, and based on the data ID and the position information.
- the multimedia data is displayed at the display position on the display screen 111 of the display unit 11 indicated by the position information. Therefore, the user using the moderator terminal device 201 can reliably and easily manage the display position of the multimedia data displayed on the display unit 11 of the display device 10.
- multimedia data such as moving image data and audio data is transferred by a streaming method
- the transferred multimedia data is sequentially reproduced at a display position on the display screen 111 of the display unit 11 indicated by position information. You can also.
- step S514 when the transfer of the multimedia data is completed, a process of closing the data line 40a between the display device 10 and the user terminal device 202a is performed. Further, the display device 10 ends its role as a Jingle initiator, and the user terminal device 202a ends its role as a Jingle responder.
- the display data is transferred from the data line 40a established between the user terminal device 202a and the display device 10, but other information terminal devices (for example, the moderator terminal device 201) are used.
- the user terminal devices 202b to 202d) can transfer the display data by opening a direct data line 40 in the same procedure.
- the moderator terminal device 201 has a data ID (data ID information) for identifying display data and a position indicating the display position of the display data on the display unit 11 of the display device 10.
- the html fragment information for speech (first information) having the information is transmitted to the display device 10 via the network 30.
- a data line 40 (data communication path) through which display data is transmitted is opened separately from the network 30 between the display device 10 and the user terminal device 202.
- the display device 10 transmits the html fragment information for speech (second information) having the stream ID (communication path identification information) for identifying the data line 40 and the data ID via the network 30 to the user terminal.
- the user terminal device 202 transmits display data to the display device 10 via the data line 40 specified by the stream ID.
- the display device 10 displays the display data on the display unit 11 based on the stream ID, the data ID, and the position information.
- the display data is transmitted from the user terminal device 202 to the display device 10 via the dedicated data line 40 different from the network 30. Therefore, even when the data transmitted / received through the network 30 and the display data transmitted through the data line 40 have different transmission characteristics from each other, the data transfer speed and the data reception interval vary without interfering with each other. Occurrence of fluctuations can be prevented. Therefore, display data can be transferred from the user terminal device 202 to the display device 10 simply, efficiently and accurately. In addition, even when multimedia data in a format other than text format, such as video data and audio data, is streamed to the data communication path, the streaming transfer of the multimedia data does not continue to occupy the communication line.
- multimedia data in a format other than text format such as video data and audio data
- the display device 10 can associate the display data received from the data line 40 specified by the stream ID with the position information by the data ID, and further display the display data at the display position of the display unit 11 indicated by the position information. Can be displayed. Therefore, the display device 10 can display and display the display data transmitted via the dedicated data line 40 on the display screen 111 of the display unit 11 of the display device 10.
- the user using the moderator terminal device 201 displays the data ID and the position information transmitted from the user terminal device 202 to the display device 10 via the dedicated data line 40 different from the network 30.
- the data and the display position of the display data on the display unit 11 of the display device 10 can be reliably and easily managed.
- the data line 40 is used by the terminal device other than the user terminal device 202 or the display device 10. Or display data transmitted / received through the data line 40 can be obtained or changed. Therefore, the security of data transfer via the data line 40 can be further improved.
- the data line 40 established between the user terminal device 202 and the display device 10 can be a logical communication path through which display data is transmitted.
- a direct data communication path for directly transmitting display data is established between the display device 10 and the user terminal device 202, it is not necessary to provide a physical communication line separately from the network 30. That is, by providing a data line 40 as a new logical communication path (logical line) different from the network 30 on a physical communication line through which the network 30 is communicated, a logically separate line from the network 30 is provided. Display data can be transmitted and received through the logical line.
- multimedia data in a format other than the text format such as moving image data and audio data is transmitted from the user terminal device 202 to the display device 10 via the dedicated data line 40 different from the network 30.
- the display device 10 can associate the multimedia data received from the data line 40 specified by the stream ID with the position information by the data ID, and further display the multimedia at the display position of the display unit 11 indicated by the position information. Data can be displayed. Therefore, the display device 10 can structure and display the multimedia data received via the dedicated data line 40 on the display screen 111 of the display unit 11.
- the html fragment information for speech (first information) transmitted from the moderator terminal device 201 to the display device 10 via the network 30 is for each user who uses the plurality of information terminal devices 20.
- access right information indicating whether or not to allow generation and change of display data
- user information indicating a user who is the owner of the display data. Therefore, the display device 10 can establish a direct data line 40 through which display data is transmitted between the user terminal device 202 used by the user indicated by the access right information or the user information and the display device 10. Therefore, it is not necessary to create a mesh communication path network in order to share information between the display device 10 and each information terminal device 20, and a user terminal that transmits display data to the display device 10 as necessary.
- the display device 10 can associate the display data received from the data line 40 with the position information by the data ID, and can display the display data at the display position of the display unit 11 indicated by the position information.
- the moderator terminal device 201 can indicate to the display device 10 the user terminal device 202 that should open the data line 40 by the access right information or user information transmitted to the display device 10, the display device 10 and the user The establishment of the data line 40 with the terminal device 202 can be controlled.
- the moderator terminal device 201 is set for each user who uses the data ID, the position information, and the plurality of information terminal devices 20, and determines whether or not to allow generation and change of display data.
- Utterance html fragment information (first information) having the access right information indicating the user and the user information indicating the user who is the owner of the display data is transmitted to the display device 10 via the network 30, and the display device 10 can display the display data on the display unit 11 based on the stream ID, the data ID, the position information, the user information, and the access right information.
- the display device 10 can associate the display data received from the data line 40 identified by the stream ID with the user information, access right information, and position information received from the moderator terminal device 201 by the data ID. Based on the user information and the access right information, it is determined whether or not to display the display data identified by the data ID, and the display data is displayed at the display position of the display unit 11 indicated by the position information. it can. Therefore, the display data transferred from the user terminal device 202 is managed by the data ID, and the access right (that is, set for each of a plurality of users using the information terminal device 20) (that is, the display data). Each display data displayed on the display unit 11 of the display device 10 is controlled according to whether or not the generation or change of the display data is permitted. Therefore, smooth communication according to each access right between a plurality of users is possible.
- the display device 10 matches the stream ID, the data ID, and the position. Display data can be displayed on the display unit 11 based on the information. Accordingly, the display device 10 has a user who is the owner of the display data identified by the data ID, and a user who has an access right to the display data (that is, whether or not the generation or change of the display data is permitted). The display data can be displayed on the display unit 11 only when and match. That is, the display device 10 specifies the display data received from the data line 40 specified by the stream ID by the data ID, and displays the specified display data at the display position on the display unit 11 indicated by the position information. Therefore, smooth communication according to each access right between a plurality of users is possible.
- a communication method in an electronic conference in which a plurality of users participate can be used. Therefore, each utterance (display data) presented in the virtual conference room (that is, the electronic conference system 1) can be reliably and easily managed by the data ID, and a plurality of participants participating in the virtual conference room. Remarks (display data) presented in the virtual conference room according to the access rights set for each participant (user) (that is, whether presentation or modification of the remarks (display data) is permitted) Therefore, a plurality of users participating in the virtual conference room can perform smooth communication according to their access rights.
- the display device 10 and the plurality of information terminal devices 20 can perform communication based on XMPP. Therefore, real-time messaging (information exchange) can be performed between the display device 10 and the plurality of information terminal devices 20 (the moderator terminal device 201 and the user terminal device 202), and messaging is performed by XMPP using the data ID. And the display data displayed on the display unit 11 of the display device 10 can be easily and reliably associated with each other.
- the establishment of the data line 40 between the display device 10 and the user terminal device 202 and the transmission of multimedia data from the user terminal device 202 to the display device 10 via the data line 40 are performed.
- XMPP XEP-0166 Joint
- XEP-0167 Joint RTP Sessions
- XEP-0177 Joint Raw UDP Transport
- the html fragment information for speech can be an html file in which meta information is extended.
- the html file with the expanded meta information is data in a format that can be expressed in html that is compatible with XMPP-compliant communication, and is a data communication established between the display device 10 and the user terminal device 202. It includes meta information that is information (attribute information) related to display data transferred through a route.
- the meta information includes attribute information corresponding to messaging by XMPP such as data ID, position information, stream ID, access right information, and user information.
- attribute information for example, data ID, location information, stream ID, access right information, user information, etc.
- extension for example, data ID, location information, stream ID, access right information, user information, etc.
- each piece of meta information for example, data ID, position information, stream ID, user information, access right information
- the html fragment information for speech first information and second information
- each meta information data ID, position information, stream ID, user information, access right information, etc.
- the display element of html can be associated. Therefore, messaging by XMPP can be linked to Web and html.
- the speech html fragment information (second information) transmitted to the terminal device 202 is fragment information constituting structured display information (display information) for display on the display unit 11 of the display device 10. can do. Therefore, for example, a plurality of information terminal devices 20 (moderator terminal device 201, user terminal device 202) try to change some information included in structured display information for displaying on the display unit 11 of the display device 10. Then, if only the fragment information having the changed information is transmitted, the display device 10 can correct the structured display information for display on the display unit 11 based on the received fragment information.
- the data line 40 (data communication path) different from the network 30 transmits multimedia data in a format other than the text format such as moving image data and audio data. You can also send the data.
- the html drawing mechanism is used for the structured display information (display information).
- DOM Document Object Model
- DOM is a standardized API (Application Program Interface) for html and XML (eXtensible Markup Language).
- the display device 10 and the plurality of information terminal devices 20 are configured to perform communication conforming to XMPP, but the present invention is not limited to this. Communication conforming to a protocol (communication protocol) similar to XMPP may be performed.
- the establishment of the data line 40 for transferring display data (multimedia data) and the transmission of display data (multimedia data) are performed by Jingle (XEP-0166), which is an XMPP protocol, or Jingle. -Although it shall comply with at least one of the rules of RTP (XEP-0167) and Jingle-UDP (XEP-0177), it is not limited to this. Any communication protocol for establishing a communication path for transmitting and receiving data between two communicable terminal devices can be used.
- each display device 10 there are a plurality of display devices 10 that perform display based on the structured display information, and each may be located at a remote place. In this case, each display device only needs to share the same structured display information.
- each display device 10 can share structured display information in accordance with XEP-0060 (Publish-Subscribe), which is an XMPP application protocol (communication protocol).
- XEP-0060 publish-Subscribe
- XMPP application protocol communication protocol
- the present invention provides a chat system in which a plurality of people who can freely write / read and view information in a community such as home, workplace, school, etc. can talk in real time, or a virtual conference between a plurality of users. It can be used for an electronic conference system where discussions and opinions can be presented in the room.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
<装置構成>
<電子会議システムの動作>
10 表示装置
11 表示部
111 表示画面
12 通信部
13 記憶部
14 制御部
20 情報端末装置
201 司会者端末装置
202、202a、202b、202c、202d ユーザ端末装置
21 端末表示部(表示部)
22 端末通信部(通信部)
23 端末記憶部(記憶部)
24 端末制御部(制御部)
25 端末入力部(入力部)
30、30a、30b、30c、30d、30e ネットワーク
40、40a、40b、40c、40d、40e データ回線(データ通信経路)
Claims (41)
- 複数のユーザが参加し、前記複数のユーザが使用する各情報端末装置から表示装置に送信される表示データが前記表示装置の表示部にて表示される通信方法において、
前記情報端末装置は、前記表示データを前記表示装置に送信するユーザ端末装置と、前記表示データを管理する司会者端末装置と、を有し、
前記司会者端末装置は、前記表示データを識別するためのデータID情報と、前記表示部での前記表示データの表示位置を示す位置情報と、を有する第1の情報を、ネットワークを介して前記表示装置に送信し、
前記表示装置と前記ユーザ端末装置との間に、前記表示データが送信されるデータ通信経路が開設され、
前記表示装置は、前記データ通信経路を識別するための通信経路識別情報と、前記データID情報とを有する第2の情報を、前記ネットワークを介して前記ユーザ端末装置に送信し、
前記ユーザ端末装置は、前記表示データを、前記通信経路識別情報によって特定される前記データ通信経路を介して前記表示装置に送信し、
前記表示装置は、前記通信経路識別情報と前記データID情報と前記位置情報とに基づいて、前記表示データを前記表示部に表示することを特徴とする通信方法。 - 前記データ通信経路は、前記表示データが送信される論理的な通信経路であることを特徴とする請求項1に記載の通信方法。
- 前記表示データは、テキスト形式以外の形式のマルチメディアデータであることを特徴とする請求項1又は請求項2に記載の通信方法。
- 前記司会者端末装置は、前記データID情報と、前記位置情報と、前記複数の情報端末装置を使用するユーザ毎に設定され、前記表示データの生成と変更とを許可する否かを示すアクセス権情報とを有する前記第1の情報を、前記ネットワークを介して前記表示装置に送信し、
前記表示装置と、前記アクセス権情報が示すユーザが使用するユーザ端末装置との間に、前記表示データが送信される前記データ通信経路が開設されることを特徴とする請求項1又は請求項2に記載の通信方法。 - 前記司会者端末装置は、前記データID情報と、前記位置情報と、前記表示データの所有者であるユーザを示すユーザ情報と、を有する前記第1の情報を、前記ネットワークを介して前記表示装置に送信し、
前記表示装置と、前記ユーザ情報が示すユーザが使用するユーザ端末装置との間に、前記表示データが送信される前記データ通信経路が開設されることを特徴とする請求項1又は請求項2に記載の通信方法。 - 前記司会者端末装置は、前記データID情報と、前記位置情報と、前記複数の情報端末装置を使用するユーザ毎に設定され、前記表示データの生成と変更とを許可する否かを示すアクセス権情報と、前記表示データの所有者であるユーザを示すユーザ情報と、を有する前記第1の情報を、前記ネットワークを介して前記表示装置に送信し、
前記表示装置は、前記通信経路識別情報と前記データID情報と前記位置情報と前記ユーザ情報と前記アクセス権情報とに基づいて、前記表示データを前記表示部に表示することを特徴とする請求項1又は請求項2に記載の通信方法。 - 前記表示装置は、
前記アクセス権情報が示す前記表示データの生成と変更とが許可されたユーザと、前記ユーザ情報が示すユーザとが一致するとき、
前記通信経路識別情報と前記データID情報と前記位置情報とに基づいて、前記表示データを前記表示部に表示することを特徴とする請求項6に記載の通信方法。 - 前記複数のユーザが参加する電子会議での通信方法であることを特徴とする請求項1又は請求項2に記載の通信方法。
- 前記表示装置と前記情報端末装置とが、XMPPに準拠した通信を行うことを特徴とする請求項1又は請求項2に記載の通信方法。
- 前記表示装置と前記ユーザ端末装置との間の前記データ通信経路の開設、及び、前記ユーザ端末装置から前記表示装置への前記データ通信経路を介した前記表示データの送信は、XMPPのXEP-0166(Jingle)、XEP-0167(Jingle RTP Sessions)、XEP-0177(Jingle Raw UDP Transport)のうちの少なくともいずれかの規約に準じて行われることを特徴とする請求項9に記載の通信方法。
- 前記第1の情報、及び前記第2の情報は、メタ情報を拡張したhtmlファイルであることを特徴とする請求項9に記載の通信方法。
- 前記第1の情報、及び前記第2の情報は、前記表示装置の前記表示部に表示を行うための表示情報を構成する断片情報であることを特徴とする請求項1又は請求項2に記載の通信方法。
- 表示データを表示する表示部と、
前記表示データを管理する司会者端末装置及び前記表示データを送信するユーザ端末装置を有する複数の情報端末装置とネットワークを介して通信を行う通信部と、
前記通信部が、前記司会者端末装置から前記ネットワークを介して、前記表示データを識別するためのデータID情報と、前記表示部での前記表示データの表示位置を示す位置情報と、を有する第1の情報を受信すると、前記ユーザ端末装置との間に、前記表示データが送信されるデータ通信経路を開設する制御部と、
を備え、
前記通信部は、前記データ通信経路を識別するための通信経路識別情報と、前記データID情報と、を有する第2の情報を、前記ネットワークを介して前記ユーザ端末装置に送信し、
前記表示部は、前記通信経路識別情報と前記データID情報と前記位置情報とに基づいて、前記ユーザ端末装置から前記通信経路識別情報によって特定される前記データ通信経路を介して前記通信部が受信する前記表示データを表示することを特徴とする表示装置。 - 前記データ通信経路は、前記ユーザ端末装置から前記表示データが送信される論理的な通信経路であることを特徴とする請求項13に記載の表示装置。
- 前記表示データは、テキスト形式以外の形式のマルチメディアデータであることを特徴とする請求項13又は請求項14に記載の表示装置。
- 前記通信部が、前記司会者端末装置から、前記データID情報と、前記位置情報と、前記複数の情報端末装置を使用するユーザ毎に設定され、前記表示データの生成と変更とを許可する否かを示すアクセス権情報と、を有する前記第1の情報を、前記ネットワークを介して受信すると、
前記制御部は、前記アクセス権情報が示すユーザが使用するユーザ端末装置との間に、前記表示データが送信される前記データ通信経路を開設することを特徴とする請求項13又は請求項14に記載の表示装置。 - 前記通信部が、前記司会者端末装置から、前記データID情報と、前記位置情報と、前記表示データの所有者であるユーザを示すユーザ情報と、を有する前記第1の情報を、前記ネットワークを介して受信すると、
前記制御部は、前記ユーザ権情報が示すユーザが使用するユーザ端末装置との間に、前記表示データが送信される前記データ通信経路を開設することを特徴とする請求項13又は請求項14に記載の表示装置。 - 前記通信部は、前記司会者端末装置から前記ネットワークを介して、前記データID情報と、前記位置情報と、前記複数の情報端末装置を使用するユーザ毎に設定され、前記表示データの生成と変更とを許可する否かを示すアクセス権情報と、前記表示データの所有者であるユーザを示すユーザ情報と、を有する前記第1の情報を受信し、
前記表示部は、前記通信経路識別情報と前記データID情報と前記位置情報と前記ユーザ情報と前記アクセス権情報とに基づいて、前記表示データを表示することを特徴とする請求項13又は請求項14に記載の表示装置。 - 前記表示部は、
前記アクセス権情報が示す前記表示データの生成と変更とが許可されたユーザと、前記ユーザ情報が示すユーザとが一致するとき、
前記通信経路識別情報と前記データID情報と前記位置情報とに基づいて、前記表示データを表示することを特徴とする請求項18に記載の表示装置。 - 前記複数の情報端末装置と、XMPPに準拠した通信を行うことを特徴とする請求項13又は請求項14に記載の表示装置。
- XMPPのXEP-0166(Jingle)、XEP-0167(Jingle RTP Sessions)、XEP-0177(Jingle Raw UDP Transport)のうちの少なくともいずれかの規約に準じて、
前記制御部は、前記ユーザ端末装置との間に前記データ通信経路を開設し、
前記通信部は、前記ユーザ端末装置から前記データ通信経路を介して、前記表示データを受信することを特徴とする請求項20に記載の表示装置。 - 前記第1の情報、及び前記第2の情報は、メタ情報を拡張したhtmlファイルであることを特徴とする請求項20に記載の表示装置。
- 前記第1の情報、及び前記第2の情報は、前記表示部に表示を行うための表示情報を構成する断片情報であることを特徴とする請求項13又は請求項14に記載の表示装置。
- 表示装置に表示する表示データを送信するデータ通信経路を、前記表示装置との間に開設する制御部と、
前記表示装置からネットワークを介して、前記表示データを識別するためのデータID情報と、前記データ通信経路を識別するための通信経路識別情報とを有する第2の情報を受信すると、前記データ通信経路を介して、前記表示データを前記表示装置に送信する通信部と、
を備えることを特徴とするユーザ端末装置。 - 前記データ通信経路は、前記表示装置に表示する前記表示データを送信する論理的な通信経路であることを特徴とする請求項24に記載のユーザ端末装置。
- 前記表示データは、テキスト形式以外の形式のマルチメディアデータであることを特徴とする請求項24又は請求項25に記載のユーザ端末装置。
- 前記表示装置と、XMPPに準拠した通信を行うことを特徴とする請求項24又は請求項25に記載のユーザ端末装置。
- XMPPのXEP-0166(Jingle)、XEP-0167(Jingle RTP Sessions)、XEP-0177(Jingle Raw UDP Transport)のうちの少なくともいずれかの規約に準じて、
前記制御部は、前記表示装置との間に、前記通信経路識別情報によって特定される前記データ通信経路を開設し、
前記通信部は、前記データ通信経路を介して、前記表示データを前記表示装置に送信することを特徴とする請求項27に記載のユーザ端末装置。 - 前記第2の情報は、メタ情報を拡張したhtmlファイルであることを特徴とする請求項27に記載のユーザ端末装置。
- 前記第2の情報は、前記表示装置に表示を行うための表示情報を構成する断片情報であることを特徴とする請求項24又は請求項25に記載のユーザ端末装置。
- 請求項24又は請求項25に記載のユーザ端末装置から請求項13又は請求項14に記載の表示装置に送信される表示データを管理する司会者端末装置において、
前記表示データを識別するためのデータID情報と、前記表示装置の表示部での前記表示データの表示位置を示す位置情報と、を生成する制御部と、
前記表示装置にネットワークを介して、前記データID情報と前記位置情報とを有する第1の情報を送信する通信部と、
を備えることを特徴とする司会者端末装置。 - 前記制御部は、前記表示装置と通信する複数の情報端末装置を使用するユーザ毎に設定され、前記表示データの生成と変更とを許可する否かを示すアクセス権情報を生成し、
前記第1の情報は、さらに、前記アクセス権情報を有することを特徴とする請求項31に記載の司会者端末装置。 - 前記制御部は、前記表示データの所有者であるユーザを示すユーザ情報を生成し、
前記第1の情報は、さらに、前記ユーザ情報を有することを特徴とする請求項31に記載の司会者端末装置。 - 前記表示装置と、XMPPに準拠した通信を行うことを特徴とする請求項31に記載の司会者端末装置。
- 前記第1の情報は、メタ情報を拡張したhtmlファイルであることを特徴とする請求項34に記載の司会者端末装置。
- 前記第1の情報は、前記表示装置の前記表示部に表示を行うための表示情報を構成する断片情報であることを特徴とする請求項31に記載の司会者端末装置。
- 複数のユーザが参加し、前記複数のユーザが使用する各情報端末装置から請求項13又は請求項14に記載の表示装置に送信される表示データが、前記表示装置にて表示されるマルチユーザ通信システムであって、
前記情報端末装置は、請求項24又は請求項25に記載のユーザ端末装置と、請求項31に記載の司会者端末装置とを有することを特徴とするマルチユーザ通信システム。 - 前記表示データは、テキスト形式以外の形式のマルチメディアデータであることを特徴とする請求項37に記載のマルチユーザ通信システム。
- 電子会議システムであることを特徴とする請求項37に記載のマルチユーザ通信システム。
- 前記表示装置と前記情報端末装置とが、XMPPに準拠した通信を行うことを特徴とする請求項37に記載のマルチユーザ通信システム。
- XMPPのXEP-0166(Jingle)、XEP-0167(Jingle RTP Sessions)、XEP-0177(Jingle Raw UDP Transport)のうちの少なくともいずれかの規約に準じて、
前記表示装置と前記ユーザ端末装置との間に、前記表示データが送信されるデータ通信経路が開設されるとともに、
前記ユーザ端末装置から前記データ通信経路を介して前記表示装置に、前記表示データが送信されることを特徴とする請求項40に記載のマルチユーザ通信システム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020137005672A KR20130106357A (ko) | 2010-09-06 | 2010-09-06 | 멀티 유저 통신을 위한 시스템, 방법 및 장치 |
EP10856942.7A EP2615557A4 (en) | 2010-09-06 | 2010-09-06 | SYSTEM, METHOD AND DEVICE FOR MULTI-USER COMMUNICATION |
CN201080068965.4A CN103080914B (zh) | 2010-09-06 | 2010-09-06 | 用于多用户通信的系统、方法及装置 |
US13/001,540 US8630395B2 (en) | 2010-09-06 | 2010-09-06 | System, method and device for multiuser communication |
PCT/JP2010/065230 WO2012032592A1 (ja) | 2010-09-06 | 2010-09-06 | マルチユーザ通信のためのシステム、方法及び装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2010/065230 WO2012032592A1 (ja) | 2010-09-06 | 2010-09-06 | マルチユーザ通信のためのシステム、方法及び装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012032592A1 true WO2012032592A1 (ja) | 2012-03-15 |
Family
ID=45810218
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/065230 WO2012032592A1 (ja) | 2010-09-06 | 2010-09-06 | マルチユーザ通信のためのシステム、方法及び装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US8630395B2 (ja) |
EP (1) | EP2615557A4 (ja) |
KR (1) | KR20130106357A (ja) |
CN (1) | CN103080914B (ja) |
WO (1) | WO2012032592A1 (ja) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7948448B2 (en) * | 2004-04-01 | 2011-05-24 | Polyvision Corporation | Portable presentation system and methods for use therewith |
US8954591B2 (en) * | 2011-03-07 | 2015-02-10 | Cisco Technology, Inc. | Resource negotiation for cloud services using a messaging and presence protocol |
CN104937586B (zh) * | 2012-11-12 | 2019-11-01 | 伊诺卡姆公司 | 自动化的移动系统 |
US20150067129A1 (en) * | 2013-08-29 | 2015-03-05 | Yuuichiroh Hayashi | Apparatus, system, and method of managing device, and recording medium storing device management program |
JP2015132946A (ja) * | 2014-01-10 | 2015-07-23 | シャープ株式会社 | 表示システム |
JP6361728B2 (ja) * | 2014-02-28 | 2018-07-25 | 株式会社リコー | 伝送制御システム、伝送システム、伝送制御方法、及び記録媒体 |
JP2016045291A (ja) * | 2014-08-21 | 2016-04-04 | 株式会社リコー | 画像表示システム、端末、画像表示装置及びプログラム |
JP6312866B2 (ja) * | 2015-01-23 | 2018-04-18 | マクセル株式会社 | 表示装置および表示方法 |
JP6458581B2 (ja) * | 2015-03-20 | 2019-01-30 | 株式会社リコー | 情報処理システム、表示位置決定方法、端末装置、情報処理装置及びプログラム |
US10264213B1 (en) | 2016-12-15 | 2019-04-16 | Steelcase Inc. | Content amplification system and method |
CN107368311B (zh) * | 2017-07-10 | 2021-07-23 | 武汉斗鱼网络科技有限公司 | 一种多Fragment之间的通信方法及系统 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH104406A (ja) * | 1996-06-14 | 1998-01-06 | Canon Inc | 通信端末装置 |
JP2000194875A (ja) | 1998-12-25 | 2000-07-14 | Nec Corp | 情報提示装置及び情報提示プログラムを記録したコンピュ―タ読み取り可能な記録媒体 |
JP2005222535A (ja) | 2004-01-15 | 2005-08-18 | Microsoft Corp | 複数の入力モダリティを使用して複数ユーザからの入力を与えられる共有ディスプレイを制御するシステムとプロセス |
JP2007104354A (ja) * | 2005-10-05 | 2007-04-19 | Aruze Corp | テレビ会議システム、テレビ会議方法及びテレビ会議端末装置 |
JP2007281552A (ja) * | 2006-04-03 | 2007-10-25 | Murata Mach Ltd | 通信装置 |
JP2008152625A (ja) * | 2006-12-19 | 2008-07-03 | Necディスプレイソリューションズ株式会社 | 画像表示装置、画像データ処理システムおよび画像データ処理方法 |
JP2009212657A (ja) * | 2008-03-03 | 2009-09-17 | Brother Ind Ltd | サーバ装置及びそれを備えたプロジェクタ及び表示システム |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060080407A1 (en) * | 2004-10-12 | 2006-04-13 | Motorola, Inc. | Multimedia session establishment in a user entity having audio floor control |
US20070016680A1 (en) * | 2005-06-30 | 2007-01-18 | Burd Gary S | Method and system for proxy-based file sharing |
FR2896648A1 (fr) * | 2006-01-23 | 2007-07-27 | France Telecom | Procede et systeme de conversation multimedia |
KR101517592B1 (ko) * | 2008-11-11 | 2015-05-04 | 삼성전자 주식회사 | 고분해능을 가진 화면음원 위치장치 및 재생방법 |
-
2010
- 2010-09-06 WO PCT/JP2010/065230 patent/WO2012032592A1/ja active Application Filing
- 2010-09-06 CN CN201080068965.4A patent/CN103080914B/zh not_active Expired - Fee Related
- 2010-09-06 US US13/001,540 patent/US8630395B2/en not_active Expired - Fee Related
- 2010-09-06 KR KR1020137005672A patent/KR20130106357A/ko not_active Application Discontinuation
- 2010-09-06 EP EP10856942.7A patent/EP2615557A4/en not_active Withdrawn
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH104406A (ja) * | 1996-06-14 | 1998-01-06 | Canon Inc | 通信端末装置 |
JP2000194875A (ja) | 1998-12-25 | 2000-07-14 | Nec Corp | 情報提示装置及び情報提示プログラムを記録したコンピュ―タ読み取り可能な記録媒体 |
JP2005222535A (ja) | 2004-01-15 | 2005-08-18 | Microsoft Corp | 複数の入力モダリティを使用して複数ユーザからの入力を与えられる共有ディスプレイを制御するシステムとプロセス |
JP2007104354A (ja) * | 2005-10-05 | 2007-04-19 | Aruze Corp | テレビ会議システム、テレビ会議方法及びテレビ会議端末装置 |
JP2007281552A (ja) * | 2006-04-03 | 2007-10-25 | Murata Mach Ltd | 通信装置 |
JP2008152625A (ja) * | 2006-12-19 | 2008-07-03 | Necディスプレイソリューションズ株式会社 | 画像表示装置、画像データ処理システムおよび画像データ処理方法 |
JP2009212657A (ja) * | 2008-03-03 | 2009-09-17 | Brother Ind Ltd | サーバ装置及びそれを備えたプロジェクタ及び表示システム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2615557A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP2615557A4 (en) | 2014-05-14 |
KR20130106357A (ko) | 2013-09-27 |
EP2615557A1 (en) | 2013-07-17 |
CN103080914B (zh) | 2015-11-25 |
US20120147126A1 (en) | 2012-06-14 |
CN103080914A (zh) | 2013-05-01 |
US8630395B2 (en) | 2014-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2012032592A1 (ja) | マルチユーザ通信のためのシステム、方法及び装置 | |
US11785056B2 (en) | Web browser interface for spatial communication environments | |
US11418440B2 (en) | Routing virtual area based communications | |
JP5149328B2 (ja) | 通信方法、マスター表示装置、スレーブ表示装置、及びそれらを備えた通信システム | |
US9813463B2 (en) | Phoning into virtual communication environments | |
Jang-Jaccard et al. | WebRTC-based video conferencing service for telehealth | |
US8982173B1 (en) | Methods, systems and program products for efficient communication of data between conference servers | |
US20130132058A1 (en) | Creating and managing virtual areas | |
US9210200B1 (en) | Methods, systems and program products for connecting users to operating nodes | |
CN112769582A (zh) | 用于会议的电子工具和方法 | |
JP4957830B2 (ja) | 通信方法、表示装置、司会者端末装置、ユーザ端末装置、及びそれらを備えたマルチユーザ通信システム | |
US11876707B2 (en) | Routing virtual area based communications | |
KR20170111609A (ko) | 영상서비스 제공시스템 및 영상서비스 제공방법 | |
US9628518B1 (en) | Linking a collaboration session with an independent telepresence or telephony session | |
Kasetwar et al. | A WebRTC based video conferencing system with screen sharing | |
JP5382191B2 (ja) | 通信方法、マスター表示装置、スレーブ表示装置、及びそれらを備えた通信システム | |
CN102017620A (zh) | 安排好的事件之前的通信 | |
US20230339816A1 (en) | Visual Communications | |
Presta et al. | Setting up CLUE telepresence sessions via the WebRTC data channel | |
Ilag et al. | Troubleshooting Microsoft Teams Call Quality Issues | |
Siltanen et al. | Gaze-aware video conferencing application for multiparty collaboration | |
Middlemiss et al. | Report of Otago Contributions to Telecom LifeLink Project | |
Smith et al. | Towards a standards-based, message-oriented advanced collaboration system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080068965.4 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13001540 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10856942 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20137005672 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010856942 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: JP |