JP6528603B2 - program - Google Patents

Description

  The present invention relates to a program.

  2. Description of the Related Art In recent years, in conferences, so-called electronic conference systems are used in which PCs, tablet terminals and the like are mutually connected via a network to share electronic data such as materials. In the electronic conference system, a terminal device used by a presenter (hereinafter referred to as a presenter terminal) and a terminal device used by a participant other than the presenter (hereinafter referred to as a participant terminal) are synchronized. Thus, the display content (display page of material, etc.) of the display screen of the presenter terminal is displayed in synchronization with the display screen of the participant terminal.

  For example, Patent Document 1 discloses a teleconference system in which a user can switch between synchronous and asynchronous on a terminal device. Specifically, when the user presses the synchronization button displayed on the screen of the terminal device, the display state of the other terminal device is synchronized and displayed in synchronization, and the user displays the screen on the terminal device. When the asynchronous button displayed on the screen is pressed, the asynchronous state is established, and the contents different from the display contents of other terminal devices can be displayed.

  For example, according to Patent Document 2, the presenter is the facilitator of the conference, and the document is displayed on the display screen of another participant terminal or the page of the material being displayed is switched according to the operation content by the presenter. There is disclosed an electronic conference system capable of proceeding with a conference. Further, for example, in Patent Document 2, synchronization of material and voice at a plurality of terminals by transmitting the material data referred to by the presenter and the voice data of the presenter to other participant terminals simultaneously A teleconferencing system that can be realized is disclosed.

Unexamined-Japanese-Patent No. 2010-33229 Japanese Patent Laid-Open No. 2002-009765

  The present invention is asynchronous with the second terminal device in the first terminal device capable of displaying in synchronization with the second terminal device, as compared with the case where the voice is transmitted to the terminal device performing the asynchronous display with another terminal device. It is an object of the present invention to suppress communication traffic required for voice transmission from the second terminal device to the first terminal device when displaying the image.

  The program according to claim 1 of the present invention is to display at least a part of the display content of the second terminal device in a synchronized state on at least a part of the display screen of the first terminal device in a plurality of terminal devices. A first operation acquiring unit for acquiring a first operation content indicating contents operated by a first user in the first terminal device; and the first operation content is transmitted to the second terminal device. The operation content for changing the display content displayed on the first terminal device in synchronization with each other, and in the case where the operation content is a predetermined operation content, the display content displayed on the first terminal device is 1 Display control means for changing the display content according to the operation content, restricting transmission of voice from the second terminal device to the first terminal device when the display content is changed according to the first operation content Restriction means, And characterized by causing a computer to function with.

  According to the configuration of claim 1 of the present invention, the first terminal device capable of displaying in synchronization with the second terminal device as compared to the case where the voice is transmitted to the terminal device performing display asynchronously with another terminal device In the above, when performing display asynchronous with the second terminal device, it is possible to suppress communication traffic required for voice transmission from the second terminal device to the first terminal device.

FIG. 1 is an entire configuration diagram of an electronic conference system according to a first embodiment. It is a block diagram which shows the hardware constitutions of a terminal device and a server. It is a functional block diagram which shows the concrete structure of a teleconference system. It is a functional block diagram which shows the concrete structure of a teleconference system. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system. FIG. 7 is a functional block diagram showing a specific configuration of a server according to a first modification of the first embodiment. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of a receiving terminal list. FIG. 7 is a diagram showing an example of a network configuration showing a communication path according to a first modification of the first embodiment. It is a figure which shows an example of the network configuration of a teleconference system. FIG. 7 is an entire configuration diagram of an electronic conference system according to a second embodiment. It is a block diagram which shows the hardware constitutions of an operating terminal. It is a functional block diagram which shows the specific structure of the terminal for participants. It is a figure which shows an example of the network configuration of a teleconference system. The example of the display content displayed on the display screen of the terminal for presenters is shown. It is a figure which shows an example of an operation classification table. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system. FIG. 18 is a functional block diagram showing a specific configuration of a participant terminal in the electronic conference system according to the fifth modification of the second embodiment. It is a figure which shows an example of an operation classification table. It is a figure which shows an example of an operation classification table. FIG. 18 is an operation flowchart of the electronic conference system according to the fifth modification of the second embodiment. FIG. 18 is a functional block diagram showing a specific configuration of an electronic conference system according to a modified example 8 of the second embodiment. FIG. 18 is a functional block diagram showing a specific configuration of an electronic conference system according to a modified example 8 of the second embodiment. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of the network configuration of a teleconference system. It is a whole block diagram of the electronic conference system which concerns on Embodiment 3-1. It is a block diagram which shows the hardware constitutions of the server which concerns on Embodiment 3-1. It is a functional block diagram showing a concrete composition of a server concerning Embodiment 3-1. It is a figure which shows an example of the network configuration of the electronic conference system which concerns on Embodiment 3-1. It is a table showing an example of a terminal list. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is a figure which shows an example of the display content displayed on the display screen of the terminal for presenters. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is an operation | movement flowchart of a teleconference system. It is a block diagram which shows the hardware constitutions of the terminal which concerns on Embodiment 3-2, and a server. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on Embodiment 3-2. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. FIG. 16 is a functional block diagram showing a specific configuration of a server according to a first modification of the third embodiment. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of a receiving terminal list. FIG. 18 is a diagram showing an example of a network configuration showing a communication path according to a first modification of the third embodiment. It is a figure which shows an example of the network configuration of a teleconference system. FIG. 10 is an entire configuration diagram of an electronic conference system according to a fourth embodiment. It is a block diagram which shows the hardware constitutions of a teleconference system. It is a functional block diagram which shows the specific structure of a terminal management server and a file management server. It is a figure which shows an example of the display content displayed on the display screen of the terminal for presenters. It is a functional block diagram showing the concrete composition of a terminal. It is a functional block diagram showing the concrete composition of a terminal. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is a figure which shows an example of the network configuration which shows a communication path. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system. It is a table which shows an example of access restriction information. It is an operation | movement flowchart of the access control process in a teleconference system. It is an operation | movement flowchart of the access control process in a teleconference system. It is a figure which shows an example of the updated receiving terminal list. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of the network configuration of a teleconference system. FIG. 18 is an operation flowchart of access control processing in the electronic conference system according to the fifth modification of the fourth embodiment. FIG. 18 is an operation flowchart of access control processing in the electronic conference system according to the fifth modification of the fourth embodiment. FIG. 21 is a functional block diagram showing a specific configuration of a terminal management server according to a sixth modification of the fourth embodiment. It is a figure which shows an example of the network configuration of a teleconference system. It is a figure which shows an example of a receiving terminal list. FIG. 17 is a diagram showing an example of a network configuration showing a communication path according to a sixth modification of the fourth embodiment. It is a figure which shows an example of the network configuration of a teleconference system. FIG. 18 is an entire configuration diagram of an electronic conference system according to a fifth embodiment. It is a block diagram which shows the hardware constitutions of an operating terminal. It is a functional block diagram which shows the specific structure of the terminal for participants. It is a figure which shows an example of the network configuration of a teleconference system. The example of the display content displayed on the display screen of the terminal for presenters is shown. It is a figure which shows an example of an operation classification table. It is an operation | movement flowchart of a teleconference system. It is an operation | movement flowchart of a teleconference system.

Hereinafter, some embodiments of the present invention will be described. Of the embodiments described below, two or more may be used in combination.
1-1. Embodiment 1
In the first embodiment of the present invention, an information processing apparatus, an information processing system, a program, and a recording medium capable of realizing high-quality data communication between terminal devices even when the number of terminal devices connected via a network increases. Intended to provide. In the first embodiment, as an example of the information processing system, an electronic conference system in which audio data is transmitted and received between a plurality of terminal devices connected via a network will be described as an example. The meaning of the terms in the first embodiment is limited to the scope of the first embodiment.

  FIG. 1 is an entire configuration diagram of the electronic conference system according to the first embodiment. The electronic conference system 1100 (information processing system) includes a plurality of terminal devices 110 used by a plurality of users attending a conference, and a server 120 performing information communication with each terminal device 110. In FIG. 1, six terminal devices 110 a to 110 f and one server 120 connected to the terminal devices 110 a to 110 f via the communication network 130 are illustrated. Note that the number of terminal devices 110 that configure the electronic conference system 1100 is not limited. Below, when demonstrating the structure which is common in each terminal device, it describes collectively as the terminal device 110. FIG.

  As shown in FIG. 1, each terminal device 110 and the server 120 are mutually connected via a communication network 130 such as a LAN (Local Area Network) or the Internet. In addition, in FIG. 1 and other drawings described later, dotted lines indicate a state of being connected to a network. Control information and the like between the respective terminal devices are transmitted and received between the respective terminal devices via the communication network 130.

  FIG. 2 is a block diagram showing the hardware configuration of the terminal device 110 and the server 120. As shown in FIG. The terminal device 110 is configured by a computer including a CPU 1101, a memory 1102, a storage unit 1103, a communication unit 1104, an operation unit 1105, a display unit 1106, an audio input unit 1107, and an audio output unit 1108. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 1101 controls each unit of the terminal device 110 and executes various information processing. The memory 1102 holds various programs and data. In the memory 1102, a work area of the CPU 1101 is also secured. A storage unit 1103 stores data such as various files and documents. The communication unit 1104 performs data communication with the server 120 and other terminal devices 110 via the communication network 130. The operation unit 1105 is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. A display unit 1106 is a display screen that displays various files, documents, and the like via application software such as a web browser. Further, the display unit 1106 displays an operation screen for receiving a user's operation in the electronic conference. The voice input unit 1107 is a microphone into which the voice of the user who spoke in the electronic conference is input. The voice output unit 1108 is a speaker that outputs voice data received from another terminal device 110 as voice in an electronic conference. The storage unit 1103, the operation unit 1105, the display unit 1106, the voice input unit 1107, and the voice output unit 1108 may be provided outside the terminal device 110 and may be connected to the terminal device 110 via the communication network 130. . Furthermore, the terminal device 110 incorporates software such as a browser and an electronic mail client. The terminal device 110 is, for example, a personal computer, a personal digital assistant (PDA), a portable information terminal such as a smartphone, or the like.

  The server 120 is configured by a computer including a CPU 1201, a memory 1202, a storage unit 1203, and a communication unit 1204. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 1201 controls each unit of the server 120 and executes various information processing. The memory 1202 holds various programs and data. In the memory 1202, a work area of the CPU 1201 is also secured. The storage unit 1203 stores data such as various files and documents. The communication unit 1204 performs data communication with each of the terminal devices 110 via the communication network 130.

  Here, each terminal device 110 may have both of a transmission function for transmitting voice data uttered by the user and a reception function for receiving the voice data, or each terminal apparatus 110 has only one of the functions. May be The function of each terminal device 110 can be determined based on the instruction of the user who uses each terminal device 110, the form of the electronic conference, and the like.

  3 and 4 are functional block diagrams showing a specific configuration of the teleconference system 1100. As shown in FIG. For convenience of explanation, the terminal device 110a shown in FIG. 3 shows a functional block corresponding to the transmission function, and the terminal device 110b shown in FIG. 4 shows a functional block corresponding to the reception function. As described above, the terminal device 110a may further include a reception function (see FIG. 4), and the terminal device 110b may further include a transmission function (see FIG. 3). The following also refers to the case where each terminal device has both of the above functions, as necessary.

  The server 120 includes a transmission request receiving unit 121, a reception request receiving unit 122, a determination processing unit 123, and a terminal information generation unit 124, as shown in FIGS. 3 and 4. As shown in FIG. 3, the terminal device 110 a includes a transmission request transmission unit 111, a determination result acquisition unit 112, a terminal information acquisition unit 113, a communication path establishment unit 114, an audio transmission unit 115, and a display control unit 116. There is. As shown in FIG. 4, the terminal device 110 b includes a reception request transmission unit 141, a determination result acquisition unit 142, a display control unit 143, and an audio reception unit 144.

  The above-described elements included in each of the terminal devices 110 and the server 120 are realized by the CPUs 1101 and 1201 executing programs stored in the respective memories 1102 and 1202 (see FIG. 2).

  The program may be installed in the terminal device 110 and the server 120 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or downloaded via the communication network 130 such as the Internet. Alternatively, a program corresponding to a predetermined element may be downloaded to each terminal device 110 from the server 120 in which the program corresponding to each element is stored in advance.

  For example, as shown in FIG. 5, in the network configuration in which each of the terminal devices 110a to 110f is connected to the server 120 via the communication network 130, when each of the terminal devices 110a to 110f is connected to the server 120, A program corresponding to a predetermined element may be downloaded to the memory 1102 of each of the terminal devices 110a to 110f from the server 120 in which the program corresponding to the element is stored in advance. The downloaded program may be configured by JavaScript (registered trademark), for example. When connected to the server 120, each of the terminal devices 110a to 110f acquires the program.

  Each function corresponding to the above program will be described. The following description is based on the flow of processing of the electronic conference system 1100 according to the progress of the electronic conference.

  First, in the electronic conference, when the user wishes to transmit his / her speech (voice) to another terminal device 110, that is, transmits voice data between his / her terminal device and the other terminal device. When it is requested to establish a communication channel for communication, an operation unit 1105 of the terminal device 110 is operated to give an instruction to that effect. For example, in the electronic conference, the user A uses the "voice transmission" selection screen (for example, a check box or an electronic button) displayed on the display unit 1106 of the terminal device 110a (see FIG. 3) used by himself. Use mouse or mouse to select. The transmission request transmission unit 111 of the terminal device 110 a transmits the received request of the user A (hereinafter referred to as a transmission request) to the server 120. Note that, for example, when the user A removes the check box of “voice transmission” or satisfies a predetermined condition (described later), the transmission request transmission unit 111 transmits a transmission cancellation request. For example, the transmission request transmission unit 111 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a cancellation request.

  Further, in the electronic conference, when the user desires to receive another user's speech (voice), the user operates the operation unit 1105 of the terminal device 110 to give an instruction to that effect. For example, in the electronic conference, the user B uses a keyboard for selecting a "voice reception" (for example, a check box or an electronic button) displayed on the display unit 1106 of the terminal device 110b (see FIG. 4) used by himself. Use mouse or mouse to select. The reception request transmission unit 141 of the terminal device 110 b transmits the received request of the user B (hereinafter referred to as a reception request) to the server 120. Note that, for example, when the user B removes the check box of “voice reception” or satisfies a predetermined condition (described later), the reception request transmission unit 141 transmits a cancellation request for reception. For example, the reception request transmission unit 141 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a cancellation request.

  In addition, in each terminal device 110, selection screens for both “voice transmission” and “voice reception” are displayed, and each user can select each selection screen individually. For example, in the terminal device 110a, the user A can select both "speech transmission" and "speech reception".

  The transmission request reception unit 121 of the server 120 receives the transmission request transmitted from the transmission request transmission unit 111 of the terminal device 110. For example, when the transmission request is transmitted from each of the terminal devices 110a and 110f, the transmission request receiving unit 121 receives the transmission request of both the terminal devices 110a and 110f.

  The reception request receiving unit 122 of the server 120 receives the reception request transmitted from the reception request transmitting unit 141 of the terminal device 110. For example, when the reception request is transmitted from each of the terminal devices 110a to 110f, the reception request receiving unit 122 receives the reception request of each of the terminal devices 110a to 110f.

  The determination processing unit 123 of the server 120 determines, based on the transmission request received by the transmission request receiving unit 121, permission or rejection of voice transmission in the terminal device 110 that has transmitted the transmission request. Specifically, the determination processing unit 123 compares the total number of terminal devices that have received the transmission request received by the transmission request receiving unit 121 with the preset number of terminals set in advance, and the total number is less than or equal to the preset number. Determine if there is. Then, determination processing unit 123 permits voice transmission in the terminal apparatus that has made a transmission request when the total number is equal to or less than the set number, and disallows voice transmission when the total number exceeds the set number. . For example, when the terminal devices 110a and 110f make a transmission request when the set number is set to “3”, the total number (two units) is equal to or less than the set number (three units). , 110f to allow voice transmission.

  Here, the determination processing unit 123 calculates the total number of terminal devices 110 that have made a transmission request at the current time (when the terminal device subject to determination has made a transmission request). For example, when the terminal devices 110a and 110f have already made a transmission request and the terminal device 110b has made a transmission request anew, the total number at present is three. Therefore, for example, when the set number is set to “2”, the terminal devices 110a and 110f have already made a transmission request (voice transmission may already be performed), and the terminal device 110b newly When a transmission request is made, since the total number (3 units) exceeds the set number (2 units), voice transmission of the terminal apparatus 110b which newly made a transmission request is not permitted.

  In this manner, voice transmission is permitted until the set number is reached in the order of transmission request. Also, when the number of terminal devices 110 for which voice transmission is permitted reaches the set number, voice transmission of the other terminal device 110 is performed when voice transmission (communication path) is canceled in any of the terminal devices 110. Permission may be given.

  The determination processing unit 123 transmits the determination results (permission notification, non-permission notification) to the terminal device 110 that has transmitted the transmission request.

  In addition, the determination processing unit 123 may determine, based on the reception request received by the reception request receiving unit 122, permission or rejection of voice reception in the terminal device 110 that has transmitted the reception request. For example, the determination processing unit 123 compares the total number of terminal devices 110 that have received the reception request received by the reception request receiving unit 122 with the preset number of devices set in advance, and determines whether the total number is equal to or less than the preset number It may be determined whether or not. Moreover, the permission or rejection of the voice reception may be determined based on other conditions described later (Modification 1 of Embodiment 1 described later). In addition, the determination processing unit 123 may allow voice reception for all the reception requests received by the reception request receiving unit 122. The determination processing unit 123 transmits the determination results (permission notification, non-permission notification) to the terminal device 110 that has transmitted the reception request.

  Furthermore, when the total number of terminal devices 110 that can make a transmission request reaches the set number, the determination processing unit 123 indicates that the number of transmission terminals has reached a specified value (the number of set) and that no more transmission requests can be made. A notification (message) may be sent to all the terminal devices 110 connected to the server 120. Similarly, when the number of devices that can receive the transmission cancellation request and can make the transmission request falls below the set number, a notification may be sent to all the terminal devices 110 indicating that the transmission request has become possible. Alternatively, a notification may be sent indicating the remaining number of units until the set number is reached. For example, when the number of set devices is two, if there is a transmission request from the terminal device 110a, the terminal device 110a is notified of transmission permission, and the remaining number of devices until all the terminal devices 110 reach the set number "1 (unit)" which is the next, and when there is a transmission request from the terminal device 110f next, it notifies the transmission permission to the terminal device 110f, and "0 (unit)" to all the terminal devices 110 In this case, when there is a transmission cancellation request from the terminal device 110 a, “1 (unit)” is transmitted to all the terminal devices 110. The determination processing unit 123 may execute the same process as described above for the reception request.

  The terminal information generation unit 124 of the server 120 generates transmission terminal information based on the transmission request received by the transmission request reception unit 121 and the above determination result of the determination processing unit 123. Specifically, when the total number is equal to or less than the set number, the terminal information generation unit 124 generates a transmission terminal list in which terminal information of the terminal devices 110 for which voice transmission is permitted is listed. For example, when the transmission request received from the terminal devices 110a and 110f is permitted, the terminal information generation unit 124 lists the terminal information such as the names of the terminal devices 110a and 110f and identification information (terminal ID, IP address, etc.) Create a sending terminal list. FIG. 6 shows an example of the transmission terminal list. The terminal information generation unit 124 updates the transmission terminal list each time the received transmission request is permitted or each time the transmission request is cancelled. The generated transmission terminal list is stored in the terminal list DB 1203a.

  Also, the terminal information generation unit 124 generates reception terminal information based on the reception request received by the reception request reception unit 122. Specifically, the terminal information generation unit 124 generates a receiving terminal list in which the terminal information of the terminal device 110 for which the reception request is permitted is listed. For example, when the reception request received from the terminal devices 110a to 110f is permitted, the terminal information generation unit 124 lists the terminal information such as the names of the terminal devices 110a to 110f and identification information (terminal ID, IP address, etc.) Generate a list of received terminals. FIG. 7 shows an example of the receiving terminal list. The terminal information generation unit 124 updates the receiving terminal list each time the received request for reception is permitted or each time the request for reception is canceled. FIG. 8 shows the updated receiving terminal list when the new receiving request received from the network-connected terminal device 110g (not shown) is permitted in the state of FIG. The generated receiving terminal list is stored in the terminal list DB 1203a.

  In addition, the terminal information generation unit 124 transmits the above-described receiving terminal list to the terminal device 110 for which the determination processing unit 123 permits voice transmission. Furthermore, the terminal information generation unit 124 also transmits the updated receiving terminal list to the terminal device 110 for which voice transmission is permitted even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted to the terminal devices 110a and 110f, the terminal information generation unit 124 transmits the receiving terminal list (see FIG. 7) to the terminal devices 110a and 110f. Also, even when the receiving terminal list is updated, the terminal information generation unit 124 transmits the updated receiving terminal list to the terminal devices 110a and 110f. At that time, only the modified (added) receiving terminal list may be transmitted.

  The determination result acquisition unit 112 of the terminal device 110 a receives (or acquires) the determination result in the determination processing unit 123 of the server 120. For example, the determination result acquisition unit 112 of the terminal devices 110a and 110f acquires a permission notification of voice transmission from the server 120.

  The terminal information acquisition unit 113 (terminal information reception unit 13) of the terminal device 110a receives (or acquires) the reception terminal list from the terminal information generation unit 124 of the server 120. For example, the terminal information acquisition unit 113 of the terminal devices 110a and 110f acquires the receiving terminal list illustrated in FIG. 7 from the server 120.

  The communication channel establishing unit 114 of the terminal device 110a is a communication channel for transmitting (transmitting and receiving) audio data to and from another terminal device 110 based on the receiving terminal list acquired by the terminal information acquiring unit 113. Establish. The acquired receiving terminal list is stored in the storage unit 1103. For example, the communication channel establishment unit 114 of the terminal device 110a establishes a communication channel between the terminal device 110a and each of the terminal devices 110b, 110c, 110d, 110e, and 110f. FIG. 9 shows a network configuration showing communication paths established between the terminal device 110a and the terminal devices 110b, 110c, 110d, 110e, and 110f. Similarly, the communication channel establishment unit 114 of the terminal device 110f establishes a communication channel between the terminal device 110f and each of the terminal devices 110a, 110b, 110c, 110d, and 110e. FIG. 10 shows a network configuration showing communication paths established between the terminal device 110f and each of the terminal devices 110a, 110b, 110c, 110d and 110e. FIG. 11 shows a network configuration showing all communication paths established in the above example. In FIG. 9 to FIG. 11, the direction of the arrow indicates the transmission direction of the audio data. 9 to 11 show the configuration for transmitting and receiving audio data without passing through the server 120, but the network configuration is not limited to this, and the configuration is for transmitting and receiving audio data by using the server 120 as a relay. May be

  Further, establishment of a communication path is performed, for example, for a terminal device (sending terminal device) that transmits voice, to a terminal device (receiving terminal device) that receives voice based on the IP address and port number of the receiving terminal information . Also, for example, when the user A removes the check box of “audio transmission” displayed on the display unit 1106 of the terminal device 110 a, the communication path establishment unit 114 cancels the established communication path.

  When the communication path establishment unit 114 establishes the communication path, the audio transmission unit 115 of the terminal device 110 a transmits the audio data input to the audio input unit 1107 to each terminal device 110 via the communication path ( To deliver. For example, the voice transmission unit 115 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 1107 of the terminal device 110a through the communication channel (the single line in FIG. 11) to the terminal device 110b, The voice data corresponding to the speech (voice) of the user F transmitted to 110c, 110d, 110e, and 110f and input to the voice input unit 1107 of the terminal device 110f through the communication path (double line in FIG. 11) It transmits to terminal device 110a, 110b, 110c, 110d, 110e. Thereby, the speech (voice data) of the user A and the user F can be transmitted to the other terminal device 110 at the same timing, for example. Note that the audio transmission unit 115 may perform stream transmission (streaming) to each terminal device 110 or may transmit an audio data file. When both the transmitting terminal device and the receiving terminal device incorporate a Web browser, the voice stream of the transmitting terminal device may be connected to the receiving terminal device using Web Real-Time Communication (WebRTC).

  The display control unit 116 of the terminal device 110 a causes the display unit 1106 to display the display content corresponding to the determination result acquired by the determination result acquisition unit 112. For example, when the determination result acquisition unit 112 acquires a permission notification of audio transmission from the server 120, the display control unit 116 causes the display unit 1106 to display a message indicating that audio transmission is permitted. In addition, when the determination result acquisition unit 112 acquires a notification of denial of voice transmission from the server 120, the display control unit 116 causes the display unit 1106 to display an error message indicating that the voice transmission is not permitted, and Change the selection screen (check box or electronic button) of “send voice” displayed in 1106 so that it can not be selected. For example, the electronic button for selecting voice transmission (transmission request) is grayed out (deactivated) and can not be selected (pressed), or the display unit 1106 indicates that "current transmission request can not be made". You may display the note of. As described above, the display control unit 116 may control the display content of the display unit 1106 so that the user can not transmit a new voice (transmission request).

  The determination result acquisition unit 142 of the terminal device 110 b receives (or acquires) the determination result in the determination processing unit 123 of the server 120. For example, the determination result acquisition unit 142 of each of the terminal devices 110a to 110f acquires a permission notification of voice reception from the server 120.

  When the determination result acquisition unit 142 acquires the permission notification, the display control unit 143 of the terminal device 110b causes the display unit 1106 to display a message indicating that audio reception is permitted. In addition, when the determination result acquisition unit 142 acquires a notification of denial of voice reception from the server 120, the display control unit 143 causes the display unit 1106 to display an error message indicating that the voice reception is not permitted, and the display unit The selection screen (check box or electronic button) of “voice reception” displayed in 1106 is changed so as not to be selected.

  The voice receiving unit 144 of the terminal device 110b receives voice data transmitted via the communication path. The voice output unit 1108 converts the received voice data and outputs voice. For example, the voice reception unit 144 of each of the terminal devices 110b, 110c, 110d, 110e, and 110f corresponds to the speech (voice) of the user A transmitted from the terminal device 110a via the communication path (the single line in FIG. 11). Audio data to be received, and each audio output unit 1108 outputs an audio. In addition, the voice reception unit 144 of each of the terminal devices 110a, 110b, 110c, 110d, and 110e is used for the speech (voice) of the user F transmitted from the terminal device 110f via the communication path (double line in FIG. 11). The corresponding audio data is received, and each audio output unit 1108 outputs an audio. Thus, for example, the user B, the user C, the user D, and the user E of the terminal devices 110b, 110c, 110d, and 110e can hear the speech of the user A and the speech of the user F at the same timing.

  Next, the flow of processing in the server 120 will be described using a flow diagram. FIG. 12 shows a flowchart when the server 120 receives a transmission request from the terminal device 110.

  First, when a transmission request is transmitted from the terminal device 110, the transmission request receiving unit 121 receives the transmission request (S1101). Next, the determination processing unit 123 compares the total number of terminal devices 110 that have made a transmission request with the preset number of devices set in advance, and determines whether the total number is less than or equal to the preset number (S1102) .

  When the total number is equal to or less than the set number, the determination processing unit 123 transmits an audio transmission permission notification to the terminal device 110 that has made the transmission request, and the terminal information generation unit 124 transmits the transmission terminal list (see FIG. 6) is generated (S1103). Subsequently, the terminal information generation unit 124 transmits, to the terminal device 110 registered in the transmission terminal list, a receiving terminal list in which the information on the terminal device that has made the reception request is listed (S1104).

  In the process of S1102, when the total number exceeds the set number, the determination processing unit 123 transmits a voice transmission disapproval notification to the terminal device 110 that has transmitted the transmission request (S1105). The processes in S1101 to S1105 are repeated until the electronic conference ends (S1106).

  FIG. 13 shows a flow diagram when the server 120 receives a reception request from the terminal device 110.

  First, when a reception request is transmitted from the terminal device 110, the reception request receiving unit 122 receives the reception request (S1201). Next, the terminal information generation unit 124 generates or updates the receiving terminal list (see FIG. 7) (S1202). Next, the terminal information generation unit 124 transmits an audio reception permission notification to the terminal device 110 registered in the receiving terminal list (S1203). Here, the case where voice reception is permitted for all the reception requests received by the reception request receiving unit 122 is shown, but the determination processing unit 123 only receives voices when the number is equal to or less than a preset number of units set. In the case of non-permission, a notification of non-permission of voice reception may be sent to the terminal device 110. Next, the terminal information generation unit 124 acquires the transmitting terminal list, and transmits the receiving terminal list for each of the terminal devices 110 registered in the transmitting terminal list (S1204). When the receiving terminal list is changed (updated), only the changed (added) receiving terminal list may be transmitted. The processes of S1201 to S1204 are repeated until the electronic conference ends (S1205).

  FIG. 14 is a flowchart of the case where the user makes a transmission request in the terminal device 110.

  First, in the electronic conference, the terminal device 110 receives a transmission request from the user (S1301). Next, the transmission request transmission unit 111 transmits the received transmission request to the server 120 (S1302). When receiving the transmission request, the server 120 executes the processing of S1101 to S1105 shown in FIG.

  Next, the determination result acquisition unit 112 of the terminal device 110 acquires a transmission permission notification or a transmission non-permission notification from the server 120 (S1303). When the transmission permission notification is acquired, the terminal information acquisition unit 113 acquires the reception terminal list from the server 120 (S1304).

  Next, the communication path establishment unit 114 acquires terminal information (terminal ID) of any one terminal device 110 from the reception terminal list (S1305). Next, the communication path establishment unit 114 establishes a communication path for transmitting voice data to the terminal device 110 corresponding to the acquired terminal information (S1306). The communication channel establishing unit 114 executes processing to establish communication channels for all the terminal devices 110 registered in the receiving terminal list (S1307).

  Next, the voice transmission unit 115 transmits voice data to each terminal device 110 via the established communication path (S1308).

  In the process of S1303, when the determination result acquisition unit 112 acquires the transmission non-permission notification from the server 120, the display control unit 116 of the terminal device 110 causes the display unit 1106 to display an error message (S1309). The processes of S1301 to S1309 are repeated until the electronic conference ends (S1310).

  As described above, the electronic conference system 1100 sets an upper limit on the number of transmission terminals having the floor (transmits voice), and dynamically changes the terminal device for which transmission is permitted according to the user's instruction, A communication path is established between a terminal device permitted to transmit data and another terminal device.

1-2. Modifications of Embodiment 1 The electronic conference system 1100 is not limited to the above configuration, and various configurations can be adopted. Hereinafter, the electronic conference system 1100 according to the modification of the first embodiment will be described focusing on differences from the above configuration. In the electronic conference system 1100 according to the modification of the first embodiment described below, the description of the elements having the same function as the electronic conference system 1100 will be omitted.

1-2-1. Modification 1 of Embodiment 1
In the electronic conference system 1100 according to the first modification of the first embodiment, the server 120 may further include a current location acquisition unit 125 that acquires the current location of each terminal device 110. FIG. 15 is a functional block diagram showing a specific configuration of the server 120 according to the first modification of the first embodiment.

  The current location acquisition unit 125 receives, for example, detection values of a position detection unit (not shown) (for example, GPS etc.) provided in each terminal device 110, and detects the current location (address etc.) of each terminal device 110. get. Further, the current location acquisition unit 125 may set location information in advance with an IP address, a network subnet, and the like, and acquire the current location of each terminal device 110 by acquiring the IP address of each terminal device 110.

  Based on the reception request received by the reception request reception unit 122 and the current position of each terminal device 110 acquired by the current position acquisition unit 125, the determination processing unit 123 receives the voice in the terminal device 110 that has transmitted the reception request. To determine the

  The terminal information generation unit 124 generates reception terminal information based on the reception request received by the reception request reception unit 122 and the determination result of the determination processing unit 123. Specifically, the terminal information generation unit 124 generates a receiving terminal list in which information of the terminal devices 110 permitted by the determination processing unit 123 among the terminal devices 110 that have made the reception request is listed. The terminal information generation unit 124 transmits the reception terminal list to the terminal device 110 for which the determination processing unit 123 permits voice transmission.

  Hereinafter, description will be given by taking a specific example. In FIG. 16, terminal devices 110a, 110b and 110c are provided in the same conference room 1101, terminal device 110d is provided in a place P1 remote from the conference room 1101, and terminal device 110e is in a place P2 remote from the conference room 1101. It shows the network configuration in the case where the terminal device 110f is provided at a place P3 remote from the conference room 1101.

  In the network configuration of FIG. 16, it is assumed that the terminal devices 110a and 110f transmit transmission requests, and the terminal devices 110a to 110f transmit reception requests. In the terminal devices 110a and 110f, since the total number (2) of transmission requests is less than or equal to the set number (3), voice transmission is permitted.

  The current location acquisition unit 125 acquires the current location from each of the terminal devices 110a to 110f. That is, the current location acquisition unit 125 acquires the "conference room 1101" as the current location of the terminal devices 110a, 110b, 110c, acquires the "remote location P1" as the current location of the terminal device 110d, and "remote" as the current location of the terminal device 110e. The "ground P2" is acquired, and the "remote area P3" is acquired as the current position of the terminal device 110f.

  The determination processing unit 123 determines whether the current location of each terminal device 110 is a place (predetermined place) within the same or a preset range, and in the case where a plurality of terminal devices 110 exist in a predetermined place, The voice reception is permitted for one of the plurality of terminal devices 110, and the voice reception is not permitted for the other terminal devices 110. In the network configuration of FIG. 16, among the terminal devices 110a, 110b and 110c existing in a predetermined place (conference room 1101), the voice reception of the terminal device 110a is permitted, and the voice reception of the terminal devices 110b and 110c is not permitted. Do. The determination processing unit 123 transmits the determination results (permission notification, non-permission notification) to the terminal device that has transmitted the reception request.

  The terminal information generation unit 124 generates the receiving terminal list shown in FIG. 17 based on the above determination result, and transmits it to the terminal devices 110a and 110f. The terminal devices 110a and 110f establish a communication path based on the acquired receiving terminal list. FIG. 18 shows a network configuration showing communication paths established in the electronic conference system 1100 according to the first modification of the first embodiment.

  When a plurality of terminal devices 110 exist in a predetermined place and a transmission request is made in the plurality of terminal devices 110 among them, the determination processing unit 123 detects the transmission of the plurality of terminal devices 110 that has made the transmission request. The voice transmission may be permitted for one of the terminal devices 110, and the voice transmission may not be permitted for the other terminal devices 110. For example, when a transmission request is made in the terminal devices 110a, 110b, and 110c present in the conference room 1101, voice transmission of the terminal device 110a is permitted, and voice transmission of the terminal devices 110b and 110c is not permitted. The terminal information generation unit 124 transmits the receiving terminal list to the terminal device 110a that has permitted voice transmission, and the terminal device 110a establishes a communication path based on the acquired receiving terminal list.

  In the electronic conference of the above network configuration, a plurality of users (for example, users B and C) of a plurality of terminal devices 110 existing in the same conference room directly listens to the contents of one of the users (for example, user A). , And the terminal 110 (for example, the terminal 110a) of any one of the plurality of terminals 110 receives and outputs the contents of the utterance of another user (for example, users D, E, F) at a remote location. It can be heard by Therefore, according to the electronic conference system 1100 according to the first modification of the first embodiment, the number of necessary communication paths can be reduced.

1-2-2. Modification 2 of Embodiment 1
In the electronic conference system 1100 according to the second modification of the first embodiment, the set number may be dynamically changed. Specifically, the set number may be set according to the number of all the terminal devices 110 connected via the communication network 130. For example, as the number of terminal devices 110 increases, the set number can be reduced. This configuration is suitable, for example, for an electronic conference such as a seminar in which a speaker (presenter) is determined. Alternatively, the set number may be calculated and set based on the ratio to the number of all the terminal devices 110 connected via the network. Furthermore, the set number may be set according to the number of terminal devices 110 that have made a reception request.

1-2-3. Modification 3 of Embodiment 1
In the electronic conference system 1100 according to the third modification of the first embodiment, after the communication path is established, the time when the audio data is not transmitted from the terminal device 110 for which the audio transmission is permitted reaches a preset time. The communication channel establishment unit 114 may release the communication channel corresponding to the terminal device 110. For example, when the user A permitted to transmit the voice does not speak for a certain time, the communication path establishment unit 114 forcibly cancels the communication path established in the terminal device 110 a of the user A. In the above configuration, the user who uses the transmission terminal device may be photographed by a camera, and the photographed image may be analyzed to measure the presence or absence of the user's speech and the time of silence. The camera may be built in the terminal device 110 or may be installed outside (for example, a conference room).

  Here, in the first embodiment, as illustrated in FIG. 14, the display control unit 116 of the terminal device 110 causes the display unit 1106 to display an error message when the transmission non-permission notification is acquired. The configuration when voice transmission is not permitted is not limited to this.

  For example, in the electronic conference system 1100 according to the fourth modification of the first embodiment, when the terminal device 110 is connected to the server 120, if the total number of transmission terminal devices has already reached the set number, the check box is checked. You may control so that you can not do it. In addition, information may be acquired from the server 120 and control of the check box may be performed according to increase or decrease of the total number of transmission terminal devices. Acquisition of the total number of transmitting terminal devices may be performed by polling the server 120, but preferably, the state of being connected using Web Socket or the like is notified from the server 120 side to each terminal device. Just do it.

  The electronic conference system 1100 may have the following configuration.

  Even if a large number of terminal devices are connected, the electronic conference system 1100 has a limited number of people (speaker terminals) speaking simultaneously at a certain moment, so the number of people who can speak simultaneously (the number of transmission terminal devices) It has a configuration of dynamically changing the establishment state of the communication path while switching the transmission terminal while limiting. As a result, voice data can be mutually transmitted and received among a large number of terminal devices in a pseudo manner.

  Further, the electronic conference system 1100 has a configuration in which voice transmission / voice reception can be selected by each terminal device, and the server 120 is notified when the state of voice transmission / voice reception of each terminal device changes.

  In addition, the server 120 notifies a list of terminal devices for which voice reception is selected to the terminal devices for which voice transmission is selected. In addition, it is not necessary to notify the information of the terminal device in which the state until now does not change at this time. The sending terminal apparatus that has received the notification makes a call to the receiving terminal apparatus so as to receive its own stream information only for the newly registered receiving terminal apparatus (call out connection request).

  Further, in the electronic conference system 1100, the server 120 manages the total number of terminal devices that can simultaneously transmit, and when the total number reaches the upper limit value (the set number), the terminal device disables selection of the transmission request. Have.

  Further, in the electronic conference system 1100, the transmitting terminal device includes two types, a transmitting terminal device and a temporary transmitting terminal device, of which the temporary transmitting terminal device can be transmitted only for a certain period of time, for a certain period of time After the elapse of time, the voice transmission may be canceled (the check box of the transmission request is canceled). Further, the temporary transmission terminal device may be configured to be able to transmit only while the user presses the voice transmission button. In addition, in the temporary transmission terminal device, the transmission request may be canceled when the silent state continues for a predetermined time.

  Further, in the electronic conference system 1100, the user who wants to speak may make a transmission request at the terminal device, and the user designated at the specific terminal device (master terminal) may have a speaking right (permit as the transmission terminal device). .

  The network configuration in the electronic conference system 1100 is not limited to the configuration shown in FIG. 5, and the server 120 and any one of the plurality of terminal devices 110 may be the same terminal, or the server 120 It may be configured not to have (FIG. 19). The configuration shown in FIG. 19 is implemented by downloading programs corresponding to the elements included in the electronic conference system 1100 to the terminal devices 110a to 110f. Specifically, each of the terminal devices 110a to 110f includes the elements shown in FIGS. 3 and 4 in common, and the CPU of each terminal device executes the program stored in the memory of each terminal device, The teleconference system 1100 is implemented. Further, in a configuration that does not have the server 120, when a transmission request (voice transmission) is made in a certain terminal device 110, a transmission request is transmitted to all the terminal devices 110, and all the terminal devices 110 share the terminal list DB 1203a. Can be configured. Further, in the above configuration, the terminal device 110 requested to be transmitted performs a process of determining whether to permit voice transmission before transmitting the transmission request to the other terminal device 110, and when it is determined to permit, the transmission request It may be configured to transmit to another terminal device 110. The program to be downloaded may be configured, for example, by JavaScript (registered trademark). Thus, each terminal device can function as a transmitting terminal device or a receiving terminal device according to the state of the conference. The terminal device 110 having the program downloaded or recorded functions as an information processing device. Further, the computer from which the program is downloaded may be the terminal device 110 or the server 120.

  In addition, in the configuration shown in FIG. 5, a program corresponding to each element included in the electronic conference system 1100 may be implemented by being downloaded to the server 120. The server 120 having the program downloaded or recorded functions as an information processing apparatus.

  The electronic conference system 1100 is not limited to the transmission and reception of audio data. That is, the electronic conference system 1100 can be applied to transmission and reception of media data including at least one of audio data and video data (moving image data). Further, the electronic conference system 1100 can be applied to various electronic conferences such as a video conference and a telephone conference. In the video conference, the video taken by the camera mounted on each terminal device is bi-directionally communicated between the terminal devices through the communication path. Also, the electronic conferencing system 1100 can be applied to teleconferencing in which conferees are remote from each other.

  According to the electronic conference system 1100 described above, high quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases. In addition, each user can select according to his / her intention, for example, when transmitting a speech (voice) or when receiving a voice, and the terminal devices on the network reflect the user's intention. The communication path changes dynamically and is established.

  In the above description, the electronic conferencing system has been exemplified as an example of the information processing system, but the information processing system is not limited to the electronic conferencing system, and various types of sharing media data among network-connected terminal devices System is included.

1-3. Advantages of Embodiment 1 A program according to Embodiment 1 of the present invention is for causing a computer that transmits and receives media data including at least one of audio data and video data to function in a plurality of terminal devices connected via a network. A transmission request receiving means for receiving the transmission request for the media data from at least one terminal device, a reception request receiving means for receiving the reception request for the media data from the at least one terminal device, the transmission request If the total number of terminal devices that performed the request is less than or equal to a predetermined number set, at least one of the terminal device that made the transmission request and the terminal device that made the reception request Communication path establishing means for establishing a communication path for transmitting the media data to a terminal device; To make the computer function. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  In the program according to the first embodiment of the present invention, the computer further causes the computer to function as a current location acquisition unit for acquiring the current location of each terminal device, and the communication channel establishment unit performs the reception request. When a plurality of terminals exist in a predetermined range, the communication path may be established for one of the terminal devices.

  In the program according to the first embodiment of the present invention, the set number may be set according to the number of all the terminal devices connected via the network. According to this configuration, the set number is set according to the number of terminal devices.

  In the program according to the first embodiment of the present invention, the set number may be set according to the number of the terminal devices that have made the reception request. According to this configuration, the set number is set in accordance with the number of terminal devices that have made the reception request.

  In the program according to the first embodiment of the present invention, a new transmission request is received by the transmission request receiving unit when the total number of the terminal devices that have made the transmission request reaches the set number. The communication path establishing means may refuse establishment of the communication path for the terminal apparatus that has made a new transmission request.

  In the program according to the first embodiment of the present invention, when a time period in which the media data is not transmitted from the terminal device that has made the transmission request after the communication path has been established reaches a predetermined time. The communication path establishing means may release the communication path corresponding to the terminal device. According to this configuration, when the time when the media data is not transmitted reaches the time set in advance, the communication path of the corresponding terminal device is released.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as a display control unit that controls the display content of the display unit of the terminal device, and the total number of the terminal devices that made the transmission request is the When the set number has been reached, the display control means may display a screen indicating that the transmission request is not accepted on the display unit of the terminal device that has made a new transmission request. .

  In the program according to the first embodiment of the present invention, the computer is further caused to function as a display control unit that controls the display content of the display unit of the terminal device, and the total number of the terminal devices that made the transmission request is the When the set number has been reached, the display control means may control the display content of the display unit so that the user can not select a new transmission request. According to this configuration, a screen indicating that the transmission request is not accepted is displayed on the display unit of the terminal device that has refused to establish the communication path.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as a display control unit that controls the display content of the display unit of the terminal device, and the total number of the terminal devices that made the transmission request is the When the set number has been reached, the display control means displays on the display unit for the user to make the transmission request when the terminal device is connected to a server that manages all the terminal devices. It may be controlled not to check the check box to be checked. According to this configuration, a screen indicating that the transmission request is not accepted is displayed on the display unit of the terminal device that has refused to establish the communication path.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as a display control unit that controls the display content of the display unit of the terminal device, and the total number of the terminal devices that made the transmission request is the When the set number has been reached, the display control means causes the display unit to display the transmission request so that the user can not select a new transmission request, and the total number of the terminal devices that have made the transmission request is When the number is less than the set number, the display content of the display unit may be changed so that the user can select a new transmission request. According to this configuration, the screen for receiving the transmission request and the screen for not receiving the transmission request are switched and displayed according to the increase or decrease of the total number of transmission terminal devices.

  A program according to Embodiment 1 of the present invention is a program for causing a computer to transmit and receive media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. Transmission request receiving means for receiving the transmission request for the media data from at least one terminal device, reception request receiving means for receiving the reception request for the media data from at least one terminal device, the terminal having made the transmission request When the total number of devices is equal to or less than a predetermined number of set devices, between the terminal device that has made the transmission request and at least one of the terminal devices of the terminal devices that have made the reception request Transmission request for permitting establishment of a communication path for transmitting the media data, Determination processing means for transmitting to the terminal apparatus that has performed, and characterized by causing a computer to function as a. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  A program according to Embodiment 1 of the present invention is a program for causing a computer to transmit and receive media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. A transmission request transmission unit that transmits a transmission request for transmitting the media data to another transmission terminal, and the total number of the terminal devices that have made the transmission request is equal to or less than a predetermined number set A communication path for transmitting the media data between the terminal device that has made a transmission request and at least one of a plurality of terminal devices that has made a reception request to receive the media data. The computer functions as communication channel establishing means for establishing According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  A program according to Embodiment 1 of the present invention is a program for causing a computer to transmit and receive media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. Transmission request transmission means for transmitting a transmission request for transmitting the media data to another transmission terminal, terminal information reception means for receiving a reception terminal list in which information of a terminal apparatus for receiving the media data is registered, the transmission A computer is provided as a communication path establishing means for establishing a communication path for transmitting the media data between the terminal device for which a request has been granted and the terminal device registered in the received terminal list. It is characterized by having it function. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  The program may be stored in a computer readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal device or a server that manages the terminal device.

  An information processing apparatus according to a first embodiment of the present invention is an information processing apparatus for transmitting and receiving media data including at least one of audio data and video data in a plurality of terminal devices connected via a network, the media A transmission request transmission unit that transmits a transmission request for transmitting data to another transmission terminal, and the total number of the terminal devices that have made the transmission request is equal to or less than a predetermined number set A communication path for transmitting the media data is formed between the terminal device that made the request and at least one terminal device of the plurality of terminal devices that made the reception request to receive the media data. And means for establishing a communication path. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  An information processing system according to a first embodiment of the present invention is an information processing system for transmitting and receiving media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. Transmission request receiving means for receiving the transmission request of the media data from the plurality of terminal devices, reception request receiving means for receiving the reception request for the media data from at least one of the terminal devices, and the terminal having made the transmission request When the total number of devices is equal to or less than a predetermined number of set devices, between the terminal device that has made the transmission request and at least one of the terminal devices of the terminal devices that have made the reception request And channel establishing means for establishing a channel for transmitting the media data. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

  A recording medium according to Embodiment 1 of the present invention is a program for causing a computer to transmit and receive media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. Transmission request receiving means for receiving the transmission request for the media data from at least one terminal device, reception request receiving means for receiving the reception request for the media data from at least one terminal device, and the transmission request being performed When the total number of terminal devices is equal to or less than a predetermined number set, the terminal device that has made the transmission request and the terminal device that has made the reception request at least one of the terminal devices Meanwhile, as a communication path establishing means for establishing a communication path for transmitting the media data, And characterized by recording a program for. According to this configuration, the media data is transmitted between the terminal device that made the transmission request and the terminal device that made the reception request when the total number of terminal devices that made the transmission request is less than or equal to the set number. Communication paths are established, and high-quality data communication can be realized between the terminal devices even if the number of terminal devices connected via the network increases.

2-1. Embodiment 2
In the second embodiment of the present invention, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the user's desired operation can be performed without requiring a synchronous / asynchronous switching operation by the user of the operation terminal. An object of the present invention is to provide an information processing apparatus, an information processing system, a program, and a recording medium capable of displaying contents according to the requirements. In the second embodiment, as an example of the information processing system, an electronic conference system in which electronic data is shared among a plurality of operation terminals connected via a network will be described as an example. In addition, the meaning of the term of Embodiment 2 shall extend only to the range of Embodiment 2.

  FIG. 20 is an entire configuration diagram of the electronic conference system according to the second embodiment. The electronic conference system 2100 (information processing system) is configured to include a plurality of operation terminals 210 used respectively by a plurality of users attending a conference. In the second embodiment, for convenience of explanation, a user who can be the protagonist of the meeting, such as the organizer of the meeting, the facilitator of the meeting, the person in charge of the presentation in the meeting, is referred to as a "presenter" (second user). The operation terminal used by is referred to as a "presenter terminal" (second operation terminal). A user who attends a meeting other than the presenter is referred to as a "participant" (first user), and an operation terminal used by the participant is referred to as a "participant terminal" (first operation terminal). FIG. 20 shows one presenter terminal 210a and three attendee terminals 210b, 210c, and 210d. Further, in the following, when describing the configuration common to the presenter terminal 210a and the participant terminals 210b, 210c, and 210d, the operation terminal 210 will be generically described.

  As shown in FIG. 20, the presenter terminal 210a and the participant terminals 210b, 210c, and 210d are mutually connected via a communication network 220 such as a LAN (Local Area Network) or the Internet.

  FIG. 21 is a block diagram showing the hardware configuration of the operation terminal 210. As shown in FIG. The operation terminal 210 is configured by a computer including a CPU 2101, a memory 2102, a storage unit 2103, a communication unit 2104, an input unit 2105, and a display unit 2106. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 2101 controls each unit of the operation terminal 210 and executes various information processing. The memory 2102 holds various programs and data. In the memory 2102, a work area of the CPU 2101 is also secured. A storage unit 2103 stores data such as various files and documents. The communication unit 2104 performs data communication with another operation terminal 210 via the communication network 220. The input unit 2105 is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. A display unit 2106 is a display screen that displays various files, documents, and the like via application software such as a web browser. The storage unit 2103, the input unit 2105, and the display unit 2106 may be provided outside the operation terminal 210 and connected to the operation terminal 210 via the communication network 220. The operation terminal 210 also incorporates software such as a browser and an electronic mail client. The operation terminal 210 is, for example, a personal computer, a personal digital assistant (PDA), a portable information terminal such as a smartphone, or the like.

  Hereinafter, the specific configuration of the electronic conference system 2100 will be described mainly focusing on the presenter terminal 210a and the participant terminal 210b.

  FIG. 22 is a functional block diagram showing a specific configuration of the participant terminal 210b. The participant terminal 210 b includes a presenter operation reception unit 211, a participant operation acquisition unit 212, an operation type determination unit 213, a synchronization determination unit 214, and a display control unit 215. These elements are realized by the CPU 2101 executing a program stored in the memory 2102 (see FIG. 21). The storage unit 2103 includes a file DB 231 for storing data such as various files and documents.

  The program may be installed on the participant terminal 210 b from a computer readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or downloaded via the communication network 220 such as the Internet. Alternatively, the program may be downloaded from a server stored beforehand.

  For example, as shown in FIG. 23, in the network configuration in which each operation terminal 210 is connected to the network via the server 230, when the participant terminals 210b, 210c and 210d are connected to the server 230, the above program becomes a server It may be downloaded to the memory 2102 of each participant terminal 210 b, 210 c, 210 d from 230, and the material data for the conference may be downloaded to the file DB 231. The program and the material data may be configured by JavaScript (registered trademark), for example. Also, when the presenter connects the operation terminal 210 to the server 230 and performs predetermined settings, the operation terminal 210 is recognized as the presenter terminal 210a, and the participant connects the operation terminal 210 to the server 230. By performing a predetermined setting, the operation terminal 210 is recognized as the participant terminal 210b or the like. The server 230 transmits the program and the material data to each operation terminal 210 recognized by the participant terminal. The server 230 may transmit the program and the material data also to the operation terminal 210 recognized as the presenter terminal. After transmitting the program and the material data, the server 230 mainly functions as a relay that performs information communication between the presenter terminal 210a and the participant terminals 210b, 210c, and 210d. The operation terminal 210 having the program downloaded or recorded functions as an information processing apparatus. Further, the computer to which the program is downloaded may be the operation terminal 210 or the server 230.

  Each function corresponding to the above program will be described.

  The presenter operation reception unit 211 receives information (hereinafter, referred to as presenter operation information) (second operation content) indicating contents operated by the presenter on the presenter terminal 210a from the presenter terminal 210a. The presenter operation information is, for example, display of a new material, writing to a material with a pen tool (tool for handwriting), pickup of a post comment (selection), page switching of material, operation of inputting and moving a mouse pointer, voice input, etc. It is information indicating the content.

  Here, a specific example of processing contents in the presenter terminal 210a will be described. FIG. 24 shows an example of display content displayed on the display screen of the presenter terminal 210a.

  For example, when the presenter operates the mouse or the like (input unit 2105) in the presenter terminal 210a to read the material stored in the file DB 231 (operation to display a new material on the material screen), The presenter terminal 210a notifies (sends) the presenter terminal 210b of presenter operation information indicating the operation content including the information indicating the storage destination URL of the material or the material ID via the communication unit 2104.

  Also, for example, when the presenter operates the mouse on the presenter terminal 210a and inputs the mouse pointer on the material screen (see FIG. 24) displayed on the display unit 2106, the presenter terminal 210a communicates The presenter terminal 210b is notified of presenter operation information indicating the operation content including the information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number and the like via the unit 2104. The presenter terminal 210a may sequentially transmit presenter operation information at regular intervals (for example, every 50 msec).

  Also, for example, when the presenter operates the pen tool in the presenter terminal 210a and writes characters or the like on the material screen (see FIG. 24) displayed on the display unit 2106, the presenter terminal 210a communicates Through the unit 2104, the participant terminal 210b is notified of presenter operation information indicating the content of the operation including information indicating the written position (coordinates), the ID of the written material, the page number and the like.

  Also, for example, when the presenter operates the mouse on the presenter terminal 210a to switch the page of the material screen (see FIG. 24) displayed on the display unit 2106, the presenter terminal 210a communicates with the communication unit The presenter terminal 210b is notified of presenter operation information indicating the operation content including the ID of the displayed material and the information indicating the designated page number via 2104.

  Thus, the presenter terminal 210a notifies each participant terminal 210b, 210c, 210d of information indicating the content thereof based on the operation of the presenter.

  The participant operation acquisition unit 212 acquires information (hereinafter referred to as participant operation information) (first operation content) indicating the content operated by the participant on the participant terminal 210b. The participant operation information is similar to the presenter operation information, for example, display of the material, writing to the material with the pen tool, creation of a post comment, page switching of the material, input and movement of the mouse pointer, voice input, etc. It is information to show.

  The operation type determination unit 213 determines the operation type (presenter operation type) based on the presenter operation information received by the presenter operation reception unit 211 from the presenter terminal 210a. In addition, the operation type determination unit 213 determines the operation type (participant operation type) based on the participant operation information acquired by the participant operation acquisition unit 212 in the own terminal (the participant terminal 210b). The operation type is one in which the operation contents of the presenter and the participant are classified by type. The operation type is set in advance, and is stored in, for example, the storage unit 2103 as an operation type table. The operation content registered in the operation type table changes the operation content that is important for the presenter and the participant, for example, the display content (synchronization content) displayed on the participant terminal 210b in synchronization with the presenter terminal 210a. Operation contents to be Specifically, when the first page of the material A displayed on the presenter terminal 210a is synchronously displayed on the participant terminal 210b, the terminal 210b for the participant can be obtained by switching to the second page. The mouse pointer is input to the first page when the operation of changing the display content of the first page of the material A displayed on the presenter terminal 210a is synchronously displayed on the participant terminal 210b. This means an operation or the like for changing the display content of the participant terminal 210b.

  In the participant terminal 210b, the synchronization content may be displayed on the entire display screen, or the synchronization content may be displayed on a part of the display screen. Also, the entire display screen of the presenter terminal 210a may be synchronized, or part of the display screen may be synchronized. Therefore, for example, even when the mouse pointer operated by the presenter in the presenter terminal 210a is synchronously moving in the participant terminal 210b (synchronous state), the mouse pointer for the participant terminal 210b is separately (For example, it may be displayed outside the synchronized display screen). Further, in the synchronized display screen, both of the synchronized mouse pointer operated by the presenter and the mouse pointer for the participant terminal 210b operated by the participant may be displayed. The input operation of the mouse pointer on the presenter terminal 210a is included in the operation of changing the display content of the participant terminal 210b.

  FIG. 25 shows an example of the operation type table. In the operation type table shown in FIG. 25, five operation types of “document display”, “pen”, “pickup”, “page switching”, and “pointer” are set corresponding to the operation content. For example, the operation type determination unit 213 specifies the operation type corresponding to the content of the operation performed by the presenter with reference to the operation type table. In addition, the operation type determination unit 213 specifies the operation type corresponding to the content of the operation performed by the participant with reference to the above-described operation type table. In addition, when the operation type corresponding to the operation content does not exist, the operation type determination unit 213 determines “no operation type”. Also, the operation content registered in the operation type table is not limited to the content of FIG. For example, the operation content and the operation type registered in the operation type table may be different between the one for the presenter and the one for the participant. In this case, the presenter's operation type table and the participant's operation type table may be provided separately.

  The synchronization determination unit 214 determines, based on the determination result of the operation type determination unit 213, whether to synchronize the participant terminal 210b with the presenter terminal 210a or to make it asynchronous. Specifically, when the content of the operation by the presenter corresponds to a predetermined operation type (see FIG. 25), the synchronization determination unit 214 determines “synchronization”. When the content of the operation by the participant corresponds to a predetermined operation type (see FIG. 25), the synchronization determination unit 214 determines “asynchronous”. When the content of the operation by the presenter or the content of the operation by the participant is “no operation type”, the synchronization determination unit 214 determines “asynchronous”.

  The display control unit 215 controls the display content of the display screen of the participant terminal 210b based on the determination result of the synchronization determination unit 214. Specifically, when the synchronization determination unit 214 determines “synchronization”, the display control unit 215 causes the participant terminal 210 b to reflect the display content according to the content of the operation by the presenter. For example, when the presenter causes new material A to be displayed on the presenter terminal 210a, the synchronization determination unit 214 determines “synchronization”, and the display control unit 215 causes the display unit 2106 of the participant terminal 210b to display the material Display A. Also, for example, when the presenter switches the display page of the material A from the first page to the second page on the presenter terminal 210a, the synchronization determination unit 214 determines “synchronization”, and the display control unit 215 The display page of the material A displayed on the display unit 2106 of the user terminal 210b is switched from the first page to the second page. Similarly, when a character is written by a pen tool, a post comment is picked up, or the presenter moves the mouse pointer, the display control unit 215 reflects the operation content on the participant terminal 210b.

  On the other hand, when the synchronization determination unit 214 determines “asynchronous”, the display control unit 215 brings the participant terminal 210 b into an asynchronous state (asynchronous mode) with respect to the presenter terminal 210 a, and The operation content is reflected on the participant terminal 210b. For example, when the material A is displayed on the participant terminal 210b in synchronization with the presenter terminal 210a, if the participant selects another material B, it is determined as “asynchronous” in the synchronization determination unit 214. The display control unit 215 makes the participant terminal 210b asynchronous with the presenter terminal 210a, changes the display content of the participant terminal 210b, and causes the display unit 2106 to display the material B. Also, for example, when the third page of the material A is displayed on the participant terminal 210b in synchronization with the presenter terminal 210a, the participant performs an operation to switch to the previous page (fourth page) In this case, the synchronization determination unit 214 determines “asynchronous”, and the display control unit 215 makes the participant terminal 210 b asynchronous with respect to the presenter terminal 210 a and displays it on the display unit 2106 of the participant terminal 210 b. The display page of the document A is switched (changed) from the third page to the fourth page. Similarly, when a character is written by a pen tool, a post comment is created, or the participant moves the mouse pointer, the display control unit 215 causes the participant terminal 210b to be asynchronous with the presenter terminal 210a. This state of operation is reflected on the participant terminal 210b.

  As described above, the display control unit 215 functions as a synchronization cancellation unit that cancels the synchronization state (switching to the asynchronous state) when the participant performs a preset operation on the participant terminal 210b, and the synchronization state is In the released state (asynchronous state), when the presenter performs an operation set in advance on the presenter terminal 210a, the presenter functions as a resynchronization means to return to the synchronous state (cancel the asynchronous state) again.

  Next, the flow of processing in the electronic conference system 2100 will be described. 26 and 27 are operation flow diagrams of the teleconference system 2100. FIG. Here, as an example, the presenter P makes a presentation on material A at an electronic conference using the presenter terminal 210a, the participant S participates in the electronic conference using the participant terminal 210b, and the presenter Description will be made on the assumption that the electronic conference proceeds while P and the participant S perform desired operations. Although the electronic conference system 2100 includes one presenter terminal and a plurality of participant terminals connected to each other via the communication network 220, here, for one presenter, It demonstrates paying attention to the terminal 210a and the terminal 210b for one participant.

  First, the presenter P selects the file of the material A stored in the storage unit 2103 (FIG. 21) on the presenter terminal 210a. Thereby, the contents of the material A are displayed on the display unit 2106 of the presenter terminal 210a (S2101). For example, the first page (first page) of the material A is displayed. In addition, the presenter terminal 210a includes presenter operation information indicating the operation content of the presenter P (here, the display of the new material A) including the information of the material A (for example, the ID of the material A and the page number). It notifies the participant terminal 210b.

  Next, the presenter operation reception unit 211 of the participant terminal 210b receives the presenter operation information from the presenter terminal 210a (S2201). Here, the presenter operation accepting unit 211 accepts an operation content (“display of new material A”) including the ID of the material A.

  Next, the operation type determination unit 213 of the participant terminal 210b determines the operation type based on the presenter operation information (S2202). Here, the operation type determination unit 213 refers to the operation type table shown in FIG. 25 to identify the operation type (“display of material”) corresponding to the operation content (“display of new material A”).

  Next, the synchronization determination unit 214 of the participant terminal 210b determines synchronization / asynchronization of the participant terminal 210b based on the determination result of the operation type determination unit 213 (S2203). Here, since “display of material” is specified as the operation type, the synchronization determination unit 214 determines “synchronization”.

  Next, the display control unit 215 of the participant terminal 210b controls the display content of the display screen on the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2204). Here, since the synchronization determination unit 214 determines “synchronization”, the display control unit 215 causes the display unit 2106 of the participant terminal 210 b to display the first page of the material A.

  In the processes of S2201 to S2204, the presenter terminal 210a and the participant terminal 210b are in the synchronization state (synchronization mode), and the same content is displayed.

  Subsequently, the participant S performs a desired operation on the participant terminal 210b. Here, it is assumed that the participant S switches the display page (first page) of the material A displayed on the display screen to the second page (S2205).

  Then, the participant operation acquisition unit 212 of the participant terminal 210b acquires participant operation information indicating the content operated by the participant S. Here, the participant terminal 210b acquires participant operation information indicating the operation content of the participant S (here, page switching of the material A) including the information of the material A (for example, the ID of the material A). (S2206).

  Next, the operation type determination unit 213 of the participant terminal 210b determines an operation type based on the participant operation information (S2207). Here, the operation type determination unit 213 specifies the operation type ("page switching") corresponding to the operation content ("page switching of material A") with reference to the operation type table shown in FIG.

  Next, the synchronization determination unit 214 of the participant terminal 210b determines synchronization / asynchronization of the participant terminal 210b based on the determination result of the operation type determination unit 213 (S2208). Here, since “page switching” is specified as the operation type, the synchronization determination unit 214 determines “asynchronous”.

  Next, the display control unit 215 of the participant terminal 210b controls the display screen of the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2209). Here, since the synchronization determination unit 214 determines “asynchronous”, the display control unit 215 displays the first page of the document A on the display unit 2106 of the presenter terminal 210 a, even if the first page of the document A is displayed. The display content of the display unit 2106 of the terminal 210b is changed to display the second page of the material A.

  In the processing of S2205 to S2209, the participant terminal 210b is in an asynchronous state (asynchronous mode), and different contents are displayed on the presenter terminal 210a and the participant terminal 210b.

  Subsequently, the presenter P performs a desired operation on the presenter terminal 210a. Here, it is assumed that the presenter P writes a character on the first page of the material A displayed on the display unit 2106 using a pen tool (S2102 in FIG. 27).

  Then, the presenter terminal 210a displays the contents operated by the presenter P including the position (coordinates) of the written character, the ID of the written material A, and the page number (here, the material A by the pen tool ) Is notified to the participant terminal 210b.

  Next, the presenter operation receiving unit 211 of the participant terminal 210b receives the presenter operation information from the presenter terminal 210a (S2210).

  Next, the operation type determination unit 213 of the participant terminal 210b determines the operation type based on the presenter operation information (S2211). Here, the operation type determination unit 213 specifies the operation type ("pen") corresponding to the operation content ("writing to the material A by the pen tool") with reference to the operation type table shown in FIG.

  Next, the synchronization determination unit 214 of the participant terminal 210b determines synchronization / asynchronization of the participant terminal 210b based on the determination result of the operation type determination unit 213 (S2212). Here, since “pen” is specified as the operation type, the synchronization determination unit 214 determines “synchronization”.

  Next, the display control unit 215 of the participant terminal 210b controls the display content of the display screen on the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2213). Here, since the synchronization determination unit 214 determines “synchronization”, the display control unit 215 changes the display content of the display unit 2106 of the participant terminal 210b, and the first of the material A in which the character is written Display the page.

  In the processing of S2210 to S2213, the participant terminal 210b is again in the synchronization state (synchronization mode), and the same content is displayed on the presenter terminal 210a and the participant terminal 210b.

  As described above, in the electronic conference system 2100, synchronous / asynchronous switching is automatically switched according to the desired operation of the presenter and the participant, and the display content of the participant terminal 210b is changed.

2-2. Modification of Embodiment 2 The electronic conference system 2100 is not limited to the above configuration, and various configurations can be adopted. Below, the electronic conference system 2100 which concerns on the modification of Embodiment 2 is demonstrated focusing on difference with the said structure. In the electronic conference system 2100 according to the modification of the second embodiment, the description of the elements having the same function as the electronic conference system 2100 will be omitted.

2-2-1. Modification 1 of Embodiment 2
In the electronic conference system 2100 according to the first modification of the second embodiment, when the participant operation acquisition unit 212 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined. The display control unit 215 causes the participant terminal 210b to be in an asynchronous state (asynchronous mode) with respect to the presenter terminal 210a, and causes the participant terminal 210b to display the display content according to the operation content. It is also good. Then, when the presenter operation reception unit 211 receives the operation content (presenter operation information) by the presenter, the operation control corresponding to the operation content is determined, and the display control unit 215 controls the participant terminal 210b. While making a synchronization state (synchronization mode) for the presenter terminal 210a, display contents corresponding to the operation content corresponding to the operation type may be displayed on the participant terminal 210b.

  According to the electronic conference system 2100 of the first modification of the second embodiment, the presenter changes the important operation (the operation corresponding to the operation type), for example, the display content displayed on the presenter terminal 210a. The display content according to the operation is displayed on the participant terminal 210b only when the, is performed, and the display content according to the operation desired by the participant is displayed while the operation is not performed. It is displayed on the participant terminal 210b.

2-2-2. Modification 2 of Embodiment 2
In the electronic conference system 2100 according to the second modification of the second embodiment, when the presenter operation reception unit 211 receives the operation content (presenter operation information) by the presenter, the operation type corresponding to the operation content is determined. Instead, the display control unit 215 causes the participant terminal 210b to be in synchronization with the presenter terminal 210a (synchronization mode) and causes the participant terminal 210b to display the display content corresponding to the operation content. Good. Then, when the participant operation acquisition unit 212 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined, and the display control unit 215 displays the participant terminal 210b. While making it asynchronous state (asynchronous mode) with respect to the presenter terminal 210a, the display content according to the said operation content applicable to the said operation classification may be displayed on the participant terminal 210b.

  According to the electronic conference system 2100 according to the second modification of the second embodiment, an operation important by the participant (operation corresponding to the operation type), for example, displayed on the participant terminal 210b in synchronization with the presenter terminal 210a Only when the operation to change the displayed content is performed, an asynchronous state is established and the display content corresponding to the operation is displayed on the participant terminal 210b, and while the above operation is not performed, the presenter desires The display content corresponding to the operation of is displayed on the participant terminal 210b. The electronic conference system 2100 according to the second modification of the second embodiment is configured to automatically shift to the synchronization state when the display content corresponding to the content of the operation by the participant is displayed on the participant terminal 210b. It is also good.

2-2-3. Modification 3 of Embodiment 2
In the electronic conference system 2100 according to the third modification of the second embodiment, the display content corresponding to the operation content by the participant is displayed to the participant terminal 210b while maintaining the synchronization state of the presenter terminal 210a and the participant terminal 210b. It may be displayed on the screen. For example, when the presenter terminal 210a and the participant terminal 210b are in a synchronized state and the first page of the material A is displayed on each display screen, the display control is performed when the participant switches to the second page. The unit 215 divides the display screen into a first screen for synchronous mode and a second screen for asynchronous mode, displays a first page on the first screen corresponding to the synchronous mode, and displays the first page on the second screen. The second page is displayed corresponding to the asynchronous mode. In this case, the size of the first screen may be smaller than that of the second screen. In addition, the first screen and the second screen may be displayed side by side, or the other screen may be displayed overlapping on one screen. Further, in the above example, when the participant performs an operation to select (click) the first screen, the display control unit 215 cancels the asynchronous mode in the second screen and displays the first screen in full screen display. You may switch.

  According to the electronic conference system 2100 according to the third modification of the second embodiment, the participant confirms the same content as the display content of the presenter terminal 210a on the participant terminal 210b and responds to the desired operation. The contents can be displayed.

2-2-4. Modification 4 of Embodiment 2
The electronic conference system 2100 according to the fourth modification of the second embodiment may be configured to maintain the asynchronous state based on the instruction of the participant when the participant terminal 210b is in the asynchronous state. For example, when the participant selects the asynchronous button on the display screen with the mouse pointer, the participant terminal 210b maintains the asynchronous state. Further, for example, while the participant is touching the display screen with a finger, the participant terminal 210b may be configured to maintain the asynchronous state.

  Moreover, in the electronic conference system 2100 according to the fourth modification of the second embodiment, when the asynchronous state is maintained, the operation content of the presenter corresponds to the operation type related to the important operation among the plurality of operation types. May be configured to forcibly cancel the asynchronous state and shift to the synchronous state. The important operations include, for example, display of new materials, writing on materials, and the like.

2-2-5. Modification 5 of Embodiment 2
FIG. 28 is a functional block diagram showing a specific configuration of the participant terminal 210b in the electronic conference system 2100 according to the fifth modification of the second embodiment. In the electronic conference system 2100 according to the fifth modification of the second embodiment, the participant terminal 210b further includes a priority (priority for presenter) of the operation type corresponding to the presenter operation information and the participant operation information. It includes a priority comparison unit 216 that acquires and compares the priority of the corresponding operation type (priority for participants). The priority represents the degree of importance of the operation content of the presenter or the participant. For example, as shown in FIG. 29, “display data” has the highest priority, and thereafter “pen”, “pickup”, “page The priority becomes lower in the order of "switch" and "pointer". The priority is set in advance in the operation type table shown in FIG. The presenter priority and the participant priority may be the same as shown in FIG. 29, or may be different as shown in FIG.

  When the period in which the presenter operation reception unit 211 receives the presenter operation information and the period in which the participant operation acquisition unit 212 acquires the participant operation information overlap with each other, the priority comparison unit 216 sets the respective priorities above. Compare.

  FIG. 31 is an operation flowchart of the teleconference system 2100 according to the fifth modification of the second embodiment. First, in the participant terminal 210b, the presenter operation reception unit 211 receives presenter operation information from the presenter terminal 210a (S211), and the participant operation acquisition unit 212 acquires participant operation information (S212) . Next, the operation type determination unit 213 identifies each of the operation types corresponding to the presenter operation information and the participant operation information (S213). Next, the priority comparison unit 216 acquires each priority (priority for presenter, priority for participant) corresponding to each operation type (S214), and the priority for presenter is for participants It is determined whether it is larger than the priority (S215). If the priority for the presenter is higher than the priority for the participant (YES in S215), the display control unit 215 displays the display content according to the operation content of the presenter on the display screen of the participant terminal 210b. (S216). On the other hand, when the participant priority is higher than the presenter priority (NO in S215), the display control unit 215 displays the display content corresponding to the operation content of the participant on the display screen of the participant terminal 210b. (S217). After the processes of S216 and S217, the above process is repeated until the electronic conference ends (S218).

  As described above, in the electronic conference system 2100 according to the fifth modification of the second embodiment, the display control unit 215 selects the operation information corresponding to the operation type having the higher priority among the presenter operation information and the participant operation information. The display content according to the request is displayed on the display screen of the participant terminal 210b. For example, when the presenter moves the mouse pointer on the material screen (see FIG. 24) displayed on the presenter terminal 210a, the participant screen is displayed on the participant terminal 210b (FIG. 24). Since the participant priority (“2”) is higher than the presenter priority (“1”) when switching the reference page, the display control unit 215 displays “move the mouse pointer” as the participant. “Page switching” is reflected on the participant terminal 210 b without reflecting on the terminal 210 b.

  The electronic conference system 2100 which concerns on the modification 5 of Embodiment 2 is not limited to the said structure. For example, the priority comparing unit 216 may compare the presenter's priority with a predetermined priority set in advance. Then, if the presenter priority is equal to or less than the predetermined priority, the display control unit 215 does not reflect the display content according to the presenter operation information corresponding to the presenter priority on the participant terminal 210b. It is good also as composition.

  Further, in the electronic conference system 2100 according to the fifth modification of the second embodiment, while the display content corresponding to the operation information with high priority is displayed on the participant terminal 210b, the display according to the other operation information After the display content corresponding to the operation information with high priority is displayed on the participant terminal 210b without receiving the content, the display content may be permitted to be received according to the other operation information. For example, while the writing to the material by the pen tool is performed in the participant terminal 210b (asynchronous state), the content of the operation by the presenter (for example, display of new material) is not accepted, and the writing to the material by the presenter The new material may be displayed on the participant terminal 210b at the end of the session.

2-2-6. Modification 6 of Embodiment 2
In the electronic conference system 2100 according to the sixth modification of the second embodiment, the participant operation acquisition unit 212 acquires participant operation information from the participant terminal 210b which is the own terminal, and another participant terminal 210c, The participant operation information may be acquired from 210 d. That is, the participant operation acquisition unit 212 may be configured to acquire the operation information also from another terminal other than the own terminal. Then, in the above configuration, for example, when the operation content in the participant operation information received from the participant terminal 210c corresponds to a predetermined operation type, the operation content may be reflected on the participant terminal 210b. . According to the above configuration, for example, when a comment is posted on the participant terminal 210c, the posted comment is displayed on the participant terminal 210b.

  By the way, in the electronic conference system 2100 according to each embodiment described above, the synchronization determination unit 214 may be omitted. An electronic conference system 2100 not including the synchronization determination unit 214 will be described below as a seventh modification of the second embodiment.

2-2-7. Modification 7 of Embodiment 2
In the electronic conference system 2100 according to the seventh modification of the second embodiment, the display control unit 215 may control the display content of the display screen of the participant terminal 210b based on the determination result of the operation type determination unit 213. . Specifically, when the operation content by the presenter corresponds to a predetermined operation type (see FIG. 25), the display control unit 215 causes the participant terminal 210b to reflect the display content according to the operation content. It may be displayed.

  For example, while reflecting the presenter's operation content (for example, display of a mouse pointer or writing by a pen tool) on the participant terminal 210b, the operation content of the participant is displayed by a mouse pointer or by a pen tool (within the same page) In the case of writing, the operation content of the participant may also be reflected on the participant terminal 210b. That is, both the content of the presenter's operation and the content of the participant's operation may be reflected on the participant terminal 210b. Therefore, it is possible to set an intermediate state (semi-synchronized state) between the synchronous state and the asynchronous state in which the operation content of the participant is simultaneously reflected while reflecting the operation content of the presenter. Thus, the display control unit 215 can realize the semi-synchronous mode regardless of the synchronous mode / asynchronous mode. That is, the display control unit 215 can also change the display content displayed on the participant terminal 210b to display content according to both the operation content of the presenter and the operation content of the participant.

  When the electronic conference system 2100 includes the synchronization determination unit 214, for example, the system shown in the eighth modification of the second embodiment can be configured using the determination result of the synchronization determination unit 214.

2-2-8. Modification 8 of Embodiment 2
FIG. 32 is a functional block diagram showing a specific configuration of the electronic conference system 2100 according to the eighth modification of the second embodiment. In the electronic conference system 2100 according to the eighth modification of the second embodiment, the participant terminal 210b further includes a synchronization information notification unit 217, and the presenter terminal 210a further includes a synchronization information acquisition unit 221 and a display control unit. Contains 222.

  The synchronization information notification unit 217 of the participant terminal 210b indicates the synchronization state indicating whether the participant terminal 210b is synchronized with the presenter terminal 210a, the display content of the display screen when the synchronization is not performed, and the like. The synchronization information containing is transmitted to the presenter terminal 210a.

  The synchronization information acquisition unit 221 of the presenter terminal 210a acquires the synchronization information from the participant terminal 210b. The synchronization information acquisition unit 221 acquires the synchronization information from all the participant terminals included in the electronic conference system 2100.

  The display control unit 222 of the presenter terminal 210a controls the display content of the display screen of the presenter terminal 210a based on the synchronization information acquired by the synchronization information acquisition unit 221. For example, the display control unit 222 calculates the total number (number of synchronizations) of participant terminals in synchronization among all the participants terminals, and displays the number of synchronizations on the display screen of the presenter terminal 210a. In addition, the display control unit 222 calculates the ratio (synchronization rate) of the number of participant terminals in synchronization state to the number of all participant terminals, and displays the synchronization rate on the display screen of the presenter terminal 210a. You may display it. In addition, the display control unit 222 may arrange display contents displayed on the display screen of the participant terminal 210b in an asynchronous state on the display screen of the presenter terminal 210a and display (for example, thumbnail display) .

2-2-9. Modification 9 of Embodiment 2
In the electronic conference system 2100 according to the ninth modification of the second embodiment, in the electronic conference system 2100 according to the eighth modification of the second embodiment, the participant terminal acquisition unit 212 and the operation type determination unit 213 It is omitted. FIG. 33 is a functional block diagram showing a specific configuration of the teleconference system 2100 according to the ninth modification of the second embodiment. The presenter terminal 210a is the same as the configuration shown in FIG. The participant terminal 210b can apply a known operation terminal that performs synchronous display. According to the above configuration, as in the eighth modification of the second embodiment, the display screen of the presenter terminal 210a displays the synchronous rate and the display content of the participant terminal 210b in the asynchronous state. Therefore, the presenter can grasp the degree of interest of the participant for his / her presentation contents.

  The program for realizing the electronic conference system 2100 according to the modified example 9 of the second embodiment is, in a plurality of operation terminals, at least a part of the display screen of the participant terminal 210b (first operation terminal), A program capable of displaying at least a part of the display contents of the presenter terminal 210a (second operation terminal) in a synchronized state and participating in the synchronized state with respect to the number of all the participant terminals 210b. The ratio (synchronization rate) of the number of the user terminals 210b can be a program for causing the computer to function as display control means for displaying the display screen of the presenter terminal 210a. Further, the display control means may display the display content of the participant terminal 210b in the asynchronous state on the display screen of the presenter terminal 210a.

  Each element shown in the second embodiment and the modification of the second embodiment of the electronic conference system 2100 described above is network-connected to the operation terminal 210 (the presenter terminal 210a and the participant terminals 210b, 210c, and 210d). The information processing apparatus may be realized by the CPU executing a program. The information processing apparatus can be, for example, a server 230 shown in FIG. In this case, in the information processing apparatus, the participant operation acquisition unit 212 acquires participant operation information from each participant terminal, and the operation type determination unit 213 specifies an operation type corresponding to each participant terminal. The synchronization determination unit 214 determines synchronization and non-synchronization corresponding to each participant terminal. Further, the display control unit 215 controls the display content of the display screen of each participant terminal based on the determination result of the synchronization determination unit 214.

  Moreover, each modification of the said Embodiment 2 and Embodiment 2 is an example, Comprising: Each form can also be combined.

  Further, the network configuration of the electronic conference system 2100 is not limited to the configuration shown in FIG. For example, as shown in FIG. 34, each operation terminal 210 may be configured (star type) mutually connected via the participant terminal 210b. Further, as shown in FIG. 35, the configuration may be such that the participant terminals 210b, 210c, and 210d are connected starting from the presenter terminal 210a (P2P (Peer to Peer) type).

  Further, in the network configuration shown in FIG. 23, the connection from each operation terminal 210 to the server 230 may be made by the user launching a web browser and specifying a common URL (server), or An application launched on the operation terminal 210 may be automatically connected to the server 230 in accordance with a preset address. In addition, the connection between each operation terminal 210 and the server 230 may be connected by Web Socket, or each operation terminal 210 is connected to the server 230 at regular intervals (polling) to operate the operation terminal in a pseudo manner. Information may be exchanged between 210.

  When the initial setting (default) of the operation terminal 210 is in the asynchronous state, the mutual transition (switching) between the synchronous state and the asynchronous state in the electronic conference system 2100 is released from the asynchronous state and shifted to the synchronous state. If the initial state is a synchronous state, the synchronous state is canceled and the asynchronous state is entered.

  In the above description, the electronic conferencing system has been exemplified as an example of the information processing system, but the information processing system is not limited to the electronic conferencing system, and various types of electronic data sharing between operation terminals connected to a network System is included.

2-3. Advantages of Embodiment 2 The program according to Embodiment 2 of the present invention synchronizes at least a part of the display content of the second operation terminal with at least a part of the display screen of the first operation terminal in a plurality of operation terminals. A first operation acquisition unit that acquires a first operation content indicating the content operated by a first user on the first operation terminal; and the first operation content is The operation content for changing the display content displayed on the first operation terminal in synchronization with the second operation terminal, and in the case where the operation content is predetermined, the display displayed on the first operation terminal The computer is made to function as display control means for changing the content to the display content according to the first operation content. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.

  In the program according to the second embodiment of the present invention, the display control means may switch the display content displayed on the first operation terminal to display content according to the first operation content. According to this configuration, the display content displayed on the first operation terminal is switched to the display content according to the operation content by the user (for example, the meeting participant).

  In the program according to the second embodiment of the present invention, the display control means may switch the display content in which the display content is switched according to the first operation content, together with the display content displayed on the first operation terminal. It may be displayed on the first operation terminal. According to this configuration, the display content in the synchronous state and the display content in the asynchronous state are displayed together on the first operation terminal of the user (conference participant).

  The program according to the second embodiment of the present invention further causes the computer to function as a second operation receiving unit that receives a second operation content indicating content operated by a second user on the second operation terminal, When the second operation receiving means receives the second operation content while the display content corresponding to the first operation content is displayed on the first operation terminal, the second operation content is the second operation content. [2] The operation content for changing the display content displayed on the operation terminal, and in the case where the operation content is predetermined, the display control means performs the display content displayed on the first operation terminal You may change into the display content according to the 2nd operation content. According to this configuration, in the first operation terminal of the user (meeting participant), the display content in the asynchronous state is switched to the display content in the synchronous state according to the operation of the user (presenter).

  The program according to the second embodiment of the present invention further causes the computer to function as a second operation receiving unit that receives a second operation content indicating content operated by a second user on the second operation terminal, A plurality of each of the predetermined operation contents corresponding to the first operation contents and the second operation contents are determined, and in each of the operation contents, the priority is previously determined according to the contents, A period in which the first operation content is acquired by the first operation acquisition means and a period in which the second operation content is received by the second operation reception means overlap, and the first operation content and the second operation content are respectively When the priority of the first operation content is higher than the priority of the second operation content, the display control means being included in the predetermined operation content of , The said display contents displayed on the first operation terminal may be changed to the display contents corresponding to the first operation content. According to this configuration, when the priority of the operation content of the user (conference participant) is higher than the priority of the operation content of the user (presenter), the display content displayed on the first operation terminal is the user It is switched to the display content according to the operation content by the (conference participant).

  The program according to the second embodiment of the present invention further causes the computer to function as a second operation receiving unit that receives a second operation content indicating content operated by a second user on the second operation terminal, A plurality of each of the predetermined operation contents corresponding to the first operation contents and the second operation contents are determined, and in each of the operation contents, the priority is previously determined according to the contents, A period in which the first operation content is acquired by the first operation acquisition means and a period in which the second operation content is received by the second operation reception means overlap, and the first operation content and the second operation content are respectively When the priority of the second operation content is higher than the priority of the first operation content, the display control means being included in the predetermined operation content of , The said display contents displayed on the first operation terminal may be changed to the display contents corresponding to the second operation content. According to this configuration, when the priority of the operation content of the user (presenter) is higher than the priority of the operation content of the user (conference participant), the display content displayed on the first operation terminal is the user It is possible to switch to the display content according to the operation content by (the presenter).

  In the program according to the second embodiment of the present invention, the display control means sets a ratio of the number of the first operation terminals in the synchronized state to the number of all the first operation terminals in the second operation terminal. It may be displayed on the display screen. According to this configuration, the ratio (synchronization rate) of the number of first operation terminals in synchronization to the number of all first operation terminals is displayed on the second operation terminal.

  The program according to the second embodiment of the present invention may display at least a part of the display content of the second operation terminal in a synchronized state on at least a part of the display screen of the first operation terminal in a plurality of operation terminals. A possible program which comprises: synchronization release means for releasing the synchronization state by a predetermined operation of a first user of the first operation terminal; and in the state where the synchronization state is released, the second operation terminal The computer is made to function as resynchronization means for returning to the synchronization state again by a predetermined operation by a second user. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.

  The program may be stored in a computer readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the operation terminal.

An information processing apparatus according to a second embodiment of the present invention causes at least a portion of the display content of the second operation terminal to be displayed in synchronization on at least a portion of the display screen of the first operation terminal in a plurality of operation terminals. A first operation acquisition unit configured to acquire a first operation content indicating the content operated by a first user on the first operation terminal; and the first operation content is The operation content for changing the display content displayed on the first operation terminal in synchronization with the second operation terminal, and in the case where the operation content is predetermined, the display displayed on the first operation terminal And display control means for changing the contents into display contents according to the first operation contents. The information processing apparatus may be the operation terminal. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.
An information processing apparatus according to a second embodiment of the present invention causes at least a portion of the display content of the second operation terminal to be displayed in synchronization on at least a portion of the display screen of the first operation terminal in a plurality of operation terminals. An information processing apparatus capable of canceling the synchronization state according to a predetermined operation by the first user of the first operation terminal, and the synchronization state when the synchronization state is canceled. Re-synchronizing means for returning again to the synchronized state by a predetermined operation by a second user of the second operating terminal. The information processing apparatus may be the operation terminal. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.

  An information processing system according to a second embodiment of the present invention includes a first operation terminal and a second operation terminal, and at least a part of a display screen of the first operation terminal is at least a part of display content of the second operation terminal. An information processing system capable of displaying a part in a synchronized state, wherein the first operation acquisition unit acquires a first operation content indicating content operated by a first user on the first operation terminal; The first operation content is an operation content for changing the display content displayed on the first operation terminal in synchronization with the second operation terminal, and the first operation content is a predetermined operation content. (1) Display control means for changing the display content displayed on the operation terminal to display content corresponding to the first operation content. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.

  A recording medium according to Embodiment 2 of the present invention is to display at least a part of display content of a second operation terminal in a synchronized state on at least a part of a display screen of a first operation terminal in a plurality of operation terminals. A first operation acquisition unit for acquiring a first operation content indicating the content operated by a first user on the first operation terminal, the first operation content being the second operation terminal Operation content for changing the display content displayed on the first operation terminal in synchronization with the first operation terminal, and in the case where the operation content is predetermined, the display content displayed on the first operation terminal is A program for causing a computer to function is recorded as display control means for changing display contents according to the first operation contents. The computer may be the operation terminal. According to this configuration, in the operation terminal displayed in synchronization with another operation terminal in the electronic conference, the operation according to the user's desired operation is performed without requiring the synchronous / asynchronous switching operation by the user of the operation terminal. The content is displayed. Therefore, the convenience of the user is improved.

3-1. Embodiment 3
An object of Embodiment 3 of the present invention is to provide an information processing apparatus, an information processing system, a program, and a recording medium which can appropriately set or transfer the presenter's authority in a meeting. In the third embodiment, as an example of the information processing system, an electronic conference system in which electronic data such as materials and media data such as audio data and image data are shared between a plurality of terminals connected via a network is exemplified. Explain. The meaning of the terms in the third embodiment is limited to the scope of the third embodiment.

3-2. Embodiment 3-1
FIG. 36 is an entire configuration diagram of an electronic conference system according to Embodiment 3-1. The electronic conference system 3100 (information processing system) is configured to include a plurality of terminals 310 used by a plurality of users attending the meeting, and a server 320 (information processing apparatus) which manages the terminals 310. In the embodiment 3-1, for convenience of explanation, a user who is in charge of presentation in a meeting and who is a facilitator of the meeting is referred to as a "presenter", and a terminal used by the presenter is referred to as a "presenter terminal". In addition, users who attend meetings other than the presenter are referred to as "participants", and terminals used by the participants are referred to as "participant terminals". For example, in FIG. 36, when the terminal 310a is a presenter's terminal, the other five terminals 310b, 310c, 310d, 310e, and 310f are participant's terminals. Each terminal can be either a presenter terminal or a participant terminal. In addition, the presenter terminal is given the operation authority, whereby the display screen according to the content operated by the presenter on the presenter terminal is synchronously displayed on the other participant terminals. In the following, when describing the functions common to the presenter terminal and the participant terminal, they will be collectively referred to as the terminal 310.

  As shown in FIG. 36, the terminals 310a, 310b, 310c, 310d, 310e and 310f and the server 320 are mutually connected via a communication network 330 such as a LAN (Local Area Network) or the Internet.

  FIG. 37 is a block diagram showing the hardware configuration of the server 320. As shown in FIG. The server 320 is configured by a computer including a CPU 3201, a memory 3202, a storage unit 3203, and a communication unit 3204. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 3201 controls each unit of the server 320 and executes various information processing. The memory 3202 holds various programs and data. In the memory 3202, a work area of the CPU 3201 is also secured. A storage unit 3203 stores data such as various files and documents. The communication unit 3204 performs data communication with the terminal 310 via the communication network 330. The storage unit 3203 may be provided outside the server 320 and may be connected to the server 320 via the communication network 330.

  The terminal 310 is a terminal (user terminal) used by a user who attends the meeting. The terminal 310 includes an operation unit and a display unit (not shown). The operation unit is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. The display unit is a display screen that displays various files, documents, and the like via application software such as a web browser. In addition, the display unit displays an operation screen for receiving an operation of the user in the conference. The terminal 310 incorporates software such as a browser and an e-mail client. The terminal 310 is, for example, a personal computer, a personal digital assistant (PDA), a portable information terminal such as a smartphone, or the like. Note that one terminal 310 may be, for example, one browser, one window in the browser, or one application.

  FIG. 38 is a functional block diagram showing a specific configuration of the server 320. As shown in FIG. The server 320 includes a reception processing unit 321, a communication connection unit 322, a terminal determination unit 323, a notification unit 324, a terminal information update unit 325, and a terminal state determination unit 326. These elements are realized by the CPU 3201 executing a program stored in the memory 3202. The storage unit 3203 includes a terminal information database (terminal information DB 331) for storing terminal information, and a file database (file DB 332) for storing data such as various files and documents.

  The program may be installed in the server 320 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or may be downloaded via the communication network 330 such as the Internet. The program may be downloaded from a server stored beforehand.

  Also, the program may be installed in each terminal 310. For example, as shown in FIG. 39, in a network configuration in which each terminal 310 is connected to the network via the server 320, when each terminal 310 is connected to the server 320, the program causes the server 320 to store the memory of each terminal 310. And the material data for the conference may be downloaded to the storage unit. The program and the material data may be configured by JavaScript (registered trademark), for example. The terminal 310 having the program downloaded or recorded functions as an information processing apparatus. The computer from which the program is downloaded may be the terminal 310 or the server 320.

  In the embodiment 3-1, the server 320 has a program for realizing each function shown in FIG. When each terminal 310 is connected to the server 320, for example, the material data of the file DB 332 used for the conference and the display control program for controlling the display content on the display unit of the terminal 310 are downloaded to each terminal 310 Ru.

  The reception processing unit 321 receives (receives) various information (operation information, request information, and the like) corresponding to the content operated by the user on each terminal 310, and executes processing according to the information. Examples of the operation information include the operation contents (display of new material, page switching of material, etc.) by the presenter during the conference. Examples of the request information include a request for connection to the server 320 of the terminal 310, a request for disconnection, a request for changing the presenter (a request for transfer of operation authority), and the like. Reception processing unit 321 includes a receiving unit for receiving a connection request from terminal 310 and a function as a transfer request receiving unit for receiving a transfer request for operating authority from terminal 310.

  When receiving the connection request from the terminal 310, the reception processing unit 321 registers the terminal information of the terminal 310 in the terminal list of the terminal information DB 331. The terminal information includes identification information (terminal ID) of the terminal 310 and type information (type ID) indicating whether the terminal 310 is a presenter terminal or a participant terminal. FIG. 40 is a table showing an example of the terminal list. In FIG. 40, “1” indicates a presenter terminal, and “0” indicates a participant terminal. Also, "1" indicates the operation authority. Here, a user who uses the terminal 310a is a presenter of the conference, and each user who uses the terminals 310b, 310c, 310d, 310e, and 310f is a participant of the conference.

  The communication connection unit 322 performs connection and disconnection of communication with the terminal 310 in response to a connection request and a disconnection request received from the terminal 310. Although the communication standard used in the teleconference system 3100 is not particularly limited, for example, Web Socket is preferable.

  The terminal determination unit 323 refers to the terminal list (FIG. 40) of the terminal information DB 331 to determine whether each terminal 310 is registered as a presenter terminal or registered as a participant terminal.

  The notification unit 324 notifies each terminal 310 of various messages such as an inquiry message. The terminal 310 having received the message causes the display unit to display the message. As an example of the content of the message, "Do you want to make a presentation?" Which asks whether you want to make a presentation (acquisition of the operation authority) at the meeting or a person in charge of presentation to the presenter during the meeting ( "Do you allow the presenter's change?", Which is the content asking for permission or refusal of the change of operation (transfer), or the content of the notification when the presenter does not exist at the meeting, It does not do. The notification unit 324 has a function as an inquiry unit.

  Further, the notification unit 324 notifies each participant terminal of operation information (presenter operation information) of the presenter at the start of the meeting and during the meeting. The presenter operation information indicates an operation content such as display of a new material, writing to a material with a pen tool (handwriting tool), pickup of a post comment (selection), page switching of material, input and movement of a mouse pointer, etc. It is information. For example, when the notification unit 324 receives presenter operation information (for example, information of a material ID and page number when the presenter switches the material page) from the presenter terminal, the notification unit 324 notifies the participant terminal of the information. . The notification unit 324 also has a function as an operation information notification unit. When the participant terminal receives the presenter operation information from the notification unit 324, the participant terminal reads out the material data corresponding to the material ID and the page number from the storage unit of the terminal and displays the material data on the display screen. The participant terminal executes the display control program to display the display content corresponding to the presenter operation information on its own display unit. Each terminal 310 has a function as a display control unit.

  The terminal information update unit 325 updates the terminal list (FIG. 40) of the terminal information DB 331 based on the operation content of the user at each terminal 310. For example, when the presenter (operation authority) changes during the meeting, the type ID indicating the type of the presenter terminal and the participant terminal is changed. Further, the terminal information of the terminal 310 newly connected as a participant terminal during the conference is added.

  The terminal state determination unit 326 determines the current state of the terminal 310 during the conference. For example, it determines the time when the presenter operation information is not transmitted from the presenter terminal 310, or determines the time from the transmission of the inquiry message to the presenter terminal 310 until the reply.

  Next, the flow of processing in the electronic conference system 3100 will be described. FIG. 41 is an operation flowchart of the server 320 in the electronic conference system 3100. FIG. 41 schematically shows the overall flow from the start to the end of the conference.

  First, the electronic conference system 3100 starts operation by executing a program stored in the server 320 (S311: start processing). Next, when the reception processing unit 321 of the server 320 receives various operations from each of the terminals 310 (including the presenter terminal and the participant terminal) (S312), each unit of the server 320 responds to the received operation content. Execute the process.

  For example, when the reception processing unit 321 of the server 320 receives a connection request from the terminal 310 in S312, the server 320 executes a "new connection process" described later (S313). The new connection process is performed when the meeting is started or during the meeting.

  In S312, when the reception processing unit 321 receives the presenter operation information from the presenter terminal, the notification unit 324 notifies the presenter terminal of the presenter operation information (S314). Here, it is determined that the terminal 310a is determined to be the presenter's terminal (given the operation authority) and the terminals 310b, 310c, 310d, 310e, and 310f are determined to be participant terminals by the “new connection process”. Assume.

  For example, the reception processing unit 321 displays a new material from the presenter terminal 310a, writes to the material with a pen tool (handwriting tool), picks up a post comment (selection), switches the material page, inputs a mouse pointer, The information indicating the operation content such as movement is received. Here, a specific example of processing content in the presenter terminal 310a will be described. FIG. 42 shows an example of display content displayed on the display screen of the presenter terminal 310a. For example, when the presenter operates the mouse or the like on the presenter terminal 310a to read the material stored in the storage unit of the presenter (operation for displaying a new material on the material screen), the reception processing unit 321 receives presenter operation information including information indicating a material ID and a page number from the presenter terminal 310a. Further, for example, when the presenter operates the mouse on the presenter terminal 310a and inputs the mouse pointer on the material screen (see FIG. 42) displayed on the display unit, the reception processing unit 321 is for the presenter The terminal 310a receives presenter operation information including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like. Further, for example, when the presenter operates the pen tool on the presenter terminal 310a and writes characters or the like on the material screen (see FIG. 42) displayed on the display unit, the reception processing unit 321 is for the presenter The terminal 310a receives presenter operation information including information indicating a written position (coordinates), an ID of a written material, a page number, and the like. Further, for example, when the presenter operates the mouse on the presenter terminal 310a to switch the page of the material screen (see FIG. 42) displayed on the display unit, the reception processing unit 321 is a presenter terminal From 310a, presenter operation information including information indicating the ID of the displayed material and the designated page number is received. A known technique can be applied to the method of synchronous display or asynchronous display.

  When the reception processing unit 321 receives the presenter operation information, the notification unit 324 notifies the participant terminals 310b, 310c, 310d, 310e, and 310f of the presenter operation information. When the participant terminals 310b, 310c, 310d, 310e, and 310f receive the presenter operation information, they display a display screen corresponding to the presenter operation information. For example, the material data corresponding to the material ID and the page number is read out from the storage unit of itself and displayed on the display screen. When the electronic conference system 3100 receives the above-mentioned presenter operation information from the presenter terminal 310a and notifies the participant terminals 310b, 310c, 310d, 310e and 310f, and a series of processes of synchronous display, Returning to S 312, the acceptance processing unit 321 again accepts various operations from each terminal 310.

  In S312, when the reception processing unit 321 receives the presenter change request from the participant terminal 310b, the electronic conference system 3100 executes a “presenter terminal change process” described later (S315).

  When the reception processing unit 321 receives a disconnection request from the terminal 310 in S312, the electronic conference system 3100 executes a “terminal disconnection process” described later (S316). Specifically, the reception processing unit 321 receives a disconnection request from the presenter terminal 310a or receives a disconnection request from the participant terminal 310b during a meeting.

  When the reception processing unit 321 receives an instruction to end the meeting from the terminal 310 (S317), the end processing of the meeting is performed and the meeting is ended (S318). For example, when the reception processing unit 321 receives an instruction to end the conference from the presenter terminal 310a to which the operation authority is given, the notification unit 324 notifies all the participant terminals of a message indicating that the conference is ended, and the communication connection is established. The unit 322 disconnects the network connection with all the terminals 310. When the reception processing unit 321 does not receive the instruction to end the conference, the processing returns to S312 and receives various operations from the terminals 310.

  In addition, when the “new connection process”, the “terminal change process for presenter”, and the “terminal disconnection process” are completed, the process returns to S312 and the reception processing unit 321 receives various operations from each terminal 310.

  Next, the flow of the "new connection process" will be described. FIG. 43 is an operation flowchart of “new connection process” in the electronic conference system 3100.

  For example, the reception processing unit 321 of the server 320 receives a connection request from the terminal 310a (S3101). When receiving the connection request, the reception processing unit 321 registers the terminal information of the terminal 310a in the terminal list (see FIG. 40) of the terminal information DB 331 (S3102). Next, the communication connection unit 322 establishes a communication connection between the server 320 and the terminal 310a (S3103).

  Next, the terminal determination unit 323 refers to the terminal list in the terminal information DB 331, and determines whether the presenter has already determined, that is, whether the terminal 310 to which the operation authority has been granted has already determined. It determines (S3104). Specifically, the terminal determination unit 323 determines whether “1” indicating the presenter's terminal is registered in the terminal list.

  If the presenter has not yet determined (NO in S3104), the notification unit 324 inquires of the terminal 310a whether or not to request a presentation (acquisition of the operation authority) in the meeting (S3105). When the reception processing unit 321 receives an answer indicating that a request for presentation is received from the terminal 310a (YES in S3106), the reception processing unit 321 registers “1” in the type ID column of the terminal 310a in the terminal list (S3107) . That is, the reception processing unit 321 assigns the operation authority to the terminal 310a. The reception processing unit 321 includes a function as an authority giving unit that gives the terminal 310 an operation authority. Thus, the terminal 310a is registered as a presenter terminal. Next, the notification unit 324 requests the presenter terminal 310a to select a material to be used for presentation (S3108). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the reception processing unit 321 registers the received presenter operation information (S3109). Next, the notification unit 324 notifies the above-mentioned presenter operation information to all the participant terminals registered in the terminal list (S3110). Thereafter, the process returns to the process of S312. The notification unit 324 includes a function as a selection request transmission unit that transmits a selection request of a new material to be shared in the conference.

  When the reception processing unit 321 receives an answer from the terminal 310a indicating that the user does not want to make a presentation (NO in S3106), the reception processing unit 321 registers “0” in the type ID column of the terminal 310a in the terminal list. Thus, the terminal 310a is registered as a participant terminal. In this case, since the presenter has not yet been determined, and the reception processing unit 321 has not received the presenter operation information, the notification unit 324 notifies the participant terminal 310a of a standby message. As an example of the content of the waiting message, "Please wait until the presenter makes a decision" and the like can be mentioned. The standby message (standby screen) is displayed on the display screen of the participant terminal 310a. During this time, the participant terminal 310a may be in an asynchronous state, and a desired screen may be displayed according to the user's operation. Next, when the presenter is determined (YES in S3133), the notification unit 324 notifies the participant terminal 310a of the presenter operation information received by the reception processing unit 321 (S3134). Thereafter, the process returns to the process of S312. The above standby message is displayed on the display screen of the participant terminal 310a until the presenter decides (NO in S3133).

  On the other hand, if the presenter has already determined in S3104 (YES in S3104), the reception processing unit 321 registers “0” in the type ID column of the terminal 310a in the terminal list. Thus, the terminal 310a is registered as a participant terminal. Here, when the presenter has already determined, the reception processing unit 321 has already received the presenter operation information from the presenter terminal 310. Therefore, the notification unit 324 immediately notifies the terminal 310a registered as the participant terminal of the above-mentioned presenter operation information (S3134). Thereafter, the process returns to the process of S312.

  Next, the flow of the above-mentioned "presenter terminal change process" will be described. FIG. 44 is an operation flowchart of “presenter terminal change process” in the electronic conference system 3100. Here, the case where the terminal 310a is registered in the presenter's terminal will be described as an example.

  For example, the reception processing unit 321 of the server 320 receives a presenter change request (transfer request of operation authority) from the participant terminal 310b (S3201). Next, the notification unit 324 inquires the presenter terminal 310a whether or not the replacement of the person in charge of the presentation is permitted (S3202). Specifically, the notification unit 324 notifies the presenter terminal 310a of a transfer request for the operation authority.

  Next, the terminal state determination unit 326 determines whether the reception processing unit 321 has received an answer from the presenter terminal 310a (S3203). If the reception processing unit 321 receives the response, the process advances to step S3204, and if the reception process unit 321 does not receive the response, the process advances to step S3220. In S3220, after the terminal state determination unit 326 notifies the presenter terminal 310a of the transfer request, the terminal state determination unit 326 determines whether a predetermined set time has elapsed (S3220). If the answer is received before the set time has elapsed, the process returns to S3203, and if the set time has elapsed, the process proceeds to S3205.

  In S3204, the reception processing unit 321 determines whether the above response received from the presenter terminal 310a is "permitted". If the answer is "permit" (YES in S3204), that is, if the user of the presenter terminal 310a permits the alternation of the presenter (in charge of presentation) (transfer of the operation authority), the notification unit 324 makes a presentation A message to that effect is notified to the participant terminal 310b that has made the person change request (S3205). Next, the reception processing unit 321 (authorization means) changes the type ID column of the terminals 310a and 310b in the terminal list, and the notification unit 324 transmits a message indicating that the presenter has been replaced by the user of the terminal 310b. The terminal 310 is notified of (S3206). Specifically, the reception processing unit 321 changes the type ID of the terminal 310 a from “1” to “0”, and changes the type ID of the terminal 310 b from “0” to “1”. That is, the reception processing unit 321 transfers the operation authority from the terminal 310a to the terminal 310b. Thereby, the terminal 310a is changed to a participant terminal, and the terminal 310b is changed to a presenter terminal.

  Next, the notification unit 324 requests the presenter terminal 310b to select a material to be used for presentation (S3207). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the reception processing unit 321 registers the received presenter operation information (S3208). Next, the notification unit 324 notifies the above-mentioned presenter operation information to all the participant terminals registered in the terminal list (S3209). Thereafter, the process returns to the process of S312.

  On the other hand, if the response received by the reception processing unit 321 from the presenter terminal 310a in S3204 is "reject" (NO in S3204), the notification unit 324 changes the presenter for the presenter terminal 310b. A message indicating that the request has been rejected is notified (S3210). Thereafter, the process returns to the process of S312. According to the above processing, the presenter is replaced during the meeting (the operation authority is transferred).

  Next, the flow of the "terminal disconnection process" will be described. FIG. 45 is an operation flowchart of the “terminal disconnection process” in the electronic conference system 3100.

  For example, when the reception processing unit 321 of the server 320 receives a disconnection request from the terminal 310 during a conference, the terminal determination unit 323 determines whether the terminal 310 that has issued the disconnection request is a presenter terminal, that is, the operation It is determined whether the authority is given (S3401). The disconnection request is made, for example, when the user who is present at the meeting leaves the meeting on demand.

  When the disconnection request is received from the presenter terminal (YES in S3401), the communication connection unit 322 disconnects the communication with the presenter terminal (S3402). In this case, the presenter terminal disappears and the presenter is absent. Therefore, first, the notification unit 324 inquires of all the terminals 310 (participant terminals) whether or not presentation is desired in the meeting (S3403). The notification unit 324 may notify all the terminals 310 of a message indicating that there is no (authorized) terminal having the operation authority. For example, when the reception processing unit 321 receives an answer indicating that the user wishes to make a presentation from the terminal 310c (YES in S3404), the reception processing unit 321 changes the type ID column of the terminal 310c in the terminal list from "0" to "1". Change (S3405). That is, the reception processing unit 321 transfers the operation authority to the terminal 310c. Thus, the terminal 310c is registered as a presenter terminal. Next, the notification unit 324 requests the presenter terminal 310c to select a material to be used for presentation (S3406). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the reception processing unit 321 registers the received presenter operation information (S3407). Next, the notification unit 324 notifies the above-mentioned presenter operation information to all the participant terminals registered in the terminal list (S3408). Thereafter, the process returns to the process of S312.

  On the other hand, when the reception processing unit 321 receives the disconnection request from the participant terminal in S3401 (NO in S3401), the communication connection unit 322 disconnects the communication with the participant terminal (S3410). Thereafter, the process returns to the process of S312. By the above process, the disconnection process of the terminal is performed during the conference.

  According to the configuration of the electronic conference system 3100 described above, even if the presenter is absent at the start of the meeting or the presenter is absent during the meeting, the presenter (operational authority) of the meeting is appropriately set or transferred Because (changed) the conference is not started or the conference progress is not interrupted, efficient conference operation is realized.

  The electronic conference system 3100 which concerns on Embodiment 3-1 is not limited to the said structure. For example, when the network connection of the presenter terminal 310 is disconnected unintentionally due to a system failure or the like and a preset time has elapsed, the processing of S3403 to S3408 in FIG. 45 may be executed. Further, in the electronic conference system 3100, a plurality of users (presentation candidates) who wish to make a presentation may be registered in advance. In this case, when the presenter terminal 310 is disconnected, an inquiry may be made to the terminal 310 as to whether or not the presentation is desired in the candidate order (for example, S3105 in FIG. 43). In addition, the electronic conference system 3100 transmits a message to the effect that the participant X in the conference wishes to be in charge of presentation to the terminals for the other participants, and the electronic conference system 3100 sends the message from the terminals for the participants The presenter terminal may be forcibly changed (transfer of the operation authority) by majority based on the answer.

3-3. Embodiment 3-2
An electronic conference system according to Embodiment 3-2 will be described. The description of the same components and the same functions as those of the electronic conference system 3100 according to the embodiment 3-1 will be omitted as appropriate.

  The electronic conference system 3200 (information processing system) according to the embodiment 3-2 generally has the same function as the electronic conference system 3100 (see FIG. 38) according to the embodiment 3-1, and further, It has a function of controlling communication of media data such as audio data and image data independently of the sharing state (synchronous or asynchronous) of (display contents). For example, the electronic conference system 3200 includes a terminal (a terminal to which an operation right is given) used by a user (presenter) who performs an operation regarding the content displayed on the display screen during the meeting and a user who And the terminal operated by the speaker can realize the case where they are the same and the case where they are different, and can realize efficient operation of the conference.

  FIG. 46 is a block diagram showing a hardware configuration of the terminal 310 and the server 320. The terminal 310 is configured by a computer including a CPU 3101, a memory 3102, a storage unit 3103, a communication unit 3104, an operation unit 3105, a display unit 3106, an audio input unit 3107, and an audio output unit 3108. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 3101 controls each unit of the terminal 310 and executes various information processing. The memory 3102 holds various programs and data. In the memory 3102, a work area of the CPU 3101 is also secured. A storage unit 3103 stores data such as various files and documents. The communication unit 3104 performs data communication with the server 320 and other terminals 310 via the communication network 330. The operation unit 3105 is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. A display unit 3106 is a display screen that displays various files, documents, and the like via application software such as a web browser. In addition, the display unit 3106 displays an operation screen for receiving a user's operation in a conference, materials used for the conference, and the like. The voice input unit 3107 is a microphone to which the voice of the user who spoke in the conference is input. The voice output unit 3108 is a speaker that outputs voice data received from another terminal 310 as voice in a conference. The storage unit 3103, the operation unit 3105, the display unit 3106, the voice input unit 3107, and the voice output unit 3108 may be provided outside the terminal 310 and connected to the terminal 310 via the communication network 330.

  Here, each terminal 310 may have both a transmission function for transmitting voice data uttered by the user and a reception function for receiving the voice data, or each terminal 310 has only one of the functions. It is also good. The function of each terminal 310 can be determined based on an instruction of a user who uses each terminal 310, a form of a meeting, and the like.

  47 and 48 are functional block diagrams showing a specific configuration of the teleconference system 3200. For convenience of explanation, the terminal 310 shown in FIG. 47 (hereinafter also referred to as transmitting terminal) shows a functional block corresponding to the transmitting function, and the terminal 310 shown in FIG. 48 (hereinafter also referred to as receiving terminal) is a receiving function. Shows a functional block corresponding to As described above, the transmitting terminal 310 may further include a receiving function (see FIG. 48), and the receiving terminal 310 may further include a transmitting function (see FIG. 47). The following also refers to the case where each terminal has both of the above functions, as necessary. Further, either the transmission terminal 310 or the reception terminal 310 may have the operation authority, or may not have the operation authority.

  As shown in FIGS. 47 and 48, the server 320 further includes a terminal information generation unit 327 in the configuration of the electronic conference system 3100 (see FIG. 38) according to the embodiment 3-1. The transmission terminal 310 includes a transmission request transmission unit 311, a determination result acquisition unit 312, a terminal information acquisition unit 313, a communication path establishment unit 314, a voice transmission unit 315, and a display control unit 316, as shown in FIG. There is. As shown in FIG. 48, the receiving terminal 310 includes a reception request transmitting unit 341, a determination result acquiring unit 342, a display control unit 343, and an audio receiving unit 344.

  The above elements included in each of the terminals 310 and the server 320 are realized by the respective CPUs 3101 and 3201 executing programs stored in the respective memories 3102 and 3202 (see FIG. 46).

  The program may be installed in the terminal 310 and the server 320 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or downloaded via a communication network 330 such as the Internet. Alternatively, a program corresponding to a predetermined element may be downloaded to each terminal 310 from a server 320 in which a program corresponding to each element is stored in advance.

  Next, the flow of processing in the electronic conference system 3200 will be described. FIG. 49 is an operation flowchart of the server 320 in the teleconference system 3200. FIG. 49 schematically shows the overall flow from the start to the end of the conference.

  When the reception processing unit 321 of the server 320 receives a connection request from the terminal 310 (S313), the server 320 executes the “new connection process” (see FIG. 43) described in the embodiment 3-1. When the reception processing unit 321 receives presenter operation information from the presenter terminal (S314), the notification unit 324 notifies the presenter terminal of the presenter operation information (synchronization display processing). When the reception processing unit 321 receives a presenter change request from the participant terminal 310 (S315), the server 320 executes the “presenter terminal change process” (see FIG. 44) described in the embodiment 3-1. When the reception processing unit 321 receives a disconnection request from the terminal 310 (S316), the server 320 executes the “terminal disconnection process” (see FIG. 45) described in the embodiment 3-1. When the reception processing unit 321 receives a voice transmission request (hereinafter, referred to as a transmission request) (S 321), the server 320 executes a process (“number of terminals determination process”) shown in FIG. 56 described later. When the reception processing unit 321 receives a voice reception request (hereinafter, referred to as a reception request) (S322), the server 320 executes a process ("receiving terminal list generation process") shown in FIG. 57 described later. The reception processing unit 321 includes a transmission request receiving unit that receives a transmission request, and a function as a reception request receiving unit that receives a reception request.

  The following description focuses on the functions of the electronic conference system 3200 for realizing voice communication.

  The transmission request is transmitted from the terminal 310 to the server 320 based on the user's operation. Specifically, first, in the conference, when the user desires to transmit his / her speech (voice) to another terminal 310, that is, transmit voice data between his / her terminal and the other terminal. When it is requested to establish a communication path for communication, an operation unit 3105 of the terminal 310 is operated to give an instruction to that effect. For example, in a conference, the user A displays a selection screen (for example, a check box or an electronic button) of “voice transmission” displayed on the display unit 3106 of the terminal 310 (see FIG. 47) used by himself. Select using etc. The transmission request transmission unit 311 of the terminal 310 transmits the received request of the user A (hereinafter referred to as a transmission request) to the server 320. In addition, for example, when the user A removes the check box of “voice transmission” or satisfies a predetermined condition (described later), the transmission request transmission unit 311 transmits a transmission cancellation request. For example, the transmission request transmission unit 311 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a cancellation request.

  The reception request is transmitted from the terminal 310 to the server 320 based on the user's operation. Specifically, when a user wishes to receive another user's speech (voice) in a conference, the user operates the operation unit 3105 of the terminal 310 to give an instruction to that effect. For example, in a conference, the user B uses a keyboard or a mouse to select a "voice reception" selection screen (for example, a check box or electronic button) displayed on the display unit 3106 of the terminal 310 (see FIG. 48) used by himself. Select using etc. The reception request transmission unit 341 of the terminal 310 transmits the received request of the user B (hereinafter, referred to as a reception request) to the server 320. Note that, for example, when the user B removes the check box of “voice reception” or satisfies a predetermined condition (described later), the reception request transmission unit 341 transmits a cancellation request for reception. For example, the reception request transmission unit 341 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a cancellation request.

  In each terminal 310, selection screens for both "speech transmission" and "speech reception" are displayed, and each user can select each selection screen individually. For example, at terminal 310, user A can also select both "speech transmission" and "speech reception".

  The reception processing unit 321 (transmission request receiving unit) of the server 320 receives the transmission request transmitted from the transmission request transmission unit 311 of the terminal 310. For example, when the transmission request is transmitted from each of the terminals 310a and 310f, the reception processing unit 321 receives the transmission request of both the terminals 310a and 310f.

  The reception processing unit 321 (reception request receiving unit) of the server 320 receives the reception request transmitted from the reception request transmission unit 341 of the terminal 310. For example, when the reception request is transmitted from each of the terminals 310a to 310f, the reception processing unit 321 receives the reception request of each of the terminals 310a to 310f.

  The terminal determination unit 323 of the server 320 determines, based on the transmission request received by the reception processing unit 321, permission or rejection of voice transmission in the terminal 310 that has transmitted the transmission request. Specifically, the terminal determination unit 323 compares the total number of terminals that have received the transmission request received by the reception processing unit 321 with the preset number of terminals set in advance, and determines whether the total number is equal to or less than the preset number It is determined whether or not. Then, if the total number is equal to or less than the set number, the terminal determination unit 323 permits voice transmission at the terminal that has made the transmission request, and rejects voice transmission if the total number exceeds the set number. For example, when the set number is set to “3” and the terminals 310a and 310f make a transmission request, the total number (two) is equal to or less than the set number (three), so the terminals 310a and 310f Allow voice transmission in

  Here, the terminal determination unit 323 calculates the total number of terminals 310 that are requesting transmission at the present time (at the time when the determination target terminal has made a transmission request). For example, when the terminals 310a and 310f have already made a transmission request, and the terminal 310b has made a transmission request anew, the total number at present is three. Therefore, for example, when the set number is set to “2”, the terminals 310a and 310f have already made a transmission request (voice transmission may have already been made), and the terminal 310b newly requests transmission. If the total number (3) exceeds the set number (2), the voice transmission of the terminal 310b which newly made a transmission request is rejected.

  In this manner, voice transmission is permitted until the set number is reached in the order of transmission request. In addition, when the number of terminals 310 permitted to transmit voices reaches the set number, when any one of the terminals 310 cancels the voice transmission (communication path), the other terminals 310 are permitted to transmit voices. It can be given.

  The terminal determination unit 323 transmits the determination results (permission notification, rejection notification) to the terminal 310 that has transmitted the transmission request.

  In addition, the terminal determination unit 323 may determine, based on the reception request received by the reception processing unit 321, permission or rejection of voice reception in the terminal 310 that has transmitted the reception request. For example, the terminal determination unit 323 compares the total number of terminals 310 that have received the reception request received by the reception processing unit 321 with the preset number of terminals set in advance, and determines whether the total number is equal to or less than the preset number. May be determined. Moreover, the permission or rejection of the voice reception may be determined based on other conditions described later (Modification 1 of Embodiment 3 described later). In addition, the terminal determination unit 323 may allow voice reception for all reception requests received by the reception processing unit 321. The terminal determination unit 323 transmits the determination results (permission notification, rejection notification) to the terminal 310 that has transmitted the reception request.

  Furthermore, when the total number of terminals 310 that can make a transmission request reaches the set number, the terminal determination unit 323 indicates that the number of transmission terminals has reached a specified value (the set number) and that no more transmission requests can be made. A notification (message) may be sent to all the terminals 310 connected to the server 320. Similarly, when the number of devices that can make a transmission request in response to the transmission cancellation request falls below the set number, a notification indicating that the transmission request has become possible may be transmitted to all the terminals 310. Alternatively, a notification may be sent indicating the remaining number of units until the set number is reached. For example, when the number of set devices is two, when there is a transmission request from the terminal 310a, the transmission permission is notified to the terminal 310a, and the number of remaining devices until the set number of devices is reached for all the terminals 310 Then, when there is a transmission request from the terminal 310f, the transmission permission is notified to the terminal 310f, and “0 (unit)” is transmitted to all the terminals 310, and this time the terminal 310a is transmitted. If there is a request for cancellation of transmission from the above, "1 (unit)" is transmitted to all the terminals 310. The terminal determination unit 323 may execute the same process as described above for the reception request.

  The terminal information generation unit 327 of the server 320 generates transmission terminal information based on the transmission request received by the reception processing unit 321 and the determination result of the terminal determination unit 323. Specifically, when the total number is equal to or less than the set number, the terminal information generation unit 327 generates a transmission terminal list in which terminal information of the terminals 310 for which voice transmission is permitted is listed. For example, when the transmission request received from the terminals 310a and 310f is permitted, the terminal information generation unit 327 transmits terminal information such as names of the terminals 310a and 310f and identification information (terminal ID, IP address, etc.) in a list. Generate a terminal list. FIG. 50 shows an example of the transmission terminal list. The terminal information generation unit 327 updates the transmission terminal list each time the received transmission request is permitted or each time the transmission request is cancelled. The generated transmission terminal list is stored in the terminal information DB 331.

  Also, the terminal information generation unit 327 generates reception terminal information based on the reception request received by the reception processing unit 321. Specifically, the terminal information generation unit 327 generates a receiving terminal list in which terminal information of the terminals 310 for which the reception request is permitted is listed. For example, when the reception request received from the terminals 310a to 310f is permitted, the terminal information generation unit 327 receives terminal information such as the names of the terminals 310a to 310f and identification information (terminal ID, IP address, etc.) in a list Generate a terminal list. FIG. 51 shows an example of the receiving terminal list. The terminal information generation unit 327 updates the receiving terminal list each time the received request for reception is permitted or each time the request for reception is canceled. FIG. 52 shows the updated receiving terminal list when the new receiving request received from the network-connected terminal 310g (not shown) is permitted in the state of FIG. The generated receiving terminal list is stored in the terminal information DB 331.

  Also, the terminal information generation unit 327 transmits the receiving terminal list to the terminal 310 for which the terminal determination unit 323 permits voice transmission. Furthermore, the terminal information generation unit 327 transmits the updated receiving terminal list to the terminal 310 for which voice transmission is permitted even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted to the terminals 310a and 310f, the terminal information generation unit 327 transmits the receiving terminal list (see FIG. 51) to the terminals 310a and 310f. In addition, even when the receiving terminal list is updated, the terminal information generation unit 327 transmits the updated receiving terminal list to the terminals 310a and 310f. At that time, only the modified (added) receiving terminal list may be transmitted. The terminal information generation unit 327 has a function as a receiving terminal information notification unit.

  The determination result acquisition unit 312 (see FIG. 47) of the terminal 310 receives (or acquires) the determination result in the terminal determination unit 323 of the server 320. For example, the determination result acquisition unit 312 of the terminals 310a and 310f acquires a permission notification of audio transmission from the server 320.

  The terminal information acquisition unit 313 (terminal information reception unit) (see FIG. 47) of the terminal 310 acquires (or receives) the reception terminal list from the terminal information generation unit 327 of the server 320. For example, the terminal information acquisition unit 313 of the terminals 310a and 310f acquires the reception terminal list illustrated in FIG. 51 from the server 320.

  The channel establishment unit 314 (channel establishment unit) (see FIG. 47) of the terminal 310 transmits voice data to another terminal 310 based on the reception terminal list acquired by the terminal information acquisition unit 313. Establish a communication path to do (transmit and receive). The acquired receiving terminal list is stored in the storage unit 3103. For example, the communication channel establishment unit 314 of the terminal 310a establishes a communication channel between the terminal 310a and each of the terminals 310b, 310c, 310d, 310e, and 310f. FIG. 53 shows a network configuration showing communication paths established between the terminal 310a and the terminals 310b, 310c, 310d, 310e and 310f. Similarly, the communication channel establishment unit 314 of the terminal 310f establishes a communication channel between the terminal 310f and each of the terminals 310a, 310b, 310c, 310d, and 310e. FIG. 54 shows a network configuration showing communication paths established between the terminal 310f and the terminals 310a, 310b, 310c, 310d, and 310e, respectively. FIG. 55 shows a network configuration showing all communication paths established in the above example. In FIGS. 53 to 55, the direction of the arrow indicates the transmission direction of audio data. Although FIGS. 53 to 55 show the configuration for transmitting and receiving audio data without passing through the server 320, the network configuration is not limited to this, and the configuration is for transmitting and receiving audio data by using the server 320 as a relay. May be

  Further, establishment of a communication path is performed, for example, for a terminal (sending terminal) that transmits voice, with respect to a terminal (receiving terminal) that receives voice, based on the IP address and port number of the receiving terminal information. Also, for example, when the user A removes the check box of “audio transmission” displayed on the display unit 3106 of the terminal 310 a, the communication path establishment unit 314 cancels the established communication path.

  When the communication channel is established by the communication channel establishment unit 314, the audio transmission unit 315 (see FIG. 47) of the terminal 310 transmits the audio data input to the audio input unit 3107 to each terminal 310 via the communication channel. Send to (deliver). For example, the voice transmission unit 315 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 3107 of the terminal 310a through the communication path (single line in FIG. 55) to the terminals 310b and 310c, Voice data corresponding to the speech (voice) of the user F transmitted to 310d, 310e, and 310f and input to the voice input unit 3107 of the terminal 310f is transmitted to the terminal 310a via the communication path (double line in FIG. 55), It transmits to 310b, 310c, 310d, and 310e. Thereby, the speech (voice data) of the user A and the user F can be transmitted to the other terminal 310 at the same timing, for example. Note that the audio transmission unit 315 may perform stream transmission (streaming) to each terminal 310 or may transmit an audio data file. Further, when both the transmitting terminal and the receiving terminal incorporate a web browser, the voice stream of the transmitting terminal may be connected to the receiving terminal using Web Real-Time Communication (WebRTC).

  The display control unit 316 (see FIG. 47) of the terminal 310 causes the display unit 3106 to display the display content according to the determination result acquired by the determination result acquisition unit 312. For example, when the determination result acquisition unit 312 acquires a permission notification of audio transmission from the server 320, the display control unit 316 causes the display unit 3106 to display a message indicating that the audio transmission is permitted. In addition, when the determination result acquisition unit 312 acquires a rejection notification of audio transmission from the server 320, the display control unit 316 causes the display unit 3106 to display an error message indicating rejection of audio transmission and causes the display unit 3106 to Change so that the displayed "voice transmission" selection screen (check box or electronic button) can not be selected. For example, the electronic button for selecting voice transmission (transmission request) is grayed out (deactivated) and can not be selected (pressed), or the display unit 3106 indicates that "the transmission request can not be made at present". You may display the note of. As described above, the display control unit 316 may control the display content of the display unit 3106 so that the user can not transmit a new voice (transmission request).

  The determination result acquisition unit 342 (see FIG. 48) of the terminal 310 receives (or acquires) the determination result in the terminal determination unit 323 of the server 320. For example, the determination result acquisition unit 342 of the terminals 310a to 310f acquires a permission notification of voice reception from the server 320.

  When the determination result acquisition unit 342 acquires the permission notification, the display control unit 343 (see FIG. 48) of the terminal 310 causes the display unit 3106 to display a message indicating that audio reception is permitted. Further, when the determination result acquisition unit 342 acquires a rejection notification of voice reception from the server 320, the display control unit 343 causes the display unit 3106 to display an error message indicating rejection of voice reception and causes the display unit 3106 to Change so that the displayed "voice reception" selection screen (check box or electronic button) can not be selected.

  The voice receiving unit 344 (see FIG. 48) of the terminal 310 receives voice data transmitted via the communication path. The voice output unit 3108 converts the received voice data and outputs voice. For example, the voice reception unit 344 of each of the terminals 310b, 310c, 310d, 310e, and 310f is a voice corresponding to the speech (voice) of the user A transmitted from the terminal 310a through the communication path (the single line in FIG. 55). The data is received, and each voice output unit 3108 outputs voice. Also, the voice reception unit 344 of each of the terminals 310a, 310b, 310c, 310d, and 310e corresponds to the speech (voice) of the user F transmitted from the terminal 310f via the communication path (the double line in FIG. 55). Audio data is received, and each audio output unit 3108 outputs audio. Thus, for example, the user B, the user C, the user D, and the user E of the terminals 310b, 310c, 310d, and 310e can hear the speech of the user A and the speech of the user F at the same timing.

  Next, the flow of processing in the server 320 will be described using a flow diagram. FIG. 56 is a flowchart of the number-of-terminals determination process when the server 320 receives a transmission request from the terminal 310 (S321 in FIG. 49). This process is executed, for example, by the notification unit 324 (see FIG. 38) of the server 320 notifying the start notification of the conference to the plurality of terminals 310 connected to the server 320 when the conference is started. The same applies to the processing of FIG. 57 and FIG. 58 described later.

  First, when a transmission request is transmitted from the terminal 310, the reception processing unit 321 receives the transmission request (S3501). Next, the terminal determination unit 323 compares the total number of terminals 310 that have made the transmission request with the preset number of terminals set in advance, and determines whether the total number is equal to or less than the preset number (S3502).

  When the total number is equal to or less than the set number, the terminal determination unit 323 transmits an audio transmission permission notification to the terminal 310 that has made the transmission request, and the terminal information generation unit 327 transmits the transmission terminal list (see FIG. 50). See (S3503). Subsequently, the terminal information generation unit 327 transmits, to the terminal 310 registered in the transmission terminal list, a reception terminal list in which the information on the terminal that has made the reception request is listed (S3504).

  In the process of S3502, when the total number exceeds the set number, the terminal determination unit 323 transmits an audio transmission rejection notification to the terminal 310 that has transmitted the transmission request (S3505). The processes of S3501 to S3505 are repeated until the conference is over (S3506).

  FIG. 57 is a flowchart of the reception terminal list generation process when the server 320 receives a reception request from the terminal 310 (S322 in FIG. 49).

  First, when a reception request is transmitted from the terminal 310, the reception processing unit 321 receives the reception request (S3601). Next, the terminal information generation unit 327 generates or updates the reception terminal list (see FIG. 51) (S3602). Next, the terminal information generation unit 327 transmits an audio reception permission notification to the terminal 310 registered in the receiving terminal list (S3603). Here, the case where voice reception is permitted for all reception requests received by the reception processing unit 321 is shown, but the terminal determination unit 323 only performs voice reception if the number is equal to or less than a preset number of units. In the case of permission and rejection, a notification of rejection of voice reception may be sent to the terminal 310. Next, the terminal information generation unit 327 acquires the transmitting terminal list, and transmits the receiving terminal list for each of the terminals 310 registered in the transmitting terminal list (S3604). When the receiving terminal list is changed (updated), only the changed (added) receiving terminal list may be transmitted. The processes of S3601 to S3604 are repeated until the conference is over (S3605).

  FIG. 58 shows a flowchart when the user makes a transmission request at the terminal 310.

  First, in a conference, the terminal 310 receives a transmission request from the user (S3701). Next, the transmission request transmission unit 311 transmits the received transmission request to the server 320 (S3702). When receiving the transmission request, the server 320 executes the processes of S3501 to S3505 shown in FIG.

  Next, the determination result acquisition unit 312 of the terminal 310 acquires a transmission permission notification or a transmission rejection notification from the server 320 (S3703). When the transmission permission notification is acquired, the terminal information acquisition unit 313 acquires the reception terminal list from the server 320 (S3704).

  Next, the communication path establishment unit 314 acquires terminal information (terminal ID) of any one terminal 310 from the reception terminal list (S3705). Next, the communication path establishment unit 314 establishes a communication path for transmitting voice data to the terminal 310 corresponding to the acquired terminal information (S3706). The communication path establishing unit 314 executes processing for establishing communication paths for all the terminals 310 registered in the receiving terminal list (S3707).

  Next, the voice transmission unit 315 sends voice data to each terminal 310 via the established communication path (S3708).

  In the process of S3703, when the determination result acquisition unit 312 acquires the transmission refusal notification from the server 320, the display control unit 316 of the terminal 310 causes the display unit 3106 to display an error message (S3709). The processes of S3701 to S3709 are repeated until the conference is over (S3710).

  As described above, the electronic conference system 3200 according to the embodiment 3-2 sets an upper limit on the number of transmission terminals to which the right to speak is given (speech is transmitted), and according to the user's instruction, the terminals for which transmission is permitted. It is dynamically changed to establish a communication path between a terminal permitted to transmit data and another terminal. Thus, even if the number of terminals connected via the network increases, high-quality data communication can be realized between the terminals. In addition, each user can select according to his / her intention, for example, when transmitting a speech (voice) or when receiving a voice, and the terminals on the network are reflected in the user's intention. The communication path is dynamically changed and established.

  Further, according to the electronic conference system 3200, communication of audio data is controlled independently of the sharing state (synchronous or asynchronous) of the material (display content). For example, when a network of communication channels for transmitting and receiving audio data is constructed as shown in FIG. 55 during a meeting, and the user A of the terminal 310a is a presenter who performs an operation related to the display content, the user A Can also make a statement (for example, an explanation to the contents of the table) while performing the above operation. Thus, the users B to F of the other terminals 310b, 310c, 310d, 310f check the display screen according to the operation content on the terminal 310a on the display screen of their own terminal while It is possible to hear the utterance (description) of the user A output from the audio output unit 3108.

  Further, in the above example, when the presenter is changed from user A to user F (transfer of operation authority) during the meeting, user F speaks while performing an operation related to the new display content (for example, to the table content Description) can be done. Further, in the network configuration of FIG. 55, since the user F has the floor, in this case, even if the operation authority is transferred, it is not necessary to execute construction of a new communication path for voice data. For this reason, even when the presenter takes over, seamless voice communication is possible without interruption or delay of the output voice, and efficient operation of the conference is realized.

  Further, in the above example, when the presenter is changed from the user A to the user B during the meeting, the user B performs an operation regarding a new display content. At this time, when the user B requests voice transmission, a new communication path is established based on the above-described processing. When the user B does not request voice transmission, the network configuration shown in FIG. 55 is maintained. Such a form is suitable for, for example, a usage scene in which a user who operates a material and a user who explains a material are different.

  As described above, according to the electronic conference system 3200, since the sharing state (synchronous or asynchronous) of the material (display content) and the sharing state of the audio data are separately controlled, the sharing state of the material (display content) is A terminal that transmits voice is dynamically switched to another terminal while being maintained, and a communication path is rebuilt, or while a communication path of voice is maintained, a terminal to which an operation authority is given is dynamically switched to another terminal. You can switch to As a result, it becomes possible to mutually transmit and receive audio data among a large number of terminals in a pseudo manner while sharing materials (display contents). That is, it is possible to bi-directionally exchange voices between a large number of terminals while synchronizing the operation content of the material by the presenter.

3-4. Modified Example of Embodiment 3 The configuration for transmitting and receiving voice in the teleconference system 3200 is not limited to the above configuration, and various configurations can be adopted. Hereinafter, the electronic conference system 3200 according to the modification of the third embodiment will be described focusing on differences from the above configuration. In the electronic conference system 3200 according to the modification of the third embodiment described below, the description of the elements having the same function as the electronic conference system 3200 will be omitted.

3-4-1. Modification 1 of Embodiment 3
In the electronic conference system 3200 according to the first modification of the third embodiment, the server 320 may further include a current location acquisition unit 328 for acquiring the current location of each terminal 310. FIG. 59 is a functional block diagram showing a specific configuration of the server 320 according to the first modification of the third embodiment.

  The current location acquisition unit 328 receives, for example, a detection value of a position detection unit (not shown) (for example, GPS etc.) provided in each terminal 310, and acquires the current location (address place etc.) of each terminal 310. . Further, the current location acquisition unit 328 may set location information in advance with an IP address, a subnet of a network, and the like, and acquire the current location of each of the terminals 310 by acquiring the IP address of each of the terminals 310.

  The terminal determination unit 323 is based on the reception request received by the reception processing unit 321 and the current location of each terminal 310 acquired by the current location acquisition unit 328, permission / prohibition of voice reception at the terminal 310 that has transmitted the reception request judge.

  The terminal information generation unit 327 generates reception terminal information based on the reception request received by the reception processing unit 321 and the determination result of the terminal determination unit 323. Specifically, the terminal information generation unit 327 generates a reception terminal list in which information of the terminals 310 permitted by the terminal determination unit 323 is listed among the terminals 310 that have made the reception request. The terminal information generation unit 327 transmits the reception terminal list to the terminal 310 for which the terminal determination unit 323 permits voice transmission.

  Hereinafter, description will be given by taking a specific example. In FIG. 60, terminals 310a, 310b and 310c are provided in the same conference room 3101, a terminal 310d is provided in a place P1 remote from the meeting room 3101, and a terminal 310e is provided in a place P2 remote from the meeting room 3101, The network configuration is shown when the terminal 310 f is provided at a place P3 remote from the conference room 3101.

  In the network configuration of FIG. 60, it is assumed that terminals 310a and 310f transmit transmission requests and terminals 310a to 310f transmit reception requests. Since the total number (2) of transmission requests is less than or equal to the set number (3), the terminals 310a and 310f are permitted to transmit voice.

  The current location acquisition unit 328 acquires the current location from each of the terminals 310a to 310f. That is, the current location acquisition unit 328 acquires the "conference room 3101" as the current location of the terminals 310a, 310b, 310c, acquires the "remote location P31" as the current location of the terminal 310d, and "remote location P32" as the current location of the terminal 310e. And “remote place P33” as the current place of the terminal 310f.

  The terminal determination unit 323 determines whether or not the current location of each terminal 310 is the same place or a predetermined place (predetermined place), and in the case where the plurality of terminals 310 exist in a predetermined place, a plurality of terminals 310 are present. The voice reception is permitted for one of the terminals 310 among the three terminals 310, and the voice reception is rejected for the other terminals 310. In the network configuration of FIG. 60, among the terminals 310a, 310b, 310c existing in a predetermined place (conference room 3101), the voice reception of the terminal 310a is permitted, and the voice reception of the terminals 310b, 310c is rejected. The terminal determination unit 323 transmits the determination results (permission notification, rejection notification) to the terminal that has transmitted the reception request.

  The terminal information generation unit 327 generates the receiving terminal list shown in FIG. 61 based on the above determination result, and transmits it to the terminals 310a and 310f. The terminals 310a and 310f establish a communication path based on the acquired receiving terminal list. FIG. 62 shows a network configuration showing communication paths established in the electronic conference system 3200 according to the first modification of the third embodiment.

  When a plurality of terminals 310 exist in a predetermined place and a transmission request is made in the plurality of terminals 310 among them, the terminal determination unit 323 selects one of the plurality of terminals 310 that has made the transmission request. Voice transmission may be permitted for the three terminals 310, and voice transmission may be rejected for the other terminals 310. For example, when the transmission request is made at the terminals 310a, 310b, 310c existing in the conference room 3101, the voice transmission of the terminal 310a is permitted, and the voice transmission of the terminals 310b, 310c is rejected. The terminal information generation unit 327 transmits the receiving terminal list to the terminal 310a that has permitted voice transmission, and the terminal 310a establishes a communication path based on the acquired receiving terminal list.

  In the network configuration meeting, a plurality of users (for example, users B and C) of a plurality of terminals 310 existing in the same conference room can directly hear the contents of one of the users (for example, user A). Listening to the content of the utterance of another user (for example, users D, E, F) at a remote location by receiving and outputting any one of the terminals 310 (for example, the terminal 310a) of the plurality of terminals 310. it can. Therefore, according to the electronic conference system 3200 in the first modification of the third embodiment, the number of necessary communication paths can be reduced.

3-4-2. Modification 2 of Embodiment 3
In the electronic conference system 3200 according to the second modification of the third embodiment, the set number may be dynamically changed. Specifically, according to the number of all the terminals 310 connected via the communication network 330, the set number may be set. For example, as the number of terminals 310 increases, the set number can be reduced. This configuration is suitable, for example, for an electronic conference such as a seminar in which a speaker (presenter) is determined. Alternatively, the set number may be calculated and set based on the ratio to the number of all the terminals 310 connected via the network. Furthermore, the set number may be set according to the number of terminals 310 that have made a reception request.

3-4-3. Modification 3 of Embodiment 3
In the electronic conference system 3200 according to the third modification of the third embodiment, after the communication path is established, the time when the voice data is not transmitted from the terminal 310 for which the voice transmission is permitted reaches a preset time. The channel establishment unit 314 may release the channel corresponding to the terminal 310. For example, when the user A permitted to transmit the voice does not speak for a certain period of time, the communication path establishment unit 314 forcibly cancels the communication path established in the terminal 310a of the user A. In the above configuration, the user who uses the transmission terminal may be photographed by a camera, and the photographed image may be analyzed to measure the presence or absence of the user's speech and the time of silence. The camera may be built in the terminal 310 or may be installed outside (for example, a conference room).

3-4-4. Modification 4 of Embodiment 3
Here, in the third embodiment, as shown in FIG. 58, when the transmission refusal notification is obtained, the display control unit 316 of the terminal 310 causes the display unit 3106 to display an error message, but voice transmission is performed. Configuration is not limited to this.

  For example, in the electronic conference system 3200 according to the fourth modification of the third embodiment, when the terminal 310 is connected to the server 320, the check box can not be checked if the total number of transmission terminals has already reached the set number. You may control it. In addition, information may be acquired from the server 320 and control of the check box may be performed according to the increase or decrease of the total number of transmission terminals. Acquisition of the total number of transmitting terminals may be performed by polling to the server 320, but preferably, if it is in a connected state using Web Socket etc. and notified to each terminal from the server 320 side good.

  The electronic conference system 3200 may have the following configuration.

  Even if a large number of terminals are connected, the electronic conference system 3200 limits the number of people who can speak simultaneously (the number of transmission terminals) since the number of people speaking at the same time (speaker terminals) at a certain moment is limited. In addition, while the transmission terminal is switched, the communication channel establishment state is dynamically changed. As a result, voice data can be mutually transmitted and received among a large number of terminals in a pseudo manner.

  In addition, the electronic conference system 3200 has a configuration in which voice transmission and voice reception can be selected by each terminal, and the server 320 is notified when the status of voice transmission and voice reception of each terminal changes.

  Also, the server 320 notifies a terminal for which voice transmission is selected, of a list (list) of terminals for which voice reception is selected. At this time, it is not necessary to notify information of a terminal whose status has not changed so far. The notified transmitting terminal makes a call to the receiving terminal so as to receive its own stream information only for the newly registered receiving terminal (call out connection request).

  Further, in the electronic conference system 3200, the server 320 manages the total number of terminals that can simultaneously transmit, and when the total number reaches the upper limit (the number of set terminals), the terminals have a configuration that disables selection of transmission requests. .

  Further, in the electronic conference system 3200, the transmitting terminal includes two types of a transmitting terminal and a temporary transmitting terminal, and among these, the transmitting terminal can transmit only for a certain period of time, and after a certain period of time The transmission may be canceled (the check box of the transmission request is cancelled). In addition, the temporary transmission terminal may be configured to be able to transmit only while the user presses the voice transmission button. In addition, the temporary transmission terminal may be configured to cancel the transmission request when the silent state continues for a predetermined time.

  Also, in the electronic conference system 3200, the user who wants to speak may make a transmission request at the terminal, and give a speaking right to the user designated at the specific terminal (master terminal) (permit as the transmission terminal).

  Further, in the electronic conference system 3200, when an operation right is given to a certain terminal, the voice transmission of the terminal may be automatically permitted. That is, the electronic conference system 3200 may be configured such that the terminal to which the operation authority is given is a terminal that automatically transmits the voice.

  Each modification of Embodiment 3-1, Embodiment 3-2 and Embodiment 3 of each electronic meeting system described above is an example, and each form can also be combined.

  Also, the network configuration of each electronic conference system is not limited to the configuration shown in FIG. 39, and may be a configuration without the server 320 (FIG. 63). The configuration shown in FIG. 63 is realized by downloading a program corresponding to each element included in the electronic conference system to each of the terminals 310a to 310f. Specifically, each teleconference system is realized by the CPU of each terminal executing the program stored in the memory of each terminal 310a to 310f. The program to be downloaded may be configured, for example, by JavaScript (registered trademark). Further, the terminal 310 having the program downloaded or recorded functions as an information processing apparatus. The computer from which the program is downloaded may be the terminal 310 or the server 320.

  The teleconference system 3200 is not limited to transmission and reception of audio data. That is, the electronic conference system 3200 can be applied to transmission and reception of media data including at least one of audio data and video data (moving image data). Further, each electronic conference system can be applied to various electronic conferences such as a video conference and a telephone conference. In the video conference, the video taken by the camera mounted on each terminal is bi-directionally communicated between the terminals via the communication path. Each teleconferencing system can also be applied to teleconferencing where conferees are remote from one another.

  In the above description, the electronic conferencing system has been exemplified as an example of the information processing system, but the information processing system is not limited to the electronic conferencing system, and various types of media data sharing between network connected terminals It includes the system.

3-5. Effects of Third Embodiment The program according to the third embodiment of the present invention is a program for causing a computer to function to synchronously display a part of a display screen among a plurality of terminals connected via a network. Accepting means for receiving a connection request from the plurality of terminals, authority giving means for granting an operation authority to a material to be synchronously displayed on any one of the plurality of terminals having transmitted the connection request, and the terminal A terminal other than the terminal to which the operation authority is given among the plurality of terminals to which the connection request has been transmitted, and the material information of the material displayed on the screen and the operation information indicating the content operated on the material And causing the computer to function as notification means for notifying the user. According to this configuration, the presenter's authority in the meeting is appropriately set or transferred.

  In the program according to the third embodiment of the present invention, the computer further comprises transmission request receiving means for receiving a transmission request of media data including at least one of audio data and video data from at least one terminal, at least one. A reception request receiving unit for receiving the reception request for the media data from the mobile terminal and the transmission request when the total number of the terminals making the transmission request is less than or equal to a predetermined number set The terminal may be made to function as a receiving terminal information notification means for notifying information of the terminal that has made the reception request. According to this configuration, when the total number of terminals requesting transmission is less than or equal to the set number, media data is transmitted between the terminal requesting transmission and the terminal requesting reception. A communication path is established. Therefore, even if the number of terminals connected via the network increases, high quality data communication can be realized between the terminals. Also, media data is communicated independently of the shared state (synchronous or asynchronous) of the material (display content).

  In the program according to the third embodiment of the present invention, when there is no terminal to which the operation right has been granted, the authority giving unit requests acquisition of the operation right to the plurality of terminals that have transmitted the connection request. In addition to making an inquiry, the operation authority is given to a terminal desiring acquisition of the operation authority, and the notification means notifies a terminal not wanting acquisition of the operation authority to display a standby screen. It is also good. According to this configuration, the standby screen is displayed on the terminal that does not want to acquire the operation authority.

  In the program according to the third embodiment of the present invention, transfer request receiving means for receiving the transfer request of the operation authority from any one of the plurality of terminals used by the plurality of participants. And the terminal to which the operation authority has been granted is made to function as an inquiry means for transmitting an inquiry as to whether or not to permit the transfer request, and the authority giving means is the terminal to which the operation authority has been granted. When the reply to the effect that the transfer request is permitted is received, the operation authority may be transferred to the terminal that has transmitted the transfer request. According to this configuration, when the user of the terminal to which the operation authority has been granted permits transfer of the operation authority, the operation authority is transferred to another terminal.

  In the program according to the third embodiment of the present invention, when the predetermined time set in advance has passed since the transmission of the inquiry, the authorization granting unit sends the transfer request to the terminal to which the operation authorization has been granted. The operation authority may be transferred to the terminal which has determined that it has been permitted and which has transmitted the transfer request. According to this configuration, when the set time has elapsed since the transmission of the inquiry, the operation authority is forcibly transferred.

  In the program according to the third embodiment of the present invention, the notifying unit is configured to use the plurality of participants used by the plurality of participants when the terminal to which the operation authority is given is disconnected from the network during a meeting. The terminal may be notified that the terminal to which the operation right has been granted does not exist. According to this configuration, when the terminal to which the operation authority is assigned is disconnected from the network, it is notified to the other terminals that there is no terminal to which the operation authority is assigned.

  In the program according to the third embodiment of the present invention, the notification unit further transmits an inquiry as to whether or not to acquire the operation authority to the plurality of terminals used by the plurality of participants. The authority granting means may transfer the operation authority to a terminal which desires to acquire the operation authority. According to this configuration, when the terminal to which the operation authority has been granted is disconnected from the network, the operation authority is transferred to the terminal desiring to acquire the operation authority.

  In the program according to the third embodiment of the present invention, when the operation authority is further transferred to another terminal, the computer is selected to transmit a selection request of a new material to be shared in a conference to the terminal. Functioning as request transmission means, the notification means notifying the plurality of terminals used by the other plurality of participants of the operation information for the material selected in the terminal to which the operation authority has been transferred You may According to this configuration, the material selected on the terminal to which the operation authority has been transferred is displayed on the display screen of the other terminal.

  In the program according to the third embodiment of the present invention, the notification unit may notify a standby message to the terminal used by the participant if the operation authority is not given to any terminal. Good. According to this configuration, the standby message is displayed on the display screen of the terminal used by the participant until the operation authority is given to any one of the terminals.

  In the program according to the third embodiment of the present invention, the computer is further configured to transmit the transmission request when the total number of the terminals requesting the transmission is equal to or less than a predetermined number set. And a communication path establishing means for establishing a communication path for transmitting the media data between at least one of the terminals having made the reception request. According to this configuration, when the total number of terminals requesting transmission is less than or equal to the set number, media data is transmitted between the terminal requesting transmission and the terminal requesting reception. A communication path is established. Therefore, even if the number of terminals connected via the network increases, high quality data communication can be realized between the terminals. Also, media data is communicated independently of the shared state (synchronous or asynchronous) of the material (display content).

  In the program according to the third embodiment of the present invention, the transmission is performed when the communication path is established between the plurality of terminals requesting the transmission and the plurality of terminals requesting the reception. When the plurality of terminals which have made the request include the terminal to which the operation authority is given and the terminal to which the operation authority is transferred, the communication path establishing means does not change the communication path. May be According to this configuration, the communication path is not changed when the terminals to which the operation request has been given include the terminal to which the operation authority is assigned and the terminal to which the operation authority is transferred.

  In the program according to the third embodiment of the present invention, when the operation authority is given to the terminal, transmission of the media data of the terminal may be permitted. According to this configuration, transmission of media data of the terminal is permitted when the terminal is granted the operation authority.

  In the program according to the third embodiment of the present invention, the computer is further caused to function as current position acquisition means for acquiring the current position of each terminal, and the communication path establishment means is predetermined with the terminal that made the reception request. If a plurality of terminals exist within the range, the communication path may be established for one of the terminals. According to this configuration, when there are a plurality of terminals that have made reception requests within a predetermined range, a communication path is established for one of the terminals.

  In the program according to the third embodiment of the present invention, when a new transmission request is received by the transmission request receiving unit when the total number of terminals that have made the transmission request has reached the set number. The communication path establishing means may reject establishment of the communication path for the terminal which has made a new transmission request. According to this configuration, the establishment of the communication path is rejected at the terminal that has made a new transmission request when the number of terminals that have made a transmission request has reached the set number.

  In the program according to the third embodiment of the present invention, in the case where the time during which the media data is not transmitted from the terminal that has made the transmission request after the communication path has been established reaches a predetermined time, The communication channel establishing means may release the communication channel corresponding to the terminal. According to this configuration, when the time when the media data is not transmitted reaches the time set in advance, the communication path of the corresponding terminal is released.

  In the program according to the third embodiment of the present invention, the computer is further caused to function as a display control unit that controls the display content of the display screen of the terminal, and the display control unit is configured to perform the transmission request. When the total number has reached the set number, the display screen is displayed so that the user can not select the new transmission request, and the total number of the terminals that have made the transmission request is the set number. When the value falls below the condition (4), the display content of the display screen may be changed so that the user can select a new transmission request. According to this configuration, the screen for receiving the transmission request and the screen for not receiving the transmission request are switched and displayed according to the increase or decrease of the total number of transmission terminals.

  The program may be stored in a computer readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal.

  An information processing apparatus according to a third embodiment of the present invention is an information processing apparatus for synchronizing and displaying a part of a display screen among a plurality of terminals connected via a network, and the connection request from the plurality of terminals Of the material displayed on the terminal, the authorization means for giving the operation authority to the material to be synchronously displayed on any one of the plurality of terminals that transmitted the connection request, Notification means for notifying material information and operation information indicating contents operated on the material to a terminal other than the terminal to which the operation authority is given among the plurality of terminals that have transmitted the connection request; It is characterized by including. According to this configuration, the presenter's authority in the meeting is appropriately set or transferred.

  In an information processing apparatus according to a third embodiment of the present invention, transmission request receiving means for receiving a transmission request of media data including at least one of audio data and video data from at least one terminal; and at least one terminal Reception request receiving means for receiving the reception request for the media data, and when the total number of the terminals making the transmission request is equal to or less than a predetermined number set, the terminal having made the transmission request, And receiving terminal information notifying means for notifying information of the terminal that has made the reception request. The information processing apparatus may be the terminal. According to this configuration, when the total number of terminals requesting transmission is less than or equal to the set number, media data is transmitted between the terminal requesting transmission and the terminal requesting reception. A communication path is established. Therefore, even if the number of terminals connected via the network increases, high quality data communication can be realized between the terminals. Also, media data is communicated independently of the shared state (synchronous or asynchronous) of the material (display content).

  An information processing system according to a third embodiment of the present invention synchronizes and displays a part of a display screen among a plurality of terminals connected via a network, and at least a plurality of audio data and video data in the plurality of terminals. An information processing system for transmitting and receiving media data including any, the receiving means for receiving a connection request from the plurality of terminals, and synchronization with any one of the plurality of terminals having transmitted the connection request. The connection request is transmitted to the authority giving means for giving the operation authority to the material to be displayed, the material information of the material displayed on the terminal, and the operation information indicating the content operated on the material Audio data and video data from at least one terminal and notification means for notifying terminals other than the terminal to which the operation authority is given among a plurality of terminals A transmission request receiving means for receiving a transmission request for media data including at least one, a reception request receiving means for receiving a reception request for the media data from at least one terminal, and a total of the terminals having made the transmission request And receiving terminal information notifying means for notifying the terminal, which has made the transmission request, of information on the terminal, which has made the reception request, when the number is equal to or less than a predetermined set number. I assume. According to this configuration, the presenter's authority in the meeting is appropriately set or transferred.

  A recording medium according to Embodiment 3 of the present invention is a program for causing a computer to function to synchronously display a part of a display screen among a plurality of terminals connected via a network, and the plurality of terminals Receiving means for receiving a connection request from the terminal, authority giving means for giving the operation authority to the material to be synchronously displayed on any one of the plurality of terminals which transmitted the connection request, and displayed on the terminal Notification to notify the terminals other than the terminal to which the operation authority has been granted among the plurality of terminals that have transmitted the connection request, and the operation information indicating the content of the operation performed on the selected information A program for causing a computer to function is recorded as a means. According to this configuration, the presenter's authority in the meeting is appropriately set or transferred.

  In the recording medium according to Embodiment 3 of the present invention, the computer further comprises transmission request receiving means for receiving a transmission request of media data including at least one of audio data and video data from at least one terminal, Reception request receiving means for receiving the reception request for the media data from the plurality of terminals, and when the total number of the terminals making the transmission request is equal to or less than a predetermined number of set terminals, the transmission request is performed A program for causing the terminal to function as receiving terminal information notification means for notifying information of the terminal that has made the reception request may be recorded. The computer may be the terminal. According to this configuration, when the total number of terminals requesting transmission is less than or equal to the set number, media data is transmitted between the terminal requesting transmission and the terminal requesting reception. A communication path is established. Therefore, even if the number of terminals connected via the network increases, high quality data communication can be realized between the terminals. Also, media data is communicated independently of the shared state (synchronous or asynchronous) of the material (display content).

4-1. Embodiment 4
The fourth embodiment of the present invention provides an information processing apparatus, an information processing system, a program, and a recording medium capable of separately controlling material and voice separately between a plurality of terminals and maintaining the secrecy of the conference. The purpose is In the fourth embodiment, as an example of an information processing system, an electronic conference system in which electronic data such as materials and media data such as audio data and image data are shared (synchronized) among a plurality of terminals connected via a network. This will be described by way of example. The meaning of the terms in the fourth embodiment is limited to the scope of the fourth embodiment.

  FIG. 64 is an entire configuration diagram of the electronic conference system according to the fourth embodiment. The electronic conference system 4100 (information processing system) includes a plurality of terminals 410 used (operated) by a plurality of users attending the meeting, a terminal management server 420 managing the terminals 410, and materials used for the meeting. And a file management server 430 that manages files. The terminal management server 420 and the file management server 430 may be included in one information processing apparatus. In the fourth embodiment, the user in charge of the presentation at the meeting is referred to as a "presenter" and the terminal used by the presenter is referred to as a "presenter terminal", as necessary. In addition, users who attend meetings other than the presenter are referred to as "participants", and terminals used by the participants are referred to as "participant terminals". For example, in FIG. 64, when the terminal 410a is a presenter's terminal, the other five terminals 410b, 410c, 410d, 410e, and 410f are participant's terminals. Each terminal 410 can be either a presenter terminal or a participant terminal. In addition, the presenter terminal is given the operation authority, whereby the display screen according to the content operated by the presenter on the presenter terminal is synchronously displayed on the other participant terminals. In addition, the presenter may have a voice (voice transmission right) to speak on materials and the like at the meeting. The voice may be possessed by one user, or may be possessed by a plurality of users. In the following, when describing the functions common to the presenter terminal and the participant terminal, they will be collectively referred to as the terminal 410.

  Each terminal 410 has both a transmission function of transmitting voice data uttered by the user and a reception function of receiving the voice data. Thus, for example, the presenter operates the material displayed on his / her terminal 410 to synchronously display it on the participant's terminal 410, speaks the explanation about the material, and outputs the spoken voice from the participant's terminal 410 It can be done.

  As shown in FIG. 64, the terminals 410a, 410b, 410c, 410d, 410e, and 410f, the terminal management server 420, and the file management server 430 communicate via a communication network 450 such as a LAN (Local Area Network) or the Internet. Are connected to each other.

  FIG. 65 is a block diagram showing a hardware configuration of the terminal 410, the terminal management server 420, and the file management server 430.

  The terminal 410 is configured by a computer including a CPU 4101, a memory 4102, a storage unit 4103, a communication unit 4104, an operation unit 4105, a display unit 4106, an audio input unit 4107, and an audio output unit 4108. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 4101 controls each unit of the terminal 410 and executes various information processing. The memory 4102 holds various programs and data. In the memory 4102, a work area of the CPU 4101 is also secured. A storage unit 4103 stores data such as various files and documents. The communication unit 4104 performs data communication with the terminal management server 420, the file management server 430, and other terminals 410 via the communication network 450. The operation unit 4105 is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. A display unit 4106 is a display screen that displays various files, documents, and the like via application software such as a web browser. In addition, the display unit 4106 displays an operation screen for receiving a user's operation in a conference, materials used for the conference, and the like. The voice input unit 4107 is a microphone into which the voice of the user who spoke in the conference is input. The voice output unit 4108 is a speaker that outputs voice data received from another terminal 410 as voice in a conference. The storage unit 4103, the operation unit 4105, the display unit 4106, the voice input unit 4107, and the voice output unit 4108 may be provided outside the terminal 410 and connected to the terminal 410 via the communication network 450.

  The terminal 410 is a terminal used by a user attending a conference. The terminal 410 incorporates software such as a browser and an electronic mail client. The terminal 410 is, for example, a personal computer, a personal digital assistant (PDA), a portable information terminal such as a smartphone, or the like. Note that one terminal 410 may be, for example, one browser, one window in the browser, or one application.

  The terminal management server 420 is configured by a computer including a CPU 4201, a memory 4202, a storage unit 4203, and a communication unit 4204. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 4201 controls each unit of the terminal management server 420 and executes various information processing. The memory 4202 holds various programs and data. In the memory 4202, a work area of the CPU 4201 is also secured. A storage unit 4203 stores data such as various files and documents. The communication unit 4204 performs data communication with the terminal 410 and the file management server 430 via the communication network 450. The storage unit 4203 may be provided outside the terminal management server 420, and may be connected to the terminal management server 420 via the communication network 450.

  The file management server 430 is configured by a computer including a CPU 4301, a memory 4302, a storage unit 4303, and a communication unit 4304. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 4301 controls each unit of the file management server 430 and executes various information processing. The memory 4302 holds various programs and data. In the memory 4302, a work area of the CPU 4301 is also secured. A storage unit 4303 stores data such as various files and documents. The communication unit 4304 performs data communication with the terminal 410 and the terminal management server 420 via the communication network 450. The storage unit 4303 may be provided outside the file management server 430, and may be connected to the file management server 430 via the communication network 450.

  FIG. 66 is a functional block diagram showing a specific configuration of the electronic conference system 4100. FIG. 66 shows specific configurations of the terminal management server 420 and the file management server 430.

  The terminal management server 420 includes a reception processing unit 421, a communication connection unit 422, a notification unit 423, a transmission request reception unit 424, a reception request reception unit 425, a determination processing unit 426, and a terminal information generation unit 427. These elements are realized by the CPU 4201 executing a program stored in the memory 4202. The storage unit 4203 includes a terminal information database (terminal information DB 428) for storing terminal information.

  The program may be installed in the terminal management server 420 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or may be downloaded via a communication network 450 such as the Internet. Alternatively, the program may be downloaded from a pre-stored server.

  Also, the program may be installed in each terminal 410. For example, when each terminal 410 is connected to the terminal management server 420, the program may be downloaded from the terminal management server 420 to the memory of each terminal 410 and material data for a conference may be downloaded to the storage unit. The program and the material data may be configured by JavaScript (registered trademark), for example. The terminal 410 having the program downloaded or recorded functions as an information processing apparatus. The computer from which the program is downloaded may be the terminal 410 or the terminal management server 420.

  In the electronic conference system 4100 according to the fourth embodiment, the terminal management server 420 has a program for realizing the functions shown in FIG. Also, when each terminal 410 is connected to the terminal management server 420 and authenticated, for example, data of materials used for the conference, display contents (including synchronous display) on the display unit of the terminal 410, etc. A display control program to be controlled and a communication channel control program to control establishment or disconnection of a communication channel for transmitting and receiving audio data are downloaded.

Synchronized display processing
Next, functions for realizing synchronous display processing in the electronic conference system 4100 will be described.

  The reception processing unit 421 receives (receives) various information (operation information, request information, and the like) corresponding to the content operated by the user at each terminal 410, and executes processing according to the information. Examples of the operation information include the operation contents (display of new material, page switching of material, etc.) by the presenter during the conference. Examples of the request information include a request for connection to the terminal management server 420 of the terminal 410 and a request for disconnection.

  The communication connection unit 422 performs connection and disconnection of communication with the terminal 410 in response to a connection request and a disconnection request received from the terminal 410. Although the communication standard used in the electronic conference system 4100 is not particularly limited, for example, Web Socket is preferable. The method of authenticating the connection with the terminal 410 is not particularly limited, and known techniques can be applied.

  The notification unit 423 notifies each participant terminal of operation information (presenter operation information) of the presenter at the start of the meeting and during the meeting. The presenter operation information indicates an operation content such as display of a new material, writing to a material with a pen tool (handwriting tool), pickup of a post comment (selection), page switching of material, input and movement of a mouse pointer, etc. It is information. For example, when the notification unit 423 receives presenter operation information (for example, information of a material ID when the presenter switches the material page, information of page number) from the presenter terminal, the notification unit 423 notifies the information to the participant terminal. . When the participant terminal receives the information, the participant terminal reads out the material data corresponding to the material ID and the page number from the storage unit of the terminal and displays it on the display screen.

  Here, a specific example of synchronous display in a meeting will be described. Here, it is assumed that the terminal 410a is determined as the presenter's terminal (the operation authority is given), and the terminals 410b, 410c, 410d, 410e, and 410f are determined as the participant's terminals. When the reception processing unit 421 receives the presenter operation information from the presenter terminal 410a, the notification unit 423 notifies the presenter terminal information 410b, 410c, 410d, 410e, and 410f. For example, the reception processing unit 421 displays a new material from the presenter terminal 410a, writes to the material with a pen tool (handwriting tool), picks up a post comment (selection), switches the material page, inputs a mouse pointer, The information indicating the operation content such as movement is received.

  FIG. 67 shows an example of display content displayed on the display screen of the presenter terminal 410a. For example, on the presenter terminal 410a, the presenter operates the operation unit 4105 such as a mouse to read the material stored in the storage unit 4103 of the user (operation of displaying a new material on the material screen) In the case, the reception processing unit 421 receives, from the presenter terminal 410a, presenter operation information including information indicating a material ID and a page number. Further, for example, when the presenter operates the mouse on the presenter terminal 410a and inputs the mouse pointer on the material screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 displays the presenter From the terminal 410a, presenter operation information including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like is received. Further, for example, when the presenter operates the pen tool on the presenter terminal 410a and writes characters or the like on the material screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 displays the presenter The presenter terminal 410a receives presenter operation information including information indicating the written position (coordinates), the ID of the written material, the page number, and the like. Furthermore, for example, when the presenter operates the mouse on the presenter terminal 410a to switch the page of the material screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 is for the presenter The terminal 410a receives presenter operation information including information indicating the ID of the displayed material and the designated page number.

  When the reception processing unit 421 receives the presenter operation information, the notification unit 423 notifies the participant terminals 410b, 410c, 410d, 410e, and 410f of the presenter operation information. When the participant terminals 410b, 410c, 410d, 410e, and 410f receive the presenter operation information, the participant terminals 410b, 410c, 410f, and 410f display a display screen corresponding to the presenter operation information on the display unit 4106. For example, the material data corresponding to the material ID and the page number is read out from the storage unit 4103 of its own and displayed on the display unit 4106. Thus, on the display screen of each of the plurality of terminals 410 used by the plurality of participants participating in the conference, the display content of the display screen of the terminal 410 used by the presenter who operates the material shared in the conference Synchronize and display. A known technique can be applied to the method of synchronous display or asynchronous display in the electronic conference system 4100. The participant terminal executes the display control program to display the display content corresponding to the presenter operation information on its own display unit. Each terminal 410 has a function as a display control unit.

[Communication path establishment processing]
Next, functions for realizing the communication channel establishment process in the electronic conference system 4100 will be described.

  68 and 69 are functional block diagrams showing a specific configuration of the terminal 410 in the electronic conference system 4100. In the following, for convenience of explanation, a terminal 410 (hereinafter also referred to as transmitting terminal) shown in FIG. 68 indicates a functional block corresponding to the transmitting function, and a terminal 410 (hereinafter also referred to as receiving terminal) shown in FIG. The functional block corresponding to the receiving function is shown. As described above, each terminal 410 has both the transmission function (see FIG. 68) and the reception function (see FIG. 69). Further, any one of the transmitting terminal 410 and the receiving terminal 410 may have the above operation authority, or none of them may have the above operation authority.

  As shown in FIG. 68, the transmission terminal 410 includes a transmission request transmission unit 411, a determination result acquisition unit 412, a terminal information acquisition unit 413, a communication path control unit 414, an audio transmission unit 415, and a display control unit 416. There is. As shown in FIG. 69, the reception terminal 410 includes a reception request transmission unit 441, a determination result acquisition unit 442, a display control unit 443, and an audio reception unit 444.

  The above-described elements included in each terminal 410 are realized by the CPU 4101 executing programs stored in the respective memories 4102 (see FIG. 65). The program may be installed in the terminal 410 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or may be downloaded via a communication network 450 such as the Internet. The program corresponding to the predetermined element may be downloaded to each terminal 410 from the terminal management server 420 in which the program corresponding to each element is stored in advance.

  Each function corresponding to the above program will be described. The following description is based on the flow of processing of the electronic conference system 4100 according to the progress of the conference.

  First, when a user wishes to transmit his / her speech (voice) to another terminal 410 in a conference, that is, a channel for transmitting voice data between his / her terminal and the other terminal. When it is requested to establish the command, the operation unit 4105 of the terminal 410 is operated to give an instruction to that effect. For example, in a conference, the user A displays a selection screen (for example, a check box or an electronic button) of “speech transmission” displayed on the display unit 4106 of the terminal 410 (see FIG. Select using etc. The transmission request transmission unit 411 of the terminal 410 transmits the received request of the user A (hereinafter referred to as a transmission request) to the terminal management server 420. For example, when the user A removes the check box of “voice transmission” or satisfies a predetermined condition (described later), the transmission request transmission unit 411 transmits a transmission cancellation request. For example, the transmission request transmission unit 411 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a cancellation request.

  In addition, when a user wishes to receive another user's speech (voice) in a conference, he / she operates the operation unit 4105 of the terminal 410 to give an instruction to that effect. For example, in a conference, the user B uses a keyboard or a mouse to select a "voice reception" selection screen (for example, a check box or an electronic button) displayed on the display unit 4106 of the terminal 410 (see FIG. 69) used by himself. Select using etc. The reception request transmission unit 441 of the terminal 410 transmits the received request of the user B (hereinafter referred to as a reception request) to the terminal management server 420. Note that, for example, when the user B removes the check box of “voice reception” or satisfies a predetermined condition (described later), the reception request transmission unit 441 transmits a cancellation request for reception. For example, the reception request transmission unit 441 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a cancellation request.

  In each terminal 410, selection screens for both "speech transmission" and "speech reception" are displayed, and each user can select each selection screen separately. For example, at terminal 410, user A may select both "speech transmission" and "speech reception".

  The transmission request reception unit 424 of the terminal management server 420 (see FIG. 66) receives the transmission request transmitted from the transmission request transmission unit 411 of the terminal 410. For example, when the transmission request is transmitted from each of the terminals 410a and 410f, the transmission request reception unit 424 receives the transmission request of both the terminals 410a and 410f.

  The reception request reception unit 425 of the terminal management server 420 receives the reception request transmitted from the reception request transmission unit 441 of the terminal 410. For example, when the reception request is transmitted from each of the terminals 410a to 410f, the reception request receiving unit 425 receives the reception request of each of the terminals 410a to 410f.

  Based on the transmission request received by the transmission request reception unit 424, the determination processing unit 426 of the terminal management server 420 determines whether voice transmission is permitted at the terminal 410 that has transmitted the transmission request. Specifically, the determination processing unit 426 compares the total number of terminals 410 that have received the transmission request received by the transmission request receiving unit 424 with the preset number of terminals set in advance, and the total number is less than or equal to the preset number. Determine if there is. Then, the determination processing unit 426 permits voice transmission at the terminal 410 that has made the transmission request when the total number is equal to or less than the set number, and rejects voice transmission when the total number exceeds the set number. For example, when the set number is set to “3” and the terminals 410a and 410f make a transmission request, the total number (two) is equal to or less than the set number (three), so the terminals 410a and 410f Allow voice transmission in

  Here, the determination processing unit 426 calculates the total number of terminals 410 that are requesting transmission at the current time (when the terminal to be determined makes a transmission request). For example, when the terminals 410a and 410f have already made a transmission request, and the terminal 410b has made a transmission request anew, the total number at present is three. Therefore, for example, when the set number is set to “2”, the terminals 410a and 410f have already made a transmission request (voice transmission may already be performed), and the terminal 410b newly requests transmission. If the total number (3) exceeds the set number (2), the voice transmission of the terminal 410b which has newly made a transmission request is rejected.

  In this manner, voice transmission is permitted until the set number is reached in the order of transmission request. Also, when the number of terminals 410 permitted to transmit voices reaches the set number, if any one of the terminals 410 cancels the voice transmission (communication path), the other terminals 410 are permitted to transmit voices. It can be given.

  The determination processing unit 426 transmits the determination results (permission notification, rejection notification) to the terminal 410 that has transmitted the transmission request.

  In addition, the determination processing unit 426 may determine, based on the reception request received by the reception request reception unit 425, permission or rejection of voice reception in the terminal 410 that has transmitted the reception request. For example, the determination processing unit 426 compares the total number of terminals 410 that have received the reception request received by the reception request reception unit 425 with the preset number of terminals set in advance, and determines whether the total number is equal to or less than the preset number. It may be determined. Moreover, the permission or rejection of the voice reception may be determined based on other conditions described later (Modification 1 of Embodiment 4 described later). In addition, the determination processing unit 426 may allow voice reception for all the reception requests received by the reception request receiving unit 425. The determination processing unit 426 transmits the above determination results (permission notification, rejection notification) to the terminal 410 that has transmitted the reception request.

  Furthermore, when the total number of terminals 410 that can make a transmission request reaches the set number, the determination processing unit 426 indicates that the number of transmission terminals has reached a specified value (the set number) and that no more transmission requests can be made. The notification (message) may be transmitted to all the terminals 410 connected to the terminal management server 420. Similarly, when the number of devices that can make a transmission request in response to the transmission cancellation request falls below the set number, a notification indicating that the transmission request has become possible may be transmitted to all the terminals 410. Alternatively, a notification may be sent indicating the remaining number of units until the set number is reached. For example, when the set number is two, when there is a transmission request from the terminal 410a, the transmission permission is notified to the terminal 410a, and the remaining number before reaching the set number for all the terminals 410 is " Next, when there is a transmission request from the terminal 410f, the transmission permission is notified to the terminal 410f, and “0 (unit)” is transmitted to all the terminals 410. When there is a transmission cancellation request from the terminal 410 a, “1 (unit)” is transmitted to all the terminals 410. The determination processing unit 426 may execute the same process as described above for the reception request.

  The terminal information generation unit 427 of the terminal management server 420 generates transmission terminal information based on the transmission request received by the transmission request reception unit 424 and the determination result in the determination processing unit 426. Specifically, when the total number is equal to or less than the set number, the terminal information generation unit 427 generates a transmission terminal list in which terminal information of the terminals 410 for which voice transmission is permitted is listed. For example, when the transmission request received from the terminals 410a and 410f is permitted, the terminal information generation unit 427 transmits terminal information such as the names of the terminals 410a and 410f and identification information (terminal ID, IP address, etc.) in a list. Generate a terminal list. FIG. 70 shows an example of the transmission terminal list. The terminal information generation unit 27 updates the transmission terminal list each time the received transmission request is permitted or each time the transmission request is cancelled. The generated transmission terminal list is stored in the terminal information DB 428.

  Also, the terminal information generation unit 427 generates reception terminal information based on the reception request received by the reception request reception unit 425. Specifically, the terminal information generation unit 427 generates a receiving terminal list in which terminal information of the terminals 410 for which the reception request is permitted is listed. For example, when the reception request received from the terminals 410a to 410f is permitted, the terminal information generation unit 427 receives terminal information such as the names of the terminals 410a to 410f and identification information (terminal ID, IP address, etc.) in a list Generate a terminal list. FIG. 71 shows an example of the receiving terminal list. The terminal information generation unit 427 updates the receiving terminal list each time the received request for reception is permitted or each time the request for reception is canceled. FIG. 72 shows the updated receiving terminal list when the new receiving request received from the network connected terminal 410g (not shown) is permitted in the state of FIG. The generated receiving terminal list is stored in the terminal information DB 428.

  In addition, the terminal information generation unit 427 transmits the above-described reception terminal list to the terminal 410 for which the determination processing unit 426 permits voice transmission. Furthermore, the terminal information generation unit 427 transmits the updated receiving terminal list to the terminal 410 for which voice transmission is permitted even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted to the terminals 410a and 410f, the terminal information generation unit 427 transmits the receiving terminal list (see FIG. 71) to the terminals 410a and 410f. Also, even when the receiving terminal list is updated, the terminal information generation unit 427 transmits the updated receiving terminal list to the terminals 410a and 410f. At that time, only the modified (added) receiving terminal list may be transmitted.

  The determination result acquisition unit 412 (see FIG. 68) of the terminal 410 receives (or acquires) the determination result in the determination processing unit 426 of the terminal management server 420. For example, the determination result acquisition unit 412 of the terminals 410a and 410f acquires a permission notification of voice transmission from the terminal management server 420.

  The terminal information acquisition unit 413 (terminal information reception unit) (see FIG. 68) of the terminal 410 acquires (or receives) the reception terminal list from the terminal information generation unit 427 of the terminal management server 420. For example, the terminal information acquisition unit 413 of the terminals 410a and 410f acquires the receiving terminal list illustrated in FIG. 71 from the terminal management server 420.

  The communication path control unit 414 (control means) (see FIG. 68) of the terminal 410 transmits voice data to another terminal 410 based on the reception terminal list acquired by the terminal information acquisition unit 413 (see FIG. Establish a communication path for transmission / reception. The acquired receiving terminal list is stored in the storage unit 4103. For example, the communication channel control unit 414 of the terminal 410a establishes a communication channel between the terminal 410a and each of the terminals 410b, 410c, 410d, 410e, and 410f. FIG. 73 shows a network configuration showing communication paths established between the terminal 410a and the terminals 410b, 410c, 410d, 410e and 410f. Similarly, the communication channel control unit 414 of the terminal 410f establishes a communication channel between the terminal 410f and each of the terminals 410a, 410b, 410c, 410d, and 410e. FIG. 74 shows a network configuration showing communication paths established between the terminal 410f and the terminals 410a, 410b, 410c, 410d and 410e. FIG. 75 shows a network configuration showing all communication paths established in the above example. In FIGS. 73 to 75, the direction of the arrow indicates the transmission direction of audio data. Although FIG. 73 to FIG. 75 show the configuration for transmitting and receiving audio data without passing through the terminal management server 420, the network configuration is not limited to this, and audio data is transmitted and received using the terminal management server 420 as a relay. The configuration may be

  Further, establishment of a communication path is performed, for example, for a terminal (sending terminal) that transmits voice, with respect to a terminal (receiving terminal) that receives voice, based on the IP address and port number of the receiving terminal information. Further, for example, when the user A removes the check box of “audio transmission” displayed on the display unit 4106 of the terminal 410 a, the communication path control unit 414 cancels the established communication path.

  When the communication channel is established by the communication channel control unit 414, the audio transmission unit 415 (see FIG. 68) of the terminal 410 transmits the audio data input to the audio input unit 4107 to each terminal 410 via the communication channel. Send to (deliver). For example, the voice transmission unit 415 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 4107 of the terminal 410a via the communication path (single line in FIG. 75) to the terminals 410b, 410c, The voice data corresponding to the speech (voice) of the user F transmitted to 410d, 410e and 410f and input to the voice input unit 4107 of the terminal 410f is transmitted to the terminal 410a via the communication path (double line in FIG. 75), It transmits to 410b, 410c, 410d, and 410e. Thereby, the speech (voice data) of the user A and the user F can be transmitted to the other terminal 410 at the same timing, for example. Note that the audio transmission unit 415 may perform stream transmission (streaming) to each terminal 410, or may transmit an audio data file. Further, when both the transmitting terminal and the receiving terminal incorporate a web browser, the voice stream of the transmitting terminal may be connected to the receiving terminal using Web Real-Time Communication (WebRTC).

  The display control unit 416 (see FIG. 68) of the terminal 410 causes the display unit 4106 to display the display content according to the determination result acquired by the determination result acquisition unit 412. For example, when the determination result acquisition unit 412 acquires a permission notification of audio transmission from the terminal management server 420, the display control unit 416 causes the display unit 4106 to display a message indicating that audio transmission is permitted. In addition, when the determination result acquisition unit 412 acquires a rejection notification of voice transmission from the terminal management server 420, the display control unit 416 causes the display unit 4106 to display an error message indicating rejection of voice transmission and the display unit It changes so that the selection screen (check box or electronic button) of "voice transmission" displayed on 4106 can not be selected. For example, the electronic button for selecting voice transmission (transmission request) is grayed out (deactivated) and can not be selected (pressed), or the display unit 4106 indicates that "current transmission request can not be made". You may display the note of. Thus, the display control unit 416 may control the display content of the display unit 4106 so that the user can not transmit a new voice (transmission request).

  The determination result acquisition unit 442 (see FIG. 69) of the terminal 410 receives (or acquires) the determination result in the determination processing unit 426 of the terminal management server 420. For example, the determination result acquisition unit 442 of the terminals 410a to 410f acquires a permission notification of voice reception from the terminal management server 420.

  When the determination result acquisition unit 442 acquires the permission notification, the display control unit 443 (see FIG. 69) of the terminal 410 causes the display unit 4106 to display a message indicating that audio reception is permitted. In addition, when the determination result acquisition unit 442 acquires a notification of rejection of voice reception from the terminal management server 420, the display control unit 443 causes the display unit 4106 to display an error message indicating rejection of voice reception and display unit The selection screen (check box or electronic button) of “voice reception” displayed in 4106 is changed so as not to be selected.

  The voice receiving unit 444 (see FIG. 69) of the terminal 410 receives voice data transmitted via the communication path. The voice output unit 4108 converts the received voice data and outputs voice. For example, the voice receiving unit 444 of each of the terminals 410b, 410c, 410d, 410e, and 410f is a voice corresponding to the speech (voice) of the user A transmitted from the terminal 410a through the communication path (the single line in FIG. 75). The data is received, and each voice output unit 4108 outputs voice. Also, the voice receiving unit 444 of each of the terminals 410a, 410b, 410c, 410d, and 410e corresponds to the speech (voice) of the user F transmitted from the terminal 410f via the communication path (the double line in FIG. 75). Audio data is received, and each audio output unit 4108 outputs audio. Thus, for example, the user B, the user C, the user D, and the user E of the terminals 410b, 410c, 410d, and 410e can hear the speech of the user A and the speech of the user F at the same timing.

  Next, the flow of communication channel establishment processing in the electronic conference system 4100 will be described using a flowchart. FIG. 76 shows a flowchart when the terminal management server 420 receives a transmission request from the terminal 410. This process is executed, for example, by the terminal management server 420 notifying the terminal management server 420 of a plurality of terminals 410 connected to the network when the conference is started. The same applies to the processing of FIG. 77 and FIG. 78 described later.

  First, when a transmission request is transmitted from the terminal 410, the transmission request reception unit 424 receives the transmission request (S4101). Next, the determination processing unit 426 compares the total number of terminals 410 that have made the transmission request with the previously set number of terminals, and determines whether the total number is equal to or less than the set number (S4102).

  When the total number is equal to or less than the set number, the determination processing unit 426 transmits an audio transmission permission notification to the terminal 410 that has made the transmission request, and the terminal information generation unit 427 transmits the transmission terminal list (see FIG. 70). See (S4103). Subsequently, the terminal information generation unit 427 transmits, to the terminal 410 registered in the transmission terminal list, a reception terminal list in which the information on the terminal that has made the reception request is listed (S4104).

  In the process of S4102, when the total number exceeds the set number, the determination processing unit 426 transmits an audio transmission rejection notification to the terminal 410 that has transmitted the transmission request (S4105). The processes of S4101 to S4105 are repeated until the conference is over (S4106).

  FIG. 77 shows a flowchart when the terminal management server 420 receives a reception request from the terminal 410.

  First, when a reception request is transmitted from the terminal 410, the reception request receiving unit 425 receives the reception request (S4201). Next, the terminal information generation unit 427 generates or updates the reception terminal list (see FIG. 71) (S4202). Next, the terminal information generation unit 427 transmits an audio reception permission notification to the terminal 410 registered in the receiving terminal list (S4203). Here, the case where voice reception is permitted for all the reception requests received by the reception request reception unit 425 is shown, but the determination processing unit 426 only receives voice when the number is equal to or less than the preset number set. In the case of rejection, the terminal 410 may be notified of rejection of voice reception. Next, the terminal information generation unit 427 acquires the transmission terminal list, and transmits the reception terminal list for each of the terminals 410 registered in the transmission terminal list (S4204). When the receiving terminal list is changed (updated), only the changed (added) receiving terminal list may be transmitted. The processes of S4201 to S4204 are repeated until the meeting is over (S4205).

  FIG. 78 shows a flowchart of processing (communication path establishment processing) in the terminal 410 when the user makes a transmission request in the terminal 410.

  First, in a conference, the terminal 410 receives a transmission request from the user (S4301). Next, the transmission request transmission unit 411 transmits the received transmission request to the terminal management server 420 (S4302). When the terminal management server 420 receives the transmission request, the terminal management server 420 executes the processing of S4101 to S4105 shown in FIG.

  Next, the determination result acquisition unit 412 of the terminal 410 acquires a transmission permission notification or a transmission rejection notification from the terminal management server 420 (S4303). When the transmission permission notification is acquired, the terminal information acquisition unit 413 acquires the reception terminal list from the terminal management server 420 (S4304).

  Next, the communication path control unit 414 acquires terminal information (terminal ID) of any one terminal 410 from the reception terminal list (S4305). Next, the communication path control unit 414 establishes a communication path for transmitting voice data to the terminal 410 corresponding to the acquired terminal information (S4306). The communication path control unit 414 executes processing for establishing communication paths for all the terminals 410 registered in the receiving terminal list (S4307).

  Next, the voice transmission unit 415 sends voice data to each terminal 410 via the established communication path (S4308).

  In the process of S4303, when the determination result acquisition unit 412 acquires the transmission refusal notification from the terminal management server 420, the display control unit 416 of the terminal 410 displays an error message on the display unit 4106 (S4309). The processes of S4301 to S4309 are repeated until the conference is over (S4310).

  As described above, the electronic conference system 4100 according to the fourth embodiment sets an upper limit on the number of transmission terminals to which the right to speak is given (speech is transmitted) and moves the terminals permitted to transmit according to the user's instruction. It has a configuration to establish a communication path between a terminal permitted to transmit and another terminal by changing it in a way. Thus, even if the number of terminals connected via the network increases, high-quality data communication can be realized between the terminals. In addition, each user can select according to his / her intention, for example, when transmitting a speech (voice) or when receiving a voice, and the terminals on the network are reflected in the user's intention. The communication path is dynamically changed and established.

  Further, according to the electronic conference system 4100, communication of audio data is controlled independently of the sharing state (synchronous or asynchronous) of the material (display content). That is, materials and sounds can be separately controlled synchronously between a plurality of terminals. Therefore, for example, in the case where a network of communication paths for transmitting and receiving audio data is constructed as shown in FIG. 75 during a conference and the user A of the terminal 410a is a presenter who performs an operation related to the display content, The user A can also make a statement (for example, an explanation to the contents of the table) while performing the above operation. Thus, the users B to F of the other terminals 410b, 410c, 410d, 410f check the display screen corresponding to the operation content of the terminal 410a on the display screen of their own terminal while It is possible to hear the utterance (description) of the user A output from the audio output unit 4108.

  In the configuration described above, for example, the document A displayed by the presenter's user A on the display unit 4106 of the terminal 410a is synchronously displayed on the display units 4106 of the terminals 410b to 410f of the participants B to F. The configuration is such that the voices uttered by the user A are output from the terminals 410b to 410f. In addition, when the user A performs an operation on the document X, for example, writing to the document X by a pen tool, picking up a posted comment, switching the page of the document X, or inputting and moving a mouse pointer to the document X The content according to the operation is displayed in synchronization with the display unit 4106 of the terminals 410b to 410f.

  The electronic conference system 4100 according to the fourth embodiment has a function to control voice communication (communication path) of each terminal based on the access right of each user to the material, in addition to the function to realize the above configuration. For example, when user A changes material X to another material Y (displays a new material) in the above configuration, the access right of users B to F to material Y is determined, and the terminal of the user who does not have the access right , Cancel synchronization, or disconnect voice communication.

  Below, the access control process in the electronic conference system 4100 corresponding to the said function is demonstrated.

[Access control processing]
The electronic conference system 4100 according to the fourth embodiment further includes a file management server 430 as a configuration for realizing the access control process. The file management server 430 has functions of managing the material (file) used for the conference and restricting the access of the user (terminal) to the material. Then, the electronic conference system 4100 controls synchronous / asynchronous of the material and voice communication based on the access restriction state of the material in the file management server 430.

  As shown in FIG. 66, the file management server 430 includes a reception processing unit 431, an access determination processing unit 432, and a file transmission unit 433. These elements are realized by the CPU 4301 executing a program stored in the memory 4302 (see FIG. 65). The storage unit 4303 has a file database (file DB 434) for storing various materials (files) used in the conference and an access restriction information database (access restriction information DB 435) in which user access restriction information for each material is associated. It is included.

  The program may be installed in the file management server 430 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or may be downloaded via a communication network 450 such as the Internet. Alternatively, the program may be downloaded from a pre-stored server.

  Also, the program may be installed in each terminal 410. For example, when each terminal 410 is connected to the file management server 430, the program may be downloaded from the file management server 430 to the memory of each terminal 410, and the material data for the conference may be downloaded to the storage unit. The program and the material data may be configured by JavaScript (registered trademark), for example. The terminal 410 having the program downloaded or recorded functions as an information processing apparatus. Further, the computer from which the program is downloaded may be the terminal 410 or the file management server 430. In the electronic conference system 4100 according to the fourth embodiment, the file management server 430 has a program for realizing the functions shown in FIG.

  The reception processing unit 431 receives (receives) an acquisition request for the material stored in the file DB 434 from each of the terminals 410, and executes processing according to the acquisition request. For example, when the user A of the presenter selects the material Y at the terminal 410a, the reception processing unit 431 receives an acquisition request for the material Y from the terminal 410a. When the user B of the participant selects the material Y at the terminal 410b, the reception processing unit 431 receives a request for acquiring the material Y from the terminal 410b. The identification request (ID, password, etc.) of the user may be associated with the acquisition request.

  The access determination processing unit 432 (determination unit) refers to the access restriction information DB 435 based on the acquisition request acquired by the reception processing unit 431, and determines whether access to the material corresponding to the acquisition request is permitted (presence or absence of access right). judge. In the access restriction information DB 435, a plurality of materials, a user who can access each material, and identification information (terminal ID) of a terminal used by the user are registered in association with each other. FIG. 79 is a table showing an example of the access restriction information DB 435. In the example of FIG. 79, users A, B, C, D, E, and F have access to the material X, and users A, B, D, E, and F have the access to the material Y, Users A, B, C, D, and E have access to the material Z. The access determination processing unit 432 transmits the determination result to the terminal management server 420. The presence or absence of each user's access right to each material is registered in advance by a manager or the like and updated as appropriate. The identification information of the terminal may not be registered in advance in the access restriction information DB 435. The terminal identification information may be acquired, for example, by specifying the transmission source terminal when the acquisition request is received.

  The reception processing unit 431 (or the reception processing unit 421 of the server 20) has a function (user specifying unit) for specifying a user who uses the terminal 410 connected to the communication network 450, and the access determination processing unit 432. May determine the presence or absence of the access right with respect to the material corresponding to the said acquisition request about all the specified users.

  The file transmission unit 433 transmits the material to the terminal 410 of the user who has the access right to the material corresponding to the acquisition request.

  The terminal management server 420 executes the following processing. That is, the reception processing unit 421 receives, from the terminal 410 used by the presenter, a notification (change notification) indicating that the material used for the conference has been changed, and the information corresponding to the received change notification (new material Access information etc.) is transmitted to each terminal 410 used by the participant. Further, the reception processing unit 421 receives the above determination result from the file management server 430. The terminal information generation unit 427 updates the receiving terminal list based on the determination result, and transmits the receiving terminal list to the terminal 410 permitted to transmit the voice.

  Upon receiving the updated receiving terminal list, the terminal 410 that performs voice transmission executes processing (described later) for reestablishing a communication path based on the receiving terminal list.

  Next, the flow of access control processing in the electronic conference system 4100 will be described using the flow diagrams of FIG. 80 and FIG. Here, an operation will be described in the case where the user A who is the presenter selects another material Y at the terminal 410 a during a meeting (while the material X is synchronously displayed). Further, it is assumed that the network shown in FIG. 75 corresponding to the receiving terminal list of FIG. 71 is established as the audio communication path. That is, the terminal 410a transmits the voice of the user A to the other terminals 410b, 410c, 410d, 410e and 410f, and the users B to F (participants) of the other terminals 410b, 410c, 410d, 410e and 410f It is assumed that the user can listen to the voice of the user A outputted from the voice output unit 4108 of his / her terminal while confirming the material X on the display screen of his / her terminal.

  First, in the above situation (during a meeting), the user A selects the material Y at the terminal 410a (S441). Then, the reception processing unit 431 of the file management server 430 receives an acquisition request for the material Y from the terminal 410a (S442). The reception processing unit 421 of the terminal management server 420 may receive the acquisition request from the terminal 410 a, and the reception processing unit 421 may transfer the acquisition request to the file management server 430. When the file management server 430 receives the acquisition request, the file transmission unit 433 transmits the material Y to the terminal 410a (S443).

  When the terminal 410a receives the material Y (S444), the terminal 410a transmits, to the terminal management server 420, a notification (change notification) indicating that the material has been changed (S445). Here, the change notification includes the access information of the material Y (for example, the storage destination URL of the material Y). When receiving the change notification, the reception processing unit 421 of the terminal management server 420 transmits the access information of the material Y to each of the terminals 410b, 410c, 410d, 410e, and 410f (S446).

  When each of the terminals 410b, 410c, 410d, 410e, and 410f receives the access information of the material Y (S447), the display unit 4106 displays a message to the effect that the material is changed from the material X to the material Y, and the access information ( Display the storage destination URL of the document Y). The users B, C, D, E and F of the terminals 410b, 410c, 410d, 410e and 410f select the material Y (the storage destination URL of the material Y) in their own terminals (S448). Then, the reception processing unit 431 of the file management server 430 receives an acquisition request for the material Y from each of the terminals 410b, 410c, 410d, 410e, and 410f (S449).

  Next, the access determination processing unit 432 of the file management server 430 determines the presence or absence of the access right of each user with respect to the material Y with reference to the access restriction information DB 435 (see FIG. 79) based on the acquisition request. S450). For example, for the material Y, the users A, B, D, E, and F have access rights, but the user C does not have access rights. Therefore, the access determination processing unit 432 determines that the users B, D, E, and F have “access right” in response to the acquisition request for the material Y received from the terminals 410 b, 410 c, 410 d, 410 e, and 410 f. C is determined as "no access right". The access determination processing unit 432 transmits the determination result to the terminal management server 420 (S450).

  In addition, the file transmission unit 433 transmits the material Y to the terminals 410b, 410d, 410e, and 410f used by the users B, D, E, and F determined to have “access right” (S451). When each of the terminals 410b, 410d, 410e, and 410f receives the material Y (S452), the terminals 410b, 410d, and 410f store the received material Y in each storage unit 4103. Thereafter, each of the terminals 410b, 410d, 410e, and 410f receives, from the terminal management server 420, presenter operation information corresponding to the operation content of the user A on the terminal 410a, and synchronous display for the material Y is performed.

  On the other hand, when the terminal management server 420 receives the above determination result from the access determination processing unit 432 (S 453), the terminal information generation unit 427 updates the receiving terminal list (see FIG. 71) (S 454). Specifically, the terminal information generation unit 427 excludes a terminal used by a user who does not have an access right from the receiving terminal list. Here, the terminal information generation unit 427 excludes the terminal 410c and updates the reception terminal list shown in FIG. The terminal information generation unit 427 transmits the updated receiving terminal list to the terminal 410a that transmits the voice (S455).

  Next, when the terminal 410a receives the receiving terminal list (see FIG. 82) (S456), the communication path control unit 414 receives the receiving terminal list before updating (see FIG. 71) and the receiving terminal list after updating (see FIG. 71). (Refer to FIG. 82) to identify a terminal (excluded terminal) not registered in the updated receiving terminal list (S457). Here, the communication path control unit 414 identifies the terminal 410c. Next, the communication path control unit 414 disconnects the communication path established between the terminal 410a and the specified terminal (S458). Here, the communication path control unit 414 disconnects the communication path between the terminal 410a and the terminal 410c. Thus, the terminal 410a performs communication channel reestablishment. Thereby, the network of the communication path shown in FIG. 75 is updated (reconstructed) to the network shown in FIG. In FIG. 83, “x” shown on the display unit 4106 of the terminal 410c indicates that the document Y is not displayed synchronously.

  In the above process, only the reestablishment of the communication channel in the terminal 410a is shown, but the reestablishment of the communication channel may be performed in all the terminals permitted to transmit the voice. Here, the communication path may be re-established also in the terminal 410 f. Thus, the communication path between the terminal 410 f and the terminal 410 c is also disconnected. Therefore, in this case, the network of the communication path shown in FIG. 75 is updated (reconstructed) to the network shown in FIG.

  According to the above configuration in the teleconference system 4100, when the material is changed during the meeting, the synchronous display of the material and the transmission of the sound are canceled to the user who does not have the access right to the changed material. Can maintain the secrecy and security of materials and meetings.

  As another example, when the user A who is the presenter selects another material Z at the terminal 410 a during a meeting (during the material X is synchronously displayed), the user F is determined as “no access right” ( See Figure 16). In this case, the communication path between the terminal 410a and the terminal 410f and the communication path from the terminal 410f to each terminal are disconnected, and the communication path for voice transmission is updated (reconstructed) to the network shown in FIG.

  Here, in the above configuration (see FIG. 84), for example, for the terminal 410c used by the user who does not have the access right to the material Y, both of the transmission of the material Y and the transmission of the voice are prohibited. The configuration of the teleconference system 4100 is not limited to this. For example, in the above example, the electronic conference system 4100 may be configured to permit transmission of the material Y and prohibit only transmission of the voice, or allow transmission of audio and prohibit only transmission of the material Y. It is also good. Thereby, the convenience and efficiency of the meeting can be enhanced.

4-2. Modification 4-2 of Embodiment 4 4-2. Modification 1 of Embodiment 4
The access control process in the electronic conference system 4100 is not limited to the above configuration, and may have the following configuration.

  First, during the meeting (similar to the above-mentioned situation), the user A selects the material Y at the terminal 410a. Then, the reception processing unit 421 of the terminal management server 420 receives an acquisition request for the material Y from the terminal 410a. Next, the terminal management server 420 acquires the material Y from the file management server 430 based on the presence or absence of the user's access right to the material Y. When the terminal management server 420 has the access right to the material Y of the user A, the terminal management server 420 acquires the material Y and transmits it to the terminal 410a used by the user A. The terminal management server 420 also transmits a notification (change notification) to the effect that the material has been changed to each of the terminals 410b, 410c, 410d, 410e, and 410f.

  Next, the terminal 410a disconnects all communication channels for voice transmission, and transmits a voice transmission request to the terminal management server 420 again. Further, each of the terminals 410b, 410c, 410d, 410e, and 410f, upon receiving the change notification, transmits an acquisition request for the material Y based on the operation (selection of the material Y) of each user. It should be noted that among the terminals 410 of the participant, the terminal permitted to transmit the voice disconnects all the communication paths of the voice transmission as the terminal 410a, and transmits the transmission request of the voice to the terminal management server 420 again.

  Next, the terminal management server 420 acquires the material Y from the file management server 430 based on the presence or absence of the access right of each of the users B, C, D, E, and F to the material Y. The terminal management server 420 attempts to acquire the material Y for each of the terminals 410b, 410c, 410d, 410e, and 410f used by the users B, C, D, E, and F. The terminal management server 420 transmits the material Y to the terminal 410 of the user who has the access right and succeeded in acquiring the material Y. In addition, the terminal management server 420 does not transmit the material Y to the terminal 410 of the user who does not have the access right and fails to obtain the material Y, and disconnects the voice transmission communication path. Here, since the user C does not have the access right to the material Y, the terminal management server 420 disconnects the communication path for the terminal 410 c used by the user C (see FIG. 84).

4-2-2. Modification 2 of Embodiment 4
The access control process in the teleconference system 4100 may have the following configuration.

  First, during the meeting (similar to the above-mentioned situation), the user A selects the material Y at the terminal 410a. Then, the reception processing unit 421 of the terminal management server 420 receives an acquisition request for the material Y from the terminal 410a. Next, the terminal management server 420 acquires the material Y from the file management server 430 based on the presence or absence of the user A's access to the material Y. When the terminal management server 420 has an access right to the material Y of the user A, the terminal management server 420 acquires the material Y and transmits it to the terminal 410a of the user A. In addition, the terminal management server 420 notifies each of the terminals 410b, 410c, 410d, 410e, and 410f of a notification (change notification) indicating that the material has been changed and a notification indicating that the communication path for voice transmission is disconnected (disconnection request). Send to

  Next, each of the terminals 410b, 410c, 410d, 410e, and 410f disconnects their communication paths upon receiving the disconnection request. Further, each of the terminals 410b, 410c, 410d, 410e, and 410f, upon receiving the change notification, transmits an acquisition request for the material Y based on the operation (selection of the material Y) of each user.

  Next, the terminal management server 420 acquires the material Y from the file management server 430 based on the presence or absence of the access right of each of the users B, C, D, E, and F to the material Y. The terminal management server 420 attempts to acquire the material Y for each of the terminals 410b, 410c, 410d, 410e, and 410f used by the users B, C, D, E, and F. The terminal management server 420 transmits the material Y to the terminal 410 of the user who has the access right and succeeded in acquiring the material Y. The terminal 410 having received the material Y receives from the user whether "voice transmission" is desired or "voice reception" is desired. After any one of them is received, the above-described communication channel establishment process (see FIGS. 76 to 78) is performed.

  In addition, the terminal management server 420 does not transmit the material Y to the terminal 410 of the user who does not have the access right and fails to obtain the material Y, and the communication path is not reestablished.

4-2-3. Modification 3 of Embodiment 4
The access control process in the teleconference system 4100 may have the following configuration. That is, in the flow chart of FIG. 81, when the terminal information generation unit 427 updates the receiving terminal list (see FIG. 71) (S454), the terminal management server 420 excludes the terminal 410a and the receiving terminal list from the receiving terminal list (access right Communication path with a terminal used by a user who does not have As described above, the terminal management server 420 may include a function as communication path control means, and execute processing of establishing and disconnecting the communication path between the respective terminals.

4-2-4. Modification 4 of Embodiment 4
The access control process in the teleconference system 4100 may have the following configuration. That is, in the flow chart of FIG. 80, after the terminal 410 receives the access information of the material Y (S447), the user selects the material Y (the storage destination URL of the material Y) at the own terminal 410 (S448) When an attempt is made to acquire Y, but there is no access right and the document Y can not be acquired, the terminal 410 notifies the terminal management server 420 that acquisition of the material Y has failed (notice of acquisition failure). When the terminal management server 420 receives the acquisition failure notification, the terminal information generation unit 427 updates the receiving terminal list. For example, the terminal information generation unit 427 excludes the terminal 410c that has transmitted the acquisition failure notification from the reception terminal list.

4-2-5. Modification 5 of Embodiment 4
As described above, the terminal management server 420 and the file management server 430 may be included in one information processing apparatus. For example, the terminal management server 420 may include the file management server 430. 86 and 87 are flowcharts showing the operation of the access control process in the electronic conference system 4100 according to the fifth modification of the fourth embodiment. The same operations as those in the flowcharts shown in FIGS. 80 and 81 have the same step numbers.

  In the electronic conference system 4100 according to the fifth modification of the fourth embodiment, in the terminal management server 420, when the reception processing unit 431 receives an acquisition request for the material Y from each of the terminals 410b, 410c, 410d, 410e, and 410f (S449) The access determination processing unit 432 determines the presence / absence of the access right of each user to the material Y based on the acquisition request (S450). Next, the terminal information generation unit 427 updates the reception terminal list (see FIG. 71) (S454), and the file transmission unit 433 transmits the material Y to the terminal 410 registered in the updated reception terminal list ( S451). Here, the file transmission unit 433 transmits the material Y to the terminals 410b, 410d, 410e, and 410f except for the terminal 410c. In the subsequent synchronous display process, the notification unit 423 of the terminal management server 420 notifies presenter operation information only to the terminals registered in the receiving terminal list.

4-2-6. Modification 6 of Embodiment 4
The configuration for transmitting and receiving voice in the electronic conference system 4100 is not limited to the above configuration, and various configurations can be adopted. Hereinafter, an electronic conference system 4100 according to the sixth modification of the fourth embodiment will be described focusing on differences from the above configuration. In the electronic conference system 4100 according to the sixth modification of the fourth embodiment, the description of the elements having the same function as the electronic conference system 4100 will be omitted.

  In the electronic conference system 4100 according to the sixth modification of the fourth embodiment, the terminal management server 420 may further include a current location acquisition unit 429 for acquiring the current location of each terminal 410. FIG. 88 is a functional block diagram illustrating a specific configuration of the terminal management server 420 according to the sixth modification of the fourth embodiment.

  The current location acquisition unit 429 receives, for example, a detection value of a position detection unit (not shown) (for example, GPS etc.) provided in each terminal 410, and acquires the current location (address place etc.) of each terminal 410. . In addition, the current location acquisition unit 429 may set location information in advance, such as an IP address or a subnet of a network, and acquire the current location of each terminal 410 by acquiring the IP address of each terminal 410.

  Based on the reception request received by the reception request reception unit 425 and the current location of each terminal 410 acquired by the current location acquisition unit 429, the determination processing unit 426 permits or rejects voice reception at the terminal 410 that has transmitted the reception request. Determine

  The terminal information generation unit 427 generates reception terminal information based on the reception request received by the reception request reception unit 425 and the determination result of the determination processing unit 426. Specifically, the terminal information generation unit 427 generates a reception terminal list in which information of the terminals 410 permitted by the determination processing unit 426 among the terminals 410 that have made the reception request is listed. The terminal information generation unit 427 transmits the reception terminal list to the terminal 410 for which the determination processing unit 426 permits voice transmission. As described above, the terminal information generation unit 427 updates the receiving terminal list based on the determination result of the access determination processing unit 432 (refer to FIG. 66) which has determined permission or rejection of access to the material (presence or absence of access right). .

  Hereinafter, description will be given by taking a specific example. In FIG. 89, terminals 410a, 410b and 410c are provided in the same conference room 4101, a terminal 410d is provided in a place P41 remote from the meeting room 4101, and a terminal 410e is provided in a place P42 remote from the meeting room 4101, It shows a network configuration in the case where the terminal 410 f is provided at a location P 43 remote from the conference room 4101.

  In the network configuration of FIG. 89, it is assumed that terminals 410a and 410f transmit transmission requests and terminals 410a to 410f transmit reception requests. Since the total number (2) of transmission requests is equal to or less than the set number (3), the terminals 410a and 410f are permitted to transmit voice.

  The current location acquisition unit 429 acquires the current location from each of the terminals 410a to 410f. That is, the current location acquisition unit 429 acquires the "conference room 4101" as the current location of the terminals 410a, 410b, and 410c, acquires the "remote location P1" as the current location of the terminal 410d, and "remote location P2" as the current location of the terminal 410e. And “remote place P3” as the current position of the terminal 410f.

  The determination processing unit 426 determines whether or not the current location of each terminal 410 is the same place or a predetermined place (predetermined place), and when the plurality of terminals 410 exist in the predetermined place, a plurality of the plurality of terminals 410 are present. The voice reception is permitted for one of the terminals 410 among the four terminals 410, and the voice reception is rejected for the other terminals 410. In the network configuration of FIG. 89, among the terminals 410a, 410b, and 410c existing in a predetermined place (conference room 4101), the voice reception of the terminal 410a is permitted, and the voice reception of the terminals 410b and 410c is rejected. The determination processing unit 426 transmits the determination results (permission notification, rejection notification) to the terminal that has transmitted the reception request.

  The terminal information generation unit 427 generates the receiving terminal list shown in FIG. 90 based on the above determination result, and transmits it to the terminals 410a and 410f. The terminals 410a and 410f establish a communication path based on the acquired receiving terminal list. FIG. 91 shows a network configuration showing communication paths established in the electronic conference system 4100 according to the sixth modification of the fourth embodiment.

  When a plurality of terminals 410 exist in a predetermined place and a transmission request is made in the plurality of terminals 410 among them, the determination processing unit 426 selects one of the plurality of terminals 410 that has made the transmission request. Voice transmission may be permitted for one terminal 410 and voice transmission may be rejected for the other terminals 410. For example, when the transmission request is made at the terminals 410a, 410b, and 410c existing in the conference room 4101, the voice transmission of the terminal 410a is permitted, and the voice transmission of the terminals 410b and 410c is rejected. The terminal information generation unit 427 transmits the receiving terminal list to the terminal 410a that has permitted voice transmission, and the terminal 410a establishes a communication path based on the acquired receiving terminal list.

  In the network configuration meeting, a plurality of users (e.g., users B and C) of a plurality of terminals 410 present in the same conference room can directly hear the contents of one of the users (e.g., user A). Listening to the content of the utterance of another user (for example, users D, E, F) at a remote location by receiving and outputting any one of the plurality of terminals 410 (for example, the terminal 410a). it can. Therefore, according to the electronic conference system 4100 which concerns on the modification 6 of Embodiment 4, the number of required communication paths can be reduced.

4-2-7. Modification 7 of Embodiment 4
In the electronic conference system 4100 according to the seventh modification of the fourth embodiment, the set number may be dynamically changed. Specifically, the set number may be set according to the number of all the terminals 410 connected via the communication network 450. For example, as the number of terminals 410 increases, the set number can be reduced. This configuration is suitable, for example, for an electronic conference such as a seminar in which a speaker (presenter) is determined. Further, the set number may be calculated and set based on the ratio to the number of all the terminals 410 connected via the network. Furthermore, the set number may be set according to the number of terminals 410 that have made a reception request.

4-2-8. Modification 8 of Embodiment 4
In the electronic conference system 4100 according to the eighth modification of the fourth embodiment, after the communication path is established, the time when the audio data is not transmitted from the terminal 410 for which the audio transmission is permitted has reached a preset time. The channel control unit 414 (see FIG. 68) may release the channel corresponding to the terminal 410. For example, when the user A permitted to transmit the voice does not speak for a certain period of time, the communication path control unit 414 forcibly cancels the communication path established in the terminal 410a of the user A. In the above configuration, the user who uses the transmission terminal may be photographed by a camera, and the photographed image may be analyzed to measure the presence or absence of the user's speech and the time of silence. The camera may be built in the terminal 410 or may be installed outside (for example, a conference room).

4-2-9. Modification 9 of Embodiment 4
In the fourth embodiment, as shown in FIG. 78, the display control unit 416 of the terminal 410 causes the display unit 4106 to display an error message when the transmission refusal notification is obtained, but the voice transmission is rejected. The configuration in the case is not limited to this.

  For example, in the electronic conference system 4100 according to the ninth modification of the fourth embodiment, when the terminal 410 is connected to the terminal management server 420, the check box is selected when the total number of transmission terminals has already reached the set number. You may control so that you can not do it. Further, information may be acquired from the terminal management server 420 and control of the check box may be performed according to the increase or decrease of the total number of transmission terminals. Acquisition of the total number of transmitting terminals may be performed by polling the terminal management server 420, but preferably, it is in a state of being connected using Web Socket etc., and each terminal is connected from the terminal management server 420 side. You just need to notify

4-2-10. Modification 10 of Embodiment 4
The electronic conference system 4100 according to the fourth embodiment may be configured not to include the communication channel establishing process. That is, the terminal management server 420 in the electronic conference system 4100 has a function of synchronizing and displaying a part of the display screen among the plurality of terminals 410 connected via the communication network 450. Specifically, the terminal management server 420 uses a user identification unit (reception processing unit 421) for identifying a user who uses the terminal 410 connected to the communication network 450, and a first user (presenter) in the first terminal 410. A reception processing unit 421 (reception means) for receiving the material information of the material selected by) and the operation information (presenter operation information) operated on the material, and specifying the above for the material of the received material information The above-described material information accepted for the access determination processing unit 432 (determination means) that determines the presence or absence of the access right for all the users who have been used and for the terminal 410 used by the user who is determined to have the access right for the material And a notification unit 423 (notification means) for notifying presenter operation information. The electronic conference system 4100 according to the tenth modification of the fourth embodiment may include conventional voice communication processing.

  According to the configuration of the electronic conference system 4100 according to the tenth modification of the fourth embodiment, for example, the materials synchronized by the user A of the terminal 410a are changed between the terminals already participating in the conference (displayed synchronously) In this case, the changed new material is displayed on the terminal of the user who has the access right to the material, but the changed new material is not displayed on the terminal of the user who does not have the access right. That is, this configuration is different from the conventional configuration which enables synchronous display of all materials after logging in to a conference for the first time and authenticating the access right, and determines whether there is access permission for each material and displays it. The configuration for controlling synchronization and asynchronousness can enhance the secrecy and security of the material.

  The electronic conference system 4100 may have the following configuration.

  Even if a large number of terminals are connected, the electronic conference system 4100 limits the number of people who can speak simultaneously (the number of transmission terminals) because the number of people speaking at the same time (speaker terminals) at a certain moment is limited. In addition, while the transmission terminal is switched, the communication channel establishment state is dynamically changed. As a result, voice data can be mutually transmitted and received among a large number of terminals in a pseudo manner.

  In addition, the electronic conference system 4100 has a configuration in which voice transmission and voice reception can be selected by each terminal, and the terminal management server 420 is notified when the state of voice transmission and voice reception of each terminal changes.

  Further, the terminal management server 420 notifies a terminal for which voice transmission is selected, of a list (list) of terminals for which voice reception is selected. At this time, it is not necessary to notify information of a terminal whose status has not changed so far. The notified transmitting terminal makes a call to the receiving terminal so as to receive its own stream information only for the newly registered receiving terminal (call out connection request).

  Further, in the electronic conference system 4100, the terminal management server 420 manages the total number of terminals that can simultaneously transmit, and when the total number reaches the upper limit value (the number of units set), the terminal disables selection of transmission requests in the terminals. Have.

  Further, in the electronic conference system 4100, the transmitting terminal includes two types, a transmitting terminal and a temporary transmitting terminal, and among these, the transmitting terminal can transmit only for a certain period of time, and after a certain period of time The transmission may be canceled (the check box of the transmission request is cancelled). In addition, the temporary transmission terminal may be configured to be able to transmit only while the user presses the voice transmission button. In addition, the temporary transmission terminal may be configured to cancel the transmission request when the silent state continues for a predetermined time.

  Further, in the electronic conference system 4100, a user who wants to speak may make a transmission request at a terminal, and give a speaking right to a user designated at a specific terminal (master terminal) (permit as a transmission terminal).

  The modifications of the fourth embodiment and the fourth embodiment of each electronic conference system described above are merely examples, and the respective embodiments can be combined.

  Also, the network configuration of each electronic conference system may be a configuration without the terminal management server 420 (FIG. 92). The configuration shown in FIG. 92 is realized by downloading programs corresponding to the elements included in the electronic conference system to the terminals 410a to 410f. Specifically, each teleconference system is realized by the CPU of each terminal executing the program stored in the memory of each terminal 410a to 410f. The program to be downloaded may be configured, for example, by JavaScript (registered trademark). Further, the terminal 410 having the program downloaded or recorded functions as an information processing apparatus. The computer from which the program is downloaded may be the terminal 410 or the terminal management server 420.

  The teleconference system 4100 is not limited to transmission and reception of audio data. That is, the electronic conference system 4100 can be applied to transmission and reception of media data including at least one of audio data and video data (moving image data). Further, each electronic conference system can be applied to various electronic conferences such as a video conference and a telephone conference. In the video conference, the video taken by the camera mounted on each terminal is bi-directionally communicated between the terminals via the communication path. Each teleconferencing system can also be applied to teleconferencing where conferees are remote from one another.

  In the above description, the electronic conferencing system has been exemplified as an example of the information processing system, but the information processing system is not limited to the electronic conferencing system, and various types of media data sharing between network connected terminals It includes the system.

4-3. Advantages of Embodiment 4 The program according to Embodiment 4 of the present invention synchronizes and displays materials used in a conference among a plurality of terminals connected via a network, and at least one of audio data and video data. Program for causing a computer to transmit and receive media data including a plurality of media based on presence / absence of access rights of each of a plurality of users with respect to the material selected by the first user at the first terminal. A computer functions as control means for controlling display contents of each of a plurality of terminals used by each user and controlling transmission and reception of the media data between the first terminal and each of the plurality of terminals. I assume. According to this configuration, material and voice are separately controlled synchronously between the plurality of terminals, and the confidentiality of the conference is maintained.

  In the program according to the fourth embodiment of the present invention, when the second user does not have the access right to the material, the control means causes the material to be displayed on the display screen of the second terminal used by the second user. Alternatively, transmission and reception of the media data between the first terminal and the second terminal may be prohibited. According to this configuration, the material is not displayed on the display screen of the second terminal, and transmission / reception of media data between the first terminal and the second terminal is prohibited.

  In the program according to the fourth embodiment of the present invention, the control unit further causes the third user to display the material displayed on the display screen of the first terminal when the third user has an access right to the material. The media data may be transmitted and received between the first terminal and the third terminal while being displayed in synchronization with the display screen of the third terminal to be used. According to this configuration, the material displayed on the display screen of the first terminal is displayed in synchronization with the display screen of the third terminal, and media data is transmitted and received between the first terminal and the third terminal.

  In the program according to the fourth embodiment of the present invention, a storage unit further storing the computer in advance in association with a plurality of materials used in a conference and the presence or absence of the plurality of users' access rights to each of the plurality of materials. Function as determining means for determining presence or absence of the access right of each of the plurality of users associated with the material selected by the first user with reference to the control means, the control means determining the determination of the determination means Based on the result, control of display contents of each of the plurality of terminals used by each of the plurality of users, and control of transmission and reception of the media data between the first terminal and each of the plurality of terminals are controlled. May be According to this configuration, the display content is controlled based on the determination result on the presence or absence of the access right, and transmission / reception of media data is controlled.

  In the program according to the fourth embodiment of the present invention, the first material is displayed in synchronization between the plurality of terminals, and the media data is transmitted and received through the communication path established between the plurality of terminals. When the first user selects and displays a second material different from the first material at the first terminal, the control means may include the first terminal and the second material. The communication path established between the user who does not have an access right to the terminal used by the user may be disconnected. According to this configuration, when the first user selects and displays the second material at the first terminal, the communication path between the first terminal and the terminal not having the access right to the second material is disconnected. Ru.

  In the program according to the fourth embodiment of the present invention, the control means further causes the second material to be displayed synchronously on the display screen of the terminal used by a user having an access right to the second material, The second material may not be displayed on the display screen of the terminal used by a user who does not have the access right to the second material. According to this configuration, the second material is displayed synchronously on the display screen of the terminal having the access right to the second material, while the second material is displayed on the display screen of the terminal not having the access right to the second material I will not.

  In the program according to the fourth embodiment of the present invention, the computer further comprises transmission request receiving means for receiving a transmission request for the media data from at least one terminal, and a reception request for the media data from at least one terminal. When the total number of reception request receiving means to receive and the number of terminals that have made the transmission request is equal to or less than a predetermined number set, the reception request is made with the terminal that has made the transmission request. It may function as a communication path establishing means for establishing a communication path for transmitting the media data with at least one of the terminals. According to this configuration, when the total number of terminals requesting transmission is less than or equal to the set number, media data is transmitted between the terminal requesting transmission and the terminal requesting reception. A communication path is established. Therefore, even if the number of terminals connected via the network increases, high quality data communication can be realized between the terminals. Also, media data is communicated independently of the shared state (synchronous or asynchronous) of the material (display content).

  In the program according to the fourth embodiment of the present invention, the communication is performed when the communication path is established between the plurality of terminals transmitting the transmission request and the plurality of terminals transmitting the reception request. The path establishing means establishes, among the plurality of terminals that have transmitted the transmission request and the second terminal, the user who uses the second terminal that has transmitted the reception request does not have access to the material. The communication path may be disconnected. According to this configuration, when the second terminal that made the reception request does not have access to the material, the communication path between the plurality of terminals that made the transmission request and the second terminal is disconnected.

  In the program according to the fourth embodiment of the present invention, the computer is further caused to function as current position acquisition means for acquiring the current position of each terminal, and the communication path establishment means is predetermined with the terminal that transmitted the reception request. If a plurality of terminals exist within the range, the communication path may be established for one of the terminals. According to this configuration, when there are a plurality of terminals that have made reception requests within a predetermined range, a communication path is established for one of the terminals.

  In the program according to the fourth embodiment of the present invention, when a new transmission request is received by the transmission request receiving unit when the total number of terminals that have made the transmission request has reached the set number. The communication path establishing means may reject establishment of the communication path for the terminal which has made a new transmission request. According to this configuration, the establishment of the communication path is rejected at the terminal that has made a new transmission request when the number of terminals that have made a transmission request has reached the set number.

  In the program according to the fourth embodiment of the present invention, in the case where the time during which the media data is not transmitted from the terminal which has made the transmission request after the communication path has been established, the time has reached a predetermined time. The communication channel establishing means may release the communication channel corresponding to the terminal. According to this configuration, when the time when the media data is not transmitted reaches the time set in advance, the communication path of the corresponding terminal is released.

  The program according to the fourth embodiment of the present invention is a program for synchronizing and displaying a part of a display screen among a plurality of terminals connected via a network, which is a terminal connected to the network. User identification means for identifying a user to use, acceptance means for accepting material information of material selected by the first user at the first terminal, and operation information operated on the material, material of the accepted material information For the terminal used by the user determined to have the access right to the material, and the received document information and operation information for the terminal used by the user determined to have the access right to the material And causing the computer to function as notification means for notifying the user. This configuration maintains the secrecy of the materials used in the conference.

  The program may be stored in a computer readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal.

  An information processing apparatus according to a fourth embodiment of the present invention synchronizes and displays materials used in a conference among a plurality of terminals connected via a network, and includes at least one of audio data and video data. An information processing apparatus for transmitting and receiving media data, which is used by each of a plurality of users based on presence or absence of an access right of each of the plurality of users with respect to the material selected by the first user in the first terminal. A control means is included to control display contents in each of the terminals and to control transmission and reception of the media data between the first terminal and each of the plurality of terminals. The information processing apparatus may be the terminal. According to this configuration, material and voice are separately controlled synchronously between the plurality of terminals, and the confidentiality of the conference is maintained.

  An information processing system according to a fourth embodiment of the present invention synchronizes and displays materials used in a conference among a plurality of terminals connected via a network, and includes at least one of audio data and video data. An information processing system for transmitting and receiving media data, which is used by each of a plurality of users based on the presence or absence of the access right of each of the plurality of users with respect to the material selected by the first user in the first terminal. A control means is included to control display contents in each of the terminals and to control transmission and reception of the media data between the first terminal and each of the plurality of terminals. According to this configuration, material and voice are separately controlled synchronously between the plurality of terminals, and the confidentiality of the conference is maintained.

  A recording medium according to Embodiment 4 of the present invention is a medium including at least one of audio data and video data, while synchronously displaying materials used in a conference among a plurality of terminals connected via a network. A program for causing a computer to transmit and receive data to function, which is used by each of the plurality of users based on the presence or absence of each of the plurality of users with respect to the material selected by the first user at the first terminal. Controlling a display content in each of the plurality of terminals, and recording a program for causing a computer to function as control means for controlling transmission and reception of the media data between the first terminal and each of the plurality of terminals. It is characterized by According to this configuration, material and voice are separately controlled synchronously between the plurality of terminals, and the confidentiality of the conference is maintained.

5-1. Embodiment 5
In the fifth embodiment of the present invention, an operation terminal displayed in synchronization with another operation terminal in the electronic conference is asynchronously displayed from the other operation terminal when it is not synchronized with the other operation terminal. An object of the present invention is to suppress network traffic more than transmitting voice to an operation terminal. In the fifth embodiment, as an example of the information processing system, an electronic conference system in which electronic data is shared among a plurality of operation terminals connected via a network will be described as an example. The meaning of the terms in the fifth embodiment is limited to the scope of the fifth embodiment.

  FIG. 93 is an entire configuration diagram of the electronic conference system according to the fifth embodiment. The electronic conference system 5100 (information processing system) includes a plurality of operation terminals 510 used by a plurality of users attending the conference. In the fifth embodiment, for convenience of explanation, a user who can be the protagonist of the meeting, such as the organizer of the meeting, the facilitator of the meeting, the person in charge of the presentation at the meeting, is referred to as a "presenter" (second user). The operation terminal used by is referred to as a "presenter terminal" (second terminal device). A user who attends a meeting other than the presenter is referred to as a "participant" (first user), and an operation terminal used by the participant is referred to as a "participant terminal" (first terminal device). FIG. 93 shows one presenter terminal 510a and three attendee terminals 510b, 510c, and 510d. In the following, when describing the configuration common to the presenter terminal 510a and the participant terminals 510b, 510c, and 510d, the operation terminal 510 is generically described.

  As shown in FIG. 93, the presenter terminal 510a and the participant terminals 510b, 510c, and 510d are mutually connected via a communication network 520 such as a LAN (Local Area Network) or the Internet.

  FIG. 94 is a block diagram showing a hardware configuration of operation terminal 510. Referring to FIG. The operation terminal 510 is configured by a computer including a CPU 5101, a memory 5102, a storage unit 5103, a communication unit 5104, an input unit 5105, a display unit 5106, an audio input unit 5107 and an audio output unit 5108. These hardware elements are mutually connected by a bus so as to be able to transmit and receive data. The CPU 5101 controls each unit of the operation terminal 510 and executes various information processing. The memory 5102 holds various programs and data. In the memory 5102, a work area of the CPU 5101 is also secured. A storage unit 5103 stores data such as various files and documents. The communication unit 5104 performs data communication with another operation terminal 510 via the communication network 520. The input unit 5105 is an input device such as a keyboard, a mouse, a pen tool, and a touch panel. A display unit 5106 is a display screen that displays various files, documents, and the like via application software such as a web browser. The voice input unit 5107 is a microphone into which an ambient sound including the voice of the user operating the operation terminal 510 or the voice of the user present around the operation terminal 510 is input. The audio output unit 5108 is a speaker that outputs audio data as audio. The voice data also includes voice data (presenter voice information described later) received from another operation terminal 510 via the communication network 520. The storage unit 5103, the input unit 5105, the display unit 5106, the voice input unit 5107, and the voice output unit 5108 may be provided outside the operation terminal 510 and connected to the operation terminal 510 via the communication network 520. In addition, software such as a browser and an electronic mail client is incorporated in the operation terminal 510. The operation terminal 510 is, for example, a personal computer, a personal digital assistant (PDA), a portable information terminal such as a smartphone, or the like.

  In the following, the specific configuration of the electronic conference system 5100 will be described mainly focusing on the presenter terminal 510a and the participant terminal 510b.

  FIG. 95 is a functional block diagram showing a specific configuration of the participant terminal 510b. The participant terminal 510 b includes a presenter information reception unit 511, a participant operation acquisition unit 512, an operation type determination unit 513, a synchronization determination unit 514, a display control unit 515, and a voice transmission restriction unit 516. These elements are realized by the CPU 5101 executing a program stored in the memory 5102 (see FIG. 94). The storage unit 5103 includes a file DB 531 for storing data such as various files and documents.

  The program may be installed on the participant terminal 510 b from a computer readable information storage medium such as a CD-ROM, a DVD-ROM, a memory card, or downloaded via a communication network 520 such as the Internet. Alternatively, the program may be downloaded from a server stored beforehand.

  For example, as shown in FIG. 96, in the network configuration in which each operation terminal 510 is connected to the network via the server 530, when the participant terminals 510b, 510c, and 510d are connected to the server 530, the above program becomes a server. It may be downloaded to the memory 5102 of each participant terminal 510 b, 510 c, 510 d from 530, and the material data for the conference may be downloaded to the file DB 531. The program and the material data may be configured by JavaScript (registered trademark), for example. In addition, when the presenter connects the operation terminal 510 to the server 530 and performs predetermined settings, the operation terminal 510 is recognized as the presenter terminal 510a, and the participant connects the operation terminal 510 to the server 530. By performing a predetermined setting, the operation terminal 510 is recognized as the participant terminal 510 b or the like. The server 530 transmits the program and the material data to each operation terminal 510 recognized by the participant terminal. The server 530 may transmit the program and the material data also to the operation terminal 510 recognized as the presenter terminal. After transmitting the program and the material data, the server 530 mainly functions as a relay that performs information communication between the presenter terminal 510a and the participant terminals 510b, 510c, and 510d. The operation terminal 510 having the program downloaded or recorded functions as an information processing apparatus. The computer from which the program is downloaded may be the operation terminal 510 or the server 530.

  Each function corresponding to the above program will be described.

  The presenter information reception unit 511 receives, from the presenter terminal 510a, information indicating contents operated by the presenter on the presenter terminal 510a (hereinafter referred to as presenter operation information), and a voice of the presenter terminal 510a. Information (hereinafter, referred to as presenter voice information) indicating the voice of the presenter input to the input unit 5107 is received. The presenter operation information is, for example, display of a new material, writing to a material with a pen tool (tool for handwriting), pickup of a post comment (selection), page switching of material, operation of inputting and moving a mouse pointer, voice input, etc. It is information indicating the content. Further, the presenter voice information is information indicating a voice uttered in the electronic conference such as, for example, an utterance related to an operation of the presenter terminal 510a or an utterance related to the content displayed by the operation.

  Here, a specific example of processing contents in the presenter terminal 510a will be described. FIG. 97 shows an example of display contents displayed on the display screen of the presenter terminal 510a.

  For example, when the presenter operates the mouse or the like (input unit 5105) on the presenter terminal 510a to read the material stored in the file DB 531 (operation of displaying a new material on the material screen), The presenter terminal 510a transmits the presenter operation information indicating the operation content including the information indicating the storage destination URL of the material or the material ID to the participant terminal 510b via the communication unit 5104.

  Further, for example, when the presenter operates the mouse on the presenter terminal 510a and inputs the mouse pointer on the material screen (see FIG. 97) displayed on the display unit 5106, the presenter terminal 510a communicates The presenter operation information indicating the operation content including the position (coordinates) of the mouse pointer, the ID of the input material, the page number and the like is transmitted to the participant terminal 510 b via the unit 5104. The presenter terminal 510a may sequentially transmit presenter operation information at regular intervals (for example, every 50 msec).

  Further, for example, when the presenter operates the pen tool on the presenter terminal 510a and writes characters or the like on the material screen (see FIG. 97) displayed on the display unit 5106, the presenter terminal 510a communicates The presenter operation information indicating the operation content including the position (coordinates) written, the ID of the written material, the page number and the like is transmitted to the participant terminal 510 b via the unit 5104.

  Also, for example, when the presenter operates the mouse on the presenter terminal 510a to switch the page of the material screen (see FIG. 97) displayed on the display unit 5106, the presenter terminal 510a communicates with the communication unit The presenter operation information indicating the operation content including the information indicating the ID of the displayed material and the designated page number is transmitted to the participant terminal 510 b via 5104.

  Further, for example, when the voice of the presenter is input to the voice input unit 5107 of the presenter terminal 510a and the presenter voice information indicating the presenter's voice is generated, the presenter terminal 510a generates the generated presentation The participant voice information is transmitted to the participant terminal 510 b via the communication network 520.

  Thus, the presenter terminal 510a notifies each participant terminal 510b, 510c, 510d of information indicating the content thereof based on the operation or the voice of the presenter.

  The participant operation acquisition unit 512 acquires information indicating the content operated by the participant on the participant terminal 510 b (hereinafter referred to as participant operation information). The participant operation information is similar to the presenter operation information, for example, display of the material, writing to the material with the pen tool, creation of a post comment, page switching of the material, input and movement of the mouse pointer, voice input, etc. It is information to show.

  The operation type determination unit 513 determines the operation type (presenter operation type) based on the presenter operation information received by the presenter information reception unit 511 from the presenter terminal 510a. In addition, the operation type determination unit 513 determines the operation type (participant operation type) based on the participant operation information acquired by the participant operation acquisition unit 512 in the own terminal (the participant terminal 510b). The operation type is one in which the operation contents of the presenter and the participant are classified by type. The operation type is set in advance, and is stored in, for example, the storage unit 5103 as an operation type table. The operation content registered in the operation type table changes the operation content that is important for the presenter and the participant, for example, the display content (synchronization content) displayed on the participant terminal 510b in synchronization with the presenter terminal 510a. Operation contents to be Specifically, when the first page of the material A displayed on the presenter terminal 510a is synchronously displayed on the participant terminal 510b, the terminal 510b for the participant can be obtained by switching to the second page. The mouse pointer is input to the first page when the operation to change the display content of the first page of the material A displayed on the presenter terminal 510a is synchronously displayed on the participant terminal 510b. This means an operation or the like for changing the display content of the participant terminal 510b.

  In the participant terminal 510b, the synchronization content may be displayed on the entire display screen, or may be displayed on a part of the display screen. In addition, the entire display screen of the presenter terminal 510a may be synchronized, or part of the display screen may be synchronized. Therefore, for example, even when the mouse pointer operated by the presenter in the presenter terminal 510a is synchronously moving in the participant terminal 510b (synchronized state), the mouse pointer for the participant terminal 510b is separately (For example, it may be displayed outside the synchronized display screen). Further, in the synchronized display screen, both of the synchronized mouse pointer operated by the presenter and the mouse pointer for the participant terminal 510b operated by the participant may be displayed. The input operation of the mouse pointer on the presenter terminal 510a is included in the operation of changing the display content of the participant terminal 510b.

  FIG. 98 shows an example of the operation type table. In the operation type table shown in FIG. 98, five operation types of “document display”, “pen”, “pickup”, “page switching”, and “pointer” are set corresponding to the operation content. For example, the operation type determination unit 513 specifies the operation type corresponding to the content of the operation performed by the presenter with reference to the operation type table. Further, the operation type determination unit 513 identifies the operation type corresponding to the content of the operation by the participant with reference to the above-described operation type table. In addition, when the operation type corresponding to the operation content does not exist, the operation type determination unit 513 determines that “the operation type is not present”. Also, the operation content registered in the operation type table is not limited to the content of FIG. For example, the operation content and the operation type registered in the operation type table may be different between the one for the presenter and the one for the participant. In this case, the presenter's operation type table and the participant's operation type table may be provided separately.

  The synchronization determination unit 514 determines, based on the determination result of the operation type determination unit 513, whether to synchronize the participant terminal 510b with the presenter terminal 510a or to make it asynchronous. Specifically, when the operation content by the presenter corresponds to a predetermined operation type (see FIG. 98), the synchronization determination unit 514 determines “synchronization”. When the content of the operation by the participant corresponds to a predetermined operation type (see FIG. 98), the synchronization determination unit 514 determines “asynchronous”. When the content of the operation by the presenter or the content of the operation by the participant is “no operation type”, the synchronization determination unit 514 determines “asynchronous”.

  The display control unit 515 controls the display content of the display screen of the participant terminal 510 b based on the determination result of the synchronization determination unit 514. Specifically, when the synchronization determination unit 514 determines “synchronization”, the display control unit 515 causes the participant terminal 510 b to reflect the display content according to the content of the operation performed by the presenter. For example, when the presenter causes new material A to be displayed on the presenter terminal 510a, the synchronization determination unit 514 determines “synchronization”, and the display control unit 515 causes the display unit 5106 of the participant terminal 510b to display the material. Display A. Also, for example, when the presenter switches the display page of the material A from the first page to the second page in the presenter terminal 510a, the synchronization determination unit 514 determines “synchronization”, and the display control unit 515 The display page of the material A displayed on the display unit 5106 of the user terminal 510b is switched from the first page to the second page. Similarly, when a character is written by a pen tool, a post comment is picked up, or the presenter moves the mouse pointer, the display control unit 515 reflects these operation contents on the participant terminal 510b.

  On the other hand, when the synchronization determination unit 514 determines “asynchronous”, the display control unit 515 puts the participant terminal 510 b in an asynchronous state (asynchronous mode) with respect to the presenter terminal 510 a, and The operation content is reflected on the participant terminal 510b. For example, when the material A is displayed on the participant terminal 510b in synchronization with the presenter terminal 510a and the participant selects another material B, it is determined as “asynchronous” in the synchronization determination unit 514. The display control unit 515 causes the participant terminal 510b to be asynchronous with the presenter terminal 510a, changes the display content of the participant terminal 510b, and causes the display unit 5106 to display the material B. Also, for example, when the third page of the material A is displayed on the participant terminal 510b in synchronization with the presenter terminal 510a, the participant performs an operation to switch to the previous page (fourth page) In this case, the synchronization determination unit 514 determines “asynchronous”, and the display control unit 515 causes the participant terminal 510 b to be asynchronous with the presenter terminal 510 a and displayed on the display unit 5106 of the participant terminal 510 b. The display page of the document A is switched (changed) from the third page to the fourth page. Similarly, when a character is written by a pen tool, a post comment is created, or the participant moves the mouse pointer, the display control unit 515 causes the participant terminal 510b to be asynchronous with the presenter terminal 510a. In this state, the operation contents are reflected on the participant terminal 510b.

  As described above, the display control unit 515 functions as a synchronization cancellation unit that cancels the synchronization state (switching to the asynchronous state) when the participant performs a preset operation on the participant terminal 510b, and the synchronization state is In the released state (asynchronous state), when the presenter performs an operation set in advance on the presenter terminal 510a, the presenter functions as a resynchronization means to return to the synchronous state (cancel the asynchronous state) again.

  The voice transmission restriction unit 516 limits or cancels the transmission of the presenter's voice information from the presenter terminal 510a to the participant terminal 510b based on the determination result of the synchronization determination unit 514. Specifically, when the synchronization determination unit 514 determines “synchronization”, the voice transmission restriction unit 516 indicates that the transmission of the presenter's voice information from the presenter terminal 510 a to the participant terminal 510 b is not restricted. The restriction release information is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction release information continues transmitting the presenter voice information to the participant terminal 510b via the communication network 520 (that is, the transmission of the presenter voice information is not restricted). On the other hand, when it is determined in the synchronization determination unit 514 as “asynchronous”, the voice transmission limiting unit 516 limits the transmission of the presenter voice information from the presenter terminal 510a to the participant terminal 510b. Is sent to the presenter terminal 510a. The presenter terminal 510a that has received the restriction request information stops transmitting the presenter's voice information via the communication network 520 (that is, transmission of the presenter's voice information is restricted). As described above, when the display control unit 515 cancels the synchronization state (switched to the asynchronous state) based on the determination result of the synchronization determination unit 514, the voice transmission restriction unit 516 is for the participant from the presenter terminal 510a. It functions as a limiting means for limiting transmission of voice (presenter voice information) to the terminal 510b.

  Next, the flow of processing in the electronic conference system 5100 will be described. FIG. 99 is an operation flowchart of the teleconference system 5100. Here, as an example, the presenter P makes a presentation on the material A at the electronic conference using the presenter terminal 510a, the participant S participates in the electronic conference using the participant terminal 510b, and the presenter Description will be made on the assumption that the electronic conference proceeds while P and the participant S perform desired operations. Although the electronic conference system 5100 includes one presenter terminal and a plurality of participant terminals interconnected via the communication network 520, here, one presenter terminal is used here. It demonstrates paying attention to the terminal 510a and the terminal 210b for one participant.

  First, the presenter P selects the file of the material A stored in the storage unit 5103 (FIG. 94) on the presenter terminal 510a. As a result, the contents of the material A are displayed on the display unit 5106 of the presenter terminal 510a (S5101). For example, the first page (first page) of the material A is displayed. In addition, the presenter terminal 510a participates in presenter operation information indicating the operation content of the presenter P (here, the display of the new material A) including the information of the material A (for example, the ID of the material A and the page number). It transmits to the user terminal 510b.

  In addition, the presenter P inputs a voice to the voice input unit 5107 of the presenter terminal 510a by speaking. Thereby, the presenter terminal 510a generates presenter voice information indicating the voice of the presenter (S5102). Also, the presenter terminal 510a sequentially transmits the generated presenter voice information to the participant terminal 510b.

  Next, the presenter information reception unit 511 of the participant terminal 510b receives the presenter operation information and the presenter voice information from the presenter terminal 510a (S5201). Here, the presenter information reception unit 511 receives the operation content (“display of new material A”) including the ID of the material A.

  Next, the operation type determination unit 513 of the participant terminal 510b determines the operation type based on the presenter operation information (S5202). Here, the operation type determination unit 513 specifies the operation type ("display of material") corresponding to the operation content ("display of new material A") with reference to the operation type table shown in FIG.

  Next, the synchronization determination unit 514 of the participant terminal 510b determines synchronization / asynchronization of the participant terminal 510b based on the determination result of the operation type determination unit 513 (S5203). Here, since “display of data” is specified as the operation type, the synchronization determination unit 514 determines “synchronization”.

  Next, the display control unit 515 of the participant terminal 510b controls the display content of the display screen on the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5204). Here, since the synchronization determination unit 514 determines “synchronization”, the display control unit 515 causes the display unit 5106 of the participant terminal 510 b to display the first page of the material A.

  Also, the voice transmission restriction unit 516 of the participant terminal 510 b limits or cancels the transmission of the presenter voice information from the presenter terminal 510 a to the participant terminal 510 b based on the determination result of the synchronization determination unit 514. (S5205). Here, since the synchronization determination unit 514 determines “synchronization”, the voice transmission restriction unit 516 of the participant terminal 510 b restricts transmission of presenter voice information from the presenter terminal 510 a to the participant terminal 510 b. The restriction release information indicating that it is not to be transmitted is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction release information continues transmission of the presenter voice information to the participant terminal 510b. Also, the participant terminal 510b outputs a voice (that is, a voice of the presenter) according to the received presenter voice information from the voice output unit 5108 (S5206).

  In the process of S5201 to S5206, the presenter terminal 510a and the participant terminal 510b are in the synchronized state (synchronous mode), and the same content is displayed on the presenter terminal 510a and the participant terminal 510b, A voice (of the presenter) according to the presenter's voice information is output from the voice output unit 5108 of the user terminal 510b.

  Subsequently, the participant S performs a desired operation on the participant terminal 510b. Here, it is assumed that the participant S switches the display page (first page) of the material A displayed on the display screen to the second page (S5207).

  Then, the participant operation acquisition unit 512 of the participant terminal 510b acquires participant operation information indicating the content operated by the participant S. Here, the participant terminal 510b acquires participant operation information indicating the operation content of the participant S (here, page switching of the material A) including the information of the material A (for example, the ID of the material A). (S5208). Here, it is assumed that the presenter terminal 510a continues to transmit presenter voice information to the participant terminal 510b.

  Next, the operation type determination unit 513 of the participant terminal 510b determines an operation type based on the participant operation information (S5209). Here, the operation type determination unit 513 specifies the operation type ("page switching") corresponding to the operation content ("page switching of material A") with reference to the operation type table shown in FIG.

  Next, the synchronization determination unit 514 of the participant terminal 510b determines synchronization / asynchronization of the participant terminal 510b based on the determination result of the operation type determination unit 513 (S5210). Here, since “page switching” is specified as the operation type, the synchronization determination unit 514 determines “asynchronous”.

  Next, the display control unit 515 of the participant terminal 510b controls the display screen of the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5211). Here, since it is determined as “asynchronous” by the synchronization determination unit 514, the display control unit 515 is used for the participant even if the first page of the material A is displayed on the display unit 5106 of the presenter terminal 510a. The display content of the display unit 5106 of the terminal 510b is changed to display the second page of the material A.

  Also, the voice transmission restriction unit 516 of the participant terminal 510 b limits or cancels the transmission of the presenter voice information from the presenter terminal 510 a to the participant terminal 510 b based on the determination result of the synchronization determination unit 514. (S5212). Here, since the synchronization determination unit 514 determines “asynchronous”, the voice transmission restriction unit 516 of the participant terminal 510 b restricts transmission of presenter voice information from the presenter terminal 510 a to the participant terminal 510 b. Limit request information indicating that it is to be sent to the presenter terminal 510a. The presenter terminal 510a having received the restriction request information cancels the transmission of the presenter voice information to the participant terminal 510b (S5103). Here, in the presenter terminal 510a, even if the presenter's voice is input to the voice input unit 5107 of the presenter terminal 510a and the presenter voice information indicating the presenter's voice is generated, the presenter terminal 510a Do not send presenter voice information to 510b.

  In the processing of S5207 to S5212, the participant terminal 510b is in the asynchronous state (asynchronous mode), and different contents are displayed on the presenter terminal 510a and the participant terminal 510b, and the presenter's voice is displayed via the communication network 520. Information is not sent. As described above, when the participant terminal 510 b is in the asynchronous state, the presenter terminal 510 a does not transmit presenter voice information via the communication network 520, so the presenter is not concerned with the determination of the synchronization determination unit 514. The traffic of the communication network 520 is suppressed as compared to the case of transmitting voice information.

  Subsequently, the presenter P performs a desired operation on the presenter terminal 510a. Here, it is assumed that the presenter P writes a character on the first page of the material A displayed on the display unit 5106 using a pen tool (S5104 in FIG. 100).

  Then, the presenter terminal 510a displays the contents operated by the presenter P including the position (coordinates) of the written character, the ID of the written material A, and the page number (here, the material A by the pen tool To the participant terminal 510b.

  Next, the presenter information reception unit 511 of the participant terminal 510b receives the presenter operation information from the presenter terminal 510a (S5213). Here, it is assumed that the presenter terminal 510a receives the restriction request information and stops the transmission of the presenter voice information to the participant terminal 510b.

  Next, the operation type determination unit 513 of the participant terminal 510b determines an operation type based on the presenter operation information (S5214). Here, the operation type determination unit 513 specifies the operation type (“pen”) corresponding to the operation content (“writing to the material A by the pen tool”) with reference to the operation type table shown in FIG.

  Next, the synchronization determination unit 514 of the participant terminal 510b determines synchronization / asynchronization of the participant terminal 510b based on the determination result of the operation type determination unit 513 (S5215). Here, since “pen” is specified as the operation type, the synchronization determination unit 514 determines “synchronization”.

  Next, the display control unit 515 of the participant terminal 510b controls the display content of the display screen on the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5216). Here, since it is determined by the synchronization determination unit 514 as “synchronization”, the display control unit 515 changes the display content of the display unit 5106 of the participant terminal 510b, and the first of the material A in which the character is written Display the page.

  Also, the voice transmission restriction unit 516 of the participant terminal 510 b limits or cancels the transmission of the presenter voice information from the presenter terminal 510 a to the participant terminal 510 b based on the determination result of the synchronization determination unit 514. (S5217). Here, since the synchronization determination unit 514 determines “synchronization”, the voice transmission restriction unit 516 of the participant terminal 510 b restricts transmission of presenter voice information from the presenter terminal 510 a to the participant terminal 510 b. It transmits restriction release information indicating that it is not (in this case, restriction release) to the presenter terminal 510a. The presenter terminal 510a that has received the restriction cancellation information resumes transmission of the presenter voice information to the participant terminal 510b (S5105). In addition, the participant terminal 510b outputs, from the voice output unit 5108, a voice according to the received presenter voice information (that is, the voice of the presenter) (S5218).

  In the processing of S5213 to S5218, the participant terminal 510b is again in the synchronization state (synchronization mode), and the same content is displayed on the presenter terminal 510a and the participant terminal 510b, and the voice of the participant terminal 510b is displayed. The output unit 5108 outputs the voice of the presenter.

  As described above, in the electronic conference system 5100, synchronous / asynchronous switching is automatically switched according to the desired operation of the presenter and the participant, and the display content of the participant terminal 510b is changed. In addition, when the participant terminal 510 b is in the asynchronous state, the presenter terminal 510 a does not transmit presenter voice information via the communication network 520, so the presenter voice information is generated regardless of the determination of the synchronization determination unit 514. The traffic of the communication network 520 is suppressed as compared to the case of transmitting

5-2. Modification of Embodiment 5 The electronic conference system 5100 is not limited to the above configuration, and various configurations can be adopted. Hereinafter, the electronic conference system 5100 according to the modification of the fifth embodiment will be described focusing on differences from the above configuration. In the electronic meeting system 5100 which concerns on the modification of the following Embodiment 5, description is abbreviate | omitted about the element which a function is common in the said electronic meeting system 5100. FIG.

5-2-1. Modification 1 of Embodiment 5
In the electronic conference system 5100 according to the first modification of the fifth embodiment, when the participant operation acquisition unit 512 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined. The display control unit 515 causes the participant terminal 510b to be in an asynchronous state (asynchronous mode) with respect to the presenter terminal 510a, and causes the participant terminal 510b to display the display content according to the operation content. It is also good. In addition, when participant operation information is acquired, the voice transmission restriction unit 516 can determine the type of presenter voice information from the presenter terminal 510a to the participant terminal 510b without determining the operation type corresponding to the operation content. Even if restriction request information indicating restriction of transmission is transmitted to the presenter terminal 510a and the restriction request information is accepted, the presenter terminal 510a stops transmission of presenter voice information to the participant terminal 510b. Good.

  According to the electronic conference system 5100 according to the first modification of the fifth embodiment, when an operation to change the display content displayed on the participant terminal 510 b is performed by the participant, the operation is asynchronous and the operation is performed. The corresponding display content is displayed on the participant terminal 510b, and the voice of the presenter is not output from the voice output unit 5108 of the participant terminal 510b.

5-2-2. Modification 2 of Embodiment 5
In the electronic conference system 5100 according to the second modification of the fifth embodiment, when the presenter information reception unit 511 receives the operation content (presenter operation information) by the presenter, the operation type corresponding to the operation content is determined. The display control unit 515 causes the participant terminal 510b to be in synchronization with the presenter terminal 510a (synchronization mode) and causes the participant terminal 510b to display the display content according to the operation content. It is also good. Further, when the presenter operation information is received, the voice transmission restriction unit 516 does not determine the operation type corresponding to the operation content, the presenter voice information from the presenter terminal 510a to the participant terminal 510b. The restriction release information indicating that transmission is not restricted is transmitted to the presenter terminal 510a, and the presenter terminal 510a having received the restriction cancellation information receives the presenter voice information for the participant terminal 510b via the communication network 520. The transmission of may be started.

  According to the electronic conference system 5100 according to the second modification of the fifth embodiment, when an operation for changing the display content displayed on the presenter terminal 510a is performed by the presenter, the operation is synchronized and the operation is performed. The display content according to the request is displayed on the participant terminal 510b, and the voice of the presenter is output from the voice output unit 5108 of the participant terminal 510b.

5-2-3. Modification 3 of Embodiment 5

  The electronic conference system 5100 according to the third modification of the fifth embodiment may be configured to maintain the asynchronous state based on the instruction of the participant when the participant terminal 510b is in the asynchronous state. For example, when the participant selects the asynchronous button on the display screen with the mouse pointer, the participant terminal 510b maintains the asynchronous state. Further, for example, while the participant is touching the display screen with a finger, the participant terminal 510b may be configured to maintain the asynchronous state. As described above, the presenter terminal 510a stops the transmission of the presenter voice information to the participant terminal 510b even while the asynchronous state is maintained.

  The respective elements shown in the fifth embodiment and the modifications of the fifth embodiment of the electronic conference system 5100 described above are connected to the operation terminal 510 (the presenter terminal 510a and the participant terminals 510b, 510c, 510d) via a network. The information processing apparatus may be realized by the CPU executing a program. The information processing apparatus can be, for example, a server 530 shown in FIG. In this case, in the information processing apparatus, the participant operation acquisition unit 512 acquires participant operation information from each participant terminal, and the operation type determination unit 513 specifies an operation type corresponding to each participant terminal, The synchronization determination unit 514 determines synchronization and non-synchronization corresponding to each participant terminal. Further, the display control unit 515 controls the display content of the display screen of each participant terminal based on the determination result of the synchronization determination unit 514. Further, based on the determination result of the synchronization determination unit 514, the voice transmission restriction unit 516 limits or cancels the transmission of the presenter voice information from the presenter terminal 510a to the participant terminal 510b.

  Moreover, each modification of the said Embodiment 5 and Embodiment 5 is an example, Comprising: Each form can also be combined. Further, in the above description, the electronic conference system is exemplified as an example of the information processing system, but the information processing system is not limited to the electronic conference system, and electronic data is shared between operation terminals connected to the network. It includes a wide variety of systems.

· Code of Embodiment 1 · · · Electronic conference system, 1101 ... CPU, 1201 ... CPU, 1102 ... memory, 1202 ... memory, 1103 ... storage unit, 1203 ... storage unit, 1104 ... communication unit, 1204 ... communication unit, 1105 ... Operation unit, 1106: display unit, 1107: voice input unit, 1108: voice output unit, 110: terminal device, 120: server, 111: transmission request transmission unit, 112: determination result acquisition unit, 113: terminal information acquisition unit, 114: communication path establishment unit, 115: voice transmission unit, 116: display control unit, 121: transmission request reception unit, 122: reception request reception unit, 123: determination processing unit, 124: terminal information generation unit, 125: present location acquisition Section 130 Communication network 141 Reception request transmission section 142 Determination result acquisition section 143 Display control section 144 Voice reception section.

· Code of the second embodiment 2100 ... electronic conference system, 2101 ... CPU, 2102 ... memory, 2103 ... storage unit, 2104 ... communication unit, 2105 ... input unit, 2106 ... display unit, 210 ... operation terminal, 210a ... for presenter Terminal 210b Participant terminal 211 Presenter operation reception unit 212 Participant operation acquisition unit 213 Operation type determination unit 214 Synchronization determination unit 215 Display control unit 216 Priority comparison unit 217: synchronization information notification unit 220: communication network 230: server 231: file DB.

· Code of Embodiment 3 · · · 3100 electronic conference system, 3200 electronic conference system, 3101 CPU, 3201 CPU, 3102 memory, 3202 memory, 3103 storage unit, 3203 storage unit, 3104 communication unit, 3204 ... communication unit, 3105 ... operation unit, 3106 ... display unit, 3107 ... voice input unit, 3108 ... voice output unit, 330 ... communication network, 320 ... server, 321 ... reception processing unit, 322 ... communication connection unit, 323 ... terminal Judgment unit 324 Notification unit 325 Terminal information update unit 326 Terminal state determination unit 327 Terminal information generation unit 328 Current location acquisition unit 331 Terminal information DB 332 File DB 310 Terminal 311: transmission request transmission unit, 312: determination result acquisition unit, 313: terminal information acquisition unit, 314: communication path establishment unit, 31 5 ... voice transmission unit, 316 ... display control unit, 341 ... reception request transmission unit, 342 ... determination result acquisition unit, 343 ... display control unit, 344 ... voice reception unit.

· 4100 ... electronic conference system, 4101 ... CPU, 4201 ... CPU, 4301 ... CPU, 4102 ... memory, 4202 ... memory, 4302 ... memory, 4103 ... storage unit, 4203 ... storage unit, 4303 ... storage unit 4104 communication unit 4204 communication unit 4304 communication unit 4105 operation unit 4106 display unit 4107 voice input unit 4108 voice output unit 450 communication network 410 terminal 411 transmitting 411 Request transmission unit 412: Judgment result acquisition unit 413: Terminal information acquisition unit 414: Channel control unit 415: Voice transmission unit 416: Display control unit 420: Terminal management server 421: Reception processing unit 422 ... communication connection unit, 423 ... notification unit, 424 ... transmission request reception unit, 425 ... reception request reception unit, 426 ... determination processing unit, 4 27 Terminal information generation unit 428 Terminal information DB 429 Current location acquisition unit 430 File management server 431 Reception processing unit 432 Access determination processing unit 433 File transmission unit 434 File DB 435 ... access restriction information DB, 441 ... reception request transmission unit, 442 ... determination result acquisition unit, 443 ... display control unit, 444 ... voice reception unit.

Reference numeral 5100 of the fifth embodiment: electronic conference system 5101: CPU 5102 memory 5103 storage unit 5104 communication unit 5105 input unit 5106 display unit 5107 voice input unit 5108 voice output Part 510 510 operation terminal 510a presenter terminal 510b participant terminal 511 presenter information reception part 512 participant operation acquisition part 513 operation type determination part 514 synchronization determination part 515: display control unit, 516: voice transmission restriction unit, 520: communication network, 530: server, 531: file DB.

Claims (1)

A program capable of causing at least a part of display content of a second terminal device to be displayed in synchronization with at least a part of a display screen of the first terminal device in a plurality of terminal devices,
A first operation acquisition unit configured to acquire a first operation content indicating content operated by a first user in the first terminal device;
The first operation content is an operation content for changing the display content displayed on the first terminal device in synchronization with the second terminal device, and the first operation content is the predetermined operation content. Display control means for changing the display content displayed on the terminal device to display content according to the first operation content;
Restricting means for restricting transmission of voice from the second terminal device to the first terminal device when the display content is changed according to the first operation content;
A program to make a computer function.

Images