JP2017045180A - program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To restrain communication traffic necessary for voice transmission from a second terminal device to a first terminal device when the first terminal device capable of displaying in synchronization with the second terminal device makes display in asynchronization with the second terminal device.SOLUTION: If a synchronization determination unit 514 determines that devices are synchronized, a voice transmission restriction unit 516 transmits restriction cancellation information indicating no restriction on the transmission of a presenter's voice information to a presenter terminal 510a. Receiving the restriction cancellation information, the presenter terminal 510a continues transmitting the presenter's voice information to a participant terminal 510b. Meanwhile, if the synchronization determination unit 514 determines that devices are not synchronized, the voice transmission restriction unit 516 transmits restriction request information indicating restriction on the transmission of the presenter's voice information to the presenter terminal 510a. Receiving the restriction request information, the presenter terminal 510a stops transmitting the presenter's voice information to the participant terminal 510b.SELECTED DRAWING: Figure 95

Description

  The present invention relates to a program.

  2. Description of the Related Art In recent years, so-called electronic conference systems that use PCs and tablet terminals connected to each other via a network to share electronic data such as materials have been used in conferences. In the electronic conference system, a terminal device used by a presenter (hereinafter referred to as a presenter terminal) and a terminal device used by participants other than the presenter (hereinafter referred to as a participant terminal) are synchronized. Thus, the display content (such as the display page of the material) of the display screen of the presenter terminal is displayed in synchronization with the display screen of the participant terminal.

  For example, Patent Document 1 discloses an electronic conference system in which a user can switch between synchronous and asynchronous on a terminal device. Specifically, when the user presses the synchronization button displayed on the screen of the terminal device, the display contents of the other terminal devices are synchronized and displayed on the screen of the terminal device. When the asynchronous button displayed on is pressed, the asynchronous state is entered, and the content different from the display content of other terminal devices can be displayed.

  For example, in Patent Document 2, a presenter serves as a facilitator of a conference, and depending on the content of operations performed by the presenter, a document is displayed on the display screen of another participant's terminal, or the page of the displayed document is switched. An electronic conference system capable of proceeding with a conference is disclosed. Further, for example, in Patent Document 2, the material data referred to by the presenter and the speech data of the presenter are broadcasted to other participant terminals, thereby synchronizing the material and the sound at a plurality of terminals. An electronic conference system capable of realizing the above is disclosed.

JP 2010-33229 A JP 2002-009765 A

  In the first terminal device capable of displaying in synchronization with the second terminal device, the first terminal device is asynchronous with the second terminal device, as compared with the case where voice is transmitted to the terminal device that performs asynchronous display with other terminal devices. The purpose of this is to suppress communication traffic required for voice transmission from the second terminal device to the first terminal device.

  The program according to claim 1 of the present invention may cause at least a part of the display content of the second terminal device to be displayed in a synchronized state on at least a part of the display screen of the first terminal device in a plurality of terminal devices. A first operation acquisition means for acquiring a first operation content indicating a content operated by a first user in the first terminal device, and the first operation content is stored in the second terminal device. If the operation content is to change the display content displayed on the first terminal device synchronously and is a predetermined operation content, the display content displayed on the first terminal device is changed to the first content. Display control means for changing to display content according to one operation content, and transmission of audio from the second terminal device to the first terminal device is restricted when the display content is changed to display content according to the first operation content Restriction means, And characterized by causing a computer to function with.

  According to the configuration of the first aspect of the present invention, the first terminal device that can display in synchronization with the second terminal device, compared to the case where voice is transmitted to the terminal device that displays asynchronously with other terminal devices. When performing display asynchronous with the second terminal device, communication traffic required for voice transmission from the second terminal device to the first terminal device can be suppressed.

1 is an overall configuration diagram of an electronic conference system according to Embodiment 1. FIG. It is a block diagram which shows the hardware constitutions of a terminal device and a server. It is a functional block diagram which shows the specific structure of an electronic conference system. It is a functional block diagram which shows the specific structure of an electronic conference system. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list | wrist. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system. 6 is a functional block diagram illustrating a specific configuration of a server according to Modification 1 of Embodiment 1. FIG. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the network structure which shows the communication channel which concerns on the modification 1 of Embodiment 1. FIG. It is a figure which shows an example of the network structure of an electronic conference system. It is a whole block diagram of the electronic conference system which concerns on Embodiment 2. FIG. It is a block diagram which shows the hardware constitutions of an operating terminal. It is a functional block diagram which shows the specific structure of a terminal for participants. It is a figure which shows an example of the network structure of an electronic conference system. An example of display contents displayed on the display screen of the presenter terminal is shown. It is a figure which shows an example of the operation classification table. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system. It is a functional block diagram which shows the specific structure of the terminal for participants in the electronic conference system which concerns on the modification 5 of Embodiment 2. FIG. It is a figure which shows an example of the operation classification table. It is a figure which shows an example of the operation classification table. It is an operation | movement flowchart of the electronic conference system which concerns on the modification 5 of Embodiment 2. FIG. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on the modification 8 of Embodiment 2. FIG. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on the modification 8 of Embodiment 2. FIG. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of the network structure of an electronic conference system. It is a whole block diagram of the electronic conference system which concerns on Embodiment 3-1. It is a block diagram which shows the hardware constitutions of the server which concerns on Embodiment 3-1. It is a functional block diagram which shows the specific structure of the server which concerns on Embodiment 3-1. It is a figure which shows an example of the network configuration of the electronic conference system which concerns on Embodiment 3-1. It is a table which shows an example of a terminal list. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is a figure which shows an example of the display content displayed on the display screen of a terminal for presenters. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-1. It is an operation | movement flowchart of an electronic conference system. It is a block diagram which shows the hardware constitutions of the terminal and server which concern on Embodiment 3-2. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on Embodiment 3-2. It is a functional block diagram which shows the specific structure of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list | wrist. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. It is an operation | movement flowchart of the electronic conference system which concerns on Embodiment 3-2. FIG. 10 is a functional block diagram illustrating a specific configuration of a server according to Modification 1 of Embodiment 3. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the network structure which shows the communication path which concerns on the modification 1 of Embodiment 3. It is a figure which shows an example of the network structure of an electronic conference system. It is a whole block diagram of the electronic conference system which concerns on Embodiment 4. It is a block diagram which shows the hardware constitutions of an electronic conference system. It is a functional block diagram which shows the specific structure of a terminal management server and a file management server. It is a figure which shows an example of the display content displayed on the display screen of a terminal for presenters. It is a functional block diagram which shows the specific structure of a terminal. It is a functional block diagram which shows the specific structure of a terminal. It is a figure which shows an example of a transmission terminal list. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the updated receiving terminal list | wrist. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is a figure which shows an example of the network structure which shows a communication path. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system. It is a table which shows an example of access restriction information. It is an operation | movement flowchart of the access control process in an electronic conference system. It is an operation | movement flowchart of the access control process in an electronic conference system. It is a figure which shows an example of the updated receiving terminal list | wrist. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of the network structure of an electronic conference system. FIG. 10 is an operation flowchart of access control processing in an electronic conference system according to Modification 5 of Embodiment 4. FIG. 10 is an operation flowchart of access control processing in an electronic conference system according to Modification 5 of Embodiment 4. It is a functional block diagram which shows the specific structure of the terminal management server which concerns on the modification 6 of Embodiment 4. FIG. It is a figure which shows an example of the network structure of an electronic conference system. It is a figure which shows an example of a receiving terminal list. It is a figure which shows an example of the network structure which shows the communication path which concerns on the modification 6 of Embodiment 4. It is a figure which shows an example of the network structure of an electronic conference system. It is a whole block diagram of the electronic conference system which concerns on Embodiment 5. FIG. It is a block diagram which shows the hardware constitutions of an operating terminal. It is a functional block diagram which shows the specific structure of a terminal for participants. It is a figure which shows an example of the network structure of an electronic conference system. An example of display contents displayed on the display screen of the presenter terminal is shown. It is a figure which shows an example of the operation classification table. It is an operation | movement flowchart of an electronic conference system. It is an operation | movement flowchart of an electronic conference system.

Hereinafter, some embodiments of the present invention will be described. Of the embodiments described below, two or more may be used in combination.
1-1. Embodiment 1
Embodiment 1 of the present invention is an information processing apparatus, an information processing system, a program, and a recording medium that can realize high-quality data communication between terminal apparatuses even when the number of terminal apparatuses connected via a network increases. The purpose is to provide. In the first embodiment, an electronic conference system that transmits and receives audio data between a plurality of terminal devices connected via a network will be described as an example of an information processing system. In addition, the meaning of the term of Embodiment 1 shall extend only to the range of Embodiment 1.

  FIG. 1 is an overall configuration diagram of the electronic conference system according to the first embodiment. The electronic conference system 1100 (information processing system) includes a plurality of terminal devices 110 used by a plurality of users attending the conference, and a server 120 that performs information communication with each terminal device 110. In FIG. 1, six terminal devices 110a to 110f and one server 120 connected to each of the terminal devices 110a to 110f via the communication network 130 are shown. Note that the number of terminal devices 110 constituting the electronic conference system 1100 is not limited. Hereinafter, when a configuration common to each terminal apparatus is described, the terminal apparatus 110 will be collectively referred to.

  As shown in FIG. 1, each terminal device 110 and server 120 are connected to each other via a communication network 130 such as a LAN (Local Area Network) or the Internet. In FIG. 1 and other figures to be described later, a dotted line indicates a state of being connected to the network. Control information and the like between the terminal devices are transmitted and received between the terminal devices via the communication network 130.

  FIG. 2 is a block diagram illustrating the hardware configuration of the terminal device 110 and the server 120. The terminal device 110 includes a computer including a CPU 1101, a memory 1102, a storage unit 1103, a communication unit 1104, an operation unit 1105, a display unit 1106, a voice input unit 1107, and a voice output unit 1108. These hardware elements are connected to each other by a bus so as to be able to exchange data. CPU1101 controls each part of the terminal device 110, or performs various information processing. The memory 1102 holds various programs and data. A work area for the CPU 1101 is also secured in the memory 1102. The storage unit 1103 stores data such as various files and documents. The communication unit 1104 performs data communication with the server 120 and other terminal devices 110 via the communication network 130. The operation unit 1105 is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. A display unit 1106 is a display screen that displays various files, documents, and the like via application software such as a Web browser. The display unit 1106 displays an operation screen for accepting a user operation in the electronic conference. The voice input unit 1107 is a microphone into which a user's voice spoken during an electronic conference is input. The audio output unit 1108 is a speaker that outputs audio data received from another terminal device 110 as audio in an electronic conference. The storage unit 1103, the operation unit 1105, the display unit 1106, the audio input unit 1107, and the audio output unit 1108 may be provided outside the terminal device 110 and connected to the terminal device 110 via the communication network 130. . Further, the terminal device 110 incorporates software such as a browser and an e-mail client. The terminal device 110 is, for example, a personal computer, a PDA (Personal Digital Assistant), a portable information terminal such as a smartphone, or the like.

  The server 120 includes a computer including a CPU 1201, a memory 1202, a storage unit 1203, and a communication unit 1204. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 1201 controls each unit of the server 120 and executes various types of information processing. The memory 1202 holds various programs and data. A work area for the CPU 1201 is also secured in the memory 1202. The storage unit 1203 stores data such as various files and documents. The communication unit 1204 performs data communication with each terminal device 110 via the communication network 130.

  Here, each terminal apparatus 110 may have both a transmission function for transmitting voice data spoken by the user and a reception function for receiving the voice data, or only one of the functions. May be. The functions of each terminal device 110 can be determined based on an instruction of a user who uses each terminal device 110, a form of an electronic conference, or the like.

  3 and 4 are functional block diagrams showing a specific configuration of the electronic conference system 1100. For convenience of explanation, the terminal device 110a shown in FIG. 3 shows functional blocks corresponding to the transmission function, and the terminal device 110b shown in FIG. 4 shows functional blocks corresponding to the reception function. As described above, the terminal device 110a may further include a reception function (see FIG. 4), and the terminal device 110b may further include a transmission function (see FIG. 3). Hereinafter, reference will be made also to the case where each terminal device has both the above functions as necessary.

  As shown in FIGS. 3 and 4, the server 120 includes a transmission request receiving unit 121, a reception request receiving unit 122, a determination processing unit 123, and a terminal information generation unit 124. As shown in FIG. 3, the terminal device 110a includes a transmission request transmission unit 111, a determination result acquisition unit 112, a terminal information acquisition unit 113, a communication path establishment unit 114, a voice transmission unit 115, and a display control unit 116. Yes. As illustrated in FIG. 4, the terminal device 110 b includes a reception request transmission unit 141, a determination result acquisition unit 142, a display control unit 143, and a voice reception unit 144.

  Each element included in each terminal device 110 and server 120 is realized by each CPU 1101 and 1201 executing a program stored in each memory 1102 and 1202 (see FIG. 2).

  The program may be installed in the terminal device 110 and the server 120 from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or downloaded via a communication network 130 such as the Internet. Alternatively, a program corresponding to a predetermined element may be downloaded to each terminal device 110 from the server 120 in which a program corresponding to each element is stored in advance.

  For example, as shown in FIG. 5, in the network configuration in which the terminal devices 110 a to 110 f are connected to the server 120 via the communication network 130, each of the terminal devices 110 a to 110 f is connected to the server 120. A program corresponding to a predetermined element may be downloaded from the server 120 in which a program corresponding to the element is stored in advance to each memory 1102 of each of the terminal devices 110a to 110f. The downloaded program may be constituted by, for example, JavaScript (registered trademark). Each terminal device 110a to 110f acquires the program when connected to the server 120.

  Each function corresponding to the program will be described. Below, it demonstrates according to the flow of a process of the electronic conference system 1100 according to the progress of the electronic conference.

  First, in an electronic conference, when a user desires to transmit his / her speech (voice) to another terminal device 110, that is, the user transmits voice data between the terminal device and the other terminal device. When it is requested to establish a communication channel for this, the operation unit 1105 of the terminal device 110 is operated to give an instruction to that effect. For example, in an electronic conference, the user A displays a “voice transmission” selection screen (for example, a check box or an electronic button) displayed on the display unit 1106 of the terminal device 110a (see FIG. 3) used by the user A using a keyboard. Select using the mouse or mouse. The transmission request transmission unit 111 of the terminal device 110 a transmits the received user A request (hereinafter referred to as a transmission request) to the server 120. For example, when the user A removes the “voice transmission” check box or when a predetermined condition is satisfied (described later), the transmission request transmission unit 111 transmits a transmission cancellation request. For example, the transmission request transmission unit 111 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a release request.

  Further, in an electronic conference, when a user desires to receive another user's speech (voice), the user operates the operation unit 1105 of the terminal device 110 to give an instruction to that effect. For example, in an electronic conference, the user B displays a “voice reception” selection screen (for example, a check box or an electronic button) displayed on the display unit 1106 of the terminal device 110b (see FIG. 4) used by the user B using a keyboard. Select using the mouse or mouse. The reception request transmission unit 141 of the terminal device 110b transmits the received user B request (hereinafter referred to as a reception request) to the server 120. For example, when the user B removes the “voice reception” check box or satisfies a predetermined condition (described later), the reception request transmission unit 141 transmits a reception cancellation request. For example, the reception request transmission unit 141 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a release request.

  Each terminal device 110 displays both “voice transmission” and “voice reception” selection screens, and each user can select each selection screen individually. For example, in the terminal device 110a, the user A can select both “voice transmission” and “voice reception”.

  The transmission request reception unit 121 of the server 120 receives the transmission request transmitted from the transmission request transmission unit 111 of the terminal device 110. For example, when a transmission request is transmitted from each of the terminal devices 110a and 110f, the transmission request receiving unit 121 receives the transmission requests of both the terminal devices 110a and 110f.

  The reception request reception unit 122 of the server 120 receives the reception request transmitted from the reception request transmission unit 141 of the terminal device 110. For example, when a reception request is transmitted from each of the terminal devices 110a to 110f, the reception request receiving unit 122 receives the reception request of each of the terminal devices 110a to 110f.

  Based on the transmission request received by the transmission request receiving unit 121, the determination processing unit 123 of the server 120 determines whether or not the terminal device 110 that has transmitted the transmission request permits voice transmission. Specifically, the determination processing unit 123 compares the total number of terminal devices that have received the transmission request received by the transmission request receiving unit 121 with a preset number of terminals, and the total number is equal to or less than the set number. It is determined whether or not there is. When the total number is equal to or less than the set number, the determination processing unit 123 permits voice transmission in the terminal device that has requested transmission, and disallows voice transmission when the total number exceeds the set number. . For example, when the set number is set to “3” and the terminal devices 110a and 110f make a transmission request, the total number (2) is equal to or less than the set number (3), so the terminal device 110a. , 110f allows voice transmission.

  Here, the determination processing unit 123 calculates the total number of terminal devices 110 that are requesting transmission at the present time (when the determination target terminal device makes a transmission request). For example, when the terminal devices 110a and 110f have already made a transmission request and the terminal device 110b has newly made a transmission request, the total number at the present time is three. Therefore, for example, when the set number is set to “2”, the terminal devices 110a and 110f have already made a transmission request (voice transmission may have already been performed), and the terminal device 110b is newly set. When the transmission request is made, the total number (3) exceeds the set number (2), and therefore the voice transmission of the terminal device 110b newly making the transmission request is not permitted.

  As described above, the voice transmission is permitted until the set number is reached in the order in which the transmission requests are made. In addition, when the number of terminal devices 110 that are permitted to transmit voice reaches the set number, when voice transmission (communication path) is canceled in any one of the terminal devices 110, voice transmission of other terminal devices 110 is performed. Permission may be given.

  The determination processing unit 123 transmits the determination result (permission notification, non-permission notification) to the terminal device 110 that has transmitted the transmission request.

  Further, the determination processing unit 123 may determine whether or not the terminal device 110 that has transmitted the reception request is permitted to receive a voice based on the reception request received by the reception request reception unit 122. For example, the determination processing unit 123 compares the total number of terminal devices 110 that have received the reception request received by the reception request reception unit 122 with a preset number of sets, and whether the total number is equal to or less than the set number. It may be determined whether or not. Further, whether or not the voice reception is permitted may be determined based on other conditions described later (modified example 1 of the first embodiment described later). Further, the determination processing unit 123 may permit voice reception for all reception requests received by the reception request reception unit 122. The determination processing unit 123 transmits the determination result (permission notification, non-permission notification) to the terminal device 110 that transmitted the reception request.

  Furthermore, when the total number of terminal devices 110 that can make a transmission request reaches the set number, the determination processing unit 123 confirms that the number of transmission terminals reaches a specified value (set number) and that no more transmission requests can be made. The notification (message) indicated may be transmitted to all the terminal devices 110 connected to the server 120. Similarly, a notification indicating that a transmission request can be made may be transmitted to all the terminal devices 110 when the number of units that can make a transmission request in response to a transmission release request falls below the set number. Moreover, you may transmit the notification which shows the remaining number itself until it reaches a setting number. For example, if the set number is two and if there is a transmission request from the terminal device 110a, the terminal device 110a is notified of the transmission permission, and all the terminal devices 110 remain until the set number is reached. "1 (unit)" is transmitted, and when there is a transmission request from the terminal device 110f next, the terminal device 110f is notified of transmission permission, and "0 (unit)" is transmitted to all the terminal devices 110. For example, when there is a transmission cancellation request from the terminal device 110a, “1 (unit)” is transmitted to all the terminal devices 110. Note that the determination processing unit 123 may perform the same processing as described above for a reception request.

  The terminal information generation unit 124 of the server 120 generates transmission terminal information based on the transmission request received by the transmission request reception unit 121 and the determination result in the determination processing unit 123. Specifically, when the total number is less than or equal to the set number, the terminal information generation unit 124 generates a transmission terminal list that lists terminal information of the terminal device 110 that permits voice transmission. For example, when the transmission request received from the terminal devices 110a and 110f is permitted, the terminal information generation unit 124 lists terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminal devices 110a and 110f. Generate a list of sending terminals. FIG. 6 shows an example of the transmission terminal list. The terminal information generation unit 124 updates the transmission terminal list every time the received transmission request is permitted or every time the transmission request is canceled. The generated transmission terminal list is stored in the terminal list DB 1203a.

  Further, the terminal information generation unit 124 generates reception terminal information based on the reception request received by the reception request reception unit 122. Specifically, the terminal information generation unit 124 generates a reception terminal list that lists terminal information of the terminal device 110 that permits the reception request. For example, when the reception request received from the terminal devices 110a to 110f is permitted, the terminal information generation unit 124 lists terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminal devices 110a to 110f. The received terminal list is generated. FIG. 7 shows an example of the receiving terminal list. The terminal information generation unit 124 updates the reception terminal list every time the received reception request is permitted or every time the reception request is canceled. FIG. 8 shows an updated receiving terminal list when a new reception request received from the terminal device 110g (not shown) connected to the network is permitted in the state of FIG. The generated receiving terminal list is stored in the terminal list DB 1203a.

  In addition, the terminal information generation unit 124 transmits the reception terminal list to the terminal device 110 that is permitted to transmit voice by the determination processing unit 123. Further, the terminal information generation unit 124 transmits the updated receiving terminal list to the terminal device 110 that is permitted to transmit voice even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted for the terminal devices 110a and 110f, the terminal information generation unit 124 transmits the reception terminal list (see FIG. 7) to the terminal devices 110a and 110f. In addition, when the receiving terminal list is updated, the terminal information generation unit 124 transmits the updated receiving terminal list to the terminal devices 110a and 110f. At that time, only the changed (added) receiving terminal list may be transmitted.

  The determination result acquisition unit 112 of the terminal device 110a receives (or acquires) the determination result in the determination processing unit 123 of the server 120. For example, the determination result acquisition unit 112 of the terminal devices 110 a and 110 f acquires a voice transmission permission notification from the server 120.

  The terminal information acquisition unit 113 (terminal information reception unit 13) of the terminal device 110a receives (or acquires) the reception terminal list from the terminal information generation unit 124 of the server 120. For example, the terminal information acquisition unit 113 of the terminal devices 110a and 110f acquires the reception terminal list shown in FIG.

  The communication path establishment unit 114 of the terminal device 110a is a communication path for transmitting (transmitting / receiving) audio data to / from another terminal device 110 based on the reception terminal list acquired by the terminal information acquisition unit 113. Establish. The acquired receiving terminal list is stored in the storage unit 1103. For example, the communication path establishment unit 114 of the terminal device 110a establishes a communication path between the terminal device 110a and each of the terminal devices 110b, 110c, 110d, 110e, and 110f. FIG. 9 shows a network configuration showing communication paths established between the terminal device 110a and the terminal devices 110b, 110c, 110d, 110e, and 110f. Similarly, the communication path establishment unit 114 of the terminal device 110f establishes a communication path between the terminal device 110f and each of the terminal devices 110a, 110b, 110c, 110d, and 110e. FIG. 10 shows a network configuration showing communication paths established between the terminal device 110f and the terminal devices 110a, 110b, 110c, 110d, and 110e. FIG. 11 shows a network configuration showing all communication paths established in the above example. 9 to 11, the direction of the arrow indicates the transmission direction of the audio data. 9 to 11 show a configuration in which audio data is transmitted and received without going through the server 120. However, the network configuration is not limited to this, and the configuration is such that the server 120 is used as a repeater to transmit and receive audio data. May be.

  The communication path is established, for example, by a terminal device (sending terminal device) that transmits voice to a terminal device (receiving terminal device) that receives voice based on the IP address and port number of the receiving terminal information. . For example, when the user A removes the “voice transmission” check box displayed on the display unit 1106 of the terminal device 110a, the communication channel establishment unit 114 cancels the established communication channel.

  When the communication channel establishment unit 114 establishes the communication channel, the voice transmission unit 115 of the terminal device 110a transmits the voice data input to the voice input unit 1107 to each terminal device 110 via the communication channel ( To deliver. For example, the voice transmission unit 115 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 1107 of the terminal device 110a via the communication path (single line in FIG. 11), 110c, 110d, 110e, and 110f, and the voice data corresponding to the speech (voice) of the user F input to the voice input unit 1107 of the terminal device 110f via the communication path (double line in FIG. 11). It transmits to terminal device 110a, 110b, 110c, 110d, 110e. Thereby, the utterances (voice data) of the user A and the user F can be transmitted to the other terminal devices 110 at the same timing, for example. In addition, the audio | voice transmission part 115 may perform stream transmission (streaming) to each terminal device 110, and may transmit an audio | voice data file. When a Web browser is incorporated in both the transmission terminal device and the reception terminal device, the audio stream of the transmission terminal device may be connected to the reception terminal device using WebRTC (Web Real-Time Communication).

  The display control unit 116 of the terminal device 110 a causes the display unit 1106 to display the display content corresponding to the determination result acquired by the determination result acquisition unit 112. For example, when the determination result acquisition unit 112 acquires a voice transmission permission notification from the server 120, the display control unit 116 causes the display unit 1106 to display a message indicating that voice transmission is permitted. When the determination result acquisition unit 112 acquires a voice transmission non-permission notification from the server 120, the display control unit 116 causes the display unit 1106 to display an error message indicating voice transmission non-permission, and the display unit The “voice transmission” selection screen (check box or electronic button) displayed in 1106 is changed so that it cannot be selected. For example, an electronic button for selecting voice transmission (transmission request) is grayed out (inactivated) so that it cannot be selected (pressed), or the display unit 1106 indicates that “current transmission request cannot be made”. May be displayed. As described above, the display control unit 116 may control the display content of the display unit 1106 so that the user cannot perform new voice transmission (transmission request).

  The determination result acquisition unit 142 of the terminal device 110b receives (or acquires) the determination result in the determination processing unit 123 of the server 120. For example, the determination result acquisition unit 142 of the terminal devices 110 a to 110 f acquires a voice reception permission notification from the server 120.

  When the determination result acquisition unit 142 acquires the permission notification, the display control unit 143 of the terminal device 110b causes the display unit 1106 to display a message indicating that voice reception is permitted. When the determination result acquisition unit 142 acquires a voice reception non-permission notification from the server 120, the display control unit 143 causes the display unit 1106 to display an error message indicating voice reception non-permission and the display unit. The selection is changed so that the selection screen (check box or electronic button) of “voice reception” displayed in 1106 cannot be selected.

  The voice receiving unit 144 of the terminal device 110b receives voice data transmitted via the communication path. The audio output unit 1108 converts the received audio data and outputs audio. For example, each of the voice reception units 144 of the terminal devices 110b, 110c, 110d, 110e, and 110f corresponds to the speech (voice) of the user A transmitted from the terminal device 110a via the communication path (single line in FIG. 11). Audio data to be received is received, and each audio output unit 1108 outputs audio. In addition, each of the voice reception units 144 of the terminal devices 110a, 110b, 110c, 110d, and 110e transmits the speech (voice) of the user F transmitted from the terminal device 110f via the communication path (double line in FIG. 11). Corresponding audio data is received, and each audio output unit 1108 outputs audio. Thereby, for example, the user B, the user C, the user D, and the user E of the terminal devices 110b, 110c, 110d, and 110e can hear the user A and the user F at the same timing.

  Next, the flow of processing in the server 120 will be described using a flowchart. FIG. 12 shows a flowchart when the server 120 receives a transmission request from the terminal device 110.

  First, when a transmission request is transmitted from the terminal device 110, the transmission request receiving unit 121 receives the transmission request (S1101). Next, the determination processing unit 123 compares the total number of terminal devices 110 that have made a transmission request with a preset set number, and determines whether the total number is equal to or less than the set number (S1102). .

  When the total number is equal to or less than the set number, the determination processing unit 123 transmits a voice transmission permission notification to the terminal device 110 that has requested transmission, and the terminal information generation unit 124 transmits a transmission terminal list (see FIG. 6) is generated (S1103). Subsequently, the terminal information generation unit 124 transmits a receiving terminal list that lists information of the terminal device that has made the reception request to the terminal device 110 registered in the transmitting terminal list (S1104).

  In the process of S1102, when the total number exceeds the set number, the determination processing unit 123 transmits a voice transmission non-permission notification to the terminal device 110 that has transmitted the transmission request (S1105). The processes from S1101 to S1105 are repeated until the electronic conference is completed (S1106).

  FIG. 13 shows a flowchart when the server 120 receives a reception request from the terminal device 110.

  First, when a reception request is transmitted from the terminal device 110, the reception request reception unit 122 receives the reception request (S1201). Next, the terminal information generation unit 124 generates or updates the receiving terminal list (see FIG. 7) (S1202). Next, the terminal information generation unit 124 transmits a voice reception permission notification to the terminal device 110 registered in the receiving terminal list (S1203). Note that, here, a case where voice reception is permitted for all reception requests received by the reception request reception unit 122 is shown, but the determination processing unit 123 receives the voice only when the number is less than a preset number. If not allowed, a voice reception non-permission notice may be transmitted to the terminal device 110. Next, the terminal information generation unit 124 acquires the transmission terminal list, and transmits the reception terminal list for each of the terminal devices 110 registered in the transmission terminal list (S1204). When the receiving terminal list is changed (updated), only the receiving terminal list that has been changed (added) may be transmitted. The processing from S1201 to S1204 is repeated until the electronic conference is completed (S1205).

  FIG. 14 is a flowchart when the user makes a transmission request in the terminal device 110.

  First, in an electronic conference, the terminal device 110 receives a transmission request from a user (S1301). Next, the transmission request transmission unit 111 transmits the received transmission request to the server 120 (S1302). When receiving the transmission request, the server 120 executes the processing from S1101 to S1105 shown in FIG.

  Next, the determination result acquisition unit 112 of the terminal device 110 acquires a transmission permission notification or a transmission non-permission notification from the server 120 (S1303). When the transmission permission notification is acquired, the terminal information acquisition unit 113 acquires a reception terminal list from the server 120 (S1304).

  Next, the communication path establishment unit 114 acquires terminal information (terminal ID) of any one terminal device 110 from the receiving terminal list (S1305). Next, the communication path establishment unit 114 establishes a communication path for transmitting voice data to the terminal device 110 corresponding to the acquired terminal information (S1306). The communication path establishment unit 114 executes processing for establishing a communication path for all the terminal devices 110 registered in the receiving terminal list (S1307).

  Next, the voice transmission unit 115 transmits the voice data to each terminal device 110 via the established communication path (S1308).

  In the process of S1303, when the determination result acquisition unit 112 acquires a transmission non-permission notification from the server 120, the display control unit 116 of the terminal device 110 displays an error message on the display unit 1106 (S1309). The processes from S1301 to S1309 are repeated until the electronic conference is finished (S1310).

  As described above, the electronic conference system 1100 sets an upper limit on the number of transmitting terminals having the right to speak (transmits voice) and dynamically changes the terminal device that permits transmission according to a user instruction, A communication path is established between a terminal device that is permitted to transmit and another terminal device.

1-2. Modified Example of Embodiment 1 The electronic conference system 1100 is not limited to the above configuration, and various configurations can be adopted. Hereinafter, an electronic conference system 1100 according to a modification of the first embodiment will be described focusing on differences from the above configuration. In the electronic conference system 1100 according to the modification of the first embodiment below, description of elements having the same functions as those of the electronic conference system 1100 will be omitted.

1-2-1. Modification 1 of Embodiment 1
In the electronic conference system 1100 according to the first modification of the first embodiment, the server 120 may further include a current location acquisition unit 125 that acquires the current location of each terminal device 110. FIG. 15 is a functional block diagram illustrating a specific configuration of the server 120 according to the first modification of the first embodiment.

  The current location acquisition unit 125 receives, for example, a detection value of a position detection unit (not shown) (for example, a GPS) provided in each terminal device 110, and determines the current location (address location, etc.) of each terminal device 110. get. The current location acquisition unit 125 may acquire the current location of each terminal device 110 by setting the IP address, the subnet of the network, and location information in advance, and acquiring the IP address of each terminal device 110.

  Based on the reception request received by the reception request reception unit 122 and the current location of each terminal device 110 acquired by the current location acquisition unit 125, the determination processing unit 123 receives the voice in the terminal device 110 that has transmitted the reception request. Judge whether or not.

  The terminal information generation unit 124 generates reception terminal information based on the reception request received by the reception request reception unit 122 and the determination result of the determination processing unit 123. Specifically, the terminal information generation unit 124 generates a reception terminal list that lists information of the terminal devices 110 permitted by the determination processing unit 123 among the terminal devices 110 that have made a reception request. The terminal information generation unit 124 transmits the reception terminal list to the terminal device 110 that is permitted to transmit the voice in the determination processing unit 123.

  Hereinafter, a specific example will be described. In FIG. 16, the terminal devices 110a, 110b, and 110c are provided in the same conference room 1101, the terminal device 110d is provided in a location P1 remote from the conference room 1101, and the terminal device 110e is provided in a location P2 remote from the conference room 1101. A network configuration is shown in the case where the terminal device 110f is provided at a location P3 remote from the conference room 1101.

  In the network configuration of FIG. 16, it is assumed that the terminal devices 110a and 110f transmit a transmission request, and the terminal devices 110a to 110f transmit a reception request. Since the total number (2) of transmission requests is less than or equal to the set number (3), the terminal devices 110a and 110f are permitted to transmit voice.

  The current location acquisition unit 125 acquires the current location from each of the terminal devices 110a to 110f. That is, the current location acquisition unit 125 acquires “conference room 1101” as the current location of the terminal devices 110a, 110b, and 110c, acquires “remote location P1” as the current location of the terminal device 110d, and “remote location” as the current location of the terminal device 110e. "P2" is acquired, and "Remote P3" is acquired as the current location of the terminal device 110f.

  The determination processing unit 123 determines whether or not the current location of each terminal device 110 is the same or a location (predetermined location) within a preset range, and when a plurality of terminal devices 110 exist at the predetermined location. The voice reception is permitted for one terminal device 110 among the plurality of terminal devices 110, and the voice reception is not permitted for the other terminal devices 110. In the network configuration of FIG. 16, among the terminal devices 110a, 110b, and 110c existing in a predetermined place (conference room 1101), the voice reception of the terminal device 110a is permitted, and the voice reception of the terminal devices 110b and 110c is not permitted. To do. The determination processing unit 123 transmits the determination result (permission notification, non-permission notification) to the terminal device that transmitted the reception request.

  The terminal information generation unit 124 generates a reception terminal list shown in FIG. 17 based on the determination result, and transmits the reception terminal list to the terminal devices 110a and 110f. The terminal devices 110a and 110f establish communication paths based on the acquired receiving terminal list. FIG. 18 shows a network configuration showing a communication path established in the electronic conference system 1100 according to the first modification of the first embodiment.

  In addition, when a plurality of terminal devices 110 exist in a predetermined place and a transmission request is made in the plurality of terminal devices 110 among these, the determination processing unit 123 sets the plurality of terminal devices 110 that have made the transmission requests. Voice transmission may be permitted for one of the terminal devices 110, and voice transmission may not be permitted for the other terminal devices 110. For example, when a transmission request is made in the terminal devices 110a, 110b, and 110c existing in the conference room 1101, the voice transmission of the terminal device 110a is permitted, and the voice transmission of the terminal devices 110b and 110c is not permitted. The terminal information generation unit 124 transmits the receiving terminal list to the terminal device 110a that has permitted voice transmission, and the terminal device 110a establishes a communication path based on the acquired receiving terminal list.

  In an electronic conference having the above network configuration, a plurality of users (for example, users B and C) of a plurality of terminal devices 110 existing in the same conference room directly listen to the content of one user (for example, user A). The terminal device 110 (for example, the terminal device 110a) of the plurality of terminal devices 110 receives and outputs the utterance content of other users (for example, the users D, E, and F) at a remote location. Can be heard. Therefore, according to the electronic conference system 1100 which concerns on the modification 1 of Embodiment 1, the number of required communication paths can be reduced.

1-2-2. Modification 2 of Embodiment 1
In the electronic conference system 1100 according to the second modification of the first embodiment, the set number may be changed dynamically. Specifically, the set number may be set according to the number of all terminal devices 110 connected via the communication network 130. For example, a configuration can be adopted in which the set number is reduced as the number of terminal devices 110 increases. This configuration is suitable for an electronic conference such as a seminar in which a speaker (presenter) is determined. Alternatively, the set number may be calculated and set based on the ratio to the number of all terminal devices 110 connected via the network. Further, the set number may be set according to the number of terminal devices 110 that have made a reception request.

1-2-3. Modification 3 of Embodiment 1
In the electronic conference system 1100 according to the third modification of the first embodiment, after the communication path is established, the time when the voice data is not transmitted from the terminal device 110 that is permitted to transmit the voice reaches a preset time. The communication path establishment unit 114 may cancel the communication path corresponding to the terminal device 110. For example, when the user A who is permitted to transmit voice does not speak for a certain period of time, the communication path establishment unit 114 forcibly releases the communication path established in the terminal device 110a of the user A. In the above configuration, a user who uses the transmission terminal device may be photographed with a camera, and the photographed image may be analyzed to measure the presence / absence of the user's speech and the silent state time. The camera may be built in the terminal device 110 or may be installed outside (for example, a conference room).

  Here, in the first embodiment, as illustrated in FIG. 14, when the transmission non-permission notification is acquired, the display control unit 116 of the terminal device 110 displays an error message on the display unit 1106. The configuration when voice transmission is not permitted is not limited to this.

  For example, in the electronic conference system 1100 according to the fourth modification of the first embodiment, when the total number of transmission terminal devices has already reached the set number when the terminal device 110 is connected to the server 120, check the check box. You may control so that it cannot. Further, the check box may be controlled by acquiring information from the server 120 in accordance with the increase or decrease of the total number of transmitting terminal devices. Acquisition of the total number of transmission terminal devices may be performed by polling the server 120, but preferably, the connection is made using Web Socket or the like, and the server 120 side notifies each terminal device. Just do it.

  The electronic conference system 1100 may have the following configuration.

  Even if a large number of terminal devices are connected to the electronic conference system 1100, the number of people who can speak at the same time (speaker terminals) is limited at a certain moment. The communication path establishment state is dynamically changed while switching the transmission terminal device while limiting. Thereby, it becomes possible to mutually transmit and receive audio data between a large number of terminal devices in a pseudo manner.

  The electronic conference system 1100 has a configuration in which voice transmission / voice reception can be selected by each terminal device and the server 120 is notified when the voice transmission / voice reception status of each terminal device changes.

  Further, the server 120 notifies the terminal device selected for voice transmission of a list of terminal devices selected for voice reception. At this time, it is not necessary to notify the information of the terminal device whose state has not changed so far. The transmitting terminal device that has received the notification calls the receiving terminal device so as to receive its own stream information only to the newly registered receiving terminal device (calls a connection request).

  Also, in the electronic conference system 1100, the server 120 manages the total number of terminal devices that can transmit simultaneously, and when the total number reaches the upper limit (set number), the terminal device cannot select a transmission request. Have

  Further, in the electronic conference system 1100, the transmission terminal device includes two types, a constant transmission terminal device and a temporary transmission terminal device. Of these, the temporary transmission terminal device can transmit only for a certain period of time. After the elapse of time, the voice transmission may be canceled (the transmission request check box is canceled). The temporary transmission terminal device may be configured to allow transmission only while the user is pressing the voice transmission button. Further, the temporary transmission terminal device may be configured such that the transmission request is canceled when the silent state continues for a certain period of time.

  Further, the electronic conference system 1100 may be configured such that a user who wants to speak makes a transmission request in a terminal device and gives a speaking right to a user designated in a specific terminal device (master terminal) (permits as a transmission terminal device). .

  The network configuration in the electronic conference system 1100 is not limited to the configuration illustrated in FIG. 5, and the server 120 and any one of the terminal devices 110 among the plurality of terminal devices 110 may be the same terminal. It may be a configuration not having (FIG. 19). The configuration shown in FIG. 19 is realized by downloading a program corresponding to each element included in the electronic conference system 1100 to each of the terminal devices 110a to 110f. Specifically, each terminal device 110a to 110f includes the elements shown in FIGS. 3 and 4 in common, and the program stored in the memory of each terminal device is executed by the CPU of each terminal device. An electronic conference system 1100 is realized. In a configuration without the server 120, when a transmission request (voice transmission) is made in a certain terminal device 110, the transmission request is transmitted to all the terminal devices 110, and all the terminal devices 110 share the terminal list DB 1203a. It can be set as the structure to do. Also, in the above configuration, the terminal device 110 that has made a transmission request performs a process of determining whether or not to permit voice transmission before transmitting the transmission request to another terminal device 110, and if it determines that permission is granted, the transmission request is made. It can be set as the structure transmitted to the other terminal device 110. FIG. Note that the downloaded program may be constituted by, for example, JavaScript (registered trademark). Thus, each terminal device can function as a transmission terminal device or a reception terminal device depending on the status of the conference. Note that the terminal device 110 in which the program is downloaded or recorded functions as an information processing device. Further, the computer on which the program is downloaded may be the terminal device 110 or the server 120.

  In the configuration shown in FIG. 5, a program corresponding to each element included in the electronic conference system 1100 may be downloaded to the server 120. The server 120 in which the program is downloaded or recorded functions as an information processing apparatus.

  The electronic conference system 1100 is not limited to audio data transmission / reception. That is, the electronic conference system 1100 can be applied to transmission / reception of media data including at least one of audio data and video data (moving image data). The electronic conference system 1100 can be applied to various electronic conferences such as a video conference and a telephone conference. In a video conference, video captured by a camera mounted on each terminal device is bidirectionally communicated between the terminal devices via the communication path. The electronic conference system 1100 can also be applied to a remote conference where conference attendees are remote from each other.

  According to the electronic conference system 1100 described above, high-quality data communication is realized between terminal devices even when the number of terminal devices connected via a network increases. In addition, each user can make a selection according to his / her own intention, such as when he / she wants to transmit a speech (voice) or receives voice, and is reflected in the intention of the user between terminal devices on the network. The communication path is dynamically changed and established.

  In the above description, an electronic conference system is taken as an example of an information processing system. However, the information processing system is not limited to an electronic conference system, and various types of media data can be shared between terminal devices connected to a network. System.

1-3. Advantageous Effects of Embodiment 1 A program according to Embodiment 1 of the present invention is for causing a computer that transmits and receives media data including at least one of audio data and video data to a plurality of terminal devices connected via a network. A transmission request receiving means for receiving the media data transmission request from at least one terminal apparatus, a reception request receiving means for receiving the media data reception request from at least one terminal apparatus, and the transmission request When the total number of the terminal devices that have performed is less than or equal to a predetermined number, the terminal device that has made the transmission request and at least one of the terminal devices that have made the reception request A communication path establishment means for establishing a communication path for transmitting the media data with a terminal device; And making the computer function. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as a current location acquisition unit that acquires a current location of each terminal device, and the communication path establishment unit includes: When there are a plurality of terminals within a predetermined range, the communication path may be established for one of the terminal devices.

  In the program according to the first embodiment of the present invention, the set number may be set according to the number of all terminal devices connected via the network. According to this configuration, the set number is set according to the number of terminal devices.

  In the program according to the first embodiment of the present invention, the set number may be set according to the number of the terminal devices that have made the reception request. According to this configuration, the set number is set according to the number of terminal devices that have requested reception.

  In the program according to Embodiment 1 of the present invention, when the transmission request receiving means receives a new transmission request when the total number of the terminal devices that have made the transmission request has reached the set number. The communication path establishment means may reject the establishment of the communication path for the terminal device that has made a new transmission request.

  In the program according to the first embodiment of the present invention, after the communication path is established, when the time during which the media data is not transmitted from the terminal device that has made the transmission request has reached a predetermined time, The communication path establishment means may release the communication path corresponding to the terminal device. According to this configuration, when the time during which media data is not transmitted reaches a preset time, the communication path of the corresponding terminal device is released.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as display control means for controlling display contents of the display unit of the terminal device, and the total number of the terminal devices that have made the transmission request is When the set number has been reached, the display control means may display a screen indicating that the transmission request is not accepted on the display unit of the terminal device that has made a new transmission request. .

  In the program according to the first embodiment of the present invention, the computer is further caused to function as display control means for controlling display contents of the display unit of the terminal device, and the total number of the terminal devices that have made the transmission request is When the set number has been reached, the display control means may control the display content of the display unit so that the user cannot select a new transmission request. According to this configuration, a screen indicating that a transmission request is not accepted is displayed on the display unit of the terminal device that has been refused establishment of the communication path.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as display control means for controlling display contents of the display unit of the terminal device, and the total number of the terminal devices that have made the transmission request is When the set number has been reached, the display control means displays on the display unit for the user to make the transmission request when the terminal device is connected to a server that manages all the terminal devices. You may make it control so that the check box to be checked cannot be checked. According to this configuration, a screen indicating that a transmission request is not accepted is displayed on the display unit of the terminal device that has been refused establishment of the communication path.

  In the program according to the first embodiment of the present invention, the computer is further caused to function as display control means for controlling display contents of the display unit of the terminal device, and the total number of the terminal devices that have made the transmission request is When the set number has been reached, the display control means displays the display unit so that the user cannot select a new transmission request, and the total number of the terminal devices that have made the transmission request is When the number is less than the set number, the display content of the display unit may be changed so that the user can select a new transmission request. According to this configuration, a screen that accepts a transmission request and a screen that does not accept a transmission request are switched and displayed according to an increase or decrease in the total number of transmission terminal devices.

  A program according to Embodiment 1 of the present invention is a program for causing a computer that transmits and receives media data including at least one of audio data and video data in a plurality of terminal devices connected via a network, Transmission request receiving means for receiving the media data transmission request from at least one terminal apparatus; Reception request receiving means for receiving the media data reception request from at least one terminal apparatus; and the terminal that has made the transmission request If the total number of devices is equal to or less than a predetermined number, the transmission between the terminal device that has made the transmission request and at least one of the terminal devices out of the terminal devices that have made the reception request A permission notification for permitting establishment of a communication path for transmitting the media data in the transmission request. Determination processing means for transmitting to the terminal apparatus that has performed, and characterized by causing a computer to function as a. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  A program according to Embodiment 1 of the present invention is a program for causing a computer that transmits and receives media data including at least one of audio data and video data in a plurality of terminal devices connected via a network, Transmission request transmission means for transmitting a transmission request for transmitting the media data to another transmission terminal, if the total number of the terminal devices that have performed the transmission request is equal to or less than a predetermined set number, A communication path for transmitting the media data between the terminal device that has made a transmission request and at least one terminal device among a plurality of terminal devices that have made a reception request for receiving the media data The computer is made to function as a communication path establishment means for establishing the communication path. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  A program according to Embodiment 1 of the present invention is a program for causing a computer that transmits and receives media data including at least one of audio data and video data in a plurality of terminal devices connected via a network, A transmission request transmitting means for transmitting a transmission request for transmitting the media data to another transmitting terminal; a terminal information receiving means for receiving a receiving terminal list in which information of a terminal apparatus that receives the media data is registered; and the transmission A computer as communication path establishment means for establishing a communication path for transmitting the media data between the terminal apparatus for which the request is permitted and the terminal apparatus registered in the received receiving terminal list. It is made to function. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  The program may be stored in a computer-readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal device or a server that manages the terminal device.

  The information processing apparatus according to the first embodiment of the present invention is an information processing apparatus that transmits and receives media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. When the total number of transmission request transmission means for transmitting a transmission request for transmitting data to another transmission terminal and the terminal apparatus that has made the transmission request is equal to or less than a predetermined number, the transmission A communication path for transmitting the media data is provided between the terminal device that has made the request and at least one terminal device among the plurality of terminal devices that have made the reception request for receiving the media data. Communication path establishment means to be established. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  An information processing system according to Embodiment 1 of the present invention is an information processing system that transmits and receives media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. Transmission request receiving means for receiving the media data transmission request from one terminal apparatus, reception request receiving means for receiving the media data reception request from at least one terminal apparatus, and the terminal that has made the transmission request If the total number of devices is equal to or less than a predetermined number, the transmission between the terminal device that has made the transmission request and at least one of the terminal devices out of the terminal devices that have made the reception request Communication path establishing means for establishing a communication path for transmitting the media data. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

  The recording medium according to the first embodiment of the present invention is a program for causing a computer to transmit and receive media data including at least one of audio data and video data in a plurality of terminal devices connected via a network. A transmission request receiving means for receiving the transmission request for the media data from at least one terminal apparatus; a reception request receiving means for receiving the reception request for the media data from at least one terminal apparatus; When the total number of terminal devices is equal to or less than a predetermined number, the terminal device that has made the transmission request and at least one terminal device of the terminal devices that have made the reception request In the meantime, a computer is provided as communication path establishment means for establishing a communication path for transmitting the media data. And characterized by recording a program for. According to this configuration, when the total number of terminal devices that have requested transmission is equal to or less than the set number, media data is transmitted between the terminal device that has requested transmission and the terminal device that has requested reception. Therefore, even if the number of terminal devices connected via the network increases, high-quality data communication is realized between the terminal devices.

2-1. Embodiment 2
In Embodiment 2 of the present invention, an operation terminal that is displayed in synchronization with another operation terminal in an electronic conference can be operated by a user's desired operation without requiring a synchronous / asynchronous switching operation by the user of the operation terminal. An object of the present invention is to provide an information processing apparatus, an information processing system, a program, and a recording medium that can display corresponding contents. In the second embodiment, as an example of the information processing system, an electronic conference system that shares electronic data among a plurality of operation terminals connected via a network will be described as an example. In addition, the meaning of the term of Embodiment 2 shall extend only to the range of Embodiment 2.

  FIG. 20 is an overall configuration diagram of the electronic conference system according to the second embodiment. The electronic conference system 2100 (information processing system) includes a plurality of operation terminals 210 used by a plurality of users attending the conference. In the second embodiment, for convenience of explanation, a user who can play a leading role in the conference, such as a conference organizer, a facilitator of the conference, or a person in charge of the presentation at the conference, is called a “presenter” (second user). The operation terminal used by is called “presenter terminal” (second operation terminal). A user who attends a meeting other than the presenter is referred to as a “participant” (first user), and an operation terminal used by the participant is referred to as a “participant terminal” (first operation terminal). FIG. 20 shows one presenter terminal 210a and three participant terminals 210b, 210c, and 210d. In the following description, the common configuration of the presenter terminal 210a and the participant terminals 210b, 210c, and 210d will be collectively referred to as the operation terminal 210.

  As shown in FIG. 20, the presenter terminal 210a and the participant terminals 210b, 210c, and 210d are connected to each other via a communication network 220 such as a LAN (Local Area Network) or the Internet.

  FIG. 21 is a block diagram illustrating a hardware configuration of the operation terminal 210. The operation terminal 210 includes a computer including a CPU 2101, a memory 2102, a storage unit 2103, a communication unit 2104, an input unit 2105, and a display unit 2106. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 2101 controls each unit of the operation terminal 210 and executes various types of information processing. The memory 2102 holds various programs and data. A work area of the CPU 2101 is also secured in the memory 2102. The storage unit 2103 stores data such as various files and documents. The communication unit 2104 performs data communication with other operation terminals 210 via the communication network 220. The input unit 2105 is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. A display unit 2106 is a display screen that displays various files, documents, and the like via application software such as a Web browser. The storage unit 2103, the input unit 2105, and the display unit 2106 may be provided outside the operation terminal 210 and connected to the operation terminal 210 via the communication network 220. In addition, the operation terminal 210 incorporates software such as a browser and an e-mail client. The operation terminal 210 is, for example, a personal computer, a PDA (Personal Digital Assistant), a portable information terminal such as a smartphone, or the like.

  Hereinafter, a specific configuration of the electronic conference system 2100 will be described mainly focusing on the presenter terminal 210a and the participant terminal 210b.

  FIG. 22 is a functional block diagram showing a specific configuration of the participant terminal 210b. The participant terminal 210b includes a presenter operation accepting unit 211, a participant operation obtaining unit 212, an operation type determining unit 213, a synchronization determining unit 214, and a display control unit 215. These elements are realized by the CPU 2101 executing a program stored in the memory 2102 (see FIG. 21). The storage unit 2103 includes a file DB 231 that stores data such as various files and documents.

  The program may be installed in the participant terminal 210b from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or downloaded via a communication network 220 such as the Internet. Alternatively, the program may be downloaded from a previously stored server.

  For example, as shown in FIG. 23, in the network configuration in which each operation terminal 210 is connected to the network via the server 230, when the participant terminals 210b, 210c, and 210d are connected to the server 230, the program is 230 may be downloaded to the memory 2102 of each of the participant terminals 210b, 210c, and 210d, and the conference material data may be downloaded to the file DB 231. The program and the material data may be configured by, for example, JavaScript (registered trademark). Further, when the presenter connects the operation terminal 210 to the server 230 and performs a predetermined setting, the operation terminal 210 is recognized as the presenter terminal 210a, and the participant connects the operation terminal 210 to the server 230. By performing the predetermined setting, the operation terminal 210 is recognized as the participant terminal 210b or the like. The server 230 transmits the program and material data to each operation terminal 210 recognized by the participant terminal. The server 230 may transmit the program and the material data to the operation terminal 210 recognized as the presenter terminal. The server 230 mainly functions as a relay for performing information communication between the presenter terminal 210a and the participant terminals 210b, 210c, and 210d after transmitting the program and the material data. The operation terminal 210 in which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the operation terminal 210 or the server 230.

  Each function corresponding to the program will be described.

  The presenter operation reception unit 211 receives information (hereinafter referred to as presenter operation information) (second operation content) indicating the content operated by the presenter on the presenter terminal 210a from the presenter terminal 210a. The presenter operation information includes, for example, operations such as display of new materials, writing to materials with a pen tool (handwriting tool), picking up (selecting) posted comments, page switching of materials, mouse pointer input and movement, voice input, etc. This is information indicating the contents.

  Here, a specific example of processing contents in the presenter terminal 210a will be described. FIG. 24 shows an example of display contents displayed on the display screen of the presenter terminal 210a.

  For example, when the presenter operates the mouse or the like (input unit 2105) on the presenter terminal 210a to read the material stored in the file DB 231 (operation to display a new material on the material screen), The presenter terminal 210a notifies (sends) the presenter operation information indicating the operation content including information indicating the storage destination URL or the document ID to the participant terminal 210b via the communication unit 2104.

  Further, for example, when the presenter operates the mouse on the presenter terminal 210a and inputs a mouse pointer on the material screen (see FIG. 24) displayed on the display unit 2106, the presenter terminal 210a The presenter operation information indicating the operation content including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like is notified to the participant terminal 210b via the unit 2104. The presenter terminal 210a may sequentially transmit presenter operation information at regular intervals (for example, every 50 msec).

  For example, when the presenter operates the pen tool on the presenter terminal 210a to write characters or the like on the document screen (see FIG. 24) displayed on the display unit 2106, the presenter terminal 210a Through the unit 2104, the presenter operation information indicating the operation content including information indicating the written position (coordinates), the ID of the written material, the page number, and the like is notified to the participant terminal 210b.

  Further, for example, when the presenter switches the page of the document screen (see FIG. 24) displayed on the display unit 2106 by operating the mouse in the presenter terminal 210a, the presenter terminal 210a The presenter operation information indicating the operation content including the information indicating the ID of the displayed material and the specified page number is notified to the participant terminal 210b via 2104.

  In this manner, the presenter terminal 210a notifies each participant terminal 210b, 210c, 210d of information indicating the content based on the operation of the presenter.

  The participant operation acquisition unit 212 acquires information (hereinafter referred to as participant operation information) (first operation content) indicating the content operated by the participant on the participant terminal 210b. The participant operation information is similar to the presenter operation information, for example, display of materials, writing to materials with a pen tool, creation of posted comments, page switching of materials, input and movement of the mouse pointer, voice input, etc. It is information to show.

  The operation type determination unit 213 determines an operation type (presenter operation type) based on the presenter operation information received from the presenter terminal 210a by the presenter operation reception unit 211. Further, the operation type determination unit 213 determines the operation type (participant operation type) based on the participant operation information acquired by the participant operation acquisition unit 212 in the own terminal (participant terminal 210b). The operation type is obtained by classifying operation contents of the presenter and the participant by type. The operation type is set in advance, and is stored in the storage unit 2103 as an operation type table, for example. The operation content registered in the operation type table changes the operation content important for the presenter and the participant, for example, the display content (synchronization content) displayed on the participant terminal 210b in synchronization with the presenter terminal 210a. The content of the operation to be performed Specifically, when the first page of the document A displayed on the presenter terminal 210a is synchronously displayed on the participant terminal 210b, by switching to the second page, the participant terminal 210b The mouse pointer is input to the first page when an operation for changing the display content of the document A or when the first page of the document A displayed on the presenter terminal 210a is synchronously displayed on the participant terminal 210b. This means an operation for changing the display content of the participant terminal 210b.

  In the participant terminal 210b, the synchronization content may be displayed on the entire display screen, or the synchronization content may be displayed on a part of the display screen. Further, the entire display screen of the presenter terminal 210a may be synchronized, or a part of the display screen may be synchronized. For this reason, for example, even when the mouse pointer operated by the presenter at the presenter terminal 210a is moving synchronously at the participant terminal 210b (synchronized state), the mouse pointer for the participant terminal 210b is separately provided. It may be displayed (for example, outside the synchronized display screen). In the synchronized display screen, both a synchronized mouse pointer operated by the presenter and a mouse pointer for the participant terminal 210b operated by the participant may be displayed. The mouse pointer input operation on the presenter terminal 210a is included in the operation of changing the display contents of the participant terminal 210b.

  FIG. 25 shows an example of the operation type table. In the operation type table shown in FIG. 25, five operation types of “material display”, “pen”, “pickup”, “page switching”, and “pointer” are set corresponding to the operation content. For example, the operation type determination unit 213 refers to the operation type table and identifies the operation type corresponding to the operation content by the presenter. In addition, the operation type determination unit 213 refers to the operation type table and specifies an operation type corresponding to the operation content by the participant. If there is no operation type corresponding to the operation content, the operation type determination unit 213 determines “no operation type”. Further, the operation content registered in the operation type table is not limited to the content of FIG. For example, the operation content and operation type registered in the operation type table may be different for the presenter and the participant. In this case, the presenter operation type table and the participant operation type table may be provided separately.

  Based on the determination result of the operation type determination unit 213, the synchronization determination unit 214 determines whether the participant terminal 210b is synchronized with the presenter terminal 210a or is asynchronous. Specifically, when the content of the operation by the presenter corresponds to a predetermined operation type (see FIG. 25), the synchronization determination unit 214 determines “synchronization”. Further, when the operation content by the participant corresponds to a predetermined operation type (see FIG. 25), the synchronization determination unit 214 determines “asynchronous”. If the operation content by the presenter or the operation content by the participant is “no operation type”, the synchronization determination unit 214 determines “asynchronous”.

  The display control unit 215 controls the display content of the display screen of the participant terminal 210b based on the determination result of the synchronization determination unit 214. Specifically, when the synchronization determination unit 214 determines “synchronization”, the display control unit 215 causes the display content corresponding to the operation content by the presenter to be reflected and displayed on the participant terminal 210b. For example, when the presenter displays a new document A on the presenter terminal 210a, the synchronization determination unit 214 determines “synchronization”, and the display control unit 215 displays the document on the display unit 2106 of the participant terminal 210b. A is displayed. For example, when the presenter switches the display page of the document A from the first page to the second page on the presenter terminal 210a, the synchronization determination unit 214 determines “synchronization”, and the display control unit 215 The display page of the document A displayed on the display unit 2106 of the user terminal 210b is switched from the first page to the second page. Similarly, when a character is written with a pen tool, a posted comment is picked up, or the presenter moves the mouse pointer, the display control unit 215 reflects these operation contents on the participant terminal 210b.

  On the other hand, when the synchronization determination unit 214 determines “asynchronous”, the display control unit 215 places the participant terminal 210b in an asynchronous state (asynchronous mode) with respect to the presenter terminal 210a and The operation content is reflected on the participant terminal 210b. For example, when the document A is displayed on the participant terminal 210 b in synchronization with the presenter terminal 210 a, if the participant selects another document B, the synchronization determination unit 214 determines “asynchronous”. The display control unit 215 puts the participant terminal 210b in an asynchronous state with the presenter terminal 210a, changes the display content of the participant terminal 210b, and causes the display unit 2106 to display the document B. Further, for example, when the third page of the document A is displayed on the participant terminal 210b in synchronization with the presenter terminal 210a, the participant performs an operation of switching to the previous page (fourth page). In this case, the synchronization determination unit 214 determines “asynchronous”, and the display control unit 215 puts the participant terminal 210b into an asynchronous state with respect to the presenter terminal 210a and displays it on the display unit 2106 of the participant terminal 210b. The display page of the document A is switched from the third page to the fourth page (changed). Similarly, when a character is written with a pen tool, a posted comment is created, or the participant moves the mouse pointer, the display control unit 215 asynchronously moves the participant terminal 210b to the presenter terminal 210a. The operation contents are reflected on the participant terminal 210b.

  As described above, the display control unit 215 functions as a synchronization cancellation unit that cancels the synchronization state (switches to the asynchronous state) when the participant performs a preset operation on the participant terminal 210b. In the released state (asynchronous state), the presenter functions as a resynchronization means for returning to the synchronous state again (releasing the asynchronous state) by performing a preset operation on the presenter terminal 210a.

  Next, the flow of processing in the electronic conference system 2100 will be described. 26 and 27 are operation flowcharts of the electronic conference system 2100. FIG. Here, as an example, the presenter P makes a presentation regarding the document A in the electronic conference using the presenter terminal 210a, and the participant S participates in the electronic conference using the participant terminal 210b. Description will be made assuming that the electronic conference proceeds while P and the participant S perform a desired operation. Note that the electronic conference system 2100 includes one presenter terminal and a plurality of participant terminals connected to each other via the communication network 220, but here, for one presenter Description will be made by paying attention to the terminal 210a and one participant terminal 210b.

  First, the presenter P selects the file of the material A stored in the storage unit 2103 (FIG. 21) in the presenter terminal 210a. Thereby, the content of the document A is displayed on the display unit 2106 of the presenter terminal 210a (S2101). For example, the first page (first page) of the material A is displayed. The presenter terminal 210a also includes presenter operation information indicating the operation content of the presenter P (in this case, display of the new material A) including the information of the material A (for example, the ID and page number of the material A). Notify the participant terminal 210b.

  Next, the presenter operation acceptance unit 211 of the participant terminal 210b accepts the presenter operation information from the presenter terminal 210a (S2201). Here, the presenter operation accepting unit 211 accepts the operation content including the ID of the material A (“display of the new material A”).

  Next, the operation type determination unit 213 of the participant terminal 210b determines the operation type based on the presenter operation information (S2202). Here, the operation type determination unit 213 refers to the operation type table shown in FIG. 25 and identifies the operation type (“material display”) corresponding to the operation content (“display new material A”).

  Next, the synchronization determination unit 214 of the participant terminal 210b determines synchronization / asynchronization of the participant terminal 210b based on the determination result of the operation type determination unit 213 (S2203). Here, “data display” is specified as the operation type, so the synchronization determination unit 214 determines “synchronization”.

  Next, the display control unit 215 of the participant terminal 210b controls the display content of the display screen on the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2204). Here, since the synchronization determination unit 214 determines “synchronization”, the display control unit 215 displays the first page of the document A on the display unit 2106 of the participant terminal 210b.

  In the processing of S2201 to S2204, the presenter terminal 210a and the participant terminal 210b are in a synchronized state (synchronous mode), and the same content is displayed.

  Subsequently, the participant S performs a desired operation on the participant terminal 210b. Here, it is assumed that the participant S has switched the display page (first page) of the material A displayed on the display screen to the second page (S2205).

  Then, the participant operation acquisition unit 212 of the participant terminal 210b acquires participant operation information indicating the content operated by the participant S. Here, the participant terminal 210b acquires participant operation information indicating the operation content of the participant S (here, page switching of the document A) including the information of the document A (for example, the ID of the document A). (S2206).

  Next, the operation type determination unit 213 of the participant terminal 210b determines the operation type based on the participant operation information (S2207). Here, the operation type determination unit 213 refers to the operation type table shown in FIG. 25 and specifies the operation type (“page switching”) corresponding to the operation content (“page switching of material A”).

  Next, the synchronization determination unit 214 of the participant terminal 210b determines synchronization / asynchronization of the participant terminal 210b based on the determination result of the operation type determination unit 213 (S2208). Here, since “page switching” is specified as the operation type, the synchronization determination unit 214 determines “asynchronous”.

  Next, the display control unit 215 of the participant terminal 210b controls the display screen on the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2209). Here, since it is determined as “asynchronous” by the synchronization determination unit 214, the display control unit 215 is for the participant even if the first page of the document A is displayed on the display unit 2106 of the presenter terminal 210a. The display content of the display unit 2106 of the terminal 210b is changed to display the second page of the document A.

  In the processing of S2205 to S2209, the participant terminal 210b is in an asynchronous state (asynchronous mode), and different contents are displayed on the presenter terminal 210a and the participant terminal 210b.

  Subsequently, the presenter P performs a desired operation on the presenter terminal 210a. Here, it is assumed that the presenter P has written characters on the first page of the document A displayed on the display unit 2106 using the pen tool (S2102 in FIG. 27).

  Then, the presenter terminal 210a operates the contents operated by the presenter P including the information indicating the position (coordinates) of the written characters, the ID of the written material A, and the page number (here, the material A by the pen tool). To the participant terminal 210b.

  Next, the presenter operation reception unit 211 of the participant terminal 210b receives the presenter operation information from the presenter terminal 210a (S2210).

  Next, the operation type determination unit 213 of the participant terminal 210b determines the operation type based on the presenter operation information (S2211). Here, the operation type determination unit 213 refers to the operation type table shown in FIG. 25 and identifies the operation type (“pen”) corresponding to the operation content (“writing to the document A by the pen tool”).

  Next, the synchronization determination unit 214 of the participant terminal 210b determines whether the participant terminal 210b is synchronous or asynchronous based on the determination result of the operation type determination unit 213 (S2212). Here, since “pen” is specified as the operation type, the synchronization determination unit 214 determines “synchronization”.

  Next, the display control unit 215 of the participant terminal 210b controls the display content of the display screen on the participant terminal 210b based on the determination result of the synchronization determination unit 214 (S2213). Here, since the synchronization determination unit 214 determines “synchronization”, the display control unit 215 changes the display content of the display unit 2106 of the participant terminal 210b to change the first content A of the document A in which characters are written. Display the page.

  In the processing of S2210 to S2213, the participant terminal 210b is again in a synchronized state (synchronous mode), and the same contents are displayed on the presenter terminal 210a and the participant terminal 210b.

  As described above, in the electronic conference system 2100, synchronization / asynchronization is automatically switched according to a desired operation of the presenter and the participant, and the display content of the participant terminal 210b is changed.

2-2. Modified Example of Embodiment 2 The electronic conference system 2100 is not limited to the above configuration, and various configurations can be adopted. Below, the electronic conference system 2100 which concerns on the modification of Embodiment 2 is demonstrated centering on difference with the said structure. In an electronic conference system 2100 according to a modification of the second embodiment below, description of elements having the same functions as those of the electronic conference system 2100 will be omitted.

2-2-1. Modification 1 of Embodiment 2
In the electronic conference system 2100 according to the first modification of the second embodiment, when the participant operation acquisition unit 212 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined. The display control unit 215 causes the participant terminal 210b to be in an asynchronous state (asynchronous mode) with respect to the presenter terminal 210a, and causes the participant terminal 210b to display display content corresponding to the operation content. Also good. When the presenter operation accepting unit 211 accepts the operation content (presenter operation information) by the presenter, the operation type corresponding to the operation content is determined, and the display control unit 215 controls the participant terminal 210b. The presenter terminal 210a may be in a synchronized state (synchronous mode), and display content corresponding to the operation content corresponding to the operation type may be displayed on the participant terminal 210b.

  According to the electronic conference system 2100 according to the first modification of the second embodiment, an important operation (operation corresponding to the operation type) by the presenter, for example, an operation to change the display content displayed on the presenter terminal 210a. , The display content corresponding to the operation is displayed on the participant terminal 210b and the display content corresponding to the desired operation of the participant is displayed while the operation is not performed. It is displayed on the participant terminal 210b.

2-2-2. Variation 2 of Embodiment 2
In the electronic conference system 2100 according to the second modification of the second embodiment, when the presenter operation reception unit 211 receives an operation content (presenter operation information) by the presenter, an operation type corresponding to the operation content is determined. Even if the display control unit 215 places the participant terminal 210b in a synchronized state (synchronous mode) with the presenter terminal 210a, the display content corresponding to the operation content is displayed on the participant terminal 210b. Good. When the participant operation acquisition unit 212 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined, and the display control unit 215 controls the participant terminal 210b. The presenter terminal 210a may be in an asynchronous state (asynchronous mode), and display content corresponding to the operation content corresponding to the operation type may be displayed on the participant terminal 210b.

  According to the electronic conference system 2100 according to the second modification of the second embodiment, an operation that is more important to the participant (operation corresponding to the operation type), for example, displayed on the participant terminal 210b in synchronization with the presenter terminal 210a. The display content corresponding to the operation is displayed on the participant terminal 210b only when the operation to change the displayed content is performed, and the presenter's request is displayed while the operation is not performed. The display content corresponding to the operation is displayed on the participant terminal 210b. Note that the electronic conference system 2100 according to the second modification of the second embodiment is configured to automatically shift to a synchronized state when the display content corresponding to the operation content by the participant is displayed on the participant terminal 210b. Also good.

2-2-3. Modification 3 of Embodiment 2
In the electronic conference system 2100 according to the third modification of the second embodiment, the display content corresponding to the operation content by the participant is displayed while maintaining the synchronization state of the presenter terminal 210a and the participant terminal 210b. May be displayed. For example, when the presenter terminal 210a and the participant terminal 210b are in a synchronized state and the first page of the document A is displayed on the respective display screens, the display control is performed when the participant switches to the second page. The unit 215 divides the display screen into a first screen for the synchronous mode and a second screen for the asynchronous mode, the first screen displays the first page corresponding to the synchronous mode, and the second screen The second page is displayed corresponding to the asynchronous mode. In this case, the size of the first screen may be smaller than that of the second screen. Further, the first screen and the second screen may be displayed side by side, or the other screen may be displayed in an overlapping manner within one screen. In the above example, when the participant performs an operation of selecting (clicking) the first screen, the display control unit 215 cancels the asynchronous mode in the second screen and makes the first screen full screen display. You may switch.

  According to the electronic conference system 2100 according to the third modification of the second embodiment, the participant responds to a desired operation while confirming the same content as the content displayed on the presenter terminal 210a on the participant terminal 210b. The contents can be displayed.

2-2-4. Modification 4 of Embodiment 2
In the electronic conference system 2100 according to the fourth modification of the second embodiment, when the participant terminal 210b is in an asynchronous state, the asynchronous state may be maintained based on an instruction from the participant. For example, when the participant selects an asynchronous button on the display screen with the mouse pointer, the participant terminal 210b maintains the asynchronous state. For example, while the participant is touching the display screen with a finger, the participant terminal 210b may be configured to maintain an asynchronous state.

  In the electronic conference system 2100 according to the fourth modification of the second embodiment, when the asynchronous operation is maintained, the presenter's operation content corresponds to an operation type related to an important operation among a plurality of operation types. May be configured to forcibly cancel the asynchronous state and shift to the synchronous state. An important operation is, for example, displaying new material or writing to the material.

2-2-5. Modification 5 of Embodiment 2
FIG. 28 is a functional block diagram illustrating a specific configuration of the participant terminal 210b in the electronic conference system 2100 according to the fifth modification of the second embodiment. In the electronic conference system 2100 according to the fifth modification of the second embodiment, the participant terminal 210b further includes the priority of the operation type (presenter priority) corresponding to the presenter operation information and the participant operation information. A priority comparison unit 216 that acquires and compares the priority of the corresponding operation type (participant priority) is included. The priority indicates the importance of the operation content in the presenter or the participant. For example, as shown in FIG. 29, “document display” has the highest priority, and thereafter “pen”, “pickup”, “page” The priority decreases in the order of “switch” and “pointer”. The priority is set in advance in the operation type table shown in FIG. The presenter priority and the participant priority may be the same as shown in FIG. 29 or may be different as shown in FIG.

  The priority comparison unit 216 sets the respective priorities when the period in which the presenter operation information is received by the presenter operation reception unit 211 and the period in which the participant operation information is acquired by the participant operation acquisition unit 212 overlap. Compare.

  FIG. 31 is an operation flowchart of the electronic conference system 2100 according to the fifth modification of the second embodiment. First, in the participant terminal 210b, the presenter operation reception unit 211 receives presenter operation information from the presenter terminal 210a (S211), and the participant operation acquisition unit 212 acquires participant operation information (S212). . Next, the operation type determination unit 213 identifies each operation type corresponding to the presenter operation information and the participant operation information (S213). Next, the priority comparison unit 216 acquires each priority (presenter priority, participant priority) corresponding to each operation type (S214), and the presenter priority is for the participant. It is determined whether or not the priority is greater than the priority (S215). When the presenter priority is higher than the participant priority (YES in S215), the display control unit 215 displays the display content according to the operation content of the presenter on the display screen of the participant terminal 210b. (S216). On the other hand, when the participant priority is higher than the presenter priority (NO in S215), the display control unit 215 displays the display content corresponding to the operation content of the participant on the display screen of the participant terminal 210b. (S217). After the processes of S216 and S217, the above process is repeated until the electronic conference is finished (S218).

  As described above, in the electronic conference system 2100 according to the fifth modification of the second embodiment, the display control unit 215 displays the operation information corresponding to the operation type with the higher priority among the presenter operation information and the participant operation information. The corresponding display content is displayed on the display screen of the participant terminal 210b. For example, when the presenter moves the mouse pointer on the material screen (see FIG. 24) displayed on the presenter terminal 210a, the participant displays the material screen (FIG. 24) displayed on the participant terminal 210b. When the page of (see) is switched, the priority for participant (“2”) is higher than the priority for presenter (“1”). Instead of reflecting on the terminal 210b, “page switching” is reflected on the participant terminal 210b.

  The electronic conference system 2100 according to the fifth modification of the second embodiment is not limited to the above configuration. For example, the priority comparison unit 216 may compare the presenter priority with a predetermined priority set in advance. If the presenter priority is equal to or lower than the predetermined priority, the display control unit 215 does not reflect the display content corresponding to the presenter operation information corresponding to the presenter priority on the participant terminal 210b. It is good also as a structure.

  In the electronic conference system 2100 according to the fifth modification of the second embodiment, while the display content corresponding to the high priority operation information is displayed on the participant terminal 210b, the display corresponding to the other operation information is displayed. The display content corresponding to the operation information with high priority may be allowed to be accepted after the display content corresponding to the operation information with high priority is displayed on the participant terminal 210b without accepting the content. For example, while a pen tool is writing data on the participant terminal 210b (asynchronous state), the presenter does not accept an operation content (for example, display of a new material) and the presenter writes to the material. The new material may be displayed on the participant terminal 210b at the time when is completed.

2-2-6. Modification 6 of Embodiment 2
In the electronic conference system 2100 according to the sixth modification of the second embodiment, the participant operation acquisition unit 212 acquires participant operation information from the participant terminal 210b, which is its own terminal, and other participant terminals 210c, The participant operation information may be acquired from 210d. That is, the participant operation acquisition unit 212 may be configured to acquire operation information from a terminal other than its own terminal. In the above configuration, for example, when the operation content in the participant operation information received from the participant terminal 210c corresponds to a predetermined operation type, the operation content may be reflected in the participant terminal 210b. . According to the above configuration, for example, when a comment is posted on the participant terminal 210c, the posted comment is displayed on the participant terminal 210b.

  By the way, in the electronic conference system 2100 which concerns on each form mentioned above, the synchronous determination part 214 may be abbreviate | omitted. An electronic conference system 2100 that does not include the synchronization determination unit 214 will be described below as a modified example 7 of the second embodiment.

2-2-7. Modification 7 of Embodiment 2
In the electronic conference system 2100 according to the seventh modification of the second embodiment, the display control unit 215 may control the display content of the display screen of the participant terminal 210b based on the determination result of the operation type determination unit 213. . Specifically, when the operation content by the presenter corresponds to a predetermined operation type (see FIG. 25), the display control unit 215 reflects the display content corresponding to the operation content on the participant terminal 210b. It may be displayed.

  For example, the presenter's operation content (for example, display of a mouse pointer or writing by a pen tool) is reflected on the participant terminal 210b, and the operation content of the participant is displayed by a mouse pointer or by a pen tool (within the same page). In the case of writing, the operation contents of the participant may be reflected on the participant terminal 210b. That is, both the presenter's operation content and the participant's operation content may be reflected on the participant terminal 210b. Therefore, while reflecting the operation content of the presenter, it is also possible to set the state between the synchronous state and the asynchronous state (semi-synchronous state) that also reflects the operation content of the participant. Thus, the display control unit 215 can realize the semi-synchronous mode regardless of the synchronous mode / asynchronous mode. That is, the display control unit 215 can change the display content displayed on the participant terminal 210b to display content corresponding to both the presenter's operation content and the participant's operation content.

  When the electronic conference system 2100 includes the synchronization determination unit 214, for example, a system shown in Modification 8 of Embodiment 2 below can be configured using the determination result of the synchronization determination unit 214.

2-2-8. Modification 8 of Embodiment 2
FIG. 32 is a functional block diagram illustrating a specific configuration of an electronic conference system 2100 according to Modification 8 of Embodiment 2. In the electronic conference system 2100 according to Modification 8 of Embodiment 2, the participant terminal 210b further includes a synchronization information notification unit 217, and the presenter terminal 210a further includes a synchronization information acquisition unit 221 and a display control unit. 222 is included.

  The synchronization information notification unit 217 of the participant terminal 210b displays a synchronization state indicating whether or not the participant terminal 210b is synchronized with the presenter terminal 210a, a display content of the display screen when not synchronized, and the like. The included synchronization information is transmitted to the presenter terminal 210a.

  The synchronization information acquisition unit 221 of the presenter terminal 210a acquires the synchronization information from the participant terminal 210b. The synchronization information acquisition unit 221 acquires the synchronization information from all the participant terminals included in the electronic conference system 2100.

  The display control unit 222 of the presenter terminal 210a controls the display content of the display screen of the presenter terminal 210a based on the synchronization information acquired by the synchronization information acquisition unit 221. For example, the display control unit 222 calculates the total number (synchronization number) of the participant terminals in a synchronized state among all the participant terminals, and displays the synchronization number on the display screen of the presenter terminal 210a. Further, the display control unit 222 calculates the ratio (synchronization rate) of the number of participant terminals in a synchronized state to the number of all participant terminals, and sets the synchronization rate on the display screen of the presenter terminal 210a. It may be displayed. The display control unit 222 may display (for example, thumbnail display) the display contents displayed on the display screen of the participant terminal 210b in an asynchronous state side by side on the display screen of the presenter terminal 210a. .

2-2-9. Modification 9 of Embodiment 2
In the electronic conference system 2100 according to Modification 9 of Embodiment 2, in the electronic conference system 2100 according to Modification 8 of Embodiment 2, the participant terminal 210b includes a participant operation acquisition unit 212 and an operation type determination unit 213. It is omitted. FIG. 33 is a functional block diagram showing a specific configuration of the electronic conference system 2100 according to the ninth modification of the second embodiment. The presenter terminal 210a has the same configuration as that shown in FIG. A known operation terminal that performs synchronous display can be applied to the participant terminal 210b. According to the above configuration, the synchronization rate and the display contents of the participant terminal 210b in an asynchronous state are displayed on the display screen of the presenter terminal 210a, as in the eighth modification of the second embodiment. Therefore, the presenter can grasp the participant's degree of interest in the content of the presentation.

  Note that a program for realizing the electronic conference system 2100 according to the ninth modification of the second embodiment is provided on at least a part of the display screen of the participant terminal 210b (first operation terminal) in a plurality of operation terminals. A program that can display at least a part of display contents of the presenter terminal 210a (second operation terminal) in a synchronized state, and is in a synchronized state with respect to the number of all the participant terminals 210b. A program for causing a computer to function as display control means for displaying the ratio (synchronization rate) of the number of the presenter terminals 210b on the display screen of the presenter terminal 210a can be used. The display control means may display the display content of the participant terminal 210b in an asynchronous state on the display screen of the presenter terminal 210a.

  Each element shown in the second embodiment and each modification of the second embodiment of the electronic conference system 2100 described above is connected to the operation terminal 210 (presenter terminal 210a, participant terminals 210b, 210c, and 210d) via a network. In the information processing apparatus, the CPU may execute the program. The information processing apparatus can be, for example, a server 230 shown in FIG. In this case, in the information processing apparatus, the participant operation acquisition unit 212 acquires participant operation information from each participant terminal, and the operation type determination unit 213 specifies an operation type corresponding to each participant terminal, The synchronization determination unit 214 determines synchronization and asynchronous corresponding to each participant terminal. Further, the display control unit 215 controls the display content of the display screen of each participant terminal based on the determination result of the synchronization determination unit 214.

  Moreover, each modification of the said Embodiment 2 and Embodiment 2 is an example, Comprising: Each form can also be combined.

  Further, the network configuration of the electronic conference system 2100 is not limited to the configuration shown in FIG. For example, as shown in FIG. 34, the operation terminals 210 may be connected to each other via a participant terminal 210b (star type). Further, as shown in FIG. 35, a configuration (P2P (Peer to Peer) type) in which participant terminals 210b, 210c, and 210d are connected starting from a presenter terminal 210a may be used.

  In the network configuration shown in FIG. 23, the connection from each operation terminal 210 to the server 230 may be established by the user starting up a web browser and specifying a common URL (server). An application started up on the operation terminal 210 may be automatically connected to the server 230 according to a preset address. Further, the connection between each operation terminal 210 and the server 230 may be connected by Web Socket, or the operation terminal 210 is simulated when the operation terminal 210 connects to the server 230 at a predetermined interval (polling). Information may be exchanged between 210.

  In the electronic conference system 2100, when the initial setting (default) of the operation terminal 210 is an asynchronous state, the asynchronous state is canceled and the synchronous state and the asynchronous state are shifted to the synchronous state. If the initial state is the synchronous state, the synchronous state is canceled and the state shifts to the asynchronous state.

  In the above description, an electronic conference system is taken as an example of an information processing system. However, the information processing system is not limited to an electronic conference system, and various types of electronic data are shared between operation terminals connected to a network. System.

2-3. Effect of Embodiment 2 A program according to Embodiment 2 of the present invention is configured to synchronize at least part of the display content of the second operation terminal with at least part of the display screen of the first operation terminal in a plurality of operation terminals. A first operation acquisition means for acquiring a first operation content indicating a content operated by a first user in the first operation terminal, and the first operation content includes: If the operation content changes the display content displayed on the first operation terminal in synchronization with the second operation terminal and is a predetermined operation content, the display displayed on the first operation terminal The computer is caused to function as display control means for changing the content to display content corresponding to the first operation content. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.

  In the program according to the second embodiment of the present invention, the display control unit may switch the display content displayed on the first operation terminal to display content corresponding to the first operation content. According to this structure, the display content displayed on the 1st operation terminal is switched to the display content according to the operation content by a user (for example, meeting participant).

  In the program according to the second embodiment of the present invention, the display control unit displays the display content displayed on the first operation terminal together with the display content switched according to the first operation content. You may display on a 1st operation terminal. According to this configuration, the display content in the synchronized state and the display content in the asynchronous state are displayed together on the first operation terminal of the user (conference participant).

  In the program according to the second embodiment of the present invention, the computer is further caused to function as a second operation accepting unit that accepts a second operation content indicating content operated by a second user in the second operation terminal, When the second operation accepting unit accepts the second operation content when the display content corresponding to the first operation content is displayed on the first operation terminal, the second operation content is the first operation content. 2 If the operation content is to change the display content displayed on the operation terminal and is a predetermined operation content, the display control means displays the display content displayed on the first operation terminal, You may change into the display content according to 2nd operation content. According to this configuration, in the first operation terminal of the user (conference participant), the display content in the asynchronous state is switched to the display content in the synchronous state according to the operation of the user (presenter).

  In the program according to the second embodiment of the present invention, the computer is further caused to function as a second operation accepting unit that accepts a second operation content indicating content operated by a second user in the second operation terminal, A plurality of the predetermined operation contents corresponding to the first operation contents and the second operation contents are determined, and a priority is determined in advance for each operation content according to the contents. A period during which the first operation content is acquired by the first operation acquisition unit and a period during which the second operation content is received by the second operation reception unit overlap, and the first operation content and the second operation content are respectively Included in the predetermined operation content, and the priority of the first operation content is higher than the priority of the second operation content, the display control means , The said display contents displayed on the first operation terminal may be changed to the display contents corresponding to the first operation content. According to this configuration, when the priority of the operation content of the user (conference participant) is higher than the priority of the operation content of the user (presenter), the display content displayed on the first operation terminal is The display content is switched according to the operation content by the (conference participant).

  In the program according to the second embodiment of the present invention, the computer is further caused to function as a second operation accepting unit that accepts a second operation content indicating content operated by a second user in the second operation terminal, A plurality of the predetermined operation contents corresponding to the first operation contents and the second operation contents are determined, and a priority is determined in advance for each operation content according to the contents. A period during which the first operation content is acquired by the first operation acquisition unit and a period during which the second operation content is received by the second operation reception unit overlap, and the first operation content and the second operation content are respectively Included in the predetermined operation content, and the priority of the second operation content is higher than the priority of the first operation content, the display control means , The said display contents displayed on the first operation terminal may be changed to the display contents corresponding to the second operation content. According to this configuration, when the priority of the operation content of the user (presenter) is higher than the priority of the operation content of the user (conference participant), the display content displayed on the first operation terminal is The display contents can be switched according to the operation contents of the (presenter).

  In the program according to the second embodiment of the present invention, the display control means calculates the ratio of the number of the first operation terminals in the synchronized state to the number of all the first operation terminals. You may display on a display screen. According to this configuration, the ratio (synchronization rate) of the number of first operation terminals in a synchronized state to the number of all first operation terminals is displayed on the second operation terminal.

  The program according to the second embodiment of the present invention may cause a plurality of operation terminals to display at least a part of the display content of the second operation terminal in a synchronized state on at least a part of the display screen of the first operation terminal. A synchronization canceling means for canceling the synchronization state by a predetermined operation by a first user of the first operation terminal; in a state in which the synchronization state is canceled, the second operation terminal The computer is caused to function as resynchronization means for returning to the synchronization state again by a predetermined operation by the second user. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.

  The program may be stored in a computer-readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the operation terminal.

The information processing apparatus according to the second embodiment of the present invention causes a plurality of operation terminals to display at least a part of the display content of the second operation terminal in a synchronized state on at least a part of the display screen of the first operation terminal. A first operation acquisition means for acquiring a first operation content indicating a content operated by a first user on the first operation terminal, and the first operation content includes: If the operation content changes the display content displayed on the first operation terminal in synchronization with the second operation terminal and is a predetermined operation content, the display displayed on the first operation terminal Display control means for changing the content to display content corresponding to the first operation content. The information processing apparatus may be the operation terminal. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.
The information processing apparatus according to the second embodiment of the present invention causes a plurality of operation terminals to display at least a part of the display content of the second operation terminal in a synchronized state on at least a part of the display screen of the first operation terminal. An information processing apparatus capable of releasing the synchronization state by a predetermined operation by a first user of the first operation terminal; and in a state where the synchronization state is released, Re-synchronizing means for returning to the synchronized state again by a predetermined operation by a second user of the second operation terminal. The information processing apparatus may be the operation terminal. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.

  An information processing system according to Embodiment 2 of the present invention includes a first operation terminal and a second operation terminal, and at least a part of a display content of the second operation terminal is displayed on at least a part of a display screen of the first operation terminal. An information processing system capable of displaying a part in a synchronized state, wherein the first operation acquisition means acquires first operation content indicating content operated by a first user on the first operation terminal; When the first operation content is an operation content that changes the display content displayed on the first operation terminal in synchronization with the second operation terminal, and is a predetermined operation content, Display control means for changing the display content displayed on one operation terminal to display content corresponding to the first operation content. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.

  The recording medium according to the second embodiment of the present invention causes a plurality of operation terminals to display at least a part of the display content of the second operation terminal in a synchronized state on at least a part of the display screen of the first operation terminal. The first operation acquisition means for acquiring the first operation content indicating the content operated by the first user in the first operation terminal, and the first operation content is the second operation terminal. If the operation content changes the display content displayed on the first operation terminal in synchronization with the predetermined operation content, the display content displayed on the first operation terminal is A program for causing a computer to function as display control means for changing to display contents corresponding to the first operation contents is recorded. The computer may be the operation terminal. According to this configuration, in an operation terminal displayed in synchronization with another operation terminal in an electronic conference, the user of the operation terminal can respond to a user's desired operation without requiring a synchronous / asynchronous switching operation. The contents are displayed. For this reason, user convenience is improved.

3-1. Embodiment 3
Embodiment 3 of the present invention aims to provide an information processing apparatus, an information processing system, a program, and a recording medium that can appropriately set or transfer the authority of a presenter in a conference. In the third embodiment, as an example of an information processing system, an electronic conference system that shares electronic data such as materials and media data such as audio data and image data among a plurality of terminals connected via a network is taken as an example. I will explain. In addition, the meaning of the term of Embodiment 3 shall extend only to the range of Embodiment 3.

3-2. Embodiment 3-1.
FIG. 36 is an overall configuration diagram of the electronic conference system according to Embodiment 3-1. The electronic conference system 3100 (information processing system) includes a plurality of terminals 310 respectively used by a plurality of users attending the conference, and a server 320 (information processing apparatus) that manages the terminals 310. In the embodiment 3-1, for convenience of explanation, a user who is in charge of the presentation at the conference and becomes the facilitator of the conference is called “presenter”, and a terminal used by the presenter is called “presenter terminal”. A user who attends the conference other than the presenter is called a “participant”, and a terminal used by the participant is called a “participant terminal”. For example, in FIG. 36, when the terminal 310a is a presenter terminal, the other five terminals 310b, 310c, 310d, 310e, and 310f are participant terminals. Each terminal can be either a presenter terminal or a participant terminal. In addition, an operation authority is given to the presenter terminal, whereby a display screen corresponding to the content operated by the presenter on the presenter terminal is synchronously displayed on the other participant terminals. Hereinafter, when the functions common to the presenter terminal and the participant terminal are described, they will be collectively referred to as the terminal 310.

  As shown in FIG. 36, the terminals 310a, 310b, 310c, 310d, 310e, and 310f and the server 320 are connected to each other via a communication network 330 such as a LAN (Local Area Network) or the Internet.

  FIG. 37 is a block diagram illustrating a hardware configuration of the server 320. The server 320 includes a computer including a CPU 3201, a memory 3202, a storage unit 3203, and a communication unit 3204. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 3201 controls each unit of the server 320 and executes various types of information processing. The memory 3202 holds various programs and data. A work area for the CPU 3201 is also secured in the memory 3202. The storage unit 3203 stores data such as various files and documents. The communication unit 3204 performs data communication with the terminal 310 via the communication network 330. The storage unit 3203 may be provided outside the server 320 and connected to the server 320 via the communication network 330.

  The terminal 310 is a terminal (user terminal) used by a user attending the meeting. Terminal 310 includes an operation unit and a display unit (not shown). The operation unit is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. The display unit is a display screen that displays various files, documents, and the like via application software such as a Web browser. The display unit displays an operation screen for accepting a user operation in the conference. The terminal 310 incorporates software such as a browser and an e-mail client. The terminal 310 is, for example, a personal computer, a PDA (Personal Digital Assistant), a portable information terminal such as a smartphone, or the like. One terminal 310 may be, for example, one browser, one window in the browser, or one application.

  FIG. 38 is a functional block diagram showing a specific configuration of the server 320. The server 320 includes a reception processing unit 321, a communication connection unit 322, a terminal determination unit 323, a notification unit 324, a terminal information update unit 325, and a terminal state determination unit 326. These elements are realized by the CPU 3201 executing a program stored in the memory 3202. The storage unit 3203 includes a terminal information database (terminal information DB 331) that stores terminal information and a file database (file DB 332) that stores data such as various files and documents.

  The program may be installed in the server 320 from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or may be downloaded via a communication network 330 such as the Internet. The program may be downloaded from a previously stored server.

  The program may be installed in each terminal 310. For example, as shown in FIG. 39, in a network configuration in which each terminal 310 is connected to the network via the server 320, when each terminal 310 is connected to the server 320, the program is stored in the memory of each terminal 310 from the server 320. The conference material data may be downloaded to the storage unit. The program and the material data may be configured by, for example, JavaScript (registered trademark). The terminal 310 on which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the terminal 310 or the server 320.

  In Embodiment 3-1, the server 320 has a program for realizing each function shown in FIG. When each terminal 310 is connected to the server 320, for example, the material data of the file DB 332 used for the meeting and the display control program for controlling the display content on the display unit of the terminal 310 are downloaded to each terminal 310. The

  The reception processing unit 321 receives (receives) various types of information (operation information, request information, etc.) according to the contents operated by the user at each terminal 310 and executes processing according to the information. As an example of the operation information, there are operation contents (display of new materials, page switching of materials, etc.) by the presenter during the conference. Examples of the request information include a connection request to the server 320 of the terminal 310, a disconnection request, a presenter change request (operation authority transfer request), and the like. The reception processing unit 321 includes a function as a reception unit that receives a connection request from the terminal 310 and a transfer request reception unit that receives a transfer request for operation authority from the terminal 310.

  When receiving a connection request from the terminal 310, the reception processing unit 321 registers the terminal information of the terminal 310 in the terminal list of the terminal information DB 331. The terminal information includes identification information (terminal ID) of the terminal 310 and type information (type ID) indicating whether the terminal 310 is a presenter terminal or a participant terminal. FIG. 40 is a table showing an example of a terminal list. In FIG. 40, “1” indicates a presenter terminal, and “0” indicates a participant terminal. “1” indicates an operation authority. Here, a user who uses the terminal 310a becomes a conference presenter, and each user who uses the terminals 310b, 310c, 310d, 310e, and 310f becomes a conference participant.

  The communication connection unit 322 connects and disconnects communication with the terminal 310 in response to a connection request and a disconnection request received from the terminal 310. A communication standard used in the electronic conference system 3100 is not particularly limited, but, for example, Web Socket is preferable.

  The terminal determination unit 323 refers to the terminal list (FIG. 40) in the terminal information DB 331 to determine whether each terminal 310 is registered as a presenter terminal or a participant terminal.

  The notification unit 324 notifies each terminal 310 of various messages such as an inquiry message. The terminal 310 that has received the message causes the display unit to display the message. An example of the message content is “Would you like to make a presentation?”, Which asks whether you want to make a presentation (acquisition of operational authority) at the meeting, (Do you want to allow the change of the presenter?) That asks whether or not the change (transfer) of the operation authority) is permitted, and the notification content when there is no presenter in the meeting "There is a terminal with the operation authority" "I don't do it". The notification unit 324 has a function as an inquiry unit.

  The notification unit 324 notifies the presenter's operation information (presenter operation information) to each participant terminal at the start of the conference and during the conference. The presenter operation information indicates, for example, operation contents such as display of a new material, writing to the material with a pen tool (handwriting tool), picking up (selecting) a posted comment, page switching of the material, input and movement of a mouse pointer, and the like. Information. For example, when the notification unit 324 receives presenter operation information (for example, material ID and page number information when the presenter switches the material page) from the presenter terminal, the notification unit 324 notifies the information to the participant terminal. . The notification unit 324 also has a function as operation information notification means. When the participant terminal receives the presenter operation information from the notification unit 324, the participant terminal reads the material data corresponding to the material ID and the page number from its own storage unit and displays the material data on the display screen. The participant terminal executes the display control program to display the display content corresponding to the presenter operation information on its own display unit. Each terminal 310 has a function as display control means.

  The terminal information update unit 325 updates the terminal list (FIG. 40) in the terminal information DB 331 based on the user operation contents at each terminal 310. For example, when the presenter (operation authority) is changed during the conference, the type ID indicating the types of the presenter terminal and the participant terminal is changed. In addition, the terminal information of the terminal 310 newly connected as the participant terminal during the conference is added.

  The terminal state determination unit 326 determines the current state of the terminal 310 during the conference. For example, the time when the presenter operation information is not transmitted from the presenter terminal 310 is determined, or the time from when the inquiry message is transmitted to the presenter terminal 310 until the reply is determined.

  Next, the flow of processing in the electronic conference system 3100 will be described. FIG. 41 is an operation flowchart of the server 320 in the electronic conference system 3100. FIG. 41 schematically shows the overall flow from the start to the end of the conference.

  First, the electronic conference system 3100 starts an operation by executing a program stored in the server 320 (S311: start process). Next, when the reception processing unit 321 of the server 320 receives various operations from each terminal 310 (including the presenter terminal and the participant terminal) (S312), each unit of the server 320 responds to the received operation content. Execute the process.

  For example, in S312, when the reception processing unit 321 of the server 320 receives a connection request from the terminal 310, the server 320 executes a “new connection process” to be described later (S313). The new connection process is executed when the conference is started or during the conference.

  In S312, when the reception processing unit 321 receives the presenter operation information from the presenter terminal, the notification unit 324 notifies the presenter operation information to the participant terminal (S314). In this case, it is assumed that the terminal 310a is determined as the presenter terminal (operation authority is given) and the terminals 310b, 310c, 310d, 310e, and 310f are determined as the participant terminals by the “new connection process”. Assume.

  For example, the reception processing unit 321 displays a new material from the presenter terminal 310a, writes to the material with a pen tool (handwriting tool), picks up (selects) a posted comment, switches the page of the material, inputs a mouse pointer, Information indicating operation contents such as movement is received. Here, a specific example of processing contents in the presenter terminal 310a will be described. FIG. 42 shows an example of display contents displayed on the display screen of the presenter terminal 310a. For example, when the presenter reads a material stored in his storage unit (an operation for displaying a new material on the material screen) by operating a mouse or the like on the presenter terminal 310a, the reception processing unit 321 receives presenter operation information including information indicating a material ID and a page number from the presenter terminal 310a. Also, for example, when the presenter operates the mouse on the presenter terminal 310a and inputs a mouse pointer to the material screen (see FIG. 42) displayed on the display unit, the reception processing unit 321 is for the presenter. Presenter operation information including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like is received from the terminal 310a. In addition, for example, when the presenter operates the pen tool on the presenter terminal 310a and writes characters or the like on the document screen (see FIG. 42) displayed on the display unit, the reception processing unit 321 is used for the presenter. Presenter operation information including information indicating the written position (coordinates), the written material ID, the page number, and the like is received from the terminal 310a. Further, for example, when the presenter switches the page of the material screen (see FIG. 42) displayed on the display unit by operating the mouse in the presenter terminal 310a, the reception processing unit 321 displays the presenter terminal. Presenter operation information including information indicating the ID of the displayed material and the designated page number is received from 310a. Known methods can be applied to the synchronous display and asynchronous display methods.

  When the reception processing unit 321 receives the presenter operation information, the notification unit 324 notifies the presenter operation information to each of the participant terminals 310b, 310c, 310d, 310e, and 310f. Upon receiving the presenter operation information, the participant terminals 310b, 310c, 310d, 310e, and 310f display a display screen corresponding to the presenter operation information. For example, the material data corresponding to the material ID and the page number is read from its own storage unit and displayed on the display screen. When the electronic conferencing system 3100 completes a series of processes of receiving the presenter operation information from the presenter terminal 310a and notifying the participant terminals 310b, 310c, 310d, 310e, and 310f and synchronous display, Returning to S <b> 312, the reception processing unit 321 receives various operations from each terminal 310 again.

  In S312, when the reception processing unit 321 receives the presenter change request from the participant terminal 310b, the electronic conference system 3100 executes a “presenter terminal change process” described later (S315).

  In S312, when the reception processing unit 321 receives a disconnection request from the terminal 310, the electronic conference system 3100 executes a “terminal disconnection process” described later (S316). Specifically, the reception processing unit 321 receives a disconnection request from the presenter terminal 310a or a disconnection request from the participant terminal 310b during the conference.

  When the reception processing unit 321 receives a conference end instruction from the terminal 310 (S317), the conference end processing is executed to end the conference (S318). For example, when the reception processing unit 321 receives a conference end instruction from the presenter terminal 310a to which the operation authority is granted, the notification unit 324 notifies all the participant terminals of a conference end message, and communication connection The unit 322 disconnects the network connection with all the terminals 310. If the reception processing unit 321 does not receive an instruction to end the conference, the reception processing unit 321 returns to S312 and receives various operations from each terminal 310.

  When the “new connection process”, “presenter terminal change process”, and “terminal disconnection process” are completed, the process returns to S312 and the reception processing unit 321 receives various operations from each terminal 310.

  Next, the flow of the “new connection process” will be described. FIG. 43 is an operation flowchart of “new connection processing” in the electronic conference system 3100.

  For example, the reception processing unit 321 of the server 320 receives a connection request from the terminal 310a (S3101). When receiving the connection request, the reception processing unit 321 registers the terminal information of the terminal 310a in the terminal list (see FIG. 40) of the terminal information DB 331 (S3102). Next, the communication connection unit 322 establishes a communication connection between the server 320 and the terminal 310a (S3103).

  Next, the terminal determination unit 323 refers to the terminal list of the terminal information DB 331 to determine whether or not the presenter has already been determined, that is, whether or not the terminal 310 to which the operation authority has been assigned has already been determined. Determination is made (S3104). Specifically, the terminal determination unit 323 determines whether “1” indicating the presenter terminal is registered in the terminal list.

  If the presenter has not yet been determined (NO in S3104), the notification unit 324 inquires of the terminal 310a whether or not the presentation (acquisition of operation authority) is desired in the conference (S3105). When the reception processing unit 321 receives an answer to the effect that the presentation is desired from the terminal 310a (YES in S3106), the reception processing unit 321 registers “1” in the type ID column of the terminal 310a in the terminal list (S3107). . That is, the reception processing unit 321 gives an operation authority to the terminal 310a. The reception processing unit 321 includes a function as authority granting means for granting operation authority to the terminal 310. As a result, the terminal 310a is registered as a presenter terminal. Next, the notification unit 324 requests the presenter terminal 310a to select a material to be used for the presentation (S3108). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the received presenter operation information is registered (S3109). Next, the notification unit 324 notifies the presenter operation information to all the participant terminals registered in the terminal list (S3110). Thereafter, the processing returns to S312. The notification unit 324 includes a function as a selection request transmission unit that transmits a selection request for a new material shared in the conference.

  When the reception processing unit 321 receives a reply from the terminal 310a that it does not wish to make a presentation (NO in S3106), the reception processing unit 321 registers “0” in the type ID column of the terminal 310a in the terminal list. Thereby, the terminal 310a is registered as a participant terminal. In this case, since the presenter has not yet been determined and the reception processing unit 321 has not yet received the presenter operation information, the notification unit 324 notifies the participant terminal 310a of a standby message. As an example of the content of the waiting message, “please wait until the presenter decides” is given. The standby message (standby screen) is displayed on the display screen of the participant terminal 310a. During this period, the participant terminal 310a may be in an asynchronous state and display a desired screen according to the user's operation. When the presenter is determined (YES in S3133), the notification unit 324 notifies the presenter operation information received by the reception processing unit 321 to the participant terminal 310a (S3134). Thereafter, the processing returns to S312. Until the presenter is determined, the standby message is displayed on the display screen of the participant terminal 310a (NO in S3133).

  On the other hand, if the presenter has already been determined in S3104 (YES in S3104), the reception processing unit 321 registers “0” in the type ID column of the terminal 310a in the terminal list. Thereby, the terminal 310a is registered as a participant terminal. Here, when the presenter has already been determined, the reception processing unit 321 has already received presenter operation information from the presenter terminal 310. Therefore, the notification unit 324 immediately notifies the presenter operation information to the terminal 310a registered as the participant terminal (S3134). Thereafter, the processing returns to S312.

  Next, the flow of the “presenter terminal change process” will be described. FIG. 44 is an operation flowchart of the “presenter terminal change process” in the electronic conference system 3100. Here, a case where the terminal 310a is registered in the presenter terminal is taken as an example.

  For example, the reception processing unit 321 of the server 320 receives a presenter change request (operation authority transfer request) from the participant terminal 310b (S3201). Next, the notification unit 324 inquires of the presenter terminal 310a about whether or not to change the person in charge of the presentation (S3202). Specifically, the notification unit 324 notifies the presenter terminal 310a of an operation authority transfer request.

  Next, the terminal state determination unit 326 determines whether or not the reception processing unit 321 has received an answer from the presenter terminal 310a (S3203). When the reception processing unit 321 receives the answer, the process proceeds to S3204, and when the reception process is not received, the process proceeds to S3220. In S3220, the terminal state determination unit 326 determines whether or not a predetermined set time has elapsed after notifying the transfer request to the presenter terminal 310a (S3220). If the answer is received before the set time has elapsed, the process returns to S3203, and if the set time has elapsed, the process proceeds to S3205.

  In step S3204, the reception processing unit 321 determines whether the answer received from the presenter terminal 310a is “permitted”. When the answer is “permitted” (YES in S3204), that is, when the user of the presenter terminal 310a permits the change of the presenter (presentation person) (transfer of operation authority), the notification unit 324 makes an announcement. A message to that effect is sent to the participant terminal 310b that has requested the change of person (S3205). Next, the reception processing unit 321 (authorization means) changes the type ID column of the terminals 310a and 310b in the terminal list, and the notification unit 324 sends another message indicating that the presenter has changed to the user of the terminal 310b. The terminal 310 is notified (S3206). Specifically, the reception processing unit 321 changes the type ID of the terminal 310a from “1” to “0”, and changes the type ID of the terminal 310b from “0” to “1”. That is, the reception processing unit 321 transfers the operation authority from the terminal 310a to the terminal 310b. Thereby, the terminal 310a is changed to a participant's terminal, and the terminal 310b is changed to a presenter's terminal.

  Next, the notification unit 324 requests the presenter terminal 310b to select a material to be used for the presentation (S3207). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the received presenter operation information is registered (S3208). Next, the notification unit 324 notifies the presenter operation information to all the participant terminals registered in the terminal list (S3209). Thereafter, the processing returns to S312.

  On the other hand, when the answer received by the reception processing unit 321 from the presenter terminal 310a in S3204 is “rejected” (NO in S3204), the notification unit 324 changes the presenter to the presenter terminal 310b. A message indicating that the request has been rejected is sent (S3210). Thereafter, the processing returns to S312. Through the above processing, the presenter is changed (operating authority is transferred) during the conference.

  Next, the flow of the “terminal disconnection process” will be described. FIG. 45 is an operation flowchart of “terminal disconnection processing” in the electronic conference system 3100.

  For example, when the reception processing unit 321 of the server 320 receives a disconnection request from the terminal 310 during the meeting, the terminal determination unit 323 determines whether the terminal 310 that has made the disconnection request is a presenter terminal, that is, an operation It is determined whether authority is granted (S3401). The disconnection request is made, for example, when a user attending the conference leaves the conference due to necessity.

  When the disconnect request is received from the presenter terminal (YES in S3401), the communication connection unit 322 disconnects communication with the presenter terminal (S3402). In this case, there is no presenter terminal and the presenter is absent. Therefore, first, the notification unit 324 inquires of all the terminals 310 (participant terminals) whether or not a presentation is desired at the conference (S3403). Note that the notification unit 324 may notify all the terminals 310 of a message indicating that there is no terminal having (given) operating authority. For example, when the reception processing unit 321 receives an answer indicating that a presentation is desired from the terminal 310c (YES in S3404), the reception processing unit 321 changes the type ID column of the terminal 310c in the terminal list from “0” to “1”. Change (S3405). That is, the reception processing unit 321 transfers the operation authority to the terminal 310c. As a result, the terminal 310c is registered as a presenter terminal. Next, the notification unit 324 requests the presenter terminal 310c to select a material to be used for the presentation (S3406). When the reception processing unit 321 receives an answer (presenter operation information) to the selection request, the received presenter operation information is registered (S3407). Next, the notification unit 324 notifies the presenter operation information to all the terminals for participants registered in the terminal list (S3408). Thereafter, the processing returns to S312.

  On the other hand, when the reception processing unit 321 receives the disconnection request from the participant terminal in S3401 (NO in S3401), the communication connection unit 322 disconnects communication with the participant terminal (S3410). Thereafter, the processing returns to S312. With the above process, the terminal disconnection process is performed during the conference.

  According to the configuration of the electronic conference system 3100 described above, even if the presenter is absent at the start of the conference or the presenter is absent during the conference, the presenter (operation authority) of the conference is appropriately set or transferred. Since (changed), the conference is not started and the progress of the conference is not interrupted, so that efficient conference operation is realized.

  The electronic conference system 3100 according to Embodiment 3-1 is not limited to the above configuration. For example, when the network connection of the presenter terminal 310 is unintentionally disconnected due to a system failure or the like and a preset time has elapsed, the processes of S3403 to S3408 in FIG. 45 may be executed. In the electronic conference system 3100, a plurality of users (presentation candidates) who wish to make a presentation may be registered in advance. In this case, when the presenter terminal 310 is disconnected, the terminal 310 may be inquired as to whether or not the presentation is desired in order of candidates (for example, S3105 in FIG. 43). In addition, the electronic conference system 3100 transmits a message indicating that the participant X in the conference desires to be in charge of presentation to the other plurality of participant terminals. Based on the answer, the presenter terminal may be forcibly changed (operating authority transferred) by majority vote.

3-3. Embodiment 3-2
An electronic conference system according to Embodiment 3-2 will be described. The description of the same components and the same functions as those of the electronic conference system 3100 according to Embodiment 3-1 will be omitted as appropriate.

  The electronic conference system 3200 (information processing system) according to Embodiment 3-2 has roughly the same function as the electronic conference system 3100 (see FIG. 38) according to Embodiment 3-1, and further includes a document. It has a function of controlling communication of media data such as audio data and image data independently of the sharing state (synchronized, asynchronous) of (display contents). For example, the electronic conference system 3200 includes a terminal (a terminal to which an operation authority is given) used by a user (presenter) who performs an operation related to contents displayed on a display screen during a conference, and a user (hereinafter, referred to as a user who speaks during the conference) It is possible to realize efficient conference operation by realizing the case where the terminal operated by the speaker) is the same as or different from the terminal operated by the speaker.

  FIG. 46 is a block diagram illustrating a hardware configuration of the terminal 310 and the server 320. The terminal 310 includes a computer including a CPU 3101, a memory 3102, a storage unit 3103, a communication unit 3104, an operation unit 3105, a display unit 3106, a voice input unit 3107, and a voice output unit 3108. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 3101 controls each part of the terminal 310 and executes various types of information processing. The memory 3102 holds various programs and data. A work area for the CPU 3101 is also secured in the memory 3102. The storage unit 3103 stores data such as various files and documents. The communication unit 3104 performs data communication with the server 320 and other terminals 310 via the communication network 330. The operation unit 3105 is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. A display unit 3106 is a display screen that displays various files, documents, and the like via application software such as a Web browser. In addition, the display unit 3106 displays an operation screen for accepting a user operation in a meeting, materials used for the meeting, and the like. The voice input unit 3107 is a microphone to which a user's voice spoken at the conference is input. The audio output unit 3108 is a speaker that outputs audio data received from another terminal 310 as audio during a conference. These storage unit 3103, operation unit 3105, display unit 3106, audio input unit 3107, and audio output unit 3108 may be provided outside the terminal 310 and connected to the terminal 310 via the communication network 330.

  Here, each terminal 310 may have both a transmission function for transmitting voice data spoken by the user and a reception function for receiving the voice data, or only one of the functions. Also good. The functions provided in each terminal 310 can be determined based on an instruction of a user who uses each terminal 310, a conference form, or the like.

  47 and 48 are functional block diagrams showing a specific configuration of the electronic conference system 3200. FIG. For convenience of explanation, a terminal 310 (hereinafter also referred to as a transmission terminal) shown in FIG. 47 shows functional blocks corresponding to a transmission function, and a terminal 310 (hereinafter also called a reception terminal) shown in FIG. 48 shows a reception function. The functional block corresponding to is shown. Note that, as described above, the transmission terminal 310 may further include a reception function (see FIG. 48), and the reception terminal 310 may further include a transmission function (see FIG. 47). In the following, reference will be made also to the case where each terminal has both the above functions as necessary. In addition, either the transmission terminal 310 or the reception terminal 310 may have an operation authority, or neither of them may have an operation authority.

  As illustrated in FIGS. 47 and 48, the server 320 further includes a terminal information generation unit 327 in the configuration of the electronic conference system 3100 (see FIG. 38) according to Embodiment 3-1. As shown in FIG. 47, the transmission terminal 310 includes a transmission request transmission unit 311, a determination result acquisition unit 312, a terminal information acquisition unit 313, a communication path establishment unit 314, a voice transmission unit 315, and a display control unit 316. Yes. As shown in FIG. 48, the reception terminal 310 includes a reception request transmission unit 341, a determination result acquisition unit 342, a display control unit 343, and an audio reception unit 344.

  Each element included in each terminal 310 and server 320 is realized by each CPU 3101 and 3201 executing a program stored in each memory 3102 and 3202 (see FIG. 46).

  The program may be installed in the terminal 310 and the server 320 from a computer-readable information storage medium such as a CD-ROM, a DVD-ROM, or a memory card, or downloaded through a communication network 330 such as the Internet. Alternatively, a program corresponding to a predetermined element may be downloaded to each terminal 310 from a server 320 in which a program corresponding to each element is stored in advance.

  Next, the flow of processing in the electronic conference system 3200 will be described. FIG. 49 is an operation flowchart of the server 320 in the electronic conference system 3200. FIG. 49 schematically shows the overall flow from the start to the end of the conference.

  When the reception processing unit 321 of the server 320 receives a connection request from the terminal 310 (S313), the server 320 executes the “new connection process” (see FIG. 43) described in the embodiment 3-1. When the reception processing unit 321 receives presenter operation information from the presenter terminal (S314), the notification unit 324 notifies the presenter operation information to the participant terminal (synchronous display processing). When the reception processing unit 321 receives the presenter change request from the participant terminal 310 (S315), the server 320 executes the “presenter terminal change process” (see FIG. 44) shown in the embodiment 3-1. When the reception processing unit 321 receives a disconnection request from the terminal 310 (S316), the server 320 executes the “terminal disconnection process” (see FIG. 45) described in the embodiment 3-1. When the reception processing unit 321 receives a voice transmission request (hereinafter referred to as a transmission request) (S321), the server 320 executes a process ("terminal number determination process") shown in FIG. When the reception processing unit 321 receives a voice reception request (hereinafter referred to as a reception request) (S322), the server 320 executes a process ("receiving terminal list generation process") shown in FIG. The reception processing unit 321 includes functions as a transmission request receiving unit that receives a transmission request and a reception request receiving unit that receives a reception request.

  Below, it demonstrates focusing on the function of the electronic conference system 3200 for implement | achieving audio | voice communication.

  The transmission request is transmitted from the terminal 310 to the server 320 based on a user operation. Specifically, first, in a conference, when a user wishes to transmit his / her speech (voice) to another terminal 310, that is, voice data is transmitted between his / her terminal and the other terminal. When it is requested to establish a communication channel for this, the operation unit 3105 of the terminal 310 is operated to give an instruction to that effect. For example, the user A displays a “voice transmission” selection screen (for example, a check box or an electronic button) displayed on the display unit 3106 of the terminal 310 (see FIG. 47) used by the user A at a conference by using a keyboard and a mouse. Select using etc. The transmission request transmission unit 311 of the terminal 310 transmits the received user A request (hereinafter referred to as a transmission request) to the server 320. For example, when the user A removes the “voice transmission” check box or when a predetermined condition is satisfied (described later), the transmission request transmission unit 311 transmits a transmission cancellation request. For example, the transmission request transmission unit 311 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a release request.

  The reception request is transmitted from the terminal 310 to the server 320 based on a user operation. Specifically, in a conference, when a user desires to receive another user's speech (voice), the user operates the operation unit 3105 of the terminal 310 to give an instruction to that effect. For example, the user B displays a “voice reception” selection screen (for example, a check box or an electronic button) displayed on the display unit 3106 of the terminal 310 (see FIG. 48) that the user B uses in the conference by using a keyboard and a mouse. Select using etc. The reception request transmission unit 341 of the terminal 310 transmits the received user B request (hereinafter referred to as a reception request) to the server 320. For example, when the user B removes the “voice reception” check box or satisfies a predetermined condition (described later), the reception request transmission unit 341 transmits a reception cancellation request. For example, the reception request transmission unit 341 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a release request.

  Each terminal 310 displays both “voice transmission” and “voice reception” selection screens, and each user can select each selection screen individually. For example, in the terminal 310, the user A can select both “voice transmission” and “voice reception”.

  The reception processing unit 321 (transmission request receiving unit) of the server 320 receives the transmission request transmitted from the transmission request transmission unit 311 of the terminal 310. For example, when a transmission request is transmitted from each of the terminals 310a and 310f, the reception processing unit 321 receives the transmission request from both the terminals 310a and 310f.

  The reception processing unit 321 (reception request receiving unit) of the server 320 receives the reception request transmitted from the reception request transmission unit 341 of the terminal 310. For example, when a reception request is transmitted from each of the terminals 310a to 310f, the reception processing unit 321 receives the reception request from each of the terminals 310a to 310f.

  Based on the transmission request received by the reception processing unit 321, the terminal determination unit 323 of the server 320 determines whether or not voice transmission is permitted in the terminal 310 that has transmitted the transmission request. Specifically, the terminal determination unit 323 compares the total number of terminals that have received the transmission request received by the reception processing unit 321 with a preset set number, and whether the total number is equal to or less than the set number. Determine whether or not. And the terminal determination part 323 permits the voice transmission in the terminal which made the transmission request when the total number is equal to or less than the set number, and rejects the voice transmission when the total number exceeds the set number. For example, when the set number is set to “3” and the terminals 310a and 310f make a transmission request, the total number (2) is equal to or less than the set number (3), so the terminals 310a and 310f Allow voice transmission in.

  Here, the terminal determination unit 323 calculates the total number of terminals 310 that are requesting transmission at the present time (when the determination target terminal makes a transmission request). For example, when the terminals 310a and 310f have already made a transmission request and the terminal 310b has newly made a transmission request, the total number at the present time is three. Therefore, for example, when the set number is set to “2”, the terminals 310a and 310f have already made a transmission request (speech transmission may have already been performed), and the terminal 310b has newly made a transmission request. In this case, since the total number (3) exceeds the set number (2), the voice transmission of the terminal 310b which has newly requested transmission is rejected.

  As described above, the voice transmission is permitted until the set number is reached in the order in which the transmission requests are made. In addition, when the number of terminals 310 that are permitted to transmit audio reaches the set number, when the audio transmission (communication path) is canceled in any of the terminals 310, the audio transmission of another terminal 310 is permitted. Can be given.

  The terminal determination unit 323 transmits the determination result (permission notification, rejection notification) to the terminal 310 that transmitted the transmission request.

  In addition, the terminal determination unit 323 may determine whether or not the terminal 310 that has transmitted the reception request is permitted to receive voice based on the reception request received by the reception processing unit 321. For example, the terminal determination unit 323 compares the total number of terminals 310 that have received the reception request received by the reception processing unit 321 with a preset set number, and determines whether the total number is equal to or less than the set number. May be determined. Further, whether or not the voice reception is permitted may be determined based on other conditions described later (Modification 1 of Embodiment 3 described later). Further, the terminal determination unit 323 may permit voice reception for all reception requests received by the reception processing unit 321. The terminal determination unit 323 transmits the determination result (permission notification, rejection notification) to the terminal 310 that transmitted the reception request.

  Furthermore, when the total number of terminals 310 that can make a transmission request reaches the set number, the terminal determination unit 323 indicates that the number of transmission terminals reaches a specified value (set number), and no further transmission requests can be made. The notification (message) may be transmitted to all terminals 310 connected to the server 320. Similarly, a notification indicating that a transmission request can be made may be transmitted to all the terminals 310 when the number of units that can make a transmission request in response to a transmission cancellation request falls below the set number. Moreover, you may transmit the notification which shows the remaining number itself until it reaches a setting number. For example, if the set number is two and if there is a transmission request from the terminal 310a, the terminal 310a is notified of transmission permission, and all the terminals 310 are the remaining number until reaching the set number “1”. (Station) ”, and when there is a transmission request from the terminal 310f, the terminal 310f is notified of transmission permission, and“ 0 (unit) ”is transmitted to all the terminals 310, and this time, the terminal 310a. When there is a transmission release request from the terminal, “1 (unit)” is transmitted to all the terminals 310. Note that the terminal determination unit 323 may perform the same processing as described above for a reception request.

  The terminal information generation unit 327 of the server 320 generates transmission terminal information based on the transmission request received by the reception processing unit 321 and the determination result in the terminal determination unit 323. Specifically, when the total number is equal to or less than the set number, the terminal information generation unit 327 generates a transmission terminal list that lists terminal information of the terminals 310 that are permitted to transmit voice. For example, when a transmission request received from the terminals 310a and 310f is permitted, the terminal information generation unit 327 transmits a list of terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminals 310a and 310f. Generate a terminal list. FIG. 50 shows an example of the transmission terminal list. The terminal information generation unit 327 updates the transmission terminal list every time the received transmission request is permitted or every time the transmission request is canceled. The generated transmission terminal list is stored in the terminal information DB 331.

  Further, the terminal information generation unit 327 generates reception terminal information based on the reception request received by the reception processing unit 321. Specifically, the terminal information generation unit 327 generates a reception terminal list that lists terminal information of the terminals 310 that permit the reception request. For example, when the reception request received from the terminals 310a to 310f is permitted, the terminal information generation unit 327 receives a list of terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminals 310a to 310f. Generate a terminal list. FIG. 51 shows an example of the receiving terminal list. The terminal information generation unit 327 updates the reception terminal list every time the received reception request is permitted or every time the reception request is canceled. FIG. 52 shows an updated receiving terminal list when a new reception request received from the network-connected terminal 310g (not shown) in the state of FIG. 51 is permitted. The generated receiving terminal list is stored in the terminal information DB 331.

  In addition, the terminal information generation unit 327 transmits the reception terminal list to the terminal 310 for which voice transmission is permitted by the terminal determination unit 323. Further, the terminal information generation unit 327 transmits the updated receiving terminal list to the terminal 310 that is permitted to transmit voice even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted to the terminals 310a and 310f, the terminal information generation unit 327 transmits the reception terminal list (see FIG. 51) to the terminals 310a and 310f. In addition, when the receiving terminal list is updated, the terminal information generation unit 327 transmits the updated receiving terminal list to the terminals 310a and 310f. At that time, only the changed (added) receiving terminal list may be transmitted. The terminal information generation unit 327 has a function as receiving terminal information notification means.

  The determination result acquisition unit 312 (see FIG. 47) of the terminal 310 receives (or acquires) the determination result in the terminal determination unit 323 of the server 320. For example, the determination result acquisition unit 312 of the terminals 310 a and 310 f acquires a voice transmission permission notification from the server 320.

  The terminal information acquisition unit 313 (terminal information reception unit) (see FIG. 47) of the terminal 310 acquires (or receives) the reception terminal list from the terminal information generation unit 327 of the server 320. For example, the terminal information acquisition unit 313 of the terminals 310a and 310f acquires the reception terminal list shown in FIG.

  The communication path establishment unit 314 (communication path establishment means) (see FIG. 47) of the terminal 310 transmits audio data to and from other terminals 310 based on the reception terminal list acquired by the terminal information acquisition unit 313. Establish a communication path for transmission (transmission / reception). The acquired receiving terminal list is stored in the storage unit 3103. For example, the communication path establishment unit 314 of the terminal 310a establishes a communication path between the terminal 310a and each of the terminals 310b, 310c, 310d, 310e, and 310f. FIG. 53 shows a network configuration showing communication paths established between the terminal 310a and the terminals 310b, 310c, 310d, 310e, and 310f. Similarly, the communication path establishment unit 314 of the terminal 310f establishes a communication path between the terminal 310f and each of the terminals 310a, 310b, 310c, 310d, and 310e. FIG. 54 shows a network configuration showing communication paths established between the terminal 310f and the terminals 310a, 310b, 310c, 310d, and 310e. FIG. 55 shows a network configuration showing all communication paths established in the above example. 53 to 55, the direction of the arrow indicates the transmission direction of the audio data. 53 to 55 show a configuration in which audio data is transmitted and received without going through the server 320, the network configuration is not limited to this, and the configuration in which the server 320 is used as a repeater to transmit and receive audio data. May be.

  The communication path is established, for example, based on the IP address and port number of the receiving terminal information from the terminal that transmits voice (transmitting terminal) to the terminal that receives voice (receiving terminal). For example, when the user A removes the “voice transmission” check box displayed on the display unit 3106 of the terminal 310a, the communication channel establishment unit 314 cancels the established communication channel.

  When the communication path is established by the communication path establishment unit 314, the voice transmission unit 315 (see FIG. 47) of the terminal 310 transmits the voice data input to the voice input unit 3107 to each terminal 310 via the communication path. Send (deliver) to. For example, the voice transmission unit 315 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 3107 of the terminal 310a via the communication path (single line in FIG. 55) to the terminals 310b, 310c, The voice data corresponding to the speech (voice) of the user F transmitted to the voice input unit 3107 of the terminal 310f is transmitted to the terminals 310a, 310e, and 310f via the communication path (double line in FIG. 55). It transmits to 310b, 310c, 310d, 310e. Thereby, the utterances (voice data) of the user A and the user F can be transmitted to the other terminals 310 at the same timing, for example. Note that the audio transmission unit 315 may perform stream transmission (streaming) or an audio data file to each terminal 310. In addition, when a Web browser is incorporated in both the transmission terminal and the reception terminal, the audio stream of the transmission terminal may be connected to the reception terminal using WebRTC (Web Real-Time Communication).

  The display control unit 316 (see FIG. 47) of the terminal 310 causes the display unit 3106 to display the display content corresponding to the determination result acquired by the determination result acquisition unit 312. For example, when the determination result acquisition unit 312 acquires a voice transmission permission notification from the server 320, the display control unit 316 causes the display unit 3106 to display a message indicating that voice transmission is permitted. When the determination result acquisition unit 312 acquires a voice transmission rejection notification from the server 320, the display control unit 316 causes the display unit 3106 to display an error message indicating voice transmission rejection and causes the display unit 3106 to display the error message. Change the displayed “Send Audio” selection screen (checkbox and electronic buttons) so that it cannot be selected. For example, an electronic button for selecting voice transmission (transmission request) is grayed out (inactivated) so that it cannot be selected (pressed), or the display unit 3106 indicates that “current transmission request cannot be made”. May be displayed. As described above, the display control unit 316 may control the display content of the display unit 3106 so that the user cannot perform new voice transmission (transmission request).

  The determination result acquisition unit 342 (see FIG. 48) of the terminal 310 receives (or acquires) the determination result in the terminal determination unit 323 of the server 320. For example, the determination result acquisition unit 342 of the terminals 310 a to 310 f acquires a voice reception permission notification from the server 320.

  When the determination result acquisition unit 342 acquires the permission notification, the display control unit 343 (see FIG. 48) of the terminal 310 causes the display unit 3106 to display a message indicating that voice reception is permitted. When the determination result acquisition unit 342 acquires a voice reception rejection notification from the server 320, the display control unit 343 causes the display unit 3106 to display an error message indicating voice reception rejection, and causes the display unit 3106 to display the error message. Change the displayed “Receive Voice” selection screen (check box and electronic button) so that it cannot be selected.

  The voice receiving unit 344 (see FIG. 48) of the terminal 310 receives the voice data transmitted via the communication path. The audio output unit 3108 converts the received audio data and outputs audio. For example, each of the voice reception units 344 of the terminals 310b, 310c, 310d, 310e, and 310f has a voice corresponding to the speech (voice) of the user A transmitted from the terminal 310a via the communication path (single line in FIG. 55). The data is received, and each sound output unit 3108 outputs sound. In addition, each of the voice receiving units 344 of the terminals 310a, 310b, 310c, 310d, and 310e corresponds to the speech (voice) of the user F transmitted from the terminal 310f via the communication path (double line in FIG. 55). Audio data is received, and each audio output unit 3108 outputs audio. Thereby, for example, the user B, the user C, the user D, and the user E of the terminals 310b, 310c, 310d, and 310e can hear the user A and the user F at the same timing.

  Next, the flow of processing in the server 320 will be described using a flowchart. FIG. 56 shows a flowchart of the terminal number determination process when the server 320 receives a transmission request from the terminal 310 (S321 in FIG. 49). This process is executed, for example, when a notification unit 324 (see FIG. 38) of the server 320 notifies a plurality of terminals 310 connected to the server 320 via a network when the notification is started. The same applies to the processing of FIGS. 57 and 58 described later.

  First, when a transmission request is transmitted from the terminal 310, the reception processing unit 321 receives the transmission request (S3501). Next, the terminal determination unit 323 compares the total number of terminals 310 that have made a transmission request with a preset set number, and determines whether the total number is equal to or less than the set number (S3502).

  When the total number is equal to or less than the set number, the terminal determination unit 323 transmits a voice transmission permission notification to the terminal 310 that has requested transmission, and the terminal information generation unit 327 includes a transmission terminal list (FIG. 50). Reference) is generated (S3503). Subsequently, the terminal information generation unit 327 transmits a receiving terminal list that lists information of terminals that have made a reception request to the terminal 310 registered in the transmitting terminal list (S3504).

  In the process of S3502, when the total number exceeds the set number, the terminal determination unit 323 transmits a voice transmission rejection notification to the terminal 310 that has transmitted the transmission request (S3505). The processes from S3501 to S3505 are repeated until the conference ends (S3506).

  FIG. 57 shows a flowchart of the reception terminal list generation process when the server 320 receives a reception request from the terminal 310 (S322 in FIG. 49).

  First, when a reception request is transmitted from the terminal 310, the reception processing unit 321 receives the reception request (S3601). Next, the terminal information generation unit 327 generates or updates the receiving terminal list (see FIG. 51) (S3602). Next, the terminal information generation unit 327 transmits a voice reception permission notification to the terminal 310 registered in the receiving terminal list (S3603). In addition, although the case where audio | voice reception is permitted about all the reception requests received by the reception process part 321 is shown here, the terminal determination part 323 receives audio | voice reception only when it is below the preset set number. In the case of permission and rejection, a voice reception rejection notification may be transmitted to the terminal 310. Next, the terminal information generation unit 327 acquires the transmission terminal list and transmits the reception terminal list for each of the terminals 310 registered in the transmission terminal list (S3604). When the receiving terminal list is changed (updated), only the receiving terminal list that has been changed (added) may be transmitted. The processes from S3601 to S3604 are repeated until the conference ends (S3605).

  FIG. 58 shows a flowchart when the user makes a transmission request in the terminal 310.

  First, in the conference, the terminal 310 receives a transmission request from the user (S3701). Next, the transmission request transmission unit 311 transmits the received transmission request to the server 320 (S3702). When the server 320 receives the transmission request, the server 320 executes the processing from S3501 to S3505 shown in FIG.

  Next, the determination result acquisition unit 312 of the terminal 310 acquires a transmission permission notification or a transmission rejection notification from the server 320 (S3703). When the transmission permission notification is acquired, the terminal information acquisition unit 313 acquires a reception terminal list from the server 320 (S3704).

  Next, the communication path establishment unit 314 acquires terminal information (terminal ID) of any one terminal 310 from the receiving terminal list (S3705). Next, the communication path establishment unit 314 establishes a communication path for transmitting voice data to the terminal 310 corresponding to the acquired terminal information (S3706). The communication path establishment unit 314 executes processing for establishing a communication path for all the terminals 310 registered in the receiving terminal list (S3707).

  Next, the voice transmission unit 315 transmits the voice data to each terminal 310 via the established communication path (S3708).

  In the process of S3703, when the determination result acquisition unit 312 acquires a transmission rejection notification from the server 320, the display control unit 316 of the terminal 310 causes the display unit 3106 to display an error message (S3709). The processes from S3701 to S3709 are repeated until the conference ends (S3710).

  As described above, the electronic conference system 3200 according to Embodiment 3-2 sets an upper limit on the number of transmitting terminals to which a right to speak (transmits voice) is set, and determines terminals that permit transmission according to a user instruction. The communication channel is dynamically changed to establish a communication path between the terminal permitted to transmit and another terminal. Thereby, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, each user can make a selection according to his / her intention, such as when he / she wants to send a speech (voice) or receives a voice, and is reflected in the intention of the user between terminals on the network. A communication path is dynamically changed and established.

  In addition, according to the electronic conference system 3200, communication of audio data is controlled independently of the sharing state (synchronous or asynchronous) of the material (display contents). For example, when a network of communication paths for transmitting and receiving audio data is constructed as shown in FIG. 55 during a conference, and the user A of the terminal 310a is a presenter who performs operations related to display contents, the user A Can also make a statement (for example, an explanation of the table contents) while performing the above operation. As a result, each of the users B to F of the other terminals 310b, 310c, 310d, 310e, and 310f confirms the display screen according to the operation content on the terminal 310a on the display screen of their own terminal, User A's remarks (explanation) output from the audio output unit 3108 can be heard.

  In the above example, when the presenter is changed from the user A to the user F during the meeting (operation authority is transferred), the user F makes a statement (for example, with respect to the table contents) while performing an operation related to the new display contents. Explanation). In the network configuration of FIG. 55, since the user F has the right to speak, in this case, it is not necessary to execute construction of a new communication path for audio data even if the operation right is transferred. For this reason, even if the presenter changes, seamless audio communication is possible without interruption or delay of the output audio, and efficient conference operation is realized.

  In the above example, when the presenter is changed from the user A to the user B during the meeting, the user B performs an operation related to new display contents. At this time, when the user B requests voice transmission, a new communication path is constructed based on the above-described processing. When user B does not request voice transmission, the network configuration shown in FIG. 55 is maintained. Such a form is suitable for use scenes in which, for example, the user who operates the material differs from the user who explains the material.

  Thus, according to the electronic conference system 3200, since the sharing state (synchronous, asynchronous) of the material (display content) and the sharing state of the audio data are controlled separately, the sharing state of the material (display content) is changed. While maintaining, dynamically switch the terminal that transmits voice to another terminal to reconstruct the communication path, or maintain the voice communication path and dynamically transfer the terminal to which operation authority is granted to the other terminal Or switch to As a result, it is possible to exchange audio data between a large number of terminals in a pseudo manner while sharing materials (display contents). In other words, voices can be exchanged bidirectionally between a large number of terminals while the contents of the operation of the materials by the presenter are synchronized.

3-4. Modification of Embodiment 3 The configuration for transmitting and receiving audio in the electronic conference system 3200 is not limited to the above configuration, and various configurations can be employed. Below, the electronic conference system 3200 which concerns on the modification of Embodiment 3 is demonstrated centering on difference with the said structure. In an electronic conference system 3200 according to a modification of the third embodiment below, description of elements having the same functions as those of the electronic conference system 3200 will be omitted.

3-4-1. Modification 1 of Embodiment 3
In the electronic conference system 3200 according to the first modification of the third embodiment, the server 320 may further include a current location acquisition unit 328 that acquires the current location of each terminal 310. FIG. 59 is a functional block diagram illustrating a specific configuration of the server 320 according to the first modification of the third embodiment.

  The current location acquisition unit 328 receives, for example, a detection value of a position detection unit (not shown) (for example, GPS) provided in each terminal 310, and acquires the current location (address location, etc.) of each terminal 310. . Further, the current location acquisition unit 328 may acquire the current location of each terminal 310 by setting the IP address, the subnet of the network, and location information in advance and acquiring the IP address of each terminal 310.

  Based on the reception request received by the reception processing unit 321 and the current location of each terminal 310 acquired by the current location acquisition unit 328, the terminal determination unit 323 determines whether or not the terminal 310 that has transmitted the reception request is permitted to receive audio. judge.

  The terminal information generation unit 327 generates reception terminal information based on the reception request received by the reception processing unit 321 and the determination result of the terminal determination unit 323. Specifically, the terminal information generation unit 327 generates a reception terminal list in which information of the terminals 310 permitted by the terminal determination unit 323 among the terminals 310 that have made a reception request is listed. The terminal information generation unit 327 transmits the reception terminal list to the terminal 310 for which voice transmission is permitted by the terminal determination unit 323.

  Hereinafter, a specific example will be described. 60, the terminals 310a, 310b, and 310c are provided in the same conference room 3101, the terminal 310d is provided in a place P1 remote from the meeting room 3101, and the terminal 310e is provided in a place P2 remote from the meeting room 3101. The network configuration in the case where the terminal 310f is provided in the place P3 remote from the conference room 3101 is shown.

  In the network configuration of FIG. 60, it is assumed that terminals 310a and 310f transmit transmission requests, and terminals 310a to 310f transmit reception requests. Since the total number (two) of transmission requests of the terminals 310a and 310f is equal to or less than the set number (three), voice transmission is permitted.

  The current location acquisition unit 328 acquires the current location from each of the terminals 310a to 310f. That is, the current location acquisition unit 328 acquires “conference room 3101” as the current location of the terminals 310a, 310b, and 310c, acquires “remote location P31” as the current location of the terminal 310d, and “remote location P32” as the current location of the terminal 310e. And “remote location P33” is obtained as the current location of the terminal 310f.

  The terminal determination unit 323 determines whether or not the current location of each terminal 310 is the same or a place (predetermined place) within a preset range, and if a plurality of terminals 310 are present at the predetermined place, One of the terminals 310 is allowed to receive voice, and the other terminals 310 are refused to receive voice. In the network configuration of FIG. 60, among the terminals 310a, 310b, and 310c existing in a predetermined place (conference room 3101), the voice reception of the terminal 310a is permitted, and the voice reception of the terminals 310b and 310c is rejected. The terminal determination unit 323 transmits the determination result (permission notification, rejection notification) to the terminal that transmitted the reception request.

  The terminal information generation unit 327 generates a reception terminal list shown in FIG. 61 based on the determination result, and transmits it to the terminals 310a and 310f. The terminals 310a and 310f establish communication paths based on the acquired receiving terminal list. FIG. 62 shows a network configuration showing a communication path established in the electronic conference system 3200 according to the first modification of the third embodiment.

  When a plurality of terminals 310 are present at a predetermined location and a transmission request is made at a plurality of terminals 310 among them, the terminal determination unit 323 selects one of the plurality of terminals 310 that has made the transmission request. Voice transmission may be permitted for one terminal 310 and voice transmission for other terminals 310 may be rejected. For example, when a transmission request is made in the terminals 310a, 310b, and 310c existing in the conference room 3101, the voice transmission of the terminal 310a is permitted and the voice transmission of the terminals 310b and 310c is rejected. The terminal information generation unit 327 transmits the reception terminal list to the terminal 310a that has permitted the voice transmission, and the terminal 310a establishes a communication path based on the acquired reception terminal list.

  In a conference with the above-described network configuration, a plurality of users (for example, users B and C) of a plurality of terminals 310 existing in the same conference room can directly listen to the content of one user (for example, user A). Then, the terminal 310 (for example, the terminal 310a) of the plurality of terminals 310 receives and outputs the content of messages from other users (for example, the users D, E, and F) at remote locations. it can. Therefore, according to the electronic conference system 3200 which concerns on the modification 1 of Embodiment 3, the number of required communication paths can be reduced.

3-4-2. Variation 2 of Embodiment 3
In the electronic conference system 3200 according to the second modification of the third embodiment, the set number may be changed dynamically. Specifically, the set number may be set according to the number of all terminals 310 connected via the communication network 330. For example, the set number can be reduced as the number of terminals 310 increases. This configuration is suitable for an electronic conference such as a seminar in which a speaker (presenter) is determined. Alternatively, the set number may be calculated and set by the ratio to the number of all terminals 310 connected via the network. Further, the set number may be set according to the number of terminals 310 that have requested reception.

3-4-3. Modification 3 of Embodiment 3
In the electronic conference system 3200 according to the third modification of the third embodiment, after the communication path is established, the time when the voice data is not transmitted from the terminal 310 that is permitted to transmit the voice reaches a preset time. The communication path establishment unit 314 may cancel the communication path corresponding to the terminal 310. For example, when the user A who is permitted to transmit voice does not speak for a certain period of time, the communication path establishment unit 314 forcibly releases the communication path established in the terminal 310a of the user A. In the above configuration, the user who uses the transmission terminal may be photographed by a camera, and the photographed image may be analyzed to measure the presence / absence of the user's speech and the duration of the silent state. The camera may be built in the terminal 310 or may be installed outside (for example, a conference room).

3-4-4. Modification 4 of Embodiment 3
Here, in the third embodiment, as shown in FIG. 58, when the transmission rejection notification is acquired, the display control unit 316 of the terminal 310 displays an error message on the display unit 3106. The configuration in the case where is rejected is not limited to this.

  For example, in the electronic conference system 3200 according to the fourth modification of the third embodiment, when the total number of transmission terminals has already reached the set number when the terminal 310 is connected to the server 320, the check box cannot be checked. You may control to. Further, the check box may be controlled by acquiring information from the server 320 in accordance with the increase or decrease of the total number of transmission terminals. The acquisition of the total number of transmission terminals may be performed by polling the server 320, but preferably, the connection is made using Web Socket or the like, and each terminal is notified from the server 320 side. good.

  Note that the electronic conference system 3200 may have the following configuration.

  The electronic conference system 3200 limits the number of people who can speak at the same time (the number of transmitting terminals) because the number of people who speak at the same time (speaker terminals) is limited even if many terminals are connected. On the other hand, the communication channel establishment state is dynamically changed while switching the transmission terminal. Thereby, it becomes possible to transmit and receive audio data between a large number of terminals in a pseudo manner.

  In addition, the electronic conference system 3200 has a configuration in which voice transmission / voice reception can be selected by each terminal, and the server 320 is notified when the voice transmission / voice reception status of each terminal changes.

  Further, the server 320 notifies the terminal for which voice transmission is selected, of a list of terminals for which voice reception is selected. At this time, it is not necessary to notify the information of the terminal whose state has not changed so far. The transmitting terminal that has received the notification calls the receiving terminal so as to receive its own stream information only to the newly registered receiving terminal (calls a connection request).

  Further, the electronic conference system 3200 has a configuration in which the server 320 manages the total number of terminals that can transmit simultaneously, and when the total number reaches the upper limit (set number), the terminal cannot select a transmission request. .

  Further, in the electronic conference system 3200, the transmission terminal includes two types, a constant transmission terminal and a temporary transmission terminal. Of these, the temporary transmission terminal can be transmitted only for a certain period of time, and after a certain period of time has elapsed, the voice is transmitted. The transmission may be canceled (the transmission request check box is canceled). The temporary transmission terminal may be configured to allow transmission only while the user is pressing the voice transmission button. The temporary transmission terminal may be configured such that the transmission request is canceled when the silent state continues for a certain period of time.

  Further, the electronic conference system 3200 may be configured such that a user who wants to speak makes a transmission request at a terminal and gives a speaking right to a user designated at a specific terminal (master terminal) (permits as a transmitting terminal).

  The electronic conference system 3200 may be configured to automatically permit voice transmission of a terminal when an operation authority is given to the terminal. That is, the electronic conference system 3200 may be configured such that a terminal to which an operation authority is granted becomes a terminal that automatically transmits voice.

  Each of the modifications of Embodiments 3-1, 3-2, and 3 of each electronic conference system described above is an example, and the embodiments can be combined.

  Further, the network configuration of each electronic conference system is not limited to the configuration shown in FIG. 39, and may be a configuration without the server 320 (FIG. 63). The configuration shown in FIG. 63 is realized by downloading a program corresponding to each element included in the electronic conference system to each of the terminals 310a to 310f. Specifically, each electronic conference system is realized by the CPU of each terminal executing a program stored in the memory of each terminal 310a to 310f. Note that the downloaded program may be constituted by, for example, JavaScript (registered trademark). The terminal 310 on which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the terminal 310 or the server 320.

  The electronic conference system 3200 is not limited to audio data transmission / reception. That is, the electronic conference system 3200 can be applied to transmission / reception of media data including at least one of audio data and video data (moving image data). Each electronic conference system can be applied to various electronic conferences such as a video conference and a telephone conference. In a video conference, video captured by a camera mounted on each terminal is bidirectionally communicated between the terminals via the communication path. Each electronic conference system can also be applied to a remote conference where conference attendees are remote from each other.

  In the above description, an electronic conference system is taken as an example of an information processing system. However, the information processing system is not limited to an electronic conference system, and various types of media data can be shared between terminals connected to a network. Includes systems.

3-5. Effects of Embodiment 3 A program according to Embodiment 3 of the present invention is a program for causing a computer to display a part of a display screen in synchronization between a plurality of terminals connected via a network. An accepting unit that accepts connection requests from the plurality of terminals, an authority granting unit that grants operation authority to materials to be synchronously displayed on any one of the plurality of terminals that transmitted the connection request, and the terminal A terminal other than the terminal to which the operation authority is given among the plurality of terminals that have transmitted the connection request, and the material information of the material displayed on the screen and the operation information indicating the contents operated on the material The computer is made to function as a notification means for notifying to the user. According to this configuration, the authority of the presenter at the conference is appropriately set or transferred.

  In the program according to Embodiment 3 of the present invention, the computer further includes at least one transmission request receiving means for receiving a transmission request for media data including at least one of audio data and video data from at least one terminal. A reception request receiving means for receiving the media data reception request from the terminal, and the transmission request is made when the total number of the terminals that have made the transmission request is equal to or less than a predetermined number of terminals. You may make the said terminal function as a receiving terminal information notification means which notifies the information of the said terminal which performed the said reception request. According to this configuration, when the total number of terminals that have requested transmission is equal to or less than the set number, the media data is transmitted between the terminal that has requested transmission and the terminal that has requested reception. A communication path is established. For this reason, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, media data is communicated independently of the sharing state (synchronous, asynchronous) of the material (display content).

  In the program according to the third embodiment of the present invention, the authority granting unit requests acquisition of the operation authority to the plurality of terminals that transmitted the connection request when there is no terminal to which the operation authority is granted. In addition to inquiring, the operation authority is granted to a terminal that desires acquisition of the operation authority, and the notification means notifies the terminal that does not desire acquisition of the operation authority to display a standby screen. Also good. According to this configuration, the standby screen is displayed on a terminal that does not wish to acquire operation authority.

  In the program which concerns on Embodiment 3 of this invention, the said request | requirement transfer acceptance means which receives the said request | requirement transfer request | requirement from any one terminal among the said some terminal which the said computer uses further the said computer further And an inquiry means for transmitting an inquiry as to whether or not to permit the transfer request to the terminal to which the operation authority is granted, wherein the authority assignment means is configured to allow the terminal to be given the operation authority. When the response indicating that the transfer request is permitted is received, the operation authority may be transferred to the terminal that has transmitted the transfer request. According to this configuration, when the user of the terminal to which the operation authority is granted permits the transfer of the operation authority, the operation authority is transferred to another terminal.

  In the program according to the third embodiment of the present invention, the authority granting unit, when a predetermined set time has elapsed since the inquiry is transmitted, causes the terminal to which the operation authority is granted to send the transfer request. The operation authority may be transferred to the terminal that has been determined to be permitted and has transmitted the transfer request. According to this configuration, when the set time elapses after the inquiry is transmitted, the operation authority is forcibly transferred.

  In the program according to the third embodiment of the present invention, the notifying unit uses the plurality of participants used by the plurality of participants when the terminal to which the operation authority is granted is disconnected from the network during a meeting. You may make it notify that the said terminal to which the said operation authority was provided does not exist with respect to a terminal. According to this configuration, when a terminal to which operation authority is granted is disconnected from the network, it is notified to another terminal that there is no terminal to which operation authority is granted.

  In the program according to the third embodiment of the present invention, the notifying unit further transmits an inquiry as to whether or not the operation authority is desired to be acquired to the plurality of terminals used by the plurality of participants. The authority granting unit may transfer the operation authority to a terminal that desires to acquire the operation authority. According to this configuration, when the terminal to which the operation authority is granted is disconnected from the network, the operation authority is transferred to the terminal that desires to acquire the operation authority.

  In the program according to the third embodiment of the present invention, when the operation authority is transferred to another terminal, the computer is further selected to transmit a request for selecting a new material to be shared in the conference to the terminal. Functioning as a request transmission unit, wherein the notification unit notifies the plurality of terminals used by the plurality of other participants of the operation information for the material selected in the terminal to which the operation authority has been transferred. It may be. According to this configuration, the material selected in the terminal to which the operation authority has been transferred is displayed on the display screen of another terminal.

  In the program according to the third embodiment of the present invention, the notification unit may notify the terminal used by the participant of a standby message when the operation authority is not given to any terminal. Good. According to this configuration, the standby message is displayed on the display screen of the terminal used by the participant until the operation authority is given to any one terminal.

  In the program according to the third embodiment of the present invention, if the total number of the terminals that have made the transmission request is less than or equal to a predetermined number, the terminal that has made the transmission request And communication path establishment means for establishing a communication path for transmitting the media data with at least one of the terminals that has made the reception request. According to this configuration, when the total number of terminals that have requested transmission is equal to or less than the set number, the media data is transmitted between the terminal that has requested transmission and the terminal that has requested reception. A communication path is established. For this reason, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, media data is communicated independently of the sharing state (synchronous, asynchronous) of the material (display content).

  In the program according to Embodiment 3 of the present invention, when the communication path is established between the plurality of terminals that have made the transmission request and the plurality of terminals that have made the reception request, the transmission When the plurality of terminals that have made a request include the terminal to which the operation authority has been granted and the terminal to which the operation authority has been transferred, the communication path establishment means does not change the communication path. May be. According to this configuration, when a plurality of terminals that have made a transmission request include a terminal to which an operation authority is granted and a terminal to which the operation authority is transferred, the communication path is not changed.

  In the program according to the third embodiment of the present invention, when the operation authority is given to the terminal, the terminal may permit transmission of the media data. According to this configuration, when operation authority is given to a terminal, transmission of media data of the terminal is permitted.

  In the program according to the third embodiment of the present invention, the computer is further caused to function as a current location acquisition unit that acquires the current location of each terminal, and the communication path establishment unit determines in advance the terminal that has made the reception request. In the case where there are a plurality of terminals within the specified range, the communication path may be established for one of the terminals. According to this configuration, when there are a plurality of terminals that have requested reception within a predetermined range, a communication path is established for one of the terminals.

  In the program according to the third embodiment of the present invention, when the total number of the terminals that have made the transmission request has reached the set number, the transmission request receiving unit receives a new transmission request. The communication path establishment means may refuse to establish the communication path for the terminal that has made a new transmission request. According to this configuration, establishment of a communication path is rejected in a terminal that has made a new transmission request when the number of terminals that have requested transmission has reached the set number.

  In the program according to the third embodiment of the present invention, after the communication path is established, when the time during which the media data is not transmitted from the terminal that has made the transmission request has reached a predetermined time, The communication path establishment means may release the communication path corresponding to the terminal. According to this configuration, when the time during which media data is not transmitted reaches a preset time, the communication path of the corresponding terminal is released.

  In the program according to the third embodiment of the present invention, the computer is further caused to function as display control means for controlling display content of the display screen of the terminal, and the display control means When the total number has reached the set number, the display screen is displayed so that the user cannot select a new transmission request, and the total number of the terminals that have made the transmission request is the set number. When the value is lower than, the display content of the display screen may be changed so that the user can select a new transmission request. According to this configuration, a screen that accepts a transmission request and a screen that does not accept a transmission request are switched and displayed according to an increase or decrease in the total number of transmission terminals.

  The program may be stored in a computer-readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal.

  An information processing apparatus according to Embodiment 3 of the present invention is an information processing apparatus that displays a part of a display screen in synchronization between a plurality of terminals connected via a network, and requests connection from the plurality of terminals. Receiving means for accepting, authority granting means for granting operation authority for the material to be synchronously displayed on any one of the plurality of terminals that transmitted the connection request, and for the material displayed on the terminal Notifying means for notifying document information and operation information indicating the contents operated on the document to terminals other than the terminal to which the operation authority is granted among the plurality of terminals that have transmitted the connection request; It is characterized by including. According to this configuration, the authority of the presenter at the conference is appropriately set or transferred.

  In the information processing apparatus according to the third embodiment of the present invention, transmission request receiving means for receiving a transmission request for media data including at least one of audio data and video data from at least one terminal, and at least one terminal If the total number of the reception request receiving means for receiving the media data reception request and the terminal that has made the transmission request is equal to or less than a preset number of terminals, the terminal that has made the transmission request, Receiving terminal information notifying means for notifying information of the terminal that has made the reception request. The information processing apparatus may be the terminal. According to this configuration, when the total number of terminals that have requested transmission is equal to or less than the set number, the media data is transmitted between the terminal that has requested transmission and the terminal that has requested reception. A communication path is established. For this reason, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, media data is communicated independently of the sharing state (synchronous, asynchronous) of the material (display content).

  An information processing system according to Embodiment 3 of the present invention displays a part of a display screen in synchronization between a plurality of terminals connected via a network, and at least audio data and video data at the plurality of terminals. An information processing system that transmits / receives media data including any one of a receiving unit that receives a connection request from the plurality of terminals, and a synchronization with any one of the plurality of terminals that transmitted the connection request. The authority granting means for granting the operation authority for the material to be displayed, the material information of the material displayed on the terminal, and the operation information indicating the contents operated on the material, the connection request is transmitted. Notification means for notifying a terminal other than the terminal to which the operation authority is granted among a plurality of terminals, and audio data and video data from at least one terminal Total of transmission request receiving means for receiving a transmission request for media data including at least one, reception request receiving means for receiving a reception request for media data from at least one terminal, and the terminal that has made the transmission request And receiving terminal information notifying means for notifying the terminal that has made the transmission request to the terminal that has made the reception request when the number is equal to or less than a predetermined set number. And According to this configuration, the authority of the presenter at the conference is appropriately set or transferred.

  A recording medium according to Embodiment 3 of the present invention is a program for causing a computer to display a part of a display screen in synchronization between a plurality of terminals connected via a network, the plurality of terminals An accepting means for accepting a connection request from, an authority giving means for giving an operation authority to a material to be synchronously displayed on any one of the plurality of terminals that transmitted the connection request, and displayed on the terminal Notification of notifying the terminal information other than the terminal to which the operation authority is granted among the plurality of terminals that have transmitted the connection request, and the operation information indicating the contents operated on the material. As a means, a program for causing a computer to function is recorded. According to this configuration, the authority of the presenter at the conference is appropriately set or transferred.

  In the recording medium according to Embodiment 3 of the present invention, the computer further includes a transmission request receiving means for receiving a transmission request for media data including at least one of audio data and video data from at least one terminal. A reception request receiving means for receiving the media data reception request from one terminal and the transmission request when the total number of the terminals that have made the transmission request is equal to or less than a predetermined number of terminals. A program for causing the terminal to function as receiving terminal information notifying means for notifying information of the terminal that has made the reception request may be recorded. The computer may be the terminal. According to this configuration, when the total number of terminals that have requested transmission is equal to or less than the set number, the media data is transmitted between the terminal that has requested transmission and the terminal that has requested reception. A communication path is established. For this reason, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, media data is communicated independently of the sharing state (synchronous, asynchronous) of the material (display content).

4-1. Embodiment 4
Embodiment 4 of the present invention provides an information processing apparatus, an information processing system, a program, and a recording medium that can separately control the synchronization of materials and audio among a plurality of terminals and maintain confidentiality of a conference. For the purpose. In the fourth embodiment, as an example of an information processing system, an electronic conference system that shares (synchronizes) electronic data such as materials and media data such as audio data and image data among a plurality of terminals connected via a network Will be described as an example. In addition, the meaning of the term of Embodiment 4 shall extend only to the range of Embodiment 4.

  FIG. 64 is an overall configuration diagram of the electronic conference system according to the fourth embodiment. The electronic conference system 4100 (information processing system) includes a plurality of terminals 410 that are used (operated) by a plurality of users attending the conference, a terminal management server 420 that manages the terminals 410, and materials used for the conference. And a file management server 430 for managing files. The terminal management server 420 and the file management server 430 may be included in one information processing apparatus. In the fourth embodiment, a user who makes a presentation at a meeting is referred to as a “presenter” and a terminal used by the presenter is referred to as a “presenter terminal” as necessary. A user who attends the conference other than the presenter is called a “participant”, and a terminal used by the participant is called a “participant terminal”. For example, in FIG. 64, when the terminal 410a is a presenter terminal, the other five terminals 410b, 410c, 410d, 410e, and 410f are participant terminals. Each terminal 410 can be either a presenter terminal or a participant terminal. In addition, an operation authority is given to the presenter terminal, whereby a display screen corresponding to the content operated by the presenter on the presenter terminal is synchronously displayed on the other participant terminals. In addition, the presenter may have a right to speak (voice transmission right) to make a remark about a document or the like at a meeting. Note that the right to speak may be possessed by one user or a plurality of users. Hereinafter, when the functions common to the presenter terminal and the participant terminal are described, they will be collectively referred to as the terminal 410.

  Each terminal 410 has both a transmission function for transmitting voice data spoken by the user and a reception function for receiving the voice data. Thereby, for example, the presenter operates the material displayed on his / her terminal 410 to display it synchronously on the participant's terminal 410, speaks about the material, and outputs the spoken voice from the participant's terminal 410. Can be made.

  As shown in FIG. 64, each terminal 410a, 410b, 410c, 410d, 410e, 410f, terminal management server 420, and file management server 430 are connected via a communication network 450 such as a LAN (Local Area Network) or the Internet. Are connected to each other.

  FIG. 65 is a block diagram illustrating hardware configurations of the terminal 410, the terminal management server 420, and the file management server 430.

  The terminal 410 includes a computer including a CPU 4101, a memory 4102, a storage unit 4103, a communication unit 4104, an operation unit 4105, a display unit 4106, a voice input unit 4107, and a voice output unit 4108. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 4101 controls each unit of the terminal 410 and executes various types of information processing. The memory 4102 holds various programs and data. A work area for the CPU 4101 is also secured in the memory 4102. The storage unit 4103 stores data such as various files and documents. The communication unit 4104 performs data communication with the terminal management server 420, the file management server 430, and other terminals 410 via the communication network 450. The operation unit 4105 is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. A display unit 4106 is a display screen that displays various files, documents, and the like via application software such as a Web browser. Further, the display unit 4106 displays an operation screen for accepting a user operation in a meeting, materials used for the meeting, and the like. The voice input unit 4107 is a microphone into which a user's voice spoken at the conference is input. The audio output unit 4108 is a speaker that outputs audio data received from another terminal 410 as audio during a conference. These storage unit 4103, operation unit 4105, display unit 4106, audio input unit 4107, and audio output unit 4108 may be provided outside the terminal 410 and connected to the terminal 410 via the communication network 450.

  The terminal 410 is a terminal used by a user who attends a meeting. The terminal 410 incorporates software such as a browser and an e-mail client. The terminal 410 is, for example, a personal computer, a PDA (Personal Digital Assistant), a portable information terminal such as a smartphone, or the like. One terminal 410 may be, for example, one browser, one window in the browser, or one application.

  The terminal management server 420 includes a computer including a CPU 4201, a memory 4202, a storage unit 4203, and a communication unit 4204. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 4201 controls each unit of the terminal management server 420 and executes various types of information processing. The memory 4202 holds various programs and data. A work area of the CPU 4201 is also secured in the memory 4202. The storage unit 4203 stores data such as various files and documents. The communication unit 4204 performs data communication with the terminal 410 and the file management server 430 via the communication network 450. The storage unit 4203 may be provided outside the terminal management server 420 and connected to the terminal management server 420 via the communication network 450.

  The file management server 430 includes a computer including a CPU 4301, a memory 4302, a storage unit 4303, and a communication unit 4304. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 4301 controls each unit of the file management server 430 and executes various types of information processing. The memory 4302 holds various programs and data. A work area for the CPU 4301 is also secured in the memory 4302. The storage unit 4303 stores data such as various files and documents. The communication unit 4304 performs data communication with the terminal 410 and the terminal management server 420 via the communication network 450. The storage unit 4303 may be provided outside the file management server 430 and connected to the file management server 430 via the communication network 450.

  FIG. 66 is a functional block diagram showing a specific configuration of the electronic conference system 4100. FIG. 66 shows specific configurations of the terminal management server 420 and the file management server 430.

  The terminal management server 420 includes a reception processing unit 421, a communication connection unit 422, a notification unit 423, a transmission request reception unit 424, a reception request reception unit 425, a determination processing unit 426, and a terminal information generation unit 427. These elements are realized by the CPU 4201 executing a program stored in the memory 4202. The storage unit 4203 includes a terminal information database (terminal information DB 428) that stores terminal information.

  The program may be installed in the terminal management server 420 from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or may be downloaded via a communication network 450 such as the Internet. Alternatively, the program may be downloaded from a server stored in advance.

  Further, the program may be installed in each terminal 410. For example, when each terminal 410 is connected to the terminal management server 420, the program may be downloaded from the terminal management server 420 to the memory of each terminal 410, and the conference material data may be downloaded to the storage unit. The program and the material data may be configured by, for example, JavaScript (registered trademark). The terminal 410 on which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the terminal 410 or the terminal management server 420.

  In the electronic conference system 4100 according to the fourth embodiment, the terminal management server 420 has a program for realizing each function shown in FIG. Further, when each terminal 410 is connected to the terminal management server 420 and authenticated, for example, each terminal 410 receives data of materials used for the meeting, display contents (including synchronous display) on the display unit of the terminal 410, and the like. A display control program to be controlled and a communication path control program for controlling establishment or disconnection of a communication path for transmitting and receiving audio data are downloaded.

[Synchronous display processing]
Next, functions for realizing synchronous display processing in the electronic conference system 4100 will be described.

  The reception processing unit 421 receives (receives) various types of information (operation information, request information, etc.) corresponding to the contents operated by the user at each terminal 410 and executes processing according to the information. As an example of the operation information, there are operation contents (display of new materials, page switching of materials, etc.) by the presenter during the conference. Examples of the request information include a connection request and a disconnection request to the terminal management server 420 of the terminal 410.

  The communication connection unit 422 connects and disconnects communication with the terminal 410 in response to a connection request and a disconnection request received from the terminal 410. The communication standard used in the electronic conference system 4100 is not particularly limited, but, for example, Web Socket is suitable. Note that a method for authenticating the connection with the terminal 410 is not particularly limited, and a known technique can be applied.

  The notification unit 423 notifies each participant terminal of the presenter's operation information (presenter operation information) at the start of the conference and during the conference. The presenter operation information indicates, for example, operation contents such as display of a new material, writing to the material with a pen tool (handwriting tool), picking up (selecting) a posted comment, page switching of the material, input and movement of a mouse pointer, and the like. Information. For example, when the notification unit 423 receives presenter operation information (for example, material ID and page number information when the presenter switches the material page) from the presenter terminal, the notification unit 423 notifies the information to the participant terminal. . Upon receiving the information, the participant terminal reads the material data corresponding to the material ID and the page number from its own storage unit and displays it on the display screen.

  Here, a specific example of synchronous display in a conference will be described. Here, it is assumed that the terminal 410a is determined as the presenter terminal (operation authority is given), and the terminals 410b, 410c, 410d, 410e, and 410f are determined as the participant terminals. When the reception processing unit 421 receives the presenter operation information from the presenter terminal 410a, the notification unit 423 notifies the presenter operation information to the participant terminals 410b, 410c, 410d, 410e, and 410f. For example, the reception processing unit 421 displays a new document, writes to a document using a pen tool (handwriting tool), picks up (selects) a posted comment, switches a page of the document, inputs a mouse pointer, and the like from the presenter terminal 410a. Information indicating operation contents such as movement is received.

  FIG. 67 shows an example of display contents displayed on the display screen of the presenter terminal 410a. For example, the presenter operates the operation unit 4105 such as a mouse on the presenter terminal 410a to read the material stored in the storage unit 4103 of the presenter (an operation for displaying a new material on the material screen). In this case, the reception processing unit 421 receives presenter operation information including information indicating the document ID and the page number from the presenter terminal 410a. Also, for example, when the presenter operates the mouse on the presenter terminal 410a and inputs a mouse pointer on the material screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 displays the presenter. Presenter operation information including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like is received from the terminal 410a. For example, when the presenter operates the pen tool on the presenter terminal 410a to write characters or the like on the document screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 Presenter operation information including information indicating the written position (coordinates), written material ID, page number, and the like is received from the terminal 410a. Further, for example, when the presenter operates the mouse on the presenter terminal 410a to switch the page of the document screen (see FIG. 67) displayed on the display unit 4106, the reception processing unit 421 is for the presenter. Presenter operation information including information indicating the ID of the displayed material and the designated page number is received from the terminal 410a.

  When the reception processing unit 421 receives the presenter operation information, the notification unit 423 notifies the presenter operation information to each of the participant terminals 410b, 410c, 410d, 410e, and 410f. Upon receiving the presenter operation information, the participant terminals 410b, 410c, 410d, 410e, and 410f display a display screen corresponding to the presenter operation information on the display unit 4106. For example, the material data corresponding to the material ID and the page number is read from its own storage unit 4103 and displayed on the display unit 4106. In this way, the display contents of the display screen of the terminal 410 used by the presenter who operates the materials shared in the meeting are displayed on the display screens of the plurality of terminals 410 used by the plurality of participants participating in the meeting. Are displayed synchronously. A known technique can be applied to the synchronous display or asynchronous display method in the electronic conference system 4100. The participant terminal executes the display control program to display the display content corresponding to the presenter operation information on its own display unit. Each terminal 410 has a function as display control means.

[Communication path establishment processing]
Next, functions for realizing a communication path establishment process in the electronic conference system 4100 will be described.

  68 and 69 are functional block diagrams showing a specific configuration of the terminal 410 in the electronic conference system 4100. FIG. Hereinafter, for convenience of description, a terminal 410 (hereinafter also referred to as a transmission terminal) illustrated in FIG. 68 shows functional blocks corresponding to a transmission function, and a terminal 410 (hereinafter also referred to as a reception terminal) illustrated in FIG. The functional block corresponding to a receiving function is shown. As described above, each terminal 410 has both a transmission function (see FIG. 68) and a reception function (see FIG. 69). Further, any one of the transmission terminal 410 and the reception terminal 410 may have the operation authority, or neither of them may have the operation authority.

  As shown in FIG. 68, the transmission terminal 410 includes a transmission request transmission unit 411, a determination result acquisition unit 412, a terminal information acquisition unit 413, a communication path control unit 414, an audio transmission unit 415, and a display control unit 416. Yes. As shown in FIG. 69, the reception terminal 410 includes a reception request transmission unit 441, a determination result acquisition unit 442, a display control unit 443, and an audio reception unit 444.

  Each element included in each terminal 410 is realized by each CPU 4101 executing a program stored in each memory 4102 (see FIG. 65). The program may be installed in the terminal 410 from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or may be downloaded via a communication network 450 such as the Internet. A program corresponding to a predetermined element may be downloaded to each terminal 410 from a terminal management server 420 in which a program corresponding to each element is stored in advance.

  Each function corresponding to the program will be described. Below, it demonstrates according to the flow of a process of the electronic conference system 4100 according to progress of a meeting.

  First, in a conference, when a user desires to transmit his / her speech (voice) to another terminal 410, that is, a communication path for transmitting voice data between his / her terminal and another terminal. Is requested, the operation unit 4105 of the terminal 410 is operated to give an instruction to that effect. For example, the user A displays a “voice transmission” selection screen (for example, a check box or an electronic button) displayed on the display unit 4106 of the terminal 410 (see FIG. 68) used by the user A at a conference by using a keyboard and a mouse. Select using etc. The transmission request transmission unit 411 of the terminal 410 transmits the received user A request (hereinafter referred to as a transmission request) to the terminal management server 420. For example, when the user A removes the “voice transmission” check box or when a predetermined condition is satisfied (described later), the transmission request transmission unit 411 transmits a transmission cancellation request. For example, the transmission request transmission unit 411 transmits “+1” when transmitting a transmission request, and transmits “−1” when transmitting a release request.

  In a conference, when a user desires to receive another user's speech (voice), the user operates the operation unit 4105 of the terminal 410 to give an instruction to that effect. For example, the user B displays a “voice reception” selection screen (for example, a check box or an electronic button) displayed on the display unit 4106 of the terminal 410 (see FIG. 69) used by himself / herself in a conference by using a keyboard and a mouse. Select using etc. The reception request transmission unit 441 of the terminal 410 transmits the received user B request (hereinafter referred to as a reception request) to the terminal management server 420. For example, when the user B removes the “voice reception” check box or satisfies a predetermined condition (described later), the reception request transmission unit 441 transmits a reception cancellation request. For example, the reception request transmission unit 441 transmits “+1” when transmitting a reception request, and transmits “−1” when transmitting a release request.

  Each terminal 410 displays both “voice transmission” and “voice reception” selection screens, and each user can select each selection screen separately. For example, in the terminal 410, the user A can select both “voice transmission” and “voice reception”.

  The transmission request receiving unit 424 of the terminal management server 420 (see FIG. 66) receives the transmission request transmitted from the transmission request transmitting unit 411 of the terminal 410. For example, when a transmission request is transmitted from each of the terminals 410a and 410f, the transmission request receiving unit 424 receives the transmission request from both terminals 410a and 410f.

  The reception request reception unit 425 of the terminal management server 420 receives the reception request transmitted from the reception request transmission unit 441 of the terminal 410. For example, when a reception request is transmitted from each of the terminals 410a to 410f, the reception request receiving unit 425 receives the reception request of each of the terminals 410a to 410f.

  Based on the transmission request received by the transmission request receiving unit 424, the determination processing unit 426 of the terminal management server 420 determines whether or not the terminal 410 that transmitted the transmission request is permitted to transmit voice. Specifically, the determination processing unit 426 compares the total number of terminals 410 that have received the transmission request received by the transmission request receiving unit 424 with a preset number of terminals, and the total number is equal to or less than the set number. It is determined whether or not there is. Then, when the total number is equal to or less than the set number, the determination processing unit 426 permits voice transmission in the terminal 410 that has requested transmission, and rejects voice transmission when the total number exceeds the set number. For example, when the set number is set to “3” and the terminals 410a and 410f make a transmission request, the total number (2) is equal to or less than the set number (3), so the terminals 410a and 410f Allow voice transmission in.

  Here, the determination processing unit 426 calculates the total number of terminals 410 making a transmission request at the present time (when the determination target terminal makes a transmission request). For example, when the terminals 410a and 410f have already made a transmission request and the terminal 410b has newly made a transmission request, the total number at the present time is three. Thus, for example, when the set number is set to “2”, the terminals 410a and 410f have already made a transmission request (speech transmission may have already been performed), and the terminal 410b has newly made a transmission request. In this case, since the total number (3) exceeds the set number (2), the voice transmission of the terminal 410b that newly made a transmission request is rejected.

  As described above, the voice transmission is permitted until the set number is reached in the order in which the transmission requests are made. In addition, when the number of terminals 410 that are permitted to transmit voice reaches the set number, when any terminal 410 is released from the voice transmission (communication path), the permission of voice transmission of another terminal 410 is permitted. Can be given.

  The determination processing unit 426 transmits the determination result (permission notification, rejection notification) to the terminal 410 that transmitted the transmission request.

  Further, the determination processing unit 426 may determine whether or not the terminal 410 that has transmitted the reception request is permitted to receive a voice based on the reception request received by the reception request reception unit 425. For example, the determination processing unit 426 compares the total number of terminals 410 that have received the reception request received by the reception request reception unit 425 with a preset set number, and determines whether the total number is equal to or less than the set number. It may be determined. Further, whether or not the voice reception is permitted may be determined based on other conditions described later (Modification 1 of Embodiment 4 described later). Further, the determination processing unit 426 may permit voice reception for all reception requests received by the reception request reception unit 425. The determination processing unit 426 transmits the determination result (permission notification, rejection notification) to the terminal 410 that transmitted the reception request.

  Further, the determination processing unit 426 indicates that when the total number of terminals 410 that can make a transmission request reaches a set number, the number of transmission terminals reaches a specified value (set number), and no more transmission requests can be made. The notification (message) may be transmitted to all terminals 410 connected to the terminal management server 420. Similarly, a notification indicating that a transmission request can be made may be transmitted to all the terminals 410 when the number of units that can make a transmission request in response to a transmission release request falls below the set number. Moreover, you may transmit the notification which shows the remaining number itself until it reaches a setting number. For example, if the set number is two and if there is a transmission request from the terminal 410a, the terminal 410a is notified of transmission permission, and is the remaining number until all terminals 410 reach the set number. 1 (unit) ”and then when there is a transmission request from the terminal 410f, the terminal 410f is notified of transmission permission, and“ 0 (unit) ”is transmitted to all the terminals 410. For example, when there is a transmission cancellation request from the terminal 410a, “1 (unit)” is transmitted to all the terminals 410. Note that the determination processing unit 426 may perform the same processing as described above for a reception request.

  The terminal information generation unit 427 of the terminal management server 420 generates transmission terminal information based on the transmission request received by the transmission request reception unit 424 and the determination result in the determination processing unit 426. Specifically, when the total number is equal to or less than the set number, the terminal information generation unit 427 generates a transmission terminal list that lists terminal information of the terminals 410 that are permitted to transmit voice. For example, when the transmission request received from the terminals 410a and 410f is permitted, the terminal information generation unit 427 transmits a list of terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminals 410a and 410f. Generate a terminal list. FIG. 70 shows an example of the transmission terminal list. The terminal information generation unit 27 updates the transmission terminal list every time the received transmission request is permitted or every time the transmission request is canceled. The generated transmission terminal list is stored in the terminal information DB 428.

  Also, the terminal information generation unit 427 generates reception terminal information based on the reception request received by the reception request reception unit 425. Specifically, the terminal information generation unit 427 generates a reception terminal list that lists terminal information of the terminals 410 that permit the reception request. For example, when the reception request received from the terminals 410a to 410f is permitted, the terminal information generation unit 427 receives a list of terminal information such as the names and identification information (terminal ID, IP address, etc.) of the terminals 410a to 410f. Generate a terminal list. FIG. 71 shows an example of the receiving terminal list. The terminal information generation unit 427 updates the reception terminal list every time the received reception request is permitted or every time the reception request is canceled. FIG. 72 shows an updated receiving terminal list when a new reception request received from the terminal 410g (not shown) connected to the network is permitted in the state of FIG. The generated receiving terminal list is stored in the terminal information DB 428.

  In addition, the terminal information generation unit 427 transmits the reception terminal list to the terminal 410 for which voice transmission is permitted by the determination processing unit 426. Further, the terminal information generation unit 427 transmits the updated receiving terminal list to the terminal 410 that is permitted to transmit voice even when the receiving terminal list is updated (changed). For example, when voice transmission is permitted to the terminals 410a and 410f, the terminal information generation unit 427 transmits the reception terminal list (see FIG. 71) to the terminals 410a and 410f. Also, when the receiving terminal list is updated, the terminal information generation unit 427 transmits the updated receiving terminal list to the terminals 410a and 410f. At that time, only the changed (added) receiving terminal list may be transmitted.

  The determination result acquisition unit 412 (see FIG. 68) of the terminal 410 receives (or acquires) the determination result in the determination processing unit 426 of the terminal management server 420. For example, the determination result acquisition unit 412 of the terminals 410 a and 410 f acquires a voice transmission permission notification from the terminal management server 420.

  The terminal information acquisition unit 413 (terminal information reception unit) (see FIG. 68) of the terminal 410 acquires (or receives) the reception terminal list from the terminal information generation unit 427 of the terminal management server 420. For example, the terminal information acquisition unit 413 of the terminals 410 a and 410 f acquires the receiving terminal list shown in FIG. 71 from the terminal management server 420.

  The communication path control unit 414 (control means) (see FIG. 68) of the terminal 410 transmits audio data to and from other terminals 410 based on the receiving terminal list acquired by the terminal information acquisition unit 413 ( Establish a communication path for sending and receiving The acquired receiving terminal list is stored in the storage unit 4103. For example, the communication path control unit 414 of the terminal 410a establishes a communication path between the terminal 410a and the terminals 410b, 410c, 410d, 410e, and 410f. FIG. 73 shows a network configuration showing communication paths established between the terminal 410a and the terminals 410b, 410c, 410d, 410e, and 410f. Similarly, the communication path control unit 414 of the terminal 410f establishes a communication path between the terminal 410f and the terminals 410a, 410b, 410c, 410d, and 410e. FIG. 74 shows a network configuration showing communication paths established between the terminal 410f and the terminals 410a, 410b, 410c, 410d, and 410e. FIG. 75 shows a network configuration showing all communication paths established in the above example. 73 to 75, the direction of the arrow indicates the transmission direction of the audio data. 73 to 75 show a configuration in which voice data is transmitted and received without going through the terminal management server 420. However, the network configuration is not limited to this, and voice data is transmitted and received by using the terminal management server 420 as a repeater. It may be configured to.

  The communication path is established, for example, based on the IP address and port number of the receiving terminal information from the terminal that transmits voice (transmitting terminal) to the terminal that receives voice (receiving terminal). For example, when the user A removes the “voice transmission” check box displayed on the display unit 4106 of the terminal 410a, the communication channel control unit 414 cancels the established communication channel.

  When the communication path control unit 414 establishes the communication path, the voice transmission unit 415 (see FIG. 68) of the terminal 410 transmits the voice data input to the voice input unit 4107 to each terminal 410 via the communication path. Send (deliver) to. For example, the voice transmission unit 415 transmits voice data corresponding to the speech (voice) of the user A input to the voice input unit 4107 of the terminal 410a via the communication path (single line in FIG. 75) to the terminals 410b, 410c, 410d, 410e, 410f, voice data corresponding to the speech (voice) of the user F input to the voice input unit 4107 of the terminal 410f is transmitted to the terminals 410a, 410a, 210c via the communication path (double line in FIG. 75). 410b, 410c, 410d, 410e. Thereby, the utterances (voice data) of the user A and the user F can be transmitted to the other terminals 410 at the same timing, for example. Note that the audio transmission unit 415 may perform stream transmission (streaming) or an audio data file to each terminal 410. In addition, when a Web browser is incorporated in both the transmission terminal and the reception terminal, the audio stream of the transmission terminal may be connected to the reception terminal using WebRTC (Web Real-Time Communication).

  The display control unit 416 (see FIG. 68) of the terminal 410 causes the display unit 4106 to display the display content corresponding to the determination result acquired by the determination result acquisition unit 412. For example, if the determination result acquisition unit 412 acquires a voice transmission permission notification from the terminal management server 420, the display control unit 416 causes the display unit 4106 to display a message indicating that voice transmission is permitted. When the determination result acquisition unit 412 acquires a voice transmission rejection notification from the terminal management server 420, the display control unit 416 causes the display unit 4106 to display an error message indicating voice transmission rejection and display the display unit. The “voice transmission” selection screen (check box or electronic button) displayed in 4106 is changed so that it cannot be selected. For example, an electronic button for selecting voice transmission (transmission request) is grayed out (inactivated) so that it cannot be selected (pressed), or the display unit 4106 indicates that “current transmission request cannot be made”. May be displayed. As described above, the display control unit 416 may control the display content of the display unit 4106 so that the user cannot perform new voice transmission (transmission request).

  The determination result acquisition unit 442 (see FIG. 69) of the terminal 410 receives (or acquires) the determination result in the determination processing unit 426 of the terminal management server 420. For example, the determination result acquisition unit 442 of the terminals 410 a to 410 f acquires a voice reception permission notification from the terminal management server 420.

  When the determination result acquisition unit 442 acquires the permission notification, the display control unit 443 (see FIG. 69) of the terminal 410 causes the display unit 4106 to display a message indicating that voice reception is permitted. When the determination result acquisition unit 442 acquires a voice reception rejection notification from the terminal management server 420, the display control unit 443 displays an error message indicating voice reception rejection on the display unit 4106, and displays the display unit. The “voice reception” selection screen (check box or electronic button) displayed in 4106 is changed so that it cannot be selected.

  The audio receiving unit 444 (see FIG. 69) of the terminal 410 receives audio data transmitted via the communication path. The audio output unit 4108 converts the received audio data and outputs audio. For example, each of the voice receiving units 444 of the terminals 410b, 410c, 410d, 410e, and 410f has a voice corresponding to the speech (voice) of the user A transmitted from the terminal 410a via the communication path (single line in FIG. 75). Receiving data, each audio output unit 4108 outputs audio. In addition, each of the voice reception units 444 of the terminals 410a, 410b, 410c, 410d, and 410e corresponds to the speech (voice) of the user F transmitted from the terminal 410f via the communication path (double line in FIG. 75). Audio data is received, and each audio output unit 4108 outputs audio. Thereby, for example, the user B, the user C, the user D, and the user E of the terminals 410b, 410c, 410d, and 410e can hear the speech of the user A and the speech of the user F at the same timing.

  Next, the flow of communication path establishment processing in the electronic conference system 4100 will be described using a flowchart. FIG. 76 shows a flowchart when the terminal management server 420 receives a transmission request from the terminal 410. For example, this process is executed when the terminal management server 420 notifies a plurality of terminals 410 connected to the terminal management server 420 via a network when the terminal management server 420 starts the meeting. The same applies to the processing of FIGS. 77 and 78 described later.

  First, when a transmission request is transmitted from the terminal 410, the transmission request receiving unit 424 receives the transmission request (S4101). Next, the determination processing unit 426 compares the total number of terminals 410 that have made a transmission request with a preset set number, and determines whether the total number is equal to or less than the set number (S4102).

  When the total number is equal to or less than the set number, the determination processing unit 426 transmits a voice transmission permission notification to the terminal 410 that has requested transmission, and the terminal information generation unit 427 includes a transmission terminal list (FIG. 70). Reference) is generated (S4103). Subsequently, the terminal information generation unit 427 transmits a receiving terminal list that lists information of terminals that have made a reception request to the terminal 410 registered in the transmitting terminal list (S4104).

  In the process of S4102, if the total number exceeds the set number, the determination processing unit 426 transmits a voice transmission rejection notification to the terminal 410 that has transmitted the transmission request (S4105). The processes from S4101 to S4105 are repeated until the conference ends (S4106).

  FIG. 77 shows a flowchart when the terminal management server 420 receives a reception request from the terminal 410.

  First, when a reception request is transmitted from the terminal 410, the reception request reception unit 425 receives the reception request (S4201). Next, the terminal information generation unit 427 generates or updates the receiving terminal list (see FIG. 71) (S4202). Next, the terminal information generation unit 427 transmits a voice reception permission notification to the terminal 410 registered in the receiving terminal list (S4203). Note that, here, a case where voice reception is permitted for all reception requests received by the reception request receiving unit 425 is shown, but the determination processing unit 426 receives voice only when the number is less than or equal to a preset number. In the case of refusal, the voice reception refusal notification may be transmitted to the terminal 410. Next, the terminal information generation unit 427 acquires the transmission terminal list, and transmits the reception terminal list for each of the terminals 410 registered in the transmission terminal list (S4204). When the receiving terminal list is changed (updated), only the receiving terminal list that has been changed (added) may be transmitted. The processing from S4201 to S4204 is repeated until the conference ends (S4205).

  FIG. 78 shows a flowchart of processing (communication channel establishment processing) in terminal 410 when a user makes a transmission request in terminal 410.

  First, in the conference, the terminal 410 receives a transmission request from the user (S4301). Next, the transmission request transmission unit 411 transmits the received transmission request to the terminal management server 420 (S4302). When receiving the transmission request, the terminal management server 420 executes the processing from S4101 to S4105 shown in FIG.

  Next, the determination result acquisition unit 412 of the terminal 410 acquires a transmission permission notification or a transmission rejection notification from the terminal management server 420 (S4303). When the transmission permission notification is acquired, the terminal information acquisition unit 413 acquires a reception terminal list from the terminal management server 420 (S4304).

  Next, the communication path control unit 414 acquires terminal information (terminal ID) of any one terminal 410 from the receiving terminal list (S4305). Next, the communication path control unit 414 establishes a communication path for transmitting voice data to the terminal 410 corresponding to the acquired terminal information (S4306). The communication path control unit 414 executes processing for establishing a communication path for all the terminals 410 registered in the receiving terminal list (S4307).

  Next, the audio transmission unit 415 transmits the audio data to each terminal 410 via the established communication path (S4308).

  In the process of S4303, when the determination result acquisition unit 412 acquires a transmission rejection notification from the terminal management server 420, the display control unit 416 of the terminal 410 displays an error message on the display unit 4106 (S4309). The processing from S4301 to S4309 is repeated until the conference ends (S4310).

  As described above, the electronic conference system 4100 according to the fourth embodiment sets an upper limit on the number of transmitting terminals to which a right to speak (transmits voice) is set, and moves terminals that permit transmission according to user instructions. In other words, a communication path is established between a terminal permitted to transmit and another terminal. Thereby, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, each user can make a selection according to his / her intention, such as when he / she wants to send a speech (voice) or receives a voice, and is reflected in the intention of the user between terminals on the network. A communication path is dynamically changed and established.

  Further, according to the electronic conference system 4100, the communication of audio data is controlled independently of the sharing state (synchronous, asynchronous) of the material (display contents). That is, it is possible to separately control the material and the sound between a plurality of terminals. For this reason, for example, during a conference, a communication channel network for transmitting and receiving audio data is constructed as shown in FIG. 75, and the user A of the terminal 410a is a presenter who performs operations related to display contents. The user A can also make a statement (for example, explanation for the table contents) while performing the above operation. As a result, each of the users B to F of the other terminals 410b, 410c, 410d, 410e, and 410f confirms the display screen according to the operation content on the terminal 410a on the display screen of their own terminal, The user's A statement (explanation) output from the audio output unit 4108 can be heard.

  In the configuration described above, for example, the presenter's user A synchronously displays the material X displayed on the display unit 4106 of the terminal 410a on the display units 4106 of the terminals 410b to 410f of the participant users B to F. In this configuration, the voice spoken by the user A is output from the terminals 410b to 410f. Further, when the user A performs an operation on the material X, for example, an operation such as writing to the material X with a pen tool, picking up a posted comment, switching the page of the material X, inputting or moving the mouse pointer to the material X The content corresponding to the operation is displayed in synchronization with the display unit 4106 of the terminals 410b to 410f.

  The electronic conference system 4100 according to the fourth embodiment has a function of controlling voice communication (communication path) of each terminal based on the access right of each user to the material in addition to the function of realizing the above configuration. For example, in the above configuration, when the user A changes the material X to another material Y (displays a new material), the access right to the material Y of the users B to F is determined, and the terminal of the user who does not have the access right , Cancel the synchronization status, or disconnect the voice communication.

  Hereinafter, an access control process in the electronic conference system 4100 corresponding to the above function will be described.

[Access control processing]
The electronic conference system 4100 according to the fourth embodiment further includes a file management server 430 as a configuration for realizing the access control process. The file management server 430 has a function of managing materials (files) used for the conference and restricting access of the user (terminal) to the materials. Then, the electronic conference system 4100 controls the synchronization / asynchronization of the material and the voice communication based on the access restriction status of the material in the file management server 430.

  As shown in FIG. 66, the file management server 430 includes a reception processing unit 431, an access determination processing unit 432, and a file transmission unit 433. These elements are realized by the CPU 4301 executing a program stored in the memory 4302 (see FIG. 65). The storage unit 4303 has a file database (file DB 434) for storing various materials (files) used in the conference, and an access restriction information database (access restriction information DB 435) associated with user access restriction information for each material. It is included.

  The program may be installed in the file management server 430 from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or may be downloaded via a communication network 450 such as the Internet. Alternatively, the program may be downloaded from a server stored in advance.

  Further, the program may be installed in each terminal 410. For example, when each terminal 410 is connected to the file management server 430, the program may be downloaded from the file management server 430 to the memory of each terminal 410, and the conference material data may be downloaded to the storage unit. The program and the material data may be configured by, for example, JavaScript (registered trademark). The terminal 410 on which the program is downloaded or recorded functions as an information processing apparatus. Further, the computer on which the program is downloaded may be the terminal 410 or the file management server 430. In the electronic conference system 4100 according to the fourth embodiment, the file management server 430 has a program for realizing each function shown in FIG.

  The reception processing unit 431 receives (receives) an acquisition request for the material stored in the file DB 434 from each terminal 410 and executes a process according to the acquisition request. For example, when the presenter user A selects the material Y on the terminal 410a, the reception processing unit 431 receives the acquisition request for the material Y from the terminal 410a. Further, when the user B of the participant selects the material Y at the terminal 410b, the reception processing unit 431 receives an acquisition request for the material Y from the terminal 410b. User identification information (ID, password, etc.) may be associated with the acquisition request.

  The access determination processing unit 432 (determination means) refers to the access restriction information DB 435 based on the acquisition request acquired by the reception processing unit 431, and determines whether or not to access the material corresponding to the acquisition request (presence of access right). judge. In the access restriction information DB 435, a plurality of materials, a user who can access each material, and identification information (terminal ID) of a terminal used by the user are associated and registered. FIG. 79 is a table showing an example of the access restriction information DB 435. In the example of FIG. 79, for materials X, users A, B, C, D, E, and F have access rights, and for materials Y, users A, B, D, E, and F have access rights. For material Z, users A, B, C, D, and E have access rights. The access determination processing unit 432 transmits the determination result to the terminal management server 420. The presence or absence of each user's access right to each material is registered in advance by an administrator or the like and updated as appropriate. Note that the terminal identification information may not be registered in advance in the access restriction information DB 435. The terminal identification information may be acquired, for example, by specifying the transmission source terminal when the acquisition request is received.

  The reception processing unit 431 (or the reception processing unit 421 of the server 20) has a function (user specifying unit) that specifies a user who uses the terminal 410 connected to the communication network 450, and the access determination processing unit 432. May determine whether or not there is an access right to the material corresponding to the acquisition request for all the specified users.

  The file transmission unit 433 transmits the material to the user terminal 410 having an access right to the material corresponding to the acquisition request.

  The terminal management server 420 executes the following processing. That is, the reception processing unit 421 receives from the terminal 410 used by the presenter a notification (change notification) that the material used for the meeting has been changed, and receives information related to the received change notification (related to the new material). Access information, etc.) is transmitted to each terminal 410 used by the participant. Further, the reception processing unit 421 receives the determination result from the file management server 430. The terminal information generation unit 427 updates the receiving terminal list based on the determination result, and transmits the receiving terminal list to the terminal 410 that is permitted to transmit voice.

  Upon receiving the updated receiving terminal list, the terminal 410 that performs voice transmission executes a process (described later) for reestablishing the communication path based on the receiving terminal list.

  Next, the flow of access control processing in the electronic conference system 4100 will be described with reference to the flowcharts of FIGS. Here, an operation in a case where the user A who is the presenter selects another material Y on the terminal 410a during the meeting (when the material X is synchronously displayed) will be described. Further, it is assumed that the network shown in FIG. 75 corresponding to the receiving terminal list of FIG. That is, the terminal 410a transmits the voice of the user A to the other terminals 410b, 410c, 410d, 410e, and 410f, and the user B to the user F (participants) of the other terminals 410b, 410c, 410d, 410e, and 410f It is assumed that the user A can hear the voice of the user A output from the voice output unit 4108 of each terminal while checking the document X on the display screen of each terminal.

  First, in the above situation (during a meeting), the user A selects the material Y on the terminal 410a (S441). Then, the reception processing unit 431 of the file management server 430 receives the acquisition request for the material Y from the terminal 410a (S442). The reception processing unit 421 of the terminal management server 420 may receive the acquisition request from the terminal 410a, and the reception processing unit 421 may transfer the acquisition request to the file management server 430. When the file management server 430 receives the acquisition request, the file transmission unit 433 transmits the material Y to the terminal 410a (S443).

  When the terminal 410a receives the material Y (S444), the terminal 410a transmits a notification (change notification) indicating that the material has been changed to the terminal management server 420 (S445). Here, the change notification includes access information of the material Y (for example, a storage destination URL of the material Y). When receiving the change notification, the reception processing unit 421 of the terminal management server 420 transmits the access information of the material Y to each terminal 410b, 410c, 410d, 410e, 410f (S446).

  When each terminal 410b, 410c, 410d, 410e, 410f receives the access information of the material Y (S447), a message that the material has been changed from the material X to the material Y and an access information ( Display destination URL of document Y). The users B, C, D, E, and F of the terminals 410b, 410c, 410d, 410e, and 410f select the material Y (the storage destination URL of the material Y) at their own terminals (S448). Then, the reception processing unit 431 of the file management server 430 receives an acquisition request for the material Y from each terminal 410b, 410c, 410d, 410e, 410f (S449).

  Next, the access determination processing unit 432 of the file management server 430 determines the presence / absence of each user's access right to the material Y based on the acquisition request with reference to the access restriction information DB 435 (see FIG. 79) ( S450). For example, for material Y, users A, B, D, E, and F have access rights, but user C does not have access rights. Therefore, the access determination processing unit 432 determines that the users B, D, E, and F have “access right” in response to the acquisition request for the material Y received from the terminals 410b, 410c, 410d, 410e, and 410f. C determines “no access right”. The access determination processing unit 432 transmits the determination result to the terminal management server 420 (S450).

  Further, the file transmission unit 433 transmits the material Y to the terminals 410b, 410d, 410e, and 410f used by the users B, D, E, and F that are determined to have “access right” (S451). Each terminal 410b, 410d, 410e, 410f receives the material Y (S452), and stores the received material Y in each storage unit 4103. Thereafter, each of the terminals 410b, 410d, 410e, and 410f receives presenter operation information corresponding to the operation content of the user A at the terminal 410a from the terminal management server 420, and synchronous display for the material Y is performed.

  On the other hand, when the terminal management server 420 receives the determination result from the access determination processing unit 432 (S453), the terminal information generation unit 427 updates the receiving terminal list (see FIG. 71) (S454). Specifically, the terminal information generation unit 427 excludes terminals used by users who do not have access rights from the receiving terminal list. Here, the terminal information generation unit 427 updates the receiving terminal list shown in FIG. 82, excluding the terminal 410c. The terminal information generation unit 427 transmits the updated receiving terminal list to the terminal 410a that performs voice transmission (S455).

  Next, when the terminal 410a receives the above-described receiving terminal list (see FIG. 82) (S456), the communication path control unit 414 receives the receiving terminal list before updating (see FIG. 71) and the receiving terminal list after updating (see FIG. 71). 82), a terminal that is not registered in the updated receiving terminal list (excluded terminal) is specified (S457). Here, the communication path control unit 414 identifies the terminal 410c. Next, the communication path control unit 414 disconnects the communication path established between the terminal 410a and the identified terminal (S458). Here, the communication path control unit 414 disconnects the communication path between the terminal 410a and the terminal 410c. In this way, the terminal 410a executes communication path re-establishment. Thereby, the network of the communication path shown in FIG. 75 is updated (reconstructed) to the network shown in FIG. In FIG. 83, “X” shown on the display unit 4106 of the terminal 410c indicates that the material Y is not displayed synchronously.

  Although the above processing shows only the reestablishment of the communication path in the terminal 410a, the reestablishment of the communication path may be performed in all terminals that are permitted to transmit voice. Here, the terminal 410f may also re-establish the communication path. Thereby, the communication path between the terminal 410f and the terminal 410c is also disconnected. Therefore, in this case, the network of the communication path shown in FIG. 75 is updated (reconstructed) to the network shown in FIG.

  According to the above-described configuration of the electronic conference system 4100, when a document is changed during a conference, the synchronous display of the document and the transmission of audio are stopped for a user who does not have access rights to the changed document. Therefore, it is possible to maintain confidentiality and security in materials and meetings.

  As another example, when a user A who is a presenter selects another document Z at the terminal 410a during a meeting (the document X is being displayed synchronously), the user F is determined as “no access right” ( (See FIG. 16). In this case, the communication path between terminal 410a and terminal 410f and the communication path from terminal 410f to each terminal are disconnected, and the communication path for voice transmission is updated (reconstructed) to the network shown in FIG.

  Here, in the above configuration (see FIG. 84), for example, for the terminal 410c used by a user who does not have access rights to the material Y, both the transmission of the material Y and the transmission of sound are prohibited. The configuration of the electronic conference system 4100 is not limited to this. For example, in the above example, the electronic conference system 4100 may be configured to permit the transmission of the material Y and prohibit only the transmission of audio, or to permit the transmission of audio and prohibit only the transmission of the material Y. Also good. Thereby, the convenience and efficiency of a meeting can be improved.

4-2. Modification 4 of embodiment 4-2-1. Modification 1 of Embodiment 4
The access control processing in the electronic conference system 4100 is not limited to the above configuration, and the following configuration may be used.

  First, during the meeting (similar to the above situation), the user A selects the material Y at the terminal 410a. Then, the reception processing unit 421 of the terminal management server 420 receives an acquisition request for the material Y from the terminal 410a. Next, the terminal management server 420 acquires the material Y from the file management server 430 based on whether or not the user has access rights to the material Y. If the user A has access rights to the material Y, the terminal management server 420 acquires the material Y and transmits it to the terminal 410a used by the user A. In addition, the terminal management server 420 transmits a notification (change notification) indicating that the material has been changed to each terminal 410b, 410c, 410d, 410e, 410f.

  Next, the terminal 410a disconnects all communication paths for voice transmission, and transmits a voice transmission request to the terminal management server 420 again. In addition, when each of the terminals 410b, 410c, 410d, 410e, and 410f receives the change notification, the terminals 410b, 410c, 410d, 410e, and 410f transmit an acquisition request for the material Y based on each user's operation (selection of the material Y). Note that a terminal that is permitted to transmit voice among the participants' terminals 410 disconnects all communication paths for voice transmission and transmits a voice transmission request to the terminal management server 420 again, similarly to the terminal 410a.

  Next, the terminal management server 420 acquires the material Y from the file management server 430 based on whether or not each user B, C, D, E, F has access rights to the material Y. The terminal management server 420 attempts to acquire the material Y for each of the terminals 410b, 410c, 410d, 410e, and 410f used by the users B, C, D, E, and F. The terminal management server 420 transmits the material Y to the terminal 410 of the user having the access right who has successfully acquired the material Y. Further, the terminal management server 420 does not transmit the material Y to the user's terminal 410 that has failed to acquire the material Y and does not have the access right, and disconnects the voice transmission communication path. Here, since the user C does not have the access right to the material Y, the terminal management server 420 disconnects the communication path for the terminal 410c used by the user C (see FIG. 84).

4-2-2. Variation 2 of Embodiment 4
The access control process in the electronic conference system 4100 may have the following configuration.

  First, during the meeting (similar to the above situation), the user A selects the material Y at the terminal 410a. Then, the reception processing unit 421 of the terminal management server 420 receives an acquisition request for the material Y from the terminal 410a. Next, the terminal management server 420 acquires the material Y from the file management server 430 based on whether or not the user A has an access right to the material Y. If the terminal management server 420 has the access right to the material Y of the user A, the terminal management server 420 acquires the material Y and transmits it to the user A terminal 410a. In addition, the terminal management server 420 sends a notification that the document has been changed (change notification) and a notification that the communication path for voice transmission has been disconnected (disconnection request) to each terminal 410b, 410c, 410d, 410e, 410f. Send to.

  Next, each terminal 410b, 410c, 410d, 410e, 410f disconnects its own communication path upon receiving the disconnection request. In addition, when each of the terminals 410b, 410c, 410d, 410e, and 410f receives the change notification, the terminals 410b, 410c, 410d, 410e, and 410f transmit an acquisition request for the material Y based on each user's operation (selection of the material Y).

  Next, the terminal management server 420 acquires the material Y from the file management server 430 based on whether or not each user B, C, D, E, F has access rights to the material Y. The terminal management server 420 attempts to acquire the material Y for each of the terminals 410b, 410c, 410d, 410e, and 410f used by the users B, C, D, E, and F. The terminal management server 420 transmits the material Y to the terminal 410 of the user having the access right who has successfully acquired the material Y. The terminal 410 that has received the material Y receives whether the user desires “voice transmission” or “voice reception” from the user. After receiving either one, the above-described communication path establishment processing (see FIGS. 76 to 78) is executed.

  Further, the terminal management server 420 does not transmit the material Y to the user's terminal 410 that has failed to acquire the material Y and has no access right, and the communication path is not re-established.

4-2-3. Modification 3 of Embodiment 4
The access control process in the electronic conference system 4100 may have the following configuration. That is, in the flowchart of FIG. 81, when the terminal information generation unit 427 updates the receiving terminal list (see FIG. 71) (S454), the terminal management server 420 determines that the terminal 410a and terminals excluded from the receiving terminal list (access rights) The communication path between the terminal and the terminal used by the user who does not have the terminal may be disconnected. As described above, the terminal management server 420 may include a function as a communication path control unit and execute processing for establishing and disconnecting a communication path between the terminals.

4-2-4. Modification 4 of Embodiment 4
The access control process in the electronic conference system 4100 may have the following configuration. That is, in the flowchart of FIG. 80, after the terminal 410 receives the access information of the material Y (S447), the user selects the material Y (the storage destination URL of the material Y) (S448) at the terminal 410 of the user. When the acquisition of Y is attempted and the document Y cannot be acquired because of no access right, the terminal 410 notifies the terminal management server 420 that the acquisition of the document Y has failed (acquisition failure notification). When the terminal management server 420 receives the acquisition failure notification, the terminal information generation unit 427 updates the reception terminal list. For example, the terminal information generation unit 427 excludes the terminal 410c that has transmitted the acquisition failure notification from the reception terminal list.

4-2-5. Modification 5 of Embodiment 4
As described above, the terminal management server 420 and the file management server 430 may be included in one information processing apparatus. For example, the terminal management server 420 may include the file management server 430. 86 and 87 are flowcharts showing the operation of access control processing in the electronic conference system 4100 according to the fifth modification of the fourth embodiment. The same operations as those in the flowcharts shown in FIGS. 80 and 81 are denoted by the same step numbers.

  In the electronic conference system 4100 according to the fifth modification of the fourth embodiment, in the terminal management server 420, when the reception processing unit 431 receives an acquisition request for the material Y from each terminal 410b, 410c, 410d, 410e, 410f (S449). The access determination processing unit 432 determines whether or not each user has an access right to the material Y based on the acquisition request (S450). Next, the terminal information generation unit 427 updates the receiving terminal list (see FIG. 71) (S454), and the file transmission unit 433 transmits the material Y to the terminal 410 registered in the updated receiving terminal list ( S451). Here, the file transmission unit 433 transmits the material Y to the terminals 410b, 410d, 410e, and 410f excluding the terminal 410c. In the subsequent synchronous display process, the notification unit 423 of the terminal management server 420 notifies the presenter operation information only to the terminals registered in the receiving terminal list.

4-2-6. Modification 6 of Embodiment 4
The configuration for transmitting and receiving audio in the electronic conference system 4100 is not limited to the above configuration, and various configurations can be employed. Below, the electronic conference system 4100 which concerns on the modification 6 of Embodiment 4 is demonstrated centering on difference with the said structure. In the electronic conference system 4100 according to Modification 6 of Embodiment 4 below, description of elements having the same functions as those of the electronic conference system 4100 will be omitted.

  In the electronic conference system 4100 according to the sixth modification of the fourth embodiment, the terminal management server 420 may further include a current location acquisition unit 429 that acquires the current location of each terminal 410. FIG. 88 is a functional block diagram illustrating a specific configuration of the terminal management server 420 according to the sixth modification of the fourth embodiment.

  The current location acquisition unit 429 receives, for example, a detection value of a position detection unit (not shown) (for example, GPS) provided in each terminal 410, and acquires the current location (address location, etc.) of each terminal 410. . The current location acquisition unit 429 may acquire the current location of each terminal 410 by setting the IP address, the subnet of the network, and the location information in advance, and acquiring the IP address of each terminal 410.

  Based on the reception request received by the reception request reception unit 425 and the current location of each terminal 410 acquired by the current location acquisition unit 429, the determination processing unit 426 determines whether or not the terminal 410 that transmitted the reception request has received the voice. Determine.

  The terminal information generation unit 427 generates reception terminal information based on the reception request received by the reception request reception unit 425 and the determination result of the determination processing unit 426. Specifically, the terminal information generation unit 427 generates a reception terminal list that lists information of the terminals 410 permitted by the determination processing unit 426 among the terminals 410 that have made a reception request. The terminal information generation unit 427 transmits the reception terminal list to the terminal 410 for which voice transmission is permitted by the determination processing unit 426. As described above, the terminal information generation unit 427 updates the receiving terminal list based on the determination result of the access determination processing unit 432 (see FIG. 66) that determines permission / inhibition of access to materials (presence of access right). .

  Hereinafter, a specific example will be described. 89, the terminals 410a, 410b, and 410c are provided in the same conference room 4101, the terminal 410d is provided in the ground P41 remote from the conference room 4101, and the terminal 410e is provided in the ground P42 remote from the conference room 4101. The network configuration in the case where the terminal 410f is provided in the ground P43 remote from the conference room 4101 is shown.

  In the network configuration of FIG. 89, it is assumed that the terminals 410a and 410f transmit a transmission request and the terminals 410a to 410f transmit a reception request. The terminals 410a and 410f are permitted to transmit voice because the total number (two) of transmission requests is equal to or less than the set number (three).

  The current location acquisition unit 429 acquires the current location from each of the terminals 410a to 410f. That is, the current location acquisition unit 429 acquires “conference room 4101” as the current location of the terminals 410a, 410b, and 410c, acquires “remote location P1” as the current location of the terminal 410d, and “remote location P2” as the current location of the terminal 410e. And “remote location P3” is obtained as the current location of the terminal 410f.

  The determination processing unit 426 determines whether or not the current location of each terminal 410 is the same or a location (predetermined location) within a preset range, and if a plurality of terminals 410 exist at the predetermined location, One of the terminals 410 is allowed to receive voice, and the other terminals 410 are refused to receive voice. In the network configuration of FIG. 89, among the terminals 410a, 410b, and 410c existing in a predetermined place (conference room 4101), the terminal 410a is allowed to receive voice and the terminals 410b and 410c are not allowed to receive voice. The determination processing unit 426 transmits the determination result (permission notification, rejection notification) to the terminal that transmitted the reception request.

  The terminal information generation unit 427 generates a reception terminal list shown in FIG. 90 based on the determination result, and transmits it to the terminals 410a and 410f. The terminals 410a and 410f establish a communication path based on the acquired receiving terminal list. FIG. 91 shows a network configuration showing a communication path established in the electronic conference system 4100 according to the sixth modification of the fourth embodiment.

  When a plurality of terminals 410 are present at a predetermined location and a transmission request is made at a plurality of terminals 410 among them, the determination processing unit 426 selects one of the plurality of terminals 410 that has made the transmission request. Voice transmission may be permitted for one terminal 410 and voice transmission for other terminals 410 may be rejected. For example, when a transmission request is made in the terminals 410a, 410b, and 410c existing in the conference room 4101, the voice transmission of the terminal 410a is permitted and the voice transmission of the terminals 410b and 410c is rejected. The terminal information generation unit 427 transmits the reception terminal list to the terminal 410a that has permitted voice transmission, and the terminal 410a establishes a communication path based on the acquired reception terminal list.

  In a conference with the above-described network configuration, a plurality of users (for example, users B and C) of a plurality of terminals 410 existing in the same conference room can directly listen to the content of one user (for example, user A). Then, the terminal 410 (for example, the terminal 410a) of the plurality of terminals 410 receives and outputs the utterance content of other users (for example, the users D, E, and F) at remote locations. it can. Therefore, according to the electronic conference system 4100 which concerns on the modification 6 of Embodiment 4, the number of required communication paths can be reduced.

4-2-7. Modification 7 of Embodiment 4
In the electronic conference system 4100 according to the seventh modification of the fourth embodiment, the set number may be dynamically changed. Specifically, the set number may be set according to the number of all terminals 410 connected via the communication network 450. For example, the set number can be reduced as the number of terminals 410 increases. This configuration is suitable for an electronic conference such as a seminar in which a speaker (presenter) is determined. Alternatively, the set number may be calculated and set based on the ratio to the number of all terminals 410 connected via the network. Furthermore, the set number may be set according to the number of terminals 410 that have requested reception.

4-2-8. Modification 8 of Embodiment 4
In the electronic conference system 4100 according to the modified example 8 of the fourth embodiment, after the communication path is established, when the time when the voice data is not transmitted from the terminal 410 that is permitted to transmit the voice reaches the preset time. The communication path control unit 414 (see FIG. 68) may cancel the communication path corresponding to the terminal 410. For example, when the user A who is permitted to transmit voice does not speak for a certain period of time, the communication path control unit 414 forcibly releases the communication path established in the user A's terminal 410a. In the above configuration, the user who uses the transmission terminal may be photographed by a camera, and the photographed image may be analyzed to measure the presence / absence of the user's speech and the duration of the silent state. The camera may be built in the terminal 410 or may be installed outside (for example, a conference room).

4-2-9. Modification 9 of Embodiment 4
In the fourth embodiment, as shown in FIG. 78, when the transmission rejection notification is acquired, the display control unit 416 of the terminal 410 displays an error message on the display unit 4106, but the voice transmission is rejected. The configuration in this case is not limited to this.

  For example, in the electronic conference system 4100 according to the ninth modification of the fourth embodiment, when the total number of transmitting terminals has already reached the set number when the terminal 410 is connected to the terminal management server 420, check the check box. You may control so that it cannot. In addition, the check box may be controlled by acquiring information from the terminal management server 420 in accordance with the increase or decrease of the total number of transmission terminals. Acquisition of the total number of transmission terminals may be performed by polling the terminal management server 420, but preferably, the terminal management server 420 is connected to each terminal from the terminal management server 420 side by using a Web Socket or the like. Just notify.

4-2-10. Modification 10 of Embodiment 4
The electronic conference system 4100 according to the fourth embodiment may be configured not to include the communication path establishment process. That is, the terminal management server 420 in the electronic conference system 4100 has a function of synchronously displaying a part of the display screen among a plurality of terminals 410 connected via the communication network 450. Specifically, the terminal management server 420 includes a user identification unit (acceptance processing unit 421) that identifies a user who uses the terminal 410 connected to the communication network 450, and a first user (presenter) in the first terminal 410. ), The reception processing unit 421 (accepting means) that receives the material information of the material selected by () and the operation information (presenter operation information) operated on the material, and the above specification for the material of the received material information The received material information for the access determination processing unit 432 (determination means) that determines whether or not all the users have access rights and the terminal 410 used by the user who has been determined to have access rights to the materials. And a notification unit 423 (notification means) for notifying the presenter operation information. Note that the electronic conference system 4100 according to the tenth modification of the fourth embodiment may include conventional voice communication processing.

  According to the configuration of the electronic conference system 4100 according to the tenth modification of the fourth embodiment, for example, the materials that the user A of the terminal 410a synchronizes between the terminals already participating in the conference (synchronously displayed) are changed. In this case, the changed new material is displayed on the terminal of the user who has access right to the material, but the changed new material is not displayed on the terminal of the user who does not have the access right. In other words, this configuration is different from the conventional configuration that allows synchronous display of all materials after the first login to the conference and the access right is authenticated. Since it is the structure which controls synchronous / asynchronous, the confidentiality and security with respect to a material can be improved.

  Note that the electronic conference system 4100 may have the following configuration.

  The electronic conference system 4100 limits the number of people who can speak at the same time (the number of transmitting terminals) because the number of people who speak at the same time (speaker terminals) is limited even if many terminals are connected. On the other hand, the communication channel establishment state is dynamically changed while switching the transmission terminal. Thereby, it becomes possible to transmit and receive audio data between a large number of terminals in a pseudo manner.

  In addition, the electronic conference system 4100 has a configuration in which voice transmission / voice reception can be selected by each terminal, and the terminal management server 420 is notified when the voice transmission / voice reception status of each terminal changes.

  In addition, the terminal management server 420 notifies a terminal selected for voice transmission of a list of terminals selected for voice reception. At this time, it is not necessary to notify the information of the terminal whose state has not changed so far. The transmitting terminal that has received the notification calls the receiving terminal so as to receive its own stream information only to the newly registered receiving terminal (calls a connection request).

  In the electronic conference system 4100, the terminal management server 420 manages the total number of terminals that can transmit simultaneously, and when the total number reaches the upper limit (set number), the terminal cannot select a transmission request. Have

  Further, in the electronic conference system 4100, the transmission terminal includes two types, a constant transmission terminal and a temporary transmission terminal. Of these, the temporary transmission terminal can be transmitted only for a certain period of time, and after a certain period of time has elapsed, the voice is transmitted. The transmission may be canceled (the transmission request check box is canceled). The temporary transmission terminal may be configured to allow transmission only while the user is pressing the voice transmission button. The temporary transmission terminal may be configured such that the transmission request is canceled when the silent state continues for a certain period of time.

  Further, the electronic conference system 4100 may be configured such that a user who wants to speak makes a transmission request at a terminal and gives a speaking right to a user designated at a specific terminal (master terminal) (permits as a transmitting terminal).

  Embodiments 4 and 4 of each electronic conference system described above are merely examples, and the embodiments can be combined.

  The network configuration of each electronic conference system may be a configuration that does not include the terminal management server 420 (FIG. 92). The configuration shown in FIG. 92 is realized by downloading a program corresponding to each element included in the electronic conference system to each of the terminals 410a to 410f. Specifically, each electronic conference system is realized by the CPU of each terminal executing a program stored in the memory of each terminal 410a to 410f. Note that the downloaded program may be constituted by, for example, JavaScript (registered trademark). Further, the terminal 410 on which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the terminal 410 or the terminal management server 420.

  The electronic conference system 4100 is not limited to audio data transmission / reception. That is, the electronic conference system 4100 can be applied to transmission / reception of media data including at least one of audio data and video data (moving image data). Each electronic conference system can be applied to various electronic conferences such as a video conference and a telephone conference. In a video conference, video captured by a camera mounted on each terminal is bidirectionally communicated between the terminals via the communication path. Each electronic conference system can also be applied to a remote conference where conference attendees are remote from each other.

  In the above description, an electronic conference system is taken as an example of an information processing system. However, the information processing system is not limited to an electronic conference system, and various types of media data can be shared between terminals connected to a network. Includes systems.

4-3. Effects of Embodiment 4 A program according to Embodiment 4 of the present invention displays materials used in a conference in synchronization between a plurality of terminals connected via a network, and at least one of audio data and video data. A program for causing a computer to transmit / receive media data including the above-described media data based on presence / absence of an access right of each of a plurality of users to the material selected by the first user in the first terminal. A computer is caused to function as a control unit that controls display contents on each of a plurality of terminals used by each user and controls transmission and reception of the media data between the first terminal and each of the plurality of terminals. And According to this configuration, the material and audio are controlled separately and synchronized between a plurality of terminals, and the confidentiality of the conference is maintained.

  In the program according to Embodiment 4 of the present invention, when the second user does not have access rights to the material, the control means displays the material on the display screen of the second terminal used by the second user. In addition, transmission and reception of the media data between the first terminal and the second terminal may be prohibited. According to this configuration, no material is displayed on the display screen of the second terminal, and transmission / reception of media data between the first terminal and the second terminal is prohibited.

  In the program according to the fourth embodiment of the present invention, the control means further allows the third user to display the material displayed on the display screen of the first terminal when the third user has an access right to the material. The media data may be transmitted and received between the first terminal and the third terminal while being displayed in synchronization with the display screen of the third terminal to be used. According to this configuration, the material displayed on the display screen of the first terminal is displayed in synchronization with the display screen of the third terminal, and media data is transmitted and received between the first terminal and the third terminal.

  In the program according to Embodiment 4 of the present invention, the computer further stores in advance a plurality of materials used in a meeting and the presence or absence of access rights of the plurality of users for each of the plurality of materials in association with each other. And determining means for determining whether or not each of the plurality of users associated with the material selected by the first user has the access right, wherein the control means determines the determination means Based on the result, the display contents on each of the plurality of terminals used by the plurality of users are controlled, and transmission / reception of the media data between the first terminal and each of the plurality of terminals is controlled. May be. According to this configuration, the display content is controlled based on the determination result regarding the presence or absence of the access right, and transmission / reception of media data is controlled.

  In the program according to the fourth embodiment of the present invention, the first material is synchronously displayed between the plurality of terminals, and the media data is transmitted / received via a communication path established between the plurality of terminals. When the first user selects and displays a second material different from the first material on the first terminal, the control means includes the first terminal and the second material. The communication path established with the terminal used by a user who does not have access right to the terminal may be disconnected. According to this configuration, when the first user selects and displays the second material on the first terminal, the communication path between the first terminal and a terminal that does not have access rights to the second material is disconnected. The

  In the program according to Embodiment 4 of the present invention, the control means further causes the second material to be displayed synchronously on the display screen of the terminal used by a user having access rights to the second material, The second material may not be displayed on the display screen of the terminal used by a user who does not have access rights to the second material. According to this configuration, the second material is displayed synchronously on the display screen of the terminal having the access right to the second material, while the second material is displayed on the display screen of the terminal not having the access right to the second material. Not.

  In the program according to the fourth embodiment of the present invention, the computer further includes a transmission request receiving means for receiving a transmission request for the media data from at least one terminal, and a reception request for the media data from at least one terminal. When the total number of the reception request receiving means for receiving and the terminal that has made the transmission request is equal to or less than a predetermined set number, the reception request is made with the terminal that has made the transmission request. You may make it function as a communication path establishment means to establish the communication path for transmitting the media data between at least one of the terminals. According to this configuration, when the total number of terminals that have requested transmission is equal to or less than the set number, the media data is transmitted between the terminal that has requested transmission and the terminal that has requested reception. A communication path is established. For this reason, even if the number of terminals connected via the network increases, high-quality data communication is realized between the terminals. In addition, media data is communicated independently of the sharing state (synchronous, asynchronous) of the material (display content).

  In the program according to Embodiment 4 of the present invention, when the communication path is established between the plurality of terminals that transmitted the transmission request and the plurality of terminals that transmitted the reception request, the communication The path establishment means establishes between the plurality of terminals that have transmitted the transmission request and the second terminal when the user using the second terminal that has transmitted the reception request does not have access rights to the material. You may make it cut | disconnect the said communication path. According to this configuration, when the second terminal that has made a reception request does not have access to the material, the communication path between the plurality of terminals that have made the transmission request and the second terminal is disconnected.

  In the program according to the fourth embodiment of the present invention, the computer is further caused to function as a current location acquisition unit that acquires the current location of each terminal, and the communication path establishment unit determines the terminal that transmitted the reception request in advance. In the case where there are a plurality of terminals within the specified range, the communication path may be established for one of the terminals. According to this configuration, when there are a plurality of terminals that have requested reception within a predetermined range, a communication path is established for one of the terminals.

  In the program according to the fourth embodiment of the present invention, when the transmission request receiving means receives a new transmission request when the total number of the terminals that have made the transmission request has reached the set number. The communication path establishment means may refuse to establish the communication path for the terminal that has made a new transmission request. According to this configuration, establishment of a communication path is rejected in a terminal that has made a new transmission request when the number of terminals that have requested transmission has reached the set number.

  In the program according to the fourth embodiment of the present invention, after the communication path is established, when the time during which the media data is not transmitted from the terminal that has made the transmission request has reached a predetermined time, The communication path establishment means may release the communication path corresponding to the terminal. According to this configuration, when the time during which media data is not transmitted reaches a preset time, the communication path of the corresponding terminal is released.

  A program according to a fourth embodiment of the present invention is a program for displaying a part of a display screen in synchronization between a plurality of terminals connected via a network, the terminal connected to the network being User specifying means for specifying a user to be used, receiving means for receiving the material information of the material selected by the first user in the first terminal, and operation information operated on the material, the material of the received material information Determination means for determining whether or not all the specified users have access rights, and the received material information and operation information for a terminal used by a user determined to have access rights to the data The computer is made to function as a notification means for notifying the user. According to this configuration, the confidentiality of the material used in the conference is maintained.

  The program may be stored in a computer-readable information storage medium such as a CD-ROM or a DVD-ROM. The computer may be the terminal.

  An information processing apparatus according to Embodiment 4 of the present invention synchronously displays materials used in a conference among a plurality of terminals connected via a network, and includes at least one of audio data and video data. An information processing apparatus for transmitting and receiving media data, wherein a plurality of users used by each of the plurality of users based on whether or not each of the plurality of users has access rights to the material selected by the first user at the first terminal It includes control means for controlling display contents in each terminal and controlling transmission / reception of the media data between the first terminal and each of the plurality of terminals. The information processing apparatus may be the terminal. According to this configuration, the material and audio are controlled separately and synchronized between a plurality of terminals, and the confidentiality of the conference is maintained.

  An information processing system according to a fourth embodiment of the present invention synchronously displays materials used in a conference among a plurality of terminals connected via a network, and includes at least one of audio data and video data. An information processing system for transmitting and receiving media data, wherein a plurality of users used by each of the plurality of users based on whether or not each of the plurality of users has access rights to the material selected by the first user in the first terminal It includes control means for controlling display contents in each terminal and controlling transmission / reception of the media data between the first terminal and each of the plurality of terminals. According to this configuration, the material and audio are controlled separately and synchronized between a plurality of terminals, and the confidentiality of the conference is maintained.

  A recording medium according to Embodiment 4 of the present invention is a medium that displays materials used in a conference in synchronization between a plurality of terminals connected via a network, and includes at least one of audio data and video data A program for causing a computer to transmit and receive data to be used by each of the plurality of users based on whether or not each of the plurality of users has access rights to the material selected by the first user at the first terminal. Recording a program for causing a computer to function as control means for controlling display contents on each of the plurality of terminals and controlling transmission / reception of the media data between the first terminal and each of the plurality of terminals. It is characterized by. According to this configuration, the material and audio are controlled separately and synchronized between a plurality of terminals, and the confidentiality of the conference is maintained.

5-1. Embodiment 5
The fifth embodiment of the present invention is displayed asynchronously from another operation terminal when the operation terminal is displayed in synchronization with another operation terminal in an electronic conference and is not synchronized with the other operation terminal. The purpose is to suppress network traffic compared to the case where voice is transmitted to the operation terminal. In the fifth embodiment, as an example of an information processing system, an electronic conference system that shares electronic data among a plurality of operation terminals connected via a network will be described as an example. In addition, the meaning of the term of Embodiment 5 shall extend only to the range of Embodiment 5.

  FIG. 93 is an overall configuration diagram of the electronic conference system according to the fifth embodiment. The electronic conference system 5100 (information processing system) includes a plurality of operation terminals 510 used by a plurality of users attending the conference. In the fifth embodiment, for convenience of explanation, a user who can play a leading role in the conference, such as a conference organizer, a conference facilitator, or a person in charge of presenting at the conference, is called a “presenter” (second user) The operation terminal used by is called “presenter terminal” (second terminal device). A user who attends a meeting other than the presenter is called a “participant” (first user), and an operation terminal used by the participant is called a “participant terminal” (first terminal device). FIG. 93 shows one presenter terminal 510a and three participant terminals 510b, 510c, and 510d. In the following description, the configuration common to the presenter terminal 510a and the participant terminals 510b, 510c, and 510d will be collectively referred to as the operation terminal 510.

  As shown in FIG. 93, the presenter terminal 510a and the participant terminals 510b, 510c, and 510d are connected to each other via a communication network 520 such as a LAN (Local Area Network) or the Internet.

  FIG. 94 is a block diagram showing a hardware configuration of operation terminal 510. The operation terminal 510 includes a computer including a CPU 5101, a memory 5102, a storage unit 5103, a communication unit 5104, an input unit 5105, a display unit 5106, a voice input unit 5107, and a voice output unit 5108. These hardware elements are connected to each other by a bus so as to be able to exchange data. The CPU 5101 controls each unit of the operation terminal 510 and executes various types of information processing. The memory 5102 holds various programs and data. A work area of the CPU 5101 is also secured in the memory 5102. The storage unit 5103 stores data such as various files and documents. The communication unit 5104 performs data communication with other operation terminals 510 via the communication network 520. The input unit 5105 is an input device such as a keyboard, a mouse, a pen tool, or a touch panel. A display unit 5106 is a display screen that displays various files, documents, and the like via application software such as a Web browser. The voice input unit 5107 is a microphone to which a sound of a user who operates the operation terminal 510 or an environmental sound including a user's voice existing around the operation terminal 510 is input. The audio output unit 5108 is a speaker that outputs audio data as audio. The voice data includes voice data (presenter voice information described later) received from another operation terminal 510 via the communication network 520. Storage unit 5103, input unit 5105, display unit 5106, audio input unit 5107, and audio output unit 5108 may be provided outside operation terminal 510 and connected to operation terminal 510 via communication network 520. In addition, the operation terminal 510 incorporates software such as a browser and an e-mail client. The operation terminal 510 is, for example, a personal computer, a PDA (Personal Digital Assistant), a portable information terminal such as a smartphone, or the like.

  Hereinafter, a specific configuration of the electronic conference system 5100 will be described mainly focusing on the presenter terminal 510a and the participant terminal 510b.

  FIG. 95 is a functional block diagram showing a specific configuration of the participant terminal 510b. The participant terminal 510b includes a presenter information reception unit 511, a participant operation acquisition unit 512, an operation type determination unit 513, a synchronization determination unit 514, a display control unit 515, and an audio transmission restriction unit 516. These elements are realized by the CPU 5101 executing a program stored in the memory 5102 (see FIG. 94). The storage unit 5103 includes a file DB 531 that stores data such as various files and documents.

  The program may be installed in the participant terminal 510b from a computer-readable information storage medium such as a CD-ROM, DVD-ROM, or memory card, or downloaded via a communication network 520 such as the Internet. Alternatively, the program may be downloaded from a previously stored server.

  For example, as shown in FIG. 96, in a network configuration in which each operation terminal 510 is connected to the network via the server 530, when the participant terminals 510b, 510c, and 510d are connected to the server 530, the program is 530 may be downloaded to the memory 5102 of each of the participant terminals 510b, 510c, and 510d, and the conference material data may be downloaded to the file DB 531. The program and the material data may be configured by, for example, JavaScript (registered trademark). Further, when the presenter connects the operation terminal 510 to the server 530 and performs a predetermined setting, the operation terminal 510 is recognized as the presenter terminal 510a, and the participant connects the operation terminal 510 to the server 530. By performing the predetermined setting, the operation terminal 510 is recognized as the participant terminal 510b or the like. The server 530 transmits the program and the material data to each operation terminal 510 recognized by the participant terminal. Note that the server 530 may also transmit the program and document data to the operation terminal 510 recognized as the presenter terminal. The server 530 functions mainly as a repeater that performs information communication between the presenter terminal 510a and the participant terminals 510b, 510c, and 510d after transmitting the program and the material data. Note that the operation terminal 510 in which the program is downloaded or recorded functions as an information processing apparatus. The computer on which the program is downloaded may be the operation terminal 510 or the server 530.

  Each function corresponding to the program will be described.

  The presenter information reception unit 511 includes information indicating the contents operated by the presenter on the presenter terminal 510a from the presenter terminal 510a (hereinafter referred to as presenter operation information), and the voice of the presenter terminal 510a. Information indicating the presenter's voice input to the input unit 5107 (hereinafter referred to as presenter voice information) is received. The presenter operation information includes, for example, operations such as display of new materials, writing to materials with a pen tool (handwriting tool), picking up (selecting) posted comments, page switching of materials, mouse pointer input and movement, voice input, etc. This is information indicating the contents. Also, the presenter voice information is information indicating the voice uttered in the electronic conference, such as an utterance related to the operation of the presenter terminal 510a and an utterance related to the content displayed by the operation.

  Here, a specific example of processing contents in the presenter terminal 510a will be described. FIG. 97 shows an example of display contents displayed on the display screen of the presenter terminal 510a.

  For example, when the presenter operates the mouse or the like (input unit 5105) on the presenter terminal 510a to read the material stored in the file DB 531 (operation to display a new material on the material screen), The presenter terminal 510a transmits presenter operation information indicating the above operation contents including information indicating the document storage destination URL or the document ID to the participant terminal 510b via the communication unit 5104.

  Further, for example, when the presenter operates the mouse on the presenter terminal 510a and inputs the mouse pointer on the material screen (see FIG. 97) displayed on the display unit 5106, the presenter terminal 510a Through the unit 5104, presenter operation information indicating the operation content including information indicating the position (coordinates) of the mouse pointer, the ID of the input material, the page number, and the like is transmitted to the participant terminal 510b. Note that the presenter terminal 510a may sequentially transmit presenter operation information at regular intervals (for example, every 50 msec).

  Also, for example, when the presenter operates the pen tool on the presenter terminal 510a to write characters or the like on the document screen (see FIG. 97) displayed on the display unit 5106, the presenter terminal 510a Through the unit 5104, presenter operation information indicating the operation content including information indicating the written position (coordinates), the ID of the written material, the page number, and the like is transmitted to the participant terminal 510b.

  For example, when the presenter switches the page of the document screen (see FIG. 97) displayed on the display unit 5106 by operating the mouse on the presenter terminal 510a, the presenter terminal 510a Through 5104, presenter operation information indicating the operation content including information indicating the ID of the displayed material and the designated page number is transmitted to the participant terminal 510b.

  For example, when the presenter's voice is input to the voice input unit 5107 of the presenter terminal 510a and presenter voice information indicating the presenter's voice is generated, the presenter terminal 510a generates the generated presentation. The person voice information is transmitted to the participant terminal 510b via the communication network 520.

  In this way, the presenter terminal 510a notifies each participant terminal 510b, 510c, 510d of information indicating the content based on the presenter's operation or voice.

  Participant operation acquisition section 512 acquires information (hereinafter referred to as participant operation information) indicating the content operated by participant at terminal 510b for participant. The participant operation information is similar to the presenter operation information, for example, display of materials, writing to materials with a pen tool, creation of posted comments, page switching of materials, input and movement of the mouse pointer, voice input, etc. It is information to show.

  The operation type determination unit 513 determines an operation type (presenter operation type) based on the presenter operation information received by the presenter information reception unit 511 from the presenter terminal 510a. Further, the operation type determination unit 513 determines the operation type (participant operation type) based on the participant operation information acquired by the participant operation acquisition unit 512 in the own terminal (participant terminal 510b). The operation type is obtained by classifying operation contents of the presenter and the participant by type. The operation type is set in advance, and is stored in the storage unit 5103 as an operation type table, for example. The operation content registered in the operation type table changes the operation content important for the presenter and the participant, for example, the display content (synchronization content) displayed on the participant terminal 510b in synchronization with the presenter terminal 510a. The content of the operation to be performed Specifically, when the first page of the document A displayed on the presenter terminal 510a is synchronously displayed on the participant terminal 510b, by switching to the second page, the participant terminal 510b The mouse pointer is input to the first page when an operation for changing the display content of the document A or when the first page of the document A displayed on the presenter terminal 510a is displayed on the participant terminal 510b in synchronization. This means an operation for changing the display content of the participant terminal 510b.

  In the participant terminal 510b, the synchronization content may be displayed on the entire display screen, or the synchronization content may be displayed on a part of the display screen. Further, the entire display screen of the presenter terminal 510a may be synchronized, or a part of the display screen may be synchronized. Therefore, for example, even when the mouse pointer operated by the presenter on the presenter terminal 510a is moving in synchronization on the participant terminal 510b (synchronized state), the mouse pointer for the participant terminal 510b is separately provided. It may be displayed (for example, outside the synchronized display screen). In the synchronized display screen, both a synchronized mouse pointer operated by the presenter and a mouse pointer for the participant terminal 510b operated by the participant may be displayed. The mouse pointer input operation on the presenter terminal 510a is included in the operation of changing the display content of the participant terminal 510b.

  FIG. 98 shows an example of the operation type table. In the operation type table shown in FIG. 98, five operation types “material display”, “pen”, “pickup”, “page switching”, and “pointer” are set corresponding to the operation content. For example, the operation type determination unit 513 refers to the operation type table and specifies an operation type corresponding to the operation content by the presenter. In addition, the operation type determination unit 513 refers to the operation type table and identifies an operation type corresponding to the operation content by the participant. If there is no operation type corresponding to the operation content, the operation type determination unit 513 determines “no operation type”. Further, the operation content registered in the operation type table is not limited to the content of FIG. For example, the operation content and operation type registered in the operation type table may be different for the presenter and the participant. In this case, the presenter operation type table and the participant operation type table may be provided separately.

  Based on the determination result of the operation type determination unit 513, the synchronization determination unit 514 determines whether the participant terminal 510b is synchronized with the presenter terminal 510a or is asynchronous. Specifically, when the content of the operation by the presenter corresponds to a predetermined operation type (see FIG. 98), the synchronization determination unit 514 determines “synchronization”. Further, when the operation content by the participant corresponds to a predetermined operation type (see FIG. 98), the synchronization determination unit 514 determines “asynchronous”. If the operation content by the presenter or the operation content by the participant is “no operation type”, the synchronization determination unit 514 determines “asynchronous”.

  The display control unit 515 controls the display content of the display screen of the participant terminal 510b based on the determination result of the synchronization determination unit 514. Specifically, when the synchronization determination unit 514 determines “synchronization”, the display control unit 515 causes the display content corresponding to the operation content by the presenter to be reflected and displayed on the participant terminal 510b. For example, when the presenter displays a new document A on the presenter terminal 510a, the synchronization determining unit 514 determines “synchronized”, and the display control unit 515 displays the document on the display unit 5106 of the participant terminal 510b. A is displayed. For example, when the presenter switches the display page of the document A from the first page to the second page on the presenter terminal 510a, the synchronization determination unit 514 determines “synchronization”, and the display control unit 515 The display page of the document A displayed on the display unit 5106 of the user terminal 510b is switched from the first page to the second page. Similarly, when a character is written with the pen tool, a posted comment is picked up, or the presenter moves the mouse pointer, the display control unit 515 reflects these operation contents on the participant terminal 510b.

  On the other hand, when the synchronization determination unit 514 determines “asynchronous”, the display control unit 515 places the participant terminal 510b in an asynchronous state (asynchronous mode) with respect to the presenter terminal 510a and The operation content is reflected on the participant terminal 510b. For example, when the document A is displayed on the participant terminal 510 b in synchronization with the presenter terminal 510 a and the participant selects another document B, the synchronization determination unit 514 determines “asynchronous”. The display control unit 515 causes the participant terminal 510b to be out of synchronization with the presenter terminal 510a, changes the display content of the participant terminal 510b, and causes the display unit 5106 to display the document B. Further, for example, when the third page of the document A is displayed on the participant terminal 510b in synchronization with the presenter terminal 510a, the participant performs an operation of switching to the previous page (fourth page). In this case, the synchronization determination unit 514 determines “asynchronous”, and the display control unit 515 puts the participant terminal 510b into an asynchronous state with respect to the presenter terminal 510a, and is displayed on the display unit 5106 of the participant terminal 510b. The display page of the document A is changed from the third page to the fourth page (changed). Similarly, when a character is written with the pen tool, a posted comment is created, or the participant moves the mouse pointer, the display control unit 515 asynchronously moves the participant terminal 510b to the presenter terminal 510a. The operation contents are reflected on the participant terminal 510b.

  As described above, the display control unit 515 functions as a synchronization cancellation unit that cancels the synchronization state (switches to the asynchronous state) when the participant performs a preset operation on the participant terminal 510b, and the synchronization state is In the released state (asynchronous state), the presenter functions as resynchronization means for returning to the synchronous state again (releasing the asynchronous state) by performing a preset operation on the presenter terminal 510a.

  The audio transmission restriction unit 516 restricts or cancels the transmission of the presenter audio information from the presenter terminal 510 a to the participant terminal 510 b based on the determination result of the synchronization determination unit 514. Specifically, when the synchronization determination unit 514 determines “synchronization”, the voice transmission restriction unit 516 indicates that transmission of the presenter voice information from the presenter terminal 510 a to the participant terminal 510 b is not restricted. The restriction release information is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction release information continues to transmit presenter voice information to the participant terminal 510b via the communication network 520 (that is, transmission of presenter voice information is not restricted). On the other hand, when the synchronization determination unit 514 determines “asynchronous”, the audio transmission restriction unit 516 restricts request information indicating that transmission of the presenter audio information from the presenter terminal 510 a to the participant terminal 510 b is restricted. Is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction request information stops transmission of presenter voice information via the communication network 520 (that is, transmission of presenter voice information is restricted). As described above, when the display control unit 515 releases the synchronization state (switches to the asynchronous state) based on the determination result of the synchronization determination unit 514, the voice transmission restriction unit 516 uses the presenter terminal 510a for the participant. It functions as a restricting means for restricting transmission of voice (presenter voice information) to the terminal 510b.

  Next, the flow of processing in the electronic conference system 5100 will be described. FIG. 99 is an operation flowchart of the electronic conference system 5100. Here, as an example, the presenter P uses the presenter terminal 510a to make a presentation regarding the document A in the electronic conference, and the participant S participates in the electronic conference using the participant terminal 510b. Description will be made assuming that the electronic conference proceeds while P and the participant S perform a desired operation. The electronic conference system 5100 includes one presenter terminal and a plurality of participant terminals connected to each other via the communication network 520. Here, the present invention is used for one presenter. Description will be made focusing on the terminal 510a and one participant terminal 210b.

  First, the presenter P selects the file of the material A stored in the storage unit 5103 (FIG. 94) on the presenter terminal 510a. As a result, the content of the document A is displayed on the display unit 5106 of the presenter terminal 510a (S5101). For example, the first page (first page) of the material A is displayed. Also, the presenter terminal 510a participates in the presenter operation information indicating the operation content of the presenter P (in this case, the display of the new material A) including the information of the material A (for example, the ID and page number of the material A). To the user terminal 510b.

  Further, the presenter P inputs a voice to the voice input unit 5107 of the presenter terminal 510a by speaking. Thus, the presenter terminal 510a generates presenter voice information indicating the presenter's voice (S5102). Further, the presenter terminal 510a sequentially transmits the generated presenter voice information to the participant terminal 510b.

  Next, the presenter information reception unit 511 of the participant terminal 510b receives the presenter operation information and the presenter voice information from the presenter terminal 510a (S5201). Here, the presenter information reception unit 511 receives the operation content including the ID of the material A (“display of the new material A”).

  Next, the operation type determination unit 513 of the participant terminal 510b determines the operation type based on the presenter operation information (S5202). Here, the operation type determination unit 513 refers to the operation type table shown in FIG. 98 and specifies the operation type (“material display”) corresponding to the operation content (“display new material A”).

  Next, the synchronization determination unit 514 of the participant terminal 510b determines whether the participant terminal 510b is synchronous or asynchronous based on the determination result of the operation type determination unit 513 (S5203). Here, since “display material” is specified as the operation type, the synchronization determination unit 514 determines “synchronization”.

  Next, the display control unit 515 of the participant terminal 510b controls the display content of the display screen on the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5204). Here, since the synchronization determination unit 514 determines “synchronization”, the display control unit 515 displays the first page of the document A on the display unit 5106 of the participant terminal 510b.

  Also, the voice transmission restriction unit 516 of the participant terminal 510b restricts or cancels the transmission of the presenter voice information from the presenter terminal 510a to the participant terminal 510b based on the determination result of the synchronization determination unit 514. (S5205). Here, since the synchronization determination unit 514 determines “synchronization”, the audio transmission restriction unit 516 of the participant terminal 510b restricts transmission of the presenter audio information from the presenter terminal 510a to the participant terminal 510b. Restriction release information indicating that it is not to be transmitted is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction release information continues to transmit presenter voice information to the participant terminal 510b. Further, the participant terminal 510b outputs a sound corresponding to the received presenter sound information (that is, the presenter's sound) from the sound output unit 5108 (S5206).

  In the processing of S5201 to S5206, the presenter terminal 510a and the participant terminal 510b are in a synchronized state (synchronous mode), and the same contents are displayed on the presenter terminal 510a and the participant terminal 510b. The voice corresponding to the presenter voice information is output from the voice output unit 5108 of the presenter terminal 510b.

  Subsequently, the participant S performs a desired operation on the participant terminal 510b. Here, it is assumed that the participant S has switched the display page (first page) of the material A displayed on the display screen to the second page (S5207).

  Then, the participant operation acquisition unit 512 of the participant terminal 510b acquires participant operation information indicating the content operated by the participant S. Here, the participant terminal 510b acquires the participant operation information indicating the operation content of the participant S (here, page switching of the document A) including the information of the document A (for example, the ID of the document A). (S5208). Here, it is assumed that the presenter terminal 510a continues to transmit presenter audio information to the participant terminal 510b.

  Next, the operation type determination unit 513 of the participant terminal 510b determines the operation type based on the participant operation information (S5209). Here, the operation type determination unit 513 refers to the operation type table shown in FIG. 98 and identifies the operation type (“page switching”) corresponding to the operation content (“page switching of material A”).

  Next, the synchronization determination unit 514 of the participant terminal 510b determines whether the participant terminal 510b is synchronized or asynchronous based on the determination result of the operation type determination unit 513 (S5210). Here, since “page switching” is specified as the operation type, the synchronization determination unit 514 determines “asynchronous”.

  Next, the display control unit 515 of the participant terminal 510b controls the display screen on the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5211). Here, since it is determined as “asynchronous” by the synchronization determination unit 514, the display control unit 515 is for the participant even if the first page of the document A is displayed on the display unit 5106 of the presenter terminal 510a. The display content of the display unit 5106 of the terminal 510b is changed to display the second page of the document A.

  Also, the voice transmission restriction unit 516 of the participant terminal 510b restricts or cancels the transmission of the presenter voice information from the presenter terminal 510a to the participant terminal 510b based on the determination result of the synchronization determination unit 514. (S5212). Here, since the synchronization determination unit 514 determines “asynchronous”, the audio transmission restriction unit 516 of the participant terminal 510b restricts the transmission of the presenter audio information from the presenter terminal 510a to the participant terminal 510b. Restrict request information indicating that the request is to be sent is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction request information stops transmission of presenter voice information to the participant terminal 510b (S5103). Here, even if the presenter's voice is input to the voice input unit 5107 of the presenter terminal 510a and the presenter voice information indicating the presenter's voice is generated, the presenter terminal 510a is the participant terminal. The presenter voice information is not transmitted to 510b.

  In the processing of S5207 to S5212, the participant terminal 510b is in an asynchronous state (asynchronous mode), different contents are displayed on the presenter terminal 510a and the participant terminal 510b, and the presenter's voice is displayed via the communication network 520. Information is not sent. As described above, when the participant terminal 510b is in an asynchronous state, the presenter terminal 510a does not transmit the presenter voice information via the communication network 520. Therefore, the presenter regardless of the determination of the synchronization determination unit 514. Compared with the case where voice information is transmitted, traffic of the communication network 520 is suppressed.

  Subsequently, the presenter P performs a desired operation on the presenter terminal 510a. Here, it is assumed that the presenter P has written characters on the first page of the document A displayed on the display unit 5106 using the pen tool (S5104 in FIG. 100).

  Then, the presenter terminal 510a displays the contents operated by the presenter P including the information indicating the position (coordinates) of the written character, the ID of the written material A, and the page number (here, the material A by the pen tool). To the participant terminal 510b.

  Next, the presenter information reception unit 511 of the participant terminal 510b receives the presenter operation information from the presenter terminal 510a (S5213). Here, it is assumed that the presenter terminal 510a has received the restriction request information and has stopped transmitting the presenter voice information to the participant terminal 510b.

  Next, the operation type determination unit 513 of the participant terminal 510b determines the operation type based on the presenter operation information (S5214). Here, the operation type determination unit 513 refers to the operation type table shown in FIG. 98 and identifies the operation type (“pen”) corresponding to the operation content (“writing to the document A by the pen tool”).

  Next, the synchronization determination unit 514 of the participant terminal 510b determines whether the participant terminal 510b is synchronized or asynchronous based on the determination result of the operation type determination unit 513 (S5215). Here, since “pen” is specified as the operation type, the synchronization determination unit 514 determines “synchronization”.

  Next, the display control unit 515 of the participant terminal 510b controls the display content of the display screen on the participant terminal 510b based on the determination result of the synchronization determination unit 514 (S5216). Here, since the synchronization determination unit 514 determines “synchronization”, the display control unit 515 changes the display content of the display unit 5106 of the participant terminal 510b to change the first content A of the document A in which characters are written. Display the page.

  Also, the voice transmission restriction unit 516 of the participant terminal 510b restricts or cancels the transmission of the presenter voice information from the presenter terminal 510a to the participant terminal 510b based on the determination result of the synchronization determination unit 514. (S5217). Here, since the synchronization determination unit 514 determines “synchronization”, the audio transmission restriction unit 516 of the participant terminal 510b restricts transmission of the presenter audio information from the presenter terminal 510a to the participant terminal 510b. Restriction release information indicating that the request is not made (here, the restriction is released) is transmitted to the presenter terminal 510a. The presenter terminal 510a that has received the restriction release information resumes transmitting the presenter voice information to the participant terminal 510b (S5105). Further, the participant terminal 510b outputs a sound corresponding to the received presenter voice information (that is, the presenter's voice) from the voice output unit 5108 (S5218).

  In the processing of S5213 to S5218, the participant terminal 510b is again in a synchronized state (synchronous mode), and the same contents are displayed on the presenter terminal 510a and the participant terminal 510b, and the sound of the participant terminal 510b is displayed. The voice of the presenter is output from the output unit 5108.

  As described above, in the electronic conference system 5100, synchronization / asynchronization is automatically switched according to a desired operation of the presenter and the participant, and the display content of the participant terminal 510b is changed. In addition, when the participant terminal 510b is in an asynchronous state, the presenter terminal 510a does not transmit presenter voice information via the communication network 520, and thus the presenter voice information regardless of the determination of the synchronization determination unit 514. Compared with the case of transmitting the traffic, the traffic of the communication network 520 is suppressed.

5-2. Modified Example of Embodiment 5 The electronic conference system 5100 is not limited to the above configuration, and various configurations can be adopted. Below, the electronic conference system 5100 which concerns on the modification of Embodiment 5 is demonstrated centering on difference with the said structure. In an electronic conference system 5100 according to a modified example of the fifth embodiment below, description of elements having the same functions as those of the electronic conference system 5100 will be omitted.

5-2-1. Modification 1 of Embodiment 5
In the electronic conference system 5100 according to the first modification of the fifth embodiment, when the participant operation acquisition unit 512 acquires the operation content (participant operation information) by the participant, the operation type corresponding to the operation content is determined. The display control unit 515 causes the participant terminal 510b to be in an asynchronous state (asynchronous mode) with respect to the presenter terminal 510a, and causes the participant terminal 510b to display display content corresponding to the operation content. Also good. In addition, when the participant operation information is acquired, the voice transmission restriction unit 516 does not determine the operation type corresponding to the operation content, and the voice transmission restriction unit 516 transmits the presenter voice information to the participant terminal 510b from the presenter terminal 510a. Even if the presenter terminal 510a that has received the restriction request information transmits restriction request information indicating that the transmission is restricted to the presenter terminal 510a, the presenter terminal 510a receives the restriction request information and stops sending presenter voice information to the participant terminal 510b. Good.

  According to the electronic conference system 5100 according to the first modification of the fifth embodiment, when an operation for changing the display content displayed on the participant terminal 510b is performed by the participant, the operation is performed in an asynchronous state. The corresponding display content is displayed on the participant terminal 510b, and the presenter's voice is not output from the voice output unit 5108 of the participant terminal 510b.

5-2-2. Variation 2 of Embodiment 5
In the electronic conference system 5100 according to the second modification of the fifth embodiment, when the presenter information receiving unit 511 receives the operation content (presenter operation information) by the presenter, the operation type corresponding to the operation content is determined. The display control unit 515 causes the participant terminal 510b to be in a synchronized state (synchronous mode) with respect to the presenter terminal 510a, and causes the participant terminal 510b to display display content corresponding to the operation content. Also good. In addition, when the presenter operation information is received, the voice transmission restriction unit 516 determines the presenter voice information from the presenter terminal 510a to the participant terminal 510b without determining the operation type corresponding to the operation content. The presenter terminal 510a that has sent the restriction release information indicating that the transmission is not restricted to the presenter terminal 510a and has received the restriction release information is provided to the presenter voice information for the participant terminal 510b via the communication network 520. May be started.

  According to the electronic conference system 5100 according to the second modification of the fifth embodiment, when the presenter performs an operation of changing the display content displayed on the presenter terminal 510a, the operation is changed to a synchronized state. The corresponding display content is displayed on the participant terminal 510b, and the presenter's voice is output from the voice output unit 5108 of the participant terminal 510b.

5-2-3. Modification 3 of Embodiment 5

  In the electronic conference system 5100 according to the third modification of the fifth embodiment, when the participant terminal 510b is in an asynchronous state, the asynchronous state may be maintained based on an instruction from the participant. For example, when the participant selects an asynchronous button on the display screen with the mouse pointer, the participant terminal 510b maintains the asynchronous state. Further, for example, while the participant touches the display screen with a finger, the participant terminal 510b may be configured to maintain an asynchronous state. Thus, even during the period in which the asynchronous state is maintained, the presenter terminal 510a stops transmitting the presenter voice information to the participant terminal 510b.

  The elements shown in the fifth embodiment and the modifications of the fifth embodiment of the electronic conference system 5100 described above are connected to the operation terminal 510 (presenter terminal 510a, participant terminals 510b, 510c, 510d) via a network. In the information processing apparatus, the CPU may execute the program. The information processing apparatus can be a server 530 shown in FIG. 96, for example. In this case, in the information processing apparatus, the participant operation acquisition unit 512 acquires participant operation information from each participant terminal, and the operation type determination unit 513 specifies an operation type corresponding to each participant terminal, The synchronization determination unit 514 determines synchronization and asynchronous corresponding to each participant terminal. Further, the display control unit 515 controls the display content of the display screen of each participant terminal based on the determination result of the synchronization determination unit 514. Also, the audio transmission restriction unit 516 restricts or cancels the transmission of the presenter audio information from the presenter terminal 510a to the participant terminal 510b based on the determination result of the synchronization determination unit 514.

  Moreover, each modification of the said Embodiment 5 and Embodiment 5 is an example, Comprising: Each form can also be combined. In the above description, an electronic conference system is taken as an example of an information processing system. However, the information processing system is not limited to an electronic conference system, and electronic data is shared between operation terminals connected to a network. Includes a wide variety of systems.

Reference numeral 1100 of the first embodiment 1100 ... electronic conference system 1101 ... CPU 1201 ... CPU 1102 ... memory 1202 ... memory 1103 ... storage unit 1203 ... storage unit 1104 ... communication unit 1204 ... communication unit 1105 ... Operation unit, 1106 ... display unit, 1107 ... audio input unit, 1108 ... audio output unit, 110 ... terminal device, 120 ... server, 111 ... transmission request transmission unit, 112 ... determination result acquisition unit, 113 ... terminal information acquisition unit, DESCRIPTION OF SYMBOLS 114 ... Communication path establishment part, 115 ... Voice transmission part, 116 ... Display control part, 121 ... Transmission request reception part, 122 ... Reception request reception part, 123 ... Judgment processing part, 124 ... Terminal information generation part, 125 ... Current location acquisition , 130: communication network, 141 ... reception request transmission unit, 142 ... determination result acquisition unit, 143 ... display control unit, 144 ... voice reception unit.

Reference numeral 2100 of the second embodiment 2100 ... electronic conference system, 2101 ... CPU, 2102 ... memory, 2103 ... storage unit, 2104 ... communication unit, 2105 ... input unit, 2106 ... display unit, 210 ... operation terminal, 210a ... for presenter Terminal, 210b ... Participant terminal, 211 ... Presenter operation reception unit, 212 ... Participant operation acquisition unit, 213 ... Operation type determination unit, 214 ... Synchronization determination unit, 215 ... Display control unit, 216 ... Priority comparison unit 217 ... Synchronization information notification unit, 220 ... Communication network, 230 ... Server, 231 ... File DB.

Reference numeral 3100 in the third embodiment 3100 ... electronic conference system, 3200 ... electronic conference system, 3101 ... CPU, 3201 ... CPU, 3102 ... memory, 3202 ... memory, 3103 ... storage unit, 3203 ... storage unit, 3104 ... communication unit, 3204 Communication unit 3105 Operation unit 3106 Display unit 3107 Audio input unit 3108 Audio output unit 330 Communication network 320 Server 321 Acceptance processing unit 322 Communication connection unit 323 Terminal Determination unit, 324 ... notification unit, 325 ... terminal information update unit, 326 ... terminal state determination unit, 327 ... terminal information generation unit, 328 ... current location acquisition unit, 331 ... terminal information DB, 332 ... file DB, 310 ... terminal, 311 ... Transmission request transmission unit, 312 ... Determination result acquisition unit, 313 ... Terminal information acquisition unit, 314 ... Communication path establishment unit, 31 DESCRIPTION OF SYMBOLS 5 ... Audio | voice transmission part, 316 ... Display control part, 341 ... Reception request transmission part, 342 ... Determination result acquisition part, 343 ... Display control part, 344 ... Voice reception part.

Reference numeral 4100 of the fourth embodiment: 4100 ... electronic conference system, 4101 ... CPU, 4201 ... CPU, 4301 ... CPU, 4102 ... memory, 4202 ... memory, 4302 ... memory, 4103 ... storage unit, 4203 ... storage unit, 4303 ... storage unit 4104: Communication unit, 4204 ... Communication unit, 4304 ... Communication unit, 4105 ... Operation unit, 4106 ... Display unit, 4107 ... Audio input unit, 4108 ... Audio output unit, 450 ... Communication network, 410 ... Terminal, 411 ... Transmission Request transmission unit, 412 ... determination result acquisition unit, 413 ... terminal information acquisition unit, 414 ... communication path control unit, 415 ... voice transmission unit, 416 ... display control unit, 420 ... terminal management server, 421 ... reception processing unit, 422 ... communication connection part, 423 ... notification part, 424 ... transmission request receiving part, 425 ... reception request receiving part, 426 ... determination processing part, 4 27 ... Terminal information generation unit, 428 ... Terminal information DB, 429 ... Current location acquisition unit, 430 ... File management server, 431 ... Reception processing unit, 432 ... Access determination processing unit, 433 ... File transmission unit, 434 ... File DB, 435 ... access restriction information DB, 441 ... reception request transmission unit, 442 ... determination result acquisition unit, 443 ... display control unit, 444 ... voice reception unit.

Reference numeral 5100 ... Electronic conference system 5101 ... CPU 5102 ... Memory 5103 ... Storage unit 5104 ... Communication unit 5105 ... Input unit 5106 ... Display unit 5107 ... Audio input unit 5108 ... Audio output , 510 ... operation terminal, 510a ... presenter terminal, 510b ... participant terminal, 511 ... presenter information reception unit, 512 ... participant operation acquisition unit, 513 ... operation type determination unit, 514 ... synchronization determination unit, 515 ... Display control unit, 516 ... Audio transmission restriction unit, 520 ... Communication network, 530 ... Server, 531 ... File DB.

Claims (1)

In a plurality of terminal devices, a program capable of causing at least a part of the display content of the second terminal device to be displayed in a synchronized state on at least a part of the display screen of the first terminal device,
First operation acquisition means for acquiring first operation content indicating content operated by a first user in the first terminal device;
When the first operation content is an operation content that changes the display content displayed on the first terminal device in synchronization with the second terminal device, and is the predetermined operation content, Display control means for changing the display content displayed on the terminal device to display content corresponding to the first operation content;
Limiting means for limiting transmission of audio from the second terminal device to the first terminal device when the display content is changed according to the first operation content;
As a program to make the computer function as.

Images