JP7473807B2 - COMMUNICATION CONTROL DEVICE, COMMUNICATION CONTROL METHOD, AND COMMUNICATION CONTROL PRO - Google Patents

Description

The present invention relates to a communication control device, a communication control method, and a communication control program.

In recent years, electronic conference systems that realize electronic conferences via a network have become increasingly popular. In an electronic conference system, for example, multiple clients connect to a server via a network, and audio and video data is sent and received between each client and the server.

The following proposals have been made regarding electronic conferencing. For example, a video conferencing system has been proposed that divides conference terminals into groups based on collected information about the connection paths between conference terminals, and if there is a group whose bandwidth usage is less than a predetermined value, controls the bandwidth of the conference terminals belonging to that group. Also, a Web conferencing system has been proposed that dynamically controls the communication bandwidth used in response to changes in the user's usage status while a Web conference is being held. Furthermore, a multicast conferencing device has been proposed that, when a terminal that joins a conference midway is detected, if another terminal is to send data, transmits an intraframe coded image, rather than an interframe predictive coded image, to the terminal that joined midway.

JP 2010-157943 A JP 2014-112845 A JP 2002-305733 A

In electronic conferencing systems, if the communication speed between the client and server slows, the probability of communication data being delayed or lost increases, which can result in interrupted or impossible playback of audio and video on the client. One way to avoid this problem is to allocate sufficient communication bandwidth on the network to each client. However, if a predetermined amount of communication bandwidth or more is allocated to all clients, it would be extremely costly to expand the network equipment. For this reason, there is a problem with how to allocate the necessary and sufficient communication bandwidth to each client.

In one aspect, the present invention aims to provide a communication control device, a communication control method, and a communication control program that can optimize the allocation of communication bandwidth to each client in an electronic conference.

In one proposal, a communication control device having the following processing unit is provided. In this communication control device, the processing unit collects emails sent and received by each of multiple users participating in the electronic conference before the electronic conference begins, determines the level of interest in the electronic conference for each of the multiple users based on the analysis results of the collected emails, collects usage patterns of electronic conference applications in each of the multiple clients from multiple clients used by each of the multiple users during the electronic conference, determines the level of concentration in the electronic conference for each of the multiple users based on the collected usage patterns, and controls the communication bandwidth to be allocated for communication between a server controlling the electronic conference and each of the multiple clients based on the determination results of the level of interest and concentration.

Also, one proposal provides a communication control method in which a computer executes the same process as the above-mentioned communication control device.
Furthermore, in one proposal, a communication control program is provided that causes a computer to execute the same processing as the above-mentioned communication control device.

On one hand, it allows for the allocation of communication bandwidth to each client during electronic conferences to be optimized.

1 illustrates a configuration example and a processing example of an electronic conference system according to a first embodiment. FIG. 13 illustrates an example of a configuration of an information processing system according to a second embodiment. FIG. 2 illustrates an example of a hardware configuration of a host server. FIG. 2 illustrates an example of a hardware configuration of a router. FIG. 2 is a diagram illustrating an example of the configuration of a virtual machine in a host server. FIG. 11 is a diagram illustrating a comparative example regarding allocation of communication bands. FIG. 2 illustrates an example of the configuration of processing functions included in a virtual machine and a router. 11 is a diagram for explaining a process of collecting conference app information; FIG. FIG. 11 is a diagram for explaining a process of collecting conference information. 4A and 4B are diagrams illustrating examples of the configuration of conference information and participant information. FIG. 11 is a diagram for explaining a process of determining a level of interest. FIG. 13 is a diagram illustrating an example of a configuration of an interest level table. 11 is a diagram for explaining a process of determining a concentration level. FIG. FIG. 13 is a diagram illustrating an example of a configuration of a concentration level table. FIG. 11 is a diagram for explaining a process of determining a quality priority. FIG. 1 is a diagram for explaining communication band allocation control. 10 is a timing chart showing an example of control of allocation of communication bands in response to changes in the usage pattern of a conference application. 11 is an example of a flowchart illustrating a procedure of a conference application information collection process in a virtual machine. 11 is an example of a flowchart illustrating a procedure for a conference monitoring process. 11 is an example of a flowchart illustrating a procedure for an interest level determination process. 13 is an example of a flowchart illustrating a procedure for a bandwidth control process.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
First Embodiment
1 shows an example of the configuration and processing of an electronic conference system according to a first embodiment. The electronic conference system shown in FIG.

The server 10 controls the electronic conference. The clients 21, 22, and 23 are terminal devices used by the users A, B, and C who participate in the electronic conference, respectively. The clients 21 to 23 run electronic conference applications, and the electronic conference is realized by the electronic conference applications communicating with the server 10.

For example, the electronic conferencing application of client 21 transmits audio and video data of user A to server 10. Similarly, the electronic conferencing application of client 22 transmits audio and video data of user B to server 10, and the electronic conferencing application of client 23 transmits audio and video data of user C to server 10. Server 10 receives audio and video data from each electronic conferencing application and distributes the audio and video data to each electronic conferencing application. For example, server 10 transmits audio and video data received from clients 21 and 22 to client 23, and plays the audio and video.

The number of clients 21 to 23 is not limited to three. Also, clients 21 to 23 may be realized as physical machines or as virtual machines. In the latter case, users A, B, and C remotely operate clients 21, 22, and 23, which are virtual machines, from other terminal devices (not shown).

The communication control device 30 controls the allocation of communication bandwidth for communication between the server 10 and each of the clients 21 to 23. This communication control device 30 includes a processing unit 31. The processing unit 31 is realized, for example, as a processor. The processing unit 31 executes, for example, a predetermined program to perform the following allocation control.

The processing unit 31 collects emails sent and received by each of users A to C before the electronic conference is started. Based on the analysis results of the collected emails, the processing unit 31 determines the user's level of interest in the electronic conference for each of users A to C (step S1). For example, the more times the electronic conference is mentioned in emails sent by a certain user, the higher the user's level of interest is determined to be.

Furthermore, the processing unit 31 collects from clients 21 to 23 the usage patterns of the electronic conference application at each of them while the electronic conference is being held. For each of users A to C, the processing unit 31 determines the user's concentration on the electronic conference based on the usage patterns collected from the corresponding client (step S2). For example, the concentration level of the user corresponding to the client is determined based on the state of the display window of the electronic conference application at that client. For example, the larger the size of the display window, the higher the concentration level is determined to be. Alternatively, if the display window is displayed in the foreground, the concentration level is determined to be higher compared to when it is not.

The processing unit 31 controls the communication bandwidth to be allocated for communication between the corresponding client and the server 10 based on the results of the interest and concentration determination for each of the users A to C (step S3).

For example, both interest and concentration are judged in two stages. In addition, either a relatively wide band (broadband 41) or an even narrower band (narrowband 42) is assigned as the communication bandwidth. User A is judged to have a high interest level and a low concentration level. User B is judged to have both a low interest level and a low concentration level. User C is judged to have a low interest level and a high concentration level. In this case, as illustrated in FIG. 1, the processing unit 31 assigns broadband 41 to data transmitted from clients 21 and 23 to server 10, and assigns narrowband 42 to data transmitted from client 22 to server 10.

In addition, the usage patterns of the electronic conference application are collected at regular intervals, and the interest level is updated according to the collected results. For example, if it is determined that the concentration level of user C has decreased from the state shown in FIG. 1, the communication bandwidth allocated to the transmission data from client 23 to server 10 is changed from broadband 41 to narrowband 42.

By performing the above process, it is possible to optimize the allocation of communication bandwidth to each of the clients 21 to 23 in an electronic conference. As a result, it is possible to improve the efficiency of the use of communication resources. In addition, it is possible to reduce the cost of network equipment compared to the case where a certain amount of communication bandwidth or more is allocated to all of the clients 21 to 23.

In particular, in the above process, the allocation of communication bandwidth is determined by combining the level of interest, which is determined fixedly at the start of the electronic conference, with the level of concentration, which is determined dynamically while the electronic conference is being held. This can improve the accuracy of optimizing the allocation of communication bandwidth. For example, when only the level of concentration is used, if the levels of concentration of two users during the electronic conference are equal, each user is allocated an equal communication bandwidth. However, even if the levels of concentration are the same, high quality of audio and video may not be required depending on the importance of the electronic conference. Therefore, by using both the level of interest and the level of concentration, it is possible to improve the accuracy of optimizing the allocation of communication bandwidth.

In addition, by using the results of email analysis as an index that is determined fixedly at the start of an electronic conference, it is possible to accurately determine the user's level of interest in the electronic conference. For example, the results of email analysis can be used to determine the user's level of interest, which cannot be determined solely by the user's position in the electronic conference, such as whether or not the user is the organizer of the electronic conference.

Second Embodiment
Next, an example in which the clients 21 to 23 in FIG. 1 are realized as virtual machines will be described.

Fig. 2 is a diagram showing an example of the configuration of an information processing system according to the second embodiment. The information processing system shown in Fig. 2 includes a host server 100, a router 200, an electronic conference server 310, a schedule management server 320, and an e-mail server 330. The host server 100 and the router 200 are connected to a network 410, and the router 200, the electronic conference server 310, the schedule management server 320, and the e-mail server 330 are connected to a network 420. The host server 100 is capable of communicating with the electronic conference server 310, the schedule management server 320, and the e-mail server 330 via the router 200.

The host server 100 is a server device that operates as a virtual host that realizes virtual machines. In this embodiment, the host server 100 operates virtual machines that are remotely operated by individual users. Each user can use the services of the electronic conference server 310, schedule management server 320, and email server 330 by using the corresponding virtual machine.

The router 200 routes and relays packets between devices on the network 410, such as the host server 100, and devices on the network 420, such as the electronic conference server 310, the schedule management server 320, and the email server 330. At this time, the router 200 is capable of controlling the allocation of bandwidth for communication between each virtual machine on the host server 100 and each server on the network 420.

The electronic conference server 310 is a server device that runs an electronic conference among the virtual machines on the host server 100 .
The schedule management server 320 is a server device that manages the schedules of each user who uses a virtual machine. In particular, in this embodiment, the schedule management server 320 cooperates with the electronic conference server 310 to manage the schedules of electronic conferences in which users will participate.

The email server 330 is a server device that provides an email sending and receiving service used by each user who uses a virtual machine.
Fig. 3 is a diagram showing an example of the hardware configuration of a host server. The host server 100 can be realized, for example, as a computer having a configuration as shown in Fig. 3. As shown in Fig. 3, the host server 100 includes a processor 101, a RAM (Random Access Memory) 102, a HDD (Hard Disk Drive) 103, a graphic interface (I/F) 104, an input interface (I/F) 105, a reader 106, and a communication interface (I/F) 107.

The processor 101 performs overall control of the entire host server 100. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or a PLD (Programmable Logic Device). The processor 101 may also be a combination of two or more elements of a CPU, an MPU, a DSP, an ASIC, or a PLD.

RAM 102 is used as the main storage device of host server 100. RAM 102 temporarily stores at least a portion of the OS (Operating System) program and application programs to be executed by processor 101. RAM 102 also stores various data necessary for processing by processor 101.

The HDD 103 is used as an auxiliary storage device for the host server 100. The HDD 103 stores the OS program, application programs, and various data. Note that other types of non-volatile storage devices, such as a solid state drive (SSD), can also be used as the auxiliary storage device.

A display device 104a is connected to the graphic interface 104. The graphic interface 104 displays an image on the display device 104a in accordance with an instruction from the processor 101. Examples of the display device include a liquid crystal display and an organic EL (ElectroLuminescence) display.

An input device 105a is connected to the input interface 105. The input interface 105 transmits a signal output from the input device 105a to the processor 101. Examples of the input device 105a include a keyboard and a pointing device. Examples of the pointing device include a mouse, a touch panel, a tablet, a touch pad, and a trackball.

A portable recording medium 106a is detachably attached to the reading device 106. The reading device 106 reads data recorded on the portable recording medium 106a and transmits it to the processor 101. Examples of the portable recording medium 106a include an optical disk, a magneto-optical disk, and a semiconductor memory.

The communication interface 107 transmits and receives data to and from other devices such as the router 200 via the network 410 .
The above hardware configuration can realize the processing functions of the host server 100. The electronic conference server 310, the schedule management server 320, and the email server 330 can also be realized as computers having the same configuration as the host server 100.

Figure 4 is a diagram showing an example of the hardware configuration of a router. As shown in Figure 4, the router 200 includes, for example, a processor 201, a RAM 202, a flash memory 203, and a communication interface (I/F) 204.

The processor 201 controls the entire router 200. The processor 201 is, for example, a CPU, an MPU, an ASIC, or a PLD. The processor 201 may also be a combination of two or more elements of a CPU, an MPU, an ASIC, or a PLD.

RAM 202 is used as the main memory device of router 200. RAM 202 temporarily stores at least a portion of the program (e.g., firmware program) to be executed by processor 201. RAM 202 also stores various data necessary for processing by processor 201.

The flash memory 203 is used as an auxiliary storage device for the router 200. Programs and various data are stored in the flash memory 203. Note that other types of non-volatile storage devices, such as HDDs, can also be used as the auxiliary storage device.

The communication interface 204 has multiple ports that connect to the networks 410 and 420, and transmits and receives data (packets) at each port under the control of the processor 201.

In the router 200 shown in FIG. 4, the processor 201 executes a program to control packet transfer between ports of the communication interface 204. This causes packets to be routed (a transfer path is determined) between the networks 410 and 420. Note that at least a portion of the packet transfer control process performed by the processor 201 may be executed by a dedicated circuit such as an ASIC or PLD. The router 200 may also be realized as a server computer having a configuration such as that shown in FIG. 3, for example.

Figure 5 is a diagram showing an example of the configuration of virtual machines in a host server. As shown in Figure 5, for example, four virtual machines 110 to 140 operate on the host server 100. The host server 100 also includes a virtual host processing unit 150. The processing of the virtual host processing unit 150 is realized by the processor 101 executing a hypervisor program or a virtualization software program. The virtual host processing unit 150 constructs the virtual machines 110 to 140 using the physical resources of the host server 100 and manages their operation.

The virtual machines 110 to 140 virtually realize the functions of a client device (e.g., a personal computer) used by each individual user. In addition, user terminals 501, 502, 503, and 504 are connected to the virtual machines 110, 120, 130, and 140, respectively. The user terminals 501, 502, 503, and 504 are operated by users U1, U2, U3, and U4, respectively.

User terminals 501, 502, 503, and 504 realize the virtual desktop environments of virtual machines 110, 120, 130, and 140, respectively. That is, the desktop screens of virtual machines 110, 120, 130, and 140 are virtually displayed on user terminals 501, 502, 503, and 504, respectively. Then, information on input operations on the virtual desktop screens displayed on user terminals 501, 502, 503, and 504 is transmitted to virtual machines 110, 120, 130, and 140, respectively. This allows users U1, U2, U3, and U4 to operate client devices virtually realized by virtual machines 110, 120, 130, and 140, respectively.

By remotely operating the virtual machines 110-140 using the user terminals 501-504 in this way, the users U1-U4 can use the services provided by the electronic conference server 310, the schedule management server 320, and the email server 330. For example, the users U1-U4 can participate in an electronic conference via the user terminals 501-504 by using the electronic conference service provided by the electronic conference server 310.

When an electronic conference is held, a conference application for executing the electronic conference processing is installed on the virtual machines 110 to 140. The conference application on each of the virtual machines 110 to 140 transmits and receives data including the user's audio signals and video (moving image) signals to and from the electronic conference server 310.

At this time, in order for the virtual machines 110-140 to be able to execute the audio and video playback process smoothly and without interruption, it is desirable to secure a sufficient communication bandwidth for the electronic conference between each of the virtual machines 110-140 and the electronic conference server 310. One possible method for achieving this is to control the router 200 so that a certain amount of communication bandwidth or more is allocated in advance to packets for the electronic conference that are transferred between each of the virtual machines 110-140 and the electronic conference server 310. Here, a processing example when this method is adopted is shown in FIG. 6 as a comparative example.

Figure 6 is a diagram showing a comparative example of the allocation of communication bandwidth. In the comparative example shown in Figure 6, a communication bandwidth dedicated to electronic conferences is secured in network 420. As a method for this, in the example of Figure 5, a conference-only lane 421 dedicated to electronic conference packets and a general lane 422 for other packets are provided in network 420. Note that each lane may be secured as a separate transmission path that is physically separated, or may be logically provided on the same transmission path.

The router 200 monitors packets received from the network 410 and addressed to a server on the network 420. When the router 200 detects a packet destined for the electronic conference server 310, it sends the packet through the conference-only lane 421. This allows a certain communication bandwidth to be allocated to packets destined for the electronic conference server 310. On the other hand, when the router 200 detects a packet destined for a server 340 other than the electronic conference server 310, it sends the packet through the general lane 422.

However, even when this method is used, the traffic on the conference-only lane 421 increases as the number of electronic conference users increases. In order to ensure that a sufficient communication bandwidth is always allocated to a large number of conference users, it is necessary to prepare an ample communication bandwidth dedicated to conferences in advance, which incurs huge costs for expanding network facilities.

Even when a large number of users are using electronic conferences, some of these users do not require high quality audio or video, depending on the importance of electronic conferences to them. If a large communication bandwidth is reserved for such users, this will result in extra costs.

The router 200 of this embodiment controls the allocation of communication bandwidth for each user using an electronic conference based on a static indicator that is determined when the electronic conference begins and a dynamic indicator that changes while the electronic conference is being held. Static indicators include the user's involvement in the electronic conference, such as whether they are the organizer of the electronic conference or an invited guest, and the state of references to the electronic conference in emails sent and received by the user, and the user's level of interest in the electronic conference is determined based on these indicators. Dynamic indicators include the manner in which the electronic conference application is used, such as the state of the display window of the electronic conference application, and the user's level of concentration in the electronic conference is determined based on these indicators. The communication bandwidth to be allocated to the user is then determined based on the results of the interest and concentration determinations.

Here, in an environment in which virtual machines corresponding to each user are operated by a virtual desktop, as in the present embodiment, information indicating the usage form of the electronic conference application as described above can be easily obtained from a device external to the host server 100, such as the router 200. Also, in companies that introduce such a virtual desktop environment, electronic conference schedules and information on expected participants (conference information, described below), and sending and receiving e-mail are often managed centrally. In this embodiment as well, the conference information is managed by the schedule management server 320, and the sending and receiving of e-mail is managed by the e-mail server 330. In such an environment, a device within the system, such as the router 200, can easily obtain conference information and e-mails of each user from within the system. Note that information used to determine the interest level described above can be obtained from the conference information.

FIG. 7 illustrates an example of the configuration of processing functions included in a virtual machine and a router.
The virtual machine 110 includes a conference application 111, an agent 112, and a registry 113. Similarly, the virtual machines 120, 130, and 140 include conference applications 121, 131, and 141, agents 122, 132, and 142, and registries 123, 133, and 143, respectively.

The processing of the conference applications 111, 121, 131, and 141 is realized by the virtual processors (actually, processor 101) of the virtual machines 110, 120, 130, and 140 executing the conference application programs. The conference applications 111, 121, 131, and 141 are client applications that realize electronic conferences using the virtual machines 110, 120, 130, and 140 by communicating with the electronic conference server 310.

For example, the conference application 111 receives audio data picked up by a microphone of the user terminal 501 and video data captured by a camera of the user terminal 501, and transmits them to the electronic conference server 310. The conference application 111 also receives audio data and video data from the electronic conference server 310, and causes the user terminal 501 to play audio and video based on this data.

Similarly, the conference applications 121, 131, and 141 receive audio data picked up by the microphones of the user terminals 502, 503, and 504 and video data captured by the cameras of the user terminals 502, 503, and 504, and transmit them to the electronic conference server 310. The conference applications 121, 131, and 141 also receive audio data and video data from the electronic conference server 310, and cause the user terminals 502, 503, and 504 to play audio and video based on this data.

The electronic conference server 310 receives audio data and video data transmitted from the virtual machines 110, 120, 130, and 140 through the processing of the conference applications 111, 121, 131, and 141. The electronic conference server 310 then transmits the audio data and video data received from a specific virtual machine to a specific virtual machine. For example, the electronic conference server 310 transmits the audio data and video data received from the virtual machines 120, 130, and 140 to the virtual machine 110. The conference application 111 of the virtual machine 110 displays on the user terminal 501 audio synthesized based on the received audio data, and generates a display window for the electronic conference in which each image based on the received video data is arranged, and displays it on the user terminal 501.

The processing of agents 112, 122, 132, and 142 is realized by the virtual processors (actually processor 101) of virtual machines 110, 120, 130, and 140 executing the agent programs. Agent 112 periodically collects information indicating the usage mode of conference application 111, and registers it by overwriting the conference app information generated in registry 113. Information indicating the usage mode includes information indicating the state of the display window for electronic conferences and information indicating the on/off (mute) state of the microphone. In practice, this information is obtained via the OS (guest OS) of virtual machine 110.

Similarly, agents 122, 132, and 142 periodically collect information indicating the usage patterns of conference applications 121, 131, and 141, and overwrite and register the conference app information generated in registries 123, 133, and 143.

Registries 113, 123, 133, and 143 are realized by the storage areas of the virtual storage devices of virtual machines 110, 120, 130, and 140 (essentially storage devices provided in host server 100, such as HDD 103). Registries 113, 123, 133, and 143 are examples of storage units that store conference app information. Storing the conference app information in registries 113, 123, 133, and 143 makes it possible to easily read the conference app information from an external device (specifically, router 200) via virtual host processing unit 150.

However, the conference app information may be stored in a memory area other than the registry in the virtual storage device. In this case, for example, the conference app information may be read from an external device via the virtual host processing unit 150 and an agent.

The router 200 includes a conference monitoring unit 211 , an interest level determining unit 212 , a concentration level determining unit 213 , a quality priority determining unit 214 , a bandwidth control unit 215 , and a storage unit 220 .
The processes of the conference monitoring unit 211, the interest level determination unit 212, the concentration level determination unit 213, the quality priority level determination unit 214, and the bandwidth control unit 215 are realized, for example, by the processor 201 executing a predetermined firmware program. The conference monitoring unit 211 monitors the opening of a new electronic conference. When a new user joins an electronic conference that is being held, the interest level determination unit 212 determines the user's interest level in the electronic conference. The concentration level determination unit 213 periodically determines the concentration level in the electronic conference for each user participating in the electronic conference. The quality priority level determination unit 214 determines the quality priority level of the network quality (communication bandwidth) for each user participating in the electronic conference based on the determination results of the interest level and concentration level. The bandwidth control unit 215 controls the allocation of communication bandwidth to each user participating in the electronic conference based on the determination results of the quality priority level.

The memory unit 220 is realized as a storage area of a storage device provided in the router 200, such as the RAM 202. The memory unit 220 stores various data used in the bandwidth control process. As described below, the memory unit 220 stores such data as conference hosting information, an interest level table, a concentration level table, and a quality priority table.

8 is a diagram for explaining the process of collecting conference app information. In FIG. 8, the process in the virtual machine 110 is illustrated.
In the virtual machine 110, the agent 112 periodically collects information indicating the usage mode of the conference application 111, and overwrites and registers the information in the conference app information 114 generated in the registry 113. As information indicating the usage mode, the current window size of the display window for the electronic conference, the window display order indicating the display order of the display window, and the microphone status are collected and registered in the conference app information 114. As the window size, information indicating whether the display window is in a maximized state or a minimized state, or, if not, the vertical and horizontal sizes is registered. The window display order indicates the order (position) of the display window in the depth direction with respect to the screen. For example, information indicating whether it is at the forefront or the number from the forefront is registered. The microphone status indicates whether the microphone is on or muted.

FIG. 9 is a diagram for explaining the process of collecting conference information.
When an electronic conference is scheduled, conference information 321 indicating the scheduled time of the electronic conference, a subject indicating the content, scheduled attendees, etc. is registered in the schedule management server 320. Although not shown, the schedule management server 320 also registers conference list information indicating a list of the registered conference information 321. The scheduled start date and time of the electronic conference is also registered in the conference list information.

The conference monitoring unit 211 of the router 200 periodically obtains conference list information from the schedule management server 320. When the conference monitoring unit 211 detects a newly started electronic conference at the scheduled start date and time based on the obtained conference list information, it obtains conference information 321 for that electronic conference from the schedule management server 320. The conference monitoring unit 211 generates conference information 221 for the newly started electronic conference and registers it in the memory unit 220, and registers the contents of the obtained conference information 321 to that conference information 221.

When an electronic conference is started, the electronic conference server 310 generates and stores participant information 311 that indicates the current participants in the electronic conference. Each time a participant joins the electronic conference, the electronic conference server 310 registers information indicating the participant in the participant information 311. Note that the conference information 321 and the participant information 311 are associated with each other by a conference ID that identifies the electronic conference.

When the conference holding monitoring unit 211 detects that a new electronic conference has started as described above, it periodically obtains participant information 311 corresponding to that electronic conference from the electronic conference server 310 until the electronic conference ends. The conference holding monitoring unit 211 then registers information indicating the current participants in the electronic conference in the conference holding information 221. The conference holding information 221 is made to always hold information indicating the current participants.

Figure 10 is a diagram showing an example of the configuration of conference information and participant information. As shown in Figure 10, conference information 321, for example, registers the date and time indicating the start date and time of the electronic conference, the subject indicating the content of the electronic conference, the organizer of the electronic conference, mandatory attendees who are scheduled to definitely attend the electronic conference, and optional attendees who are scheduled to voluntarily attend the electronic conference. Furthermore, participant information 311 registers the subject of the electronic conference and currently connected participants. A currently connected participant is a participant who is currently connected to the electronic conference server 310 via the conference application of the corresponding virtual machine, i.e., a user who is currently participating in the electronic conference.

In the conference information 221, the date and time, subject, organizer, required attendees, optional attendees of the conference information 321, and currently connected participants of the participant information 311 are registered.
11 is a diagram for explaining the interest level determination process. When a new participant is registered as a currently connected participant in the conference information 221 (i.e., when a new participant is detected), the interest level determination unit 212 obtains an email 331 of the participant from the email server 330 before the conference start time.

In this acquisition process, the interest level determination unit 212 first reads the subject of the electronic conference from the conference information 221, and uses morphological analysis to extract independent words other than words that indicate the conference itself (such as "conference," "electronic conference," "meeting," and "meeting") as keywords. For example, if the subject is "Meeting about license," morphological analysis breaks it down into "license," "about," and "meeting." Then, from the independent words "license" and "meeting," "meeting," which indicates the conference itself, "meeting" is excluded, and "license" is extracted as a keyword.

The interest level determination unit 212 notifies the email server 330 of the extracted keywords. The interest level determination unit 212 then requests a search for emails 331 that contain the keywords in the subject or body of emails 331 sent (or sent and received) by the participants during the period from the time the conference schedule was decided to the conference start time. The interest level determination unit 212 obtains the searched emails 331 from the email server 330.

Although not shown, the interest level determination unit 212 also obtains from the email server 330 invitation emails for the electronic conference that were sent to the participants when the schedule for the electronic conference was decided or that were sent by the participants themselves. The interest level determination unit 212 analyzes the emails obtained in this manner and registers the analysis results in the interest level table 222 registered in the storage unit 220. The interest level determination unit 212 then determines the participants' levels of interest in the electronic conference based on the analysis results of the emails, and registers them in the interest level table 222.

Figure 12 is a diagram showing an example of the configuration of a level of interest table. The level of interest table 222 is generated for each electronic conference by the level of interest determination unit 212 and stored in the storage unit 220. As shown in Figure 12, the level of interest table 222 registers a record for each participant participating in the electronic conference, and each record registers the participant's name, organizer identification information, invitee identification information, conference mention identification information, and level of interest.

The participant name field registers the name of the currently participating participant. The organizer identification information indicates whether the participant is the organizer of the electronic conference. If the participant is the organizer, "Yes" is registered, and if the participant is an invitee, "No" is registered. The invitee identification information indicates the type of invitee the participant is. Invitees include mandatory participants, who are required to participate in the electronic conference, and optional participants, whose participation is optional. The invitee identification information is registered as either a mandatory participant, an optional participant, or "No", indicating that the participant is not an invitee.

The organizer identification information and the invitee identification information are registered, for example, based on an invitation email to an electronic conference. For example, the sender of the invitation email is determined to be the organizer, the participants to whom the invitation email was sent (those listed in the "TO" field) are determined to be required participants, and the participants listed in the "CC (Carbon Copy)" field of the invitation email are determined to be optional participants. Alternatively, the organizer identification information and the invitee identification information may be registered based on the conference hosting information 221.

The conference mention identification information indicates whether or not an electronic conference was mentioned in an e-mail sent (or sent and received) by a participant. For example, when an e-mail containing a keyword in the subject or body is searched for in the e-mail server 330 using the procedure described in FIG. 11, the conference mention identification information is registered as "mention included." Note that, for example, when it is determined that a mention has been included, multiple levels of identification information may be registered depending on the number of times the keyword appears in the e-mail.

The interest level determination unit 212 determines the participants' level of interest in the electronic conference based on the information registered in each of the items of the organizer identification information, the invitee identification information, and the conference mention identification information, and registers the determination result in the interest level item. For example, points are defined for each of the items of the organizer identification information, the invitee identification information, and the conference mention identification information according to the registered information, and the interest level is calculated by adding up the points for each item.

As an example, for the organizer identification information, +2 points are assigned for "Yes" and no points are assigned for "No." For the invitee identification information, +1 point is assigned for required participants and no points are assigned for optional participants or non-invites. For the meeting mention identification information, +2 points are assigned for mention and no points are assigned for no mention. If such a point assignment method is adopted, for example, for user U1 in Figure 12, the interest level will be "+4" based on the calculation "2 + 0 + 2."

This processing makes it possible to accurately estimate the participants' level of interest in the electronic conference. In the communication bandwidth allocation control described below, the more interested a user is, the wider the communication bandwidth is allocated so that the playback quality of the audio and video is higher. In particular, by determining the level of interest according to the conference mention identification information, it becomes possible to change the allocation of the communication bandwidth according to the state of references to the electronic conference in past e-mails. For example, the more the electronic conference is mentioned in past e-mails and the more frequently such references are made, the higher the prior interest in the electronic conference is, and the higher the importance of the electronic conference to the participants is estimated to be. By using the conference mention identification information, it is possible to allocate a wider communication bandwidth to such participants and improve the playback quality of the audio and video.

Figure 13 is a diagram for explaining the concentration level determination process. As described above, in the virtual machine on which the electronic conference is being held, the latest information indicating the usage mode of the conference application is registered in the conference app information in the registry by the agent's processing. While the electronic conference is being held, the concentration level determination unit 213 of the router 200 periodically obtains the conference app information from the registry of the virtual machine on which the electronic conference is being held, and registers the contents of the conference app information in the concentration level table 223 in the memory unit 220.

13 illustrates an example in which an electronic conference is being held on the virtual machine 110. In this case, the concentration level determination unit 213 acquires the conference app information 114 stored in the registry 113 of the virtual machine 110 via the virtual host processing unit 150. As described below, a record is generated in the concentration level table 223 for each user participating in the electronic conference, and the content of the acquired conference app information is registered in the record of the corresponding user. In the example of FIG. 13, the concentration level determination unit 213 registers the content of the acquired conference app information 114 in the record of the concentration level table 223 corresponding to user U1. Then, the concentration level determination unit 213 determines the current concentration level of user U1 (participant) in the electronic conference based on the registered content, and registers the determination result in the record corresponding to user U1 in the concentration level table 223.

Figure 14 is a diagram showing an example of the configuration of a concentration level table. The concentration level table 223 is generated for each electronic conference by the concentration level determination unit 213 and stored in the memory unit 220. As shown in Figure 14, the concentration level table 223 registers a record for each participant currently participating in the electronic conference, and each record registers the participant name, window size, window display order, microphone status, and concentration level. The participant name field registers the name of the currently participating participant. The window size, window display order, and microphone status fields register the information of the same-named items included in the conference app information as is.

The concentration level determination unit 213 determines the level of concentration of participants in the electronic conference based on the information registered in each of the items of window size, window display order, and microphone status, and registers the determination result in the concentration level item. For example, points are defined for each of the items of window size, window display order, and microphone status according to the registered information, and the concentration level is calculated by adding up the points for each item.

As an example, for window size, +1 point is given when maximized, -1 point is given when minimized (1 point is subtracted), and no points are given in other cases. For window display order, +1 point is given when it is in the foreground, and no points are given in other cases. For microphone status, +1 point is given when it is on, and no points are given when it is off (muted). If such a point giving method is adopted, for example, for user U1 in Figure 14, the concentration level will be "+1" based on the calculation "0 + 1 + 0".

This type of processing allows participants' current levels of concentration on the electronic conference to be estimated with high accuracy. In the communication bandwidth allocation control described below, users who are more concentrated are allocated a wider communication bandwidth so that the playback quality of audio and video is improved.

For example, if a participant is actively participating in an electronic conference or is listening intently to the contents of the discussion in the electronic conference, the window size tends to become larger and the window display order tends to move to the front. The above process determines that such participants are highly concentrated, so a wide communication bandwidth can be allocated to such participants.

In addition, some participants may display the display window of a conference application while simultaneously running other applications to perform other tasks. Such participants do not necessarily require high quality audio and video playback. For such participants, the window size is likely to be small and the window display order is likely to be not at the forefront. Because the above process determines that such participants have a low concentration level, it is possible to limit the communication bandwidth allocated to such participants to some extent.

In addition, if a person is actively trying to speak in an electronic conference, there is a high possibility that the microphone state is on, whereas if the microphone state is muted, it is possible that the person is not actively trying to speak and is not concentrating on the conference itself. With the above process, it is possible to take such possibilities into account and allocate a wider communication bandwidth to participants who are likely to be concentrating on the conference.

Figure 15 is a diagram for explaining the quality priority determination process. The quality priority determination unit 214 periodically obtains the interest level and concentration level of each participant from the interest level table 222 and concentration level table 223 for a certain electronic conference, and determines the quality priority level of each participant based on the interest level and concentration level. The quality priority level indicates the priority of communication quality for a participant. The higher the quality priority level of a participant, the wider the communication bandwidth is allocated to that participant.

The quality priority determination unit 214 generates a quality priority table 224 for each electronic conference and registers it in the storage unit 220. As shown in FIG. 15, the quality priority table 224 registers a record for each participant participating in the electronic conference, and each record registers the participant's name, interest level, concentration level, and quality priority.

The quality priority determination unit 214 registers the interest level for each participant obtained from the interest level table 222 in the interest level field of the corresponding participant in the quality priority table 224. At the same time, the quality priority determination unit 214 registers the concentration level for each participant obtained from the concentration level table 223 in the concentration level field of the corresponding participant in the quality priority table 224. Then, the quality priority determination unit 214 calculates a quality priority for each participant by adding the interest level and concentration level, and registers it in the record of the corresponding participant in the quality priority table 224.

Figure 16 is a diagram for explaining the control of communication bandwidth allocation. The bandwidth control unit 215 periodically obtains the quality priority of each participant currently participating in the electronic conference from the quality priority table 224. Based on the obtained quality priority, the bandwidth control unit 215 controls the allocation of communication bandwidth for packets transmitted between the virtual machine corresponding to the participant and the electronic conference server 310.

Figure 16 illustrates an example of bandwidth allocation control in the network 420 for packets sent to the electronic conference server 310. In the example of Figure 16, the network 420 is provided with a high priority lane 431 dedicated to high priority packets, a priority lane 432 dedicated to medium priority packets, and a general lane 433 dedicated to low priority packets. The high priority lane 431 is assigned a higher communication bandwidth than the priority lane 432, and the general lane 433, in that order.

Note that each of these lanes may be secured as separate, physically separated transmission paths, or may be logically provided on the same transmission path. In the latter case, for example, the number of times packets are transmitted to the network 420 is controlled according to a communication bandwidth ratio determined between high priority packets, medium priority packets, and low priority packets. For example, if the communication bandwidth ratio between high priority packets, medium priority packets, and low priority packets is 3:2:1, packet transmission is controlled so that the number of times high priority packets are transmitted within a unit time is 1/2 of the total.

In the example of FIG. 16, users U1 to U3 are participating in an electronic conference using virtual machines 110 to 130. In this case, the bandwidth control unit 215 assigns one of the lanes to packets from the virtual machine 110 to the electronic conference server 310 based on the quality priority of user U1 obtained from the quality priority table 224. Similarly, the bandwidth control unit 215 assigns one of the lanes to packets from the virtual machine 120 to the electronic conference server 310 based on the quality priority of user U2 obtained from the quality priority table 224. The bandwidth control unit 215 also assigns one of the lanes to packets from the virtual machine 130 to the electronic conference server 310 based on the quality priority of user U3 obtained from the quality priority table 224.

Note that lane allocation is performed, for example, by setting thresholds TH1 and TH2 (where TH1<TH2) in advance, and comparing the quality priority with the thresholds TH1 and TH2. For example, if the quality priority is equal to or lower than the threshold TH1, the general lane 433 is assigned, if the quality priority is higher than the threshold TH1 and equal to or lower than the threshold TH2, the priority lane 432 is assigned, and if the quality priority is higher than the threshold TH2, the high priority lane 431 is assigned.

The bandwidth control unit 215 also assigns the general lane 433 to packets transmitted from a virtual machine 140 where no electronic conference is being held. The bandwidth control unit 215 also assigns the general lane 433 to packets transmitted from virtual machines 110 to 130 where an electronic conference is being held, and addressed to a server (other server 340) other than the electronic conference server 310 on the network 420.

Figure 16 also shows the bandwidth allocation on the network 420 for packets sent from the virtual machine on which the electronic conference is being held to the electronic conference server 310. However, the bandwidth allocation on the network 410 for packets sent from the electronic conference server 310 to the virtual machine can also be performed in a similar manner.

Figure 17 is a timing chart showing an example of communication bandwidth allocation control according to changes in the usage pattern of a conference application. In Figure 17, a certain user participates in an electronic conference at time T1 using a corresponding virtual machine, and leaves the electronic conference at time T6.

When you first join an electronic conference, the conference application display window is set to full screen, the window display order is set to the foreground, and the microphone is on. In this case, a high priority lane is assigned to packets transmitted between the virtual machine and the electronic conference server 310. This ensures high quality audio and video playback.

Now, assume that at time T2, the window size is reduced and the microphone state is muted. At this time, the quality priority is lowered, and the lane assigned to packets transmitted between the virtual machine and the electronic conference server 310 is changed from the high priority lane to the priority lane. This ensures a moderate level of quality for audio and video playback.

If the microphone state is then turned back on at time T3, the quality priority increases, and the lane assigned to packets transmitted between the virtual machine and the electronic conference server 310 is changed from the priority lane to the high priority lane. This ensures high quality for audio and video playback.

If the microphone state is then muted again at time T4, the quality priority is lowered and the lane assigned to packets transmitted between the virtual machine and the electronic conference server 310 is changed from the high priority lane to the priority lane. This ensures a medium level of quality for audio and video playback.

If the window display order subsequently becomes second from the front at time T5, the quality priority is further lowered, and the lane assigned to packets transmitted between the virtual machine and the electronic conference server 310 is changed from the priority lane to the general lane. This ensures a minimum quality for audio and video playback.

The above-described processing of the router 200 allows the allocation of communication bandwidth to packets transmitted between the virtual server where the electronic conference is being held and the electronic conference server 310 to be optimized. In particular, by using both the interest level and the concentration level to allocate bandwidth, a highly accurate allocation control can be performed according to the participants' audio and video needs by combining the participant's index determined at the start of the electronic conference with an index according to the participant's state during the electronic conference. For example, when only the concentration level is used, if multiple participants have the same concentration level, each participant is assigned the same communication bandwidth. However, even if the concentration level is the same, high quality audio and video may not be required depending on the importance of the electronic conference. Therefore, by using both the interest level and the concentration level, it is possible to improve the accuracy of optimizing the allocation of communication bandwidth.

Next, the processing of the virtual machine will be described with reference to a flowchart.
FIG. 18 is an example of a flowchart illustrating a procedure of a conference application information collection process in a virtual machine.

[Step S11] The virtual machine agent determines whether a conference application is running on the virtual machine. If the conference application is running, the process proceeds to step S12. If the conference application is not running, the process proceeds to step S14.

[Step S12] The agent acquires the window size and window display order of the display window of the conference application, and the microphone state. This information is acquired from the conference application, for example, via the guest OS of the virtual OS.

[Step S13] The agent overwrites the conference app information stored in the registry with the information acquired in step S12 and registers it. If the conference app information is not stored in the registry, the agent generates conference app information, stores it in the registry, and registers the acquired information in the conference app information.

[Step S14] If the conference application information is stored in the registry, the agent deletes the conference application information.
[Step S15] The agent goes into a waiting state for a predetermined time (for example, 10 seconds). After the predetermined time has elapsed, the process returns to step S11.

Next, the process of the router 200 will be described with reference to a flowchart.
FIG. 19 is an example of a flowchart showing a procedure for a conference monitoring process.
[Step S21] The conference monitoring unit 211 acquires conference list information from the schedule management server 320.

[Step S22] The conference monitoring unit 211 determines whether there is an electronic conference that has a new scheduled start time based on the scheduled start time of the electronic conference listed in the conference list information. If there is a relevant electronic conference, the process proceeds to step S23. If there is no relevant electronic conference, the process proceeds to step S24.

[Step S23] The conference monitoring unit 211 acquires conference information 321 for the electronic conference that has reached its new scheduled start time (i.e., the newly started electronic conference) from the schedule management server 320. The conference monitoring unit 211 generates conference information 221 for the newly started electronic conference and registers it in the storage unit 220, and registers the contents of the acquired conference information 321 to the conference information 221.

[Step S24] The conference monitoring unit 211 acquires participant information 311 for the ongoing electronic conference from the electronic conference server 310. The conference monitoring unit 211 updates the participant information registered in the corresponding conference information 221 with the participant information registered in the acquired participant information.

[Step S25] The conference monitoring unit 211 waits for a predetermined time (for example, 10 seconds). After the predetermined time has elapsed, the process returns to step S21.
FIG. 20 is an example of a flowchart illustrating a procedure for an interest level determination process.

[Step S31] The interest level determination section 212 refers to the conference information 221 in the storage section 220.
[Step S32] The interest level determination unit 212 determines whether or not a new participant has joined the electronic conference based on the participant information registered in the conference information 221. If a relevant participant is present, the process proceeds to step S33; if not, the process proceeds to step S36.

Here, the following processes in steps S33 to S35 are executed for each of the new participants extracted in step S32.
[Step S33] The interest level determination unit 212 extracts independent words by performing a morphological analysis on the subject registered in the conference information 221. The interest level determination unit 212 extracts, as keywords, the independent words excluding the word indicating the conference itself from the extracted independent words.

[Step S34] The interest level determination unit 212 notifies the email server 330 of the extracted keywords and requests a search for emails. At this time, the email server 330 is notified of the participants' user IDs, the time when the electronic conference was scheduled, and the scheduled start time of the electronic conference, along with the keywords.

In response to the search request, the email server 330 extracts emails sent (or sent and received) by participants during the period from the time the electronic conference was scheduled to the scheduled start time. The email server 330 searches the extracted emails for emails that contain keywords in the subject or body. If matching emails are found, they are sent to the interest level determination unit 212, which acquires them. On the other hand, if matching emails are not found, notification information indicating this is sent to the interest level determination unit 212. As another example, notification information indicating whether matching emails have been found may be sent to the interest level determination unit 212.

The interest level determination unit 212 also obtains, from the email server 330, an invitation email for the electronic conference that was sent when the schedule for the electronic conference was decided.
[Step S35] The interest level determination unit 212 registers a record of the new participant in the interest level table 222 in the storage unit 220. If there is no interest level table 222 corresponding to the electronic conference, the interest level determination unit 212 generates a new interest level table 222, stores it in the storage unit 220, and registers a record of the new participant.

The interest level determination unit 212 registers information in the organizer identification information and invitee identification information of the registered record based on the invitation email acquired in step S34. In addition, if a search result corresponding to the keyword is obtained in step S34, the interest level determination unit 212 registers "mention" in the conference mention identification information of the registered record, and if no search result is obtained, the interest level determination unit 212 registers "no mention" in the conference mention identification information.

The interest level determination unit 212 calculates the interest level of each participant based on the registered contents of the host identification information, the invitee identification information, and the conference mention identification information, and registers the calculated level in the same record.
[Step S36] The interest level determination section 212 waits for a predetermined time (for example, 10 seconds). After the predetermined time has elapsed, the process returns to step S31.

FIG. 21 is an example of a flowchart illustrating a procedure for a bandwidth control process.
[Step S41] The concentration level determination unit 213 acquires the participant information 311 for the electronic conference being held from the electronic conference server 310. In this way, the concentration level determination unit 213 recognizes the participants currently taking part in the electronic conference.

Here, the following processes in steps S42 to S45 are executed for each of the participants recognized in step S41.
[Step S42] The concentration level determination unit 213 acquires the conference application information 114 from the register of the virtual machine used by the participant.

[Step S43] The concentration level determination unit 213 calculates the concentration level of each participant based on the contents registered in the acquired conference app information 114.
[Step S44] The quality priority determination unit 214 calculates a quality priority for the user based on the user's interest level registered in the interest level table 222 and the user's concentration level calculated in step S43.

[Step S45] The bandwidth control unit 215 allocates a communication bandwidth to packets transmitted between the virtual machine corresponding to the participant and the electronic conference server 310 based on the calculated quality priority.

[Step S46] The bandwidth control unit 215 waits for a predetermined time (for example, 10 seconds). After the predetermined time has elapsed, the process returns to step S41.
The processing functions of the devices (e.g., communication control device 30, host server 100, router 200, electronic conference server 310, schedule management server 320, and email server 330) shown in each of the above embodiments can be realized by a computer. In this case, a program describing the processing contents of the functions that each device should have is provided, and the above processing functions are realized on the computer by executing the program on a computer. The program describing the processing contents can be recorded on a computer-readable recording medium. Examples of computer-readable recording media include magnetic storage devices, optical disks, and semiconductor memories. Examples of magnetic storage devices include hard disk drives (HDDs) and magnetic tapes. Examples of optical disks include CDs (Compact Discs), DVDs (Digital Versatile Discs), and Blu-ray Discs (BD, registered trademark).

When distributing a program, for example, portable recording media such as DVDs and CDs on which the program is recorded are sold. The program can also be stored in a storage device of a server computer, and the program can be transferred from the server computer to other computers via a network.

A computer that executes a program stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. The computer then reads the program from its own storage device and executes processing according to the program. Note that the computer can also read a program directly from a portable recording medium and execute processing according to that program. The computer can also execute processing according to the received program each time a program is transferred from a server computer connected via a network.

10 Server 21-23 Client 30 Communication control device 31 Processing unit 41 Broadband 42 Narrowband A-C Users S1-S3 Steps

Claims (6)

Collecting emails sent and received by each of a plurality of users participating in an electronic conference before the electronic conference is started, and determining a level of interest in the electronic conference for each of the plurality of users based on an analysis result of the collected emails;
collecting, from a plurality of clients used by each of the plurality of users, usage patterns of an electronic conference application in each of the plurality of clients during the electronic conference, and determining a concentration level of each of the plurality of users on the electronic conference based on the collected usage patterns;
a processing unit that controls a communication bandwidth to be allocated to communication between a server that controls the electronic conference and each of the plurality of clients based on the determination results of the interest level and the concentration level;
A communication control device having the above configuration. The degree of interest is determined based on a reference state of the electronic conference in the collected emails.
The communication control device according to claim 1. In the determination of the interest level,
Acquiring a wording contained in the subject of the electronic conference from the scheduled information about the electronic conference;
determining the degree of interest based on the description of the wording in the collected e-mails;
The communication control device according to claim 1. As the usage form, a position of a display window of the electronic conference application in a depth direction of a screen is collected.
The communication control device according to any one of claims 1 to 3. The computer
Collecting emails sent and received by each of a plurality of users participating in an electronic conference before the electronic conference is started, and determining a level of interest in the electronic conference for each of the plurality of users based on an analysis result of the collected emails;
collecting, from a plurality of clients used by each of the plurality of users, usage patterns of an electronic conference application in each of the plurality of clients during the electronic conference, and determining a concentration level of each of the plurality of users on the electronic conference based on the collected usage patterns;
controlling a communication bandwidth to be allocated to communication between a server that controls the electronic conference and each of the plurality of clients based on the determination results of the interest level and the concentration level;
Communications control method. On the computer,
Collecting emails sent and received by each of a plurality of users participating in an electronic conference before the electronic conference is started, and determining a level of interest in the electronic conference for each of the plurality of users based on an analysis result of the collected emails;
collecting, from a plurality of clients used by each of the plurality of users, usage patterns of an electronic conference application in each of the plurality of clients during the electronic conference, and determining a concentration level of each of the plurality of users on the electronic conference based on the collected usage patterns;
controlling a communication bandwidth to be allocated to communication between a server that controls the electronic conference and each of the plurality of clients based on the determination results of the interest level and the concentration level;
A communication control program that executes processing.

Images