JP5402389B2 - Electronic conference system, distribution management server, data control method, program, and recording medium - Google Patents

Description

  The present invention relates to an electronic conference system, a distribution management server, a data control method, a program, and a recording medium.

  An electronic conference system (remote conference system) is a system that communicates video and audio with each other using a remote conference terminal such as a dedicated machine or a personal computer between two or more sites via a network. In the electronic conference system, the video / audio communication quality strongly depends on the network bandwidth to be used. In the conventional electronic conference system, when the usable network bandwidth is narrow, the video / audio quality is reduced (data amount is reduced) so that the video / audio is not interrupted.

  Here, an example of a remote conference in which a presentation is given between two sites will be described. First, suppose that there is a presenter at site A, and he / she listens at site B. In order to listen to the announcement at site B, the video and audio at site A are set to be of high quality. At the A site, in preparation for the Q & A, the video and audio at the B site are set to be of high quality. Here, if the network bandwidth is not sufficient, data of either the A base or the B base is lost. For example, when the data sent from the A site is lost, the video or audio of the B site is disturbed, so that there is a problem that presentation materials cannot be read or the contents of the presentation are missed. In preparation for this problem, there is a remote conference system equipped with a function for automatically adjusting video / audio quality according to network bandwidth.

  For example, in Japanese Patent Application Laid-Open No. 2007-329682, for example, transmission / reception data such as microphone volume and data is monitored, and the priority of data allocated to the band is dynamically changed according to a change in the state of the conference to optimize the band. Thus, a technique for realizing a smooth electronic conference system is disclosed.

  However, in the conventional electronic conference system, the amount of data to be transmitted / received is determined according to the conference state change. However, depending on the communication status of the network, the optimally determined data may not be accurately transmitted / received. There was a problem.

  Therefore, the present invention has been made in view of the above problems, and in an electronic conference system, an electronic conference system that can determine the optimum data amount according to the type of conference in consideration of the communication status of the network, It is an object to provide a distribution management server, a data control method, a program, and a recording medium.

An electronic conference system according to an aspect of the present invention is an electronic conference system in which a plurality of communication terminals and a distribution management server are connected via a network and performs data communication for performing a conference between the communication terminals. The terminal includes reception quality information indicating a communication state of the network when data is received, conference type information indicating the type of the conference, conference identification information for identifying the conference, and a terminal for identifying the communication terminal that performs the conference Transmission means for transmitting conference attribute information including identification information to the distribution management server, the distribution management server, receiving means for receiving the reception quality information and the conference attribute information, and for each of the conference type information, first storage means for storing the quality control information that associates the compression parameter of the reception quality information and data, a second memory for storing the conference attribute information Based on the stage and a third storage means for storing the meeting priority information associating a priority about the meeting with the terminal identification information, the conference type information included in the reception quality information and the conference attribute information has been received , a distribution management control means for acquiring the compression parameter from the quality control information, said compression parameter acquired and a transmitting means for transmitting to the communication terminal, the distribution management control means, the reception quality information is again If received, comprising: specifying means for specifying the conference type information from the terminal identification information of the communication terminal that has transmitted the reception quality information and the conference attribute information stored in the second storage means, The average value of the priority order specified from the conference type information, the terminal identification information included in the conference attribute information, and the conference priority information, and the received product received again Based on the information, the compression parameter is acquired from the quality management information, and the distribution management control means counts when the reception quality information is a predetermined value or more, and the count value exceeds the average value. In the case of the above, the compression parameter is acquired so as to further reduce the quality of video and / or audio.

A distribution management server according to another aspect of the present invention is a distribution management server that receives video data and audio data from a plurality of communication terminals, and transmits the synthesized video data and audio data to each communication terminal, identifying the reception quality information indicating the communication status of the network when the communication terminal receives data, meeting the type information indicating the type of meeting, conference identification information identifying the conference, and the communication terminal to perform the conferencing Receiving means for receiving conference attribute information including terminal identification information, storage means for storing quality management information in which the reception quality information and a data compression parameter are associated for each conference type information, and the conference attribute information. Storage means for storing; storage means for storing conference priority information associating the terminal identification information with a priority order for the conference; and the received reception quality information. And, based on the conference type information included in the conference attribute information, a distribution management control unit that acquires the compression parameter from the quality management information, and a transmission unit that transmits the acquired compression parameter to the communication terminal, And the distribution management control means, when receiving quality information is received again, specifying means for specifying the meeting type information from the terminal identification information and the meeting attribute information of the communication terminal that has transmitted the receiving quality information And the specified conference type information, the average value in the priority order specified from the terminal identification information and the conference priority information included in the conference attribute information, and the reception quality information received again. Based on the quality management information, and the distribution management control means counts a case where the reception quality information is greater than or equal to a predetermined value. Collected by, when the count value exceeds the average value, further obtains the compression parameters to drop the quality of video and / or audio.

A data control method according to another aspect of the present invention is a data control method in a distribution management server that receives video data and audio data from a plurality of communication terminals and transmits the synthesized video data and audio data to each communication terminal. a is, communication performed the reception quality information indicating the communication status of the network when the communication terminal receives data, meeting the type information indicating the type of meeting, conference identification information identifying the conference, and the conference A reception step for receiving conference attribute information including terminal identification information for identifying a terminal, and a quality control information stored in storage means and associated with the reception quality information and data compression parameters for each conference type information A distribution pipe for acquiring the compression parameter from the conference type information included in the received reception quality information and the conference attribute information. And a transmission step of transmitting the acquired compression parameter to the communication terminal, and the distribution management control step is a communication that transmits the reception quality information when the reception quality information is received again. A step of specifying the conference type information from the terminal identification information of the terminal and the conference attribute information, the specified conference type information, the terminal identification information included in the conference attribute information, and the terminal identification The compression parameter is acquired from the quality management information based on the average value of the priority order specified from the conference priority information that associates the information and the priority order for the conference, and the received quality information received again. Further, the distribution management control step counts when the reception quality information is equal to or greater than a predetermined value, and when the count value exceeds the average value, Obtaining said compression parameters to drop the quality of video and / or audio.

  In addition, the electronic conference system, distribution management server, and data communication method of the present invention can be realized by a program executable by a computer, and can also be realized by causing a computer to read a recording medium on which the program is recorded. Is possible.

  According to the present invention, in an electronic conference system, an electronic conference system, a distribution management server, a data control method, a program, and an electronic conference system that can determine an optimum data amount according to the type of conference in consideration of the communication status of the network, A recording medium can be provided.

The figure which shows an example of the electronic conference system which concerns on this invention. The block diagram which shows an example of the hardware constitutions of the delivery management server concerning this invention FIG. 2 is a block diagram illustrating an example of a functional configuration of a remote conference terminal according to the first embodiment. The figure which shows the packet format of RTCP RR. FIG. 3 is a block diagram illustrating an example of a functional configuration of a distribution management server according to the first embodiment. The figure which shows an example of the data structure memorize | stored in meeting management DB. The figure which shows an example of the data structure memorize | stored in quality management DB. FIG. 6 is a sequence diagram illustrating an example of a communication control process in the first embodiment. FIG. 3 is a sequence diagram illustrating an example of a communication end process according to the first embodiment. FIG. 9 is a block diagram illustrating an example of a functional configuration of a distribution management server according to the second embodiment. FIG. 10 is a diagram illustrating an example of a data structure of a priority information DB in the second embodiment. FIG. 10 is a diagram illustrating an example of a data structure of a conference management DB according to the second embodiment. FIG. 10 is a diagram illustrating an example of a data structure of a quality management DB according to the second embodiment. The figure which shows an example of the electronic conference system (the 1) which concerns on a modification. The figure which shows an example of the electronic conference system (the 2) which concerns on a modification.

  Exemplary embodiments of an electronic conference system, a distribution management server, a data control method, a program, and a recording medium according to the present invention will be described below in detail with reference to the accompanying drawings.

<System configuration and hardware configuration>
FIG. 1 is a diagram showing an example of an electronic conference system according to the present invention. As shown in FIG. 1, the electronic conference system includes a distribution management server 10, a remote conference terminal (communication terminal) A20, and a remote conference terminal B30.

  In the electronic conference system according to the present invention, each remote conference terminal and the distribution management server are connected via a network and are in a communicable state. Each remote conference terminal transmits the type of conference (for example, presentation format or review format), conference parameters, and reception quality of video / audio data to the distribution management server 10. The distribution management server 10 remotely increases the bandwidth of the video / audio data determined to have a high priority according to the type of conference and the reception quality, and lowers the bandwidth of the video / audio data determined to have a low priority. Instruct the conference terminal.

  Next, the hardware configuration of the distribution management server 10 according to the present invention will be described. FIG. 2 is a block diagram showing an example of the hardware configuration of the distribution management server 10 according to the present invention.

  As shown in FIG. 2, the distribution management server 10 includes a control unit 11, a main storage unit 12, an auxiliary storage unit 13, an external storage device I / F unit 14, a network I / F unit 16, an operation unit 17, and a display unit 18. including.

  The control unit 11 is a CPU that controls each device, calculates data, and processes in a computer. The control unit 11 is an arithmetic device that executes a program stored in the main storage unit 12, receives data from the input device or the storage device, calculates and processes the data, and outputs the data to the output device or the storage device.

  The main storage unit 12 is a ROM (Read Only Memory), a RAM (Random Access Memory), or the like, and a storage device that stores or temporarily stores programs and data such as an OS and application software that are basic software executed by the control unit 11. It is.

  The auxiliary storage unit 13 is an HDD (Hard Disk Drive) or the like, and is a storage device that stores data related to application software or the like.

  The external storage device I / F unit 14 is an interface between the distribution management server 10 and a storage medium 15 (for example, a flash memory) connected via a data transmission path such as USB (Universal Serial Bus).

  In addition, a predetermined program is stored in the storage medium 15, and the program stored in the storage medium 15 is installed in the distribution management server 10 via the external storage device I / F unit 14, and the installed predetermined program is It can be executed by the distribution management server 10.

  The network I / F unit 16 has a communication function connected via a network such as a LAN (Local Area Network) or a WAN (Wide Area Network) constructed by a data transmission path such as a wired and / or wireless line. This is an interface between the device and the distribution management server 10.

  The operation unit 17 and the display unit 18 include a key switch (hard key) and an LCD (Liquid Crystal Display) having a touch panel function (including a GUI software key: Graphical User Interface), and the distribution management server 10 has. It is a display and / or input device that functions as a UI (User Interface) when using the function. The display unit 18 is not always necessary.

[Example 1]
Next, the electronic conference system according to the first embodiment will be described. FIG. 3 is a block diagram illustrating an example of a functional configuration of the remote conference terminal A20 according to the first embodiment. The remote conference terminal A20 includes a camera 201, a video input control unit 202, and a video encoder 203 for encoding (encoding) video. The remote conference terminal A20 includes a microphone 209, a voice input control unit 210, and a voice encoder 211 for encoding voice. In addition, the remote conference terminal A20 includes an operation control unit 205 and a distribution policy control unit 206 in order to control data to be transmitted.

  Further, the remote conference terminal A20 includes a distribution control unit 212 and a communication control unit 207 in order to communicate each data to the distribution management server 10. The remote conference terminal A20 also includes a video decoder 214, a video output control unit 215, and a video display device 216 for decoding and displaying video. In addition, the remote conference terminal A20 includes an audio decoder 217, an audio output control unit 218, and a speaker 219 for decoding and outputting audio.

  The camera 201 captures an image and outputs the captured image to the image input unit 202. The video input control unit 202 handles the device driver of the camera connected to the remote conference terminal A20 and the video data input from the camera.

  The video encoder 203 is a video codec that compresses uncompressed video data acquired via the video input control unit 202. Examples of compression methods include H.264 and MPEG-4. In addition, the video encoder 203 changes the compression parameters according to the compression parameters (compression method, resolution, frame rate, bit rate, etc.) instructed from the distribution control unit 212.

  The microphone 209 inputs the speaker's voice and outputs the voice data to the voice input control unit 210. The voice input control unit 210 handles the device driver of the microphone connected to the remote conference terminal A20 and the voice data input from the microphone.

  The audio encoder 211 is an audio codec that compresses uncompressed audio data acquired via the audio input control unit 210. There are G.711 and AAC as compression methods.

  The operation unit 204 has a function of accepting an operation from a user, and is, for example, a button. The operation control unit 205 has a function of controlling button operations. The user selects a conference type such as a presentation format, a review format, an instruction / command format, and a brainstorming format via the operation unit 204. The operation control unit 205 outputs the conference type information selected by the user to the distribution policy control unit 206.

  The distribution policy control unit 206 sends the conference type information indicating the conference type, the terminal identification information for identifying the remote conference terminal, and the conference attribute information including the conference identification information for identifying the conference via the communication control unit 207. To the distribution management server 10.

  Further, the distribution policy control unit 206 has a function of transmitting / receiving, via the communication control unit 207, reception quality information indicating the communication status of the network or notification of conference termination, a compression parameter instruction from the distribution management server 10, and the like.

  Here, data handled by the distribution policy control unit 206 will be described in detail. The conference attribute information notifies the distribution management server 10 of the conference type, the ID of the remote conference terminal that hosts (owns) the conference, and the IDs of other terminals. Here, the ID may be an IP address or a SIP URI. The type of meeting includes a presentation format or a review format, an instruction / command format, and a brainstorming format. The meeting type may be text, or an ID may be defined according to the type and the ID transmitted. The transmission data can be realized in a text format or a binary format.

  Next, reception quality information will be described. Since RTCP's RR (Receiver Reports), which will be described later, can easily grasp the reception packet interval jitter, the packet loss occurrence rate, and the network delay time, these data are transferred to the distribution management server 10.

  The reception quality information includes the ID of the remote conference terminal on the receiving side / distribution source. Furthermore, it is possible to change to a more optimal video / audio by calculating and transmitting the usable network bandwidth, retransmission allowable time, etc. without using RTCP or in combination with RTCP.

  Next, the conference end notification will be described. The conference end notification is information for notifying the distribution management server 10 that the conference has ended. The end notification includes the conference ID.

  Next, compression parameters will be described. The compression parameters include resolution and frame rate for video and bit rate for audio. For example, the resolution includes 1920 × 1080, 1280 × 720, and the like. There are 30 and 15 frame rates. Bit rates include 256 kbps and 128 kbps.

  In addition, the compression parameter may be a percentage of the terminal initial setting value, a compression algorithm, or the like. In the case of audio, a compression algorithm, an average data compression amount, a sampling frequency, or the like may be used.

  Further, the compression parameter may indicate the screen layout on which the remote conference is to be performed. For example, when a remote conference between three sites is performed, the size of the video, the display position, the size of the conference material, and the display position may be designated.

  The distribution control unit 212 transmits the video data and audio data acquired from the video encoder 203 and the audio encoder 211 to the distribution management server 10 via the network. Also, the distribution control unit 212 outputs the video data and audio data received from the distribution management server 10 to the video decoder 214 and the audio decoder 217.

  Also, the distribution control unit 212 controls, for example, RTP (Real-time Transport Protocol) and RTSP (Real Time Streaming Protocol) clients and servers and RTCP (RTP Control Protocol). RTP is a data transfer protocol for delivering data streams such as voice and moving images in real time. RTSP is a protocol for controlling streaming data (so-called Video Cassette Recorder operation) and operates in cooperation with RTP. RTCP is a protocol for controlling a session for transmitting and receiving data by RTP.

  In addition, the distribution control unit 212 includes communication means for exchanging RTSP addresses with each other. For example, it is conceivable to connect to each other using a POSIX (Portable Operating System Interface) standard socket interface. In addition, the distribution control unit 212 is configured by SIP or H.264. Call control such as H.323 may be used.

  Further, the distribution control unit 212 calculates reception quality. Hereinafter, a method of grasping the reception packet interval jitter, the packet loss occurrence rate, and the network delay time by the RTCP RR will be described.

  FIG. 4 is a diagram illustrating a packet format of RTCP RR. The missing rate includes a value obtained by dividing the number of packets lost in a certain reporting interbel by the number to be received. The missing rate expresses a binary decimal point as a fixed-point number set at the left end of the field. That is, it becomes the same value as the integer part of the number obtained by multiplying the missing rate by 256.

  For example, when a 1/4 packet is lost, the drop rate is 1/4 × 256 = 64. When the number of received packets is larger than the number to be received due to packet duplication, and the number of missing packets becomes negative, 0 is set as the missing rate.

  The packet jitter interval is a drop-down estimate of the variation in network transfer time for the data packet transmitted by the report subject's SSRC. A time stamp is used for this measurement unit. Therefore, it is represented by a 32-bit unsigned integer, similar to the RTP time stamp.

  The network delay time may be, for example, the time from when an ICMP “echo request” is transmitted to the other party until the response “echo reply” is received, as the network delay time. The network round trip time can also be calculated using RTCP RR and SR (Sender Reports).

  The value calculated by this method is the network round trip time. Processing time at the endpoint (eg, time to buffer data before media playback to mitigate the effects of jitter on the receiving side) is not included.

  The sender must calculate the round trip time with the receiver using the time stamp of the latest transmission report (LSR: Last Sender Report) of the RR and the field of the latest transmission report elapsed time (DLSR: Delay since Last Sender Report). Can do. If the value of the LSR field is subtracted from the current time when the RR packet is received, the elapsed time from when the SR packet is transmitted to when the RR packet is received can be obtained. If the value of the DLSR field is further subtracted from that value, and the elapsed time due to processing on the receiving side is removed, the round-trip time of the network can be acquired.

  Returning to FIG. 3, the communication control unit 207 includes a protocol stack and a network interface card necessary for communication. The video decoder 214 is a video codec that decompresses the compressed video data acquired from the distribution control unit 212.

  The video output control unit 215 is a device driver of a video display device 216 such as a display connected to the remote conference terminal A20, and outputs the video data expanded by the video decoder 214 to the video display device 216. The video display device 216 is a display that displays video, such as an LCD (Liquid Crystal Display).

  The audio decoder 217 is an audio codec that decompresses the audio data acquired from the distribution control unit 212. The audio output control unit 218 is a device driver of the speaker 219 connected to the remote conference terminal A20, and outputs the audio data expanded by the audio decoder 217 to the speaker 219. The speaker 219 outputs sound data acquired from the sound output control unit 218.

  Next, functions of the distribution management server 10 will be described. FIG. 5 is a block diagram illustrating an example of a functional configuration of the distribution management server 10 according to the first embodiment. As shown in FIG. 5, the distribution management server 10 includes a communication control unit 101, a distribution management control unit 100, a conference management DB (second storage unit) 104, and a quality management DB (first storage unit) 106. The distribution management control unit 100 includes a distribution policy control unit 102, a conference management unit 103, and a quality management unit 105.

  The communication control unit 101 includes a network interface card (NIC) device driver and a network stack. The communication control unit 101 transmits / receives each data to / from each remote conference terminal via the network.

  The distribution management control unit 100 determines a compression parameter from the quality management DB 106 based on the reception quality information acquired from the communication control unit 101 and the conference type information included in the conference attribute information. Details of the distribution management control unit 100 will be described below.

  The distribution policy control unit 102 has a function of receiving conference attribute information (conference type, terminal ID, etc.), reception quality information (jitter, packet loss occurrence rate, delay time, etc.), and end notification from each remote conference terminal. Have Further, the distribution policy control unit 102 notifies the conference management unit 103 of the conference attribute information, acquires and determines the compression parameter from the quality management unit 105, and sets the communication control unit 101 to each remote conference terminal. A function of transmitting the compression parameter via

  Upon acquiring the meeting attribute information from the distribution policy control unit 102, the meeting management unit 103 stores it in the acquired meeting management DB 104.

  The conference management DB 104 stores and manages conference attribute information. FIG. 6 is a diagram illustrating an example of a data structure stored in the conference management DB 104. As shown in FIG. 6, a conference ID, a conference type, an owner terminal, and an audience terminal are associated with each other.

  For example, the conference ID “12345678” is associated with the conference type “presentation format”, the owner is “192.168.0.xx”, the audience 1 “192.168.0.xy”, and the audience 2 “192.168.1.yy”. .

  When the quality management unit 105 acquires the conference type information and the reception quality information from the distribution policy control unit 102, the quality management unit 105 acquires the compression parameter from the quality management DB 106. The quality management unit 105 outputs the acquired compression parameter to the distribution policy control unit 102.

  The quality management DB 106 stores and manages quality information indicating compression parameters corresponding to reception quality information for each conference type. FIG. 7 is a diagram illustrating an example of a data structure stored in the quality management DB 106.

  As shown in FIG. 7, compression parameters (video resolution, video frame rate, audio bit rate) corresponding to reception quality (packet loss value) are associated with each conference type.

  For example, when the conference type is “presentation format” and the packet loss threshold is “0 to 1%”, the resolution of the video of “owner” is “1920 × 1080” and the frame rate of the video is “30”. Yes, the audio bit rate is "256kbps". In the case of the same condition, the video resolution of “audience” is “720 × 480”, the video frame rate is “15”, and the audio bit rate is “256 kbps”.

  Thus, the quality management unit 105 can determine the compression parameter from the quality information when the conference type and the reception quality are determined.

  With the above function, the remote conference terminal according to the first embodiment can transmit the conference attribute information and the reception quality information to the distribution management server 10, and the distribution management server 10 can determine the compression parameter and issue a change instruction. .

<Operation>
Next, the operation of the electronic conference system according to the first embodiment will be described. FIG. 8 is a sequence diagram illustrating an example of the communication control process according to the first embodiment. As shown in FIG. 8, in step S <b> 101, the user sets a connection destination via the operation unit 204. There may be a plurality of connection destinations.

  In step S <b> 102, the user sets a conference type via the operation unit 204. The conference type is, for example, a presentation format, a review format, an instruction / command format, a brainstorming format, or the like. These types of meetings may be added / deleted according to the usage scene. The information set here is temporarily stored in the distribution policy control unit 206. At the same time, the setting information is also transmitted to the distribution control unit 212.

  In step S103, the distribution control unit 212 of the remote conference terminal A20 makes a connection request to the remote conference terminal B30. In step S104, the remote conference terminal B30 notifies the remote conference terminal A20 of connection permission. For example, both terminals are equipped with a Web client, receive SDP (Session Description Protocol) via HTTP, and start a media client (Windows Media Player, Quick time player, etc.).

  Since the media client receives the SDP from the web client, it starts by sending a SETUP. On the other hand, when the media client directly accesses the media via RTSP, it is necessary to start processing from DESCRIBE, receive SDP, and SETUP.

  Since the flow until receiving the video / audio data is in accordance with the standard, it is omitted. Further, when starting the video / audio distribution, both terminals may display a message for confirming whether the distribution can be started via the video output control unit 215. By performing this process between the terminals, bidirectional video / audio communication is started.

  Here, when the distribution is started, the remote conference terminal A20 creates a conference ID. The meeting ID may be a random number or a UUID (Universally Unique Identifier).

  In step S <b> 105, the distribution policy control unit 206 notifies the distribution management server 10 of the meeting attribute information. The conference attribute information includes conference type information, conference identification information for identifying a conference, terminal identification information for identifying a remote conference terminal, and the like.

The meeting attribute information is transmitted in the following format, for example.
SendConfProperty, 12345678,192.168.0.xx, 192.168.0.xy, 192.168.0.yy \ n (1)
(Conference attribute information), (Conference ID), (Owner terminal ID), (Audience 1 ID), (Audience 2 ID), ..., (Audience n ID) \ n
The conference attribute information is transmitted from the owner remote conference terminal A20 to the distribution management server 10 as text data over TCP / IP.

  In step S <b> 106, the conference management unit 103 stores the conference attribute information in the conference management DB 104.

  In step S107, the quality management unit 105 acquires owner and audience compression parameters using the conference type information as a key. At the start of distribution, the packet loss threshold is 0%. In step S108, the distribution management server 10 transmits (instructs) the acquired compression parameter as a media attribute to all owner and audience terminals.

The compression parameter (media attribute) is transmitted in the following format.
SetCompParameter, 1920x1080,30,256 \ n (2)
(Compression parameter), (Transmission video resolution), (Transmission frame rate), (Audio bit rate) \ n
The compression parameter is transmitted as text data from TCP / IP to the conference participation terminal from the distribution management server.

  Receiving the compression parameter, the remote conference terminal B30 encodes the video / audio with the acquired compression parameter. For example, when the owner terminal receives a resolution of 1920 × 1080 and a frame rate of 30 according to the media attribute instruction, the setting value of the encoder is changed. If the encoder does not support the received resolution or frame rate, set the closest value. In the case of voice, the voice encoder is similarly instructed.

  In step S109, the remote conference terminal A20 next notifies the distribution management server 10 of the reception quality information at an arbitrarily designated interval. The specified interval may be about 1 second. Reception quality information is acquired by RTCP.

  In step S110, when the distribution management server 10 receives the reception quality information, the distribution management server 10 acquires the conference type information from the conference management unit 103 using the IP address of the transmission source as a key.

  In step S111, the quality management unit 105 acquires a compression parameter using the conference type information and the packet loss occurrence rate included in the reception quality information as keys. For example, when the conference type is the review format and the packet loss occurrence rate of the reception quality information is 3%, the compression parameter corresponding to the packet occurrence rate of 1% to 5% is acquired.

  In step S112, the distribution management server 10 transmits the compression parameter to the remote conference terminal B30. In step S113, the remote conference terminal B30 receives the compression parameter, encodes video and audio based on the received compression parameter, and transmits the encoded video and audio to the remote conference terminal A20.

  In step S114, the remote conference terminal B30 notifies the distribution management server 10 of the reception quality information at an arbitrarily designated interval. The specified interval may be about 1 second. Reception quality information is acquired by RTCP.

  In step S115, when the distribution management server 10 receives the reception quality information, the distribution management server 10 acquires conference type information from the conference management unit 103 using the IP address of the transmission source as a key.

  In step S116, the quality management unit 105 acquires a compression parameter using the conference type information and the packet loss occurrence rate included in the reception quality information as keys. For example, when the conference type is the review format and the packet loss occurrence rate of the reception quality information is 7%, the compression parameter corresponding to the packet occurrence rate of 5% is acquired.

  In step S117, the distribution management server 10 transmits the compression parameter to the remote conference terminal A20. In step S118, the remote conference terminal A20 receives the compression parameters, encodes video and audio based on the received compression parameters, and transmits them to the remote conference terminal B30.

  Note that step S114 may be performed before or after step S109, and may be performed by performing mutual communication between the remote conference terminals and transmitting the reception quality information to the distribution management server 10.

  As described above, the remote conference terminals that perform mutual communication can perform mutual communication with the optimum data amount by using the compression parameters determined by the distribution management server 10 based on the conference type information and the reception quality information.

  Next, the communication end process in Example 1 is demonstrated. FIG. 9 is a sequence diagram illustrating an example of a communication end process according to the first embodiment. In step S <b> 201, the user performs a conference end operation via the operation unit 204.

  In step S202, upon receiving an end notification from the operation control unit 205, the distribution control unit 212 makes an end request to the connected remote conference terminal B30. In step S203, the remote conference terminal B30 notifies the remote conference terminal A20 of the end permission.

  In step S <b> 204, the distribution policy control unit 206 notifies the distribution management server 10 of the end of the conference via the communication control unit 207. The conference end notification includes at least the conference ID.

  In step S205, when the distribution management server 10 receives the end notification, the distribution management server 10 accesses the conference management DB 104 via the conference management unit 103, and deletes the same entry as the received conference ID.

  As described above, according to the first embodiment, in the electronic conference system, it is possible to determine the optimum data amount according to the type of conference in consideration of the communication state of the network.

[Example 2]
Next, an electronic conference system according to the second embodiment will be described. The second embodiment is different from the first embodiment in that the distribution management server retains the priority order for each remote conference terminal and determines the compression parameters based on the conference type information, the reception quality information, and the priority order information.

  In the current IP network, QoS (Quality of Service) control for determining how to use the available bandwidth is not performed. For example, assume that the bandwidth of the IP network is 10 Mbps. If one video conference uses about 3Mbps, three video conferences can be held.

  If one more videoconference is held here, the new videoconference will be of poor quality. In addition, the addition of a new video conference affects the quality of the three video conferences that have already been held, resulting in video disturbances and audio interruptions.

  Therefore, QoS control that allocates network bandwidth is required. For example, the quality of the fourth important new videoconference will not be lowered, and control will be performed so that video disturbance and audio interruption will not occur as much as possible even if four simultaneous videoconferences are held. It is a mechanism to do.

  As this mechanism, priorities are set in advance in the terminals themselves, and when packet loss occurs, video / audio quality is controlled according to the priorities. This mechanism will be described below as a second embodiment.

<Functional configuration>
FIG. 10 is a block diagram illustrating an example of a functional configuration of the distribution management server 40 according to the second embodiment. The distribution management server 40 includes a distribution management control unit 300, a communication control unit 101, a conference management DB 305, a quality management DB 307, and a priority information DB 303. The distribution management control unit 300 includes a distribution policy control unit 301, a priority management unit 302, a conference management unit 304, and a quality management unit 306. Here, in the function shown in FIG. 10, the same function as the function shown in FIG.

  The distribution management control unit 300 acquires conference priority information corresponding to the terminal identification information included in the conference attribute information acquired from the communication control unit 101, calculates an average value of the conference priority information, and also based on this average value To obtain the compression parameter. Details of the distribution management control unit 300 will be described below.

  The distribution policy control unit 301 calculates the average value of the priority order of the terminals connected to the conference based on the priority order information of each remote conference terminal acquired from the priority management unit 302. The distribution policy control unit 301 registers the average value in the priority order in the conference management DB 305 via the conference management unit 304.

  Further, when the distribution policy control unit 301 acquires the reception quality information, the distribution policy control unit 301 acquires a compression parameter based on the average value in the priority order and the reception quality information. Details of the compression parameter acquisition processing will be described later.

  Upon acquiring the terminal ID from the distribution policy control unit 301, the priority management unit 302 acquires the conference priority (priority order information) corresponding to the terminal ID from the conference management DB 303, and outputs the acquired conference priority to the distribution policy control unit 301. To do.

  The priority information DB 303 stores priority order information in which a priority order is associated with each terminal ID. FIG. 11 is a diagram illustrating an example of a data structure of the priority information DB 303 in the second embodiment. In the example illustrated in FIG. 11, for example, the conference priority of the terminal ID “192.168.0.xx” is “3”, and the conference priority of the terminal ID “192.168.0.xy” is “3”.

  Upon receiving a conference attribute information registration instruction from the distribution policy control unit 301, the conference management unit 304 registers the conference attribute information in the conference management DB 305. The conference attribute information registered here includes a conference priority average value indicating an average value in priority order calculated by the distribution policy control unit 301, and a quality counter indicating a state history of a network communication state.

  The conference management unit 305 stores conference attribute information. FIG. 12 is a diagram illustrating an example of a data structure of the conference management DB 305 according to the second embodiment. In the example illustrated in FIG. 12, the conference ID “12345678” includes a conference type “presentation format”, a conference priority average value “2”, a quality counter “0”, an owner “192.168.0.xx”, and an audience 1 “192.168.”. 0.xy ”and audience 2“ 192.168.0.yy ”are associated with each other.

  When the conference type information and the packet loss value are notified from the distribution policy control unit 301, the quality management unit 306 acquires a compression parameter corresponding to the conference type information and the packet loss value from the distribution management DB 307.

  Further, when the quality management unit 306 further receives a notification of setting the video / audio quality ID to “+1” from the distribution policy control unit 301, the value of the video / audio quality ID corresponding to the conference type information and the packet loss value. The compression parameter corresponding to the video / audio quality ID added to +1 is acquired. The quality management unit 306 outputs the acquired compression parameter to the distribution policy control unit 301.

  The quality management DB 307 stores conference type information, video / audio quality ID, packet loss threshold, and compression parameters in association with each other. FIG. 13 is a diagram illustrating an example of a data structure of the quality management DB 307 according to the second embodiment.

  As shown in FIG. 13, a video / audio quality ID is associated with each packet type corresponding to the packet loss threshold. For example, for the conference type “presentation format”, the video / audio quality ID “1001” corresponds to the packet loss threshold “0% to 1%”, and the video / audio quality ID corresponds to the packet loss threshold “1% to 5%”. The voice quality ID is “1002”. The compression parameter is set so that the quality of the video / audio becomes lower as the video / audio quality ID is incremented.

  Next, a specific example of the compression parameter acquisition method according to the second embodiment will be described. The second embodiment aims to reduce the video / audio quality in descending order of the average conference priority according to the conference priority preset in the remote conference terminal.

  The distribution management server 40 receives the reception quality information transmitted from each remote conference terminal, and the second embodiment can be realized by artificially increasing or decreasing the packet loss occurrence rate according to the conference priority. For example, assume that the terminal ID “192.168.0.xx” is the owner and the terminal ID “192.168.0.xy” and the terminal ID “192.168.0.yy” are in a video conference. The conference priority of each remote conference terminal is 3, 3, and 2, respectively.

  Here, the distribution policy control unit 301 calculates the average value of the conference priority by rounding down the decimal point. In the case of this example, the decimal part of (3 + 3 + 2) / 3 is rounded down to 2. This value is taken as the conference priority average value. This value is calculated when the conference attribute information is notified and registered in the conference management DB 305.

  Next, the distribution policy control unit 301 receives the reception quality information, and when the packet loss occurrence rate included in the reception quality information exceeds 1%, for example, increases the quality counter by +1. When this quality counter exceeds the conference priority average value, the distribution policy control unit 301 sets the compression parameter corresponding to the video / audio quality ID obtained by adding +1 to the video / audio quality ID corresponding to the conference type information and the packet loss value. get.

  For example, when the packet loss occurrence rate is “4%”, the video / audio quality ID of the presentation format is “1002”, but when the quality counter exceeds the conference priority average value, the distribution policy control unit 301 • The compression parameter corresponding to the video / audio quality ID “1003” is acquired by adding +1 to the audio quality ID and setting the video / audio quality ID to “1003”.

  However, for example, when the video / audio quality ID is incremented by 1 and becomes “1004”, acquisition of the compression parameter fails. In this case, the video / audio quality ID is decremented and acquired after setting it to “1003”. . The distribution management server 40 transmits the acquired compression parameter to each remote conference terminal. Since the subsequent processing is the same as that of the first embodiment, the description thereof is omitted.

<Operation>
Next, the operation of the electronic conference system according to the second embodiment will be described. Since the operation of the electronic conference system according to the second embodiment is basically the same as the process illustrated in FIG. 8, differences from the process illustrated in FIG. 8 will be described.

  When the distribution management server 40 acquires the conference attribute information in step S105, the distribution policy control unit 301 calculates the average value of the conference priority (conference priority average value) corresponding to the remote conference terminals participating in the conference.

  In step S <b> 106, the distribution control unit 301 includes the calculated conference priority average value in the conference attribute information, and stores the conference attribute information in the conference management DB 305 via the conference management unit 304.

  In step S110, the distribution policy control unit 301 receives the reception quality information. When the packet loss occurrence rate included in the reception quality information exceeds 1%, for example, the distribution policy control unit 301 increases the quality counter in the conference management DB 305 by +1.

  In step S111, when the quality counter exceeds the conference priority average value, the distribution policy control unit 301 corresponds to the video / audio quality ID obtained by adding +1 to the video / audio quality ID corresponding to the conference type information and the packet loss value. Instructs the quality management unit 306 to acquire the compression parameter.

  In step S112, the communication control unit 101 transmits the compression parameter (media attribute) acquired by the quality management unit 306 to each remote terminal. In steps S114 to S117, the same processing as described above is performed.

  As described above, according to the second embodiment, the video / audio quality can be lowered in ascending order of the conference priority average value according to the conference priority preset in the remote conference terminal.

[Modification]
Next, an electronic conference system according to a modification will be described. In the modified example, a conference is performed using the multipoint connection device 60. The present invention is also applicable when using a multipoint connection device (also referred to as MCU) 60.

<System configuration>
FIG. 14 is a diagram illustrating an example of an electronic conference system (part 1) according to a modification. As shown in FIG. 14, the electronic conference system includes a multipoint connection device 40, a remote conference device (communication device) A20, a remote conference device B30, and a remote conference device C50.

  The multipoint connection device 60 in the modified example has the functions of the distribution management servers 10 and 40 described in the first and second embodiments. The modification differs from the above-described embodiments in that only the owner's remote conference terminal transmits the conference attribute information, but each remote conference terminal receives the conference attribute information including its own terminal ID. Send to.

  Thereby, the multipoint connection apparatus 60 can appropriately control the amount of data transmitted to each remote conference terminal by acquiring the conference type information and the reception quality information from each remote conference terminal.

  The electronic conference system according to the modification may be a server different from the distribution management function and the MCU. FIG. 15 is a diagram illustrating an example of an electronic conference system (part 2) according to a modification. As shown in FIG. 15, the electronic conference system may include a distribution management server 80 as a separate server as in the first and second embodiments. Thereby, when the multipoint connection apparatus 70 and each remote conference terminal acquire the compression parameter from the distribution management server 80, the data encoded by the acquired compression parameter can be transmitted.

  The programs executed by the distribution management server and the multipoint connection device of each embodiment or modification are files in an installable format or executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, The program is provided by being recorded on a computer-readable recording medium such as a DVD (Digital Versatile Disk).

  Further, the program executed by the distribution management server or multipoint connection device of each embodiment or modification is stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. May be. Further, the program executed by the distribution management server or multipoint connection device of each embodiment or modification may be provided or distributed via a network such as the Internet.

  Further, the program executed by the distribution management server or multipoint connection device of each embodiment or modification may be provided by being incorporated in advance in a ROM or the like.

  The program executed by the distribution management server or multipoint connection apparatus of each embodiment or modification has a module configuration including the above-described units, and as actual hardware, a CPU (processor) is programmed from the above storage medium. Are read out and executed, the above-described units are loaded onto the main storage device, and the above-described units are generated on the main storage device.

  In addition, this invention is not limited to the said Example as it is, A component can be deform | transformed and embodied in the range which does not deviate from the summary in an implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, constituent elements over different embodiments may be appropriately combined.

10, 40, 80 Distribution management server 20, 30, 50 Remote conference terminal 60, 70 Multipoint connection device 100, 300 Distribution management control unit 101 Communication control unit 102, 301 Distribution policy control unit 103, 304 Conference management unit 104, 305 Conference management DB
105, 306 Quality management unit 106, 307 Quality management DB
202 Video input control unit 203 Video encoder 204 Operation unit 205 Operation control unit 206 Distribution policy control unit 207 Communication control unit 210 Audio input control unit 211 Audio encoder 212 Distribution control unit 302 Priority management unit 303 Priority information DB

JP 2007-329682 A

Claims (5)

An electronic conference system in which a plurality of communication terminals and a distribution management server are connected via a network and performs data communication for performing a conference between the communication terminals,
The communication terminal is
Reception quality information indicating the communication status of the network when data is received, conference type information indicating the type of conference, conference identification information for identifying the conference, and terminal identification information for identifying a communication terminal that performs the conference Transmitting means for transmitting the meeting attribute information including the distribution management server,
The delivery management server
Receiving means for receiving the reception quality information and the conference attribute information;
First storage means for storing quality management information in which the reception quality information and the compression parameter of the data are associated for each conference type information;
Second storage means for storing the conference attribute information;
Third storage means for storing conference priority information in which the terminal identification information is associated with the priority order for the conference;
A delivery management control means for acquiring the compression parameter from the quality management information based on the received quality information and the conference type information included in the conference attribute information;
Transmitting means for transmitting the acquired compression parameter to the communication terminal;
With
The distribution management control means includes
When reception quality information is received again, a specifying unit is provided for specifying the conference type information from the terminal identification information of the communication terminal that has transmitted the reception quality information and the conference attribute information stored in the second storage unit. ,
Based on the identified conference type information, the average value of the priority order specified from the terminal identification information and the conference priority information included in the conference attribute information, and the reception quality information received again, Obtaining the compression parameter from the quality control information;
Further, the distribution management control means includes:
When the reception quality information is equal to or greater than a predetermined value, and when the count value exceeds the average value, the compression parameter is acquired so as to further reduce the quality of video and / or audio.
Electronic conference system. A distribution management server that receives video data and audio data from a plurality of communication terminals, and transmits the synthesized video data and audio data to each communication terminal,
Identifying the reception quality information indicating the communication status of the network when the communication terminal receives data, meeting the type information indicating the type of meeting, conference identification information identifying the conference, and the communication terminal to perform the conferencing Receiving means for receiving conference attribute information including terminal identification information;
Storage means for storing quality management information in which the reception quality information and a compression parameter of data are associated with each conference type information;
Storage means for storing the conference attribute information;
Storage means for storing conference priority information in which the terminal identification information is associated with the priority order for the conference;
A delivery management control means for acquiring the compression parameter from the quality management information based on the received quality information and the conference type information included in the conference attribute information;
Transmitting means for transmitting the acquired compression parameter to the communication terminal;
With
The distribution management control means includes
When the reception quality information is received again, it comprises a specifying means for specifying the conference type information from the terminal identification information and the conference attribute information of the communication terminal that has transmitted the reception quality information,
Based on the identified conference type information, the average value of the priority order specified from the terminal identification information and the conference priority information included in the conference attribute information, and the reception quality information received again, Obtaining the compression parameter from the quality control information;
Further, the distribution management control means includes:
When the reception quality information is equal to or greater than a predetermined value, and when the count value exceeds the average value, the compression parameter is acquired so as to further reduce the quality of video and / or audio.
Distribution management server. A data control method in a distribution management server that receives video data and audio data from a plurality of communication terminals and transmits the synthesized video data and audio data to each communication terminal,
Identifying the reception quality information indicating the communication status of the network when the communication terminal receives data, meeting the type information indicating the type of meeting, conference identification information identifying the conference, and the communication terminal to perform the conferencing A reception step of receiving conference attribute information including terminal identification information;
The conference type stored in the storage means and included in the received reception quality information and the conference attribute information based on the quality management information in which the reception quality information and the data compression parameter are associated for each conference type information. A distribution management control step for obtaining the compression parameter from the information;
Transmitting the acquired compression parameter to the communication terminal;
Have
The delivery management control step includes:
When the reception quality information is received again, it has a specifying step of specifying the conference type information from the terminal identification information and the conference attribute information of the communication terminal that has transmitted the reception quality information,
An average value of priority order identified from the identified conference type information, the terminal identification information included in the conference attribute information, and the conference priority information that associates the terminal identification information with the priority order for the conference, and again Based on the received reception quality information, obtain the compression parameter from the quality management information,
Further, the distribution management control step includes:
When the reception quality information is equal to or greater than a predetermined value, and when the count value exceeds the average value, the compression parameter is acquired so as to further reduce the quality of video and / or audio.
Data control method. A program for receiving video data and audio data from a plurality of communication terminals and transmitting the synthesized video data and audio data to each communication terminal,
Identifying the reception quality information indicating the communication status of the network when the communication terminal receives data, meeting the type information indicating the type of meeting, conference identification information identifying the conference, and the communication terminal to perform the conferencing A reception step of receiving conference attribute information including terminal identification information;
The conference type stored in the storage means and included in the received reception quality information and the conference attribute information based on the quality management information in which the reception quality information and the data compression parameter are associated for each conference type information. A distribution management control step for obtaining the compression parameter from the information;
Transmitting the acquired compression parameter to the communication terminal;
To the computer,
The delivery management control step includes:
When the reception quality information is received again, it has a specifying step of specifying the conference type information from the terminal identification information and the conference attribute information of the communication terminal that has transmitted the reception quality information,
An average value of priority order identified from the identified conference type information, the terminal identification information included in the conference attribute information, and the conference priority information that associates the terminal identification information with the priority order for the conference, and again Based on the received reception quality information, obtain the compression parameter from the quality management information,
Further, the distribution management control step includes:
When the reception quality information is equal to or greater than a predetermined value, and when the count value exceeds the average value, the compression parameter is acquired so as to further reduce the quality of video and / or audio .
Program.   A computer-readable recording medium on which the program according to claim 4 is recorded.

Images