JP2007194823A - Video and audio controller, video and audio adjustment system, video and audio adjusting method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress deterioration in audio quality and a caused by a packet loss of video and audio data resulting from a network load, a variation in packet arrival interval, the retransmission control of packets, an arrival delay, etc., in an environment where a band is not guaranteed. <P>SOLUTION: A video and audio automatic controller 1 sends an instruction to adjust the quality of included video so that audio is not affected by the state change of a network to a video and audio multipoint distribution device 2 and a client state monitoring device 5. The video and audio multipoint distribution device 2, and a video and audio transmitting device 3 and a video and audio receiving device 4 to which the instruction is transferred adjust the quality of the video. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technology that eliminates factors that cause voice quality degradation due to dynamic changes in network status and machine status, and realizes comfortable voice communication without stress.

  Conventionally, in electronic conferencing systems that use lines that do not guarantee bandwidth, such as the Internet and Intranet, by setting the maximum bandwidth value and reducing the video quality according to changes in the network status and control within the range The voice band has been secured.

Here, the environment information indicating the static performance of the client terminal and the operation information indicating the dynamic performance are notified from the client terminal to the image distribution server via the communication network, and the environment information notified from the client terminal by the image distribution server The image quality of the image to be delivered to the client terminal is determined based on the operation information, and the image quality of the image to be delivered to the client terminal is converted based on the image quality and delivered. There has been proposed a technique capable of displaying a received image without stagnation of the process (for example, see Patent Document 1).
JP 2005-223430 A

  However, the conventional example described above has the following problems.

  The first problem is that only control related to securing the voice band is performed. The reason is that it is important to secure a voice band so as not to affect the voice.

  The second problem is that the minimum value of video frames per second does not fall below 1 even when the machine is heavily loaded. The reason is that it is considered that the video needs to be switched once per second because it is the lowest frame rate supported by the camera.

  The present invention has been made in view of the circumstances described above, and its purpose is to provide packet loss of video / audio data due to network load, fluctuation of packet arrival interval, packet, etc. in an environment where bandwidth is not guaranteed such as the Internet or an intranet. It is intended to suppress voice quality degradation and delay due to retransmission control, arrival delay, and the like.

  In order to solve the above-described problems, the present invention provides a bit rate to a client or a server so that audio is not affected by a change in the network state in bidirectional video / audio communication over a line whose bandwidth is not guaranteed. Provided is a video / audio control apparatus that instructs to adjust the quality of a video including at least one of a frame rate, a resolution, and frame thinning.

  In addition, in the bidirectional video / audio communication using a plurality of machines having a wide range of specifications at the same time, the present invention provides the client with a bit rate, a frame rate, and a resolution so that the sound is not affected by a change in the CPU state of each client. And a video / audio control apparatus that instructs to adjust the quality of video including at least one of frame thinning.

  In addition, the present invention provides a video / audio control that adjusts volume control to an appropriate volume according to an audio input volume so as not to cause an abnormality in bidirectional video / audio communication performed by a microphone volume set by a user. Providing equipment.

  Also, the present invention provides a client or server for bit rate, frame rate, resolution, and frame decimation so that audio is not affected by changes in the network status in bidirectional video / audio communication over a line whose bandwidth is not guaranteed. Provided is a video / audio adjustment system for adjusting the quality of an image including at least one.

  In addition, the present invention provides a bidirectional video / audio communication that uses a plurality of machines having a wide range of specifications at the same time so that the audio is not affected by a change in the state of the CPU of each client. Provided is a video / audio adjustment system for adjusting the quality of video including at least one of frame thinning.

  In addition, the present invention provides a video and audio system that performs volume control automatically to an appropriate volume according to an audio input volume and adjusts so that no abnormality occurs in the audio in bidirectional video and audio communication performed by a microphone volume set by each user. Provide a coordination system.

  The present invention also provides a video / audio adjustment comprising a video / audio automatic control device, a video / audio multipoint distribution device, a video / audio transmission device, a video / audio reception device, and a client status monitoring device connected via a network. In the client state monitoring device or the video / audio multi-point distribution device, when a factor affecting sound is detected, the video / audio automatic control device analyzes the detected content, and the audio is affected. An instruction to eliminate the factor to be given is notified to the video / audio multipoint distribution device and the client status monitoring device, and the client status monitoring device that has received the notification notifies the video / audio transmission device or the video / audio reception device. The video / audio multipoint distribution device that received the notification executes the process of transferring the instruction and lowering the video quality, and similarly reduces the video quality. Providing video and audio adjustment system performing gel process.

  Also, the present invention provides a client or server for bit rate, frame rate, resolution, and frame decimation so that audio is not affected by changes in the network status in bidirectional video / audio communication over a line whose bandwidth is not guaranteed. Provided is a video / audio adjustment method for adjusting the quality of a video including at least one.

  In addition, the present invention provides a bidirectional video / audio communication that uses a plurality of machines having a wide range of specifications at the same time so that the audio is not affected by a change in the state of the CPU of each client. Provided is a video / audio adjustment method for adjusting the quality of a video including at least one of frame thinning.

  In addition, the present invention provides a video and audio system that performs volume control automatically to an appropriate volume according to an audio input volume and adjusts so that no abnormality occurs in the audio in bidirectional video and audio communication performed by a microphone volume set by each user. Provide an adjustment method.

  The present invention also provides a video / audio using a video / audio automatic control device, a video / audio multipoint distribution device, a video / audio transmission device, a video / audio reception device, and a client status monitoring device connected via a network. In the adjustment method, in the client status monitoring device or the video / audio multipoint distribution device, when a factor affecting sound is detected, the video / audio automatic control device analyzes the detected content and affects the audio The video / audio multipoint distribution device or the client status monitoring device is notified of an instruction to eliminate the factor given by the client status monitoring device, and the received client status monitoring device is the video / audio transmission device or the video / audio reception device. The video / audio multipoint distribution device that received the notification executes the process of reducing the video quality and transfers the instruction to the video quality. Providing video and audio adjustment method of performing that process.

  According to the present invention, in an environment where bandwidth is not guaranteed, such as the Internet or an intranet, audio quality deterioration or delay due to packet loss of video / audio data due to network load, fluctuation of packet arrival interval, packet retransmission control, arrival delay, etc. Can be suppressed.

  Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.

  Referring to FIG. 1, a video / audio adjustment system according to the present embodiment includes a video / audio automatic control apparatus 1 that automatically controls video / audio according to the entire system and the state of a client, and video / audio sent from each client. A video / audio multipoint distribution device 2 that distributes packets to other clients, a video / audio transmission device 3 that encodes video / audio input from a camera and a microphone, and transmits the encoded video / audio to the video / audio multipoint distribution device 2, and a video / audio multipoint The video / audio receiving device 4 that receives and decodes the video / audio distributed from the point distribution device 2 and reproduces it, and monitors the status (CPU, NW) of the client machine and sends the monitoring information to the video / audio automatic control device 1. The client state monitoring device 5 is configured to transmit the data.

  The video / audio automatic control apparatus 1 includes an NW / CPU state monitoring unit 11 and a video / audio automatic control unit 12.

  The NW / CPU state monitoring unit 11 receives a notification of the state of the entire system from the distribution abnormality notification unit 24 in the video / audio multipoint distribution device 2 or the client state notification unit 52 in the client state monitoring device 5, and monitors it. It has a function to perform. If an abnormality is observed during monitoring, the content of the abnormality is notified to the video / audio automatic control unit 12.

  The video / audio automatic control unit 12 receives a notification of an abnormality from the NW / CPU state monitoring unit 11 and specifies an instruction to identify the cause of the abnormality and avoid the cause. The video setting changing unit 23 in the video / audio multipoint distribution apparatus 2 or It has a function of sending to the setting change instruction receiving unit 53 in the client state monitoring device 5.

  The video / audio multipoint distribution device 2 includes a video / audio reception unit 21, a video frame adjustment unit 22, a video setting change unit 23, a distribution abnormality notification unit 24, and a video / audio distribution unit 25.

  The video / audio reception unit 21 receives the video / audio transmitted from the video / audio transmission unit 33 in the video / audio transmission device 3. The video data is sent to the video frame adjustment unit 22, and the audio data is sent to the video / audio distribution unit 25. hand over.

  The video frame adjustment unit 22 thins out the video data sent from the video reception unit 21 based on the frame thinning interval notified from the video setting change unit 23 so that the video is not affected, and the video and audio It is sent to the distribution unit 25.

  The video setting change unit 23 receives the setting instruction sent from the video / audio automatic control unit 12 in the video / audio automatic control device 1 and notifies the video frame adjustment unit 22 of the received setting contents.

  The distribution abnormality notification unit 24 notifies the network load status notified from the video / audio distribution unit 25 to the NW / CPU status monitoring unit 11 in the video / audio automatic control device 1.

  The video / audio distribution unit 25 notifies the network abnormality to the distribution abnormality notification unit 24 when detecting a network load between specific video / audio reception devices 4 when transmitting the video / audio to the plurality of video / audio reception devices 4. To do.

  The video / audio transmission device 3 includes a video / audio capture unit 31, a video / audio compression unit 32, a video / audio transmission unit 33, and a setting change unit 34.

  The video / audio capture unit 31 acquires video / audio from the microphone device or the camera device in accordance with the resolution and frame rate specified by the setting change unit 34 and passes them to the video / audio compression unit 32.

  The video / audio compression unit 32 compresses the video / audio delivered from the video / audio capture unit 31 according to the image quality designated by the setting change unit 34 and passes the compressed video / audio to the video / audio transmission unit 33.

  The video / audio transmission unit 33 transmits the compressed video / audio data passed from the video / audio compression unit 32 to the video / audio reception unit 21 in the video / audio multipoint distribution device 2.

  The setting changing unit 34 designates the video / audio setting instruction notified from the setting change instruction receiving unit 53 in the client state monitoring apparatus 5 to the video / audio capturing unit 31 and the video / audio compression unit 32.

  The video / audio reception device 4 includes a video / audio reception unit 41, a video frame adjustment unit 42, a video / audio extension unit 43, a video / audio reproduction unit 44, a setting change unit 45, and a state abnormality notification unit 46. .

  The video / audio receiving unit 41 receives a plurality of video / audio from other points sent from the video / audio distribution unit 25 in the video / audio multipoint distribution apparatus 2, and the audio data is sent to the video / audio expansion unit 43 and the video / audio The data is passed to the video / audio frame adjustment unit 42. When a data loss, reception interval abnormality, or the like is detected during reception of video and audio, the state is notified to the state abnormality notification unit 46.

  The video frame adjustment unit 42 thins out the video data sent from the video / audio reception unit 41 based on the frame thinning interval notified from the setting change notification unit 45 so as not to affect the video. The data is sent to the voice decompression unit 43.

  The video / audio decompression unit 43 performs a decompression process on the video data delivered from the video frame adjustment unit 42 and the audio data delivered from the video / audio reception unit 41 and is in a reproducible state. To pass.

  The video / audio reproduction unit 44 reproduces the video / audio delivered from the video / audio reproduction unit 44 from a screen or a speaker.

  The setting changing unit 45 specifies the video / audio setting instruction notified from the setting change instruction receiving unit 53 in the client state monitoring device 5 to the video frame adjusting unit 42.

  The state abnormality notification unit 46 notifies the system monitoring unit 51 in the client state monitoring device 5 of the video / audio reception abnormal state notified from the video / audio reception unit 41.

  The client status monitoring device 5 includes a system monitoring unit 51, a client status notification unit 52, and a setting change instruction receiving unit 53.

  The system monitoring unit 51 receives the video / audio reception abnormality from the state abnormality notification unit 46 in the video / audio reception device 4 and notifies the client state notification unit 52 of the reception.

  The client status notification unit 52 transmits the video / audio reception abnormality notification notified from the system monitoring unit 51 to the NW / CPU status monitoring unit 11 in the video / audio automatic control device 1.

  Further, the CPU fluctuation state of the machine on which the client state monitoring device 5 operates is periodically transmitted to the NW / CPU state monitoring unit 11 in the video / audio automatic control device 1.

  The setting change instruction receiving unit 53 receives the setting instruction sent from the video / audio automatic control unit 12 in the video / audio automatic control device 1, and the setting change unit 34 in the video / audio transmission device 3, the video / audio receiving device 4. The setting change unit 45 is notified of the received setting contents.

  Next, the operation of the present embodiment will be described in detail with reference to FIG.

  In FIG. 2, the video / audio multipoint distribution device 2 is defined as an AV server, and an AV client that transmits / receives video / audio to / from the video / audio multipoint distribution device 2 is defined as a video / audio client 6.

  The video / audio clients 6 exist as many as the number of participating clients, and include the video / audio transmission device 3, the video / audio reception device 4, and the client state monitoring device 5.

  In addition, the video / audio multipoint distribution apparatus 2 and the video / audio clients 6 for the participants are assumed to be managed by the monitoring server of the video / audio automatic control apparatus 1.

  In FIG. 2, the video / audio data captured and compressed by the video / audio transmission device 3 operating in a certain video / audio client 6 from the microphone and the camera device is transmitted to the video / audio multipoint distribution device 2.

  In this series of processing, the resolution and frame rate of video data captured from the camera device and the bit rate for compression are dynamically changed according to instructions from the client state monitoring device 5.

  Next, the video / audio multipoint distribution device 2 distributes the video / audio data sent from a video / audio client 6 to all the clients participating at the same time. At this time, the network load is reduced by thinning out the video frames so that the video audio automatic control apparatus 1 has instructed the video to be thinned without affecting the video quality.

  Further, when a state in which transmission processing cannot catch up is detected during video / audio distribution, the video / audio automatic control apparatus 1 is notified of the abnormality.

  Next, the video / audio data 4 distributed from the video / audio multipoint distribution apparatus 2 is received by the video / audio reception apparatus 4 operating in a certain video / audio client 6, and decompressed to reproduce the video / audio from the reproduction device.

  In this series of processing, the CPU frame is reduced by thinning out the video frames to be decompressed and reproduced in accordance with instructions from the client state monitoring device 5. Further, when the voice reception interval is disturbed or the packet loss is detected, the client status monitoring device 5 is notified.

  Next, the client state monitoring device 5 periodically collects the CPU usage rate of the operating client and sends it to the video / audio automatic control device 1. Further, the abnormal status from the video / audio reception device 4 is transmitted to the video / audio automatic control device 1.

  Further, in accordance with an instruction from the video / audio automatic control apparatus 1, a setting change instruction is issued to the video / audio transmission apparatus 3 and the video / audio reception apparatus 4.

  Next, the video / audio automatic control device 1 manages the status of the server / client from the client status monitoring device 5 and the video / audio multi-point distribution device 2, determines abnormality detection, and generates an appropriate instruction to avoid the abnormality. Then, an instruction is notified to the video / audio multipoint distribution apparatus 2 and the client state monitoring apparatus 5 operating in a plurality of participating clients.

  In a state where no abnormality occurs for a certain period of time, an instruction to improve the quality is notified to the video / audio multipoint distribution device 2 and the client state monitoring device 5 operating in a plurality of participating clients.

  According to the above-described embodiment, in an environment where the bandwidth is not guaranteed such as the Internet or an intranet, the audio quality of the audio quality due to packet loss of video and audio data due to network load, fluctuation of packet arrival interval, packet retransmission control, arrival delay, etc. Deterioration and delay can be suppressed. The reason for this is that the network load is detected based on the degree of network fluctuation by RTT between each client and server, the arrival interval of voice packets is disturbed, the network load is detected based on the loss rate of voice packets, and the transmission waiting state is detected during delivery on the server. Monitors network load detection, controls to reduce the video quality (bit rate, frame rate, resolution) of each client that is dynamically affected, controls to thin out frame data when transferring video data on the server, and reduces network load This is because the voice band can be secured by the control.

  In addition, when using low-spec machines, the CPU load on each client machine increases, resulting in disturbance in the audio capture interval from the microphone device, delay in audio encoding / decoding processing, audio quality deterioration due to audio reproduction disturbance, It becomes possible to suppress the delay. The reason is that, in each client, the CPU usage rate is constantly monitored, the CPU load detection corresponding to the stepwise CPU usage rate is generated, and the video module and camera operating on the machine where the CPU usage rate has increased. Audio capture by reducing video quality (frame rate, resolution) for the device, reducing CPU load for encoding, and thinning frames before decoding and playing received video, reducing CPU load for decoding and playback This is because it is possible to secure CPU resources so as not to affect the function of processing the.

  In addition, it is possible to suppress sound interruption due to sound capture omission caused by microphone volume setting and sound quality degradation due to sound harmonic distortion. The reason is that an input volume picked up from the microphone is judged, and if the volume is too small, the volume is automatically adjusted.

  Next, a second embodiment of the present invention will be described in detail with reference to the drawings.

  Referring to FIG. 3, in the video / audio adjustment system according to the present embodiment, there are two video / audio multipoint distribution apparatuses 2, and video / audio transmission from the setting change unit 34 in the video / audio transmission apparatus 3. The first embodiment shown in FIG. 1 is that an arrow is provided for the unit 33 and that an arrow is provided for the video / audio receiver 41 from the setting change unit 45 in the video / audio receiver 4. And different. Since the basic functions of the other components are the same as those in the first embodiment described above, a duplicate description is omitted.

  Hereinafter, the operation of the present embodiment will be described in detail with reference to FIGS.

  By providing a server status monitoring function in the distribution abnormality notification unit 24 of the video / audio multi-point distribution device 2, before the number of clients logged on to the server increases and the CPU load increases and the distribution process is not in time, The abnormal distribution communication unit 24 notifies the NW / CPU state monitoring unit 11 in the video / audio automatic control device 1 of the high load of the video / audio multipoint distribution device 2.

  Next, the NW / CPU state monitoring unit 11 in the video / audio automatic control device 1 receives a high-load notification from the video / audio multipoint distribution device 2 and sends the video / audio automatic control unit 12 to the video / audio multipoint distribution device. 2 is in high load.

  Next, the video / audio automatic control unit 12 is currently transmitting / receiving the video / audio data to the setting change instruction receiving unit 53 in the client state monitoring device 5 which does not have much influence even if the video / audio multipoint distribution device 2 is switched. An instruction is given to switch the video / audio multipoint distribution device 2.

  Next, the setting change instruction receiving unit 53 in the client state monitoring device 5 that has received the instruction sends a video to the setting changing unit 34 in the video / audio transmitting device 3 and the setting changing unit 46 in the video / audio receiving device 4. An instruction is given to switch the voice multipoint distribution device 2.

  Next, the setting change unit 34 in the video / audio transmission device 3 and the setting change unit 46 in the video / audio reception device 4 that have received the instruction issue instructions to the video / audio transmission unit 33 and the video / audio reception unit 42, respectively.

  Upon receiving the instruction, the video / audio transmission unit 33 and the video / audio reception unit 42 execute a process of switching the video / audio multipoint distribution device 2, so that the number of clients increases when the number of clients increases. Realize CPU load balancing.

  Each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention. For example, the programs for realizing the functions of the video / audio automatic control device 1, the video / audio multipoint distribution device 2, the video / audio transmission device 3, the video / audio reception device 4, and the client status monitoring device 5 in the above-described embodiment are provided. You may perform the process which implement | achieves the function of each apparatus by reading in an apparatus and performing it. Further, the program is transmitted to another computer system by a transmission wave via a computer-readable recording medium such as a CD-ROM or a magneto-optical disk, or via a transmission medium such as the Internet or a telephone line. Also good.

  In each of the above-described embodiments, the video / audio automatic control device 1, the video / audio multipoint distribution device 2, the video / audio transmission device 3, the video / audio reception device 4, and the client state monitoring device 5 are separately connected. As described above, it goes without saying that the present invention can be applied to a configuration in which each function is realized as one computer system and a configuration in which a plurality of devices are added for each function.

It is a figure which shows the structure of the video / audio adjustment system in the 1st Embodiment of this invention. It is a figure which shows the processing operation in the 1st Embodiment of this invention. It is a figure which shows the structure of the video / audio adjustment system in the 2nd Embodiment of this invention. It is a figure which shows the processing operation in the 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video / audio automatic control apparatus 2 Video / audio multi-point delivery apparatus 3 Video / audio transmission apparatus 4 Video / audio reception apparatus 5 Client status monitoring apparatus 11 NW / CPU status monitoring section 12 Video / audio automatic control section 21 Video / audio reception section 22 Video frame adjustment Unit 23 video setting change unit 24 distribution abnormality notification unit 25 video / audio distribution unit 31 video / audio capture unit 32 video / audio compression unit 33 video / audio transmission unit 34 setting change unit 41 video / audio reception unit 42 video frame adjustment unit 43 video / audio extension unit 43 44 video / audio playback unit 45 setting change unit 46 state abnormality notification unit 51 system monitoring unit 52 client state notification unit 53 setting change instruction reception unit

Claims (21)

  In bidirectional video / audio communication over a line whose bandwidth is not guaranteed, at least one of bit rate, frame rate, resolution, and frame thinning is set for the client or server so that the voice is not affected by a change in the network status. A video / audio control apparatus which instructs to adjust the quality of an image including the video / audio control apparatus.   In bidirectional video / audio communication using a plurality of machines having a wide range of specifications, at least one of bit rate, frame rate, resolution, and frame thinning is applied to the client so that the sound is not affected by a change in the state of the CPU of each client. A video / audio control apparatus which instructs to adjust the quality of video including a video.   In a two-way video / audio communication performed by a microphone volume set by each user, the video / audio control device adjusts volume control to an appropriate volume according to a voice input volume so that no abnormality occurs in the voice. .   The network state change includes at least one of an RTT fluctuation between the server and the client, an arrival interval and a packet loss rate of voice packets received by each client, and a transmission waiting state when a plurality of clients are distributed by the server. The video / audio control apparatus according to claim 1, wherein the detection is performed in consideration of the above.   3. The video / audio control apparatus according to claim 2, wherein the change in the state of the CPU load in each of the clients is detected in consideration of an average load factor by monitoring at intervals of a specified number of seconds.   4. The video / audio control apparatus according to claim 3, wherein when the state that causes an abnormality in the audio does not occur for a certain period of time, adjustment is performed to improve video quality.   Video that includes at least one of bit rate, frame rate, resolution, and frame thinning at the client or server so that the voice is not affected by the change of the network status in the bidirectional video / audio communication over the line whose bandwidth is not guaranteed. A video / audio adjustment system characterized by adjusting the quality of video.   In bi-directional video / audio communication using multiple machines with a wide range of specifications, at least one of the bit rate, frame rate, resolution, and frame thinning at the client so that the sound is not affected by changes in the CPU status of each client. A video and audio adjustment system characterized by adjusting the quality of video including   Video / audio adjustment characterized in that, in bi-directional video / audio communication performed by each user-set microphone volume, the volume is automatically controlled to an appropriate volume according to the input volume of the audio and adjusted so that no abnormality occurs in the audio. system.   The network state change includes at least one of RTT fluctuation between the server and the client, an arrival interval and a packet loss rate of voice packets received by each client, and a transmission waiting state when a plurality of clients are distributed by the server. The video / audio adjustment system according to claim 7, wherein the detection is performed in consideration of the above.   9. The video / audio adjustment system according to claim 8, wherein a change in the state of the CPU load in each of the clients is monitored at a specified number of seconds and is detected in consideration of an average load factor.   The video / audio adjustment system according to claim 9, wherein when the state in which the audio is abnormal does not occur for a certain period of time, adjustment is performed to improve video quality. A video / audio adjustment system including a video / audio automatic control device, a video / audio multipoint distribution device, a video / audio transmission device, a video / audio reception device, and a client status monitoring device connected via a network,
In the client status monitoring device or the video / audio multi-point distribution device, when a factor affecting audio is detected, the video / audio automatic control device analyzes the detected content and eliminates the factor affecting audio. An instruction is notified to the video / audio multipoint distribution device and the client status monitoring device,
The client state monitoring device that has received the notification transfers an instruction to the video / audio transmission device or the video / audio reception device, and executes a process of reducing the quality of the video,
The video / audio multipoint distribution apparatus that has received the notification also executes processing for reducing the video quality in the same manner.   Video that includes at least one of bit rate, frame rate, resolution, and frame thinning at the client or server so that the audio is not affected by changes in the network status in bidirectional video and audio communication over a line whose bandwidth is not guaranteed. And adjusting the quality of the video and audio.   In bi-directional video / audio communication that uses multiple machines with a wide range of specifications at the same time, at least one of bit rate, frame rate, resolution, and frame decimation at the client so that the sound is not affected by changes in the CPU status of each client. A video / audio adjustment method comprising adjusting the quality of video including   Video / audio adjustment characterized in that, in bi-directional video / audio communication performed by each user-set microphone volume, the volume is automatically controlled to an appropriate volume according to the input volume of the audio and adjusted so that no abnormality occurs in the audio. Method.   The network state change includes at least one of RTT fluctuation between the server and the client, an arrival interval and a packet loss rate of voice packets received by each client, and a transmission waiting state when a plurality of clients are distributed by the server. 15. The video / audio adjustment method according to claim 14, wherein the detection is performed in consideration of the above.   16. The video / audio adjustment method according to claim 15, wherein a change in the state of the CPU load in each of the clients is monitored at a specified number of seconds and is detected in consideration of an average load factor.   The video / audio adjustment method according to claim 16, wherein when the state in which the audio is abnormal does not occur for a certain period of time, adjustment is performed so as to improve video quality. A video / audio adjustment method using a video / audio automatic control device, a video / audio multipoint distribution device, a video / audio transmission device, a video / audio reception device, and a client status monitoring device connected via a network,
In the client status monitoring device or the video / audio multi-point distribution device, when a factor affecting audio is detected, the video / audio automatic control device analyzes the detected content and eliminates the factor affecting audio. An instruction is notified to the video / audio multipoint distribution device and the client status monitoring device,
The client state monitoring device that has received the notification transfers an instruction to the video / audio transmission device or the video / audio reception device, and executes a process of reducing the quality of the video,
The video / audio multipoint distribution apparatus that receives the notification also executes processing for reducing the video quality in the same manner.   A program for causing a computer to execute processing for realizing the function according to any one of claims 1 to 6.

Images