JP4054775B2 - Video display method and video display control method in video conference system, user terminal and server computer used in video conference system, program for user terminal and server computer program used in video conference system - Google Patents

Description

  The present invention relates to a video conference system via a communication network, and more particularly to a video display technique for a video conference system.

  As shown in FIG. 9A, the display screen of the video conference system with video currently in practical use mainly includes a shared data screen d10, a participant list screen d20, a chat screen d30, a video screen d40, and the like. Has been. In these Web conference systems, since the video screen d40 is distributed for each participant, the occupation ratio of the video screen d40 on the display increases as the number of participants increases. In that case, the most important shared data screen d10 in the Web conference system becomes small, and the Web conference system cannot be smoothly performed.

As a method for solving this, as shown in Non-Patent Document 1, when the shared data screen d10 is mainly used, a method of hiding the video screen d40 on the back (see FIG. 9B), or a non-patent As shown in Documents 2 and 3, there is a method (see FIG. 9C) for limiting the number of participant's video screens displayed on the display.
NTTIT Corporation, “MeetingPlaza Network Meeting Room Service”, [Online], [Search on March 1, 2004], Internet <URL: http://www.meetingplaza.com/> WebEx Communications Inc., “Video Conferencing, Web Conferencing & Online Meetings”, [Online], [March 1, 2004 search], Internet <URL: http://www.webex.com/> NEC Corporation, “Communication Door”, [Online], [Search on March 1, 2004], Internet <URL: http://www.communicationdoor.com/>

  However, in the above-described method of hiding the video screen d40 on the back and the method of limiting the number of video screens of the participants to be displayed on the display, “while confirming the other party's facial expression” which is the merit of the video conference system with video There is a problem that the "conference" cannot be realized. In addition, when there is no video of the speaker, there is a problem that the participant list screen d20 must always be displayed because it is not known who speaks unless it is clearly indicated on the participant list.

  The present invention has been made in view of the above circumstances, and is used for a video display method, a video display control method, and a video conference system in a video conference system that can smoothly advance a video conference even if the number of participants increases. It is an object to provide a user terminal and a server computer, and a user terminal program and a server computer program used in a video conference system.

In order to achieve the above object, according to the present invention, a plurality of user terminals are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received. A video display method in a video conference system for performing a video conference, wherein each user terminal receives video information and audio information of another user from each of the other user terminals, and for each user , Determining the transparency of the video information based on the content of at least one of the received video information and audio information, changing the transparency of the video information of other users with the determined transparency, displays each image information is changed, when determining the transmission rate based on the image information, preparing a value of the transmittance of the two large and small, the difference between image frames of the video information When the information is equal to or greater than a predetermined first threshold value, a small value of transmittance is assigned. When the difference information between the image frames of the video information is less than the predetermined first threshold value, a large value of transmittance is assigned. It is characterized by assigning .
According to the second aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. A video display method in a system, wherein each user terminal receives video information and audio information of another user from each of the other user terminals, and the received video information and audio for each user. The transmission rate of the video information is determined based on the content of at least one of the information, the transparency of the video information of other users is changed with the determined transmission rate, and each of the video information whose transparency has been changed is changed. The determination of the transmittance is characterized in that the greater the gain value of the audio information or the difference information between the image frames of the video information, the smaller the transmittance value is set.

According to the third aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and video information and audio information of users acquired by each user terminal are mutually transmitted and received to perform a video conference. A video display method in a system, wherein each of the user terminals acquires the video information and audio information of the user, and the video is based on the content of at least one of the acquired video information and audio information Information transmission rate is determined, acquired video information and audio information, and information on the determined transmission rate are transmitted to other user terminals, and the video information and audio of other users are transmitted from each of the other user terminals. Information and information on the determined transmittance are received, and for each user, the transparency of the video information of other users is changed according to the received information on the transmittance, and transparent It displays each image information of varying, when determining the transmission rate based on the image information, preparing a value of the transmittance of the two large and small, the difference information between image frames of the video information When the threshold value is equal to or greater than a predetermined first threshold value, a small transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value transmittance is assigned. It is characterized by that.
According to the fourth aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and video information and audio information of users acquired by each user terminal are mutually transmitted and received to perform a video conference. A video display method in a system, wherein each of the user terminals acquires the video information and audio information of the user, and the video is based on the content of at least one of the acquired video information and audio information Information transmission rate is determined, acquired video information and audio information, and information on the determined transmission rate are transmitted to other user terminals, and the video information and audio of other users are transmitted from each of the other user terminals. Information and information on the determined transmittance are received, and for each user, the transparency of the video information of other users is changed according to the received information on the transmittance, and transparent Each of the video information in which the image information is changed is displayed, and the determination of the transmittance is characterized in that the greater the difference value between the image information frame of the audio information or the image information, the smaller the transmittance value is set. To do.

According to the fifth aspect of the present invention, a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually exchanged via the server computer. A video display control method in a video conference system for transmitting and receiving and performing a video conference, wherein the server computer receives video information and audio information of the user from each of the plurality of user terminals, and each user And determining the transmittance of the video information based on the content of at least one of the received video information and audio information, and regarding the received video information and audio information and the determined transmittance for each user. transmit information to the plurality of user terminals, when determining the transmission rate based on the video information, two large and small A transmittance value is prepared, and when the difference information between the image frames of the video information is equal to or greater than a predetermined first threshold, a small value of the transmittance is assigned, and the difference information between the image frames of the video information is When it is less than a predetermined first threshold value, a larger value of transmittance is assigned .
According to the present invention, a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually exchanged via the server computer. A video display control method in a video conference system for transmitting and receiving and performing a video conference, wherein the server computer receives video information and audio information of the user from each of the plurality of user terminals, and each user And determining the transmittance of the video information based on the content of at least one of the received video information and audio information, and regarding the received video information and audio information and the determined transmittance for each user. Information is transmitted to the plurality of user terminals, and the determination of the transmittance is performed by determining the gain value of the audio information or the image information of the video information. Wherein the smaller the value of the more the transmittance difference information is greater between frames.

According to the seventh aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and video information and audio information of users acquired by each user terminal are mutually transmitted and received to perform a video conference. Means for receiving the video information and audio information of other users from each of the other user terminals, and the received video information and audio information for each user; Means for determining the transmittance based on the content of at least one of the information, changing the transparency of the video information of other users with the determined transmittance, and means for displaying each of the video information with the changed transparency when having a means for varying the determined transparency the transmittance, when determining the transmission rate based on the image information, preparing a value of the transmittance of the two large and small, the movies When the difference information between the image frames of information is equal to or greater than a predetermined first threshold value, a small transmittance is assigned, and the difference information between the image frames of the video information is less than a predetermined first threshold value. In some cases, a large value of transmittance is assigned .
The present invention according to claim 8 is a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. Means for receiving the video information and audio information of other users from each of the other user terminals, and the received video information and audio information for each user; Means for determining the transmittance based on the content of at least one of the information, changing the transparency of the video information of other users with the determined transmittance, and means for displaying each of the video information with the changed transparency The means for determining the transmittance and changing the transparency includes a gain value of the audio information or difference information between image frames of the video information in the determination of the transmittance. Wherein the smaller the value of the transmittance larger.

The present invention according to claim 9 is a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. The user terminal for use in a system, the means for acquiring video data and audio data of the user, and the video information based on the content of at least one of the acquired video information and audio information Means for determining the transmittance, means for transmitting the acquired video information and audio information, and information regarding the determined transmittance to other user terminals, and video information of other users from each of the other user terminals And audio information, and means for receiving information on the determined transmittance, and for each user, according to the received information on the transmittance, the video information of other users And means for varying the brightness comprises means for displaying each image information of varying transparency, and, means for determining the transmission rate, when determining the transmission rate based on the image information, Two large and small transmittance values are prepared, and when the difference information between the image information image frames is equal to or greater than a predetermined first threshold value, a small value transmittance is assigned, and the image information image frames When the difference information is less than a predetermined first threshold value, a large transmittance is assigned .
The present invention according to claim 10 is a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. The user terminal for use in a system, the means for acquiring video data and audio data of the user, and the video information based on the content of at least one of the acquired video information and audio information Means for determining the transmittance, means for transmitting the acquired video information and audio information, and information regarding the determined transmittance to other user terminals, and video information of other users from each of the other user terminals And audio information, and means for receiving information on the determined transmittance, and video information of other users according to the received information on the transmittance for each user Means for changing transparency, and means for displaying each of the video information whose transparency has been changed, and the means for determining the transmittance is a gain value of the audio information or a difference between image frames of the video information. The larger the information, the smaller the transmittance value is set.

According to the present invention, a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted via the server computer. A server computer used in a video conference system for transmitting and receiving and performing a video conference, wherein the user computer receives video information and audio information from each of the plurality of user terminals, and for each user, Means for determining the transmittance of the video information based on the content of at least one of the received video information and audio information, and the received video information and audio information and the determined transmittance for each user; a means for transmitting information to the plurality of user terminals, and means for determining the transmittance, based on the image information When determining the transmittance, two large and small transmittance values are prepared, and when the difference information between the image frames of the video information is equal to or greater than a predetermined first threshold value, a small value of the transmission is obtained. A rate is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a larger transmittance is assigned .
According to the present invention, a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually exchanged via the server computer. A server computer used in a video conference system for transmitting and receiving and performing a video conference, wherein the user computer receives video information and audio information from each of the plurality of user terminals, and for each user, Means for determining the transmittance of the video information based on the content of at least one of the received video information and audio information, and the received video information and audio information and the determined transmittance for each user; Means for transmitting information to the plurality of user terminals, and the means for determining the transmittance comprises And sets the emission value or values of the transmittance the greater the difference information between image frames of the video information reduced.

According to the thirteenth aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. A program for a user terminal used in the system, the step of receiving video information and audio information of another user from each of other user terminals, and the received video information and audio information for each user Determining the transmittance of the video information based on the content of at least one of the information, changing the transparency of the video information of another user with the determined transmittance, and each of the video information with the changed transparency is executed and displaying, to the user terminal, the step of changing to determine the transmittance, when determining the transmission rate based on the image information Prepares two large and small transmittance values, and when the difference information between the image frames of the video information is greater than or equal to a predetermined first threshold value, assigns a small value of the transmittance, and the image of the video information When the difference information between frames is less than a predetermined first threshold value, a larger value of transmittance is assigned .
The present invention according to claim 14 is a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. A program for a user terminal used in the system, the step of receiving video information and audio information of another user from each of other user terminals, and the received video information and audio information for each user Determining the transmittance of the video information based on the content of at least one of the information, changing the transparency of the video information of another user with the determined transmittance, and each of the video information with the changed transparency The step of causing the user terminal to execute the step of determining and changing the transmittance, in the determination of the transmittance, the gain of the audio information Or wherein the smaller the value of the more the transmittance is large difference information between image frames of the video information.

The present invention according to claim 15 is a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. A program for a user terminal used in the system, the step of acquiring video data and audio data of the user, and video information based on the content of at least one of the acquired video information and audio information Determining the transmissivity of the user, transmitting the acquired video information and audio information, and information regarding the determined transmissivity to other user terminals, and video of other users from each of the other user terminals Receiving information and audio information, and information on the determined transmittance, and other uses according to the received transmittance for each user A step of changing the transparency of the video information, and displaying each image information of varying transparency, allowed to run on the user terminal, determining the transmittance, the based on the image information When determining the transmittance, two large and small transmittance values are prepared, and when the difference information between the image frames of the video information is equal to or greater than a predetermined first threshold, a small transmittance is set. When the difference information between the image frames of the video information is less than a predetermined first threshold value, a large transmittance is assigned .
According to a sixteenth aspect of the present invention, there is provided a video conference in which a plurality of user terminals are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received to perform a video conference. A program for a user terminal used in the system, the step of acquiring video data and audio data of the user, and video information based on the content of at least one of the acquired video information and audio information Determining the transmissivity of the user, transmitting the acquired video information and audio information, and information regarding the determined transmissivity to other user terminals, and video of other users from each of the other user terminals Receiving information and audio information, and information on the determined transmittance, and other uses according to the received transmittance for each user The step of causing the user terminal to execute the step of changing the transparency of the video information and the step of displaying each of the video information with the changed transparency, and determining the transmittance includes the gain value of the audio information or The greater the difference information between image frames of the video information, the smaller the transmittance value is set.

The present invention according to claim 17 is the invention according to any one of claims 13 to 16 , wherein when determining the transmittance based on the audio information, two large and small transmittance values are set. Prepared, when the gain value of the audio information is equal to or greater than a predetermined second threshold value, a small transmittance is assigned, and when the gain value of the audio information is less than the predetermined second threshold value, the transmissivity is large. It is characterized by assigning a value transmittance.

The present invention according to claim 18 is characterized in that, in the invention according to any one of claims 13 to 17 , the determined transmittance can be changed in units of users.

The present invention according to claim 19 is the invention according to any one of claims 13 to 18 , wherein the video information and audio information of each user is transmitted and received via a server computer. .

In the invention according to claim 20 , a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received via the server computer. A program for a server computer used in a video conference system that performs a video conference, the step of receiving video information and audio information of the user from each of the plurality of user terminals, and for each of the users, Determining the transmittance based on the content of at least one of the received video information and audio information, and the received video information and audio information and information regarding the determined transmittance for each user; and transmitting the plurality of user terminals, it was run on the server computer, the transmission Determining the transmittance based on the video information, two large and small transmittance values are prepared, and difference information between image frames of the video information is determined in advance. When the threshold value is equal to or greater than 1, a small value of transmittance is assigned, and when difference information between image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is assigned. .
According to the present invention, a plurality of user terminals and a server computer are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted via the server computer. A program for a server computer used in a video conference system for transmitting and receiving and performing a video conference, the step of receiving video information and audio information of the user from each of the plurality of user terminals, and for each user Determining the transmittance based on the content of at least one of the received video information and audio information, and information regarding the received video information and audio information and the determined transmittance for each user. Transmitting to the plurality of user terminals, causing the server computer to execute, and Determining the rate is characterized by setting a small value of the transmittance the greater the difference information between image frames of the gain value or the image information of the audio information.

  According to the present invention, the transmittance of video information is determined based on the amount of information of at least one of the video information and audio information of each user, and the video information of each user is determined with the determined transmittance. It can be displayed semi-transparently.

  As a result, users who speak or move can be visually highlighted, and the area of the video screen does not compress other display areas necessary for video conferencing, which increases the number of users. However, the video conference can proceed smoothly.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 1 is a schematic configuration diagram of a video conference system 100 according to the first embodiment of the present invention. A video conference system 100 shown in FIG. 1 includes a server computer 2, user terminals 3i (i = a, b,..., N) provided for each user participating in the video conference, and the server computer 2 and user terminals 3i. The system configuration includes a communication network 4 such as the Internet network that enables communication.

  The server computer 2 includes a communication unit 21 that communicates with each user terminal 3i. When the server computer 2 receives the video data and the audio data transmitted from each user terminal 3i, the server computer 2 duplicates the data and transmits it to the other user terminals 3i. Has a data relay function.

  The user terminal 3 i is equipped with a camera and a microphone to photograph the user and transmits the acquired video data and audio data of the user to the server computer 2. Specifically, the user terminal 3 i controls the communication unit 31 that communicates with the server computer 2, controls to transmit the acquired video data and audio data of the user to the server computer 2, and is transmitted from the server computer 2. A data control unit 32 that controls video displayed on the screen based on video data and audio data of other users, a data input unit 33 that inputs video data and audio data, data necessary for a video conference, and the like (specifically Specifically, the above-described camera, microphone, keyboard, mouse, and the like), video data and audio data, and data output unit 34 that outputs data necessary for video conferencing (specifically, display, speaker) And a data storage unit 35 for storing data necessary for video conferencing. And it has a configuration that.

  The server computer 2 and the user terminal 3i described above include a main processing unit (memory) including a central processing unit (CPU) having at least a calculation function and a control function, and a RAM having a function of storing programs and data. It is comprised from the electronic apparatus which has. The server computer 2 and the user terminal 3i may include an auxiliary storage device such as a hard disk in addition to the main storage device.

  A program for executing various processes according to the present embodiment is stored in the main storage device or the hard disk described above. The program can be recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, or a DVD-ROM, or can be distributed via a communication network.

  Next, the operation of the video conference system 100 according to the present embodiment will be described with reference to FIG. Here, FIG. 2 is a flowchart for explaining the operation of the user terminal 3i after the server computer 2 transmits the video data and audio data of each user to each user terminal 3i.

  First, the user terminal 3i receives each user's video data and audio data from the server computer 2 (step S10). If the received video data is data compressed by Motion JPEG (Joint Photographic Coding Experts Group), MPEG (Moving Picture Expert Group) 2, MPEG4, or the like, decoding is performed using each decoder.

  Next, the behavior pattern of each user is detected from the received data. Here, as a specific example, two cases of detection based on each user's speech and detection based on each user's movement will be described.

  When detecting by each user's remark, if the gain value of the received voice data is equal to or greater than a preset threshold value, the user terminal 3i (user) is specified from the source IP address of the voice data. It is determined that the user has remarked (behavior pattern A) (step S20). On the other hand, if the gain value of the received audio data is less than a preset threshold value, it is determined that the user has not made a statement (referred to as action pattern B) (step S20).

  In the case of detecting by the movement of each user, if the average of the received video data, for example, the scalar amount of the motion vector, which is one of the encoding parameters of MPEG2 or MPEG4, is equal to or greater than a preset threshold value, the video data The user terminal 3i (user) is identified from the source IP address of the user, and it is determined that the user has moved (behaved as action pattern A) (step S20). On the other hand, if the average of the scalar amounts of the motion vectors of the received video data is less than a preset threshold value, it is determined that the user has not moved (behaves as behavior pattern B) (step S20). ). In the case of a data format that does not require difference information between images, such as Motion JPEG, a motion vector is obtained for each local area between images and is determined by this.

  Next, the transmissivity of the video data of each user is determined based on the behavior pattern described above, and the video screen is made translucent. Specifically, for the video data of the user of the action pattern A (there is a statement or movement), the transmittance is α (for example, α = about 10 to 20%; a small transmittance is set), For the video data of the user of the action pattern B, the transmittance is β (for example, β = about 60 to 80%; a large transmittance is set), and the video screen is made translucent (steps S30 and S40). ). The greater the value of the transmittance, the higher the transparency and the background can be seen through.

  Next, the semi-transparent video screen of each user is displayed on the display (step S50). FIG. 3 shows a display example on the display when a behavior pattern is detected by speech. FIG. 3 (a) shows a case where one of the users has made a speech, and FIG. A video screen d40 is shown when no one has made a statement. Here, the entire screen is used in the shared data screen d10 and the chat screen d30, and the video screen d40 is displayed on these screens (the participant list screen d20 is not displayed).

  As shown in FIG. 3B, when no user speaks, the transmittance of the video screen d40 is set high, so that the background shared data screen is not disturbed by the video screen d40. d10 and the chat screen d30 can be confirmed. On the other hand, when there is a statement, the transmittance of the video screen d40 of the speaker is set low, so that the video screen d40 of the speaker can be confirmed. Thus, the limited display area can be used effectively by making the video screen d40 translucent and displaying it on the shared data screen d10 and the chat screen d30.

  FIG. 4 shows a display example on the display when an action pattern is detected by movement. FIG. 4A shows a case where one of the users has moved, FIG. Shows a video screen d40 when all the users have not moved. Here, the entire screen is used in the shared data screen d10 and the chat screen d30, and the video screen d40 is displayed on these screens (the participant list screen d20 is not displayed).

  When no user moves as shown in FIG. 4B, the transparency of the video screen d40 is set high, so that the background shared data screen is not disturbed by the video screen d40. d10 and the chat screen d30 can be confirmed. On the other hand, when there is movement, the transmittance of the moving video screen d40 is set low, so that the moving video screen d40 can be confirmed. Thus, the limited display area can be used effectively by making the video screen d40 translucent and displaying it on the shared data screen d10 and the chat screen d30.

  As described above, according to the video conference system 100 according to the present embodiment, the transmittance of video data is determined based on the amount of video data or audio data of each user, and each user is determined with the determined transmittance. Since the video data is displayed in a translucent manner, even if the number of users increases, the video conference can proceed smoothly.

  That is, the video screen d40 of all users can be displayed on the display without reducing other display screens necessary for the video conference such as a shared data screen. In addition, when there is a statement or movement in the user's behavior, the transparency is set to be small for the video data of the user who has said or movement, so that the user who has said or movement is visually Can be highlighted. This makes it possible to hide the participant list screen d20 that is always required to be displayed in the conventional video conference system.

  In the present embodiment, the behavior patterns are divided into two, and the transmittance of each behavior pattern is determined to be translucent. However, the present invention is not limited to this, and the determination of other transmittances is performed. Transmission using a method, for example, a simple increase function f (x) with the variable x as the scalar quantity of the motion vector of the video data or the gain value of the audio data (where f (x) can take 10 to 80) The rate may be determined so that the transmittance can take a continuous value within a predetermined range. In this case, the transmittance can be set more finely according to the situation.

  Further, when determining the transmittance, in addition to the algorithm described above, the intention of each user may be reflected. For example, the transmittance of video data of a specific user (for example, a central person in a video conference) may be set to be always 10% regardless of the behavior pattern.

<Second Embodiment>
FIG. 5 is a schematic configuration diagram of a video conference system 200 according to the second embodiment of the present invention. A video conference system 200 shown in FIG. 5 includes a server computer 2, user terminals 5 i (i = a, b,..., N) included in each user participating in the video conference, and the server computer 2 and user terminals 5 i. The system configuration includes a communication network 4 such as the Internet network that enables communication. In the present embodiment, only the configuration and functions different from those of the first embodiment will be described, and the other components and functions will be denoted by the same reference numerals and the description thereof will be omitted.

  The user terminal 5 i is equipped with a camera and a microphone to photograph the user, and transmits the acquired video data and audio data of the user to the server computer 2. Specifically, the user terminal 5i determines the information (behavior pattern) related to the transmittance from the communication unit 31 that communicates with the server computer 2 and the acquired user video data and audio data, and sends the video data and the server computer 2 The audio data and the information related to the transmittance are controlled to be transmitted, and the video data and audio data of other users transmitted from the server computer 2 and the image displayed on the screen are controlled according to the information related to the transmittance. Data control unit 52, data input unit 33 for inputting video data and audio data, data necessary for video conference, and the like (specifically, the above-mentioned camera, microphone, keyboard, mouse, etc.), video Data and audio data, and data that is output for video conferencing (Specifically a display, speaker, etc. applicable) the output unit 34 has, and an arrangement having a data storage unit 35 for storing data necessary for video conferencing.

  The above-described user terminal 5i is an electronic device having a central processing unit (CPU) having at least an arithmetic function and a control function, and a main storage device (memory) including a RAM having a function of storing programs and data. It consists of a device. In addition to the main storage device, the user terminal 5i may include an auxiliary storage device such as a hard disk.

  A program for executing various processes of the user terminal 5i is stored in the main storage device or the hard disk described above. The program can be recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, or a DVD-ROM, or can be distributed via a communication network.

  Next, the operation of the video conference system 200 according to the present embodiment will be described with reference to FIG. Here, FIG. 6A is a flowchart for explaining the operation until the user's video data and audio data acquired by each user terminal 5i are transmitted to the server computer 2, and FIG. FIG. 8 is a flowchart for explaining the operation of the user terminal 5i after the server computer 2 transmits the video data and audio data of each user to each user terminal 5i.

  First, an operation until each user terminal 5 i transmits user video data and audio data acquired to the server computer 2 will be described. When the user terminal 5i acquires the video data and audio data of the user, the user's behavior pattern is detected from the acquired data (step S110). In the present embodiment as well, as in the first embodiment, two specific cases will be described: a case where detection is performed based on a user's speech and a case where detection is performed based on a user's movement.

  When detecting by the user's utterance, if the gain value of the acquired voice data is equal to or greater than a preset threshold value, it is determined that the user has uttered (behaved as behavior pattern A) (step S120). ). On the other hand, if the gain value of the acquired audio data is less than a preset threshold value, it is determined that the user has not made a statement (behaved as behavior pattern B) (step S120).

  In the case of detecting by the movement of the user, if the average of the scalar quantity of the acquired video data, for example, the motion vector, which is one of the encoding parameters of MPEG2 or MPEG4, is equal to or greater than a preset threshold, the user (Step S120). On the other hand, if the average of the scalar amounts of the motion vectors of the acquired video data is less than a preset threshold value, it is determined that the user has not moved (behaves as behavior pattern B) (step S120). ).

  Next, the transmittance of the video data of each user is determined based on the behavior pattern described above. Specifically, for the video data of the user of the action pattern A (there is a statement or movement), the transmittance is α (for example, α = about 10 to 20%; a small transmittance is set), For the video data of the user of the action pattern B, the transmittance is determined as β (for example, β = about 60 to 80%; a large transmittance is set) (steps S130 and S140).

  Next, the user terminal 5i transmits the acquired video data and audio data and information (behavior pattern) on the determined transmittance to the server computer 2 (step S150).

  Next, the operation of the user terminal 3i after the server computer 2 transmits the video data and audio data of each user to each user terminal 5i will be described. First, the user terminal 5i receives each user's video data and audio data from the server computer 2 and information on the determined transmittance (step S160).

  Next, the user terminal 5i makes the video screen d40 translucent according to the received information regarding each transmittance, and displays the translucent video screen d40 of each user on the display (steps S170 and S180). .

  Therefore, according to the video conference system 200 according to the present embodiment, the same effects as those of the first embodiment can be obtained.

  In the present embodiment, the behavior patterns are divided into two, and the transmittance of each behavior pattern is determined to be translucent. However, the present invention is not limited to this, and the determination of other transmittances is performed. Transmission using a method, for example, a simple increase function f (x) with the variable x as the scalar quantity of the motion vector of the video data or the gain value of the audio data (where f (x) can take 10 to 80) The rate may be determined so that the transmittance can take a continuous value within a predetermined range. In this case, the transmittance can be set more finely according to the situation.

  Further, when determining the transmittance, in addition to the algorithm described above, the intention of each user may be reflected. For example, the transmittance of video data of a specific user (for example, a central person in a video conference) may be set to be always 10% regardless of the behavior pattern.

<Third Embodiment>
FIG. 7 is a schematic configuration diagram of a video conference system 300 according to the third embodiment of the present invention. A video conference system 300 shown in FIG. 7 includes a server computer 6, user terminals 7 i (i = a, b,..., N) included in each user participating in the video conference, and the server computer 6 and user terminals 7 i. The system configuration includes a communication network 4 such as the Internet network that enables communication. In the present embodiment, only configurations and functions different from those of the above-described embodiment will be described, and with regard to other configurations and functions, the same portions are denoted by the same reference numerals, and description thereof will be omitted.

  The user terminal 7 i is equipped with a camera and a microphone to photograph the user, and transmits the acquired video data and audio data of the user to the server computer 6. Specifically, the user terminal 7 i controls the communication unit 31 that communicates with the server computer 6, controls to transmit the acquired video data and audio data of the user to the server computer 6, and is transmitted from the server computer 6. Data control unit 72 for controlling video displayed on the screen in accordance with information (behavioral pattern) on transmission, video data and audio data of other users, video data and audio data, data necessary for video conference, etc. A data input unit 33 for inputting (specifically, the above-mentioned camera, microphone, keyboard, mouse, etc.), data output unit 34 for outputting video data and audio data, data necessary for a video conference, and the like. Necessary for video conferencing (specifically, displays, speakers, etc.) It has a configuration comprising a data storage unit 35 for storing data.

  When the server computer 6 receives the communication unit 21 that communicates with each user terminal 7i and the video data and audio data transmitted from each user terminal 7i, the server computer 6 generates a video screen of each user from the video data and audio data. It is configured to include a data control unit 62 that determines the transmittance, duplicates the video data and audio data of each user, and information (behavior pattern) related to the transmittance and transmits the information to other user terminals 7i. .

  The server computer 6 and the user terminal 7i described above include a central processing unit (CPU) having at least a calculation function and a control function, and a main storage device (memory) including a RAM having a function of storing programs and data. It is comprised from the electronic apparatus which has. The server computer 6 and the user terminal 7i may include an auxiliary storage device such as a hard disk in addition to the main storage device.

  A program for executing various processes according to the present embodiment is stored in the main storage device or the hard disk described above. The program can be recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, or a DVD-ROM, or can be distributed via a communication network.

  Next, the operation of the video conference system 300 according to the present embodiment will be described with reference to FIG. Here, FIG. 8 is a flowchart for explaining the operation of the server computer 6.

  First, the server computer 6 receives each user's video data and audio data from each user terminal 7i (step S210).

  Next, the behavior pattern of each user is detected from the received data. In the present embodiment as well, as in the above-described embodiment, two cases of detection based on a user's speech and detection based on a user's movement will be described as a specific example.

  In the case of detection based on each user's remark, if the gain value of the received voice data is equal to or greater than a preset threshold value, the user terminal 7i (user) is specified from the source IP address of the voice data, and this It is determined that the user has made a statement (referred to as action pattern A) (step S220). On the other hand, if the gain value of the received audio data is less than the preset threshold value, it is determined that the user has not made a statement (referred to as action pattern B) (step S220).

  In the case of detecting by the movement of each user, if the average of the received video data, for example, the scalar amount of the motion vector, which is one of the encoding parameters of MPEG2 or MPEG4, is equal to or greater than a preset threshold value, the video data The user terminal 7i (user) is identified from the source IP address of the user, and it is determined that the user has moved (behaved as behavior pattern A) (step S220). On the other hand, if the average of the scalar amounts of the motion vectors of the received video data is less than a preset threshold value, it is determined that the user has not moved (behaves as behavior pattern B) (step S220). ).

  Next, the transmissivity of the video data of each user is determined based on the behavior pattern described above, and the video screen is made translucent. Specifically, for the video data of the user of the action pattern A (there is a statement or movement), the transmittance is α (for example, α = about 10 to 20%; a small transmittance is set), For the video data of the user of the action pattern B, the transmittance is β (for example, β = about 60 to 80%; a large transmittance is set) (steps S230 and S240).

  Next, the video data and audio data of each user and information regarding the determined transmittance are transmitted to each user terminal 7i (step S250).

  Thereby, each user terminal 7i makes the video screen d40 translucent according to the received video data and audio data and the information on the determined transmittance, and displays the translucent video screen d40 of each user on the display. To display.

  Therefore, according to the video conference system 300 according to the present embodiment, the server computer 6 determines the transmittance of the video data based on the amount of information of the video data or audio data of each user, and each user Since the terminal 7i displays each user's video data in a translucent manner with the determined transmittance, the same effect as in the above embodiment can be obtained.

  In the present embodiment, the behavior patterns are divided into two, and the transmittance of each behavior pattern is determined to be translucent. However, the present invention is not limited to this, and the determination of other transmittances is performed. Transmission using a method, for example, a simple increase function f (x) with the variable x as the scalar quantity of the motion vector of the video data or the gain value of the audio data (where f (x) can take 10 to 80) The rate may be determined so that the transmittance can take a continuous value within a predetermined range. In this case, the transmittance can be set more finely.

  In determining the transmittance, in addition to the algorithm of the server computer 6 described above, the intention of each user may be reflected in the user terminal 7i. For example, the transmittance of video data of a specific user (for example, a central person in a video conference) may be set to be always 10% regardless of the behavior pattern.

  While the embodiments of the present invention have been described above, various modifications and changes can be made to the embodiments of the present invention without departing from the spirit of the present invention. For example, the user terminal of the video conference system according to the first and second embodiments transmits / receives video data and audio data via the server computer, but the present invention is limited to this system configuration. Instead, the system configuration may be a P2P (Peer to Peer) system configuration without using a server computer.

1 is a schematic configuration diagram of a video conference system according to a first embodiment of the present invention. It is a flowchart figure explaining operation | movement of the video conference system which concerns on the 1st Embodiment of this invention. It is an example of the video screen in the video conference system which concerns on the 1st Embodiment of this invention. It is an example of the video screen in the video conference system which concerns on the 1st Embodiment of this invention. It is a schematic block diagram of the video conference system which concerns on the 2nd Embodiment of this invention. It is a flowchart figure explaining operation | movement of the video conference system which concerns on the 2nd Embodiment of this invention. It is a schematic block diagram of the video conference system which concerns on the 3rd Embodiment of this invention. It is a flowchart figure explaining operation | movement of the video conference system which concerns on the 3rd Embodiment of this invention. It is a figure explaining the display screen of the conventional video conference system.

Explanation of symbols

2, 6 Server 3i, 5i, 7i User terminal 4 Communication network 21, 31 Communication unit 32, 52, 62, 72 Data control unit 33 Data input unit 34 Data output unit 35 Data storage unit 100, 200, 300 Video conference system d10 Shared data screen d20 Participant list screen d30 Chat screen d40 Video screen

Claims (21)

A video display method in a video conference system in which a plurality of user terminals are connected via a communication network, the user's video information and audio information acquired by each user terminal are mutually transmitted and received, and a video conference is performed.
Each user terminal is
Receive video and audio information of other users from each of the other user terminals,
For each user, the transmittance of the video information is determined based on the content of at least one of the received video information and audio information, and the transparency of the video information of other users is determined based on the determined transmittance. Change
Display each video information with changed transparency ,
When determining the transmittance based on the video information, two large and small transmittance values are prepared, and when the difference information between the image frames of the video information is greater than or equal to a predetermined first threshold value A video display in a video conferencing system , wherein a small value of transmittance is allocated, and when the difference information between image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is allocated. Method.   A video display method in a video conference system in which a plurality of user terminals are connected via a communication network, the user's video information and audio information acquired by each user terminal are mutually transmitted and received, and a video conference is performed.
  Each user terminal is
  Receive video and audio information of other users from each of the other user terminals,
  For each user, the transmittance of the video information is determined based on the content of at least one of the received video information and audio information, and the transparency of the video information of other users is determined based on the determined transmittance. Change
  Display each video information with changed transparency,
  In determining the transmittance, the greater the gain value of the audio information or the difference information between the image frames of the video information, the smaller the transmittance value is set.
  A video display method in a video conference system characterized by the above. A video display method in a video conference system in which a plurality of user terminals are connected via a communication network, the user's video information and audio information acquired by each user terminal are mutually transmitted and received, and a video conference is performed.
Each user terminal is
Obtaining video information and audio information of the user;
Determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information;
Send the acquired video and audio information and information about the determined transmittance to other user terminals,
From each of the other user terminals, other users' video information and audio information, and information on the determined transmittance are received,
For each user, change the transparency of the video information of other users according to the received information about the transmittance,
Display each video information with changed transparency ,
When determining the transmittance based on the video information, two large and small transmittance values are prepared, and when the difference information between the image frames of the video information is greater than or equal to a predetermined first threshold value A video display in a video conferencing system , wherein a small value of transmittance is allocated, and when the difference information between image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is allocated. Method.   A video display method in a video conference system in which a plurality of user terminals are connected via a communication network, the user's video information and audio information acquired by each user terminal are mutually transmitted and received, and a video conference is performed.
  Each user terminal is
  Obtaining video information and audio information of the user;
  Determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information;
  Send the acquired video and audio information and information about the determined transmittance to other user terminals,
  From each of the other user terminals, other users' video information and audio information, and information on the determined transmittance are received,
  For each user, change the transparency of the video information of other users according to the received information about the transmittance,
  Display each video information with changed transparency,
  In determining the transmittance, the greater the gain value of the audio information or the difference information between the image frames of the video information, the smaller the transmittance value is set.
  A video display method in a video conference system characterized by the above. A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference A video display control method in a system,
The server computer is
Receiving video information and audio information of the user from each of the plurality of user terminals;
For each user, determine the transmittance of the video information based on the content of at least one of the received video information and audio information,
For each user, the received video information and audio information and information on the determined transmittance are transmitted to the plurality of user terminals ,
When determining the transmittance based on the video information, two large and small transmittance values are prepared, and when the difference information between the image frames of the video information is greater than or equal to a predetermined first threshold value A video display in a video conferencing system , wherein a small value of transmittance is allocated, and when the difference information between image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is allocated. Control method.   A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference A video display control method in a system,
  The server computer is
  Receiving video information and audio information of the user from each of the plurality of user terminals;
  For each user, determine the transmittance of the video information based on the content of at least one of the received video information and audio information,
  For each user, the received video information and audio information and information on the determined transmittance are transmitted to the plurality of user terminals,
  In determining the transmittance, the greater the gain value of the audio information or the difference information between the image frames of the video information, the smaller the transmittance value is set.
  A video display control method in a video conference system. A plurality of user terminals are connected via a communication network, and the user terminals used in a video conference system that performs video conference by mutually transmitting and receiving user video information and audio information acquired by each user terminal. There,
Means for receiving video information and audio information of other users from each of the other user terminals;
Means for determining the transmittance based on the content of at least one of the received video information and audio information for each user, and changing the transparency of the video information of other users with the determined transmittance When,
Means for displaying each video information with changed transparency ,
The means for determining the transmittance and changing the transparency prepares two large and small transmittance values when determining the transmittance based on the video information, and provides a difference between the image frames of the video information. When the information is greater than or equal to a predetermined first threshold, a small value of transmittance is assigned, and when the difference information between image frames of the video information is less than the predetermined first threshold, a large value of transmittance is assigned. A user terminal used for a video conference system, characterized in that   A plurality of user terminals are connected via a communication network, and the user terminals used in a video conference system that performs video conference by mutually transmitting and receiving user video information and audio information acquired by each user terminal. There,
  Means for receiving video information and audio information of other users from each of the other user terminals;
  Means for determining the transmittance based on the content of at least one of the received video information and audio information for each user, and changing the transparency of the video information of other users with the determined transmittance When,
  Means for displaying each video information with changed transparency,
  The means for determining the transmittance and changing the transparency sets the value of the transmittance smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger in the determination of the transmittance.
  A user terminal used in a video conference system characterized by A plurality of user terminals are connected via a communication network, and the user terminals used in a video conference system that performs video conference by mutually transmitting and receiving user video information and audio information acquired by each user terminal. There,
Means for obtaining video data and audio data of the user;
Means for determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information;
Means for transmitting the acquired video information and audio information and information on the determined transmittance to other user terminals;
Means for receiving video information and audio information of other users and information on the determined transmittance from each of the other user terminals;
Means for changing the transparency of video information of other users according to the received information on the transmittance for each user;
Means for displaying each video information with changed transparency ,
When determining the transmittance based on the video information, the means for determining the transmittance prepares two large and small transmittance values, and difference information between image frames of the video information is determined in advance. When the threshold value is equal to or greater than the first threshold value, a small value of transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is assigned . A user terminal used in the video conference system.   A plurality of user terminals are connected via a communication network, and the user terminals used in a video conference system that performs video conference by mutually transmitting and receiving user video information and audio information acquired by each user terminal. There,
  Means for obtaining video data and audio data of the user;
  Means for determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information;
  Means for transmitting the acquired video information and audio information and information on the determined transmittance to other user terminals;
  Means for receiving video information and audio information of other users and information on the determined transmittance from each of the other user terminals;
  Means for changing the transparency of video information of other users according to the received information on the transmittance for each user;
  Means for displaying each video information with changed transparency,
  The means for determining the transmittance sets the transmittance value to be smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger.
  A user terminal used in a video conference system characterized by A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference The server computer used in the system,
Means for receiving video information and audio information of the user from each of the plurality of user terminals;
Means for determining the transmittance of video information based on the content of at least one of the received video information and audio information for each user;
Means for transmitting the received video information and audio information and information on the determined transmittance for each user to the plurality of user terminals ,
When determining the transmittance based on the video information, the means for determining the transmittance prepares two large and small transmittance values, and difference information between image frames of the video information is determined in advance. When the threshold value is equal to or greater than the first threshold value, a small value of transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is assigned . A server computer used in the video conference system.   A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference The server computer used in the system,
  Means for receiving video information and audio information of the user from each of the plurality of user terminals;
  Means for determining the transmittance of video information based on the content of at least one of the received video information and audio information for each user;
  Means for transmitting the received video information and audio information and information on the determined transmittance for each user to the plurality of user terminals,
  The means for determining the transmittance sets the transmittance value to be smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger.
  A server computer used in a video conference system characterized by the above. A program for a user terminal used in a video conference system in which a plurality of user terminals are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received to perform a video conference. Because
Receiving video information and audio information of other users from each of the other user terminals;
For each user, the transparency of the video information is determined based on the content of at least one of the received video information and audio information, and the transparency of the video information of other users is changed with the determined transmittance. Step to
Displaying each video information with changed transparency, and causing the user terminal to execute,
In the step of determining and changing the transmittance, when determining the transmittance based on the video information, two large and small transmittance values are prepared, and difference information between image frames of the video information is obtained. When the threshold value is equal to or greater than a predetermined first threshold value, a small transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value transmittance is assigned. The program for user terminals used for the video conference system characterized by the above-mentioned.   A program for a user terminal used in a video conference system in which a plurality of user terminals are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received to perform a video conference. Because
  Receiving video information and audio information of other users from each of the other user terminals;
  For each user, the transparency of the video information is determined based on the content of at least one of the received video information and audio information, and the transparency of the video information of other users is changed with the determined transmittance. Step to
  Displaying each video information with changed transparency, and causing the user terminal to execute,
  The step of determining and changing the transmittance includes setting the transmittance value to be smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger in the determination of the transmittance.
  The program for user terminals used for the video conference system characterized by this. A program for a user terminal used in a video conference system in which a plurality of user terminals are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received to perform a video conference. Because
Obtaining video data and audio data of the user;
Determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information; and
Transmitting the acquired video information and audio information, and information on the determined transmittance to other user terminals;
Receiving video information and audio information of other users, and information on the determined transmittance from each of the other user terminals;
Changing the transparency of video information of other users according to the received transmittance for each user;
Displaying each video information with changed transparency, and causing the user terminal to execute,
In the step of determining the transmittance, when determining the transmittance based on the video information, two large and small transmittance values are prepared, and difference information between image frames of the video information is determined in advance. When the threshold value is equal to or greater than the first threshold value, a small value of transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is assigned . A program for a user terminal used in a video conference system.   A program for a user terminal used in a video conference system in which a plurality of user terminals are connected via a communication network, and the user's video information and audio information acquired by each user terminal are mutually transmitted and received to perform a video conference. Because
  Obtaining video data and audio data of the user;
  Determining the transmittance of the video information based on the content of at least one of the acquired video information and audio information; and
  Transmitting the acquired video information and audio information, and information on the determined transmittance to other user terminals;
  Receiving video information and audio information of other users, and information on the determined transmittance from each of the other user terminals;
  Changing the transparency of video information of other users according to the received transmittance for each user;
  Displaying each video information with changed transparency, and causing the user terminal to execute,
  The step of determining the transmittance includes setting the transmittance value to be smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger.
  The program for user terminals used for the video conference system characterized by this. When determining the transmittance based on the sound information, two large and small transmittance values are prepared, and when the gain value of the sound information is equal to or greater than a predetermined second threshold , a small value is set. The video according to any one of claims 13 to 16 , wherein a transmittance is assigned and a larger value of the transmittance is assigned when a gain value of the audio information is less than a predetermined second threshold value. User terminal program used in a conference system. The program for a user terminal used for a video conference system according to any one of claims 13 to 17, wherein the determined transmittance can be changed for each user. 19. The user terminal program used in the video conference system according to claim 13, wherein the video information and audio information of each user are transmitted and received via a server computer. A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference A program for a server computer used in a system,
Receiving video information and audio information of the user from each of the plurality of user terminals;
Determining the transmittance based on the content of at least one of the received video information and audio information for each user; and
Transmitting the received video information and audio information and information on the determined transmittance for each user to the plurality of user terminals, causing the server computer to execute,
In the step of determining the transmittance, when determining the transmittance based on the video information, two large and small transmittance values are prepared, and difference information between image frames of the video information is determined in advance. When the threshold value is equal to or greater than the first threshold value, a small value of transmittance is assigned, and when the difference information between the image frames of the video information is less than a predetermined first threshold value, a large value of transmittance is assigned . A program for a server computer used in a video conference system.   A video conference in which a plurality of user terminals and a server computer are connected via a communication network, and the video information and audio information of the users acquired by each user terminal are mutually transmitted and received via the server computer to perform a video conference A program for a server computer used in a system,
  Receiving video information and audio information of the user from each of the plurality of user terminals;
  Determining the transmittance based on the content of at least one of the received video information and audio information for each user; and
  Transmitting the received video information and audio information and information on the determined transmittance for each user to the plurality of user terminals, and causing the server computer to execute,
  The step of determining the transmittance includes setting the transmittance value to be smaller as the gain value of the audio information or the difference information between the image frames of the video information is larger.
  A program for a server computer used in a video conference system characterized by the above.

Images