JP2009231949A - Multimedia conference system, application server, method and program for determining mixed pattern - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform multiple privacy settings on participants so that the participants can secure privacy in a conference, to quickly determine a transmission/reception setting of stream media for the entire conference based on the privacy settings set by the respective participants, and to quickly control transmission/reception of the stream media of the respective participants. <P>SOLUTION: In a multimedia conference system 1, an application server 3 determines a mixed pattern based on a transmission/reception request set by a client terminal 5, and a media server 2 mixes the stream media received from the client terminal 5 based on the mixed pattern, and transmits the stream media capable of satisfying the transmission/reception request to each client terminal 5. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a multimedia conference system, an application server, a mixed pattern determination method, and a mixed pattern determination program. More specifically, the media server receives stream media transmitted from a plurality of client terminals, and The present invention relates to a multimedia conference system, an application server, a mixed pattern determination method, and a mixed pattern determination program for mixing stream media of client terminals with a media server and transmitting the mixed media to each client terminal.

  Conventionally, in order to exchange opinions in real time, it has been necessary to gather participants in the same physical conference hall. However, today, due to the advanced development of communication technology, participants can exchange opinions in real time via a network without physically gathering. In such a multimedia conference using a network, all participants who participated in the conference are connected online, and each participant speaks his / her opinions widely to other participants via the network. It is possible to listen to the opinions of other participants.

  However, if one participant's remarks are heard by all other participants, the privacy of each participant cannot be ensured, and there is a problem that smooth progress of the conference may be hindered. It was. For this reason, various methods for ensuring the privacy of each participant have been devised.

  For example, as an example of a multimedia conference system, an instant messaging system having a privacy function has been proposed (for example, see Non-Patent Document 1). In this system, by selecting privacy settings using the interface, it is possible to invite only some participants to the exchange of opinions and exchange opinions only with invited participants. .

  However, as a method of ensuring privacy, it is not limited to grouping based on participants and restricting the comments (opinions), but only specific comments (opinions) can be heard based on the comments (opinions) of the participants. It is preferable to make a setting so that only a specific opinion (speech) can be heard (acquisition can be refused). A mute function is generally used as a privacy setting method based on such statements (opinions).

  As a general mute function in a multimedia conference, as shown in FIG. 12, three types of mute functions of self mute, PBX mute, and narrow casting mute are known.

  Self-mute is a server that collects the opinions of each participant (hereinafter, information related to these opinions is called media) and distributes it to each participant (hereinafter, this way of media acquisition and distribution). This is a function that prevents other participants from hearing their opinions by not transmitting their own media to the media server). The diagram in the “Media transmission / reception relation” column shown in FIG. 12 shows a state in which the participant P1 does not transmit the opinion of the participant P1 to the other participants P2, P3, and P4 by muting his / her opinion. Yes.

  The PBX mute is a function for controlling a person having the management authority of the multimedia conference system so that a specific participant's media cannot be acquired by other participants. The diagram in the “Media transmission / reception relationship” column shown in FIG. 12 shows a state in which the opinion of the participant P1 is restricted by the administrator and the other participants P2, P3, and P4 cannot hear the opinion of the participant P1. ing.

Narrow casting mute is a peer-to-peer format (Internet usage mode in which a large number of unspecified computers are connected to each other and directly send and receive information such as files). This is a function for selecting a participant and not transmitting media to the participant. The diagram in the “Media transmission / reception relation” column shown in FIG. 12 shows a state in which the participant P1 has rejected the media of the participant P2 by the participant P1 selecting the participant P2. In such a case, the participant P2 can exchange opinions (transmission / reception of media) with the other participants P3 and P4, but receives opinions (reception of media) with respect to the participant P1. Can only send, not send media (send media).
JP 2007-172625 A (page 8-9, FIGS. 1 to 3)

  However, such a mute function alone has a problem that it is not easy to secure a private function without impairing the convenience of participants. For example, the mute function simply limits speech. On the other hand, in order to realize a more convenient multimedia conference system, the participant can block media sent by specific participants (self and others) (unlike the self-mute described above, A function to select a specific participant and prevent the selected participant's media from being sent to other participants. This function is referred to as "mute", and this function is used (set). A function that prevents participants from receiving media from other specific participants (hereinafter referred to as “defen”), and that the use (setting) of this function is defunct. ), A function that allows participants to restrict the callers of media to be received (hereinafter, this function is referred to as “select”, and the use (setting) of this function is selected). A function that allows a user to receive only media sent by a specific participant (hereinafter, this function is called “Attend”, and that this function is used (set) is called “Attend”) can be set individually. And more preferred.

  However, when each participant sets such a plurality of settings, there is a problem that it is not easy for the media server to control transmission / reception of media according to each setting. Furthermore, in the multimedia conference system, it is desirable to switch the setting quickly by judging the privacy setting described above in real time, but it is not easy to realize such a quick setting change / setting judgment in the multimedia conference. There was a problem.

  The present invention has been made in view of the above problems, and in order for a participant to ensure privacy in a conference, a plurality of privacy settings can be made for the participant, and the privacy setting set by each participant. Multimedia conference system, application server, mixed pattern determination method, and mixed pattern determination program capable of quickly determining media transmission / reception settings for the entire conference based on the system and quickly controlling media transmission / reception of each participant It is an issue to provide.

  In order to solve the above problems, a multimedia conference system according to the present invention receives stream media transmitted from a plurality of client terminals by a media server, and mixes the received stream media by the media server. A multimedia conference system for transmitting to each client terminal, comprising: an application server for determining a mixed pattern of the stream media mixed in the media server, wherein the client terminal specifies a specific client terminal A stream media transmission / reception request in the client terminal can be set, and the application server determines the mixing pattern based on the transmission / reception request set in the client terminal, and The bar mixes the stream media received from the client terminal based on the mixing pattern determined in the application server, and transmits the stream media that can satisfy the transmission / reception request to each client terminal. To do.

  In this way, the application server determines the mixing pattern based on the transmission / reception request set in the client terminal, and the media server mixes the stream media based on the mixing pattern determined in the application server, and sends the transmission / reception request. Since the stream medium that can be satisfied is transmitted to each client terminal, the client terminal can receive the stream medium that can satisfy the transmission / reception request set for each client terminal.

  For example, in the above-described multimedia conference system, when one client terminal does not want to receive its own stream media, the client terminal corresponding to itself does not specify one client terminal to receive its own stream media. The desired transmission / reception request can be set in Since this transmission / reception request has different settings for each client terminal, when the media server that mixes the stream media performs processing to determine the content of each transmission / reception request and change the mixing method There is a risk that smooth stream media cannot be transmitted (distributed) due to an increase in processing load. For this reason, the application server receives the transmission / reception request of each client terminal, examines the contents thereof, and determines the mixing method of the stream media in the media server as a mixing pattern, thereby reducing the processing load on the media server. In addition, it is possible to quickly and reliably change the mixing process in the media server.

  In the multimedia conference system according to the present invention, the client terminal Z that sets the transmission / reception request is such that the specific client terminal X designated by the client terminal Z transmits the stream media to the client terminal. The mute representing the function to limit the stream media and the stream media received by the client terminal Z are only stream media sent by the specified client terminal X, and the stream media sent by other client terminals Y A selection indicating a function for restricting reception can be set as the transmission / reception request. The application server can select (1) the client terminal X is muted and (2) the client terminal X is muted. Not and When the client terminal Y is selected and the client terminal X is not selected, the client terminal Z determines that it is impossible to receive the stream media transmitted by the client terminal X. The mixed pattern may be determined.

  Furthermore, the application server according to the present invention is an application server that determines a mixed pattern of the stream media used for a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal. The transmission / reception request receiving means for receiving a stream media transmission / reception request set by designating a specific client terminal in the client terminal, and the transmission / reception request set in the client terminal. A mixed pattern determining means for determining a mixed pattern; and a transmitting means for transmitting the determined mixed pattern to the media server, wherein the mixed pattern determining means is specified by the client terminal Z. The specified client terminal X transmits the mute representing the function of restricting the client terminal X from transmitting stream media to the client terminal and the stream media received by the client terminal Z. A selection indicating a function that restricts reception of stream media transmitted from another client terminal Y is determined based on the transmission / reception request, and (1) the client terminal X is muted, (2) A stream transmitted from the client terminal X in the client terminal Z when the client terminal X is not muted, the client terminal Y is selected, and the client terminal X is not selected. Receive media It is determined that Rukoto is impossible and determines the mixing pattern.

  Also, the mixed pattern determination method according to the present invention determines, in the application server, the mixed pattern of the stream media used for the process of mixing the stream media received from the plurality of client terminals by the media server and transmitting the mixed media to the client terminal. A transmission / reception request receiving step in which a transmission / reception request receiving unit receives a transmission / reception request of a stream medium set by designating a specific client terminal in the client terminal; Based on the transmission / reception request set in the client terminal, a mixed pattern determining unit determines the mixed pattern, and a transmitting unit transmits the determined mixed pattern to the media server. And the mixed pattern determining unit restricts that the specific client terminal X designated by the client terminal Z transmits stream media to the client terminal in the mixed pattern determining step. The mute indicating the function to be performed and the stream media received by the client terminal Z are only stream media transmitted by the specified client terminal X, and the stream media transmitted by other client terminals Y are received. Based on the request content determined in the request content determination step, the request content determination step for determining a select representing a function to be restricted from the transmission / reception request, and (1) the client terminal X Is muted (2) When the client terminal X is not muted, the client terminal Y is selected, and the client terminal X is not selected, the client terminal Z A mixed pattern determining step of determining that it is impossible to receive the transmitted stream media and determining the mixed pattern.

  Furthermore, the mixed pattern determination program according to the present invention provides the application server with the mixed pattern of the stream media used for the process of mixing the stream media received from a plurality of client terminals by the media server and transmitting the mixed media to the client terminal. A mixed pattern determination program for determining, wherein a transmission request for a stream medium set by designating a specific client terminal in the client terminal to the computer of the application server is received from the client terminal Function, a mixed pattern determining function for determining the mixed pattern based on a transmission / reception request set in the client terminal, and transmitting the determined mixed pattern to the media server A function of restricting the specific client terminal X designated by the client terminal Z from transmitting stream media to the client terminal in the mixed pattern determining function. A function for limiting the reception of stream media transmitted by other client terminals Y, with the mute being expressed and the stream media received by the client terminal Z being only stream media transmitted by the specified client terminal X (1) When the client terminal X is muted, based on the request content determination function for determining the selection indicating from the transmission / reception request, and the request content determined by the request content determination function; ) The client terminal X is muted When the client terminal Y is selected and the client terminal X is not selected, the client terminal Z is unable to receive the stream media transmitted by the client terminal X. A mixed pattern determining program for realizing a mixed pattern determining function for determining and determining the mixed pattern.

  As described above, in the multimedia conference system, the application server, the mixed pattern determining method, and the mixed pattern determining program according to the present invention, one of the plurality of client terminals is the client terminal Z, and the client terminal Z is the client terminal Z. When the specific client terminal to be requested in the transmission / reception request to be set is the client terminal X and the other client terminal is the client terminal Y, the client terminal Z restricts the transmission of the stream media to the client terminal Z by the client terminal X. The mute indicating the function to be performed and the stream media received by the client terminal Z are limited to the stream media transmitted by the client terminal X, and the stream media transmitted by other client terminals Y are received. It is possible to set a select that represents the function of limiting the Rukoto as reception request.

  The application server determines mute and select based on the transmission / reception request, and the stream media transmitted from the client terminal X cannot be received by the client terminal Z based on the combination of the client terminals targeted for mute and select. Whether or not the mixed pattern can be determined.

  Here, the case where the stream media transmitted by the client terminal X cannot be received by the client terminal Z corresponds to the case where the client terminal X shown in (1) is muted. When the client terminal X is muted by the client terminal Z, the mute function restricts the transmission of the stream media to the client terminal Z by the client terminal X. Cannot receive stream media.

  Further, as shown in (2), even when the client terminal X is not muted, the client terminal Y is selected, and the client terminal X is not selected, the stream media transmitted by the client terminal X is not The client terminal Z cannot receive.

  Here, as described above, when the client terminal Z designates the client terminal X, the select function refers to the stream media received by the client terminal Z only as the stream media transmitted by the client terminal X, and other clients. This means a function for restricting reception of stream media transmitted by the terminal Y.

  Accordingly, even when the client terminal X is not muted by the client terminal Z and the transmission of the stream media to the client terminal Z by the client terminal X is not restricted, the client terminal Z selects another client terminal Y. In this case, the stream media that can be received at the client terminal Z is only the stream media transmitted by the client terminal Y, and the client terminal Z may be restricted from receiving the stream media transmitted by the client terminal X. is there.

  Therefore, when the client terminal Z selects the client terminal Y, it is determined whether or not the client terminal X is selected by the client terminal Z. When the client terminal Z selects the client terminal Y and the client terminal Z selects the client terminal X, the client terminal Z receives not only the stream media of the client terminal Y but also the stream media of the client terminal X. Therefore, the client terminal Z can receive the stream media transmitted by the client terminal X. On the other hand, when the client terminal Z selects the client terminal Y and the client terminal Z does not select the client terminal X, the client terminal Z can receive only the stream media of the client terminal Y. Therefore, the client terminal Z cannot receive the stream media transmitted by the client terminal X.

  In the application server, by applying the determination conditions (1) and (2) described above to all the client terminals Y, the stream media transmitted from the client terminal X is changed to the client terminal based on the transmission / reception request for each client terminal. It is possible to quickly determine whether or not reception is possible in Z and to determine a mixed pattern indicating to which client terminal the stream media received from one client terminal is transmitted. In addition, since the application server determines the mixed pattern based on the above-described condition determination, the mixed pattern can be corrected without delay even when transmission / reception requests are received from the client terminal at different timings. It is possible to appropriately mix the stream media in the server.

  In the multimedia conference system described above, when the client terminal X shown in (2) is not muted, both the client terminal X and the client terminal Y are connected to the client terminal Z. Or if both are not the client terminal Z, it is determined whether the client terminal Y is selected and whether the client terminal X is selected, and the client terminal X and the client terminal Z When both the client terminal Y is the client terminal Z or both are not the client terminal Z, the client terminal Y is selected, and the client terminal X is not selected, the client Previous at terminal Z It may be configured to determine the mixing pattern is determined that it is impossible to receive the outgoing stream media client terminal X.

  Further, in the application server described above, when the client terminal X shown in the above (2) is not muted, the mixed pattern determining means causes both the client terminal X and the client terminal Y to Or if both are not the client terminal Z, it is determined whether the client terminal Y is selected, and whether the client terminal X is selected, and the client terminal X and the client terminal Z When both the client terminal Y is the client terminal Z or both are not the client terminal Z, the client terminal Y is selected, and the client terminal X is not selected, the client The terminal Z Ianto may be configured to determine the mixing pattern is determined that it is impossible to receive the outgoing stream media terminal X.

  In the mixed pattern determination method described above, in the mixed pattern determination step, the mixed pattern determination means is a case where the client terminal X shown in (2) is not muted, and the client terminal X and the Whether or not the client terminal Y is selected and whether or not the client terminal X is selected only when both the client terminal Y and the client terminal Z are the client terminal Z or both are not the client terminal Z Both the client terminal X and the client terminal Y are the client terminal Z, or both are not the client terminal Z, the client terminal Y is selected, and the client terminal Previous if X is not selected It may be configured to determine the mixing pattern is determined that it is impossible to receive the outgoing stream media of the client terminal X in a client terminal Z.

  Furthermore, the program for determining a mixed pattern described above is the case where the client terminal X shown in (2) is not muted in the computer in the mixed pattern determination function, and the client terminal X and the client terminal Whether or not the client terminal Y is selected and whether or not the client terminal X is selected only when both Y are the client terminal Z or both are not the client terminal Z Both the client terminal X and the client terminal Y are the client terminal Z, or both are not the client terminal Z, the client terminal Y is selected, and the client terminal X is Previous if not selected It may be a mixed pattern determination program for realizing that by determining that it is impossible to receive the outgoing stream media of the client terminal X in a client terminal Z is determined the mixed pattern.

  As described above, in the multimedia conference system, the application server, the mixed pattern determining method, and the mixed pattern determining program according to the present invention, the client terminal X shown in (2) is not muted, and the client terminal Only if both X and client terminal Y are client terminals Z or both are not client terminals Z, whether or not client terminal Y is selected and whether or not client terminal X is selected When both the client terminal X and the client terminal Y are the client terminals Z, or both are not the client terminals Z, the client terminal Y is selected, and the client terminal X is not selected. , Client terminal Z It determines the mixing pattern is determined to be impossible to receive the outgoing stream media Oite client terminal X.

  For example, when both the client terminal X and the client terminal Y are not the client terminal Z, the client terminal Z selects the client terminal X, so that the stream media that can be received by the client terminal Z is transmitted by the client terminal X. However, the reception of the stream media transmitted from the client terminal Y at the client terminal Z is restricted. Similarly, when the client terminal Z selects the client terminal Y, the stream media that can be received by the client terminal Z is only the stream media transmitted by the client terminal Y, and the client terminal Z transmits by the client terminal X. The received stream media is restricted.

  However, if the sender of the stream media is yourself and the recipient of the stream media that you send is also yourself, whether or not you select another client terminal, It is desirable to be able to receive the transmitted stream media by itself. In other words, it is desirable to adopt a configuration in which the restriction by the select function is not performed when the user himself / herself is regarded as a stream media receiver. Further, even when a selection is performed on another client terminal that is not itself, it is preferable that the stream media transmitted by another client terminal representing itself can be received by itself.

  For example, since a participant who participates in the multimedia conference system may operate a plurality of client terminals (a plurality of avatars in the present embodiment), different client terminals may each represent the participants themselves. In addition, the client terminal representing itself may transmit and receive stream media in different environments. In this way, even if the same participant operates multiple client terminals, the stream media that he / she sent in different environments are not restricted by the select function targeting himself / herself, and other people are also targeted. With the select function described above, it can be said that it is more preferable that the setting is not restricted when the stream media transmitted by a different client terminal representing itself is received by itself.

  That is, when the client terminal X is the client terminal Z and the client terminal Y is not the client terminal Z itself, even if the client terminal Z selects the client terminal Y, the client terminal X is its own stream media. It is desirable to set so that the stream media of the client terminal Z can be received. Therefore, when the client terminal X is the client terminal Z itself and the client terminal Y is not the client terminal Z itself, the client terminal Z receives the stream media transmitted by the client terminal X depending on whether the client terminal Y is selected. It is desirable not to be influenced by whether or not it can be done.

  On the other hand, when the client terminal X is not the client terminal Z itself and the client terminal Y is the client terminal Z itself, even if the client terminal Z selects the client terminal Y that is itself, the selection function of the client terminal Y It is desirable to set so that it does not work for itself. Therefore, when the client terminal X is not the client terminal Z itself and the client terminal Y is the client terminal Z itself, the client terminal Z receives the stream media transmitted by the client terminal X depending on whether the client terminal Y is selected. It is desirable not to be influenced by whether or not it can be done.

  Therefore, in the case where the client terminal X shown in (2) is not muted, the client terminal Y only when both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z. When only one of the client terminal X and the client terminal Y is the client terminal Z by determining whether or not the client terminal X is selected and whether or not the client terminal X is selected. Therefore, it is possible to prevent the client terminal Z from affecting the determination as to whether or not it is impossible to receive the stream media transmitted by the client terminal X.

  On the other hand, even when the client terminal X is the client terminal Z itself and the client terminal Y is the client terminal Z itself, as described above, the environment of the client terminal X and the environment of the client terminal Y are It does not necessarily match. For this reason, when the client terminal X and the client terminal Y are the client terminals Z themselves and there are a plurality of transmission sources indicating themselves as a result, the participant explicitly selects those transmission sources. It is preferable to be able to select (determine) a stream medium that can be received by itself.

  Therefore, if the client terminal X shown in (2) is not muted and if both the client terminal X and the client terminal Y are client terminals Z, whether or not the client terminal Y is selected, and By determining whether or not the client terminal X is selected, when the client terminal Y is selected, if the client terminal X is not explicitly selected, reception is performed at the client terminal Z. The possible stream media is limited to only the stream media transmitted by the client terminal Y, and the stream media transmitted by the client terminal X cannot be received by the client terminal Z.

  On the other hand, when the client terminal Y is not selected, the stream media that can be received by the client terminal Z are not limited by the stream media transmitted by the other client terminals Y, and thus are transmitted by the client terminal X. The stream media thus made can be received at the client terminal Z.

  Furthermore, when the client terminal Y is selected and the client terminal X is also explicitly selected, the stream media that can be received by the client terminal Z are the stream media transmitted by the client terminal Y, the client Since the stream medium is transmitted from the terminal X, the stream medium transmitted from the client terminal X can be explicitly selected and received by the client terminal Z.

  If the client terminal X is not the client terminal Z itself and the client terminal Y is not the client terminal Z itself, whether or not the client terminal Z can receive the stream media transmitted by the client terminal X is determined. , It depends on the selected state of the client terminal Y.

  Therefore, when the client terminal Z does not select the client terminal Y, the stream media received by the client terminal Z is not limited to the stream media transmitted by the client terminal Y, so the client terminal X is muted. Otherwise, the client terminal Z can receive the stream media transmitted by the client terminal X.

  On the other hand, when the client terminal Z selects the client terminal Y, the stream media received by the client terminal Z is only the stream media transmitted by the client terminal Y, and the stream transmitted by the client terminal X remains as it is. The media cannot be received at the client terminal Z. Therefore, when the client terminal Z selects the client terminal Y, the client terminal Z selects the client terminal X, so that the client terminal Z can receive the stream media of the client terminal X, and the client terminal Z If the client terminal X is not selected, the client terminal Z cannot receive the stream media of the client terminal X.

  Thus, in the application server, when the client terminal X shown in (2) is not muted, both the client terminal X and the client terminal Y are the client terminals Z, or both are the client terminals Z. Only when the client terminal Y is selected, and by determining whether the client terminal X is selected, the sender of the stream media is himself, When the receiver of the stream media transmitted by is also himself, the user can receive his / her stream media regardless of whether or not he / she selects another client terminal. In addition, even when a selection is made to another client terminal that is not itself, it is possible to receive the stream media spoken by another client terminal representing itself by itself. Become.

  Further, whether or not the client terminal Y is selected when the client terminal X shown in (2) is not muted and both the client terminal X and the client terminal Y are the client terminals Z. And if it is configured to determine whether or not the client terminal X is selected, if the participant itself becomes a plurality of sound sources, it can be received by the participant by selecting them explicitly An appropriate stream medium can be explicitly determined (selected).

  In the multimedia conference system described above, the client terminal Z that sets the transmission / reception request restricts reception of the stream media transmitted by the client terminal Z at the specific client terminal X specified by the client terminal Z. Only the specified client terminal X can receive the defun indicating the function to be performed and the stream media transmitted by the client terminal Z, and the other client terminal Y receives the stream media transmitted by the client terminal Z An attendance representing a function that restricts the transmission can be set as the transmission / reception request, and the application server is configured such that (3) the client terminal X is defuncted, and (4) the client terminal X It ’s not defunct. When the client terminal Y is attended and the client terminal X is not attended, it is determined that the client terminal X cannot receive the stream medium transmitted by the client terminal Z. The mixing pattern may be determined.

  Furthermore, the application server according to the present invention is an application server that determines a mixed pattern of the stream media used for a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal. The transmission / reception request receiving means for receiving a stream media transmission / reception request set by designating a specific client terminal in the client terminal, and the transmission / reception request set in the client terminal. A mixed pattern determining means for determining a mixed pattern; and a transmitting means for transmitting the determined mixed pattern to the media server, wherein the mixed pattern determining means is specified by the client terminal Z. In the client terminal X, only the specified specific client terminal X can receive the defun indicating the function of restricting reception of the stream media transmitted by the client terminal Z and the stream media transmitted by the client terminal Z. The attendant representing the function of restricting reception of the stream media transmitted by the client terminal Z at the other client terminal Y is determined from the transmission / reception request, and (3) the client terminal X is defuncted. And (4) when the client terminal X is not defuncted, the client terminal Y is attended, and the client terminal X is not attended, the client terminal X of the client terminal Z Outgoing stream media It is determined that it is impossible to receive and determines the mixing pattern.

  Also, the mixed pattern determination method according to the present invention determines, in the application server, the mixed pattern of the stream media used for the process of mixing the stream media received from the plurality of client terminals by the media server and transmitting the mixed media to the client terminal. A transmission / reception request receiving step in which a transmission / reception request receiving unit receives a transmission / reception request of a stream medium set by designating a specific client terminal in the client terminal; Based on the transmission / reception request set in the client terminal, a mixed pattern determining unit determines the mixed pattern, and a transmitting unit transmits the determined mixed pattern to the media server. The mixed pattern determining step, wherein the mixed pattern determining means restricts reception of the stream media transmitted by the client terminal Z at the specific client terminal X designated by the client terminal Z. Only the specified client terminal X can receive the defun indicating the function to be performed and the stream media transmitted by the client terminal Z, and the other client terminal Y receives the stream media transmitted by the client terminal Z A request content determination step for determining an attendance representing a function that restricts execution from the transmission / reception request, and the mixed pattern determination means based on the request content determined in the request content determination step (3) Client terminal X is defunct And (4) when the client terminal X is not defuncted, the client terminal Y is attended, and the client terminal X is not attended, the client terminal X A mixed pattern determining step of determining that it is impossible to receive the stream medium transmitted from the terminal Z and determining the mixed pattern.

  Furthermore, the mixed pattern determination program according to the present invention provides the application server with the mixed pattern of the stream media used for the process of mixing the stream media received from a plurality of client terminals by the media server and transmitting the mixed media to the client terminal. A mixed pattern determination program for determining, wherein a transmission request for a stream medium set by designating a specific client terminal in the client terminal to the computer of the application server is received from the client terminal Function, a mixed pattern determining function for determining the mixed pattern based on a transmission / reception request set in the client terminal, and transmitting the determined mixed pattern to the media server A function of restricting reception of stream media transmitted by the client terminal Z at the specific client terminal X designated by the client terminal Z in the mixed pattern determination function. Only the specified specific client terminal X can receive the defun and the stream media transmitted by the client terminal Z, and the other client terminal Y can receive the stream media transmitted by the client terminal Z. A request content determination function for determining an attendance representing a function to be restricted from the transmission / reception request; and (3) a case where the client terminal X is defunced based on the request content determined by the request content determination function; (4) The client terminal X is When the client terminal Y is not attended and the client terminal X is not attended, the client terminal X cannot receive the stream media transmitted by the client terminal Z. It is a mixed pattern determining program for realizing a mixed pattern determining function for determining the mixed pattern by determining that

  As described above, in the multimedia conference system, the application server, the mixed pattern determination method, and the mixed pattern determination program according to the present invention, one of the plurality of client terminals is the client terminal Z, and the client terminal Z is the client terminal Z. When the specific client terminal to be requested in the transmission / reception request to be set is the client terminal X and the other client terminal is the client terminal Y, the client terminal Z is the client terminal X specified by the client terminal Z. Only the specified specific client terminal X can receive the defun indicating the function of restricting reception of the stream medium transmitted by Z and the stream medium transmitted by the client terminal Z, and the client And attend that represents the function of restricting the receiving stream media youngest Z originates in other client terminal Y, it may be set as a reception request.

  The application server determines the defun and attend from the transmission / reception request, and the stream media transmitted from the client terminal Z cannot be received by the client terminal X based on the combination of the client terminal that is the target of the defun and attend. Whether or not the mixed pattern can be determined.

  Here, the case where the stream media transmitted from the client terminal Z cannot be received by the client terminal X corresponds to the case where the client terminal X shown in (3) is defunct. When the client terminal X is defunded by the client terminal Z, the client terminal X restricts the client terminal X from receiving the stream media transmitted by the client terminal Z by the defun function. The stream media sent by cannot be received.

  In addition, as shown in (4), the client terminal Z transmits even when the client terminal X is not defuncted, the other client terminal Y is attended, and the client terminal X is not attended. It becomes impossible for the client terminal X to receive the stream media.

  Here, as described above, the attend function is a stream that can be received only by the client terminal X when the client terminal Z designates the client terminal X, and can be received by the client terminal Z. This means a function for restricting reception of media at other client terminals Y.

  Therefore, even when the client terminal X is not defunded by the client terminal Z and the reception of the stream media transmitted by the client terminal Z is not restricted at the client terminal X, the client terminal Z attends another client terminal Y. In this case, the stream media transmitted by the client terminal Z can be received only by the client terminal Y, and the client terminal X may be restricted from receiving the stream media transmitted by the client terminal Z.

  Therefore, when the client terminal Z attends the client terminal Y, it is determined whether or not the client terminal X is attended by the client terminal Z. When the client terminal Z attends the client terminal Y and the client terminal Z attends the client terminal X, the stream media transmitted at the client terminal Z is received not only at the client terminal Y but also at the client terminal X. Therefore, the client terminal X can receive the stream media transmitted from the client terminal Z. On the other hand, when the client terminal Z attends the client terminal Y and the client terminal Z does not attend the client terminal X, only the client terminal Y receives the stream media transmitted by the client terminal Z. Therefore, the client terminal X cannot receive the stream media transmitted from the client terminal Z.

  In the application server, by applying the determination conditions (3) and (4) described above to all the client terminals Y, the stream media transmitted from the client terminal Z can be changed based on the transmission / reception request for each client terminal. It is possible to quickly determine whether or not the data can be received at X, and to determine a mixed pattern indicating to which client terminal the stream media received from one client terminal is transmitted. In addition, since the application server determines the mixed pattern based on the above-described condition determination, the mixed pattern can be corrected without delay even when transmission / reception requests are received from the client terminal at different timings. It is possible to appropriately mix the stream media in the server.

  Further, in the multimedia conference system, when the client terminal X shown in (4) is not defunct, the application server is configured such that both the client terminal X and the client terminal Y are the client terminal Z. Only when both are not the client terminal Z, it is determined whether the client terminal Y is attended and whether the client terminal X is attended, and the client terminal X and the client terminal Y is both the client terminal Z or both are not the client terminal Z, the client terminal Y is attended, and the client terminal X is not attended, the client terminal X In the above-mentioned Claire It is determined that it is impossible to receive the outgoing stream media preparative terminal Z may be configured to determine the mixed pattern.

  Further, when the client terminal X shown in the above (4) is not defunct, the application server described above is configured so that the mixed pattern determining means causes both the client terminal X and the client terminal Y to be the client terminal Z. Or if both are not the client terminal Z, it is determined whether the client terminal Y is attended and whether the client terminal X is attended, and the client terminal X and the client terminal Z The client when both the client terminal Y is the client terminal Z or both are not the client terminal Z, the client terminal Y is attended, and the client terminal X is not attended The terminal X It is determined that it is impossible to receive the outgoing stream media Ant terminal Z may be configured to determine the mixed pattern.

  In the mixed pattern determination method described above, in the mixed pattern determination step, the mixed pattern determination means is a case where the client terminal X shown in (4) is not defunded, and the client terminal X and the Whether or not the client terminal Y is attended and whether or not the client terminal X is attended only when both of the client terminals Y are the client terminals Z or both are not the client terminals Z Both of the client terminal X and the client terminal Y are the client terminal Z, or both are not the client terminal Z, the client terminal Y is attended, and the client terminal When X is not attended, Client may be configured to determine the mixing pattern is determined that it is impossible to receive the outgoing stream media of the client terminal Z at the terminal X.

  Furthermore, the program for determining a mixed pattern described above is the case where the client terminal X shown in (4) is not defensed in the computer in the mixed pattern determination function, and the client terminal X and the client terminal Whether or not the client terminal Y is attended and whether or not the client terminal X is attended only when both Y are the client terminal Z or both are not the client terminal Z The client terminal X and the client terminal Y are both the client terminal Z, or both are not the client terminal Z, the client terminal Y is attended, and the client terminal X is If not attended, the It may be a mixed pattern determination program for realizing thereby determining the mixing pattern is determined that it is impossible to receive the outgoing stream media of the client terminal Z in client terminal X.

  As described above, in the multimedia conference system, the application server, the mixed pattern determining method, and the mixed pattern determining program according to the present invention, the client terminal X shown in (4) is not defunct, and the client terminal Only if both X and client terminal Y are client terminals Z or both are not client terminals Z, whether client terminal Y is attended and whether client terminal X is attended When both the client terminal X and the client terminal Y are the client terminals Z, or both are not the client terminals Z, the client terminal Y is attended, and the client terminal X is not attended , To client terminal X There are determined a mixed pattern is determined that it is impossible to receive the outgoing stream media client terminal Z.

  For example, when both the client terminal X and the client terminal Y are not the client terminal Z, the client terminal Z attends the client terminal X, so that the stream media transmitted from the client terminal Z is received only by the client terminal X. And reception at the client terminal Y is restricted. Similarly, when the client terminal Z attends the client terminal Y, the stream media transmitted from the client terminal Z is received only by the client terminal Y, and reception by the client terminal X is restricted.

  However, if the caller of the stream media is yourself and you are also receiving the stream media you send, you will be able to send it regardless of whether you are attending another client terminal or not. It is desirable to be able to receive the stream media by itself. In other words, it is desirable to adopt a configuration in which the restriction by the attend function is not performed when the user himself / herself is regarded as a stream media receiver. Further, even when an attendance is performed on another client terminal that is not itself, it is preferable that the stream media spoken by another client terminal representing itself can be received by itself.

  For example, since a participant who participates in the multimedia conference system may operate a plurality of client terminals (a plurality of avatars in the present embodiment), different client terminals may each represent the participants themselves. In addition, the client terminal representing itself may transmit and receive stream media in different environments. In this way, even when the same participant operates multiple client terminals, his / her speech in different environments is not limited by the attend function for himself / herself, and an attendant for others According to the function, it can be said that it is more preferable that the setting is not restricted when the stream media transmitted by a different client terminal representing itself is received.

  That is, when the client terminal X is the client terminal Z itself and the client terminal Y is not the client terminal Z itself, even if the client terminal Z attends the client terminal Y, the client terminal X representing itself represents itself. It is desirable to set so that the stream media transmitted by the client terminal Z to be represented can be received. Therefore, when the client terminal X is the client terminal Z itself and the client terminal Y is not the client terminal Z itself, the stream media transmitted from the client terminal Z is transmitted to the client terminal X depending on whether the client terminal Y is attended. It is desirable not to be affected by whether or not it can be received.

  On the other hand, even if the client terminal X is not the client terminal Z itself and the client terminal Y is the client terminal Z itself, even if the client terminal Z attends the client terminal Y that is itself, the attend function of the client terminal Y It is desirable to set so that it does not work for itself. Therefore, when the client terminal X is not the client terminal Z itself and the client terminal Y is the client terminal Z itself, the stream media transmitted from the client terminal Z is transmitted to the client terminal X depending on whether the client terminal Y is attended. It is desirable not to be affected by whether or not it can be received.

  Therefore, in the case where the client terminal X shown in (4) is not defunct, only when both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z, the client terminal Y In the case where only one of the client terminal X and the client terminal Y is the client terminal Z by determining whether or not the client terminal X is attended and whether or not the client terminal X is attended. Thus, it becomes possible not to affect whether it is impossible for the client terminal X to receive the stream media transmitted at the client terminal Z.

  On the other hand, even when the client terminal X is the client terminal Z itself and the client terminal Y is the client terminal Z itself, as described above, the environment of the client terminal X and the environment of the client terminal Y are It does not necessarily match. Therefore, when the client terminal X and the client terminal Y are the client terminals Z themselves, and as a result, there are a plurality of listeners who receive the stream media transmitted by themselves, and there are a plurality of listeners, It is preferable to be able to select (determine) client terminals that can receive their own stream media by explicitly selecting those listeners.

  Therefore, in the case where the client terminal X shown in (4) is not defuncted, if both the client terminal X and the client terminal Y are client terminals Z, whether or not the client terminal Y is attended, and The client terminal X is configured to determine whether the client terminal X is attended. When the client terminal Y is attended, if the client terminal X is not explicitly attended, the client terminal Z makes a call. Therefore, the received stream media is restricted from being received at the client terminal X, and the stream media transmitted from the client terminal Z cannot be received at the client terminal X.

  On the other hand, when the client terminal Y is not attended, the stream media transmitted at the client terminal Z is not limited by the stream media transmitted by other client terminals Y. The stream media transmitted by the client terminal Z can be received.

  Further, when the client terminal Y is attended and the client terminal X is also explicitly attended, the stream media transmitted from the client terminal Z is received by the client terminal Y and the client terminal X. Therefore, the stream media transmitted by the client terminal Z can be received by the client terminal X.

  If the client terminal X is not the client terminal Z itself and the client terminal Y is not the client terminal Z itself, whether or not the stream media transmitted from the client terminal Z can be received by the client terminal X Depends on the attendance state of the client terminal Y.

  Therefore, when the client terminal Z does not attend the client terminal Y, reception of the stream media transmitted at the client terminal Z is not limited to the client terminal Y. Therefore, if the client terminal X is not defunct, The stream media transmitted in Z can be received by the client terminal X.

  On the other hand, when the client terminal Z attends the client terminal Y, the stream media transmitted at the client terminal Z is received only by the client terminal Y. Stream media cannot be received. Therefore, when the client terminal Z attends the client terminal Y, the client terminal Z attends the client terminal X, whereby the stream media transmitted from the client terminal Z can be received by the client terminal X. When the client terminal Z does not attend the client terminal X, the client terminal X cannot receive the stream media of the client terminal Z.

  As described above, in the application server, when the client terminal X shown in (4) is not defunct, both the client terminal X and the client terminal Y are the client terminals Z, or both are the client terminals Z. Only when the client terminal Y is attended and whether or not the client terminal X is attended, the sender of the stream media is himself, If the person who receives the stream media transmitted by is also himself, the user can receive his / her stream media regardless of whether he / she is attending another client terminal or not. In addition, even when an attendance is performed on another client terminal that is not itself, it is possible to receive the stream media remarked by another client terminal representing itself by itself. Become.

  Further, whether or not the client terminal Y is attended when the client terminal X shown in (4) is not defunded and both the client terminal X and the client terminal Y are the client terminals Z. In addition, when the client terminal X is configured to determine whether or not the client terminal X is being attended, when there are a plurality of recipients representing themselves, the participant can By explicitly selecting the recipient, it is possible to explicitly determine (select) a client terminal that can receive the stream media transmitted by itself.

  In the multimedia conference system, the application server, the mixed pattern determination method, and the mixed pattern determination program according to the present invention, the application server determines the mixed pattern based on the transmission / reception request set in the client terminal, and the media server In order to mix the stream media based on the mixing pattern determined in the server and transmit the stream media that can satisfy the transmission / reception request to each client terminal, the client terminal satisfies the transmission / reception request set for each client terminal. It is possible to receive the obtained stream media.

  In the multimedia conference system, the application server, the mixed pattern determination method, and the mixed pattern determination program according to the present invention, the application server sets the determination conditions (1) to (4) described above for all client terminals Y. By applying, it is possible to determine a mixed pattern indicating to which client terminal the stream media received from one client terminal is transmitted.

  Furthermore, since the application server determines the mixed pattern based on the above-described condition determination, the mixed pattern can be corrected without delay even when transmission / reception requests are received from the client terminal at different timings. It is possible to appropriately mix the stream media.

  Hereinafter, a multimedia conference system according to the present invention will be described in detail with reference to the drawings.

  As shown in FIG. 1, the multimedia conference system 1 is roughly configured by a media server 2, an application server 3, a CVE (Collaborative Virtual Environment) server 4, and a client terminal 5. In the multimedia conference system 1 according to the present embodiment, audio data (stream media) in the stream data format acquired via the client terminal 5 is acquired by the media server 2, and a privacy setting request from each client terminal 5 is obtained. In accordance with (transmission / reception setting), the application server 3 determines the mixing process content (mixing pattern) of the audio data, the media server 2 mixes the audio data according to the mixing process content, and sends the audio data to each client terminal 5. Performs outgoing (stream delivery) processing.

  The client terminal 5 means an information terminal operated by a participant who participates in a multimedia conference. Specifically, a personal computer, a mobile phone, a PDA (Personal Digital Assistant, or Personal Data Assistance) or the like is applicable. To do. Further, the client terminal 5 may be a telephone or the like capable of handling audio data via the network. The client terminal 5 has a function of performing operations such as starting, changing, and ending a session with respect to the application server 3. For session control by the client terminal 5, SIP (Session Initiation Protocol) is used.

  Participants participating in the multimedia conference access the application server 3 from the client terminal 5 by using a SIP Uniform Resource Identifier (URI) provided for participating in the conference, and join, change, and end the conference. It is possible to perform basic control. Participants obtain the conference URI using e-mail, using instant messaging, using information linked to a web page, or using a non-SIP method It is possible to obtain it.

  Access from the client terminal 5 to the application server 3 is performed using Xpath (XML Path Language: a language syntax that specifies a specific part of a document conforming to XML (Extensible Markup Language)) or XCAP (XML Configuration Access Protocol: server). An XML database (a database having a function for handling XML) using a protocol for operating the above data from a client, or HTTP (Hypertext Transfer Protocol: communication used for content transmission / reception between a Web browser and a Web server) JSP (Java (registered trademark) Plug-in Framework) / JSP (Java (registered trademark) Server Pages: Java code (embedded in HTML) embedded in HTML and dynamically transmitted by the Web server Technology that generates a web page and returns it to the client) command It is realized by using.

  The client terminal 5 can transmit four types of privacy setting requests (transmission / reception requests) to the application server 3 via the CVE server 4. Specifically, four requests “mute”, “defen”, “select”, and “attend”, which will be described later, can be transmitted. In the multimedia conference system 1 according to the present embodiment, these four requests are made by operating an avatar (a doll that visually shows a participant in the virtual space) in the virtual space constructed by the CVE server 4. Is transmitted to the application server 3.

  The CVE server 4 is a server for realizing the formation of a virtual space within the SIP framework. The CVE server 4 has a function of forming a virtual space on the network (more specifically, in the server) and virtually realizing an avatar operation by each participant in the formed virtual space. Each participant can operate the avatar in the virtual space by accessing the CVE server 4 using the client terminal 5, and can visually determine the privacy setting according to the state of the avatar.

  Further, the application server 3 is provided with a CVE client 4a capable of acquiring avatar operation information. The application server 3 requests a private setting (transmission / reception request) for each client terminal 5 based on the operation of the avatar operated by the participant via the CVE client 4a (or based on the operation command of the avatar by the participant). ). Therefore, the CVE client 4a corresponds to a transmission / reception request receiving means for receiving a privacy setting request (transmission / reception request) of the client terminal 5. The access from the client terminal 5 to the CVE server 4 and the access from the CVE server 4 to the CVE client 4a are performed by a TCP (Transmission Control Protocol) socket.

  FIG. 2 is a diagram showing an avatar control panel and a display screen operated on the client terminal 5. In the client terminal 5, it is possible to operate the avatar in the virtual space constructed | assembled by the CVE server 4 using the control panel 7b shown in FIG. In addition, the participant can operate at least one avatar or more as an avatar indicating himself / herself in the virtual space. In order to ensure privacy with other participants, the participant can cause the avatar to perform the following four operations shown in FIG.

(1) “Mute”
The mute means a function of blocking voice data transmitted from a speaker (speaking opinion). For example, if you want to block the transmission of your voice data, that is, if you want to prevent your voice data from being heard by other participants, close your avatar's mouth in your virtual space Perform the action. By operating the avatar and closing the mouth with the hand in this way, it is possible to prevent the voice data from being transmitted to other participants.

  In addition, by operating your avatar and closing the other participant's mouth with your avatar's hand, you may prevent other participants' voice data from being blocked from reaching your voice. it can. In the "Avatar operation status" column of "P1 mutes P2" in the table shown in FIG. As shown in this figure, when the other participant's mouth is closed with the hand of his / her avatar, the hand is displayed so that the thumb is positioned on the lower side. On the other hand, when closing his / her mouth with his / her hand, the hand is displayed such that the thumb is positioned on the upper side.

  As shown in the table of FIG. 3, when the participant P2 is muted by holding the mouth of another participant P2 with the hand of the avatar of himself / herself P1, it is clear from the vector shown in the “audio data transmission / reception relationship” column. In addition, the voice data of the own P1 reaches the other participants P2, P3, and P4, but the voice data of the participant P2 does not reach the own P1. Since the other participants P3 and P4 are not muted, their own P1 can receive (hear) the audio data of the other participants P3 and P4, and the audio data of the participant P2 is It reaches other participants P3 and P4. In this way, the mute function blocks audio data from the muted participant to the participant P1 when the participant P1 identifies and mutees the participant (including himself) to be muted. It is a function.

(2) “Defen”
Defoon is a privacy function related to reception of audio data. Specifically, it means a function that prevents the selected participant from receiving (not hearing) the audio data on this side. For example, when a specific participant does not want to hear (not to receive) his / her opinion (audio data), the user's avatar's hand closes the ears of the opponent's avatar. In this way, by operating the avatar and closing the other party's ears by hand, it is possible to prevent the voice data from being transmitted to other participants. In addition, by operating his / her avatar and closing his / her ear with his / her hand, the voice data of the specified specific participant can be prevented from reaching him / her.

  The “Avatar operation status” column of “P1 deafens P2” in the table shown in FIG. 3 shows a state in which the ears of other participants are being held by the hand of their own avatar. In this way, when the other participant's ear is closed with the hand of his / her avatar, the hand is displayed with the thumb positioned on the upper side. On the other hand, when closing his / her ear with his / her hand, the hand is displayed such that the thumb is positioned on the lower side.

  As shown in the table of FIG. 3, when the participant P2 is defunced by pressing the ears of the other participant P2 with the hand of the avatar of his own P1, as is clear from the vector in the “audio data transmission / reception relationship” column. The self P1 can receive the audio data of the other participants P2, P3, and P4, but the audio data of the self P1 reaches only the participants P3 and P4 other than the defunded participant P2. That is, it is possible to perform control so that only the participant P2 does not hear his / her voice data. Note that the function of the participant P1 dedefining the participant P2 in this manner is the same as the function of the participant P2 muting the participant P1.

(3) “Select”
Select means a function that restricts audio data received by a participant to only audio data output by a specific participant. For example, if there are many participants and each outputs audio data, if you want to receive only the audio data of a specific participant, select that participant to receive the audio data of other participants In addition, only the audio data of the selected participant can be received. For this reason, the select function means a function of selecting a sender of voice data (that is, a participant who becomes a sound source of voice data).

  As shown in the “Avatar operation status” column of “P1 selections P2” in the table shown in FIG. 3, when the participant P1 selects a specific participant P2, a megaphone is placed in the avatar's mouth of the selected participant P2. Is displayed, and the participant P1 receives only audio data from the avatar on which the megaphone is displayed. Since the select is a command for controlling the reception of the sound source, even if the participant P1 selects the participant P2, the participants P2, P3, and P4 receive the audio data of the participant P1. Can do.

(4) "Attend"
“Attend” means a function that allows only a specific participant to receive specific audio data. For example, if there are a large number of participants and each of them is receiving audio data, if they want to receive only their audio data for a specific participant, the other participant will be able to Audio data cannot be received, and only attended participants can receive their own audio data. For this reason, the attendant function means a function in which the caller selects a receiver of voice data (that is, a participant who wants to listen to the voice data).

  As shown in the “Avatar operation status” column of “P1 attends P2” in the table shown in FIG. 3, when the participant P1 attends a specific participant P2, a megaphone Is displayed, and the audio data of the participant P1 is received only by the participant P2 displaying the megaphone. Note that the attendant is a command for restricting the participants who can receive the audio data, and therefore the sound source data of other participants received by the participant P1 is not restricted. Therefore, when the participant P1 attends the participant P2, the voice data of the participant P1 is not transmitted to other than the participant P2, but the participant P1 receives the voice data of the participants P2, P3, and P4. be able to.

  When selecting the avatar of the target participant and selecting “Mute”, “Defen”, “Select”, or “Attend”, the participant performs a check operation on a predetermined item on the control panel 7 b of the client terminal 5. Two avatars are displayed on the display screen 7a shown in FIG. 2, the avatar 8 located on the right side of the display screen 7a is “Avatar0” shown on the control panel 7b, and the avatar 9 located in the middle is “Avatar1” shown on the control panel 7b and the avatar 10 located at the left end show “Avatar2” shown on the control panel 7b. In the multimedia conference system 1 according to the present embodiment, the user is represented by checking the operation item 11 of “Self” (self) provided in the left column of the coordinate position item 20 of the control panel 7b shown in FIG. It is possible to set an avatar. In the control panel 7b shown in FIG. 2, since the operation item 11 of “Self” (self) of “Avatar0” is checked, “Avatar0” exists in the virtual space as an avatar representing the operator himself / herself. become.

  When the participant performs the mute operation and the defunct operation of the avatar, two patterns, that is, a case where the subject is himself (Self) and a case where the subject is another person (Other) can be selected. Therefore, the “Self” operation item 12 on the control panel is provided with a “Mute” check item 13 and a “Deafen” check item 14. The operation item 15 is provided with a “Mute” check item 16 and a “Deafen” check item 17. Further, on the right side of these operation items, operation items 18 and 19 for performing “Select” (select) and “Attend” (attend) operations are also provided. Since the target of the select operation and the attend operation is only other avatars, the operation items 18 and 19 for performing the select operation and the attend operation are not provided with the “Self” operation item and the “Other” operation item. Absent.

  In the control panel 7b shown in FIG. 2, since the avatar 1 is muted by the avatar 0 as shown in the control panel 7b, the hand closing the mouth of the avatar 1 indicates the hand of the avatar 0 and the thumb is on the lower side. It is displayed so that it is located. Similarly, since the avatar 2 is defuncted by the avatar 0, the hand that closes the ear of the avatar 2 indicates the hand of the avatar 0, and the thumb is positioned on the upper side.

  In addition, in a terminal that is difficult to display an avatar graphically using the display screen 7a, such as a mobile phone, a method for indicating the state of the avatar using a mobile icon as shown in FIG. 3 is used. When this mobile icon is used, the position of the thumb cannot be confirmed.

  The content of the privacy setting request (transmission / reception request) set for each participant using the control panel 7b shown in FIG. 2 is transmitted to the application server 3 via the CVE server 4 and the CVE client 4a.

  The application server 3 evaluates the privacy setting corresponding to each avatar in response to the request for the privacy setting of each participant acquired via the CVE server 4, and the voice data according to the evaluated privacy setting. It has a role to determine which participant (avatar) needs to be mixed. Here, the privacy relationship of each participant is called a policy. Therefore, the application server 3 has a function as a policy setting server.

  As shown in FIG. 1, the application server 3 includes a calculation processing unit 3a that performs policy calculation / determination processing, policy evaluation processing, and voice data mixing determination processing, and a control program (described later). 6 to 8 and the like, and a communication unit (transmission means) 3c for transmitting the determined mixed pattern to the media server 2. The arithmetic processing unit 3a executes the above-described policy calculation / determination processing, policy evaluation processing, audio data mixing determination processing, and the like according to a program stored in the storage unit 3b.

  FIG. 4 is a matrix obtained by counting and calculating the privacy settings requested by the participants, and the relationship between the audio data transmitted from each participant and the audio data that can be received by each participant Is shown. The matrix shown in FIG. 4 shows a case where there are n avatars. The matrix column indicates the voice data sender and the row indicates the voice data receiver. In the matrix, for example, the content indicated as (P1 → P2) indicates a case where audio data is transmitted from the participant P1 and received by the participant P2. Two settings of P1 (P1 → P2) and P2 (P1 → P2) are shown in the same cell of the matrix, but P1 (P1 → P2) is sent from the avatar P1 to the avatar P1. P2 (P1 → P2) indicates a policy set for the voice data received from the avatar P1 and received by the avatar P2. ing.

  For example, when there are four avatars, the matrix when the avatar P1 is muted with respect to the avatar P2 is set as shown in the "Privacy setting matrix" column of "P1 mutes P2" in the table shown in FIG. The Further, a matrix when the avatar P1 is defunct with respect to the avatar P2 is set as shown in the "Privacy setting matrix" column of "P1 deafens P2" in the table shown in FIG. Further, the matrix when the avatar P1 selects the avatar P2 is set as shown in the “Privacy setting matrix” column of the “P1 selections P2” in the table shown in FIG. The matrix when the avatar P1 is attended to the avatar P2 is set as shown in the "Privacy setting matrix" column of "P1 attends P2" in the table shown in FIG.

  FIG. 5 shows a request for privacy setting (transmission / reception request) set by the participant by the arithmetic processing unit 3a of the application server 3 as to whether or not the voice data of a specific participant can be acquired by a certain participant. It is the figure which showed the logical judgment formula (predicate calculation notation) for calculating based on this.

  The formula (1) shown in FIG. 5 shows a comprehensive judgment formula, and the formula (2) is set based on the formula (1) with a speaker / speaker (sending voice data) as a subject. Is a judgment formula showing the relationship between “mute” and “select”, which is a command to be executed, and formula (3) is a command set mainly by a listener / listener (a person who receives audio data). This is a judgment formula showing the relationship between “defen” and “attend”.

  As described above, “mute” is an instruction to explicitly invalidate voice data of a designated speaker, and “select” explicitly invalidates voice data other than the designated speaker. It is an instruction. For this reason, it can be said that “select” is equivalent to an instruction to “mute” all participants other than the speaker specified by “select”. Therefore, when determining the validity of audio data when there is a participant muted by the mute command, it is necessary to consider the presence or absence of the selected participant, and there is a participant selected by the select command. In determining the validity of the audio data in this case, it is necessary to consider the presence or absence of muted participants. Similarly, when determining the validity of audio data when there is a participant defunded by the defunc command, it is necessary to consider the presence or absence of the attended participant. When determining the validity of audio data when there is a person, it is necessary to consider the presence or absence of a defunct participant.

  Formula (1) which is the comprehensive judgment formula mentioned above is demonstrated in detail.

  Expression (1) is an expression for checking whether or not the target avatar (client terminal 5, participant) x is in a valid state. Here, whether or not the target x is in a valid state is whether or not the sound data of x can be heard by the user as shown in Expression (2) when x is treated as a speaker (valid when it can be heard). In addition, when x is treated as a listener, it means whether or not the user's own voice data can be heard by x as shown in Expression (3).

  Expressions (1) to (3) are based on the premise that a plurality of avatars representing themselves are present in the virtual space. That is, one participant can set two or more avatars as his / her avatar. Therefore, when it is determined whether or not the transmission or reception of the voice data related to a specific avatar x is valid using this expression, whether x and all other avatars y are avatars that indicate themselves. It is necessary to judge whether or not.

  In addition, as described above, the situation where it is determined that transmission or reception of audio data related to x is valid is when x is explicitly enabled (for example, x is “muted” or “defung”). In addition to x, if there are no participants explicitly enabled other than x (for example, if there is no person who is explicitly “selected” or “attended” by a participant other than x) )You could think so.

式（４）は、式（１）の一部分を構成する式である。
この式（４）を更に分解して説明する。式（４）に含まれる式（５）は、

“ｘもｙも自分自身である“場合と、”ｘもｙも自分自身でない“場合にのみ真と判断される。また、式（４）に含まれるｉｎｃｌｕｄｅ（ｙ）は、“ｙが明示的に有効にされている”という条件を表しており、この条件はつまり、ｙが話者であるならば、ｙが「セレクト」されている場合に真となり、ｙが聴取者であるならば、ｙが「アテンド」されている場合に真となる。 In addition, when x is a speaker, whether voice data of x reaches itself depends on the states of participants other than x. For example, if a participant other than x is “selected”, the audio data of x cannot be heard by himself unless x is also explicitly “selected”. On the other hand, when x is a listener, if there is a person who is “attended” among the participants other than x, his / her voice data is not included unless x is also explicitly “attended”. Does not reach x. Thus, the part which judges about the relationship with participants other than x is Formula (4) described below.

Expression (4) is an expression constituting a part of Expression (1).
This equation (4) will be further decomposed and described. Formula (5) included in Formula (4) is

It is determined to be true only when “x and y are themselves” and “x and y are not themselves”. Also, include (y) included in equation (4) represents the condition that “y is explicitly enabled”, which means that if y is a speaker, True if “selected”, if y is a listener, true if y is “attended”.

  Further, y (...) shown in the equation (4) is true when y satisfying the condition (...) exists, and y satisfying the condition (...) does not exist. Is false.

“式（６）を満たすようなｙが存在しない場合”には、ｉｎｃｌｕｄｅ（ｘ）の真偽にかかわらず、式（４）は真、つまりｘに関する音声データの送信または受信が有効であると判断され、“式（６）を満たすようなｙが存在する場合”には、ｉｎｃｌｕｄｅ（ｘ）の真偽により、式（４）の真偽が判断される旨を示している。 Further, the symbol ⇒ shown in the equation (4) represents logical inclusion.
Therefore, in equation (4):

If “y that satisfies the formula (6) does not exist”, the formula (4) is true regardless of whether the include (x) is true or false, that is, transmission or reception of audio data related to x is valid. If “y satisfying the expression (6) is present” is determined, it is indicated that the authenticity of the expression (4) is determined by the truth of the include (x).

の判断を示しており、図６のステップＳ．３の判断は、式（４）に示したヨｙ（・・・）の判断を示しており、図６のステップＳ．４の判断は、式（５）に示した判断を示しており、図６のステップＳ．５の判断は、式（１）における「ｉｎｃｌｕｄｅ（ｙ）」の判断を示しており、図６のステップＳ．６の判断は、式（１）における「ｉｎｃｌｕｄｅ（ｘ）」の判断を示している。 Based on Expression (1), the condition for whether transmission or reception of audio data related to x is valid or invalid is determined by the flowchart shown in FIG.
Step S. of FIG. 1 is determined by formula (7) in formula (1).

FIG. 3 indicates the determination of yo (...) Shown in the equation (4). 4 indicates the determination shown in Expression (5), and step S.4 in FIG. 5 indicates the determination of “include (y)” in Equation (1). The determination of 6 indicates the determination of “include (x)” in Expression (1).

  As described above, the expression (1) comprehensively includes the case where x is treated as a speaker (shown in the expression (2)) and the case where x is treated as a listener (shown in the expression (3)). This is the equation shown. Therefore, based on the equation (1), when the equation (2) when x is treated as a speaker is shown in the flowchart, it can be shown as shown in FIG.

の判断を示しており、図７のステップＳ．１３の判断は、式（２）に示したヨｙ（・・・）の判断を示しており、図７のステップＳ．１４の判断は、式（５）に示した判断を示しており、図７のステップＳ．１５の判断は、式（２）における「ｓｅｌｅｃｔ（ｙ）」の判断（ｙをセレクトしている場合に真となる）を示しており、図７のステップＳ．１６の判断は、式（２）における「ｓｅｌｅｃｔ（ｘ）」の判断（ｘをセレクトしている場合に真となる）を示している。 In the flowchart shown in FIG. 11 is determined by the equation (8) in the equation (2).

In step S. of FIG. 13 indicates the determination of yo (...) Shown in equation (2). 14 indicates the determination shown in Expression (5), and step S.14 in FIG. 15 indicates the determination of “select (y)” in equation (2) (true when y is selected). The determination of 16 indicates the determination of “select (x)” in Expression (2) (true when x is selected).

  As is apparent from this flowchart, when x is handled as a speaker, or when x is muted (No in step S.11), voice data from x cannot be received by itself (audible). No state) (step S.12). Even if x is not muted (Yes in step S.11), “x and y are both themselves, or x and y are not themselves” (Yes in step S.14) In the case of “y is selected” (in the case of Yes in step S.15), and further in the case of “x is not selected” (in the case of No in step S.16) ) Is in a state (step S.12) where the voice data from x cannot be received by itself.

  On the other hand, when x is not muted (Yes in step S.11), the condition that “x and y are both themselves or neither x nor y is myself” is satisfied (in step S.14). No), and “y is selected” (Yes in step S.15), and “x is selected” (Yes in step S.16). Is in a state (audible state) in which the audio data from x can be received by itself (step S.17).

  Further, even when x is not muted (Yes in step S.11), the condition that “x and y are own, or neither x nor y is own” is not satisfied ( If No in step S.14), or if “y is not selected” (in the case of No in step S.15), whether or not the audio data from x can be received by itself The process (step S.13) for confirming the existence of another y is executed without performing the determination (step S.12 or step S.17).

  The contents of the process shown in FIG. 7 will be described in more detail. In the privacy setting request (transmission / reception request) where z is the avatar that corresponds to you, x is the specific avatar that is the target of the request, and y is the other avatar, and z is the audio data to z by x Privacy setting is a mute representing a function for restricting outgoing calls, and a selection representing a function for restricting reception of voice data sent by other avatars y while the voice data received by z is limited to voice data sent by x Can be set.

  The application server 3 determines mute and select based on the privacy setting request, and whether or not the voice data transmitted by x cannot be received at z based on the combination of avatars targeted for mute and select. To determine the mixing pattern.

  Here, the case where the voice data transmitted by x cannot be received at z corresponds to the case where x is muted (in the case of No in step S.11 shown in FIG. 7). When x is muted by z (No in step S.11), the mute function restricts the transmission of audio data to z at x, so at z, the audio data transmitted by x Cannot be received (step S.12).

  Further, even if x is not muted (Yes in step S.11), reception of audio data of x at z may be restricted when another avatar y is selected. is there. Therefore, it is determined whether or not y which is an avatar other than x exists (step S.13). In this determination, if it is determined that y other than x does not exist, and y other than x exists, 14 or step S.14. If it is determined that y that has not been subjected to the determination process shown in FIG. 17).

  On the other hand, step S.I. 14 or step S.14. If there is y for which the determination processing shown in FIG. 15 has not been performed (Yes in step S.13), the condition that “both x and y are z or both are not z” is satisfied It is determined whether or not (step S.14). Here, the state where x or y is z may occur because it is assumed that a plurality of avatars indicating the user can exist in the virtual space, as described above.

  For example, if both x and y are not z, the audio data that can be received at z is only the audio data transmitted by x when z selects x, and the audio data that is transmitted by y at z Will be restricted. Similarly, when z selects y, the audio data receivable at z is only the audio data transmitted by y, and reception of audio data transmitted by x at z is restricted. .

  However, if the sender of the voice data is yourself and the recipient of the voice data you send is also yourself, whether you are selecting another avatar or not It is desirable to be able to receive the voice data that has been received. In other words, it is desirable to adopt a configuration in which the restriction by the select function is not performed when the user is regarded as the receiver of the audio data. Moreover, even if it is a case where it selects with respect to the other avatar which is not itself, it is preferable that the audio | voice data transmitted by the other avatar representing himself can be received in himself.

  For example, when a participant operates a plurality of avatars, the environment of each avatar becomes different, and there may be cases where different voice data are transmitted and received. In this way, even when the same participant operates multiple avatars, his / her speech in different environments is not limited by the select function targeting himself / herself, and the select function targeting others Therefore, it can be said that it is more preferable that the setting is not restricted when the voice data transmitted by a different avatar representing itself is received by itself.

  That is, when x is z itself and y is not z itself, even if z selects y, z is set so that it can receive the audio data of x which is its own audio data. It is desirable. Therefore, if x is z itself and y is not z itself, whether or not the voice data transmitted by x can be received at z is not affected by whether or not y is selected. Is desirable.

  On the other hand, if x is not z itself and y is z itself, the selection function of y should be set so that it does not work for itself even if y is selected. Is desirable. Therefore, when x is not z itself and y is z itself, whether or not the voice data transmitted by x can be received at z is not affected by whether or not y is selected. Is desirable.

  Therefore, as shown in FIG. 7, this is a case where x is not muted (Yes in step S.11). 14 or step S.14. If there is y for which the determination process shown in FIG. 15 has not been performed (Yes in Step S.13), both x and y are z or both are not z (Yes in Step S.14). Only in the case of y), it is determined whether or not y is selected (step S.15). If only one of x and y is z, x is transmitted in z. It becomes possible not to affect the determination (step S.12, step S.17) of whether or not the audio data can be received.

  On the other hand, even when x is z itself and y is z itself, as described above, the environment of x does not necessarily match the environment of y. For this reason, when x and y are z themselves, and there are a plurality of sound sources indicating themselves as a result, the participant can receive them by explicitly selecting those sound sources. It is preferable that audio data can be selected (determined).

  Therefore, this is a case where x is not muted (Yes in step S.11). 14 or step S.14. If there is y for which the determination processing shown in FIG. 15 has not been performed (in the case of Yes in step S.13), y is selected when both x and y are z (in the case of Yes in step S.14). If y is selected (Yes in step S.15), x is not explicitly selected (step S.15). In the case of No in S.16), the audio data receivable at z is selected (restricted) only to the audio data transmitted by y, and the audio data transmitted by x cannot be received at z (step S.12) becomes possible. When y is selected (Yes in step S.15), by explicitly selecting x (Yes in step S.16), the audio data receivable at z is represented by y. And the voice data transmitted by x can be selected, and the voice data transmitted by x can be received at z (step S.17).

  On the other hand, if y is not selected (No in step S.15), whether or not the audio data that can be received in z is restricted by another avatar (other y). If there is no y for which the confirmation process (step S.14, step S.15) has not been performed (No in step S.13), all of the voice data transmitted by x is Therefore, it is possible to receive audio data from x at z (step S.17).

  If x is not z itself and y is not z itself, whether or not the voice data transmitted by x in z can be received depends on the state of selection for y. Become.

  Therefore, if z does not select y (No in step S.15), the audio data that can be received at z is limited by other avatars (other y) as in the case described above. It is confirmed whether or not there is any (step S.13). Step S. 13, if there is no y for which confirmation processing (step S.14, step S.15) has not been performed (No in step S.13), the voice data transmitted by x Since it can be determined that it is not limited by y, it is possible to receive audio data from x at z (step S.17).

  On the other hand, if z selects y (Yes in step S.15), the audio data received by z is only the audio data transmitted by y, and the audio transmitted by x remains as it is. Data cannot be received at z. Therefore, when z selects y (when Yes at step S.15), z selects x (when Yes at step S.16), thereby receiving audio data of x at z. (Step S.17), and if z does not select x (No in step S.16), it becomes impossible to receive the audio data of x in z (step S.17). 12).

の判断を示しており、図８のステップＳ．２３の判断は、式（２）に示したヨｙ（・・・）の判断を示しており、図８のステップＳ．２４の判断は、式（５）に示した判断を示しており、図８のステップＳ．２５の判断は、式（３）における「ａｔｔｅｎｄ（ｙ）」の判断（ｙがアテンドされている場合に真となる）を示しており、図８のステップＳ．２６の判断は、式（３）における「ａｔｔｅｎｄ（ｘ）」の判断（ｘがアテンドされている場合に真となる）を示している。 Further, when Expression (3) in the case of treating x as a listener based on Expression (1) is shown in a flowchart, it can be shown as in FIG.
In the flowchart shown in FIG. 21 is determined by the equation (9) in the equation (3).

FIG. 23 indicates the determination of yo (...) Shown in the equation (2). 24 indicates the determination shown in equation (5). 25 indicates the determination of “attend (y)” in equation (3) (true when y is attended). The determination of 26 indicates the determination of “attend (x)” in the expression (3) (true when x is attended).

  As is apparent from this flowchart, when x is treated as a listener, if x is defunded (No in step S.21), the audio data of z cannot be received at x (step S). .22) Even if x is not defuncted (Yes in step S.21), “x and y are own, or x and y are not myself” (Yes in step S.24). In the case of “y is attended” (Yes in step S.25), and in the case of “x is not attended” (No in step S.26) ) Is in a state where the audio data of z cannot be received at x (step S.22).

  On the other hand, in the case where x is not defuncted (Yes in step S.21), the condition that “x and y are both themselves or x and y are not themselves” is satisfied (in step S.24). No) and “y is attended” (Yes in step S.25) and “x is attended” (Yes in step S.26) Is in a state (audible state) in which the audio data of z can be received at x (step S.27).

  Further, even if x is not defuncted (in the case of Yes in step S.21), the condition that “x and y are both myself or neither x nor y is myself” is not satisfied ( In the case of No in step S.24) or in the case of “y is not attended” (in the case of No in step S.25), whether or not the audio data of z can be received in x Without making the determination (step S.22 or step S.27), the process (step S.23) for confirming the existence of another y is executed.

  Also in the contents of the processing shown in FIG. 8, if the specific avatar to be requested is x and the other avatar is y in the privacy setting request (transmission / reception request) where z and z set the avatar corresponding to itself, z Privacy settings are defined as a defun that represents the function that restricts the reception of the voice data transmitted by x at x, and the attendant that represents the function that restricts the reception of the voice data transmitted by z to x and is received at y can do.

  The application server 3 determines whether defun and attend are determined based on the privacy setting request, and whether or not the voice data transmitted by z cannot be received at x based on the combination of the avatars targeted by the defun and attend. To determine the mixed pattern.

  Here, the case where the voice data transmitted by z cannot be received in x corresponds to the case where x is defuncted (in the case of No in step S.21 shown in FIG. 8). If x is defuncted by z (No in step S.21), reception of audio data from z at x is restricted by the defunc function. Cannot be received (step S.22).

  Even if x is not defuncted (Yes in step S.21), if another avatar y is attended, reception of audio data of z at x may be restricted. There is. Therefore, it is determined whether or not y which is an avatar other than x exists (step S.23). In this determination, if it is determined that y other than x does not exist, and y other than x exists, 24 or step S.E. If it is determined that y which has not been subjected to the determination process shown in FIG. 25 no longer exists (No in step S.23), the voice data transmitted by z can be received in x (step S.23). 27).

  On the other hand, step S.I. 24 or step S.E. If there is y for which the determination process shown in 25 is not performed (Yes in step S.23), the condition that “both x and y are z or both are not z” is satisfied. It is determined whether or not (step S.24).

  For example, when both x and y are not z, z can be the only avatar that can receive the voice data of z by attaching x to the voice data transmitted by z in y. Reception is restricted. Similarly, when z extends y, the voice data transmitted at z can be received only by y, and reception of the voice data transmitted by z at x is restricted. .

  However, if the caller of the voice data is yourself and the recipient of the voice data you send is also yourself, you can send your call regardless of whether you are attending another avatar or not. It is desirable to be able to receive the voice data by itself. In other words, it is desirable to adopt a configuration in which restriction by the attend function is not performed when the user is regarded as a voice data receiver. Moreover, even if it is a case where it is attended with respect to the other avatar which is not itself, it is preferable that the audio | voice data transmitted by the other avatar showing himself can be received in himself.

  For example, when a participant operates a plurality of avatars, the environment of each avatar becomes different, and there may be cases where different voice data are transmitted and received. In this way, even if the same participant operates multiple avatars, his / her speech in different environments is not limited by the attend function for himself / herself, and the attend function for others Thus, it can be said that it is more preferable that the setting is not restricted to receive the voice data transmitted by the user in different avatars representing the user himself / herself.

  That is, when x is z itself and y is not z itself, even if z attends y, x is set so that it can receive audio data of z that is its own audio data. It is desirable. Therefore, when x is z itself and y is not z itself, whether or not the voice data transmitted by z can be received in x is not affected by the presence or absence of y. desirable.

  On the other hand, if x is not z itself and y is z itself, even if y is attached to z, it is set so that the attendance function of y does not work for itself Is desirable. Therefore, when x is not z itself and y is z itself, whether or not the voice data transmitted by z can be received in x is not affected by the presence or absence of y. Is desirable.

  Therefore, as shown in FIG. 8, this is a case where x is not defuncted (in the case of Yes in step S.21). 24 or step S.E. In the case where there is y for which the determination process shown in FIG. 25 is not performed (Yes in Step S.23), both x and y are z or both are not z (Yes in Step S.24). Only in the case of y), it is determined whether or not y is attended (step S.25). When only one of x and y is z, z is transmitted at x. It becomes possible not to affect the determination (step S.22 or step S.27) of whether or not the audio data can be received.

  On the other hand, even when x is z itself and y is z itself, as described above, the environment of x does not necessarily match the environment of y. For this reason, if x and y are z themselves, and as a result, there are multiple avatars for receiving the sound source transmitted by the participant itself, the participant explicitly indicates those listeners. It is preferable that an avatar capable of receiving own voice data can be selected (determined).

  Therefore, this is the case where x is not defuncted (Yes in step S.21). 24 or step S.E. If there is y for which the determination processing shown in FIG. 25 is not performed (Yes in step S.23), y is an attendant when both x and y are z (Yes in step S.24). By determining whether or not (step S.25), it is determined that x is not attended explicitly (step S.25 is Yes). In the case of No in S.26), it is possible to select (limit) the voice data transmitted in z so as to be transmitted only by y, so that it cannot be received in x (step S.22). Also, when y is attended (in the case of Yes in step S.25), by explicitly attenuating x (in the case of Yes in step S.26), the voice data transmitted in z is converted into y. And x can be selected so that the audio data of z can be received at x (step S.27).

  On the other hand, if y is not attended (No in step S.25), whether or not the voice data transmitted in z is restricted by another avatar (other y). If there is no y for which the confirmation process (step S.24, step S.25) has not been performed (No in step S.23), all y are transmitted by z. When receiving the voice data at x, it can be determined that the voice data is not limited by y, so that the voice data from z can be received at x (step S.27).

  In addition, when x is not z itself and y is not z itself, whether or not the voice data transmitted by z in x can be received depends on the attendance state with respect to y. Become.

  Therefore, if z does not attend y (if No in step S.25), the audio data of z received at z is restricted by another avatar (other y) as in the case described above. It is confirmed whether or not it is not performed (step S.23). Step S. 23, if there is no y for which the confirmation processing (step S.24, step S.25) has not been performed (No in step S.23), the voice data transmitted by z at x is received. In this case, since it can be determined that reception is not limited by y, it is possible to receive audio data from z at x (step S.27).

  On the other hand, if z is attending y (Yes in step S.25), the audio data transmitted by z will be received only by y. Unable to receive outgoing voice data. Therefore, when z is attended to y (in the case of Yes in step S.25), z is attended to x (in the case of Yes in step S.26), and the audio data of z is received at x. (Step S.27), and if z does not attend x (No in step S.26), it becomes impossible to receive the audio data of z at x (step S.27). 22).

  As described above, the arithmetic processing unit 3a of the application server 3 receives which participant's voice data is received by which participant based on the privacy setting request (transmission / reception request) of each client terminal 5 acquired via the CVE server 4. A matrix (policy) is created by determining whether the setting is possible based on the formula (1). By using the judgment formula shown in this formula (1), in the arithmetic processing unit 3a of the application server 3, the privacy setting (transmission / reception request) set by the client terminal 5 is changed at a different timing for each participant. Even so, it is possible to quickly calculate and evaluate the policy without increasing the calculation burden.

  The arithmetic processing unit 3a of the application server 3 evaluates the created policy, and whether the privacy setting requested by the client terminal 5 is permitted (can the transmission / reception request be permitted) or not (whether the transmission / reception request is permitted). A privacy evaluation report indicating whether it can be recognized is transmitted to the client terminal 5. The CVE server 4 determines whether or not an avatar operation is possible according to the evaluation report, and when the privacy setting request (transmission / reception request) is approved, the operation of the corresponding avatar is displayed on the client terminal 5. This is realized on the screen 7a. The participant can easily and surely determine whether or not the privacy setting is realized by confirming the operating state of the avatar displayed on the display screen 7a of the client terminal 5.

  In addition, the arithmetic processing unit 3a of the application server 3 determines in accordance with the evaluated policy, to which participant the voice data transmitted by which participant is distributed, that is, how to mix the voice data of each participant. -Decide whether to distribute (mixed pattern judgment processing). Then, the set content (mixed pattern) is transmitted to the media server 2 by the communication unit 3c in accordance with MSCML (Media Server Control Markup Language) within the SIP framework.

  FIG. 9 shows an MSCML setting example (mixed pattern example) when the participant (avatar) P1 dedefines the participant (avatar) P2 when there are four participants (P1 to P4). When the participant P1 dedefines the participant P2, the participant P2 cannot receive the voice data of the participant P1. Therefore, the participant P3 and the participant P4 can listen to the voice of the participant P1, but the participant P2 cannot listen. Note that the voices of the participants P2, P3, and P4 are transmitted to other participants and are not limited. Participants who can listen to the audio data transmitted by each participant (P1 to P4) are shown in the “listener” column of the table of FIG.

  When the participant (avatar) P1 dedefines the participant (avatar) P2, the arithmetic processing unit 3a of the application server 3 is private by participants other than the participant P2 (participant P1, participant P3, and participant P4). Create a group. In the table of FIG. 9, the participant P3 and the participant P4 are set in the “member” column of the participant P1, and the participant P1 and the participant P4 are set in the “member” column of the participant P3. Participants P1 and P3 are set in the “Member” column of P4. On the other hand, since the participant P2 is not a member of the participant P1, the participant P3, or the participant P4, “None” is set in the “member” column of the participant P2.

  Then, the mixed setting (see the “mix” column in the table of FIG. 9) regarding the audio data transmitted from each participant is classified into Private and Full. Full indicates a case where all other participants can receive the audio data transmitted by the participant. As shown in the table of FIG. 9, since the participants of the audio data that becomes Full are the participant P2, the participant P3, and the participant P4, the audio data of the participant P2, the participant P3, and the participant P4 are All other participants (P1-P4) are audibly mixed. On the other hand, the audio data of the participant P1 serving as the private is mixed so that only the private group participants (here, the participant P3 and the participant P4) can listen.

  The media server 2 has a function of mixing the audio data received from the client terminal 5 of one participant and transmitting (distributing) it to the client terminal 5 of the participant participating in the multimedia conference. In particular, the media server 2 selects the audio data to be mixed based on the request received from the application server 3 (mixing pattern: setting contents of the MSCML) in the process of mixing the audio data of each participant. , Has a function of changing the mixed content of audio data to be transmitted.

  FIG. 10 is a diagram showing a flow of audio data when audio data received from four participants (client terminal 5) is mixed in the media server 2 and distributed to each participant (client terminal 5). is there. The diagram shown in FIG. 10 shows the flow of audio data when the participant P1 mutes the participant P2 and the participant P1 dedefines the participant P4.

  Audio data transmitted by each participant P1 to P4 (client terminal 5) is received by the media server 2 by RTP (Real Time Protocol: a data transfer protocol for distributing data streams such as voice and video in real time). The received audio data is mixed according to the participant (client terminal 5) of the transmission destination (distribution destination). In the case shown in FIG. 10, since the participant P1 has muted the participant P2, only the audio data of the participant P3 and the participant P4 are mixed in the audio data transmitted to the participant P1, and the participation is performed. The voice data of the person P2 is not mixed. Further, since the participant P1 is defuncting the participant P4, the participant P4 does not receive the voice data of the participant P1, and the voice data distributed to the participant P4 includes the participant P2 Only the audio data with the participant P3 is mixed, and the audio data of the participant P1 is not mixed. The other participants (participant P2 and participant P3) are not affected by the privacy setting by the participant P1, and thus can receive all the voice data of the other participants.

  FIG. 11 is a diagram showing a flow of information among the client terminal 5, the application server 3, and the media server 2 described above.

  When the client terminal 5 participates in the multimedia conference, the session is established by accessing the application server 3 using SIP (step S.31). By establishing this session, the client terminal 5 can access by RTP via the media server 2 and can transmit and receive voice data in real time (step S.32).

  Further, the client terminal 5 can make a privacy setting request (transmission / reception request) to the application server 3 via the CVE server 4 (step S.33), and the application server 3 requests the set privacy setting. In response to this, a request for mixing audio data is transmitted to the media server 2 by MSCML (step S.34). In the media server 2, the audio data output to the client terminal 5 is mixed in response to the request (mixed pattern) acquired from the application server 3, and the mixed audio data is output to each client terminal 5. (Step S.35). As described above, the application server 3 determines the privacy setting request (transmission / reception request) by the client terminal 5 and transmits the request (mixed pattern) to the media server 2, so that the participants of each client terminal 5 It is possible to participate in the multimedia conference in the secured state.

  As described above, in the multimedia conference system 1 according to the present embodiment, in the application server 3, which participant's audio data is selected based on the privacy setting (transmission / reception request) set by the client terminal 5. Whether to make a call to the participant is set (mixed pattern setting), and the media server 2 controls the distribution of the audio data based on this setting. For this reason, participants who participate in multimedia conferences listen only to the audio data of a specific participant according to their privacy settings, and only to the specific participant to listen to their own audio data. Can be controlled. Therefore, unlike the conventional multimedia conference system, it is possible to avoid the situation in which the audio data of all participants is distributed to all participants, and to ensure privacy in the multimedia conference system 1. It becomes possible.

  In particular, the application server 3 uses the expression (1) shown in FIG. 5 to determine whether or not the privacy setting for the identified participant x is possible, whether the participant x is valid or the other participant y is valid. Can be determined based on More specifically, when x is treated as a speaker, it is determined whether or not the audio data of x can be heard by a specific participant based on Equation (2), and when x is treated as a listener, Based on the equation (3), it is determined whether or not the voice data of a specific participant can be heard by x.

  For this reason, the calculation processing unit 3a of the application server 3 increases the calculation burden even when the privacy setting request (transmission / reception request) set by the client terminal 5 is changed at a different timing for each participant. It is possible to quickly evaluate and determine privacy settings without having to do so.

  Furthermore, as shown in FIG. 7 and FIG. 8, in the case where the privacy setting of the participant is performed, when only one of x and y targeted for the privacy setting is a participant (avatar) indicating himself / herself , Whether or not the voice data from x can be received by itself (step S.12 or step S.17) and whether or not the own voice data can be received at x (step S.22 or Since the determination in step S.27) is not performed, it is possible to avoid the limitation that may occur when the select function and the attend function are the sound source and the self is the receiver.

  In addition, as shown in FIGS. 7 and 8, in the case where the privacy setting of the participant is performed, if both x and y targeted for privacy setting are participants (avatars) indicating themselves, the x is changed from x. Whether or not to receive the voice data by itself (step S.12 or step S.17) can be selected (determined) by explicitly selecting x and y. It is possible to select (determine) whether x audio data can be received at x (step S.22 or step S.27) by explicitly attending x and y. .

  Furthermore, in the multimedia conference system 1 according to the present embodiment, a virtual space can be formed using the CVE server 4 and privacy settings can be performed by an avatar operation. Therefore, the participant can easily know the state of the privacy setting for each participant by visually confirming the state of the avatar.

  In particular, one or other participants can be set as the setting target of the “mute” command and “defen” command in the privacy setting. By setting privacy using an avatar, if the target of the “mute” command is your own, the thumb of the hand that closes the mouth of the avatar faces upward, and the target of the “mute” command is for other participants Since the thumb of the hand that closes the mouth of the avatar faces downward, it is possible to visually know the target of “mute”. Similarly, if the target of the “defen” command is yourself, the thumb of the hand that closes the avatar's ears faces downward, and if the target of the “defen” command is another participant, the avatar Since the thumb of the hand that closes the ear faces upward, it is possible to visually know the object of “defun”.

  Although the multimedia conference system according to the present invention has been described in detail with reference to the drawings, the multimedia conference system according to the present invention is not limited to the one according to the above-described embodiment. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these naturally belong to the technical scope of the present invention. It is understood.

  For example, in the multimedia conference system 1 according to the present embodiment, audio data is shown as an example of stream media transmitted and received in a conference, but the stream media transmitted and received in the multimedia conference system is audio. It is not limited to data only, but may be other information, for example, moving image data, and information mixed with various data such as audio data, moving image data, image data, or document data is used as a stream medium. It is possible to use.

  Further, in the multimedia conference system 1 according to the present embodiment, a case where a virtual space is formed by using the CVE server 4 and a privacy setting request (transmission / reception request) is performed by operating an avatar has been described. However, privacy setting by the client terminal 5 is not necessarily limited to processing using an avatar. It is also possible to adopt a configuration in which a privacy setting request is made directly from the client terminal 5 to the application server 3 by SIP without using an avatar. In this case, since it is not necessary to provide the CVE server 4 and the CVE client 4a, the configuration of the multimedia conference system can be simplified.

It is the block diagram which showed schematic structure of the multimedia conference system which concerns on this Embodiment. It is the figure which showed the control panel and display screen of the avatar operated in the client terminal which concerns on this Embodiment. It is the table | surface explaining the request | requirement (transmission / reception request | requirement) of the privacy setting which can be set in the client terminal which concerns on this Embodiment. The arithmetic processing unit of the application server according to the present embodiment totals the privacy settings requested by the participants, and the voice data transmitted from each participant based on the privacy settings and each participant can receive the data. 5 is a matrix table showing the relationship with the audio data calculated. Based on the privacy setting (transmission / reception request) set by the participant, whether or not the arithmetic processing unit of the application server according to the present embodiment can acquire the voice data of the specific participant in a certain participant. It is the figure which showed the logical judgment formula (predicate calculation notation) for calculating it. 6 is a flowchart showing a condition for determining whether x is valid or invalid based on Expression (1) shown in FIG. 5. FIG. 5 is a flowchart showing a determination condition as to whether or not audio data of a specific participant (self) can be received at x when x is treated as a listener based on Expression (2) shown in FIG. It is. Based on Expression (3) shown in FIG. 5, when x is treated as a speaker, it is possible to determine whether or not voice data from x can be received by a specific participant (self). It is the flowchart which showed. In the multimedia conference system which concerns on this Embodiment, it is the figure which showed the example of MSCML setting in case a participant is 4 persons (P1-P4) and the participant P1 dedefines the participant P2. It is the figure which showed the flow of the audio | voice data when the audio | voice data received from four participants are mixed in a media server in the multimedia conference system which concerns on this Embodiment, and it distributes to each participant. It is the figure which showed the flow of the information between a client terminal, an application server, and a media server in the multimedia conference system which concerns on this Embodiment. 6 is a diagram for explaining a mute function generally used in a conventional multimedia conference.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Multimedia conference system 2 ... Media server 3 ... Application server 3a ... Arithmetic processing part (mixed pattern determination means)
3b ... storage unit 3c ... communication unit (transmission means)
4 ... CVE server 4a ... CVE client (transmission / reception request receiving means)
5 ... client terminal 7a ... display screen 7b ... control panel 8, 9, 10 ... avatar 11 ... operation item 12 (self indicating the avatar) ... operation item 13 (self to be set for mute and defun) ... Check item 14 (for mute for self) ... Check item 15 (for defun that targets self) ... Operation item 16 (for another person for whom mute and defun are set) ... (Mute for other people) ) Check item 17... Check item 18 (for deaf targeting others) ... (Select) operation item 19 ... (Attend) operation item 20 ... Position coordinate item

Claims (17)

A multimedia conference system that receives stream media transmitted from a plurality of client terminals by a media server, mixes the received stream media by the media server, and transmits the mixed media to each client terminal,
An application server for determining a mixing pattern of the stream media mixed in the media server;
The client terminal can set a stream media transmission / reception request in the client terminal by designating a specific client terminal,
The application server determines the mixing pattern based on a transmission / reception request set in the client terminal,
The media server mixes the stream media received from the client terminal based on the mixing pattern determined in the application server, and transmits the stream media that can satisfy the transmission / reception request to each client terminal. A featured multimedia conference system. The client terminal Z that sets the transmission / reception request is:
A mute representing a function of restricting a specific client terminal X designated by the client terminal Z from transmitting stream media to the client terminal;
A stream medium received by the client terminal Z is only a stream medium transmitted by the specified specific client terminal X, and a select representing a function for restricting reception of the stream medium transmitted by another client terminal Y; The
It can be set as the transmission / reception request,
The application server is
(1) When the client terminal X is muted,
(2) The client terminal X is not muted,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The multimedia conference system according to claim 1, wherein the client terminal Z determines that the stream media transmitted by the client terminal X cannot be received and determines the mixed pattern. The application server is
In the case where the client terminal X shown in (2) is not muted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is selected,
And determining whether the client terminal X is selected,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The multimedia conference system according to claim 2, wherein the client terminal Z determines that the stream media transmitted by the client terminal X cannot be received and determines the mixed pattern. The client terminal Z that sets the transmission / reception request is:
In a specific client terminal X designated by the client terminal Z, a defun representing a function for restricting reception of stream media transmitted by the client terminal Z;
A function of restricting the reception of the stream media transmitted by the client terminal Z only at the specified client terminal X and the reception of the stream media transmitted by the client terminal Z at another client terminal Y; Representing the attendant,
It can be set as the transmission / reception request,
The application server is
(3) When the client terminal X is defuncted,
(4) The client terminal X is not defuncted,
And the client terminal Y is attended,
And when the client terminal X is not attended,
2. The multimedia conference system according to claim 1, wherein the client terminal X determines that it is impossible to receive the stream media transmitted by the client terminal Z and determines the mixed pattern. The application server is
In the case where the client terminal X shown in (4) is not defuncted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is attended;
And determining whether the client terminal X is attended,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is attended,
And when the client terminal X is not attended,
5. The multimedia conference system according to claim 4, wherein the client terminal X determines that the stream pattern transmitted from the client terminal Z cannot be received and determines the mixed pattern. An application server for determining a mixed pattern of the stream media used in a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal;
A transmission / reception request receiving means for receiving, from the client terminal, a stream media transmission / reception request set by designating a specific client terminal in the client terminal;
Mixed pattern determining means for determining the mixed pattern based on a transmission / reception request set in the client terminal;
Transmitting means for transmitting the determined mixed pattern to the media server;
The mixed pattern determining means includes
A mute representing a function of restricting a specific client terminal X designated by the client terminal Z from transmitting stream media to the client terminal;
A stream medium received by the client terminal Z is only a stream medium transmitted by the specified specific client terminal X, and a select representing a function for restricting reception of the stream medium transmitted by another client terminal Y; The
Judging from the transmission / reception request,
(1) When the client terminal X is muted,
(2) The client terminal X is not muted,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The application server, wherein the client terminal Z determines that the stream medium transmitted from the client terminal X cannot be received and determines the mixed pattern. The mixed pattern determining means includes
In the case where the client terminal X shown in (2) is not muted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is selected,
And determining whether the client terminal X is selected,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The application server according to claim 6, wherein the client terminal Z determines that the stream medium transmitted by the client terminal X cannot be received and determines the mixed pattern. An application server that determines a mixed pattern of the stream media used in a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal;
A transmission / reception request receiving means for receiving, from the client terminal, a stream media transmission / reception request set by designating a specific client terminal in the client terminal;
Mixed pattern determining means for determining the mixed pattern based on a transmission / reception request set in the client terminal;
Transmitting means for transmitting the determined mixed pattern to the media server;
The mixed pattern determining means includes
In a specific client terminal X designated by the client terminal Z, a defun representing a function of restricting reception of stream media transmitted by the client terminal Z;
A function of restricting the reception of the stream media transmitted by the client terminal Z only at the specified client terminal X and the reception of the stream media transmitted by the client terminal Z at another client terminal Y; Representing the attendant,
Judging from the transmission / reception request,
(3) When the client terminal X is defuncted,
(4) The client terminal X is not defuncted,
And the client terminal Y is attended,
And when the client terminal X is not attended,
The application server, wherein the client terminal X determines that the stream medium transmitted from the client terminal Z cannot be received and determines the mixed pattern. The mixed pattern determining means includes
In the case where the client terminal X shown in (4) is not defuncted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is attended;
And determining whether the client terminal X is attended,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is attended,
And when the client terminal X is not attended,
The application server according to claim 8, wherein the client terminal X determines that the stream medium transmitted from the client terminal Z cannot be received and determines the mixed pattern. A mixed pattern determination method for determining, in an application server, a mixed pattern of the stream media used for processing of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal,
A transmission / reception request receiving step in which a transmission / reception request receiving unit receives a transmission / reception request of a stream medium set by designating a specific client terminal in the client terminal;
A mixed pattern determining step in which a mixed pattern determining means determines the mixed pattern based on a transmission / reception request set in the client terminal;
A transmission step in which transmission means transmits the determined mixed pattern to the media server;
In the mixed pattern determining step, the mixed pattern determining means includes:
A mute representing a function of restricting a specific client terminal X designated by the client terminal Z from transmitting stream media to the client terminal;
A stream medium received by the client terminal Z is only a stream medium transmitted by the specified specific client terminal X, and a select representing a function for restricting reception of the stream medium transmitted by another client terminal Y; The
A request content determination step for determining from the transmission / reception request;
Based on the request content determined in the request content determination step, the mixed pattern determination means,
(1) When the client terminal X is muted,
(2) The client terminal X is not muted,
And the client terminal Y is selected,
And when the client terminal X is not selected,
A mixed pattern determining method comprising: determining that the stream medium transmitted from the client terminal X cannot be received at the client terminal Z and determining the mixed pattern. In the mixed pattern determining step, the mixed pattern determining means includes:
When the client terminal X shown in (2) is not muted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is selected,
And determining whether the client terminal X is selected,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The mixed pattern determination method according to claim 10, wherein the mixed pattern is determined by determining that it is impossible for the client terminal Z to receive the stream medium transmitted by the client terminal X. A mixed pattern determination method for determining, in an application server, a mixed pattern of the stream media used for processing of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal,
A transmission / reception request receiving step in which a transmission / reception request receiving unit receives a transmission / reception request of a stream medium set by designating a specific client terminal in the client terminal;
A mixed pattern determining step in which a mixed pattern determining means determines the mixed pattern based on a transmission / reception request set in the client terminal;
A transmission step in which transmission means transmits the determined mixed pattern to the media server;
In the mixed pattern determining step, the mixed pattern determining means includes:
In a specific client terminal X designated by the client terminal Z, a defun representing a function of restricting reception of stream media transmitted by the client terminal Z;
A function of restricting the reception of the stream media transmitted by the client terminal Z only at the specified client terminal X and the reception of the stream media transmitted by the client terminal Z at another client terminal Y; Representing the attendant,
A request content determination step for determining from the transmission / reception request;
Based on the request content determined in the request content determination step, the mixed pattern determination means,
(3) When the client terminal X is defuncted,
(4) The client terminal X is not defuncted,
And the client terminal Y is attended,
And when the client terminal X is not attended,
A mixed pattern determining method comprising: determining that the stream medium transmitted from the client terminal Z cannot be received by the client terminal X and determining the mixed pattern. In the mixed pattern determining step, the mixed pattern determining means includes:
When the client terminal X shown in (4) is not defunced,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is attended;
And determining whether the client terminal X is attended,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is attended,
And when the client terminal X is not attended,
The mixed pattern determination method according to claim 12, wherein the mixed pattern is determined by determining that the client terminal X cannot receive the stream media transmitted by the client terminal Z. A mixed pattern determination program for determining, in an application server, a mixed pattern of the stream media used in a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal,
In the computer of the application server,
A transmission / reception request reception function for receiving, from the client terminal, a stream media transmission / reception request set by designating a specific client terminal in the client terminal;
A mixed pattern determining function for determining the mixed pattern based on a transmission / reception request set in the client terminal;
Realizing the transmission function of transmitting the determined mixed pattern to the media server;
In the mixed pattern determination function, the computer
A mute representing a function of restricting a specific client terminal X designated by the client terminal Z from transmitting stream media to the client terminal;
A stream medium received by the client terminal Z is only a stream medium transmitted by the specified specific client terminal X, and a select representing a function for restricting reception of the stream medium transmitted by another client terminal Y; The
A request content determination function for determining from the transmission / reception request;
Based on the request content determined by the request content determination function,
(1) When the client terminal X is muted,
(2) The client terminal X is not muted,
And the client terminal Y is selected,
And when the client terminal X is not selected,
A mixed pattern determination program for realizing a mixed pattern determination function for determining that the stream medium transmitted from the client terminal X cannot be received by the client terminal Z and determining the mixed pattern. In the mixed pattern determination function, the computer
When the client terminal X shown in (2) is not muted,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is selected,
And determining whether the client terminal X is selected,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is selected,
And when the client terminal X is not selected,
The mixed pattern determination program according to claim 14, wherein the client terminal Z is caused to determine that the stream medium transmitted from the client terminal X cannot be received and to determine the mixed pattern. . A mixed pattern determination program for determining, in an application server, a mixed pattern of the stream media used in a process of mixing stream media received from a plurality of client terminals by a media server and transmitting the mixed media to the client terminal,
In the computer of the application server,
A transmission / reception request reception function for receiving, from the client terminal, a stream media transmission / reception request set by designating a specific client terminal in the client terminal;
A mixed pattern determining function for determining the mixed pattern based on a transmission / reception request set in the client terminal;
Realizing the transmission function of transmitting the determined mixed pattern to the media server;
In the mixed pattern determination function, the computer
In a specific client terminal X designated by the client terminal Z, a defun representing a function of restricting reception of stream media transmitted by the client terminal Z;
A function of restricting the reception of the stream media transmitted by the client terminal Z only at the specified client terminal X and the reception of the stream media transmitted by the client terminal Z at another client terminal Y; Representing the attendant,
A request content determination function for determining from the transmission / reception request;
Based on the request content determined by the request content determination function,
(3) When the client terminal X is defuncted,
(4) The client terminal X is not defuncted,
And the client terminal Y is attended,
And when the client terminal X is not attended,
A mixed pattern determination program for realizing a mixed pattern determination function for determining that the client terminal X cannot receive the stream medium transmitted from the client terminal Z and determining the mixed pattern. In the mixed pattern determination function, the computer
When the client terminal X shown in (4) is not defunced,
Only when both the client terminal X and the client terminal Y are the client terminal Z or both are not the client terminal Z,
Whether or not the client terminal Y is attended;
And determining whether the client terminal X is attended,
Both the client terminal X and the client terminal Y are the client terminals Z or both are not the client terminals Z,
And the client terminal Y is attended,
And when the client terminal X is not attended,
The mixed pattern determination program according to claim 16, for causing the client terminal X to determine that the stream medium transmitted from the client terminal Z cannot be received and to determine the mixed pattern. .

Images