JP2018056822A - Television conference device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform high accuracy grouping for each child base for a base in which a preset arbitration band is different from an actual network band.SOLUTION: A communication control unit 103 performs grouping of other television conference devices 10-2-24 based on network information. For example, the communication control unit 103 determines a base, in which RTT (Round-Trip Time) is less than or equal to a threshold value, as a base of wide band (HD resolution transmission group), and determines the base, in which the RTT is larger than the threshold value, as a base of narrow band (SD resolution transmission group). A video audio encoding/decoding unit 104 determines a video encoding parameter for each group. For example, the video audio encoding/decoding unit 104 sets an encoding parameter such that each base belonging to a HD resolution transmission group may have image resolution of 1920×1080 pixels, and sets a video encoding parameter such that each base belonging to a SD resolution transmission group may have the image resolution of 720×480 pixels.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video conference apparatus that can be simultaneously connected to apparatuses installed in a plurality of bases.

  Video conferencing systems that can perform remote conferences by connecting a plurality of bases have become widespread. The video conference device (multi-site connection unit (MCU)) at the host site (parent site) receives video data and audio data from other sites (child sites) and displays the video data of each site on the monitor screen. The audio data is output from the speaker. Patent Document 1 describes a video conference apparatus that simultaneously displays video data of three sites on a monitor screen.

  In recent years, video conference apparatuses that can be connected simultaneously with many sites (for example, 24 sites) have been developed. In general, video conferencing equipment has a smaller number of encoders than the number of connected bases, and when there are both a wideband child base and a narrowband child base, video / There is also a tendency for audio data to be encoded at a low rate in accordance with a narrow-band child base.

  There is a different speed communication function as one of means for solving the problem. In the different speed communication function, the HD resolution transmission group of the base group having a wider band than a predetermined threshold is divided into the SD resolution transmission group of the narrow base group, and encoding is performed at a different rate for each group. With this function, high-quality video / audio can be transmitted to a broadband child base.

JP 2012-231428 A

  Some bases have different mediation bandwidths and actual network bandwidths set for each child base. In particular, when the child base is a mobile terminal, the network bandwidth changes depending on the location and time.

  However, conventionally, since the grouping of the different speed communication function is performed based on the arbitration band, the accuracy of the grouping is lowered.

  An object of the present invention is to provide a video conference apparatus capable of performing grouping with high accuracy for a base where the mediation band preset for each child base is different from the actual network band.

  The video conference apparatus of the present invention is a video conference apparatus that is provided at a host base and can be connected simultaneously with a plurality of other bases, a video input unit that captures the host base and acquires video data, and a network. A communication control unit that transmits / receives a packet including video data to / from each of the other bases, and a display control unit that generates composite video data obtained by combining a plurality of the video data and displays the composite video data on a screen. The communication control unit performs grouping of the other bases based on the information on the network, and the display control unit determines a video encoding parameter for each group, and the video control parameter is determined based on the video encoding parameter. Encode the data.

  According to the present invention, it is possible to perform grouping based on an actual network band for a base whose actual network band is different from the mediation band preset for each child base.

The block diagram which shows the structure of the video conference apparatus concerning one embodiment of this invention State transition diagram showing state transition of video conference apparatus according to one embodiment of the present invention The flowchart which shows operation | movement of the video conference apparatus based on one embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. In the following, a video conference system in which the number of sites that can be connected simultaneously is 24 will be described as an example.

(Embodiment)
<Configuration and connection of video conference equipment>
First, the configuration and connection relationship of the video conference apparatus 10 according to an embodiment of the present invention will be described in detail with reference to FIG.

  A video conference device 10 is installed at each base. The video conference apparatus 10-1 at the host base (base number 1) is connected to each of the video conference apparatuses 10-2 to 24-24 installed at the other bases (base numbers 2 to 24) via the network 20. Audio data and video data are transmitted / received. The network 20 is typically the Internet.

  The video conference device 10-1 includes a main device 100, a user operation input device 200, a video input device 300, an audio input device 400, and a display device 500.

  The main device 100 is connected to the user operation input device 200, the video input device 300, the audio input device 400, and the display device 500.

  The user operation input device 200 detects an operation of selecting a base by the user, and transmits a signal including selected base information indicating the selected base to the main body device 100 by wire or wireless. The user operation input device 200 is typically a remote control or a touch panel.

  The video input device 300 outputs video data obtained by photographing the location where the main device 100 is installed to the main device 100. The video data output from the video input device 300 includes video data saved by a PC, video data reproduced by a DVD player, and the like in addition to video data captured by a camera.

  The voice input device 400 outputs voice data and the like obtained by collecting the voice of the site where the main device 100 is installed to the main device 100. The audio data output from the audio input device 400 includes audio data collected by a microphone, video data stored in a PC and audio data set, video data reproduced by a DVD player, and audio data set. There are data.

  The display device 500 displays the video data output from the main device 100 on a screen and outputs the audio data output from the main device 100 from a speaker (not shown).

  The main device 100 includes a user instruction receiving unit 101, a conference control unit 102, a communication control unit 103, a video / audio encoding / decoding unit 104, a video / audio synthesis unit 105, and a video / audio output control unit 106. And a still image holding unit 107, a video input control unit 108, and an audio input control unit 109. The video / audio encoding / decoding unit 104, the video / audio synthesis unit 105, and the video / audio output control unit 106 constitute a display control unit.

  The user instruction receiving unit 101 receives a signal transmitted from the user operation input device 200, extracts selected base information included in the received signal, and outputs it to the conference control unit 102. The selected base information includes destination information (IP address or ISDN number) of each base participating in the video conference.

  The conference control unit 102 receives data from the communication control unit 103, the video / audio encoding / decoding unit 104, and the video / audio synthesis unit 105 based on the selected base information input from the user instruction receiving unit 101. Control output timing. In addition, the conference control unit 102 outputs the selected base information input from the user instruction receiving unit 101 to the video / voice synthesis unit 105. In addition, the conference control unit 102 controls the transmission processing and call establishment processing in the communication control unit 103 based on the selected base information, and monitors whether video data has been received.

  The communication control unit 103 operates at a timing according to the control of the conference control unit 102. The communication control unit 103 establishes a call with the other video conference apparatuses 10-2 to 24-24. Then, after establishing the call, the communication control unit 103 receives the packet including the video data and the audio data transmitted from the other video conference apparatuses 10-2 to 24 through the network 20, and performs the video / audio encoding. / Output to decoding section 104. In addition, after establishing the call, the communication control unit 103 transmits packets including video data and audio data input from the video / audio encoding / decoding unit 104 to other video conference apparatuses 10-2 to 10-2 through the network 20. 24. The communication control unit 103 operates according to a predetermined communication protocol. The communication protocol is typically SIP or H.264. H.323.

  In addition, the communication control unit 103 performs grouping of the other video conference apparatuses 10-2 to 10-24 based on network information managed by the video / audio encoding / decoding unit 104. For example, the communication control unit 103 determines a base having an RTT (Round-Trip Time) equal to or less than a threshold as a broadband base (HD resolution transmission group), and a base having an RTT greater than the threshold is a narrow band base (SD resolution transmission group). ).

  The video / audio encoding / decoding unit 104 operates at a timing according to the control of the conference control unit 102. The video / audio encoding / decoding unit 104 encodes the video data input from the video / audio synthesis unit 105 and the audio data input from the audio input control unit 109 and outputs the encoded data to the communication control unit 103.

  The video data is encoded based on video encoding parameters. The video / audio encoding / decoding unit 104 determines a video encoding parameter that affects subjective evaluation of video quality for each group. The video encoding parameters include an encoding bit rate, an encoding frame rate, an encoding resolution, a packet size, a low pass filter, and the like. For example, the video / audio encoding / decoding unit 104 sets the encoding parameter so that the screen resolution of 1920 × 1080 pixels is set in each site belonging to the HD resolution transmission group, and the site belonging to the SD resolution transmission group. Sets the video encoding parameters so that the screen resolution is 720 × 480 pixels.

  Also, the video / audio encoding / decoding unit 104 decodes video data and audio data from the other video conference apparatuses 10-2 to 24-24 input from the communication control unit 103 and outputs them to the video / audio synthesis unit 105. .

  The video / audio encoding / decoding unit 104 manages network information of the other video conference apparatuses 10-2 to 10-24. The network information includes the type of device at each child base (whether it is a mobile terminal), packet loss frequency (number of packet losses within a predetermined time), IP address, RTT, estimated bandwidth, and the like.

  The video / audio synthesis unit 105 operates at a timing according to the control of the conference control unit 102. The video / audio synthesizer 105 is based on the video data from the other video conference apparatuses 10-2 to 24-24 input from the video / audio encoding / decoding unit 104 and the video data input from the video input control unit 108. In accordance with the number of bases of the selected base information input from the conference control unit 102, composite video data obtained by combining a plurality of video data is generated and output to the video / audio output control unit 106. The video / audio synthesis unit 105 outputs the synthesized video data so that the still image held in the still image holding unit 107 is displayed until the video data is received from each of the video conference apparatuses 10-2 to 24-24. Generate.

  Also, the video / audio synthesis unit 105 synthesizes the audio data input from the video / audio encoding / decoding unit 104 and the audio data input from the audio input control unit 109 with the audio data input from the other video conference apparatuses 10-2 to 10-24. The synthesized voice data is generated and output to the video / audio output control unit 106. Further, the video / audio synthesis unit 105 outputs the video data input from the video input control unit 108 to the video / audio encoding / decoding unit 104.

  The video / audio output control unit 106 displays the synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 and outputs the synthesized audio data from the speaker of the display device 500 as audio.

  The still image holding unit 107 holds in advance still image data for displaying a predetermined still image on the screen of the display device 500 during a period until video data is received from the other video conference apparatuses 10-2 to 10-24. ing.

  The video input control unit 108 outputs the video data input from the video input device 300 to the video / audio synthesis unit 105.

  The audio input control unit 109 outputs the audio data input from the audio input device 400 to the video / audio encoding / decoding unit 104 and the video / audio synthesis unit 105.

<Transition of video conferencing equipment connection status>
Next, the transition of the connection state of the video conference apparatus 10-1 will be described in detail with reference to FIG.

  The video conference apparatus 10-1 starts operating when the power is turned on. The video conference apparatus 10-1 is in a non-communication state immediately after being powered on (S1).

  In the non-communication state (S1), the video conference apparatus 10-1 is connected to the other video conference apparatus 10-i (i is an integer from 2 to 24), whereby the video conference apparatus 10-i. And a one-to-one communication state (1: 1 communication state) (S2). Then, in the 1: 1 communication state (S2), the video conference device 10-1 becomes a non-communication state when the connection with the video conference device 10-i in the communication state is disconnected (S1). In addition, the video conference apparatus 10-1 ends the operation when the power is turned off in the non-communication state (S1).

  In addition, the video conference apparatus 10-1 is further connected to another video conference apparatus 10-j (j is an integer from 2 to 24 other than i) from the 1: 1 communication state (S2). A communication state (MCU communication state) is established with the video conference apparatuses 10-i, j at a plurality of bases (S3).

  Then, the video conference apparatus 10-1 is in a one-to-one communication state when the connection with the video conference apparatus 10-j in communication is cut off (S2), and further, with the video conference apparatus 10-i in communication state If the connection is disconnected, the communication state is turned off (S1).

  In addition, the video conference apparatus 10-1 transmits all the other video conference apparatuses 10-2 to 24 at the same time in the non-communication state (S1), thereby transmitting all the other video conference apparatuses 10-2 to 10-2. 24 and a communication state (MCU communication state) (S3). And the video conference apparatus 10 will be in a non-communication state, if the connection with all the other video conference apparatuses 10-2-24 is cut | disconnected all at once (S1).

  As a method of transmitting all at once, a method in which a user manually inputs a destination to the video conference device 10-1 at the time of outgoing or a plurality of destination information stored in advance in the video conference device 10-1 is registered. A method of allowing the user to select a list can be considered. In addition, as a method for specifying a destination, an IP address, a telephone number, an identification code, or the like can be considered.

<Operation of video conference device>
Next, operation | movement of the video conference apparatus 10-1 is demonstrated in detail using FIG. FIG. 3 is a flow in the case where the video conference apparatus 10-1 transmits all other video conference apparatuses 10-2 to 24 all at once.

  First, the user instruction receiving unit 101 receives a signal from the user operation input device 200, extracts selected base information included in the received signal, and outputs it to the conference control unit 102.

  The conference control unit 102 performs communication control so that simultaneous transmission is performed to the video conference apparatuses 10-2 to 24 installed in each of the N locations (N is an integer of 1 or more, N = 23 in FIG. 3) of the selected location information. The unit 103 is controlled. Thereby, the communication control part 103 performs simultaneous transmission to the video conference apparatuses 10-2-24 of a selection base (S11). Specifically, when the selected base information is information of one list in which a plurality of destination information is recorded, the conference control unit 102 determines the number of bases based on the number of destinations of the destination information registered in the list. N can be recognized.

  The video / audio encoding / decoding unit 104 initializes network information (device type of each child base, packet loss frequency, IP address, RTT, estimated bandwidth, etc.) (S12).

  In addition, the communication control unit 103 establishes a call with each of the video conference apparatuses 10-2 to 24 at other bases (S13).

  Thereafter, the video conference apparatus 10-1 performs grouping on the n-th base (n is any integer from 2 to N + 1) in order from the base of the base number 2 (S14 to S20). Specifically, the video / audio encoding / decoding unit 104 decodes packet data received from each child base, manages (sets, updates) network information based on the decoding result (S15), and performs communication control. If the RTT of the signal transmitted to the n-th base is equal to or less than the threshold, the unit 103 determines that the base is a broadband base (S16, S17: YES, S18), and if it is greater than the threshold, determines that the base is a narrow base (S16). , S17: NO, S19).

  After the grouping is completed (S20: YES), the video / audio encoding / decoding unit 104 determines video encoding parameters for each group (S21).

<Effect>
As described above, in the present embodiment, grouping can be performed based on network information correlated with the actual network bandwidth, so that the mediation bandwidth preset for each child site differs from the actual network bandwidth. Therefore, it is possible to perform grouping with high accuracy for a base having a different mediation band from an arbitration band set in advance for each child base.

  The present invention is not limited to the above-described embodiments in terms of the type, arrangement, number, etc. of the members, and departs from the gist of the invention, such as appropriately replacing the constituent elements with those having the same operational effects. It is possible to change appropriately within the range not to be.

  Specifically, in the above embodiment, the case where grouping is performed based on the magnitude relationship between the RTT and the threshold has been described. However, the present invention is not limited to this, and grouping is performed based on other network information. Also good. For example, a base whose packet loss frequency is less than or equal to a threshold may be determined as a broadband base, and a base greater than the threshold may be determined as a narrow-band base. Alternatively, based on information such as an IP address that can estimate the location of another base, a base that exists in Japan may be determined as a broadband base, and a base that exists overseas may be determined as a narrow-band base. . Alternatively, based on information indicating the type of device at each child base, a base other than the mobile terminal may be determined as a broadband base and the mobile terminal base may be determined as a narrow-band base.

  In the above-described embodiment, the case where a still image is displayed before the image is displayed has been described. However, the present invention is not limited to this, and character information such as a message other than the still image is displayed. The screen may be left as it is.

  In the above embodiment, the video conference system in which the number of sites that can be connected simultaneously is 24 has been described as an example. However, the present invention has no limitation on the number of sites that can be connected simultaneously.

  In the present invention, display video data and transmission video data can be generated separately according to user settings. For example, the video data output from the video input control unit 108 can be used as display video data, and the video data synthesized by the video / audio synthesis unit 105 can be used as transmission video data.

  The present invention is suitable for use in a video conference apparatus that is provided at a host site and can be connected simultaneously with counterpart devices at a plurality of sites different from the host site.

DESCRIPTION OF SYMBOLS 10 Video conference apparatus 100 Main body apparatus 101 User instruction | indication receiving part 102 Conference control part 103 Communication control part 104 Video | voice / audio encoding / decoding part 105 Video | voice / synthesizer 106 Video | voice / audio output control part 107 Still image holding part 108 Video input Control unit 109 Audio input control unit 200 User operation input device 300 Video input device 400 Audio input device 500 Display device

The video conference apparatus of the present invention is a video conference apparatus that is provided at a host base and can be connected simultaneously with a plurality of other bases, a video input unit that captures the host base and acquires video data, and a network. A communication control unit that transmits / receives a packet including video data to / from each of the other bases, and a display control unit that generates composite video data obtained by combining a plurality of the video data and displays the composite video data on a screen. The communication control unit determines, based on the IP address of each other base, other bases existing in Japan as a broadband base, determines other bases present overseas as a narrow band base, and group performs grouping of the group of bases into groups of locations of the narrowband, the display control unit, which determines the video coding parameters for each group, for each of the other bases, belongs Encoding the video data based on the video encoding parameter.

Claims (3)

A video conference device that is provided at a host site and can be connected simultaneously with a plurality of other sites.
A video input unit that captures the host site and obtains video data;
A communication control unit that transmits and receives packets including video data to and from each other site via a network;
A display control unit that generates composite video data obtained by combining a plurality of the video data and displays the composite video data on the screen;
Comprising
The communication control unit
Grouping the other bases based on information about the network,
The display control unit
Determining video encoding parameters for each group, and encoding the video data based on the video encoding parameters;
Video conferencing equipment. The information on the network includes RTT (Round-Trip Time) of each other base,
The communication control unit
Grouping the other bases according to the magnitude relationship between the RTT and the threshold value,
The video conference apparatus according to claim 1. The communication control unit
A base whose RTT is less than or equal to the threshold is determined as a broadband base, and a base where the RTT is greater than the threshold is determined as a narrow-band base.
The video conference apparatus according to claim 2.

Images