CN102480613B - Method, device and system for video monitoring on terminal of videoconferencing system - Google Patents
Method, device and system for video monitoring on terminal of videoconferencing system Download PDFInfo
- Publication number
- CN102480613B CN102480613B CN201010560749.3A CN201010560749A CN102480613B CN 102480613 B CN102480613 B CN 102480613B CN 201010560749 A CN201010560749 A CN 201010560749A CN 102480613 B CN102480613 B CN 102480613B
- Authority
- CN
- China
- Prior art keywords
- monitored terminal
- terminal
- announcer
- control desk
- mcu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a method for video monitoring of a terminal of a videoconferencing system, a device for video monitoring on the terminal of the videoconferencing system and a system for video monitoring on the terminal of the videoconferencing system and a system. The method includes the steps that firstly, after a multipoint conference is successfully convened, a PC (personal computer) control console receives attribute information of a monitored terminal attending the conference and transmitted by an MCU (microprogrammed control unit), secondly, the PC control console judges whether a video format of images currently transmitted by the monitored terminal is high in definition or not according to the attribute information of the monitored terminal, and the monitored terminal is not a broadcaster or a broadcaster responsible terminal of the current conference, thirdly, the PC control console commands the monitored terminal to enter the transcoding state by the aid of the MCU and transmits transcoded images to the PC control console, and finally, the PC control console decodes and displays the received images. By the aid of the method, video monitoring on multipath high-definition terminals is realized without improving the decoding capacity of the PC control console.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of video frequency monitoring method, system and device of terminal of TV conference system.
Background technology
In large-scale TV conference system, for guaranteeing the quality of Meeting Held, need to be monitored the multipoint conference meeting-place of real-time convening.At present, video conferencing multipoint conference meeting-place method for supervising mainly contains two kinds of figure entablement monitoring and the remote monitoring of PC control desk.
Wherein, the monitoring of figure entablement refers to multipoint control unit (Multipoint Control Unit, referred to as MCU) the not treated image station equipment of directly exporting to of sound, video stream data of self terminal in the future, sound, video stream data that image station equipment will receive from MCU are processed, be presented on video wall, large-screen or similar equipment, realize the monitoring to active conference; The remote monitoring of PC control desk refers to MCU, and sound, the video stream data of self terminal are weaved into User Datagram Protoco (UDP) (User Datagram Protocol according to the mode of RTP (RTP) stream in the future, referred to as UDP) bag, send on the PC control desk of appointment, the decoder module of PC control desk is decoded to sound, video flowing, finally on PC control desk interface, shows.
Because figure entablement monitor mode need to be carried out complicated physical routing and buy special image station equipment, so its cost is higher, and uses complexity, and therefore, most of user adopts PC control desk long-distance monitoring method to be monitored video conference.But along with 720P, 1080I, the popularization of 1080P HD video ability on video conference terminal equipment, when monitored HD video terminal number is more, while adopting PC control desk long-distance monitoring method to be monitored, the decoding pressure of PC control desk is larger, thereby the problem that can't be monitored each meeting-place of video conference occurs causing because PC control desk decoding capability is not enough.
Summary of the invention
Main purpose of the present invention is to provide a kind of video frequency monitoring method, system and device of terminal of TV conference system, at least to solve the above-mentioned problem that can't be monitored each meeting-place of video conference that causes because PC control desk decoding capability is not enough.
According to an aspect of the present invention, provide a kind of video frequency monitoring method of terminal of TV conference system, having comprised: after multipoint conference is successfully held, the PC control desk receives the attribute information of the monitored terminal participated in a conference of MCU transmission; The PC control desk is according to the attribute information of described monitored terminal, and the video format that judges the current transmission image of monitored terminal is high definition, and monitored terminal is not the announcer of active conference or end that the announcer sees; The PC control desk enters the transcoding state by the described monitored terminal of described MCU order, with the video format transmission image of SD; Described monitored terminal is SD by the video format conversion of the image of its transmission, and the image after conversion is sent to described PC control desk through described MCU; Described PC control desk is decoded and is shown the image received.
According to a further aspect in the invention, provide a kind of video monitoring system of terminal of TV conference system, having comprised: multipoint control unit sends to the PC control desk for the attribute information of the monitored terminal that will participate in multipoint conference; Described PC control desk, for the attribute information according to described monitored terminal, the video format that judges the current transmission image of described monitored terminal is high definition, and announcer or end that the announcer sees that described monitored terminal is not active conference, enter the transcoding state by the described monitored terminal of described multipoint control unit order, with the video format transmission image of SD.
According to a further aspect of the invention, provide a kind of PC control desk, having comprised: receiver module, for the attribute information of the monitored terminal that receives the participation multipoint conference that MCU sends; Judge module, for the attribute information according to described monitored terminal, judge that the video format of the current transmission image of described monitored terminal is high definition, and described monitored terminal be not active conference announcer or end that the announcer sees; Control module, for by the described monitored terminal of described MCU order, carrying out the transcoding state, with the video format transmission image of SD; Decoder module, pass through the image of described MCU with the video format transmission of SD for the described monitored terminal of decoding; Display module, for showing decoded described image.
According to a further aspect of the invention, provide a kind of multipoint control unit, having comprised: sending module, for send the attribute information of the monitored terminal of participating in multipoint conference to the PC control desk; Receiver module, the monitor command sent for receiving described PC control desk, wherein, the described monitored terminal of described monitor command indication needs transcoding; Notification module, for described monitored terminal, carrying out capabilities exchange, notify described monitored terminal to enter the transcoding state, with the video format transmission image of SD; Packetization module, for described monitored terminal is packed with the video format transmitted stream of SD, and send to described PC control desk.
By the present invention, employing will not be by will be that the image that the terminal of the announcer of active conference or end that the announcer sees sends is reduced to SD by high definition, thereby reduced the requirement to the decoding capability of PC control desk, can be under the decoding capability that does not improve the PC control desk, realization is carried out video monitoring to the multi-path high-definition terminal, has reduced equipment cost.
The accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms the application's a part, and schematic description and description of the present invention the present invention does not form inappropriate limitation of the present invention for explaining.In the accompanying drawings:
Fig. 1 is the structural representation according to the video monitoring system of the terminal of the TV conference system of the embodiment of the present invention;
Fig. 2 is the structural representation according to the PC control desk of the embodiment of the present invention;
Fig. 3 is the structural representation according to the multipoint control unit of the embodiment of the present invention;
Fig. 4 is the structural representation of multipoint control unit according to one preferred embodiment of the present invention;
Fig. 5 is the structural representation of the multipoint control unit of another preferred embodiment according to the present invention;
Fig. 6 is the flow chart according to the video frequency monitoring method of the terminal of the TV conference system of the embodiment of the present invention;
Fig. 7 is the schematic diagram according to the remote monitoring example networking of a video conferencing multipoint conference unit of the embodiment of the present invention;
Fig. 8 is that the PC control desk in Fig. 7 is realized the signaling process figure that the high definition terminal is monitored;
Fig. 9 is the signaling process figure that the MCU in Fig. 7 is controlled monitored high definition terminal.
Embodiment
Below with reference to the accompanying drawings and in conjunction with the embodiments, describe the present invention in detail.
Hereinafter with reference to accompanying drawing, also describe the present invention in detail in conjunction with the embodiments.It should be noted that, in the situation that do not conflict, embodiment and the feature in embodiment in the application can combine mutually.
Video conference terminal can operate with asymmetrical video bitrate, frame rate and image resolution ratio (if supporting the resolution of multiple image).For example, allow the terminal with 720P ability to send the 264CIF video image and accept the 720P image, terminal for this kind of situation is referred to as to enter the terminal of transcoding state or the terminal of transcoding in embodiments of the present invention, also can claim that this terminal enters asymmetric mode, be referred to as to exit the terminal of transcoding state or the terminal of transcoding not for the identical terminal of video capability of accepting and send, also can claim this terminal to carry out symmetric pattern.
Fig. 1 is the structural representation according to the video monitoring system of the terminal of the TV conference system of the embodiment of the present invention, and as shown in Figure 1, this video monitoring system mainly comprises: multipoint control unit 2 and PC control desk 4.Wherein, multipoint control unit 2, send to the PC control desk for the attribute information of the monitored terminal that will participate in multipoint conference; Described PC control desk 4, for the attribute information according to described monitored terminal, the video format that judges the current transmission image of described monitored terminal is high definition, and announcer or end that the announcer sees that described monitored terminal is not active conference, enter the transcoding state by the described monitored terminal of described multipoint control unit 2 order, with the video format transmission image of SD.
For example, after meeting is successfully held, multipoint control unit 2 can report the PC control desk in the mode of terminal details by the attribute information of the monitored terminal in active conference Zhong Ge road, wherein, this attribute information includes but not limited to: whether the video protocols type of the title of terminal, the current employing of terminal and terminal are seen end by announcer and the announcer of active conference.In addition, this attribute information can also comprise: terminal connection status, terminal audio frequency protocol type etc.PC control desk 4, after the attribute information that receives each monitored terminal that multipoint control unit 2 reports, can upgrade the state of each monitored terminal on the control desk interface.PC control desk 4 according to the video capability of monitored terminal (can obtain by the video protocols type of the current employing of this terminal), whether be that the announcer of active conference or announcer see to bring in and judge whether this terminal needs transcoding, when the video protocols type of monitored terminal is high definition (720P, 1080I, 1080P) and while by non-announcer and announcer, being seen end, this monitored terminal is the terminal that needs transcoding.
For example, PC control desk 4 can notify monitored terminal to enter the transcoding state in the following manner: the PC control desk sends monitor terminal message to multipoint control unit 2, indicates above-mentioned monitored terminal whether to need transcoding; Multipoint control unit 2 is processed in the indication that receives this monitor terminal message, if this monitor terminal message indicates monitored terminal not need transcoding, multipoint control unit 2 directly will carry out the RTP packing to the audio frequency from this monitored terminal, video code flow, and in monitor terminal message with IP address and port (port address that the PC control desk is this terminal distribution) the UDP bag that sends media, and report the monitor state return messages simultaneously; If this monitor terminal message indicates monitored terminal to need transcoding, 2 ability and monitored terminals that require according to the PC control desk of multipoint control unit are carried out capabilities exchange, notify monitored terminal to carry out transcoding to image.
In a preferred implementation of the embodiment of the present invention, in order to improve the user, experience, the transcoding signaling that monitored terminal can be accepted PC control desk 4 also can not receive the transcoding signaling of PC control desk 4, whether multipoint control unit 2 can accept the transcoding order to PC control desk reporting terminal by the monitor state return messages, if monitored terminal is agreed, monitored terminal arrives to multipoint control unit with new video capability transmission code stream, the video format with SD sends image, and multipoint control unit 2 is directly by the audio frequency of the monitored terminal of correspondence, video code flow carries out the RTP packing, and wrap to the UDP of PC control desk 4 transmission media.The monitor state that PC control desk 4 reports according to multipoint control unit 2 is upgraded the attribute information of this terminal, if monitor successfully, 4, PC control desk starts to receive code stream, and according to audio protocols type, the video protocols type of terminal and whether transcoding is decoded to code stream and shows.
In a kind of preferred implementation of the embodiment of the present invention, multipoint control unit 2 is also for knowing that described monitored terminal changes the announcer of active conference or announcer into while seeing end, carry out capabilities exchange with described monitored terminal, notify described monitored terminal to exit the transcoding state, do not carry out transcoding, video format with high definition sends image, thereby can prevent that the video capability of whole meeting from descending.Preferably, multipoint control unit 2 changes the announcer of active conference or announcer into while seeing end obtaining described monitored terminal, can also send message to PC control desk 4, using described monitored terminal and change the announcer of active conference or announcer in described monitored terminal and send to PC control desk 4 as the current attribute information of the terminal of the announcer of meeting or end that the announcer sees before seeing end, make the attribute information that PC control desk 4 can these two terminals, guarantee follow-up can the monitoring these two terminals accurately.
In another preferred implementation of the embodiment of the present invention, PC control desk 4 is also for sending and stop monitor command to multipoint control unit 2, and indication stops monitoring described monitored terminal; And multipoint control unit 2 also for receive described stop monitor command after, judge that whether described monitored terminal is in the transcoding state, if so, notify described monitored terminal to exit the transcoding state, send image with the video format of high definition.Thereby, while making follow-up PC control desk 4 recover this monitored terminal is monitored, when initial, this monitored terminal can send image with the video format of high definition.Wherein, PC control desk 4 send described stop monitor command after, stop receiving this monitored terminal transmitted stream (comprising audio stream and video flowing) simultaneously.
Fig. 2 is the structural representation according to the PC control desk 4 of the embodiment of the present invention, and as shown in Figure 2, PC control desk 4 can comprise: receiver module 20, judge module 22, control module 24, decoder module 26 and display module 28.Wherein, receiver module 20, for the attribute information of the monitored terminal that receives the participation multipoint conference that MCU sends; Judge module 22 is connected with receiver module 20, for the attribute information according to described monitored terminal, judges that the video format of the current transmission image of described monitored terminal is high definition, and described monitored terminal be not active conference announcer or end that the announcer sees; Control module 24 is connected with judge module 22, for the video format at the current transmission image of the judge module 22 described monitored terminal of judgement, it is high definition, and when the announcer that described monitored terminal is not active conference or announcer see end, carry out the transcoding state by the described monitored terminal of described MCU order, with the video format transmission image of SD; Decoder module 26, pass through the image of described MCU with the video format transmission of SD for the described monitored terminal of decoding; Display module 28, for showing decoded described image.
Wherein, control module 24 can be by sending the monitor terminal message that the described monitored terminal of indication needs transcoding to described MCU, order described monitored terminal to carry out the transcoding state, wherein, MCU is after receiving above-mentioned monitor terminal message, carry out capability negotiation with described monitored terminal, notify described monitored terminal to carry out the transcoding state, the video format that sends image is reduced to SD by high definition.
Fig. 3 is the structural representation according to the multipoint control unit 2 of the embodiment of the present invention, and as shown in Figure 3, multipoint control unit 2 can comprise: sending module 30, receiver module 32, notification module 34 and packetization module 36.Wherein, sending module 30, for sending the attribute information of the monitored terminal of participating in multipoint conference to PC control desk 4; Receiver module 32, the monitor command sent for receiving described PC control desk 4, wherein, the described monitored terminal of described monitor command indication needs transcoding; Notification module 34, for described monitored terminal, carrying out capabilities exchange, notify described monitored terminal to enter the transcoding state, with the video format transmission image of SD; Packetization module 36, for described monitored terminal is packed with the video format transmitted stream of SD, and send to described PC control desk.
In a preferred implementation of the embodiment of the present invention, as shown in Figure 4, multipoint control unit 2 can also comprise monitoring module 38, whether change the announcer of active conference or end that the announcer sees into for monitoring described monitored terminal, if, trigger described notification module 34 and carry out capabilities exchange with described monitored terminal, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.Thereby can guarantee the video capability of video conference.
Preferably, described monitoring module 38 changes the announcer of active conference or announcer into while seeing end monitoring described monitored terminal, can also trigger sending module 30, sending module 30 is under the triggering of monitoring module 38, change described monitored terminal into the announcer of active conference or announcer in described monitored terminal and send to described PC control desk 4 as the current attribute information of the terminal of announcer or end that the announcer sees before seeing end, so that the more described monitored terminal of PC control desk and described monitored terminal change into the announcer of active conference or announcer see end before as the attribute information of the terminal of announcer or end that the announcer sees.
In another preferred implementation of the embodiment of the present invention, described receiver module 32 is also for receiving the monitor command that stops from described PC control desk 4, describedly stops the monitor command indication and stops monitoring described monitored terminal; As shown in Figure 5, multipoint control unit 2 can also comprise: judge module 50, for judging that whether described monitored terminal is in the transcoding state, if, triggering described notification module 34 and described monitored terminal, to carry out ability mutual, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.Thereby can guarantee that follow-up this monitored terminal can be with the video format work of high definition.
Fig. 6 is the flow chart according to the video frequency monitoring method of the terminal of the TV conference system of the embodiment of the present invention, and the method can realize by system or the device of above-mentioned Fig. 1 to 5.As shown in Figure 6, the method mainly comprises the following steps:
Step S602, after multipoint conference is successfully held, the PC control desk receives the attribute information of the monitored terminal participated in a conference of multipoint control unit MCU transmission;
After meeting is successfully held, the attribute information that MCU will participate in the terminal of active conference reports the PC control desk by the terminal details, wherein, the attribute information of terminal includes but not limited to: whether terminal name, terminal video protocols type and terminal are seen end by announcer and the announcer of active conference, the attribute information of the terminal that in addition, MCU reports can also comprise: terminal connection status and terminal audio frequency protocol type etc.
Step S604, described PC control desk, according to the attribute information of described monitored terminal, judges that the video format of the current transmission image of described monitored terminal is high definition, and described monitored terminal be not active conference announcer or end that the announcer sees;
The attribute information of each terminal that the PC control desk reports according to MCU upgrades the state of each terminal on the control desk interface.When needs carry out policer operation to some terminals (being called in embodiments of the present invention monitored terminal) on the PC control desk, the PC control desk sends monitor terminal message to MCU, if the PC control desk judges that according to the attribute information of monitored terminal the video format that the current transmission image of this monitored terminal adopts is high definition, and announcer or end that the announcer sees that this monitored terminal is not active conference, the PC control desk determines that this monitored terminal needs transcoding, and in the monitor terminal message sent, this monitored terminal of indication needs transcoding.
Step S606, described PC control desk enters the transcoding state by the described monitored terminal of described MCU order, with the video format transmission image of SD;
For example, the PC control desk can send the monitor terminal message that the monitored terminal of indication needs transcoding to MCU, MCU is after receiving monitor terminal message, know that monitored terminal need to carry out transcoding, with monitored terminal, carry out capabilities exchange, notify monitored terminal to carry out transcoding to the image sent, make monitored terminal carry out the transcoding state, with the video format transmission image of SD.
Preferably, in order to improve the user, experience, monitored terminal also can determine whether to accept the transcoding order of PC control desk according to user's setting, in this case, MCU can report monitored terminal whether to accept the transcoding order to the PC control desk by the monitor state return messages.The monitor state that the PC control desk reports according to MCU is upgraded the monitor message of this monitor terminal.When some high definition terminals are monitored, MCU need to learn whether this end needs transcoding according to the order of PC control desk, for the terminal that needs transcoding, it is mutual that the ability that MCU requires according to the PC control desk is carried out ability with terminal again, notify monitored terminal to carry out transcoding to image, make it enter asymmetric mode, send code stream with new video capability and arrive to MCU; For the terminal that does not need transcoding, MCU does not carry out special operational.
Step S608, described monitored terminal is SD by the video format conversion of the image of its transmission, and the image after conversion is sent to described PC control desk through described MCU;
If monitored terminal receives the transcoding order of PC control desk, with new video capability, send code stream (the video format with SD sends image) to MCU, the Voice & Video code stream that MCU sends this monitored terminal carries out the RTP packing, and sends the UDP bag of media to the PC control desk.
Step S610, described PC control desk is decoded and is shown the image received.
The PC control desk receives the MCU transmitted stream, and according to audio protocols type, the video protocols type of terminal and whether transcoding is decoded to code stream and shows.
Multipoint conference is held in process, usually only has announcer's terminal and announcer to see that the image of these two terminals of end is used, and the image of the other-end of participant is not used for multipoint conference.The said method provided by the embodiment of the present invention, PC control desk and MCU carry out communication, MCU according to the order of PC control desk again with to see that except announcer and announcer monitored terminal end is carried out ability mutual, allow these terminals that the video format of its transmission is dropped to SD by high definition, under the prerequisite that guarantees picture quality, the ability that the maximized PC of the sharing control desk of terminal consumes image decoding, thus can reach the decoding request that reduces the PC control desk.
In a preferred implementation of the embodiment of the present invention, the PC control desk can stop the monitoring to above-mentioned monitored terminal, and in this case, the PC control desk can send and stop monitoring message to MCU, stops this monitored terminal is received to code stream simultaneously.MCU is judged after receiving and stopping monitoring message, if this monitored terminal is current in the transcoding state, MCU is the mutual mode of handling capacity again, the not transcoding mode work of notifying this terminal to recover.
When monitored high definition terminal (being above-mentioned monitored terminal) during in the transcoding state, in multipoint conference, this monitored terminal end likely becomes announcer or end that the announcer sees dynamically, in another preferred implementation of the embodiment of the present invention, now again with this monitored terminal, to carry out ability mutual for MCU, make it enter symmetry status (exiting the transcoding state), the video format transmission image with this monitored terminal with high definition.The information that simultaneously this monitored terminal is become to announcer or end that the announcer sees sends to the PC control desk, the PC control desk at once with the HD video agreement to its demonstration of decoding.
The technical scheme provided in order further to understand the embodiment of the present invention, the networking model of PC control desk remote monitoring of the video conferencing multipoint conference shown in Fig. 7 of below take describes as example.
In Fig. 7 the equipment of multipoint conference MCU is arranged respectively, based on the terminal T1 of agreement H.323, and, based on H.320 terminal T2, the T3 of agreement, wherein between T1 and MCU, adopt the IP communication modes, adopt E1/4E1 circuit communication modes between T2, T3 and MCU.The PC control desk is arranged on a PC, and adopts the IP communication modes between MCU.
Fig. 8 is the signaling process figure that in the embodiment of the present invention, the PC control desk is monitored the high definition terminal.When the video capability of monitored terminal is high definition, it is not again the announcer of active conference or end that the announcer sees simultaneously, and the PC control desk has the right to carry out transcoding by this end of MCU order.As for whether wanting transcoding, in order to improve the user, experience, can determine according to user's concrete needs, generally speaking, to the quality requirement of image when the PC control desk is monitored terminal is not very high, now the user can select above-mentioned terminal is carried out to the transcoding monitoring, when the user is very strict to the monitoring image quality requirement of some particular terminal, can select not transcoding policer operation to it.
As shown in Figure 8, the PC control desk is monitored mainly and is comprised the following steps the high definition terminal:
Step S801, after meeting is successfully held, the attribute information that MCU will participate in active conference Ge road terminal reports the PC control desk by the terminal details, comprising but be not limited to: whether terminal name, terminal connection status, terminal audio frequency protocol type, terminal video protocols type, terminal seen end by announcer and the announcer of active conference;
Step S802, the end message that the PC control desk reports according to MCU upgrades the state of each terminal on the control desk interface;
Step S803, when needs carry out policer operation to some terminals on the PC control desk, the PC control desk sends monitor terminal message to MCU;
Step S804, the ability that MCU requires according to the PC control desk is carried out capabilities exchange with terminal again, notifies this terminal to carry out transcoding to image, makes it enter asymmetric mode;
Whether MCU indicates this terminal to need transcoding to carry out different processing according to the PC control desk after receiving above-mentioned monitor terminal message: when not needing transcoding, MCU directly carries out the RTP packing by the audio frequency of counterpart terminal, video code flow, and in monitor terminal message with IP address and port (port address that the PC control desk is this terminal distribution) the UDP bag that sends media, and report the monitor state return messages simultaneously; When the needs transcoding, the ability that MCU requires according to the PC control desk is carried out capabilities exchange with terminal again, notifies this terminal to carry out transcoding to image, makes it enter asymmetric mode, and in embodiments of the present invention, the needs transcoding of take describes as example.
Step S805, terminal sends acknowledge message to MCU, informs that the MCU terminal can send image with new video format;
In actual applications, terminal also can not accepted the transcoding order of PC control desk, and terminal notice MCU does not carry out transcoding, and still the video format with high definition sends image.
Step S806, whether MCU accepts the transcoding order by the monitor state return messages to PC control desk reporting terminal;
Step S807, the PC control desk upgrades the monitor state of this terminal on the PC control desk according to the monitor state return messages;
Step S808, terminal sends code stream with new video capability and arrives to MCU;
Step S809, MCU directly carries out the RTP packing by the audio frequency of counterpart terminal, video code flow, and sends the UDP bag of media to the PC control desk;
Step S810, the PC control desk receives code stream, and according to audio protocols type, the video protocols type of terminal and whether transcoding is decoded to code stream and shows;
Step S811 when the PC control desk need to stop monitoring to terminal, clicks and stops monitoring button after counterpart terminal on the PC control desk, and the PC control desk sends and stops monitoring message to MCU, stops this termination is received to code stream simultaneously;
Step S812, MCU judged after receiving and stopping monitoring message, if this end in the transcoding state, MCU is the mutual mode of handling capacity again, the not transcoding mode work of notifying this terminal to recover;
Step S814, terminal sends acknowledge message to MCU, informs that the MCU terminal will be with symmetrical working method work.
Fig. 9 is the control signal flow chart of MCU to monitored high definition terminal in multipoint conference.As shown in Figure 9, in the terminal that enters the transcoding state, change announcer or announcer into while seeing end, MCU this terminal is controlled mainly and comprised the following steps initiatively:
Step S901, as T1, during in the transcoding state, in the process of holding at multipoint conference, MCU knows that T1 becomes announcer's (or the announcer sees end) dynamically;
Step S902, MCU by the information reporting of original announcer T2 and new announcer T1 to the PC control desk;
Step S903, the PC control desk is upgraded the state of terminal T1 and T2, according to the original HD video ability of T1, to the demonstration of decoding of the video code flow of T1, the transcoding button of T2 terminal becomes and enables simultaneously, and the user can carry out the transcoding operation to T2 voluntarily as required;
Step S904, this step can be carried out with step S902 simultaneously, and MCU makes T1 enter symmetric pattern with the form of capabilities exchange again, does not carry out transcoding, thereby can avoid whole meeting video capability along with the video capability of T1 descends;
Step S905, T1 sends acknowledge message to MCU, and indication T1 enters the not symmetrical operating state of transcoding, and T1 sends image with the video format of high definition;
Step S906, MCU by monitor state by the state reporting of T1 to the PC control desk;
Step S907, the PC control desk is upgraded the monitor state of T1;
If what T1 returned is successfully, the PC control desk continues to receive, decode, show image according to the HD video form; If what return is failure, the PC control desk stops this terminal is monitored, and points out out corresponding information in decoding.
Step S908, T1 sends the image of the video format of high definition to MCU;
Step S909, MCU will carry out the RTP packing to Voice & Video code stream that should terminal, and send the UDP bag of media to the PC control desk.
As can be seen from the above description, the technical scheme provided by the embodiment of the present invention, solved in prior art when the multi-path high-definition video terminal is carried out to the remote monitoring of PC control desk the problem of PC decoding capability deficiency.And, in the technical scheme provided in the embodiment of the present invention, only need in existing scheme, revise on a small quantity, technology realizes simple.
Obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, perhaps be distributed on the network that a plurality of calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby they can be stored in storage device and be carried out by calculation element, perhaps they are made into respectively to each integrated circuit modules, perhaps a plurality of modules in them or step being made into to the single integrated circuit module realizes.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (14)
1. the video frequency monitoring method of the terminal of a TV conference system, is characterized in that, comprising:
After multipoint conference is successfully held, the PC control desk receives the attribute information of the monitored terminal participated in a conference of multipoint control unit MCU transmission;
Described PC control desk, according to the attribute information of described monitored terminal, judges that the video format of the current transmission image of described monitored terminal is high definition, and described monitored terminal be not active conference announcer or end that the announcer sees;
Described PC control desk enters the transcoding state by the described monitored terminal of described MCU order, with the video format transmission image of SD;
Described monitored terminal is SD by the video format conversion of the image of its transmission, and the image after conversion is sent to described PC control desk through described MCU;
Described PC control desk is decoded and is shown the image received.
2. method according to claim 1, is characterized in that, described PC control desk enters the transcoding state by the described monitored terminal of described MCU order and comprises:
Described PC control desk sends monitoring message to described MCU, indicates described monitored terminal to need transcoding;
Described MCU and described monitored terminal are carried out capabilities exchange, notify described monitored terminal to send image with the video format of SD.
3. method according to claim 1 and 2, is characterized in that, after described PC control desk enters the transcoding state by the described monitored terminal of described MCU order, described method also comprises:
Described MCU knows that described monitored terminal changes the announcer of active conference or end that the announcer sees into;
Described MCU and described monitored terminal are carried out capabilities exchange, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.
4. method according to claim 3, is characterized in that, described MCU knows that described monitored terminal changes into after the announcer of active conference or announcer see end, and described method also comprises:
Described MCU changes described monitored terminal and described monitored terminal into the announcer of active conference or announcer to be seen before end as the current attribute information of the terminal of announcer or end that the announcer sees and sends to described PC control desk;
Upgrade described PC control desk described monitored terminal and described monitored terminal change the announcer of active conference or announcer into sees that end is before as the attribute information of the terminal of announcer or end that the announcer sees.
5. method according to claim 1, is characterized in that, described method also comprises:
Described PC control desk sends and stops monitor command to described MCU, and indication stops monitoring described monitored terminal;
Described MCU judges that whether described monitored terminal is in the transcoding state, and if so, with described monitored terminal, to carry out ability mutual, notifies described monitored terminal to exit the transcoding state, with the video format of high definition, sends image.
6. whether according to the described method of any one in claim 1,2 and 5, it is characterized in that, described attribute information comprises: the video protocols type that current transmission image adopts, seen and hold and title by the announcer of active conference or announcer.
7. the video monitoring system of the terminal of a TV conference system, is characterized in that, comprising:
Multipoint control unit, send to the PC control desk for the attribute information of the monitored terminal that will participate in multipoint conference;
Described PC control desk, for the attribute information according to described monitored terminal, the video format that judges the current transmission image of described monitored terminal is high definition, and announcer or end that the announcer sees that described monitored terminal is not active conference, enter the transcoding state by the described monitored terminal of described multipoint control unit order, with the video format transmission image of SD.
8. system according to claim 7, it is characterized in that, described multipoint control unit is also for knowing that described monitored terminal changes the announcer of active conference or announcer into while seeing end, carry out capabilities exchange with described monitored terminal, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.
9. according to the described system of claim 7 or 8, it is characterized in that,
Described PC control desk is also for sending and stop monitor command to described multipoint control unit, and indication stops monitoring described monitored terminal;
Described multipoint control unit also for receive described stop monitor command after, judge that whether described monitored terminal is in the transcoding state, if so, notify described monitored terminal to exit the transcoding state, send image with the video format of high definition.
10. a PC control desk, is characterized in that, comprising:
Receiver module, for the attribute information of the monitored terminal that receives the participation multipoint conference that MCU sends;
Judge module, for the attribute information according to described monitored terminal, judge that the video format of the current transmission image of described monitored terminal is high definition, and described monitored terminal be not active conference announcer or end that the announcer sees;
Control module, for by the described monitored terminal of described MCU order, carrying out the transcoding state, with the video format transmission image of SD;
Decoder module, pass through the image of described MCU with the video format transmission of SD for the described monitored terminal of decoding;
Display module, for showing decoded described image.
11. a multipoint control unit, is characterized in that, comprising:
Sending module, for sending the attribute information of the monitored terminal of participating in multipoint conference to the PC control desk;
Receiver module, the monitor command sent for receiving described PC control desk, wherein, the described monitored terminal of described monitor command indication needs transcoding;
Notification module, for described monitored terminal, carrying out capabilities exchange, notify described monitored terminal to enter the transcoding state, with the video format transmission image of SD;
Packetization module, for described monitored terminal is packed with the video format transmitted stream of SD, and send to described PC control desk.
12. multipoint control unit according to claim 11, is characterized in that, also comprises:
Monitoring module, whether change the announcer of active conference or end that the announcer sees into for monitoring described monitored terminal, if, trigger described notification module and described monitored terminal is carried out capabilities exchange, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.
13. multipoint control unit according to claim 12, it is characterized in that, described sending module is also for using described monitored terminal and change the announcer of active conference or announcer in described monitored terminal and send to described PC control desk as the current attribute information of the terminal of announcer or end that the announcer sees before seeing end.
14. multipoint control unit according to claim 11, is characterized in that,
Described receiver module is also for receiving the monitor command that stops from described PC control desk, describedly stops the monitor command indication and stops monitoring described monitored terminal;
Described multipoint control unit also comprises: judge module, for judging that whether described monitored terminal is in the transcoding state, if, triggering described notification module and described monitored terminal, to carry out ability mutual, notify described monitored terminal to exit the transcoding state, with the video format transmission image of high definition.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010560749.3A CN102480613B (en) | 2010-11-25 | 2010-11-25 | Method, device and system for video monitoring on terminal of videoconferencing system |
| PCT/CN2011/082952 WO2012069011A1 (en) | 2010-11-25 | 2011-11-25 | Method, device and system for monitoring video of terminal of video conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010560749.3A CN102480613B (en) | 2010-11-25 | 2010-11-25 | Method, device and system for video monitoring on terminal of videoconferencing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102480613A CN102480613A (en) | 2012-05-30 |
| CN102480613B true CN102480613B (en) | 2014-01-01 |
Family
ID=46093075
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010560749.3A Expired - Fee Related CN102480613B (en) | 2010-11-25 | 2010-11-25 | Method, device and system for video monitoring on terminal of videoconferencing system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102480613B (en) |
| WO (1) | WO2012069011A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103124342B (en) * | 2013-01-28 | 2017-06-27 | 南京中兴软件有限责任公司 | The method and multipoint control unit being monitored to the state of video conference terminal |
| CN104683734A (en) * | 2013-11-26 | 2015-06-03 | 中兴通讯股份有限公司 | Video surveillance content adaptation method, system, central server and device |
| WO2018027699A1 (en) * | 2016-08-10 | 2018-02-15 | 张北江 | Transmission method and system for security video conference in low network speed environment |
| CN107888866A (en) * | 2016-09-30 | 2018-04-06 | 中兴通讯股份有限公司 | Multipart video-meeting control method, device and TV news server |
| TWI644565B (en) * | 2017-02-17 | 2018-12-11 | 陳延祚 | Video image processing method and system using the same |
| CN108040218A (en) * | 2017-12-20 | 2018-05-15 | 苏州科达科技股份有限公司 | The means of communication and communication apparatus of a kind of video conference |
| CN108696720B (en) * | 2018-05-08 | 2020-04-07 | 熊猫电子集团有限公司 | Video scheduling system and method suitable for satellite communication |
| CN110636244B (en) * | 2018-06-25 | 2022-03-29 | 中兴通讯股份有限公司 | Video conference server, system, control method and storage medium |
| CN109309806B (en) * | 2018-10-22 | 2020-10-30 | 视联动力信息技术股份有限公司 | Video conference management method and system |
| CN111405231B (en) * | 2020-03-03 | 2021-10-15 | 浙江华创视讯科技有限公司 | Video conference method, device, equipment and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101426094A (en) * | 2007-10-31 | 2009-05-06 | 索尼株式会社 | Video device, output switching method for video device, and cable discriminating method |
| CN101557495A (en) * | 2009-05-18 | 2009-10-14 | 上海华平信息技术股份有限公司 | Bandwidth control method of video conferencing system |
| CN101588252A (en) * | 2008-05-23 | 2009-11-25 | 华为技术有限公司 | Control method and control device of multipoint conference |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
-
2010
- 2010-11-25 CN CN201010560749.3A patent/CN102480613B/en not_active Expired - Fee Related
-
2011
- 2011-11-25 WO PCT/CN2011/082952 patent/WO2012069011A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101426094A (en) * | 2007-10-31 | 2009-05-06 | 索尼株式会社 | Video device, output switching method for video device, and cable discriminating method |
| CN101588252A (en) * | 2008-05-23 | 2009-11-25 | 华为技术有限公司 | Control method and control device of multipoint conference |
| CN101557495A (en) * | 2009-05-18 | 2009-10-14 | 上海华平信息技术股份有限公司 | Bandwidth control method of video conferencing system |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2012069011A1 (en) | 2012-05-31 |
| CN102480613A (en) | 2012-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102480613B (en) | Method, device and system for video monitoring on terminal of videoconferencing system | |
| US9172912B2 (en) | Telepresence method, terminal and system | |
| EP1774781B1 (en) | Monitoring and controlling administration systems | |
| KR100880150B1 (en) | Multi-point video conference system and media processing method thereof | |
| WO2014146100A1 (en) | Methods and systems for dynamic adjustment of session parameters for effective video collaboration among heterogeneous devices | |
| CN102404547B (en) | Method and terminal for realizing video conference cascade | |
| WO2007140668A1 (en) | Method and apparatus for realizing remote monitoring in conference television system | |
| US9654516B2 (en) | Method and device for negotiating media capability | |
| CN104980683A (en) | Implement method and device for video telephone conference | |
| CN103338346A (en) | Method and system for realizing multimedia digital conference | |
| US20070211138A1 (en) | System and method for configuring devices to facilitate video telephony | |
| CN101163029B (en) | Multi-point control cell main-slave rearranging method and equipment | |
| US9013537B2 (en) | Method, device, and network systems for controlling multiple auxiliary streams | |
| CN101247499B (en) | Network port backup method of MCU, MCU and video system | |
| CN110996039B (en) | Electronic whiteboard sharing method, system and computer-readable storage medium | |
| CN104581368A (en) | Multi-screen interaction method based on signal interaction | |
| CN103354557A (en) | Media control server cascade system, multimedia code stream control method and apparatus thereof | |
| JP5579660B2 (en) | Multipoint video conferencing equipment | |
| CN101998105A (en) | Media control server cascade system as well as method and device for controlling multimedia code streams | |
| CN101616186B (en) | Method, device and system for realizing remote assistance based on IP multimedia subsystem | |
| EP3641302A1 (en) | Video conference server capable of providing multi-screen video conference by using plurality of terminals for video conference, and method therefor | |
| CN117997876A (en) | Media sharing method for standardized output | |
| KR100784095B1 (en) | System for controlling a multi-videotelephony and a method the same | |
| CN115734028A (en) | Media stream pushing method and system based on cascade coding | |
| CN109788234A (en) | A kind of scheduling of multichannel network remote video stream shows method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140101 Termination date: 20191125 |