WO2012069011A1

WO2012069011A1 - Method, device and system for monitoring video of terminal of video conference system

Info

Publication number: WO2012069011A1
Application number: PCT/CN2011/082952
Authority: WO
Inventors: 杨伯辉; 孙博
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-11-25
Filing date: 2011-11-25
Publication date: 2012-05-31
Also published as: CN102480613B; CN102480613A

Abstract

The present invention provides a method, a device and a system for monitoring a video of a terminal of a video conference system. The method comprises: after a multipoint conference is started successfully, a PC console receiving attribute information of a monitored terminal participating in the conference sent by an MCU; according to the attribute information of the monitored terminal, the PC console determining that the video format of an image currently sent by the monitored terminal is high definition and that the monitored terminal is not a broadcaster of the current conference or a terminal watched by a broadcaster of the current conference; the PC console instructing, through the MCU, the monitored terminal to enter a code conversion state to send the image in a standard definition video format; the monitored terminal converting the video format of the image sent therefrom into standard definition and sending the converted image to the PC console through the MCU; and the PC console decoding and displaying the received image. Through the present invention, videos of multiple high definition terminals are able to be monitored without improving the decoding capability of the PC console.

Description

The present invention relates to the field of communications, and in particular to a video monitoring method, apparatus, and system for a terminal of a conference television system. BACKGROUND In a large-scale conference television system, in order to ensure the quality of conferences, it is necessary to monitor a multi-point conference venue held in real time. At present, the monitoring methods of conference TV multi-point conference venues mainly include image station monitoring and PC console remote monitoring. The image station monitoring refers to a multipoint control unit (MCU for short), and the audio and video stream data from the terminal are directly output to the image station device without processing, and the image station device receives the sound from the MCU. The video stream data is processed and displayed on a video wall, a large screen or a similar device to implement monitoring of the current conference; the PC console remote monitoring refers to the MCU transmitting the audio and video stream data from the terminal according to a real-time transmission protocol ( The Real-time Transport Protocol (RTP) stream is programmed into a User Datagram Protocol (UDP) packet, which is sent to the specified PC console. The decoding module of the PC console is used to listen to audio and video streams. The decoding is performed and finally displayed on the PC console interface. Since the image station monitoring method requires complicated physical wiring and purchase of special image table equipment, the cost is high and the use is complicated. Therefore, most users use the PC console remote monitoring method to monitor the video conference. However, with the promotion of 720P, 10801, and 1080P high-definition video capabilities on the conference TV terminal equipment, when the number of monitored high-definition video terminals is large, when the PC console remote monitoring method is used for monitoring, the decoding pressure of the PC console is relatively large. Therefore, there is a problem that the site of the video conference cannot be monitored due to insufficient decoding capability of the PC console. SUMMARY OF THE INVENTION The present invention provides a video surveillance method, apparatus, and system for a terminal of a conference television system, to at least solve the above problem of being unable to monitor various conference sites of a video conference due to insufficient decoding capability of the PC console. According to an aspect of the present invention, a video monitoring method for a terminal of a conference television system is provided, including: after a multipoint conference is successfully held, the PC console receives attribute information of the monitored terminal that is sent by the MCU to participate in the conference; PC control The station determines the video frame of the currently transmitted image of the monitored terminal according to the attribute information of the monitored terminal. The mode is HD, and the monitored terminal is not the broadcaster or broadcaster of the current conference; the PC console enters the transcoding state by the MCU command, and the image is sent in the standard video format; the monitored terminal sends it. The video format of the image is converted to standard definition, and the converted image is sent to the PC console via the MCU; the PC console decodes and displays the received image. Preferably, the PC console instructs the monitored terminal to enter the transcoding state by using the MCU command: the PC console sends a monitoring message to the MCU, indicating that the monitored terminal needs to be transcoded; the MCU and the monitored terminal perform capability exchange, and notify The image transmitted by the monitored terminal in standard definition video format. Preferably, after the PC console commands the monitored terminal to enter the transcoding state by using the MCU, the method further includes: the MCU knows that the monitored terminal is converted to the broadcaster or the broadcaster of the current conference; the MCU and the monitored terminal perform The capability exchange, notifying the monitored terminal to exit the transcoding state, and transmitting the image in a high-definition video format. Preferably, after the MCU learns that the monitored terminal is converted to the broadcaster or the broadcaster of the current conference, the method further includes: the MCU transforms the monitored terminal and the monitored terminal into a broadcaster or broadcaster of the current conference. The current attribute information of the terminal that is viewed by the broadcaster or the broadcaster is sent to the PC console; the PC console updates the monitored terminal and the monitored terminal is converted to the broadcaster or broadcaster of the current conference as the broadcaster. Or the attribute information of the terminal that the broadcaster is watching. Preferably, the method further includes: the PC console sends a stop monitoring command to the MCU, indicating to stop monitoring the monitored terminal; the MCU determines whether the monitored terminal is in a transcoding state, and if yes, performs capability interaction with the monitored terminal, and the notification is The monitoring terminal exits the transcoding state and sends the image in a high-definition video format. Preferably, the attribute information includes: a video protocol type used by the currently transmitted image, whether it is a broadcaster or a broadcaster of the current conference, and a name. According to another aspect of the present invention, a video surveillance system for a terminal of a conference television system includes: a multipoint control unit configured to transmit attribute information of a monitored terminal participating in a multipoint conference to a PC console; The console is configured to determine, according to the attribute information of the monitored terminal, that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference, and is commanded by the multi-point control unit. The monitoring terminal enters the transcoding state and sends the image in the standard video format. Preferably, the multi-point control unit is further configured to perform capability exchange with the monitored terminal when the monitored terminal is converted to the broadcaster or the broadcaster of the current conference, and notify the monitored terminal to exit the transcoding state, in high definition. The video format sends the image. Preferably, the PC console is further configured to send a stop monitoring command to the multipoint control unit to stop monitoring the monitored terminal; the multipoint control unit is further configured to determine whether the monitored terminal is in a transcoding state after receiving the stop monitoring command If yes, the monitored terminal is notified to exit the transcoding state, and the image is sent in a high-definition video format. According to still another aspect of the present invention, a PC console is provided, including: a receiving module, configured to receive attribute information of a monitored terminal that participates in a multipoint conference sent by an MCU; and a determining module, configured to be according to the monitored terminal Attribute information, determining that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference; the control module is configured to be configured by the MCU command The monitored terminal performs a transcoding state, and sends an image in a standard video format; the decoding module is configured to decode an image that is sent by the monitored terminal through the MCU in a standard definition video format; and the display module is configured to display the decoded device. Said image. According to still another aspect of the present invention, a multipoint control unit is provided, including: a sending module, configured to send attribute information of a monitored terminal participating in a multipoint conference to a PC console; and a receiving module configured to receive the PC a monitoring command sent by the console, wherein the monitoring command indicates that the monitored terminal needs to be transcoded; the notification module is configured to perform capability exchange with the monitored terminal, and notify the monitored terminal to enter a transcoding state, The standard video format sends an image; the packaging module is configured to package the code stream sent by the monitored terminal in the standard definition video format, and send the code stream to the PC console. Preferably, the multi-point control unit further includes: a monitoring module, configured to monitor whether the monitored terminal is converted to a broadcaster or a broadcaster of the current conference, and if so, the trigger notification module performs capability exchange with the monitored terminal, and notifies The monitored terminal exits the transcoding state and sends the image in a high-definition video format. Preferably, the sending module is further configured to send, to the PC, the current attribute information of the monitored terminal and the terminal that is viewed by the broadcaster or the broadcaster before the monitored terminal is converted to the broadcaster or broadcaster of the current conference. station. Preferably, the receiving module is further configured to receive a stop monitoring command from the PC console, and the stop monitoring command indicates to stop monitoring the monitored terminal; the multi-point control unit further includes: a determining module, configured to determine whether the monitored terminal is transcoded The status, if yes, triggers the notification module to perform capability interaction with the monitored terminal, notifies the monitored terminal to exit the transcoding state, and transmits the image in a high-definition video format. According to the present invention, the image transmitted by the terminal that is not the broadcaster or the broadcaster of the current conference is reduced from the high definition to the standard definition, thereby reducing the decoding capability of the PC console, and the PC console can be improved without Under the decoding capability, video monitoring is performed on multi-channel high-definition terminals, which reduces equipment costs. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 1 is a schematic structural diagram of a video monitoring system of a terminal of a conference television system according to an embodiment of the present invention; FIG. 2 is a schematic structural diagram of a PC console according to an embodiment of the present invention; 4 is a schematic structural view of a multipoint control unit according to a preferred embodiment of the present invention; FIG. 5 is a schematic structural view of a multipoint control unit according to another preferred embodiment of the present invention; 6 is a flowchart of a video monitoring method of a terminal of a conference television system according to an embodiment of the present invention; FIG. 7 is a schematic diagram of a remote monitoring instance networking of a conference television multipoint conference system according to an embodiment of the present invention; The PC console in FIG. 7 implements a signaling flow chart for monitoring the HD terminal. FIG. 9 is a signaling flow chart for controlling the monitored HD terminal by the MCU in FIG. 7. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the accompanying drawings in conjunction with the embodiments. The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. Videoconferencing endpoints are capable of operating at asymmetric video bitrates, frame rates, and image resolutions (if multiple images are supported). For example, the terminal having the 720P capability is allowed to transmit the 264 CIF video image and accept the 720P image. For the terminal in this case, the terminal that enters the transcoding state or the transcoded terminal in the embodiment of the present invention may also be referred to as the terminal entering the non-terminal. In the symmetric mode, a terminal that has the same ability to receive and transmit video is called a terminal that exits the transcoding state or a terminal that does not transcode, and may also be referred to as a symmetric mode. 1 is a schematic structural diagram of a video surveillance system of a terminal of a conference television system according to an embodiment of the present invention. As shown in FIG. 1, the video surveillance system mainly includes: a multipoint control unit 2 and a PC console 4. Among them, more points The control unit 2 is configured to send the attribute information of the monitored terminal participating in the multipoint conference to the PC console. The PC console 4 is configured to determine, according to the attribute information of the monitored terminal, the current status of the monitored terminal. The video format of the transmitted image is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference, and the multi-point control unit 2 commands the monitored terminal to enter the transcoding state to clear the video. Format the image. For example, after the conference is successfully convened, the multipoint control unit 2 may report the attribute information of each monitored terminal in the current conference to the PC console in the manner of the terminal detailed information, where the attribute information includes but is not limited to: The name of the video protocol that the terminal is currently using, and whether the terminal is the broadcaster and broadcaster of the current conference. In addition, the attribute information may further include: a terminal connection status, a terminal audio protocol type, and the like. After receiving the attribute information of each monitored terminal reported by the multipoint control unit 2, the PC console 4 can update the status of each monitored terminal on the console interface. The PC console 4 determines whether the terminal needs to be transcoded according to the video capability of the monitored terminal (which can be obtained through the video protocol type currently used by the terminal), whether it is the broadcaster of the current conference or the broadcaster's viewing end, when being monitored. When the video protocol type of the terminal is high definition (720P, 10801, 1080P) and is viewed by non-broadcasters and broadcasters, the monitored terminal is a terminal that needs to be transcoded. For example, the PC console 4 can notify the monitored terminal to enter the transcoding state by: the PC console sends a monitoring terminal message to the multipoint control unit 2, indicating whether the monitored terminal needs to be transcoded; the multipoint control unit 2 is receiving The instruction to the monitoring terminal message is processed. If the monitoring terminal message indicates that the monitored terminal does not need to transcode, the multipoint control unit 2 directly performs RTP packing on the audio and video code streams from the monitored terminal, and The UDP packet of the media is sent by the IP address and the port (the port address assigned by the PC console for the terminal) in the monitoring terminal message, and the monitoring status return message is reported at the same time; if the monitoring terminal message indicates that the monitored terminal needs to be transcoded, The point control unit 2 exchanges capabilities with the monitored terminal according to the capabilities required by the PC console, and notifies the monitored terminal to transcode the image. In a preferred embodiment of the embodiment of the present invention, in order to improve the user experience, the monitored terminal may accept the transcoding signaling of the PC console 4 or may not receive the transcoding signaling of the PC console 4, and the multipoint control unit 2 The monitoring status return message may report to the PC console whether the terminal accepts the transcoding command. If the monitored terminal agrees, the monitored terminal sends the code stream to the multi-point control unit with a new video capability, that is, sends the video format in standard definition. The image, and the multipoint control unit 2 directly packs the audio and video code streams corresponding to the monitored terminal, and sends the UDP packets of the media to the PC console 4. The PC console 4 updates the attribute information of the terminal according to the monitoring status reported by the multipoint control unit 2. If the monitoring is successful, the PC console 4 starts to receive the code stream, and according to the type of the audio protocol of the terminal, the type of the video protocol, and whether Transcoding decodes the code stream and displays it. In a preferred embodiment of the embodiment of the present invention, the multipoint control unit 2 is further configured to perform with the monitored terminal when learning that the monitored terminal is turned into a broadcaster or a broadcaster of the current conference. Ability to pay In other words, the monitored terminal is notified to exit the transcoding state, that is, the transcoding is not performed, and the image is transmitted in a high-definition video format, thereby preventing the video capability of the entire conference from degrading. Preferably, the multipoint control unit 2 may also send a message to the PC console 4 when the monitored terminal is converted to the broadcaster or the broadcaster of the current conference, and the monitored terminal and the The current attribute information of the terminal that is viewed by the broadcaster or the broadcaster of the conference before being broadcasted by the broadcaster or the broadcaster of the current conference is sent to the PC console 4, so that the PC console 4 can have the two terminals. The attribute information ensures that the two terminals can be monitored accurately. In another preferred embodiment of the embodiment of the present invention, the PC console 4 is further configured to send a stop monitoring command to the multipoint control unit 2, indicating to stop monitoring the monitored terminal; and the multipoint control unit 2 is further configured to After receiving the stop monitoring command, it is determined whether the monitored terminal is in a transcoding state. If yes, the monitored terminal is notified to exit the transcoding state, and the image is sent in a high-definition video format. Therefore, when the subsequent PC console 4 resumes monitoring the monitored terminal, the monitored terminal can initially send an image in a high-definition video format. The PC console 4 stops receiving the code stream (including the audio stream and the video stream) sent by the monitored terminal at the same time after transmitting the stop monitoring command. 2 is a schematic structural diagram of a PC console 4 according to an embodiment of the present invention, as shown in FIG. 2, a PC console

4 may include: a receiving module 20, a determining module 22, a control module 24, a decoding module 26, and a display module 28. The receiving module 20 is configured to receive the attribute information of the monitored terminal that participates in the multipoint conference sent by the MCU. The determining module 22 is connected to the receiving module 20, and is configured to determine that the monitored device is based on the attribute information of the monitored terminal. The video format of the current image sent by the terminal is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference; the control module 24 is connected to the judging module 22, and is configured to determine the monitored terminal at the judging module 22. When the video format of the currently transmitted image is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference, the MCU commands the monitored terminal to perform the transcoding state, and sends the video format in the standard definition video format. The decoding module 26 is configured to decode an image that is sent by the monitored terminal in the standard video format by the MCU; and the display module 28 is configured to display the decoded image. The control module 24 may, by sending a monitoring terminal message to the MCU indicating that the monitored terminal needs to be transcoded, to command the monitored terminal to perform a transcoding state, where the MCU receives the monitoring terminal message, and The monitored terminal performs capability negotiation, notifies the monitored terminal to perform a transcoding state, and reduces the video format of the transmitted image from HD to SD. FIG. 3 is a schematic structural diagram of a multipoint control unit 2 according to an embodiment of the present invention. As shown in FIG. 3, the multipoint control unit 2 may include: a sending module 30, a receiving module 32, a notification module 34, and a packing module 36. The sending module 30 is configured to send the attribute information of the monitored terminal participating in the multipoint conference to the PC console 4, and the receiving module 32 is configured to receive the monitoring command sent by the PC console 4, where the monitoring command is Indication The monitoring module needs to perform transcoding; the notification module 34 is configured to perform capability exchange with the monitored terminal, notify the monitored terminal to enter a transcoding state, and send an image in a standard video format; the packaging module 36 is set to The coded stream sent by the monitored terminal in the standard video format is packaged and sent to the PC console. In a preferred embodiment of the present invention, as shown in FIG. 4, the multipoint control unit 2 may further include a monitoring module 38 configured to monitor whether the monitored terminal is converted to a broadcaster or broadcaster of the current conference. If it is, the notification module 34 is triggered to perform capability exchange with the monitored terminal, and the monitored terminal is notified to exit the transcoding state, and the image is transmitted in a high-definition video format. Thereby the video capability of the video conference can be guaranteed. Preferably, the monitoring module 38 may also trigger the sending module 30 when the monitored terminal is turned into the broadcaster or the broadcaster of the current conference, and the sending module 30, under the trigger of the monitoring module 38, Sending, by the monitored terminal, the current attribute information of the terminal that is viewed by the broadcaster or the broadcaster before the monitored terminal is converted to the broadcaster or the broadcaster of the current conference, to the PC console 4, so that The PC console further describes attribute information of the monitored terminal and the terminal that is viewed by the broadcaster or the broadcaster before the monitored terminal is turned into the broadcaster or broadcaster of the current conference. In another preferred embodiment of the present invention, the receiving module 32 is further configured to receive a stop monitoring command from the PC console 4, the stop monitoring command instructing to stop monitoring the monitored terminal; As shown in FIG. 5, the multipoint control unit 2 may further include: a determining module 50, configured to determine whether the monitored terminal is in a transcoding state, and if so, triggering the notification module 34 to perform the capability with the monitored terminal. Interacting, notifying the monitored terminal to exit the transcoding state, and transmitting the image in a high-definition video format. Therefore, it can be ensured that the monitored terminal can work in a high-definition video format. 6 is a flowchart of a video monitoring method of a terminal of a conference television system according to an embodiment of the present invention, which may be implemented by the system or apparatus of FIGS. 1 to 5 described above. As shown in FIG. 6, the method mainly includes the following steps: Step S602: After the multipoint conference is successfully held, the PC console receives the attribute information of the monitored terminal that is sent by the multipoint control unit MCU to participate in the conference; after the conference is successfully held, The MCU reports the attribute information of the terminal participating in the current conference to the PC console through the terminal detailed information, where the attribute information of the terminal includes but is not limited to: the terminal name, the type of the terminal video protocol, and whether the terminal is the broadcaster and the broadcast of the current conference. In addition, the attribute information of the terminal reported by the MCU may further include: a terminal connection status and a terminal audio protocol type. Step S604, the PC console determines, according to the attribute information of the monitored terminal, that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not viewed by a broadcaster or broadcaster of the current conference. end;

The PC console updates the status of each terminal on the console interface according to the attribute information of each terminal reported by the MCU. When it is required to perform a monitoring operation on a PC console for a certain terminal (referred to as a monitored terminal in the embodiment of the present invention), the PC console sends a monitoring terminal message to the MCU, if the PC console according to the attribute information of the monitored terminal Determining that the video format used by the monitored terminal to transmit the image is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference, the PC console determines that the monitored terminal needs to be transcoded, and the monitoring is performed. The terminal message indicates that the monitored terminal needs to be transcoded. Step S606, the PC console commands the monitored terminal to enter a transcoding state by the MCU, and sends an image in a standard video format. For example, the PC console may send a monitoring terminal to the MCU indicating that the monitored terminal needs to be transcoded. After receiving the monitoring terminal message, the MCU learns that the monitored terminal needs to perform transcoding, and performs capability exchange with the monitored terminal to notify the monitored terminal to transcode the transmitted image, so that the monitored terminal performs the transcoding state. Send images in standard definition video format. Preferably, in order to improve the user experience, the monitored terminal may also determine whether to accept the transcoding command of the PC console according to the setting of the user. In this case, the MCU may report the monitored terminal to the PC console by monitoring the status return message. Whether to accept the transcoding command. The PC console updates the monitoring information of the monitoring terminal according to the monitoring status reported by the MCU. When monitoring a certain HD terminal, the MCU needs to know whether the terminal needs to be transcoded according to the command of the PC console. For the terminal that needs to be transcoded, the MCU re-interacts with the terminal according to the capability required by the PC console. The monitored terminal is notified to transcode the image into an asymmetric mode, and the code stream is sent to the MCU with a new video capability; for the terminal that does not need to be transcoded, the MCU does not perform special operations. Step S608, the monitored terminal converts the video format of the image sent by the monitored terminal into standard definition, and sends the converted image to the PC console via the MCU; if the monitored terminal receives the transcoding command of the PC console , the code stream is sent by the new video capability (that is, the image is sent in the standard definition video format) to the MCU, and the MCU packages the audio and video code streams sent by the monitored terminal, and sends the UDP packet of the media to the PC console. . Step S610, the PC console decodes and displays the received image. The PC console receives the code stream sent by the MCU, and decodes and displays the code stream according to the audio protocol type of the terminal, the type of the video protocol, and whether the code is transcoded. During the multipoint conference, usually only the images of the two terminals of the broadcaster terminal and the broadcaster are used, and the images of other terminals at the conference are not used for the multipoint conference. Through the above method provided by the embodiment of the present invention, the PC console communicates with the MCU, and the MCU re-interacts with the monitored terminal except the broadcaster and the broadcaster according to the command of the PC console, so that the terminals can The transmitted video format is reduced from HD to SD. Under the premise of ensuring image quality, the terminal maximizes the ability of the PC console to decode the image, thus reducing the decoding requirements of the PC console. In a preferred embodiment of the embodiment of the present invention, the PC console may stop monitoring the monitored terminal. In this case, the PC console may send a stop monitoring message to the MCU, and stop receiving the monitored terminal. Code stream. After receiving the stop monitoring message, the MCU judges that if the monitored terminal is currently in the transcoding state, the MCU re-instructs the terminal to resume the non-transcoding mode by means of capability interaction. When the monitored high-definition terminal (that is, the above-mentioned monitored terminal) is in the transcoding state, in the multi-point conference, the monitored terminal end may dynamically become the broadcaster or the broadcaster's end, in the embodiment of the present invention. In another preferred embodiment, the MCU re-interacts with the monitored terminal to enter a symmetrical state (ie, exits the transcoding state), and the monitored terminal transmits the image in a high-definition video format. At the same time, the information that the monitored terminal becomes the broadcaster or the broadcaster is sent to the PC console, and the PC console immediately decodes and displays it in the high-definition video protocol. In order to further understand the technical solution provided by the embodiment of the present invention, the networking mode of remote monitoring of the PC console of the conference television multipoint conference shown in FIG. 7 is taken as an example for description. The devices in the multipoint conference in FIG. 7 respectively have an MCU, a terminal T1 based on the H.323 protocol, and a terminal T2 and Τ3 based on the H.320 protocol, wherein the IP communication mode is adopted between the T1 and the MCU, T2, Τ3 and E1/4E1 line communication mode is adopted between MCUs. The PC console is installed on a PC and uses IP communication with the MCU. FIG. 8 is a signaling flowchart of monitoring a high definition terminal by a PC console according to an embodiment of the present invention. When the video capability of the monitored terminal is high-definition, and it is not the broadcaster or broadcaster of the current conference, the PC console has the right to transcode the terminal through the MCU. As for whether to transcode, in order to improve the user experience, it can be determined according to the specific needs of the user. Generally speaking, the quality of the image is not very high when the PC console monitors the terminal. At this time, the user can select the above. The terminal performs transcoding monitoring. When the user has strict requirements on the monitoring image quality of certain specific terminals, the user can select the non-transcoding monitoring operation. As shown in FIG. 8 , the PC console monitors the HD terminal mainly includes the following steps: Step S801: After the conference is successfully held, the MCU reports the attribute information of each terminal participating in the current conference to the PC console through the terminal detailed information, where Including, but not limited to, the terminal name, the terminal connection status, the terminal audio protocol type, the terminal video protocol type, whether the terminal is the broadcaster of the current conference, and the broadcaster's end; in step S802, the PC console updates according to the terminal information reported by the MCU. The status of each terminal on the console interface; Step S803, when a certain terminal needs to perform monitoring operation on the PC console, the PC console sends a monitoring terminal message to the MCU; Step S804, the MCU re-requires according to the capability required by the PC console Performing a capability exchange with the terminal, informing the terminal to transcode the image into an asymmetric mode;

After receiving the above monitoring terminal message, the MCU according to the PC console indicates whether the terminal needs to be transcoded for different processing: When no transcoding is needed, the MCU directly performs RTP packing of the audio and video code streams of the corresponding terminal, and monitors The IP address and port in the terminal message (the port address assigned by the PC console for this terminal) sends the UDP packet of the media and reports the monitoring status return message at the same time; when the transcoding is required, the MCU needs the capability according to the PC console. The capability exchange is performed with the terminal, and the terminal is notified to transcode the image to enter the asymmetric mode. In the embodiment of the present invention, the need for transcoding is taken as an example for description. Step S805, the terminal sends an acknowledgement message to the MCU, informing the MCU terminal that the image can be sent in a new video format. In an actual application, the terminal may not accept the transcoding command of the PC console, and the terminal notifies the MCU not to perform transcoding, Send images in HD video format. Step S806, the MCU reports to the PC console whether the terminal accepts the transcoding command by using the monitoring status return message. Step S807, the PC console updates the monitoring status of the terminal on the PC console according to the monitoring status return message; Step S808, the terminal uses a new The video capability sends the code stream to the MCU; in step S809, the MCU directly performs the RTP packetization of the audio and video code streams of the corresponding terminal, and sends the UDP packet of the media to the PC console; in step S810, the PC console receives the code stream, and according to The audio protocol type of the terminal, the type of the video protocol, and whether the transcoding decodes and displays the code stream; Step S811, when the PC console needs to stop monitoring the terminal, click the stop monitoring button after the corresponding terminal on the PC console, and the PC console sends a stop monitoring message to the MCU, and stops receiving the code stream for the terminal; Step S812, MCU After receiving the stop monitoring message, it is judged that if the end is in the transcoding state, the MCU re-instructs the terminal to resume the non-transcoding mode by means of capability interaction; step S813, the terminal sends an acknowledgement message to the MCU to inform the MCU. The terminal will work in a symmetrical way. FIG. 9 is a flow chart of control signaling of an MCU to a monitored HD terminal in a multipoint conference. As shown in FIG. 9, when the terminal entering the transcoding state is changed to the end of the broadcaster or the broadcaster, the MCU actively controlling the terminal mainly includes the following steps: Step S901: When T1 is in the transcoding state, During the multi-point conference, the MCU learns that the T1 dynamic becomes a broadcaster (or the broadcaster's end); in step S902, the MCU reports the original broadcaster T2 and the new broadcaster T1 to the PC console. Step S903, the PC console updates the status of the terminals T1 and T2, decodes and displays the video code stream of the T1 according to the original high-definition video capability of the T1, and the transcoding button of the T2 terminal becomes enabled, and the user can The T2 needs to perform the transcoding operation. In step S904, the step can be performed simultaneously with the step S902. The MCU enters the symmetric mode in the form of re-capability exchange, and does not perform transcoding, thereby avoiding the entire conference video capability along with the T1 video. The capability is decreased. Step S905: T1 sends an acknowledgement message to the MCU, indicating that T1 enters a symmetric working state of non-transcoding, that is, T1 sends an image in a high-definition video format; Step S906 The MCU reports the status of the T1 to the PC console through the monitoring status. In step S907, the PC console updates the monitoring status of the T1. If the T1 returns successfully, the PC console continues to receive, decode, and display according to the HD video format. Image; If the return is a failure, the PC console stops monitoring the terminal and prompts the corresponding information on the decoding. Step S908, T1 sends an image of a high-definition video format to the MCU; Step S909, the MCU performs RTP packaging on the audio and video code streams of the terminal, and sends the UDP packets of the media to the PC console. From the above description, it can be seen that the technical solution provided by the embodiment of the present invention solves the problem that the decoding capability of the PC is insufficient when the PC console is remotely monitored for the multi-channel high-definition video terminal in the prior art. Moreover, in the technical solution provided by the embodiment of the present invention, only a small amount of modification is needed in the existing solution, and the technical implementation is simple. Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device so that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claim

A video surveillance method for a terminal of a conference television system, comprising:

After the multipoint conference is successfully held, the PC console receives the attribute information of the monitored terminal that participates in the conference sent by the multipoint control unit MCU;

The PC console determines, according to the attribute information of the monitored terminal, that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference;

The PC console commands the monitored terminal to enter a transcoding state by the MCU, and sends an image in a standard video format;

The monitored terminal converts the video format of the image sent by the monitored terminal into standard definition, and sends the converted image to the PC console via the MCU;

The PC console decodes and displays the received image.

2. The method according to claim 1, wherein the PC console instructing the monitored terminal to enter a transcoding state by using the MCU comprises:

Sending, by the PC console, a monitoring message to the MCU, indicating that the monitored terminal needs to be transcoded; the MCU and the monitored terminal perform capability exchange, and notify the monitored terminal to send an image in a standard definition video format. .

The method according to claim 1 or 2, wherein after the PC console commands the monitored terminal to enter a transcoding state by using the MCU, the method further includes:

The MCU learns that the monitored terminal is turned into a broadcaster or broadcaster of the current conference.

3⁄4 ;

The MCU performs capability exchange with the monitored terminal, notifying the monitored terminal to exit the transcoding state, and transmitting the image in a high-definition video format.

The method according to claim 3, wherein, after the MCU learns that the monitored terminal is converted to the broadcaster or the broadcaster of the current conference, the method further includes: Transmitting, by the MCU, the monitored terminal and the monitored terminal to the PC console, the current attribute information of the terminal viewed by the broadcaster or the broadcaster before the broadcaster or the broadcaster of the current conference ;

The PC console updates the attribute information of the monitored terminal and the monitored terminal to be the terminal of the terminal that the broadcaster or the broadcaster is watching before the broadcaster or the broadcaster of the current conference.

The method according to claim 1, wherein the method further comprises:

Sending, by the PC console, a stop monitoring command to the MCU, indicating to stop monitoring the monitored terminal;

The MCU determines whether the monitored terminal is in a transcoding state, and if so, performs capability interaction with the monitored terminal, notifying the monitored terminal to exit the transcoding state, and transmitting the image in a high-definition video format.

The method according to any one of claims 1 to 2, wherein the attribute information comprises: a video protocol type used by the currently transmitted image, whether it is a broadcaster or a broadcaster of the current conference, And the name.

7. A video surveillance system for a terminal of a conference television system, comprising:

a multi-point control unit, configured to send attribute information of the monitored terminal participating in the multi-point conference to the PC console;

The PC console is configured to determine, according to the attribute information of the monitored terminal, that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not viewed by a broadcaster or broadcaster of the current conference. End, the multi-point control unit commands the monitored terminal to enter a transcoding state, and sends an image in a standard video format.

8. The system according to claim 7, wherein the multipoint control unit is further configured to, when learning that the monitored terminal is turned into a broadcaster or a broadcaster of the current conference, with the monitored terminal The capability exchange is performed, and the monitored terminal is notified to exit the transcoding state, and the image is sent in a high-definition video format.

9. The system according to claim 7 or 8, wherein

The PC console is further configured to send a stop monitoring command to the multipoint control unit, to instruct to stop monitoring the monitored terminal; The multi-point control unit is further configured to: after receiving the stop monitoring command, determine whether the monitored terminal is in a transcoding state, and if yes, notify the monitored terminal to exit the transcoding state, in a high-definition video. Format the image.

10. A PC console that includes:

a receiving module, configured to receive attribute information of the monitored terminal that participates in the multipoint conference sent by the MCU;

The determining module is configured to determine, according to the attribute information of the monitored terminal, that the video format of the currently transmitted image of the monitored terminal is high-definition, and the monitored terminal is not the broadcaster or the broadcaster of the current conference;

a control module, configured to: the MCU commands the monitored terminal to perform a transcoding state, and sends an image in a standardized video format;

a decoding module, configured to decode an image sent by the monitored terminal by the MCU in a standard definition video format;

A display module configured to display the decoded image.

11. A multipoint control unit comprising:

a sending module, configured to send, to the PC console, attribute information of the monitored terminal participating in the multipoint conference;

a receiving module, configured to receive a monitoring command sent by the PC console, where the monitoring command indicates that the monitored terminal needs to be transcoded;

The notification module is configured to perform capability exchange with the monitored terminal, notify the monitored terminal to enter a transcoding state, and send an image in a standard video format;

The packaging module is configured to packetize the code stream sent by the monitored terminal in the standard video format, and send the code stream to the PC console.

12. The multipoint control unit of claim 11, further comprising:

a monitoring module, configured to monitor whether the monitored terminal is turned into a broadcaster or a broadcaster of the current conference, and if so, triggering the notification module to perform capability exchange with the monitored terminal, and notifying the monitored terminal Exit the transcoding status and send the image in HD video format.

13. The multipoint control unit of claim 12, wherein the transmitting module is further configured to convert the monitored terminal and before the monitored terminal is turned into a broadcaster or broadcaster of the current conference The current attribute information of the terminal as the broadcaster or the broadcaster is watching is transmitted to the PC console.

14. The multipoint control unit according to claim 11, wherein

The receiving module is further configured to receive a stop monitoring command from the PC console, the stop monitoring command instructing to stop monitoring the monitored terminal;

The multi-point control unit further includes: a judging module, configured to determine whether the monitored terminal is in a transcoding state, and if yes, triggering the notification module to perform capability interaction with the monitored terminal to notify the monitored The terminal exits the transcoding state and sends the image in HD video format.