WO2011134224A1

WO2011134224A1 - Video processing method and system thereof, multipoint control unit (mcu) video processing unit

Info

Publication number: WO2011134224A1
Application number: PCT/CN2010/076995
Authority: WO
Inventors: 张中华; 陈涛; 李文; 刘克华; 刘书好
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-04-29
Filing date: 2010-09-16
Publication date: 2011-11-03
Also published as: CN101860714A; CN101860714B

Abstract

An MCU video processing unit is provided by the present invention, which includes: a simply-code subunit, which is set for simply-compressing and coding the baseband video stream waiting for transmission, then obtaining the simply-compressed baseband video stream and outputting it; a baseband video stream output interface, which is set for sending the simply-compressed baseband video stream outputted by the simply-code subunit to a baseband video stream centralized exchange unit; a baseband video stream input interface, which is set for obtaining the simply-compressed baseband video stream from the baseband video stream centralized exchange unit; a simply-decode subunit, which is set for simply-decoding the simply-compressed baseband video stream obtained from the baseband video stream input interface. The present invention also provides a video processing method using the above MCU video processing unit and a video processing system. The present invention reduces the consumption of the capability processing resource, and increases the utilization ratio of the capability processing resource.

Description

Video processing method and system thereof, MCU video processing unit

TECHNICAL FIELD The present invention relates to the field of multimedia communications, and in particular, to a multipoint control unit

(Multipoint Control Unit, MCU) video processing method, a video processing system applied to an MCU, and an MCU video processing unit.

Background technique

Currently, video conferencing systems are mainly used for teleconferencing, multipoint conferencing, and real-time conferencing. In realizing multipoint conferences, video data and audio data need to be transmitted and exchanged in real time. The multipoint conference system mainly includes a terminal and an MCU. In a small video conference system, the video conference system is mainly connected to the same MCU by a plurality of terminals to form a star topology network. The terminal is a client device, and is equipped with multimedia components such as a display, a camera, a speaker, and a microphone. The MCU is a system-side device, and is mainly used for centrally exchanging and processing multimedia information of each terminal connected thereto. Taking a video conference system as shown in FIG. 1 as an example, a method of video processing in the prior art will be described. FIG. 1 is a schematic diagram of video communication of a specific video conference system in the prior art. The video conference system is composed of a terminal 1, a terminal 2, and an MCU video processing unit MCU3, and the two terminals are connected to the MCU3. The terminal 1 and the terminal 2 can exchange video data through the MCU 3. The terminal 1 includes an encoder 11, a decoder 12, a camera 13 and a display 14. The terminal 2 includes an encoder 21, a decoder 22, a camera 23 and a display 24. The MCU 3 includes The first decoder 31, the first encoder 32, the second decoder 33, and the second encoder 34. For a clearer and more detailed description of the manner in which the video is processed in the prior art, it is assumed that the terminal 1 is a source terminal, the terminal 2 is a target terminal, and the terminal 1 transmits video data to the terminal 2 as an example for detailed description. When the terminal 1 transmits video data to the terminal 2, the following steps are included: Step 1: The terminal 1 receives the video data sent by the camera 13, and the video data is called a baseband video stream. In general, the baseband video stream has a large amount of data, such as a high-definition video format 1080P30 (4:2:0) baseband video stream data volume of 752 megabits per second (Mbps), if the baseband video stream is not compressed Processing directly through the network will take up a lot of network bandwidth.

Step 2: The terminal 1 compresses and encodes the received baseband video stream by using the encoder 11 to obtain a compressed video stream, and the rate and encoding format used for compressing and encoding the baseband video stream are the rates and encoding formats supported by the terminal 1. And send the compressed video stream to MCU3. The compressed video stream obtained after compression encoding has a much smaller data volume than the baseband video stream. For example, the compressed video stream of the HDP format 1080P30 (4:2:0) has a data volume lower than 8 Mbps; the compressed video stream is mainly Used for network transmission to reduce the network bandwidth occupied during transmission. The compressed video stream cannot perform operations such as video processing and display. Only the baseband video stream obtained after decompressing the compressed video stream can perform operations such as video processing and display. Step 3: The MCU 3 decompresses the received compressed video stream by using the first decoder 31 and the rate and encoding format supported by the terminal 1 to obtain a baseband video stream; and performing corresponding video processing on the baseband video stream; And, after the video processing ends, the processed baseband video stream is compression-encoded by the first encoder 32 using the rate and encoding format supported by the terminal 2, and the compressed video stream is obtained and transmitted to the terminal 2. Step 4: The terminal 2 decompresses the received compressed video stream by using the decoder 22, using the rate and encoding format supported by the terminal 2 to obtain a baseband video stream, and displays the baseband video stream in the display 24. For the same reason, the process of the terminal 2 transmitting the video data to the terminal 1 is similar to the process of the terminal 1 transmitting the video data to the terminal 2, and details are not described herein again. It can be seen from the video data flow between the terminal 1 and the terminal 2 that the transmission rate used by each terminal is different under different network conditions, and the video formats used by different terminals of the multimedia component (including the baseband video format and the compressed video format) are also different. Therefore, using this video processing method, the MCU video processing needs to meet two basic requirements: 1. Perform rate matching so that video data can be exchanged between terminals with different transmission rates; 2. Perform video format matching. To visualize Video data can be exchanged between terminals with different frequency formats. At present, people also need to perform multi-picture synthesis processing on video processing functions. Therefore, MCU video processing needs to meet the third basic requirement: For example, the display screen of a certain terminal is divided into two screens, and the display terminal 1 is transmitted separately. The video data and the video data transmitted by the terminal 2 are two screens, and the multi-channel picture (hereinafter referred to as a multi-picture video stream) can also be displayed on the display of the terminal as needed. At present, due to the demand for personalization and large capacity, two major requirements are placed on the video processing technology of the MCU: 1. The video processing function can be flexibly implemented, such as the Universal Port (UP) function, that is, each terminal participating in the video conference. You can freely choose different video formats and transmission rates, multi-picture number and form, and video content. Second, video processing capacity can be linearly extended. The so-called linear expansion usually means that the system structure is unchanged and the system size and complexity only follow the unit module. The increase is linear and increases, so that the system capacity can be easily expanded. The steps of implementing the rate matching or the format matching function are: first decoding the compressed video stream coming from the source terminal according to its rate and format definition, obtaining a baseband video stream, and then encoding according to the rate and format requirements of the destination terminal to obtain a compressed video stream. Then sent to the destination terminal. The steps of implementing the multi-picture function are: first decoding the compressed video stream from multiple source terminals, obtaining a plurality of baseband video streams, and then performing scaling to obtain a plurality of small-screen video streams, and then synthesizing the plurality of small-screen video streams. A normal-sized picture video stream is then compressed to obtain a compressed video stream and sent to the destination terminal. It can be seen that the steps of implementing the video processing function can be decomposed into four: one, decoding, two, encoding, three, scaling, four, synthesis. The three basic functions of video processing can be combined by these four steps. The four steps of video processing, usually performed on various processor chips, require a lot of processor power resources, but the processor power resources consumed by each step are still different, which is related to its algorithm complexity. For example, HD video format 1080P30 (4:2:0), its encoding: decoding: scaling: the ratio of the combined processing power resources is 32: 8: 1: 1. The above steps are typically performed on a variety of processor chips and require a significant amount of processor power resources. Since both the terminal and the MCU need to encode and/or decode the video data, it takes a long time and introduces a large delay (this is a time-space-changing method, that is, increasing the transmission processing. Time, reduce transmission bandwidth space), reducing the real-time performance of video transmission. 2 is a schematic structural diagram of a prior art MCU video processing unit. The MCU video processing unit includes: a compressed video stream input interface 201, a compressed video stream output interface 202, and decoding. Subunit 203, encoding subunit 204, scaling subunit 205, and synthesizing subunit 206. As shown in FIG. 3, each MCU video processing unit includes a compressed video stream input interface and a compressed video stream output interface, and the plurality of MCU video processing units are collectively connected to the compression through respective compressed video stream input interfaces and output interfaces. The video stream is centralized on the switching unit to form a star topology network, which facilitates exchange of compressed video streams between each MCU video processing unit and other MCU video processing units or other functional units. The existing video transmission methods have the following technical defects: The baseband video stream cannot be directly exchanged between the MCU video processing units, and the baseband video stream is exchanged between the subunits in the MCU video processing unit, and each MCU video processing The unit can only exchange compressed video streams but not baseband video streams by compressing video stream centralized switching units. When multiple MCU video processing units require video data sent by the same terminal, the compressed video stream sent by the terminal needs to be obtained from the compressed video stream centralized switching unit, and the compressed video stream is decompressed and encoded to obtain a baseband video stream. . Since each MCU video processing unit needs to perform the step of decompressing encoding, the processing power resource consumed is large. For example, 20 MCU video processing units are collectively connected to the compressed video centralized switching unit. When each MCU video processing unit needs the video data of the terminal 1, it is obtained from the compressed video stream centralized switching unit for each MCU video processing unit. The compressed video stream of the terminal 1 is decompressed and encoded, and then sent to each subunit of the MCU video processing unit, which is equivalent to the same compression required by each MCU video processing unit. The video stream is decompressed and encoded, and the compressed video stream of the same terminal is decompressed and encoded 20 times. Since the processing power for decompressing and encoding the compressed video stream is large, it may cause a limited processing power resource. Other features are not possible.

SUMMARY OF THE INVENTION The present invention provides a video processing method and system thereof, and an MCU video processing unit, to implement baseband video stream exchange between different MCU video processing units, reduce capability processing resource consumption, and improve capability processing resources. Utilization rate. A multi-point control unit MCU video processing unit, comprising: a shallow coding subunit, a baseband view The frequency stream output interface, the baseband video stream input interface and the shallow decoding subunit, wherein: the shallow coding subunit is set to: shallow compression coding of the baseband video stream to be transmitted, obtaining a shallow compressed baseband video stream and outputting; baseband video stream output interface setting And: transmitting the shallow compressed baseband video stream output by the shallow coding subunit to the baseband video stream centralized switching unit; the baseband video stream input interface is configured to: obtain the shallow compressed baseband video from the shallow compressed baseband video stream centralized switching unit The shallow decoding subunit is configured to: perform shallow decoding on the shallow compressed baseband video stream obtained by the baseband video stream input interface.

The shallow coding sub-unit performs shallow compression coding on the transmission baseband video stream, obtains a shallow compressed baseband video stream and outputs the same to the baseband video stream output interface; and the baseband video stream output interface outputs the shallow compression baseband video of the shallow coding subunit The stream is sent to the baseband video stream centralized switching unit. The baseband video stream input interface obtains a shallow compressed video stream from the baseband video stream centralized switching unit, and outputs the shallow compressed video stream to the shallow decoding subunit; and the shallow decoding subunit performs shallow shallow compression video stream output by the baseband video stream input interface. Decode to obtain a baseband video stream. A video processing system, comprising: a baseband video stream centralized switching unit, and a plurality of multi-point control unit MCU video processing units collectively connected to the baseband video stream centralized switching unit, wherein: the baseband video stream centralized switching unit is set to : receiving and forwarding the shallow compressed baseband video stream sent by the multiple MCU video processing units;

The MCU video processing unit is configured to: perform shallow compression encoding on the transmission baseband video stream, obtain a shallow compressed baseband video stream, and send the shallow compressed baseband video stream to the baseband video stream centralized switching unit; and, from the baseband video The shallow compressed baseband video stream is obtained by the stream centralized switching unit, and the shallow compressed baseband video stream is shallowly decoded to obtain a baseband video stream. In the embodiment of the present invention, the MCU video processing unit performs shallow compression encoding on the transmission baseband video stream to obtain a shallow compressed baseband video stream, and sends the shallow compressed baseband video stream to the baseband video stream set connected to the MCU video processing unit. The switching unit: the MCU video processing unit obtains the shallow compressed baseband video stream from the baseband video stream centralized switching unit, and performs shallow decoding on the shallow compressed baseband video stream. According to the technical solution of the present invention, the shallow compressed video stream obtained by the MCU video processing unit after performing shallow compression coding on the baseband video stream is sent to the baseband video stream centralized switching unit, so that other MCU video processing units are from the baseband video stream switching unit. After obtaining the shallow compressed baseband video stream and performing shallow decoding, the baseband video stream can be obtained, thereby implementing the MCU video processing unit to implement baseband video stream exchange; and in the prior art, the MCU video processing unit is to transmit the baseband video stream. Performing compression coding to obtain a compressed video stream, and transmitting the compressed video stream to a compressed video stream centralized switching unit, for other MCU video processing units to acquire the compressed video stream, and decoding the compressed video stream to obtain a baseband to be transmitted. Compared with the video stream, the technical solution of the present invention reduces the consumption of the capability processing resources and improves the utilization rate of the capability processing resources.

1 is a schematic diagram of video communication of a video conference system in the prior art; FIG. 2 is a schematic structural diagram of a video processing unit of an MCU in the prior art;

4 is a schematic structural diagram of an MCU video processing unit according to an embodiment of the present invention;

6a is a flowchart of implementing exchange of compressed video streams between MCU video processing units according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of implementing a video conference system according to an embodiment of the present invention; FIG. 8 is a flowchart of exchanging baseband video streams between MCU video processing units by using the system shown in FIG. 7 according to an embodiment of the present invention. The preferred embodiment of the present invention is to solve the technical problem in the prior art. The embodiment of the present invention provides a video processing method and an apparatus thereof. The video processing method is mainly as follows: multiple MCU video processing units are connected in a baseband. a video stream centralized switching unit, the baseband video stream centralized switching unit is configured to receive and forward the baseband video stream sent by the multiple MCU video processing units; and the MCU video processing unit converts the baseband video stream to be transmitted into the multiple MCU video processing. The unit supports the supported transmission rate and video format, and sends the format converted baseband video stream to the baseband video stream centralized switching unit for other MCU video processing units or other functional units to obtain from the baseband video stream centralized switching unit. The baseband video stream. Preferably, the bandwidth of transmission and exchange of some systems may not be sufficient in practical applications. Therefore, in order to ensure reliable transmission of the baseband video stream, in the technical solution of the present invention, the MCU video processing unit performs shallow compression encoding on the transmission baseband video stream, obtains a shallow compressed baseband video stream, and sends the shallow compressed baseband video stream to the The baseband video stream centralized switching unit connected to the MCU video processing unit, for other MCU video processing units to obtain the shallow compressed baseband video stream from the baseband video stream centralized switching unit; when the MCU video processing unit needs the baseband video stream, the baseband The video stream centralized switching unit obtains the shallow compressed baseband video stream, and performs shallow decoding on the shallow compressed baseband video stream to obtain a baseband video stream. According to the technical solution of the present invention, when multiple MCU video processing units require the same baseband video stream, only a shallow decoding operation of the shallow compressed video stream is required, and multiple MCU video processing units are required in the prior art. When the same baseband video stream is required to perform multiple decoding operations on the same compressed video stream, the consumption of the capability processing resources is reduced, and the utilization of the capability processing resources is improved. First, the technical terms related to the present invention will be explained. A shallow compression codec algorithm is a codec algorithm obtained by simplifying a common compression codec algorithm (such as H.263 or H.264). The shallow compression codec algorithm must satisfy the amount of compressed data and introduce The encoding delay requirement, such as: Shallow compression encoding of a high-definition video stream of the format 1080P30 (4:2:0) requires that the amount of compressed data be reduced to less than 12 Mbps, and the introduction of the encoding delay is less than or equal to 30 milliseconds. The shallow compressed baseband video stream is a baseband video stream obtained by compressing and encoding the baseband video stream by using the above-mentioned shallow compression codec algorithm, and the data amount of the shallow compressed baseband video stream is shallower than that of the baseband video stream. The amount of data is small, and the amount of data of the compressed video stream after normal compression is larger than that of the baseband video stream.

The MCU video processing unit is a functional unit for processing video in the MCU. The functional unit is a functional unit with appropriate granularity and capable of independently performing various forms of video processing functions, depending on the design requirements of different projects, according to the requirements of the MCU. The video processing unit needs to process the number of rate matching, the number of format matches, and the number of pictures to set the granularity of the MCU video processing unit. The compressed video stream centralized switching unit is configured to: receive and forward the compressed video stream uploaded by each MCU video processing unit; and send the compressed video stream to the MCU video processing unit that needs the compressed video stream. The baseband video stream centralized switching unit is configured to: receive and forward the shallow compressed baseband video stream uploaded by each MCU video processing unit; and send the shallow compressed baseband video stream to the MCU video processing unit that needs the shallow compressed baseband video stream. A plurality of MCU video processing units are collectively connected to the compressed video stream centralized switching unit and the baseband video stream centralized switching unit to form a star topology network; to achieve linear expansion of capacity, the plurality of MCU video processing units may constitute video processing. A single video board can form a video processing unit. Multiple video processing units can form a video processor. The above-mentioned baseband video stream centralized switching unit and the compressed video stream centralized switching unit are set to be applicable to switching units at all levels, and are suitable for interconnection between video processing boards, video processing units, and video processing machines, for better interconnection. Achieve linear expansion of capacity. The technical solution of the present invention will be described in detail below with reference to the accompanying drawings. 4 is a schematic structural diagram of an MCU video processing unit according to an embodiment of the present invention. The MCU video processing unit is improved on an existing MCU video processing unit, and a baseband video stream is added to the MCU video processing unit 4. Output interface 42, shallow coding sub-unit 48, baseband video stream input interface 43 and shallow decoding sub-unit 49. The MCU video processing unit 4 further includes a scaling subunit 46, a synthesizing subunit 47, a compressed video stream input interface 40, and a compressed video stream output interface. 41. Decoding subunit 44 and encoding subunit 45. The MCU video processing unit 4 is configured to: send the shallow compressed baseband video stream to the baseband video stream centralized switching unit through the baseband video stream output interface 42 for other MCU video processing units or other functional units to exchange the unit from the baseband video stream. Obtaining the shallow compressed baseband video stream; acquiring, by the baseband video stream input interface 43 from the baseband video stream centralized switching unit, the shallow compressed baseband video stream sent by another MCU video processing unit or other functional unit; by compressing the video stream input interface 40 from Acquiring a compressed video stream sent by another MCU video processing unit or other functional unit in the compressed video stream centralized switching unit; sending the compressed video stream to the compressed video stream centralized switching unit through the compressed video stream output interface 41 for other MCU video processing units Or other functional unit obtains the compressed video stream from the compressed video stream centralized switching unit. The decoding sub-unit 44 is configured to: decompress and encode the compressed video stream obtained by the compressed video stream input interface 40 to obtain a baseband video stream. The encoding sub-unit 45 is configured to compress-encode the baseband video stream to be obtained to obtain a compressed video stream, and send the compressed video stream to the compressed video stream centralized switching unit through the compressed video stream output interface 41. The shallow coding sub-unit 48 is configured to: use a shallow compression codec algorithm to perform shallow compression coding on the baseband video stream to obtain a shallow compressed baseband video stream, and send the shallow compressed baseband video stream to the baseband through the baseband video stream output interface 42. Video stream centralized switching unit. The shallow decoding sub-unit 49 is configured to: use a shallow compression codec algorithm to perform shallow decoding on the shallow compressed baseband video stream obtained by the baseband video stream input interface 43 to obtain a baseband video stream. The scaling sub-unit 46 is configured to: perform a scaling process on the baseband video stream to be transmitted before the shallow encoding sub-unit 48 performs shallow compression encoding on the video stream to be transmitted, to obtain a small-screen baseband video stream of a set size, and The picture baseband video stream is sent to the shallow coding subunit 48, and the size of the small picture baseband video stream is determined according to the number and form of pictures set by the user terminal. The scaling sub-unit 46 may be further configured to: perform a scaling process on the baseband video stream output by the decoding sub-unit 44 to obtain a small-screen baseband video stream of a size setting; or may be configured to: shallowly decode the shallow decoding sub-unit 49 to obtain a baseband video stream. The scaling process is performed to obtain a small-screen baseband video stream of a size setting. The synthesizing sub-unit 47 is configured to acquire a plurality of small-screen baseband video streams from the scaling sub-unit 46 or the shallow decoding sub-unit 49, and synthesize the plurality of small-screen baseband video streams to obtain a baseband video stream and transmit the same. The shallow compression codec algorithm used by the above-described shallow coding sub-unit 48 or shallow decoding sub-unit 49 can be obtained by simplifying the ordinary compression codec algorithm H.263 or H.264. 5 is a schematic structural diagram of interconnection of multiple MCU video processing units according to an embodiment of the present invention. In FIG. 5, multiple MCU video processing units are respectively connected to compression through respective compressed video stream input interfaces and compressed video stream output interfaces. The video stream is centralized on the switching unit to form a star topology network, which facilitates exchange of compressed video streams between each MCU video processing unit and other MCU video processing units or other functional units; and the plurality of MCU video processing units respectively pass The respective baseband video stream input interface and the baseband video stream output interface are collectively connected to the baseband video stream centralized switching unit to form a star topology network, which is convenient for each MCU video processing unit and other MCU video processing units or other functional units. Exchanging shallow compressed baseband video streams. The flow of compressed video stream exchange between the MCU video processing unit and other MCU video processing units or other functional units, and the flow of shallow compressed baseband video stream exchange are described in detail below through a plurality of flowcharts. 6a is a flowchart of exchanging compressed video streams between an MCU video processing unit and other MCU video processing units or other functional units according to an embodiment of the present invention, where the method includes the following steps: When the MCU video processing unit needs to acquire baseband video When streaming, the following steps 601 602 are performed; when the MCU video processing unit needs to send a baseband video stream, steps 603-604 are performed, so that other MCU video processing units or other functional units use the baseband video stream. Step 601: The MCU video processing unit acquires, by using the compressed video stream input interface, the compressed video stream sent by another MCU video processing unit or other functional unit from the compressed video stream centralized switching unit. Step 602: The MCU video processing unit decodes the obtained compressed video stream by using a decoding subunit to obtain a baseband video stream for use by each subunit in the MCU video processing unit. Step 603: The MCU video processing unit uses the encoding subunit to process the baseband video stream. Row compression coding yields a compressed video stream. Step 604: The MCU video processing unit sends the compressed video stream obtained in step 603 to the compressed video stream centralized switching unit by using the compressed video stream output interface, so that the other MCU video processing unit or other functional unit uses the compressed video stream. Referring to FIG. 6b, a flowchart of exchanging baseband video streams between MCU video processing units or between MCU video processing units and other functional units is performed according to an embodiment of the present invention, where the method includes the following steps: When the MCU video processing unit needs to be from other When the MCU video processing unit or other functional unit acquires the baseband video stream, steps 605-606 are performed; when the MCU video processing unit needs to send the baseband video stream for use by other MCU video processing units or other functional units, perform steps 607-608. Step 605: The MCU video processing unit acquires the shallow compressed baseband video stream sent by another MCU video processing unit or other functional unit from the baseband video stream centralized switching unit through the baseband video stream input interface. Step 606: The MCU video processing unit passes through Decoding the subunit, performing shallow decoding on the shallow compressed baseband video stream obtained in step 605 to obtain a baseband video stream, so that the subunits in the MCU video processing unit use the baseband video stream. Step 607: The MCU video processing unit passes the shallow coding sub- Unit, shallow compression of the baseband video stream to be transmitted The code obtains the shallow compressed baseband video stream. Step 608: The MCU video processing unit sends the shallow compressed baseband video stream obtained in step 607 to the baseband video stream centralized switching unit through the baseband video stream output interface, so as to enable other MCU video processing units or other functions. The unit uses the shallow compressed baseband video stream. Optionally, if the MCU video processing unit scales the baseband video stream sent by other functional units or the baseband video stream obtained from other MCU video processing units, the video is scaled to a small picture baseband video. When streaming, the flow shown in FIG. 6a and FIG. 6b further includes step 609: Step 609, the scaling subunit of the MCU video processing unit scales the baseband video stream into a small-size baseband video stream of a set size. Optionally, if the MCU processing sub-unit needs to perform a synthesis process on the plurality of small-screen baseband video streams obtained by the scaling sub-unit or the shallow decoding sub-unit, the step 609 further includes the following steps:

The element acquires a multi-channel small-picture baseband video stream, and synthesizes the multi-channel small-picture baseband video stream to obtain a multi-picture baseband video stream of a size setting. Preferably, if a plurality of MCU video processing units require the same content and the same number of multi-pictures, in order to improve the rate of acquiring the multi-picture baseband video stream, the step 610 further includes: Step 611: The MCU video processing unit is shallow The coding sub-unit performs shallow compression coding on the multi-picture baseband video stream obtained by the synthesis sub-unit to obtain a shallow compressed baseband video stream, and sends the shallow compressed baseband video stream to the baseband video stream centralized switching unit for other MCU video processing. Used by units or other functional units. Preferably, if multiple MCU video processing units need to acquire the baseband video stream sent by the same terminal, the baseband video stream sent by the terminal may be obtained by the following steps: Step 1. One of the multiple MCU video processing units An MCU video processing unit performs the above steps 601 602, and converts the compressed video stream sent by the terminal into a baseband video stream; the MCU video processing unit performs shallow compression coding on the baseband video stream to obtain a shallow compression by performing steps 607-608. Baseband video stream, and the shallow compressed baseband video stream is sent to the baseband video stream centralized switching unit; the other MCU video processing unit respectively obtains the shallow compressed baseband video stream from the baseband video stream centralized switching unit by performing the above steps 605 606 And shallow decoding the shallow compressed video stream to obtain a baseband video stream. Preferably, if a plurality of MCU video processing units need to obtain a reduced-picture baseband video stream of the same terminal, the reduced-picture baseband video stream of the terminal may be obtained by the following steps: Step 1. From the multiple MCU video processing units One of the MCU video processing units performs the above steps 601-602 to convert the compressed video stream sent by the terminal into a baseband video stream; the MCU video processing unit performs the above step 609 610 to scale the baseband video stream to a size setting. a small-size baseband video stream, and shallow-compressing the small-frame baseband video stream into a baseband video stream; the MCU video processing unit further transmitting the shallow compressed baseband video stream to the baseband video stream centralized switching unit by performing step 608 ; other MCU video processing units perform the above steps respectively 605-606: Acquire the shallow compressed baseband video stream from the baseband video stream centralized switching unit, and perform shallow decoding on the shallow compressed video stream to obtain a baseband video stream. The MCU video processing unit learns whether to acquire data from the compressed video stream centralized switching unit or the data control scheduling system from the baseband video stream centralized switching unit by controlling the scheduling system. In addition, the MCU video processing unit also controls how to control the scheduling. The system knows whether to obtain a small-screen baseband video stream, which is shallow-compressed into a baseband video stream or a multi-picture baseband video stream obtained by a synthesis sub-unit, to perform a shallow compression-encoded data stream. The control scheduling system knows which decoding, encoding, scaling, and synthesizing processing steps are required to hold a conference, and on the other hand, knows which processing capability resources (such as DSP resources) in the system can be used. According to the information of these two aspects, Develop data flow and processing routes, and schedule each MCU video processing unit to receive (resolve where data comes from), handle (solve how to deal with data), and send (resolve where data goes).

The embodiment of the present invention further provides a video processing system, where the system includes a baseband video stream centralized switching unit, and a plurality of MCU video processing units collectively connected to the baseband video stream centralized switching unit, where:

The baseband video stream centralized switching unit is configured to: receive and forward the shallow compressed baseband video stream sent by the multiple MCU video processing units;

The MCU video processing unit is configured to: perform shallow compression coding on the obtained baseband video stream to be obtained, obtain a shallow compressed baseband video stream, and send the shallow compressed baseband video stream to the baseband video stream centralized switching unit. Acquiring any one or more MCU video processing units of the plurality of MCU video processing units to obtain the shallow compressed baseband video stream from a baseband video stream centralized switching unit, and performing shallow decoding on the shallow compressed video stream to obtain the to-be-processed Transfer the baseband video stream. Preferably, in a practical application, the baseband video stream centralized switching unit and the compressed video stream centralized switching unit can be implemented by using a Gigabit Ethernet chip, that is, the baseband video stream centralized switching unit and the compressed video stream set in the embodiment of the present invention The switching unit is a Gigabit Ethernet chip. Preferably, the MCU video processing unit can be implemented by multiple DSP chips, and each DSP The chip comprises a video interface and a Gigabit Ethernet interface; the plurality of DSP chips are respectively connected to the Gigabit Ethernet chip through respective Gigabit Ethernet interfaces, and the plurality of DSP chips are connected end to end through a video interface, forming a chrysanthemum Chain shape. The implementation of the technical solution of the present invention will be described in detail below with reference to a specific application example. Each MCU video processing unit includes a plurality of DSP (Digital Signal Processing) chips. The processing capability and interface resources of different types of DSP chips are different. Therefore, those skilled in the art can determine the granularity of the MCU video processing unit. The MCU video processing unit is composed of a corresponding number and different types of DSP chips. The structure of the video processing system is described in detail in a specific example in the embodiment of the present invention. The structure of the system is as shown in FIG. 7. FIG. 7 is a schematic diagram of a specific structure of a video processing system according to an embodiment of the present invention. The video processing system includes a Gigabit Ethernet switching chip 71 and a plurality of MCU video processing units 72, wherein: a Gigabit Ethernet switching chip 71, It is used to implement the function of the centralized switching unit of the compressed video stream and the centralized switching unit of the baseband video stream.

The MCU video processing unit 72 is composed of four DSP chips (DSP1 chip, DSP2 chip, DSP3 chip, DSP4 chip), each DSP chip includes a Gigabit Ethernet interface and a video interface; DSP1 chip, DSP2 chip, DSP3 The chip and the DSP4 chip are sequentially connected through a video interface, and the video interfaces of the four DSP chips are connected end to end to form a daisy chain shape, and the baseband video stream is transmitted through the video interface to realize the transmission of the baseband video stream inside the video processing unit; the DSP1 chip and the DSP2 chip The DSP3 chip and the DSP4 chip are respectively connected to the Gigabit Ethernet switch chip through their respective Gigabit Ethernet interfaces to form a star topology network, and through the Gigabit Ethernet interface and other MCU video processing units or other functions. Units (such as network transceiver units) exchange compressed video streams and baseband video streams.

Each DSP chip in the MCU video processing unit 72 can implement the functions to be implemented by the decoding subunit, the encoding subunit, the scaling subunit, the synthesizing subunit, the shallow decoding subunit, and the shallow encoding subunit; the Gigabit Ethernet of the DSP chip The network interface can implement the functions of the aforementioned compressed video stream output/input interface and the baseband video stream output/input interface. The following is a detailed example of the video processing method of the system shown in FIG. description of. In this example, 20 terminals participate in the video conference, and each terminal has an UP function, that is, each terminal can be a high-definition terminal with different rates and different video formats, and the number of pictures displayed by each terminal is 16, The video formats supported by the 20 terminals are all H.264 1080P30, and the terminal 1 is taken as an example for description. FIG. 8 is a flowchart of a method for performing video processing by using the system shown in FIG. 8 according to an embodiment of the present invention. The process includes the following steps: Step 801: A DSP1 chip in an MCU video processing unit passes through a Gigabit Ethernet interface from a thousand The high-definition compressed video stream sent by the terminal 1 is obtained from the mega Ethernet switch chip. For example, the video format of the HD compressed video stream is H.2641080P30, and the compressed video stream has a data volume of 8 Mbps. Step 802: The DSP1 chip decodes the acquired compressed video stream to obtain a baseband video stream, and scales the baseband video stream into a small-size baseband video stream of a set size. Step 803: The DSP1 chip uses a shallow compression codec algorithm to perform shallow compression coding on the small-screen baseband video stream obtained in step 802 to obtain a shallow compressed baseband video stream (eg, the data volume of the shallow compressed baseband video stream is less than 4 Mbps). The shallow compressed baseband video stream is multicast to the Gigabit Ethernet switch chip through the Gigabit Ethernet port for use by the other MCU video processing unit. Step 804: The DSP2 chip obtains the shallow compressed baseband video stream of the nl (nl<16) small picture uploaded by the other MCU video processing unit from the Gigabit Ethernet switch chip, and respectively performs the nl road shallow compressed baseband video stream. Shallow decoding, get nl road small picture baseband video stream. Step 805: The DSP2 chip synthesizes the nl small-frame baseband video stream, and sends the synthesized baseband video stream to the DSP3 chip through the video interface. Step 806: The DSP3 chip acquires a n2 (n2<16, and nl+n2=16) small picture shallow compressed baseband video stream sent by another MCU video processing unit from the Gigabit Ethernet switching chip, and shallowly compresses the n2 way. The baseband video stream is decoded to obtain an n2 way small picture baseband video stream. Step 807: The DSP3 chip synthesizes the nl small-screen baseband video stream sent by the DSP2 chip and the n2 small-screen baseband video stream, and obtains a 16-channel picture baseband video stream, and connects through the video. The port sends the 16-picture baseband video stream to the DSP4 chip. Step 808: The DSP4 chip receives the baseband video stream of the 16-channel picture through the video interface, and compresses and encodes the baseband video stream of the 16-channel picture to obtain a high-definition compressed video stream, and the HD compressed video is output through a Gigabit Ethernet interface. The stream is sent to the terminal 1. The above method flow refers to a specific implementation manner, and there are many other implementation manners, such as: not only the DSP1 chip acquires the high-definition compressed video stream of the terminal 1, but also the DSP2 chip, the DSP3 chip or the DSP4 chip to obtain the terminal 1 HD compressed video stream and subsequent decoding, shallow compression, etc.; not limited to DSP2 chip and DSP3 chip to obtain small picture shallow compression baseband video stream from Gigabit Ethernet switch chip, can also be DSP1 chip and DSP2 chip, or DSP1 chip and DSP3 chip, or DSP1 chip and DSP4 chip, or DSP1 chip, DSP2 chip and DSP3 chip, or DSP1 chip, DSP2 chip and DSP4 chip, or DSP2 chip, DSP3 chip and DSP4 chip, or DSP1 chip, DSP2 chip, The DSP3 chip and the DSP4 chip are used to obtain a small-screen shallow compressed video stream, and the implementation manners are various, and those skilled in the art can perform corresponding settings according to actual applications. The video processing method and apparatus provided by the embodiments of the present invention not only solve the problem that the baseband video streams cannot be exchanged between the MCU video processing units, but also realize the flexibility of the video processing and the linearity of the video processing capacity. Expansion. Taking 20 MCU video processing units as an example, if the 20 MCU video processing units require the video data of the terminal 1, the technical solution of the present invention is required, and only one of the MCU video processing units is required to be from the compressed video stream centralized switching unit. Obtaining a compressed video stream of the terminal 1 and decoding the compressed video stream to obtain a baseband video stream; the MCU video processing unit performs shallow compression encoding on the baseband video stream to obtain a shallow compressed baseband video stream; the MCU video processing unit The shallow compressed baseband video stream is sent to the baseband video stream centralized switching unit through the baseband video stream output interface; the other 19 MCU video processing units respectively obtain the shallow compressed baseband video stream from the baseband video stream centralized switching unit, and the shallow compressed baseband is obtained. The video stream is subjected to shallow decoding to obtain a baseband video stream. With the technical solution of the present invention, only one decoding, one shallow compression coding, and 19 shallow decoding steps of the compressed video stream of the terminal 1 are required, and the terminal needs to be used in the prior art. Compared with 20 decoding operations, the compressed video stream of 1 improves the acquisition speed of the baseband video stream. Rate, saving the ability to process resources. One of ordinary skill in the art will appreciate that all or part of the steps in the above methods may be passed through the program. The instructions are related to hardware completion, and the program can be stored in a computer readable storage medium such as a read only memory, a magnetic disk, or an optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware, or may be implemented in the form of a software function module. The invention is not limited to any specific form of combination of hardware and software.

The spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of the inventions

Industrial Applicability According to the technical solution of the present invention, a shallow compressed video stream obtained by performing a shallow compression encoding of a baseband video stream by an MCU video processing unit is sent to a baseband video stream centralized switching unit, so that other MCU video processing units can receive the baseband video stream from the baseband video stream. After obtaining the shallow compressed baseband video stream in the switching unit and performing shallow decoding, the above baseband video stream can be obtained, thereby implementing the MCU video processing unit to implement baseband video stream exchange; and in the prior art, the MCU video processing unit is to be transmitted. The compressed video stream is obtained by compressing and encoding the baseband video stream, and the compressed video stream is transmitted to the compressed video stream centralized switching unit, so that the other MCU video processing unit obtains the compressed video stream, and the compressed video stream is decoded. Compared with the baseband video stream to be transmitted, the technical solution of the invention reduces the consumption of the capability processing resources and improves the utilization rate of the capability processing resources.

Claims

Claim

A multi-point control unit (MCU) video processing unit, comprising: a shallow coding subunit, a baseband video stream output interface, a baseband video stream input interface, and a shallow decoding subunit, wherein: the shallow coding subunit is set to: Transmitting a baseband video stream for shallow compression coding, and obtaining a shallow compressed baseband video stream and outputting; the baseband video stream output interface is configured to: send the shallow compressed baseband video stream output by the shallow coding subunit to a baseband video stream centralized switching unit; The video stream input interface is configured to: obtain a shallow compressed baseband video stream from the baseband video stream centralized switching unit; the shallow decoding subunit is configured to: shallowly convert the shallow compressed baseband video stream obtained by the baseband video stream input interface decoding.

2. The MCU video processing unit of claim 1, further comprising a scaling subunit coupled to the shallow encoding subunit: the scaling subunit is configured to: in the shallow encoding subunit pair the baseband to be transmitted Before the video stream is subjected to shallow compression coding, the baseband video stream to be transmitted is scaled to obtain a small-screen baseband video stream of a set size, and the small-screen baseband video stream is sent to the shallow coding sub-unit, the small picture The size of the baseband video stream is determined according to the number and format of the picture set by the user terminal; the shallow coding subunit is further configured to: perform shallow compression coding on the small picture baseband video stream sent by the scaling subunit to obtain a small picture baseband video stream, And transmitting the small picture baseband video stream to the baseband video stream centralized switching unit.

3. The MCU video processing unit of claim 2, further comprising a synthesis subunit connected to the scaling subunit and the shallow decoding subunit, respectively: the synthesis subunit is set to: from a scaling subunit or a shallow decoder The unit acquires a plurality of small-screen baseband video streams, and synthesizes the plurality of small-screen baseband video streams to obtain a baseband video stream and transmits the same.

A video processing method using the MCU video processing unit according to any one of claims 1 to 3, comprising: the shallow coding sub-unit performs shallow compression coding on the transmission baseband video stream to obtain a shallow compressed baseband video stream and outputs And the baseband video stream output interface sends the shallow compressed baseband video stream output by the shallow coding subunit to the baseband video stream centralized switching unit.

5. The method of claim 4, further comprising: a baseband video stream input interface acquiring a shallow compressed video stream from the baseband video stream centralized switching unit and outputting to the shallow decoding subunit; and a shallow decoding subunit pair The shallow compressed video stream output by the baseband video stream input interface is shallowly decoded to obtain a baseband video stream.

6. The method according to claim 5, wherein: before the step of shallow coding sub-unit performing shallow compression coding on the transmission baseband video stream, the method further comprises: scaling the sub-unit to perform scaling processing on the baseband video stream to be transmitted And obtaining a small-screen baseband video stream of the set size, and transmitting the small-screen baseband video stream to the shallow coding sub-unit; wherein, the size of the small-screen baseband video stream is determined according to the number and form of the screen set by the user terminal; The encoding subunit performs shallow compression encoding on the transmission baseband video stream, the shallow coding subunit performs shallow compression encoding on the small picture baseband video stream sent by the scaling subunit to obtain a small picture baseband video stream; baseband video stream output The interface sends the shallow compressed baseband video stream to the baseband video stream centralized switching unit, and sends the small picture baseband video stream to the baseband video stream centralized switching unit.

7. The method according to claim 6, further comprising: synthesizing the subunit to acquire a plurality of small picture baseband video streams from the scaling subunit or the shallow decoding subunit, and synthesizing the plurality of small picture baseband video streams, Get the baseband video stream and send it.

A video processing system, comprising: a baseband video stream centralized switching unit, and a plurality of multi-point control unit (MCU) video processing units collectively connected to the baseband video stream centralized switching unit, wherein: the baseband video The flow centralized switching unit is configured to: receive and forward the shallow compressed baseband video stream sent by the multiple MCU video processing units;

The MCU video processing unit is configured to: perform shallow compression encoding on the transmission baseband video stream, obtain a shallow compressed baseband video stream, and send the shallow compressed baseband video stream to the baseband video stream centralized switching unit; and, from the baseband video The shallow compressed baseband video stream is obtained by the stream centralized switching unit, and the shallow compressed baseband video stream is shallowly decoded to obtain a baseband video stream.

9. The system according to claim 8, wherein any one or more of the plurality of MCU video processing units acquire the shallow compressed baseband video stream from the baseband video stream centralized switching unit. And performing shallow decoding on the shallow compressed video stream to obtain the baseband video stream to be transmitted.

10. The system according to claim 8, wherein the MCU video processing unit comprises: a shallow coding subunit, a baseband video stream output interface, a baseband video stream input interface, and a shallow decoding subunit; wherein: the shallow coding subunit setting The method comprises: performing shallow compression coding on the transmission baseband video stream to obtain a shallow compressed baseband video stream and outputting; the baseband video stream output interface is configured to: send the shallow compressed baseband video stream output by the shallow coding subunit to the baseband video stream for centralized exchange a baseband video stream input interface configured to: obtain a shallow compressed baseband video stream from the baseband video stream centralized switching unit; the shallow decoding subunit is configured to: the shallow compression obtained on the baseband video stream input interface The baseband video stream is shallowly decoded.