WO2016173496A1 - 一种多画面调整方法、装置及多点控制单元 - Google Patents
一种多画面调整方法、装置及多点控制单元 Download PDFInfo
- Publication number
- WO2016173496A1 WO2016173496A1 PCT/CN2016/080390 CN2016080390W WO2016173496A1 WO 2016173496 A1 WO2016173496 A1 WO 2016173496A1 CN 2016080390 W CN2016080390 W CN 2016080390W WO 2016173496 A1 WO2016173496 A1 WO 2016173496A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sub
- picture
- screen
- display
- adjustment request
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 23
- 238000012544 monitoring process Methods 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 9
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 230000000694 effects Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 239000007787 solid Substances 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 239000011800 void material Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000005549 size reduction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
Definitions
- This document relates to but not limited to the field of multimedia video communication, and in particular relates to a multi-picture adjustment method, device and multi-point control unit.
- a conference television system capable of realizing multi-picture effects, comprising at least two terminals, an MCU (Multipoint Controller Unit), and a corresponding transmission network.
- the MCU plays a central role in the multi-view conference television system. It can be an independent device or a device logic entity embedded in the conference television terminal. It is responsible for receiving and decoding the compressed video code stream sent by multiple terminals. And according to the requirements of the conference, the zoom processing is performed, and then the scaled video is filled to the corresponding position on the multi-screen according to the preset multi-screen layout, and finally the filled video is encoded and sent to the terminal, and the terminal decodes and receives When you get the video stream, you can see the multi-picture after splicing.
- the layout of the sub-pictures in the multi-picture and the size of the sub-pictures in the layout are fixed, or a limited layout adjustment can be performed in the case of a given number of pictures, in which the size of the sub-pictures is also fixed. of.
- the embodiment of the invention provides a multi-picture adjustment method and device, and a multi-point control unit, which can solve how to enable a conference television user to implement according to his own needs without changing the hardware of the existing MCU, the terminal, and the networking conditions.
- a multi-screen adjustment method includes:
- the multipoint control unit MCU receives the code stream sent from the plurality of terminals, and decodes the obtained video data to synthesize the multi-picture;
- the MCU receives an adjustment request for the sub-picture in the multi-screen, and adjusts display parameters of the corresponding sub-picture according to the adjustment request;
- the MCU sends the adjusted multi-picture code to the corresponding terminal.
- the receiving, by the MCU, the adjustment request for the sub-picture in the multi-picture includes:
- the MCU receives the adjustment request for the multi-picture neutron picture from the MCU local monitoring station or the terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the adjusting display parameters of the corresponding sub-screen according to the adjustment request includes:
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the adjusting display parameters of the corresponding sub-screen according to the adjustment request includes:
- the method further includes:
- the designated sub-segment is in accordance with the size of the region occupied by the specified sub-screen in the display region of the multi-screen
- the screen is cropped or reduced.
- the method further includes:
- the display size of the other sub-pictures is correspondingly increased or the non-content area is filled with a predetermined pattern
- the display size of the other sub-pictures is correspondingly reduced or the content of the overlapping area is displayed in a predetermined manner.
- a multi-screen adjustment device is disposed in the multi-point control unit MCU, and includes:
- a processing module configured to receive a code stream sent from a plurality of terminals, and obtain a multi-picture after decoding the obtained video data
- the adjusting module is configured to receive an adjustment request for the sub-picture in the multi-screen, and adjust display parameters of the corresponding sub-picture according to the adjustment request;
- the sending module is configured to send the adjusted multi-picture code to the corresponding terminal.
- the receiving, by the adjusting module, the adjustment request for the sub-picture in the multi-picture includes:
- the adjustment module receives the adjustment request for the multi-picture neutron picture from the MCU local monitoring station or the terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the adjusting module adjusts display parameters of the corresponding sub-screen according to the adjustment request, including:
- the adjustment module adjusts a display size of the specified sub-screen to the set size according to the adjustment request.
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the adjusting module adjusts display parameters of the corresponding sub-screen according to the adjustment request, including:
- the adjusting module adjusts the display position of the specified sub-screen to the set position according to the adjustment request.
- the adjusting module is further configured to: after the display position of the specified sub-screen is adjusted to the set position according to the adjustment request, if a partial area of the specified sub-picture is located in the multi-screen In addition to the display area, the designated sub-screen is cropped or reduced in accordance with the size of the area occupied by the specified sub-screen in the display area of the multi-screen.
- the adjusting module is further configured to: after adjusting the display parameter of the corresponding sub-screen according to the adjustment request, if there is no content area in the display area of the multi-screen after the adjustment, the display size of the other sub-screens is adjusted accordingly Large or filling the no-content area with a predetermined pattern; if the sub-picture overlapping area appears in the display area of the multi-screen after adjustment, the display size of the other sub-pictures is correspondingly reduced or the overlapping is displayed in a predetermined manner The content of the area.
- a multipoint control unit MCU comprising:
- a network interface configured to receive a code stream sent from a plurality of terminals
- a decoder configured to decode the code stream to obtain video data
- a synthesis module configured to synthesize the video data into multiple pictures
- An encoder configured to encode the synthesized multi-picture and transmit through the network interface
- the network interface is further configured to receive an adjustment request for the sub-picture in the multi-picture
- the synthesizing module is further configured to adjust display parameters of the corresponding sub-picture according to the adjustment request;
- the encoder is further configured to transmit the adjusted multi-picture code to the corresponding terminal through the network interface.
- the multi-point control unit further includes:
- the MCU local monitoring station includes:
- a display screen configured to display the multi-picture
- a mouse configured to input the adjustment request
- Receiving, by the network interface, an adjustment request for the sub-picture in the multi-picture includes:
- the network interface receives the adjustment request for the sub-picture in the multi-screen from the MCU local monitoring station, or receives the adjustment request for the sub-picture in the multi-picture from the terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the synthesizing module adjusts display parameters of the corresponding sub-picture according to the adjustment request, including:
- the synthesizing module adjusts a display size of the specified sub-screen to the set size according to the adjustment request.
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the synthesizing module adjusts display parameters of the corresponding sub-picture according to the adjustment request, including:
- the synthesizing module adjusts the display position of the specified sub-screen to the set position according to the adjustment request.
- the synthesizing module is further configured to: in the specified sub-picture according to the adjustment request After the display position is adjusted to the set position, if a partial area of the specified sub-picture is located outside the display area of the multi-screen, the designated sub-screen is in the display area of the multi-screen according to the specified sub-picture The size of the occupied area, and the specified sub-picture is cropped or reduced.
- the synthesizing module is further configured to: after adjusting the display position of the specified sub-screen to the set position according to the adjustment request, if the content-free area appears in the display area of the multi-screen after the adjustment And correspondingly, the display size of the other sub-pictures is adjusted to be larger or the non-content area is filled with a predetermined pattern; if the sub-picture overlapping area appears in the display area of the multi-picture after the adjustment, the display of the other sub-pictures is correspondingly performed. The size is reduced or the content of the overlapping area is displayed in a predetermined manner.
- a computer readable storage medium storing computer executable instructions for performing the above method.
- the solution of the embodiment of the invention can improve the controllability of the conference television.
- the hardware architecture of the MCU and the terminal is not changed, the requirement for the individual television to adjust the size and position of a sub-picture of interest can be satisfied, and it is especially useful when the number of pictures is relatively large.
- FIG. 1 is a schematic flow chart of a multi-picture adjustment method according to Embodiment 1 of the present invention.
- FIG. 2 is a schematic diagram of a multi-picture adjusting apparatus according to Embodiment 2 of the present invention.
- FIG. 3 is a block diagram of a conference television system employing an embodiment of the present invention.
- FIG. 5(a) to (c) are schematic diagrams showing the layout of the sub-picture in the multi-screen conference television after the size is changed;
- FIGS. 6(a) to (c) are schematic diagrams showing a layout of a sub-picture change position in a multi-screen conference television
- FIG. 7 is a flow chart of selecting and adjusting a sub-screen using a button remote controller
- FIG. 8 is a schematic structural diagram of a multipoint control unit according to Embodiment 3 of the present invention.
- Embodiment 1 A multi-picture adjustment method, as shown in FIG. 1 , includes steps S110-S130:
- the MCU receives the code stream sent from the multiple terminals, and obtains the multi-picture after decoding and obtaining the video data.
- the MCU receives an adjustment request for the sub-picture in the multi-screen, and adjusts display parameters of the corresponding sub-picture according to the adjustment request.
- the MCU sends the adjusted multi-picture code to the corresponding terminal.
- the display of one or more sub-pictures in the multi-picture can be personalized, and no adjustment on the hardware architecture is required.
- the receiving, by the MCU, the adjustment request for the sub-picture in the multi-picture includes:
- the MCU receives the adjustment request for the multi-picture neutron picture from the MCU local monitoring station or the terminal.
- the terminal may include one or more of the following categories:
- Desktop terminals such as laptops
- mobile terminals such as tablets or large-screen phones
- conference TV terminals that support touch-screen operation
- traditional conference TV terminals equipped with remote controls
- the corresponding terminal in the S130 may be the terminal of any one of the sending streams, or may be the terminal specified in the adjustment request, or may be the terminal that sends the adjustment request or the default terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the adjusting display parameters of the corresponding sub-screen according to the adjustment request includes:
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the adjusting display parameters of the corresponding sub-screen according to the adjustment request includes:
- the corresponding sub-picture can be displayed at a specific position as needed.
- the method further includes:
- the designated sub-screen is determined according to the size of the region occupied by the specified sub-screen in the display region of the multi-screen Crop or shrink.
- the sub-picture When the sub-picture is enlarged, the sub-picture is enlarged in the display area of the multi-picture. Therefore, generally, the partial area of the adjusted sub-picture is not located outside the display area of the multi-picture. If it does, you can refer to the above for processing.
- the method further includes:
- the other sub-pictures ie, the sub-pictures other than the adjusted sub-pictures in the multi-picture
- the display size is increased or the content-free area is filled with a predetermined pattern; the predetermined pattern here also includes a solid color;
- the display size of the other sub-pictures is correspondingly reduced or the overlapping area is displayed in a predetermined manner.
- Content includes transparent superimposition or cloaking (such as displaying the content of a sub-picture in the overlapping area on the top layer in the overlapping area, blocking the content of other sub-pictures in the overlapping area; displayed at the top level
- the sub-picture may be, but is not limited to, the specified sub-picture).
- the second embodiment is a multi-screen adjustment device, which is disposed in the multi-point control unit MCU, as shown in FIG. 2, and includes:
- the processing module 21 is configured to receive the code stream sent from the multiple terminals, and obtain the multi-picture after decoding the obtained video data;
- the adjusting module 22 is configured to receive an adjustment request for the sub-picture in the multi-screen, and adjust display parameters of the corresponding sub-picture according to the adjustment request;
- the sending module 23 is configured to send the adjusted multi-picture code to the corresponding terminal.
- the receiving, by the adjusting module, the adjustment request for the sub-picture in the multi-picture includes:
- the adjustment module receives the adjustment request for the multi-picture neutron picture from the MCU local monitoring station or the terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the adjusting module adjusts display parameters of the corresponding sub-screen according to the adjustment request, including:
- the adjustment module adjusts a display size of the specified sub-screen to the set size according to the adjustment request.
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the adjusting module adjusts display parameters of the corresponding sub-screen according to the adjustment request, including:
- the adjusting module adjusts the display position of the specified sub-screen to the set position according to the adjustment request.
- the adjusting module is further configured to: after the display position of the specified sub-screen is adjusted to the set position according to the adjustment request, if a partial area of the specified sub-picture is located in the multi-screen In addition to the display area, the designated sub-screen is cropped or reduced in accordance with the size of the area occupied by the specified sub-screen in the display area of the multi-screen.
- the adjusting module is further configured to: after adjusting the display parameter of the corresponding sub-screen according to the adjustment request, if there is no content area in the display area of the multi-screen after the adjustment, the display size of the other sub-screens is adjusted accordingly Large or filling the no-content area with a predetermined pattern; if the sub-picture overlapping area appears in the display area of the multi-screen after adjustment, the display size of the other sub-pictures is correspondingly reduced or the overlapping is displayed in a predetermined manner The content of the area.
- the following is an example of the process of making adjustments at the MCU local monitoring station.
- the user treats the sub-picture of the variable size (ie, the designated or selected sub-picture), and sets the size of the sub-picture by dragging the edge or corner of the picture (equivalent to generating an adjustment request).
- the MCU then changes the display size of the sub-picture according to the set size. After the display size of the selected sub-picture changes, it will involve the re-layout of the remaining sub-pictures. If the selected sub-picture size is enlarged, it will occupy a partial area of the adjacent sub-picture, and the occupied area forms an overlapping area; the overlapping area may be processed by covering or transparent superposition, except for the sub-picture having a larger size.
- Other sub-pictures can also be automatically reduced to avoid overlapping areas; if the selected sub-picture size is reduced, gaps may occur between the reduced sub-picture and adjacent sub-pictures, and the gaps may be filled with a solid color or The selected pattern, the size of the other sub-pictures other than the sub-picture whose size is smaller remains unchanged, or automatically increases to fill the picture.
- the dimensional changes mentioned in the above scheme include, but are not limited to, the manner of equal aspect ratio scaling; if the overlap or gap occurs after other sub-picture sizes become larger or smaller, refer to the above for processing;
- the user treats the sub-picture of the changed position (that is, the specified or selected sub-picture), and sets the position of the sub-picture by dragging the screen (equivalent to generating an adjustment request), and then the MCU according to the setting
- the fixed position changes the display position of the sub-picture.
- the display position of the selected sub-screen changes, it involves the re-layout of the remaining sub-pictures. If the selected sub-picture moves to the inner side of the entire picture (ie, the display area of the multi-picture) (ie, moves toward the center position), it occupies a partial area of the adjacent sub-picture, and the occupied areas form an overlap.
- the area and the overlapping area may be processed by covering or transparent superposition, and the other sub-pictures other than the position moving sub-picture may be automatically reduced to avoid the overlapping area, and the position of the position moving sub-picture may be removed. Filled with a solid color or a selected pattern; if the selected sub-picture moves to the outside of the entire picture (ie, moves to the edge position), part of the selected sub-picture after moving may be outside the entire picture, Display only the remaining portion of the selected sub-picture that is still in the entire picture, or reduce the selected sub-picture so that it is completely within the entire picture.
- the moved sub-picture and adjacent sub-pictures have gaps.
- the size of the other sub-pictures other than the position-shifted sub-picture remains the same, or automatically enlarges to fill the picture.
- the dimensional changes mentioned in the above scheme include but are not limited to the manner of equal aspect ratio scaling; if other sub-picture sizes become larger After the reduction or the overlap/void occurs, refer to the above for processing.
- the following is an example of the process of adjusting through the terminal.
- the user can select the sub-picture (ie, the specified or selected sub-picture) that needs to be resized, and drag the edge or corner of the picture to set the sub-picture size, and then The terminal reports the set size to the MCU, and the next implementation method is the same as the process of adjusting the MCU local monitoring station;
- the user can select the sub-picture (ie, the designated or selected sub-picture) that wants to move the position, and set the position of the sub-picture by dragging the picture, and then the terminal sets the setting.
- the location is reported to the MCU, and the next implementation is the same as the one that is adjusted at the MCU local monitoring station.
- the user selects the sub-screen (that is, the designated or selected sub-screen) that needs to be resized on the interface where the multi-screen appears, and uses a combination of some keys, for example, by using the "confirm” button. And the "direction” button, etc., so that the sub-picture is in the state of resizing, and then by operating some buttons, a finite level of zooming and reduction can be realized (changes in the MCU local monitoring station or through the terminal adjustment scheme can include stepless zooming)
- the method then the terminal reports the set size to the MCU, and the next implementation method is the same as the adjustment process in the MCU local monitoring station;
- the user selects the sub-screen (that is, the designated or selected sub-screen) that needs to be moved in the interface where the multi-screen appears, and uses a combination of some keys, for example, by using the "confirm” button. And the "direction" key, so that the sub-picture is in the state of moving position, and then by operating the "direction” key, the movement of the selected sub-picture can be realized, moving to the position to be set, confirming, and then the terminal sets the The location is reported to the MCU, and the next implementation is the same as the adjustment process at the MCU local monitoring station.
- FIG. 3 is a block diagram of a conference television system employing a multi-picture adjustment method according to an embodiment of the present invention. The functions of each component are briefly described as follows:
- the MCU 101 is a core of the multi-view conference television system, and is configured to receive the compressed video streams of the terminals 103-105. After decoding, the corresponding transcoding and scaling operations are performed according to the requirements of the conference, and then multiple screens are generated according to the corresponding parameters according to the layout requirements. The re-encoding is sent to the terminals 103-105; when the sub-picture size and layout are adjusted, if it is operated by the monitoring station local to the MCU, it can also be used as a direct input of the set size and position;
- the terminals 103-105 are connected to the MCU 101 through the network 102.
- the terminals 103-105 respectively transmit single-picture video data to the MCU 101, and simultaneously receive multi-picture video data sent by the MCU 101.
- the video data mentioned here are all subjected to some encoding algorithm.
- the processed compressed code stream, if the sub-picture size and layout are adjusted on the terminals 103-105, the size and position set for the specified sub-picture are uploaded to the MCU 101 via the network 102;
- the conference television terminal 103 is equipped with a console and supports mouse operation; or is equipped with a touch screen to support touch operation; or is equipped with a button remote controller. Through the mouse and touch, the sub-pictures that need to be resized or positioned are selected, dragged, zoomed, clicked, dragged, etc.; through the combination of buttons, the sub-pictures that need to be resized or positioned are selected, clicked, zoomed, Click to move and other operations.
- the conference television terminal 103 uploads information about the size, position, and the like set for the specified sub-picture to the MCU 101;
- the desktop terminal 104 has an operation of supporting a mouse or a touch screen for screen drag and drop.
- the user can select a sub-picture that needs to be resized or positioned, and then perform operations such as drag and drop, click zoom, drag and drop, and the desktop terminal 104 will
- the information of the size, position, etc. of the specified sub-screen setting is uploaded to the MCU 101;
- the mobile terminal 105 is provided with a touch screen for dragging the screen.
- the user can select a sub-picture that needs to be resized or positioned, and then perform operations such as drag and drop, click zoom, drag and drop, and the mobile terminal 105 will specify the sub screen.
- the information of the changed size, position, etc. is uploaded to the MCU 101.
- Figure 4 (a) ⁇ (d) is a common sub-screen layout method for multi-screen conference TV, taking 6 screens with a 16:9 aspect ratio as an example:
- the upper left corner is a large sub-picture 1, occupying an area of 4/9, and the pictures 2 to 6 are small sub-pictures, each occupying an area of 1/9, and all the sub-pictures are seamlessly spliced together to form a 6-picture;
- the upper right corner is a large sub-picture 1, occupying an area of 4/9, and the pictures 2 to 6 are small sub-pictures, each occupying an area of 1/9, and all the sub-pictures are seamlessly spliced together to form a 6-picture;
- the lower left corner is a large sub-picture 1, occupying an area of 4/9, and the pictures 2 to 6 are small sub-pictures, each occupying an area of 1/9, and all the sub-pictures are seamlessly spliced together to form a 6-picture;
- the lower right corner is a large sub-picture 1, occupying 4/9 area, and pictures 2 to 6 are small sub-pictures, each occupying an area of 1/9, and all the sub-pictures are seamlessly spliced together to form a 6-picture.
- FIG. 5 is a schematic diagram of a layout after the sub-picture is resized in the multi-screen conference television, and is adjusted for the layout of the schematic diagram 4(a) as an example:
- FIG. 5(a) demonstrates the effect of increasing the size of the sub-picture 6 to the lower left corner and the like. When the sub-picture 6 is increased, it will occupy the position of the adjacent sub-picture, as shown in FIG.
- FIG. 5(a) occupying the entire area of the sub-picture 5, occupying a partial area of the sub-pictures 1 to 4, if the sub-pictures 1 to 5 If the size remains unchanged, the processing of the overlapping area may be covered or transparently superimposed; if the size of the sub-pictures 1 to 5 changes as the sub-picture 6 becomes larger, the effect is referred to FIG. 5(b);
- the size of the sub-picture 6 becomes large, occupying an area of the adjacent sub-picture.
- the size of the sub-pictures 1 to 5 changes accordingly, and the variation of the aspect ratio including, but not limited to, the aspect ratio is shown, and FIG. 5(b) demonstrates the effect of reducing the aspect ratio of the sub-pictures 1 to 5 and the like.
- FIG. 5(b) demonstrates the effect of reducing the aspect ratio of the sub-pictures 1 to 5 and the like.
- some gaps appear in the picture (areas of the grid line portion in Fig. 5(b)). These spaces may be filled, including but not limited to solid colors, such as but not limited to padding. pure black.
- FIG. 5(c) shows the sub-picture 1 The effect of reducing the size to the upper left corner and other aspect ratios.
- the size of the sub-pictures 2-6 is either maintained or includes, but is not limited to, an expansion of the equal aspect ratio.
- the void region (the region of the grid line portion in FIG. 5(c)) generated after the above variation may be filled in a manner including, but not limited to, a solid color, for example, the size of the sub-pictures 2 to 6 remains unchanged after the sub-picture 1 becomes smaller. Fill the gap with pure black.
- FIG. 6 is a schematic diagram of a layout after changing a position of a sub-screen in a multi-screen conference television, and is adjusted for the layout of the schematic diagram 4(a) as an example:
- Fig. 6(a) demonstrates the effect of moving the sub-picture 1 to the inner side, that is, to the lower right corner. After the sub-picture 1 moves, it will occupy the area of the adjacent sub-picture, as shown in FIG. 6(a), occupying a partial area of the sub-pictures 2 to 6, and a void area generated by the upper left corner after the movement (FIG.
- the area of the grid line can be filled with pure black; if the size of the sub-pictures 2 to 6 remains unchanged, the processing of the overlapping area can be covered or transparently superimposed; if the size of the sub-pictures 2 to 6 is along with the sub-picture If the movement of 1 also changes, the effect is shown in Figure 6(b);
- the sub-picture 1 in the layout of Fig. 4(a) is selected, and its position is changed by dragging, for example, moving inward, occupying a partial area of the adjacent sub-pictures 2-6.
- the size of the sub-pictures 2 to 6 changes accordingly, and the variation of the aspect ratio including but not limited to the aspect ratio is shown.
- FIG. 6(b) demonstrates the effect of reducing the aspect ratio of the sub-pictures 2 to 6 and the like. After the sub-pictures 2 to 6 are reduced in aspect ratio, some gaps appear in the picture (the area of the grid line portion in Fig. 6(b)), and these spaces may be filled, including but not limited to, in a solid color, such as filled with pure black.
- Figure 6(c) demonstrates the effect of sub-picture 1 moving to the upper left corner.
- the remainder of the entire picture can be simply screened (ie, only the remaining portion of the selected sub-picture is still in the entire picture) or reduced sub-picture 1, reduced by a variation including, but not limited to, an aspect ratio.
- Figure 6(c) demonstrates the effect of a simple screen shot, where 4031 and 4032 are the parts that are removed from the picture, that is, the parts that are simply cropped.
- FIG. 6(c) demonstrates that after the sub-picture 1 is moved outward, the sizes of the sub-pictures 2 to 6 remain unchanged, and the gap can be filled with pure black. (The area of the grid line portion in Fig. 6(c)).
- buttons remote control configured for the traditional conference TV terminal:
- Direction button There are four directions of up, down, left and right. The more advanced remote control also adds four directions: upper left, upper right, lower left, and lower right.
- the terminal in the embodiment of the present invention is a conference television terminal
- the invention includes, but is not limited to, using a remote controller in four directions of up, down, left, and right, including but not limited to using a button remote controller.
- the “direction” key plays the role of selecting and moving the sub-picture, and simulating the function of dragging the frame of the picture, and also selecting the function of the upper and lower levels in the menu operation;
- Confirm button Confirm the selected sub-picture, and press the confirmation button on the sub-picture that is ready to change the size.
- the sub-picture can be continuously enlarged. After the sub-picture is continuously enlarged and moved, after a period of time, again “ Press the "OK” button to confirm the selected size and position;
- “Menu” button press the “Menu” button to select the adjustment sub-screen menu, and then select the sub-menu to adjust the sub-picture size or position;
- “Back” button After completing the adjustment of the sub-picture size or position, the user can return to the previous screen size or position by pressing the “Back” button, and press the “Back” button continuously to return to the original multi-screen layout. ;
- the functions of the keys of the remote controller and their combinations in the multi-screen adjustment are not limited to the above description, and can be set by themselves.
- Figure 7 is a flow chart for selecting and adjusting the size and layout of the sub-picture using the button remote control.
- GUI Graphic User Interface
- the user selects a sub-menu for adjusting the size or position of the sub-picture as needed, if the sub-menu for adjusting the sub-picture size is selected, the process proceeds to step 603a, and if the sub-menu for adjusting the sub-picture position is selected, the process proceeds to step 603b;
- Step 603a
- the state of selecting the sub-picture size has been entered, and the sub-pictures in the multi-picture image are selected by default.
- the embodiment of the present invention includes, but is not limited to, the selected mode mentioned in steps 601-602.
- the user selects the sub-picture to be resized by pressing the “direction” key as needed, and then proceeds to step 604a, where the selected sub-picture can be indicated by a frame or a convex form;
- Step 604a
- the selected sub-picture can be represented by the standard frame or sinking, and then proceeds to step 605a;
- Step 605a
- Step 606a
- step 607a After zooming in to the desired size, after a pause for a while, the user presses the "confirm" button again, and the size of the sub-screen is selected to confirm that the adjustment is complete. If the user wants to reduce the enlarged sub-picture, proceed to step 607a; if the user wants to directly return to the original multi-screen layout, then proceeds to step 608a;
- Step 607a
- Step 608a
- the state of selecting the location of the sub-screen has been entered, and the sub-screens of the multi-screen image are selected by default.
- the embodiment of the present invention includes, but is not limited to, the selection mode mentioned in steps 601-602.
- the user selects the sub-picture to be adjusted by pressing the "direction" key as needed, and then proceeds to step 604b, where the sub-picture that has been selected can be indicated by a frame or a convex form;
- the selected sub-picture can be represented by the standard frame or sinking, and then proceeds to step 605b;
- step 606b the layout of the remaining sub-pictures refers to the schematic diagrams 6(a) to (c);
- step 607b After moving to the desired position, after a pause for a period of time, the user presses the "confirm" button again, and the position of the sub-screen is selected to confirm that the adjustment is completed. If the user wants to return to the last position of the sub-screen, proceed to step 607b; if the user wants to directly return to the original multi-screen layout, then proceeds to step 608b;
- Embodiment 3 A multi-point control unit MCU, as shown in FIG. 8, includes:
- a network interface 81 configured to receive a code stream sent from a plurality of terminals
- a decoder 82 configured to decode the code stream to obtain video data
- a synthesizing module 83 configured to synthesize the video data into multiple pictures
- the encoder 84 is configured to encode the synthesized multi-picture and send it through the network interface;
- the network interface is further configured to receive an adjustment request for the sub-picture in the multi-picture
- the synthesizing module is further configured to adjust display parameters of the corresponding sub-picture according to the adjustment request;
- the encoder is further configured to transmit the adjusted multi-picture code to the corresponding terminal through the network interface.
- the network interface can also be arranged to send parameters to the decoder, the encoder, and the synthesis module.
- the MCU further includes an MCU local monitoring station;
- the MCU local monitoring station includes:
- a display screen configured to display the multi-picture
- a mouse configured to input the adjustment request
- Receiving, by the network interface, an adjustment request for the sub-picture in the multi-picture includes:
- the network interface receives the adjustment request for the sub-picture in the multi-screen from the MCU local monitoring station, or receives the adjustment request for the sub-picture in the multi-picture from the terminal.
- the adjusting request includes: requesting to adjust the specified sub-picture to a set size;
- the synthesizing module adjusts display parameters of the corresponding sub-picture according to the adjustment request, including:
- the synthesizing module adjusts a display size of the specified sub-screen to the set size according to the adjustment request.
- the adjusting request includes: requesting to move the specified sub-picture to a set position;
- the synthesizing module adjusts display parameters of the corresponding sub-picture according to the adjustment request, including:
- the synthesizing module adjusts the display position of the specified sub-screen to the set position according to the adjustment request.
- the synthesizing module is further configured to: after the display position of the specified sub-screen is adjusted to the set position according to the adjustment request, if a partial region of the specified sub-picture is located in the multi-screen In addition to the display area, the designated sub-picture is cropped or reduced in size of the area occupied by the display area of the multi-picture.
- the synthesizing module is further configured to: after adjusting the display position of the specified sub-screen to the set position according to the adjustment request, if the content-free area appears in the display area of the multi-screen after the adjustment And correspondingly increasing the display size of the other sub-pictures or filling the non-content area with a predetermined pattern; if the sub-picture overlapping area appears in the display area of the multi-picture after the adjustment, the display size of the other sub-pictures correspondingly The content of the overlapping area is displayed small or in a predetermined manner.
- Embodiment 4 A computer readable storage medium storing computer executable instructions for performing the method of Embodiment 1 above.
- the solution of the embodiment of the invention can improve the controllability of the conference television.
- the hardware architecture of the MCU and the terminal is not changed, the requirement for the individual television to adjust the size and position of a sub-picture of interest can be satisfied, and it is especially useful when the number of pictures is relatively large.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
一种多画面调整方法、装置及多点控制单元；方法包括：MCU接收从多个终端发过来的码流，解码视频后合成多画面；所述MCU接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；所述MCU将调整后的多画面编码发送给相应终端。
Description
本文涉及但不限于多媒体视频通讯领域，尤其涉及一种多画面调整方法、装置及多点控制单元。
一个能够实现多画面效果的会议电视系统，包含至少两台终端、一台MCU(Multipoint Controller Unit，多点控制单元)以及相应的传输网络。MCU在多画面会议电视系统中起到核心的作用，可以是独立的设备也可以是内嵌在会议电视终端中的设备逻辑实体，它负责接收多个终端发送过来的压缩视频码流并进行解码，并根据会议的要求进行缩放处理，然后根据事先规定好的多画面布局，把缩放后的视频填充到多画面上对应的位置，最后对填充完毕的视频进行编码并且发送给终端，终端解码收到的视频码流，就可以看到拼接后的多画面。
在多画面会议电视中，多画面中的子画面布局以及在该布局下子画面的大小是固定的，或者在给定画面数情况下能够进行有限的布局调整，在该布局下子画面的大小也是固定的。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本发明实施例提供一种多画面调整方法、装置及多点控制单元，可以解决在不改变现有MCU、终端的硬件以及组网条件的情况下，如何使得会议电视用户可以根据自己的需要实现多画面会议中子画面的调整，以实现个性化的需求的问题。
本发明实施例采用如下技术方案。
一种多画面调整方法，包括：
多点控制单元MCU接收从多个终端发过来的码流，解码获得视频数据后合成多画面；
所述MCU接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；
所述MCU将调整后的多画面编码发送给相应终端。
可选地，所述所述MCU接收对所述多画面中子画面的调整请求包括：
所述MCU从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述根据调整请求调整相应子画面的显示参数包括：
根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述根据调整请求调整相应子画面的显示参数包括：
根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
可选地，所述根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后还包括：
当所述指定的子画面的部分区域位于所述多画面的显示区域之外时，按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
可选地，所述根据调整请求调整相应子画面的显示参数后还包括：
当调整后所述多画面的显示区域中出现无内容区域时，相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；
当调整后所述多画面的显示区域中出现子画面交叠区域时，相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
一种多画面调整装置，设置于多点控制单元MCU中，包括：
处理模块，设置成接收从多个终端发过来的码流，解码获得视频数据后合成多画面；
调整模块，设置成接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；
发送模块，设置成将调整后的多画面编码发送给相应终端。
可选地，所述调整模块接收对所述多画面中子画面的调整请求包括：
所述调整模块从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述调整模块根据调整请求调整相应子画面的显示参数包括：
所述调整模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述调整模块根据调整请求调整相应子画面的显示参数包括：
所述调整模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
可选地，所述调整模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
可选地，所述调整模块还设置成在根据调整请求调整相应子画面的显示参数后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
一种多点控制单元MCU，包括：
网络接口，设置成接收从多个终端发过来的码流；
解码器，设置成解码所述码流获得视频数据；
合成模块，设置成将所述视频数据合成多画面；
编码器，设置成将合成的多画面进行编码，通过所述网络接口发送；
其中：
所述网络接口还设置成接收对所述多画面中子画面的调整请求；
所述合成模块还设置成根据所述调整请求调整相应子画面的显示参数；
所述编码器还设置成将调整后的多画面编码，通过所述网络接口发送给相应终端。
可选地，所述的多点控制单元还包括：
MCU本地监控台；所述MCU本地监控台包括：
显示屏，设置成显示所述多画面；
鼠标，设置成输入所述调整请求；
所述网络接口接收对所述多画面中子画面的调整请求包括：
所述网络接口从所述MCU本地监控台接收所述对多画面中子画面的调整请求，或从终端接收所述对多画面中子画面的调整请求。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述合成模块根据调整请求调整相应子画面的显示参数包括：
所述合成模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述合成模块根据调整请求调整相应子画面的显示参数包括：
所述合成模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
可选地，所述合成模块还设置成在根据调整请求将所述指定的子画面的
显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
可选地，所述合成模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域时，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述方法。
本发明实施例的方案可以使会议电视的可操控性得到提高。在MCU、终端的硬件架构不做任何改变的情况下，可以满足会议电视对某个感兴趣的子画面单独调整大小和位置的需求，在画面数比较多的情况下尤其实用。
在阅读并理解了附图和详细描述后，可以明白其它方面。
附图概述
图1是本发明实施例一的一种多画面调整方法的流程示意图；
图2是本发明实施例二的一种多画面调整装置的示意图；
图3是采用本发明实施例的会议电视系统框图；
图4(a)～(d)是多画面会议电视常见的子画面布局方式；
图5(a)～(c)是多画面会议电视中子画面改变大小后的布局示意图；
图6(a)～(c)是多画面会议电视中子画面改变位置后的布局示意图；
图7是一种使用按键遥控器选中、调整子画面的流程图；
图8是本发明实施例三的多点控制单元的结构示意图。
需要说明的是，如果不冲突，本发明实施例以及实施例中的特征可以相互结合。另外，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。
实施例一、一种多画面调整方法，如图1所示，包括步骤S110～S130：
S110、MCU接收从多个终端发过来的码流，解码获得视频数据后合成多画面；
S120、所述MCU接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；
S130、所述MCU将调整后的多画面编码发送给相应终端。
通过本实施例的方法，可以对多画面中的一个或多个子画面的显示进行个性化调整，而且无需硬件架构上的调整。
可选地，所述MCU接收对所述多画面中子画面的调整请求包括：
所述MCU从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。所述终端可以包括以下几类中的一种或几种：
桌面终端(如笔记本电脑等)、移动终端(如平板电脑或大屏幕手机等)、支持触屏操作的会议电视终端、配备遥控器的传统会议电视终端等。
所述S130中的相应终端可是任一个发码流的终端，也可以是调整请求中指定的终端，还可以是发送所述调整请求的终端或默认的终端。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述根据调整请求调整相应子画面的显示参数包括：
根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
通过本可选方法，可以根据需要调大或调小相应的子画面。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述根据调整请求调整相应子画面的显示参数包括：
根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位
置。
通过本可选方法，可以根据需要将相应的子画面显示在特定的位置。
可选地，所述根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后还包括：
当所述指定的子画面的部分区域位于所述多画面的显示区域之外时，按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定子画面进行裁剪或缩小。
在调整尺寸时，子画面放大时是在所述多画面的显示区域内进行扩展，所以一般不会出现调整后子画面的部分区域位于所述多画面的显示区域之外的情况。如果出现，则可参照上文进行处理。所述指定的子画面在所述多画面的显示区域中所占区域即：所述指定的子画面位于所述多画面的显示区域中的那部分区域。
通过本可选方法，可以更好的适应调整子画面位置后可能导致的子画面超出显示范围的情况。
可选地，所述根据调整请求调整相应子画面的显示参数后还包括：
当调整后所述多画面的显示区域中出现无内容区域(即：子画面之间存在空隙)时，相应将其它子画面(即所述多画面中，所调整的子画面以外的子画面)的显示尺寸调大或者采用预定图案填充所述无内容区域；这里的预定图案也包括纯色；
当调整后所述多画面的显示区域中出现子画面交叠区域(即：子画面之间存在部分重合)时，相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容；这里的预定方式包括透明叠加或遮盖(比如将某个子画面位于交叠区域中的内容显示在该交叠区域中的顶层，挡住该交叠区域中其它子画面的内容；显示在顶层的子画面可以但不限于为所述指定的子画面)。
通过本可选方法，可以更好的适应调整子画面显示参数后可能导致的子画面重叠或出现空白区域的情况。
实施例二、一种多画面调整装置，设置于多点控制单元MCU中，如图2所示，包括：
处理模块21，设置成接收从多个终端发过来的码流，解码获得视频数据后合成多画面；
调整模块22，设置成接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；
发送模块23，设置成将调整后的多画面编码发送给相应终端。
可选地，所述调整模块接收对所述多画面中子画面的调整请求包括：
所述调整模块从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述调整模块根据调整请求调整相应子画面的显示参数包括：
所述调整模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述调整模块根据调整请求调整相应子画面的显示参数包括：
所述调整模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
可选地，所述调整模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
可选地，所述调整模块还设置成在根据调整请求调整相应子画面的显示参数后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
下面用一个示例介绍在MCU本地监控台进行调整的过程。
在MCU本地的监控台上，用户对待变动大小的子画面(即指定或选中的子画面)，通过拖拽画面边缘或边角实现对该子画面尺寸的设定(相当于生成调整请求)，然后MCU根据设定的尺寸改变该子画面的显示尺寸。选中的子画面的显示尺寸变动后，就会涉及到其余子画面的重新布局。如果该选中的子画面尺寸扩大，就会占据相邻子画面的部分区域，所占据的区域形成交叠区域；交叠区域可以采用遮盖或透明叠加的方式处理，除尺寸变大的子画面之外的其它子画面也可以自动变小以避免产生交叠区域；如果该选中的子画面尺寸缩小，缩小后的子画面和相邻子画面之间就可能出现空隙，这些空隙可以填充为纯色或选定的图案，除尺寸变小的子画面之外的其它子画面尺寸保持不变，或者自动变大以填充画面。上述方案中提到的尺寸变化都包括但不限于等宽高比缩放的方式；如果其它子画面尺寸变大或缩小后出现交叠/空隙，参照上文进行处理即可；
在MCU本地的监控台上，用户对待变动位置的子画面(即指定或选中的子画面)，通过拖动画面实现对该子画面位置的设定(相当于生成调整请求)，然后MCU根据设定的位置改变该子画面的显示位置。选中的子画面的显示位置变动后，涉及到其余子画面的重新布局。如果该选中的子画面向整幅画面(即所述多画面的显示区域)的内侧移动(即：向中心位置移动)，就会占据相邻子画面的部分区域，所占据的区域形成交叠区域，交叠区域可以采用遮盖或透明叠加的方式处理，除位置移动的子画面之外的其它子画面也可以自动变小以避免产生交叠区域，位置移动的子画面移出后的空隙位置可以填充为纯色或选定的图案；如果该选中的子画面向整幅画面的外侧移动(即：向边缘位置移动)，移动后选中的子画面的部分区域可能会位于整幅画面之外，可以只显示该选中的子画面尚在整幅画面内的剩余部分，或者缩小选中的子画面使其完全位于整幅画面之内，移动后的子画面和相邻子画面留有空隙，这些空隙可以填充为纯色或选定的图案，除位置移动的子画面之外的其它子画面尺寸保持不变，或者自动变大以填充画面。上述方案中提到的尺寸变化都包括但不限于等宽高比缩放的方式；如果其它子画面尺寸变大
或缩小后出现交叠/空隙，参照上文进行处理即可。
下面用一个示例介绍通过终端进行调整的过程。
对于支持屏幕选中及拖拽操作的终端，用户可以选中想要调整大小的子画面(即指定或选中的子画面)，通过拖拽画面边缘或边角实现对该子画面尺寸的设定，然后终端把设定的尺寸上报给MCU，接下来的实现方法与在MCU本地监控台进行调整的过程相同；
对于支持屏幕选中及拖拽操作的终端，用户可以选中想要移动位置的子画面(即指定或选中的子画面)，通过拖动画面实现对该子画面位置的设定，然后终端把设定的位置上报给MCU，接下来的实现方法与在MCU本地监控台进行调整的过程相同。
下面用一个示例介绍通过遥控器进行调整的过程。
对于仅支持遥控器的会议电视终端，用户在出现多画面的界面上，先选中需要调整大小的子画面(即指定或选中的子画面)，使用一些按键的组合，比如通过使用“确认”键和“方向”键等方式，使该子画面处于调整尺寸的状态，再通过操作一些按键，可以实现有限级的放大缩小(在MCU本地监控台或通过终端调整的方案中变化可以包含无级缩放的方式)，然后终端把设定的尺寸上报给MCU，接下来的实现方法与在MCU本地监控台进行调整的过程相同；
对于仅支持遥控器的会议电视终端，用户在出现多画面的界面上，先选中需要移动位置的子画面(即指定或选中的子画面)，使用一些按键的组合，比如通过使用“确认”键和“方向”键，使该子画面处于移动位置的状态，再通过操作“方向”键，可以实现选定子画面的移动，移动到想要设定的位置后确认，然后终端把设定的位置上报给MCU，接下来的实现方法与在MCU本地监控台进行调整的过程相同。
下面结合附图对本发明实施例的技术方案进行详细阐述。
图3是采用本发明实施例所述的多画面调整方法的会议电视系统框图。每个组成部分的功能简单介绍如下：
MCU 101是实现多画面会议电视系统的核心，设置成接收终端103～105的压缩视频流，解码后根据会议的要求进行相应的转码缩放操作，然后按照布局要求，根据相应参数生成多画面，再编码发给终端103～105；在调整子画面大小和布局的时候，如果在MCU本地的监控台操作，它还可以作为设定的尺寸、位置的直接输入端；
终端103～105通过网络102与MCU 101相连，终端103～105分别向MCU 101发送单画面视频数据，同时接收MCU 101发出的多画面视频数据，这里提到的视频数据都是经过某种编码算法处理的压缩码流，如果在终端103～105上进行子画面大小和布局的调整时，为指定的子画面设定的尺寸、位置会通过网络102上传给MCU 101；其中：
会议电视终端103，装备有控制台，支持鼠标操作；或者配备有触摸屏支持触控操作；或者配有按键遥控器。通过鼠标、触控对需要调整尺寸或位置的子画面实施选中、拖拽缩放、点击缩放、拖拽移动等操作；通过按键的组合，对需要调整尺寸或位置的子画面实施选中、点击缩放、点击移动等操作。会议电视终端103会把为指定的子画面设定的尺寸、位置等变动的信息上传给MCU 101；
桌面终端104，具备支持鼠标或触屏进行屏幕拖拽的操作，用户可以选中需要调整尺寸或位置的子画面，然后实施拖拽缩放、点击缩放、拖拽移动等操作，桌面终端104会把为指定的子画面设定的尺寸、位置等变动的信息上传给MCU 101；
移动终端105，具备触屏进行屏幕拖拽的操作，用户可以选中需要调整尺寸或位置的子画面，然后实施拖拽缩放、点击缩放、拖拽移动等操作，移动终端105会把指定的子画面，设定的尺寸、位置等变动的信息上传给MCU101。
图4(a)～(d)是多画面会议电视常见的子画面布局方式，以16：9宽高比的6画面为例：
示意图4(a)
左上角为大的子画面1，占据4/9的面积，画面2～6为小的子画面，各自占据1/9的面积，所有的子画面无缝的拼接在一起，组成一个6画面；
示意图4(b)：
右上角为大的子画面1，占据4/9的面积，画面2～6为小的子画面，各自占据1/9的面积，所有的子画面无缝的拼接在一起，组成一个6画面；
示意图4(c)：
左下角为大的子画面1，占据4/9的面积，画面2～6为小的子画面，各自占据1/9的面积，所有的子画面无缝的拼接在一起，组成一个6画面；
示意图4(d)：
右下角为大的子画面1，占据4/9的面积，画面2～6为小的子画面，各自占据1/9的面积，所有的子画面无缝的拼接在一起，组成一个6画面。
图5是多画面会议电视中子画面改变大小后的布局示意图，以针对示意图4(a)的布局进行调整为例说明：
示意图5(a)：
先选中图4(a)中的子画面6，通过拖拽或点击等方式增大其尺寸，包括但不限于宽高比维持不变的尺寸增大方式，尺寸最大可以调整到铺满整个屏幕，图5(a)演示了子画面6向左下角等宽高比增大尺寸的效果。子画面6增大之后会占据邻近的子画面的位置，如图5(a)所示，占据了子画面5的全部区域，占据了子画面1～4的部分区域，如果子画面1～5尺寸维持不变的话，对交叠区域的处理可以采用遮盖或者透明叠加的方式；如果子画面1～5尺寸随着子画面6变大也发生变化的话，效果参考示意图5(b)；
示意图5(b)：
子画面6的尺寸变大，占据了邻近的子画面的区域。子画面1～5尺寸随之发生变化，采用包括但不限于等宽高比的变化方式，图5(b)演示了子画面1～5等宽高比减少尺寸的效果。子画面1～5等宽高比缩小之后，画面会出现一些空隙(图5(b)中网格线部分的区域)，这些空隙可以采用填充包括但不限于纯色的方式，比如但不限于填充纯黑色。
示意图5(c)：
选中图4(a)中的子画面1，通过拖拽或点击等方式减小其尺寸，包括但不限于宽高比维持不变的尺寸减小方式，图5(c)演示了子画面1向左上角等宽高比减少尺寸的效果。子画面1减小之后，子画面2～6的尺寸要么维持不变，要么包括但不限于等宽高比的扩大。上述变动之后产生的空隙区域(图5(c)中网格线部分的区域)可以采用填充包括但不限于纯色的方式，比如子画面1变小之后，子画面2～6的尺寸维持不变，用纯黑色填充空隙。
图6是多画面会议电视中子画面改变位置后的布局示意图，以针对示意图4(a)的布局进行调整为例说明：
示意图6(a)：
选中图4(a)中的子画面1，通过拖动方式移动其位置，图6(a)演示了子画面1向内侧即向右下角移动位置的效果。子画面1移动之后会占据邻近的子画面的区域，如图6(a)所示，占据了子画面2～6的部分区域，移动后左上角产生的空隙区域(图6(a)中网格线部分的区域)则可以填充纯黑色；如果子画面2～6尺寸维持不变的话，对交叠区域的处理可以采用遮盖或者透明叠加的方式；如果子画面2～6尺寸随着子画面1的移动也发生变化的话，效果参考示意图6(b)；
示意图6(b)：
选中图4(a)布局中的子画面1，通过拖动的方式使其位置发生变化，比如向内移动，占据了邻近的子画面2～6的部分区域。子画面2～6尺寸随之发生变化，采用包括但不限于等宽高比的变化方式，图6(b)演示了子画面2～6等宽高比减少尺寸的效果。子画面2～6等宽高比缩小之后，画面会出现一些空隙(图6(b)中网格线部分的区域)，这些空隙可以采用填充包括但不限于纯色的方式，比如填充纯黑色。
示意图6(c)：
选中图4(a)布局中的子画面1，通过拖动的方式使其位置发生变化，比如向外移动，图6(c)演示了子画面1向左上角移动的效果，移动后尚在
整幅画面的剩余部分可以单纯截屏(即：只显示该选中的子画面尚在整幅画面内的剩余部分)或者缩小子画面1，缩小采用包括但不限于等宽高比的变化方式。图6(c)演示了单纯截屏的效果，其中4031和4032为移出画面的部分，也就是单纯裁剪掉的部分。子画面1向外移动之后，子画面2～6的尺寸要么维持不变，要么包括但不限于等宽高比的扩大。上述变动之后产生的空隙区域可以采用填充包括但不限于纯色的方式，图6(c)演示了子画面1向外移动之后，子画面2～6的尺寸维持不变，可以用纯黑色填充空隙(图6(c)中网格线部分的区域)。
在为传统会议电视终端配置的按键遥控器中：
“方向”键：有上下左右四个方向，更高级的遥控器还增加了左上、右上、左下、右下等4个方向。本发明实施例中所述终端为会议电视终端时，包括但不限于采用上下左右四个方向的遥控器，包括但不限于采用按键遥控器。在本发明实施例中“方向”键起到选中、移动子画面的作用，以及模拟拖动画面边框的作用，在菜单操作中还有选择上下级菜单的作用；
“确认”键：对选中的子画面进行确认，对准备改变大小的子画面快速按动确认键，可以实现子画面的连续放大；在子画面连续放大、移动之后，经过一段时间间隔，再次“按动”确认键完成对所选尺寸和位置的确认；
“菜单”键：按下“菜单”键选中调整子画面菜单，再一步选择调整子画面大小或位置的下级菜单；
“返回”键：在完成按下子画面大小或位置的调整之后，用户通过按动“返回”键可以返回上一次的画面大小或位置，连续按动“返回”键则返回至最初的多画面布局；
在实际应用时，遥控器的按键及其组合在多画面调整中所起的作用不限于上文的描述，可以自行设置。
图7是一种使用按键遥控器选中、调整子画面大小、布局的流程图。
步骤601：
按“菜单”键，电视的多画面图像上会出现GUI(图形用户界面)菜单，选择进入调整子画面菜单，然后进入步骤602；
步骤602：
用户根据需要，选择调整子画面大小或位置的子菜单，如果选中调整子画面大小的子菜单，则进入步骤603a，如果选中调整子画面位置的子菜单，则进入步骤603b；
步骤603a：
此时已经进入选择子画面大小的状态，多画面图像中会有子画面被默认选中，本发明实施例包含但不限于步骤601～602中提到的选中方式。用户根据需要，通过按动“方向”键选中准备调整大小的子画面，然后就进入步骤604a，选择中可以用标框或凸出的方式表示已经选到的子画面；
步骤604a：
用户此时按“确认”键，表示已经选中的子画面准备调整大小的子画面，选中的子画面可以用标框或下沉的方式来表示，然后进入步骤605a；
步骤605a：
用户快速连续按“确认”键，选中的子画面尺寸会变大，最大可以铺满整个画面，每两次连续按键尺寸放大一级，放大到需要的尺寸后，暂停一段时间后，进入步骤606a。其中子画面尺寸放大后但未铺满整个画面的时候，其余子画面的布局参考示意图5(a)～(b)；
步骤606a：
放大到需要的尺寸后，暂停一段时间后，用户再次按“确认”键，选中子画面的尺寸则确认调整完成。如果用户想要缩小变大的子画面，则进入步骤607a；如果用户想要直接回到原始的多画面布局，则进入步骤608a；
步骤607a：
如果用户想要缩小变大的子画面，按“返回”键后子画面则缩小一级回到上一次的大小，直至回到原始的多画面布局；
步骤608a：
如果用户想要直接回到原始的多画面布局，快速连续按“返回”键后，则恢复到原始的多画面布局；
步骤603b：
此时已经进入选择子画面位置的状态，多画面图像中会有子画面被默认选中，本发明实施例包含但不限于步骤601～602中提到的选中方式。用户根据需要，通过按动“方向”键选中准备调整位置的子画面，然后就进入步骤604b，选择中可以用标框或凸出的方式表示已经选到的子画面；
步骤604b：
用户此时按“确认”键，表示已经选中的子画面准备调整大小的子画面，选中的子画面可以用标框或下沉的方式来表示，然后进入步骤605b；
步骤605b：
用户快速连续按“方向”键，选中的子画面位置会发生变化，每两次连续按键位置移动一格，移动到需要的位置后，暂停一段时间后，进入步骤606b。其中子画面移动的时候，其余子画面的布局参考示意图6(a)～(c)；
步骤606b：
移动到需要的位置后，暂停一段时间后，用户再次按“确认”键，选中子画面的位置则确认调整完成。如果用户想要退回到子画面上一次的位置，则进入步骤607b；如果用户想要直接回到原始的多画面布局，则进入步骤608b；
步骤607b：
如果用户想要退回到子画面上一次的位置，按“返回”键后子画面则退回一格，直至回到原始的多画面布局；
步骤608b：
如果用户想要直接回到原始的多画面布局，快速连续按“返回”键后，则恢复到原始的多画面布局。
实施例三、一种多点控制单元MCU，如图8所示，包括：
网络接口81，设置成接收从多个终端发过来的码流；
解码器82，设置成解码所述码流获得视频数据；
合成模块83，设置成将所述视频数据合成多画面；
编码器84，设置成将合成的多画面进行编码，通过所述网络接口发送；
其中：
所述网络接口还设置成接收对所述多画面中子画面的调整请求；
所述合成模块还设置成根据所述调整请求调整相应子画面的显示参数；
所述编码器还设置成将调整后的多画面编码，通过所述网络接口发送给相应终端。
所述网络接口还可以设置成发送参数给所述解码器、编码器以及合成模块。
可选地，所述MCU还包括MCU本地监控台；
所述MCU本地监控台包括：
显示屏，设置成显示所述多画面；
鼠标，设置成输入所述调整请求；
所述网络接口接收对所述多画面中子画面的调整请求包括：
所述网络接口从所述MCU本地监控台接收所述对多画面中子画面的调整请求，或从终端接收所述对多画面中子画面的调整请求。
可选地，所述调整请求包括：请求将指定的子画面调整为设定的尺寸；
所述合成模块根据调整请求调整相应子画面的显示参数包括：
所述合成模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
可选地，所述调整请求包括：请求将指定的子画面移动到设定的位置；
所述合成模块根据调整请求调整相应子画面的显示参数包括：
所述合成模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
可选地，所述合成模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定子画面进行裁剪或缩小。
可选地，所述合成模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
实施例四、一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述实施例一的方法。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序来指令相关硬件完成，所述程序可以存储于计算机或嵌入式系统可读写存储介质中，如只读存储器、可读写存储器、磁盘或光盘等。可选地，上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现。相应地，上述实施例中的模块/单元可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。本发明实施例不限制于任何特定形式的硬件和软件的结合。
本发明实施例的方案可以使会议电视的可操控性得到提高。在MCU、终端的硬件架构不做任何改变的情况下，可以满足会议电视对某个感兴趣的子画面单独调整大小和位置的需求，在画面数比较多的情况下尤其实用。
Claims (18)
- 一种多画面调整方法，包括：多点控制单元MCU接收从多个终端发过来的码流，解码获得视频数据后合成多画面；所述MCU接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；所述MCU将调整后的多画面编码发送给相应终端。
- 如权利要求1所述的方法，其中，所述所述MCU接收对所述多画面中子画面的调整请求包括：所述MCU从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。
- 如权利要求1所述的方法，其中：所述调整请求包括：请求将指定的子画面调整为设定的尺寸；所述根据调整请求调整相应子画面的显示参数包括：根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
- 如权利要求1所述的方法，其中：所述调整请求包括：请求将指定的子画面移动到设定的位置；所述根据调整请求调整相应子画面的显示参数包括：根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
- 如权利要求4所述的方法，其中，所述根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后还包括：当所述指定的子画面的部分区域位于所述多画面的显示区域之外时，按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指 定的子画面进行裁剪或缩小。
- 如权利要求1～5中任一项所述的方法，其中，所述根据调整请求调整相应子画面的显示参数后还包括：当调整后所述多画面的显示区域中出现无内容区域时，相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；当调整后所述多画面的显示区域中出现子画面交叠区域时，相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
- 一种多画面调整装置，设置于多点控制单元MCU中，包括：处理模块，设置成接收从多个终端发过来的码流，解码获得视频数据后合成多画面；调整模块，设置成接收对所述多画面中子画面的调整请求，根据所述调整请求调整相应子画面的显示参数；发送模块，设置成将调整后的多画面编码发送给相应终端。
- 如权利要求7所述的装置，其中，所述调整模块接收对所述多画面中子画面的调整请求包括：所述调整模块从MCU本地监控台或终端接收所述对多画面中子画面的调整请求。
- 如权利要求7所述的装置，其中：所述调整请求包括：请求将指定的子画面调整为设定的尺寸；所述调整模块根据调整请求调整相应子画面的显示参数包括：所述调整模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
- 如权利要求7所述的装置，其中：所述调整请求包括：请求将指定的子画面移动到设定的位置；所述调整模块根据调整请求调整相应子画面的显示参数包括：所述调整模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
- 如权利要求10所述的装置，其中：所述调整模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
- 如权利要求7～11中任一项所述的装置，其中：所述调整模块还设置成在根据调整请求调整相应子画面的显示参数后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
- 一种多点控制单元MCU，包括：网络接口，设置成接收从多个终端发过来的码流；解码器，设置成解码所述码流获得视频数据；合成模块，设置成将所述视频数据合成多画面；编码器，设置成将合成的多画面进行编码，通过所述网络接口发送；其中：所述网络接口还设置成接收对所述多画面中子画面的调整请求；所述合成模块还设置成根据所述调整请求调整相应子画面的显示参数；所述编码器还设置成将调整后的多画面编码，通过所述网络接口发送给相应终端。
- 如权利要求13所述的多点控制单元，还包括：MCU本地监控台；所述MCU本地监控台包括：显示屏，设置成显示所述多画面；鼠标，设置成输入所述调整请求；所述网络接口接收对所述多画面中子画面的调整请求包括：所述网络接口从所述MCU本地监控台接收所述对多画面中子画面的调整请求，或从终端接收所述对多画面中子画面的调整请求。
- 如权利要求13所述的多点控制单元，其中：所述调整请求包括：请求将指定的子画面调整为设定的尺寸；所述合成模块根据调整请求调整相应子画面的显示参数包括：所述合成模块根据所述调整请求将所述指定的子画面的显示尺寸调整为所述设定的尺寸。
- 如权利要求13所述的多点控制单元，其中：所述调整请求包括：请求将指定的子画面移动到设定的位置；所述合成模块根据调整请求调整相应子画面的显示参数包括：所述合成模块根据所述调整请求将所述指定的子画面的显示位置调整为所述设定的位置。
- 如权利要求16所述的多点控制单元，其中：所述合成模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果所述指定的子画面的部分区域位于所述多画面的显示区域之外，则按照所述指定的子画面在所述多画面的显示区域中所占区域的尺寸，对所述指定的子画面进行裁剪或缩小。
- 如权利要求13～17中任一项所述的多点控制单元，其中：所述合成模块还设置成在根据调整请求将所述指定的子画面的显示位置调整为所述设定的位置后，如果调整后所述多画面的显示区域中出现无内容区域，则相应将其它子画面的显示尺寸调大或者采用预定图案填充所述无内容区域；如果调整后所述多画面的显示区域中出现子画面交叠区域时，则相应将其它子画面的显示尺寸调小或者采用预定方式显示所述交叠区域的内容。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP16785927.1A EP3276954A4 (en) | 2015-04-30 | 2016-04-27 | Multi-image adjusting method and device, and multipoint controller unit |
| US15/569,391 US20180295326A1 (en) | 2015-04-30 | 2016-04-27 | Multi-Image Adjusting Method and Device, and Multipoint Controller Unit |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510216792.0 | 2015-04-30 | ||
| CN201510216792.0A CN106210599B (zh) | 2015-04-30 | 2015-04-30 | 一种多画面调整方法、装置及多点控制单元 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016173496A1 true WO2016173496A1 (zh) | 2016-11-03 |
Family
ID=57199687
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/080390 WO2016173496A1 (zh) | 2015-04-30 | 2016-04-27 | 一种多画面调整方法、装置及多点控制单元 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20180295326A1 (zh) |
| EP (1) | EP3276954A4 (zh) |
| CN (1) | CN106210599B (zh) |
| WO (1) | WO2016173496A1 (zh) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110049277A (zh) * | 2019-05-28 | 2019-07-23 | 南京南方电讯有限公司 | 一种会议接入实现方法 |
| US11517577B2 (en) | 2018-07-30 | 2022-12-06 | NZP UK Limited | Fluorinated bile acid derivatives |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756768A (zh) * | 2017-11-08 | 2019-05-14 | 中国电信股份有限公司 | 视频流处理方法、装置和视频流显示方法、装置 |
| CN109257546A (zh) * | 2018-09-26 | 2019-01-22 | 北京大米未来科技有限公司 | 一种视频显示方法、装置、电子设备及介质 |
| CN109120867A (zh) * | 2018-09-27 | 2019-01-01 | 乐蜜有限公司 | 视频合成方法及装置 |
| CN113115108A (zh) * | 2018-12-20 | 2021-07-13 | 聚好看科技股份有限公司 | 一种视频处理方法及计算设备 |
| US10666902B1 (en) * | 2019-01-30 | 2020-05-26 | Microsoft Technology Licensing, Llc | Display conflict elimination in videoconferencing |
| CN110264543B (zh) * | 2019-06-21 | 2022-07-12 | 苏州科达科技股份有限公司 | 拼接画面的边框绘制方法、装置及存储介质 |
| CN112422879B (zh) * | 2019-08-20 | 2022-10-28 | 华为技术有限公司 | 媒体能力动态调整方法及装置 |
| CN110784774A (zh) * | 2019-09-23 | 2020-02-11 | 视联动力信息技术股份有限公司 | 视频窗口移动方法、装置及计算机可读存储介质 |
| CN112738452A (zh) * | 2019-10-10 | 2021-04-30 | 西安诺瓦星云科技股份有限公司 | 画面预监和图像处理方法、装置及其应用 |
| CN112558854B (zh) * | 2020-12-07 | 2022-06-24 | 深圳市捷视飞通科技股份有限公司 | 多画面分屏模式定制方法、装置和计算机设备 |
| CN113055615B (zh) * | 2021-02-01 | 2024-05-03 | 广州朗国电子科技股份有限公司 | 会议一体机、屏幕切分显示方法以及存储装置 |
| CN113315927B (zh) * | 2021-05-27 | 2023-04-28 | 维沃移动通信有限公司 | 视频处理方法和装置、电子设备和存储介质 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5764277A (en) * | 1995-11-08 | 1998-06-09 | Bell Communications Research, Inc. | Group-of-block based video signal combining for multipoint continuous presence video conferencing |
| CN101026702A (zh) * | 2006-02-23 | 2007-08-29 | 三星电子株式会社 | 同时显示多频道可视图像的数字广播接收器及其显示方法 |
| CN101582254A (zh) * | 2008-05-13 | 2009-11-18 | 深圳华为通信技术有限公司 | 一种图像呈现方法及装置 |
| CN102111605A (zh) * | 2009-12-28 | 2011-06-29 | 杭州华三通信技术有限公司 | Mcu多画面分屏实现方法及mcu |
| US20110205333A1 (en) * | 2003-06-03 | 2011-08-25 | Duanpei Wu | Method and apparatus for using far end camera control (fecc) messages to implement participant and layout selection in a multipoint videoconference |
| CN102685415A (zh) * | 2011-03-18 | 2012-09-19 | 华为终端有限公司 | 一种视频画面处理方法、系统、设备及终端 |
| CN102833518A (zh) * | 2011-06-13 | 2012-12-19 | 华为终端有限公司 | 一种mcu多画面优化配置的方法及装置 |
| CN103873813A (zh) * | 2012-12-10 | 2014-06-18 | 中兴通讯股份有限公司 | 一种会议电视多画面切换的方法及系统 |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1381237A3 (en) * | 2002-07-10 | 2004-05-12 | Seiko Epson Corporation | Multi-participant conference system with controllable content and delivery via back-channel video interface |
| US7176957B2 (en) * | 2004-05-25 | 2007-02-13 | Seiko Epson Corporation | Local video loopback method for a multi-participant conference system using a back-channel video interface |
| US7477281B2 (en) * | 2004-11-09 | 2009-01-13 | Nokia Corporation | Transmission control in multiparty conference |
| CN102090069B (zh) * | 2008-06-09 | 2014-04-30 | 维德约股份有限公司 | 可缩放视频和音频通信系统中的改进视图布局管理 |
| US8228363B2 (en) * | 2009-01-30 | 2012-07-24 | Polycom, Inc. | Method and system for conducting continuous presence conferences |
| NO331338B1 (no) * | 2009-06-24 | 2011-11-28 | Cisco Systems Int Sarl | Fremgangsmate og anordning for endring av en videokonferanse-layout |
| US8786665B2 (en) * | 2010-04-27 | 2014-07-22 | Lifesize Communications, Inc. | Streaming a videoconference from a server including boundary information for client layout adjustment |
| CN101951493A (zh) * | 2010-09-25 | 2011-01-19 | 中兴通讯股份有限公司 | 移动终端及其视频通话中对远端图像局部放大方法 |
| CN104571872A (zh) * | 2015-01-27 | 2015-04-29 | 深圳市中兴移动通信有限公司 | 一种移动终端的分屏管理方法及装置 |
-
2015
- 2015-04-30 CN CN201510216792.0A patent/CN106210599B/zh active Active
-
2016
- 2016-04-27 EP EP16785927.1A patent/EP3276954A4/en not_active Ceased
- 2016-04-27 US US15/569,391 patent/US20180295326A1/en not_active Abandoned
- 2016-04-27 WO PCT/CN2016/080390 patent/WO2016173496A1/zh active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5764277A (en) * | 1995-11-08 | 1998-06-09 | Bell Communications Research, Inc. | Group-of-block based video signal combining for multipoint continuous presence video conferencing |
| US20110205333A1 (en) * | 2003-06-03 | 2011-08-25 | Duanpei Wu | Method and apparatus for using far end camera control (fecc) messages to implement participant and layout selection in a multipoint videoconference |
| CN101026702A (zh) * | 2006-02-23 | 2007-08-29 | 三星电子株式会社 | 同时显示多频道可视图像的数字广播接收器及其显示方法 |
| CN101582254A (zh) * | 2008-05-13 | 2009-11-18 | 深圳华为通信技术有限公司 | 一种图像呈现方法及装置 |
| CN102111605A (zh) * | 2009-12-28 | 2011-06-29 | 杭州华三通信技术有限公司 | Mcu多画面分屏实现方法及mcu |
| CN102685415A (zh) * | 2011-03-18 | 2012-09-19 | 华为终端有限公司 | 一种视频画面处理方法、系统、设备及终端 |
| CN102833518A (zh) * | 2011-06-13 | 2012-12-19 | 华为终端有限公司 | 一种mcu多画面优化配置的方法及装置 |
| CN103873813A (zh) * | 2012-12-10 | 2014-06-18 | 中兴通讯股份有限公司 | 一种会议电视多画面切换的方法及系统 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3276954A4 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11517577B2 (en) | 2018-07-30 | 2022-12-06 | NZP UK Limited | Fluorinated bile acid derivatives |
| CN110049277A (zh) * | 2019-05-28 | 2019-07-23 | 南京南方电讯有限公司 | 一种会议接入实现方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210599A (zh) | 2016-12-07 |
| CN106210599B (zh) | 2021-02-12 |
| EP3276954A1 (en) | 2018-01-31 |
| EP3276954A4 (en) | 2018-03-28 |
| US20180295326A1 (en) | 2018-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016173496A1 (zh) | 一种多画面调整方法、装置及多点控制单元 | |
| US20220182729A1 (en) | Windows management in a television environment | |
| US8547414B2 (en) | Touch screen video switching system | |
| WO2021175269A1 (zh) | 一种图像处理的方法及移动终端 | |
| US11153625B2 (en) | Image display method, image distribution method, image display apparatus, and image distribution apparatus | |
| CN102547069B (zh) | 移动终端及其图像分屏处理方法 | |
| US20200059675A1 (en) | Image display method and image display apparatus | |
| US7903903B1 (en) | Integrated live video production system | |
| US8456571B1 (en) | Integrated live video production system | |
| US20110022988A1 (en) | Providing user interface for three-dimensional display device | |
| KR20100036664A (ko) | 영상 이동이 가능한 디스플레이 장치 및 그 방법 | |
| WO2012092853A1 (zh) | 视频会议的控制方法和会议终端 | |
| KR20220029789A (ko) | 전화 통화 중의 화상 회의 설정 | |
| US20200186887A1 (en) | Real-time broadcast editing system and method | |
| WO2008013046A1 (fr) | Dispositif d'affichage d'image, procédé d'affichage d'image, programme d'affichage d'image et support d'enregistrement | |
| JP2012094111A (ja) | 画像処理装置、画像処理方法及びプログラム | |
| US10448100B2 (en) | Display apparatus and control method thereof | |
| CN104853065A (zh) | 双导播界面控制平台 | |
| US20140101700A1 (en) | Touch screen video switching system | |
| KR20120065689A (ko) | 영상처리장치 및 그 ｕｉ 제공 방법 | |
| US20180247672A1 (en) | Bundling Separate Video Files to Support a Controllable End-User Viewing Experience with Frame-Level Synchronization | |
| CN105812883A (zh) | 视频译码方法以及应用此方法的电子系统 | |
| WO2015176489A1 (zh) | 画面亮度调整方法、多点控制单元mcu及终端 | |
| CN114866841B (zh) | 具有回显功能的超高清多画面显示系统及方法 | |
| CN107295247B (zh) | 图像记录装置及其控制方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16785927 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 15569391 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |