CN100583985C - Method, apparatus and system for switching pictures in video service - Google Patents

Method, apparatus and system for switching pictures in video service Download PDF

Info

Publication number
CN100583985C
CN100583985C CN200710097575A CN200710097575A CN100583985C CN 100583985 C CN100583985 C CN 100583985C CN 200710097575 A CN200710097575 A CN 200710097575A CN 200710097575 A CN200710097575 A CN 200710097575A CN 100583985 C CN100583985 C CN 100583985C
Authority
CN
China
Prior art keywords
picture
image
blender
user
display mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200710097575A
Other languages
Chinese (zh)
Other versions
CN101031065A (en
Inventor
朱祥文
吴宗武
周旭锋
莫燕
瞿新
刘家锋
李渊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN200710097575A priority Critical patent/CN100583985C/en
Publication of CN101031065A publication Critical patent/CN101031065A/en
Priority to PCT/CN2008/000848 priority patent/WO2008131644A1/en
Application granted granted Critical
Publication of CN100583985C publication Critical patent/CN100583985C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention is used for solving the issue existed in currently-used technology that is the video service users can not select image-displaying mode according to their needs. The method thereof comprises: multi-point controller receives a switch request message comprising the amount of sub-images indicated by the image-displaying mode; according to the image-displaying mode the multi-point controller determines the image mixer required by the image-displaying mode, and outputs the images corresponding to the image-displaying mode to the user end sending the switch request message.

Description

A kind of method, Apparatus and system of in video traffic, realizing the picture switching
Technical field
The present invention relates to the multimedia video technique of the communications field, particularly a kind of method, Apparatus and system of in video traffic, realizing the picture switching.
Background technology
Video conferencing system allows meeting participant interactive voice, video and data in real time, be very easy between the meeting participant communication with exchange.In the video conferencing system network configuration as shown in Figure 1, multipoint control unit (MCU, Multipoint Control Unit) connect each meeting-place participate in a conference, be used for reception meeting field signal, processing meeting field signal and will handle after the meeting field signal be issued to each meeting-place of participant; Subscriber terminal equipment is mainly realized the input and output of voice, image and data, and communicates functions such as connection and data transmit-receive; Plural subscriber terminal equipment and MCU have made up a multiple spot, real-time conference communication environment, and the user watches other users' image and listen to other users' sound by terminal equipment.
For satisfying the demand that participant in the video conference can understand other participants' of all or part image information at one time simultaneously, prior art provides the mode that can realize in video conference that many pictures show:
The main handling process of the implementation method that a kind of many pictures show is as follows:
1, will pass through H.221 frame processing module processing from the meeting-place image terminal data of each conference terminal, and form and satisfy the H.221 multiple source high speed serialization view data code stream of standard;
2, described multiple source high speed serialization code image data stream is by source high-speed serial data passage, the footpath switching net exchanges to one or more target high-speed serial data passages, forms one or more target high speed serialization view data code streams of video wall target monitoring terminal;
3, the destination image data code stream is sent to the picture decoding module, forms H.261 form or the H.263 laggard line number word image decoding of image code stream of form, obtain CCIR601 format standard digital picture and CLV Common Intermediate Format CIF standard digital image through separating frame;
4, CCIR601 format standard digital picture is carried out analog image coding, be converted to and be sent to video wall target monitoring terminal behind the analog video signal and show;
5, described CIF standard digital image is sent to the combined picture that the picture composition module combinations becomes certain pattern, form the multiple image data code flow with carrying out framing behind the combined picture coding, by switching net exchange and H.221 the frame processing module send to each terminal after handling, thereby realize that the many pictures of each terminal show.
This technical scheme is primarily aimed at certain concrete TV conference system, need establish the video conferencing wall at the MCU bogie side frame, so application limitation is bigger; Each can only watch identical multiple image with the user in this method in addition, can not independently select picture, can not realize simultaneously mutual conversion between many pictures and the single-image to select interested a certain participant's image information, therefore many menu display functions are single.
Another kind of realize the method for many pictures by the transcoder of video conferencing system, its main handling process is as follows:
1, the user video signal that receives is decoded, sampled, and each vision signal that will obtain after will sampling deposits in the internal memory;
2, from this internal memory, read each vision signal after the sampling by a plurality of picture recombiners and carry out compoundly, form a plurality of identical compound many pictures;
3, encoded by the corresponding codes device in each compound many pictures back of sampling, and the vision signal after the output encoder compression.
This technical scheme has solved the problem that a plurality of user video signals have different image pixel precision by transcoder, but, each participant user can only watch identical multiple image in this method, can not independently select picture, can not realize simultaneously mutual conversion between many pictures and the single-image to select interested a certain participant's image information, therefore many menu display functions are single.
The number of number that has participated in also providing in video conference is carried out according to video conference in the prior art or the video source that is input to video conferencing system is the method for the composite mode of the many pictures of decision dynamically, when the number of participant in the video conference increases or reduce, the corresponding dynamic adjustment of the composite mode of many pictures, but, each participant user can only watch identical multiple image in this method, can not independently select picture, can not realize simultaneously mutual conversion between many pictures and the single-image to select interested a certain participant's image information, many menu display functions are single.
In summary it can be seen, exist the single problem of many menu display functions in the process that the many pictures of realization show in the existing video conference, each participant user can only watch identical multiple image simultaneously, and can not be according to watching needs to select the picture display mode, can not between many pictures display mode and single-image display mode, switch simultaneously, therefore in video conference, can not satisfy user's the demand of watching.
Summary of the invention
The embodiment of the invention provides a kind of method, Apparatus and system that picture switches of realizing in video traffic, be used to realize that the user who participates in video traffic can independently select the picture display mode to watch image as required.
A kind of method that realizes the picture switching in video traffic comprises step:
Multipoint control unit MCU receives handoff request message, and described request message comprises that the picture display mode shows the sprite number that picture shows;
Described MCU determines the picture blender of needs according to described picture display mode, and to the user terminal output and the corresponding picture image of picture display mode of asking that send handoff request message.
A kind of picture device for switching that realizes in video traffic comprises:
Control module is used to manage the control information of many pictures, and to the user terminal displaying video menu prompt information that participates in video traffic, and according to the dynamically definite picture blender of the picture display mode of user's selection;
Decoder module is used for the video source code image data stream of each user terminal is decoded;
The picture composition module is used for carrying out many picture compositions according to described many pictures control information by one or more picture blenders;
Coding module is used for the multiple image information after the combination is carried out corresponding encoded, and the multiple image that obtains is exported to user terminal.
A kind of video service system, a plurality of user terminals that comprise multipoint control unit MCU, link to each other with described MCU by network; Described MCU is to the user terminal displaying video menu prompt information that participates in video traffic; User terminal sends handoff request message according to the picture display mode that the user selects to described MCU, and described picture display mode shows the sprite number that picture shows; Described MCU determines the picture blender of needs according to described picture display mode, and to the user terminal output and the corresponding picture image of picture display mode of asking that send handoff request message.
Above-mentioned multipoint control unit MCU exports the picture image corresponding with this picture display mode according to the picture display mode that the user selects to the terminal at this user place, the user who participates in video traffic can watch image with identical picture display mode, also can independently select the picture display mode to watch image as required, realize the user in the flexible switching between many pictures display mode, between many pictures display mode and the single-image display mode, satisfied the demand that the user differentiation is watched conference image.
Description of drawings
Fig. 1 is a meeting video system configuration schematic diagram in the prior art;
Fig. 2 is a multipoint control unit structural representation in the embodiment of the invention;
Fig. 3 is a picture composition modular structure schematic diagram in the embodiment of the invention;
Fig. 4 is many pictures display mode schematic diagram in the embodiment of the invention;
Fig. 5 A be in the embodiment of the invention a plurality of user terminals with the realization schematic diagram of four picture display mode display conference images;
Fig. 5 B be in the embodiment of the invention a plurality of user terminals with the schematic diagram of four picture display mode display conference images;
Fig. 6 A is the realization flow figure that user A selects six picture display mode display conference images in the embodiment of the invention;
Fig. 6 B is when user A selects six picture display modes in the embodiment of the invention, the schematic diagram of user A, B, C, D terminal display conference image;
Fig. 7 A is the realization flow figure that user C selects single-image display mode display conference image in the embodiment of the invention;
Fig. 7 B is when user C selects the single-image display mode in the embodiment of the invention, the schematic diagram of user A, B, C, D terminal display conference image;
Fig. 8 A is the realization flow figure of frame sign sprite in the embodiment of the invention;
Fig. 8 B is the demonstration schematic diagram of frame sign sprite in the embodiment of the invention.
Embodiment
For solve the problem that many menu display functions are single and the user can not change in the prior art between many pictures and single-image display mode, present embodiment is that example is elaborated to embodiment of the invention technical scheme with the video conferencing system.
Video conferencing system in the present embodiment as shown in Figure 1, the a plurality of user terminals that comprise multipoint control unit MCU, are connected with MCU by network, wherein, multipoint control unit MCU structure as shown in Figure 2, this MCU comprises control module 20, decoder module 21, picture composition module 22 and coding module 23; Wherein:
Control module 20, be used to manage the control information of many pictures, this information is by consulting to obtain with the user terminal that participates in video conference, and to the user terminal displaying video menu prompt information that participates in video conference, and the picture display mode dynamic assignment picture blender of selecting according to the user; Described many pictures control information comprises input video source information, picture mixed information and many pictures output information; Input video source information comprises the identification information of each decoder and each input video source image pixel precision etc.; The picture mixed information comprises the attribute information of number, multiple image pixel accuracy and each picture blender of all the picture blenders that need support of this meeting-place, wherein, the multiple image pixel accuracy is defined as the maximum image pixel accuracy in each participant terminal usually, also can be provided with according to system's needs, the attribute information of picture blender comprises the position of each sprite in pattern that many pictures show, this many pictures display mode and the identification information of the corresponding encoder of each sprite etc.; Many pictures output information comprises each encoder identification information, corresponding blender sign and output image pixel accuracy etc.
Described control module 20 is specified the picture blender of an acquiescence when the video conference initialization, the attribute of this picture blender can carry out dynamically changing according to the user terminal quantity that participates in video conference in the process in meeting, but can not delete; Carry out in the process in video conference, determine corresponding picture blender, can increase corresponding picture and mix blender, also can dynamically delete these picture blenders according to the picture display mode that the user selects.
Decoder module 21 is made up of a plurality of decoders, is used for the video source image code stream of the user terminal that participates in video conference is decoded, and sends the video source image information that decoding obtains to picture composition module 22 by data/address bus; The decoding algorithm that each image code stream of user terminal output is corresponding to be distributed a decoder, each decoder to use the image code stream encryption algorithm with input to be complementary (as H.263, MPEG-4 etc.) the input picture code stream is decoded, restore image information; Each decoder is all supported multiple decoding algorithm, carries out the initialization matching algorithm when distributing to the input picture code stream.
Picture composition module 22, be used for by one or more picture blenders a plurality of video source image informations of decoder output being carried out many picture compositions, and the multiple image information after will making up sends coding module 23 to by data/address bus according to the control information of many pictures; As shown in Figure 3, described picture composition module 22 further comprises: view data input unit 220 is used to receive the video source image information that described decoder module 21 is exported; A plurality of first samplers 221, be used for pixel accuracy and this video source image image pixel precision of correspondence position in many pictures of the corresponding video source image of view data input unit 220 are compared, when both are inconsistent, the video source image information is sampled, and the video source image information after will sampling outputs to picture blender 222; Otherwise, the video source image information is directly outputed to picture blender 222; Sampling comprises and rises sampling and down-sampled, as being that the image drop sampling of 704 * 576 (4CIF) is the image of 352 * 288 (CIF) with pixel accuracy, perhaps be that the image liter of 176 * 144 (QCIF) is sampled as the image that pixel accuracy is 352 * 288 (CIF) with pixel accuracy; Picture blender 222 be used for each video source image information of first sampler, 221 outputs is carried out many picture compositions, and the multiple image information after will making up outputs to second sampler 223; A plurality of second samplers 223, be used for the pixel accuracy of the multiple image of picture blender 222 output and the output image pixel accuracy of many pictures output information are compared, when both are inconsistent, multiple image information carried out corresponding sampling and will sample after the multiple image information that obtains send image data-outputting unit 224 to by data/address bus; Otherwise, multiple image information is directly outputed to image data-outputting unit 224; Image data-outputting unit 224 is used for image information is exported to coding module 23.
Picture blender 222 in the described picture composition module 22 can be one or more, the first picture blender is designated or be set to give tacit consent to the picture blender when conference initiation, the first picture blender attribute can carry out changing in the process in meeting, but can not be deleted; In meeting is carried out, can increase other picture blenders, also can dynamically delete this picture blender, to satisfy the demand of watching of user's differentiation; Control module 20 is according to user's operation information, input video source information in the control information of many pictures, picture mixed information and many pictures output information are refreshed, and first sampler 221, picture blender 222 and second sampler 223 are handled accordingly according to new many pictures control information.
Coding module 23, form by a plurality of encoders, be used for the multiple image information of picture composition module 22 outputs is encoded, the multiple image compressed bit stream that formation and participant decoding terminals algorithm are complementary, and it is outputed to each participant terminal respectively, the multiple image compressed bit stream that the participant end-on is received carries out behind the corresponding decoding showing in this locality multiple image; Each encoder is all supported multiple encryption algorithm, carries out initialization coupling when distributing to the output image code stream, and encoder can corresponding one or more participant terminals; The schematic diagram that the many pictures of participant terminal show as shown in Figure 4, many pictures display mode of each picture blender support can be wherein any, but does not limit to several situations of diagram.
In the present embodiment, MCU specifies the picture blender of an acquiescence and selects the picture display mode according to service needed during the video traffic initialization, thereby further carry out many picture compositions and realize that many pictures show by this acquiescence picture blender, can reduce the usage quantity of picture blender like this, thereby save resource.
In order to be illustrated more clearly in the implementation procedure that many pictures show in the present embodiment, describe below by concrete example.
Example one: user A, B, C and D terminal are connected in the video conference, and wherein, the video attribute of user A, B, C and D terminal is as shown in the table:
User terminal Image compression algorithm The image pixel precision
A H.263 CIF(352×288)
B MPEG-4 CIF(352×288)
C H.263 QCIF(176×144)
D MPEG-4 QCIF(176×144)
Control module initialization user A, B, C, D terminal are watched many pictures display mode of meeting, many pictures display mode of the first picture blender is set to four picture display modes, the image that is user A, B, C, D terminal respectively accounts for 1/4 of picture, and the multiple image pixel accuracy is chosen as CIF (352 * 288); Shown in Fig. 5 A, the realization principle that four pictures show is as follows:
After the user inserted the meeting-place, control module was distributed to each user's corresponding decoder and initialization decoding algorithm, and the video source image code stream that each decoder is imported each user is exported after being reduced into corresponding video source image information; H.263 the decoding algorithm that user A terminal corresponding decoder 1 and user C terminal corresponding decoder 3 are used is initialized as, and the decoding algorithm that user B terminal corresponding decoder 2 and user D terminal corresponding decoder 4 are used is initialized as MPEG-4; Decoder 1,2,3,4 is decoded to the image code stream of user A, B, C, D terminal respectively, and the video source image information that reduction obtains is outputed to view data input unit in the picture composition module respectively.
First sampler 1,2 judges that according to the pixel accuracy and the multiple image pixel accuracy of the video source image of user A, the input of B terminal the decoded picture informational needs of user A, B terminal correspondence is down-sampled, therefore first sampler 1,2 carries out down-sampledly respectively to the decoded picture information of user A, B terminal correspondence, and the image pixel precision that will obtain after will sampling is that the image of QCIF (176 * 144) outputs to the picture blender; Because the decoded picture pixel accuracy of user C, D terminal correspondence is QCIF (176 * 144), therefore first sampler 3,4 judges that its image information does not need to sample, and directly decoded picture information is outputed to the picture blender.
The video source image information of user A, the B that the picture blender is exported first sampler 1,2,3,4 according to the many pictures display mode in the picture mixed information, C, D terminal correspondence is combined into a four-picture image information, and outputs it to second sampler.
Second sampler 1,2 according to the output image pixel accuracy of each user terminal judge this four-picture image information pointer to user A, B terminal not needs sample, by image data-outputting unit it is exported to corresponding codes device 1,2 respectively; Second sampler 3,4 judges that this four-picture image information pointer need carry out down-sampled to user C, D terminal, therefore, 3,4 pairs of four-picture image information of second sampler are down-sampled, and the image pixel precision that will obtain after will sampling is that the image of QCIF (176 * 144) is exported to corresponding codes device 3,4 respectively by image data-outputting unit.
The four-picture image information of 1,2,3, the 4 pairs of picture composition modules of encoder output is encoded respectively, and the image compression code stream that output and user A, B, C, D decoding terminals algorithm are complementary is to corresponding user terminal.
Show four-picture image respectively in this locality after the image compressed code stream that user A, B, C, D end-on are received is decoded, the schematic diagram of its demonstration is shown in Fig. 5 B.
User A, B, C, D terminal are watched conference image with four identical picture display modes in the above-mentioned example, present embodiment user in meeting is carried out can pass through terminal operation and select other many pictures display modes to watch conference image, and free image switching display mode and do not influence watching of other participant sides, as shown in Figure 6A, the user to switch the specific implementation process of many pictures display mode as follows:
Step 600, MCU carry out timing displaying video menu prompt information in the process in meeting, and how the prompting user carries out associative operation.
Step 601, user select corresponding many picture display mode by terminal operation according to information when other many pictures display modes of needs are watched conference image, send handoff request by user place terminal to MCU.
Step 602, MCU upgrade the control information of many pictures according to handoff request, determine the picture blender that needs.
Step 603, MCU are carried out many picture compositions according to the many pictures control information after upgrading by the picture blender of determining, and satisfy the multiple image of many pictures display mode that the user selects and to the corresponding multiple image of other user terminals outputs to the user terminal output that sends handoff request.
Example two: in the meeting of example one is carried out, user A selects six picture display modes to watch conference image by terminal operation, send the request of image switching display mode to MCU by user A terminal, MCU upgrades the picture mixed information according to this request, and determine to need increasing by the second picture blender, its attribute comprises the position of each sprite in six picture display modes, this six pictures display mode and each sprite corresponding codes device identification information etc.First sampler is selected the decoded video source image information of user A, B, C, D terminal correspondence and it is carried out corresponding sampling processing according to the attribute information of input video source information and picture mixed information and the first picture blender and the second picture blender; The first picture blender and the second picture blender carry out four picture compositions and six picture compositions to each video source image information respectively; Four-picture image information after second sampler makes up the first picture blender is exported to user B terminal corresponding codes device 2 by image data-outputting unit, carry out the four-picture image information after the combination down-sampled, and the four-picture image information after will sampling exports to user C, D terminal corresponding codes device 3,4 by image data-outputting unit, and six picture image information after the combination of the second picture blender are exported to user A terminal corresponding codes device 1 by image data-outputting unit; After encoding, the multiple image information of the corresponding output of 1,2,3,4 pairs of picture composition modules of encoder exports to corresponding user terminal; The multiple image that shows correspondence after the image compressed code stream that user A, B, C, D end-on are received is decoded in this locality respectively, be user A watches meeting on terminal six picture images, user B, C, D watch the four-picture image of meeting on terminal separately, the schematic diagram that the many pictures of each user terminal show is shown in Fig. 6 B.
The user selects many pictures display mode to watch conference image by terminal operation, also can select the single-image display mode to watch conference image as required simultaneously, and shown in Fig. 7 A, the user selects the single-image display mode to watch the specific implementation process of conference image as follows:
Step 700, MCU carry out timing displaying video menu prompt information in the process in meeting, and how the prompting user carries out associative operation.
Step 701, user select corresponding single-image display mode by terminal operation according to information when needs single-image display mode is watched conference image, send handoff request by user place terminal to MCU.
Step 702, MCU upgrade the control information of many pictures according to handoff request.
Step 703, MCU are directly exported corresponding single-image image to the user terminal that sends handoff request, and mix by original picture according to the control information of many pictures and to carry out many picture compositions, to the corresponding multiple image of other user terminals outputs.
Example three: in the meeting of example two is carried out, after user C selects to watch the single-image image of user A by terminal operation, user C terminal sends the request of image switching pattern to MCU, MCU upgrades the picture mixed information according to this request, and only need to determine the first picture blender and the second picture blender, its corresponding attribute information remains unchanged; First sampler is selected the decoded picture information of user A, B, C, D terminal correspondence and is carried out corresponding sampling processing according to the attribute information of input video source information and picture mixed information and the first picture blender and the second picture blender; The first picture blender and the second picture blender carry out four picture compositions and six picture compositions respectively; Four-picture image information after second sampler makes up the first picture blender is exported to user B terminal corresponding codes device 2 by image data-outputting unit, carry out the four-picture image information after the combination down-sampled, and the four-picture image information that will obtain after will sampling exports to user D terminal corresponding codes device 4 by image data-outputting unit, and six picture image information after the combination of the second picture blender are exported to user A terminal corresponding codes device 1 by image data-outputting unit; Image information after first sampler will be sampled after with the down-sampled one-tenth of the decoded picture pixel information of user A terminal correspondence QCIF (176 * 144) outputs to user C terminal corresponding codes device 3 by image data-outputting unit; After encoding, the picture image information of the corresponding output of 1,2,3,4 pairs of picture composition modules of encoder exports to corresponding user terminal; The picture image that shows correspondence after the image compressed code stream that user A, B, C, D end-on are received is decoded in this locality respectively, it is user C watches user A on terminal image information, user A watches the image information of six image modes on terminal, user B and user D watch the image information of four pictures respectively on terminal; The schematic diagram that the many pictures of each user terminal show is shown in Fig. 7 B.
In addition, in the present embodiment certain sprite in many pictures is carried out the frame sign to highlight this picture image, for example the sprite to the participant side D of current speaking carries out the frame sign to highlight its image, shown in Fig. 8 A, realizes that the detailed process that the frame sign highlights is as follows:
Step 800, MCU need to determine the sub-screen information of the user terminal correspondence of frame sign.
Step 801, MCU upgrade the control information of many pictures.
Step 802, MCU record this sub-screen information in the picture blender.
Step 803, picture blender carry out the frame sign to this sub-screen image after finishing many picture compositions.
The picture image that step 804, MCU have the frame sign to user terminal output.
The process of the decoding of image information in this process, many picture compositions and coding and the implementation procedure in the foregoing description in like manner repeat no more; The schematic diagram that many pictures of user A, B, C, D terminal show is shown in Fig. 8 B.
In the implementation method that the many pictures that provide in the present embodiment show, the participant terminal is watched conference image with identical many pictures display mode when session initial, in the carrying out of meeting, the user can select to watch the many pictures display mode or the single-image display mode of conference image as required, satisfied the demand that user's differentiation is watched conference image; The participant user can be switched its implementation simple and flexible in the present embodiment between many pictures display mode and single-image display mode by terminal operation; In addition, in the present embodiment sprite in many pictures is carried out the frame sign and highlight picture, satisfied professional diversified needs.
It is above-mentioned that to be example with the video conference describe the implementation procedure of embodiment of the invention technical scheme, but embodiment of the invention technical scheme is not limited to video conference, also be adapted to other video traffics, as video interactive voice answer-back (IVR, Interactive Voice Response) business, in many ways video communication business of Can Yuing etc., when in other video service systems, realizing said method to MCU functional similarity or identical in the requirement of processor (as MCU) on function and the present embodiment, its process that realization picture shows and picture switches and the implementation procedure in the present embodiment in like manner repeat no more.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (16)

1, a kind of method that realizes the picture switching in video traffic is characterized in that, comprises step:
Multipoint control unit MCU receives handoff request message, and described request message comprises that the picture display mode shows the sprite number that picture shows;
Described MCU determines the picture blender of needs according to described picture display mode, and to the user terminal output and the corresponding picture image of picture display mode of asking that send handoff request message.
2, the method for claim 1 is characterized in that, described MCU judges when user terminal requests is switched the single-image display mode, directly exports corresponding single-image image to the user terminal of this handoff request message of transmission; Described MCU judges when user terminal requests is switched many image modes, is undertaken exporting corresponding multiple image to the user terminal that sends this handoff request message behind many picture compositions by the picture blender of determining.
3, method as claimed in claim 1 or 2, it is characterized in that, when the video traffic initialization, described MCU specifies the picture blender of an acquiescence, carry out many picture compositions by described acquiescence picture blender according to the control information of many pictures, and the multiple image after will making up is exported to each user terminal.
4, method as claimed in claim 3 is characterized in that, described MCU on-the-fly modifies the attribute information of described acquiescence picture blender according to the user terminal quantity that participates in video traffic in video traffic carries out.
5, method as claimed in claim 4 is characterized in that, described attribute information comprises the display position of many pictures display mode, each sprite.
6, method as claimed in claim 3 is characterized in that, described MCU will need the relevant information records of sub-screen image of frame sign in the picture blender, and described picture blender carries out the frame sign to this sub-screen image after finishing many picture compositions.
7, a kind of picture device for switching that realizes in video traffic is characterized in that, comprising:
Control module is used to manage the control information of many pictures, and to the user terminal displaying video menu prompt information that participates in video traffic, and according to the dynamically definite picture blender of the picture display mode of user's selection;
Decoder module is used for the video source code image data stream of each user terminal is decoded;
The picture composition module is used for carrying out many picture compositions according to described many pictures control information by one or more picture blenders;
Coding module is used for the multiple image information after the combination is carried out corresponding encoded, and the multiple image that obtains is exported to user terminal.
8, device as claimed in claim 7 is characterized in that, described control module specifies the picture blender of an acquiescence to carry out many picture compositions when the video traffic initialization; Described control module video traffic carry out in the process according to the picture display mode that the user selects determine needs the picture blender.
9, device as claimed in claim 8 is characterized in that, described control module on-the-fly modifies the attribute information of described acquiescence picture blender according to the user terminal quantity that participates in video traffic in video traffic carries out.
10, as each described device of claim 7-9, it is characterized in that, described control module will need the relevant information records of sub-screen image of frame sign in the picture blender, and described picture blender carries out the frame sign to this sub-screen image after finishing many picture compositions.
11, device as claimed in claim 10 is characterized in that, described device is multipoint control unit MCU.
12, a kind of video service system is characterized in that, a plurality of user terminals that comprise multipoint control unit MCU, link to each other with described MCU by network; Described MCU is to the user terminal displaying video menu prompt information that participates in video traffic; User terminal sends handoff request message according to the picture display mode that the user selects to described MCU, and described picture display mode shows the sprite number that picture shows; Described MCU determines the picture blender of needs according to described picture display mode, and to the user terminal output and the corresponding picture image of picture display mode of asking that send handoff request message.
13, system as claimed in claim 12 is characterized in that, described MCU specifies the picture blender of an acquiescence to carry out many picture compositions when the video traffic initialization; Described MCU video traffic carry out in the process according to the picture display mode that the user selects determine needs the picture blender.
14, system as claimed in claim 13 is characterized in that, described MCU carries out in the process at video traffic, on-the-fly modifies the attribute information of described acquiescence picture blender according to the user terminal quantity that participates in video traffic.
15, as each described system of claim 12-14, it is characterized in that described MCU comprises:
Control module is used to manage the control information of many pictures, and to the user terminal displaying video menu prompt information that participates in video traffic, and according to the dynamically definite picture blender of the picture display mode of user's selection;
Decoder module is used for the video source code image data stream of each user terminal is decoded;
The picture composition module is used for carrying out many picture compositions according to described many pictures control information by one or more picture blenders;
Coding module is used for the multiple image information after the combination is carried out corresponding encoded, and the multiple image that obtains is exported to user terminal.
16, system as claimed in claim 15, it is characterized in that, described control module will need the relevant information records of sub-screen image of frame sign in the picture blender, and described picture blender carries out the frame sign to this sub-screen image after finishing many picture compositions.
CN200710097575A 2007-04-27 2007-04-27 Method, apparatus and system for switching pictures in video service Active CN100583985C (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN200710097575A CN100583985C (en) 2007-04-27 2007-04-27 Method, apparatus and system for switching pictures in video service
PCT/CN2008/000848 WO2008131644A1 (en) 2007-04-27 2008-04-25 A method, device and system for realizing picture switching in the video service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200710097575A CN100583985C (en) 2007-04-27 2007-04-27 Method, apparatus and system for switching pictures in video service

Publications (2)

Publication Number Publication Date
CN101031065A CN101031065A (en) 2007-09-05
CN100583985C true CN100583985C (en) 2010-01-20

Family

ID=38716091

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200710097575A Active CN100583985C (en) 2007-04-27 2007-04-27 Method, apparatus and system for switching pictures in video service

Country Status (2)

Country Link
CN (1) CN100583985C (en)
WO (1) WO2008131644A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105530131A (en) * 2015-12-18 2016-04-27 航天恒星科技有限公司 Terminal access monitoring management method and system

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100583985C (en) * 2007-04-27 2010-01-20 华为技术有限公司 Method, apparatus and system for switching pictures in video service
CN101472090B (en) * 2007-12-27 2011-12-28 新奥特（北京）视频技术有限公司 Method for monitoring beforehand hardware self-adapting multi-channel multi-mode video of video server
CN101262588B (en) * 2008-04-01 2010-06-02 中国联合网络通信集团有限公司 A method and system for mandatory control over auxiliary stream of video network
CN101984659A (en) * 2010-11-16 2011-03-09 中兴通讯股份有限公司 Method, terminal and system for flexibly sending video source in video conference communication
CN102547136B (en) * 2010-12-21 2014-06-04 新奥特（北京）视频技术有限公司 Special effect graph processing method and system for images with multiply pixel ratios
CN102595094A (en) * 2011-01-11 2012-07-18 深圳市锐取软件技术有限公司 Multi-information combined multimedia communication method and system
CN102123268A (en) * 2011-03-15 2011-07-13 深圳市捷视飞通科技有限公司 Video conference terminal and system
CN102256099A (en) * 2011-06-20 2011-11-23 中兴通讯股份有限公司 Parameter control method and device
CN102238341B (en) * 2011-06-28 2017-05-10 中兴通讯股份有限公司 Device and method for automatically switching video sub-pictures
CN103248944B (en) * 2012-02-03 2017-08-25 海尔集团公司 A kind of image transfer method and system
CN102625079B (en) * 2012-03-21 2015-01-14 厦门亿联网络技术股份有限公司 Video implementation method for trilateral video conference
CN103686066B (en) * 2012-09-25 2017-05-03 杭州海康威视数字技术股份有限公司 Method and client for adjusting segmentation mode of multi-screen play
CN103905776B (en) 2012-12-26 2018-01-16 华为技术有限公司 Code flow processing method and system, multipoint control unit
CN104253969B (en) * 2013-06-28 2017-12-05 华为技术有限公司 The rendering method and device of more picture compositions
CN103702064B (en) * 2013-12-27 2019-01-18 三亚中兴软件有限责任公司 A kind of video-meeting method, terminal and system
CN103888735A (en) * 2014-03-26 2014-06-25 龙迅半导体科技(合肥)有限公司 Multi-channel video monitoring image data processing method and system
CN105323532B (en) * 2014-06-30 2019-10-15 中兴通讯股份有限公司 A kind of adaptive display method and device of mobile terminal image
CN105472306A (en) * 2014-08-19 2016-04-06 中兴通讯股份有限公司 Video conference data sharing method and related device
CN105704424A (en) * 2014-11-27 2016-06-22 中兴通讯股份有限公司 Multi-image processing method, multi-point control unit, and video system
CN105828151B (en) * 2015-01-07 2019-09-13 中国移动通信集团公司 A kind of display processing method and device
CN106331576A (en) * 2015-06-25 2017-01-11 中兴通讯股份有限公司 Multimedia service processing method, system and device
JP2017072644A (en) * 2015-10-05 2017-04-13 キヤノン株式会社 Display control device
CN105472309B (en) * 2015-12-31 2020-03-10 杭州华为数字技术有限公司 Data transmission method, device and system
CN106941598A (en) * 2016-01-04 2017-07-11 中兴通讯股份有限公司 Many picture bit stream synthetic methods, many picture bit streams synthesis control method and device
CN108111797A (en) * 2016-11-24 2018-06-01 北京中创视讯科技有限公司 Participant's treating method and apparatus
CN110636242B (en) * 2018-06-22 2023-02-17 中兴通讯股份有限公司 Picture switching method in video conference, terminal and MCU
EP3817359A1 (en) * 2018-06-29 2021-05-05 SZ DJI Technology Co., Ltd. Image display method and device, pan/tilt, and storage medium
CN109756695A (en) * 2018-12-25 2019-05-14 视联动力信息技术股份有限公司 A kind of method and apparatus that TV news stream is shown
CN110264543B (en) * 2019-06-21 2022-07-12 苏州科达科技股份有限公司 Frame drawing method and device of spliced picture and storage medium
CN111124337B (en) * 2019-12-17 2023-08-01 西安万像电子科技有限公司 Image display method and system
CN113784080A (en) * 2020-06-10 2021-12-10 中兴通讯股份有限公司 Video conference realization method, device and storage medium
CN111984214A (en) * 2020-08-06 2020-11-24 深圳拔越软件有限公司 Intelligent configuration method for multiple vertical screens and multiple pictures and display system
CN112882672B (en) * 2021-02-26 2024-01-23 京东方科技集团股份有限公司 Near-eye display control method and device and near-eye display equipment
CN113727149B (en) * 2021-08-31 2023-06-30 京东方科技集团股份有限公司 Display control method and device, video processing device and display system
CN114449205B (en) * 2022-04-08 2022-07-29 浙江华创视讯科技有限公司 Data processing method, terminal device, electronic device and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2407533Y (en) * 2000-01-06 2000-11-22 李保国 Multi-pot interaction multimedia video frequency communication control device
JP2003069563A (en) * 2001-08-22 2003-03-07 Nippon Telegr & Teleph Corp <Ntt> Method and system for multi-location meeting
CN100366080C (en) * 2003-11-21 2008-01-30 华为技术有限公司 Method of implementing switching of single picture and multi-pictures in conference television system
CN100583985C (en) * 2007-04-27 2010-01-20 华为技术有限公司 Method, apparatus and system for switching pictures in video service

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105530131A (en) * 2015-12-18 2016-04-27 航天恒星科技有限公司 Terminal access monitoring management method and system
CN105530131B (en) * 2015-12-18 2020-05-22 航天恒星科技有限公司 Terminal access monitoring management method and system

Also Published As

Publication number Publication date
CN101031065A (en) 2007-09-05
WO2008131644A1 (en) 2008-11-06

Similar Documents

Publication Publication Date Title
CN100583985C (en) Method, apparatus and system for switching pictures in video service
KR100880150B1 (en) Multi-point video conference system and media processing method thereof
US9462228B2 (en) Distributed real-time media composer
CN101370114B (en) Video and audio processing method, multi-point control unit and video conference system
CN101755454B (en) Method and apparatus for determining preferred image format between mobile video telephones
CN101198008A (en) Method and system for implementing multi-screen and multi-picture
US8228363B2 (en) Method and system for conducting continuous presence conferences
CN101478642A (en) Multi-picture mixing method and apparatus for video meeting system
CN101557496B (en) Built-in video conference cooperative operation system
CN102892032B (en) Real-time interactive high definition network video communication system
CN103795964A (en) Video conferencing method and device thereof
CN110943909A (en) Audio and video fusion communication server
CN101895718A (en) Video conference system multi-image broadcast method, and device and system thereof
CN101345844A (en) Multimedia code stream transmission method and multi-point control cell
CN101350908A (en) Video data transmission system and method for network video conference
CN203015009U (en) Real-time interactive high-definition network video communication system
EP2637404A1 (en) Method and device for controlling multiple auxiliary streams, and network system
US8515042B2 (en) Method for indicating call progress state, conference control device, and conference system
CN115022573A (en) Desktop video conference system
US11102451B2 (en) Videoconferencing server for providing multi-screen videoconferencing by using a plurality of videoconferencing terminals and method therefor
KR101691124B1 (en) System and method for providing multi-sharing of multimedia
CN112839197B (en) Image code stream processing method, device, system and storage medium
KR100949233B1 (en) Apparatus and method for document sharing by using standard video terminal and ip tv
CN115734028A (en) Media stream pushing method and system based on cascade coding
CN116320261A (en) Video conference live broadcast processing method and video conference live broadcast system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C56 Change in the name or address of the patentee

Owner name: TENCENT TECHNOLOGY (SHENZHEN) CO., LTD.

Free format text: FORMER NAME: HUAWEI TECHNOLOGY CO LTD

CP03 Change of name, title or address

Address after: 518057 Tencent Building, Nanshan District hi tech park, Shenzhen, Guangdong

Patentee after: Tencent Technology (Shenzhen) Co., Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: Huawei Technologies Co., Ltd.