CN109309805A - A kind of multi-window display method of video conference, device, equipment and system - Google Patents

A kind of multi-window display method of video conference, device, equipment and system Download PDF

Info

Publication number
CN109309805A
CN109309805A CN201811158872.5A CN201811158872A CN109309805A CN 109309805 A CN109309805 A CN 109309805A CN 201811158872 A CN201811158872 A CN 201811158872A CN 109309805 A CN109309805 A CN 109309805A
Authority
CN
China
Prior art keywords
window
conference
information
video
main window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811158872.5A
Other languages
Chinese (zh)
Other versions
CN109309805B (en
Inventor
王运璇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shizhen Information Technology Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shizhen Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shizhen Information Technology Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority to CN201811158872.5A priority Critical patent/CN109309805B/en
Publication of CN109309805A publication Critical patent/CN109309805A/en
Application granted granted Critical
Publication of CN109309805B publication Critical patent/CN109309805B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses a kind of multi-window display methods of video conference, comprising: whether detection client has subscribed the main window and secondary window of display same conference member；The video quality of main window is higher than the video quality of secondary window, and main window and secondary window are equipped with the id information of conference member；The id information of conference member is added to the video flowing to be shown of the main window；By the video stream to be shown of the main window of the id information with conference member to client, and forbid the video stream to be shown of secondary window to client, so that client shows the video flowing to be shown of main window in main window and secondary window respectively.The embodiment of the invention also discloses the windows display devices of video conference, the windows display system of the windows display equipment of video conference and video conference.Using the embodiment of the present invention, the uplink of server can be reduced, promotes the load capacity of server.

Description

A kind of multi-window display method of video conference, device, equipment and system
Technical field
The present invention relates to multimedia field more particularly to a kind of multi-window display method of video conference, device, set Standby and system.
Background technique
According to the layout designs of client window in video conference, two windows can occur and show the same member's Situation.The automatic mode of display either is amplified to spokesman or client manually selects window and amplifies.Generally Window layout be a central big window shows a member, the wicket around big window is shown to be shown including big window All conference members including member.In this case, the upper of server is reduced while best meeting experience in order to reach Row, generally allowing wicket to receive, video quality is smaller, and the received video quality of big window is bigger.According to above method, When big window and wicket show the same person, actually high quality and low quality two-path video can be sent to client, in this way The uplink that will increase server causes the speed of service of server slack-off.
Summary of the invention
The purpose of the embodiment of the present invention is that a kind of multi-window display method of video conference, device, equipment and system are provided, The uplink that server can be reduced promotes the load capacity of server.
To achieve the above object, the embodiment of the invention provides a kind of multi-window display methods of video conference, comprising:
Instruction is subscribed in response to the window that client is sent, whether detection client has subscribed display same conference member's Main window and secondary window；Wherein, the video quality of the main window is higher than the video quality of the secondary window, the main window and Secondary window is equipped with the id information of the conference member；
After determining that the client subscription shows the main window and secondary window of same conference member, by the meeting at The id information of member is added to the video flowing to be shown of the main window；
By the video stream to be shown of the main window of the id information with the conference member to client, and prohibit Only by the video stream to be shown of the secondary window to client, so that the client is by the id information of the conference member After being matched respectively with the id information of the main window and secondary window, by the video flowing to be shown of the main window respectively in institute It states main window and the secondary window is shown.
Compared with prior art, the multi-window display method of video conference disclosed by the invention exists by detection first When having subscribed another member's display window of same conference member with member's display window, two member's display windows are determined In main window and secondary window；Then, after determining the main window and the secondary window, by the id information of the conference member It is added to the video flowing to be shown of the main window；Finally, by the main window of the id information with the conference member Video stream to be shown is to client, so that the client is by the video flowing to be shown of the main window respectively in the master Window and the secondary window are shown.When solving big window in the prior art and the wicket display same person, actually High quality and low quality two-path video can be sent to client, will increase the uplink of server in this way, lead to the operation of server The problem of slowing can reduce the uplink of server, promote the load capacity of server.
As an improvement of the above scheme, the method also includes:
When detect participate in video conference client there are member's display windows that two have subscribed same conference member When, the id information of the conference member is obtained, and the id information of the conference member is respectively allocated to the main window and institute State secondary window.
As an improvement of the above scheme, the id information by the conference member is added to the to be shown of the main window Video flowing, comprising:
The id information of the conference member is added to the real-time transport protocol of the video flowing to be shown of the main window In identifier.
To achieve the above object, the embodiment of the present invention also provides the multi-window display method of another video conference, comprising:
It is instructed in response to subscribing to, subscribes to main window and secondary window to server；Wherein, the main window and the secondary window Show same conference member, the video quality of the main window is greater than the video quality of the secondary window, the main window and pair Window is equipped with the id information of the conference member；
The id information of the conference member is sent, so that the id information of the conference member is added to the master by server The video flowing to be shown of window；
The video flowing to be shown for receiving the main window of the id information with the conference member, by the conference member Id information matched respectively with the id information of the main window and secondary window after, by the video flowing to be shown of the main window It is shown respectively in the main window and the secondary window.
Compared with prior art, the multi-window display method of video conference disclosed by the invention, firstly, referring in response to subscribing to When enabling, main window and secondary window are subscribed to；Then, send the id information of the conference member so that server by the meeting at The id information of member is added to the video flowing to be shown of the main window；Finally, receiving the id information with the conference member The video flowing to be shown of the main window, by the video flowing to be shown of the main window respectively in the main window and the secondary window Mouth is shown.When solving big window in the prior art and the wicket display same person, it can actually be sent to client High quality and low quality two-path video, will increase the uplink of server in this way, the problem for causing the speed of service of server slack-off, The uplink that server can be reduced promotes the load capacity of server.
As an improvement of the above scheme, the id information for sending the conference member, so that server is by the meeting The id information of member is added to the video flowing to be shown of the main window, comprising:
Send the id information of the conference member so that server the id information of the conference member is added to it is described In the identifier of the real-time transport protocol of the video flowing to be shown of main window.
As an improvement of the above scheme, the main window for receiving the id information with the conference member to aobvious After showing video flowing, further includes:
The video flowing to be shown of the main window of id information with the conference member is parsed, described in extraction The id information of conference member.
To achieve the above object, the embodiment of the invention also provides a kind of windows display devices of video conference, comprising:
Conference member detection unit, the window for sending in response to client subscribe to instruction, and whether detection client is ordered The main window and secondary window of display same conference member are read；Wherein, the video quality of the main window is higher than the secondary window Video quality, the main window and secondary window are equipped with the id information of the conference member；
Id information adding unit, in the main window and pair for determining that the client subscription shows same conference member After window, the id information of the conference member is added to the video flowing to be shown of the main window；
Video flowing to be shown forbids transmission unit, for forbidding the video stream to be shown by the secondary window to client End；
Video stream unit to be shown, the main window of the id information for the conference member will to be had to aobvious Show video stream to client so that the client by the id information of the conference member respectively with the main window and pair After the id information of window is matched, by the video flowing to be shown of the main window respectively in the main window and the secondary window It is shown.
Compared with prior art, the windows display device of video conference disclosed by the invention, firstly, passing through conference member Detection unit detection is determined and is somebody's turn to do in the presence of when having subscribed another member's display window of same conference member with member's display window Main window and secondary window in two member's display windows；Then, id information adding unit is by the id information of the conference member It is added to the video flowing to be shown of the main window；Finally, video stream unit to be shown will have the conference member The video stream to be shown of the main window of id information is to client, so that the client is by the main window to aobvious Show that video flowing is shown in the main window and the secondary window respectively.It solves big window in the prior art and wicket is aobvious When showing the same person, actually high quality and low quality two-path video can be sent to client, will increase the upper of server in this way Row, the problem for causing the speed of service of server slack-off can reduce the uplink of server, promote the load capacity of server.
As an improvement of the above scheme, described device further includes id information allocation unit, and the id information allocation unit is used In when detecting that the client for participating in video conference has subscribed there are two member's display window of same conference member, acquisition The id information of the conference member, and the id information of the conference member is respectively allocated to the main window and the secondary window Mouthful；
The id information adding unit, in the main window for determining that the client subscription shows same conference member After secondary window, the id information of the conference member is added to the real-time transport protocol of the video flowing to be shown of the main window Identifier in.
To achieve the above object, the embodiment of the invention also provides the windows display device of another video conference, packets It includes:
Window subscriber units subscribe to instruction for responding, and subscribe to main window and secondary window；Wherein, the main window and institute It states secondary window and shows same conference member, the video quality of the main window is greater than the video quality of the secondary window, the master Window and secondary window are equipped with the id information of the conference member；
Id information transmission unit, for sending the id information of the conference member, so that server is by the conference member Id information be added to the video flowing to be shown of the main window；
Video flowing display unit, for receiving the view to be shown for having the main window of id information of the conference member Frequency flows, will be described after the id information of the conference member is matched with the id information of the main window and secondary window respectively The video flowing to be shown of main window is shown in the main window and the secondary window respectively.
Compared with prior art, windows display side's device of video conference disclosed by the invention, firstly, in response to subscribing to When instruction, window subscriber units subscribe to main window and secondary window；Then, id information transmission unit sends the ID of the conference member Information, so that the id information of the conference member is added to the video flowing to be shown of the main window by server；Finally, video The video flowing to be shown that display unit receives the main window of the id information with the conference member is flowed, by the main window Video flowing to be shown shown respectively in the main window and the secondary window.Solves big window in the prior art and small When window shows the same person, actually high quality and low quality two-path video can be sent to client, will increase service in this way The uplink of device, the problem for causing the speed of service of server slack-off can reduce the uplink of server, promote the load of server Ability.
As an improvement of the above scheme, described device further includes id information extraction unit, and the id information extraction unit is used Parsed in the video flowing to be shown of the main window to the id information with the conference member, extract the meeting at The id information of member.
To achieve the above object, the embodiment of the present invention also provides a kind of windows display equipment of video conference, including place It manages device, memory and storage in the memory and is configured as the computer program executed by the processor, it is described Processor realizes that the multiwindow of the video conference as described in any one of above-described embodiment is aobvious when executing the computer program Show method.
To achieve the above object, the embodiment of the present invention also provides the windows display system of video conference, including server With at least one client；Wherein,
The server is the windows display device of the video conference as described in any one of above-described embodiment.
The client is the windows display device of the video conference as described in any one of above-described embodiment.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the multi-window display method of video conference provided in an embodiment of the present invention；
Fig. 2 is that a kind of member of the client of the multi-window display method of video conference provided in an embodiment of the present invention shows Window schematic diagram；
Fig. 3 is a kind of another flow chart of the multi-window display method of video conference provided in an embodiment of the present invention；
Fig. 4 is the flow chart of the multi-window display method of another video conference provided in an embodiment of the present invention；
Fig. 5 is a kind of structural block diagram of the windows display device 10 of video conference provided in an embodiment of the present invention；
Fig. 6 is the structural block diagram of the windows display device 20 of another video conference provided in an embodiment of the present invention；
Fig. 7 is a kind of structural block diagram of the windows display equipment 30 of video conference provided in an embodiment of the present invention；
Fig. 8 is the structural block diagram of the windows display equipment 40 of another video conference provided in an embodiment of the present invention；
Fig. 9 is a kind of structural block diagram of the windows display system 50 of video conference provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
It is worth noting that video conference described in the embodiment of the present invention includes two kinds of situations, one is in video conference All showing each member's display window in each client for participating in video conference, i.e., each client synchronization is shown, such as Remote Video Conference.Another kind is to show each member's display window in video conference in only one client, remaining visitor Family end is only used as camera shooting video, is then aggregated into a client and shows, such as in the video of the same meeting room Meeting.
There are two types of types, including fixed window and active window for member's display window described in the embodiment of the present invention.It is fixed Window can be the lesser member's display window of video quality, and this is the member for showing each participation video conference, with The member for participating in video conference corresponds；Another active window can be the biggish member's display window of video quality, this Kind is for highlighting one of member for participating in video conference, and the member of display can be identical as any conference member, Or it is different from any conference member.Two members for then having subscribed same conference member in embodiments of the present invention show Main window is active window in window, and secondary window is fixed window.
When subscribing to member's display window, server will not generally distribute to window quality and be higher than view the client The video flowing of frequency quality is prevented beyond client maximum decoding capability.But in the present invention, allow member's display window Video flowing exceed member's display window video quality, but not be more than client request a series of member's display windows Maximum video quality in mouthful, therefore still can guarantee the maximum decoding capability without departing from client.
In the prior art, when video conference starts, client can subscribe to member's display window, and it is aobvious that server obtains member Show the video quality of window, server can get participated in that the client of video conference sends over member's display window The corresponding video flowing to be shown of video quality, client sends video flowing to be shown all the way at this time, then server pair Video flowing to be shown after all video flowings to be shown will summarize again after being summarized is forwarded to member's display window of client In.In above process, when needing to show the same conference member there are two member's display windows, at this point, server meeting The two-way video flowing to be shown that client corresponding with the conference member is sent is received, then the two-way is waited showing by server again Show that video flowing is separately sent to show in the member's display window for needing to show the same conference member.
And the scheme of the invention is, when needing to show the same conference member there are two member's display windows, at this point, Client corresponding with the conference member still only sends video flowing to be shown all the way, and, to server, server can be received and is somebody's turn to do The video flowing to be shown all the way that the corresponding client of conference member is sent, server again will be corresponding with the conference member to be shown Video flowing is rendered into the member's display window for need to show the same conference member shows simultaneously.Server is not then at this time The load capacity of server is promoted with more video flowings to be shown all the way are received again so as to reduce the uplink of server.
Embodiment one
The multi-window display method of video conference provided by the present embodiment can execute realization by server, then described The agreement of the information exchange of server and the client can use DTLS (Datagram Transport Layer Security), i.e. data packet transport layer security protocol.Preferably, the client includes but is not limited to mobile phone, computer and throwing Image device.
It is a kind of flow chart of the multi-window display method of video conference provided in an embodiment of the present invention referring to Fig. 1, Fig. 1； Include:
S11, in response to client send window subscribe to instruction, detection client whether have subscribed display same conference at The main window of member and secondary window；Wherein, the video quality of the main window is higher than the video quality of the secondary window, the main window Mouth and secondary window are equipped with the id information of the conference member；
S12, after determining that the client subscription shows the main window and secondary window of same conference member, by the meeting The id information of view member is added to the video flowing to be shown of the main window；
S13, will the video stream to be shown with the main window of the id information of the conference member to client, And forbid the video stream to be shown of the secondary window to client, so that the client is by the ID of the conference member After information is matched with the id information of the main window and secondary window respectively, the video flowing to be shown of the main window is distinguished It is shown in the main window and the secondary window.
Specifically, in step s 11, when there is any client to be added to video conference, client can subscribe to it is described at Member display window, when detect participate in video conference client there are member's display windows that two have subscribed same conference member When mouth, the id information of the conference member is respectively allocated to the main window and the secondary window.
Specifically, detecting whether there is another member's display window for having subscribed same conference member with member's display window Mouthful, that is, it detects in the client at this time and whether there are two member's display window to show identical conference member.When presence and this When member's display window has subscribed another member's display window of same conference member, determine in two member's display windows Main window and secondary window.
Specifically, can determine main window and secondary window by judging the video quality between two member's display windows Mouthful.At this point, server obtains every while subscribing to member's display window when there is any client to be added to video conference The video quality of a member's display window, each member's display window in the client are preset with corresponding video matter Amount, such as 360P, 720P or 1080p etc..When in the presence of another member for having subscribed same conference member with member's display window When display window, judge whether the video quality of member's display window is greater than the video matter of another member's display window Amount；When the video quality of member's display window is greater than the video quality of another member's display window, the member is determined Display window is the main window having subscribed in two member's display windows of same conference member, another member's display window For secondary window.
Specifically, in step s 12, after determining the main window and the secondary window, by the conference member Id information is added to the video flowing to be shown of the main window.Preferably, entrained by the video flowing to be shown of the main window The id information of conference member be server encode in advance into the video flowing to be shown of the main window real-time transport protocol (RTP: Real Time Transport Protocol) identifier (CSRC) in, the identifier (CSRC) is for identifying State the unique identification in the source of video flowing to be shown.
Specifically, in step s 13, forbidding video stream to be shown corresponding to the secondary window to the client End, and remaining remaining video flowing to be shown is all allowed to transmission.Referring to Fig. 3, member's display window A (main window) and at Member display window D (secondary window) has subscribed the same client a, and member's display window B has subscribed client b, member's display window Mouthful C has subscribed client c, and the client has all the way when receiving multichannel that server sends over video flowing to be shown Video (i.e. the video flowing to be shown of the main window of the id information with the conference member) to be shown needs while rendering Member's display window A and member display window D, the view to be shown of the main window of the id information with the conference member The video quality that the video quality of frequency stream is member's display window A.If member's display window D has had subscribed at this time Content, then the subscribed content of member's display window D is emptied that (server has stopped described in transmission by the client at this time The corresponding video flowing to be shown of the video quality of member's display window D).So that the client believes the ID of the conference member It, will be corresponding with member's display window A described after breath is matched with the id information of the main window and secondary window respectively Main window video flowing to be shown is rendered into member's display window A and member's display window D simultaneously and shows.
Preferably, the process of above-mentioned steps S11~S13 can refer to Fig. 3.
Further, in step s 11, the side that there is the member's display window for having subscribed same conference member is detected whether Method includes but is not limited to detect audio-frequency information and detection control instruction.
Specifically, when detecting whether that the method that there is the member's display window for having subscribed same conference member is detection audio When information, server determines that the audio-frequency information of which road video flowing to be shown is more than that (client is needed itself shooting preset value The video stream of conference member uniformly summarizes to server, then by server, therefore server is able to detect that and sends over Video flowing to be shown audio-frequency information), the preset value can be 10db, and server judgement at this time is detected the presence of and had subscribed Member's display window of same conference member.Such as when there is conference member making a speech, then conference member correspondence is being got Video flowing to be shown in audio-frequency information when being more than preset value, it may be determined that the conference member needs to subscribe to two identical meetings of display Member's display window of member is discussed, i.e., client has the member's display window for having subscribed same conference member at this time.Pass through inspection It surveys audio-frequency information and detects whether there is the member's display window for having subscribed same conference member automatically, do not needed in conference process User manually selects, convenient and efficient.
Specifically, when detecting whether that the method that there is the member's display window for having subscribed same conference member is detection control When instruction, i.e., client can manually select any conference member needs in the member of two same conference members of client subscription Display window, client sends the control instruction for needing to subscribe to member's display window of two same conference members to service at this time Device, server then determine to detect the presence of the member's display window for having subscribed same conference member when receiving the control instruction Mouthful, the above process needs conference member to manually select.
When it is implemented, first by detect exist and member's display window have subscribed same conference member it is another at When member's display window, the main window and secondary window in two member's display windows are determined；Then, determine the main window with After the pair window, the id information of the conference member is added to the video flowing to be shown of the main window；Finally, will have The video stream to be shown of the main window of the id information of the conference member is to client, so that the client is by institute The video flowing to be shown for stating main window is shown in the main window and the secondary window respectively.
Compared with prior art, the multi-window display method of video conference disclosed by the invention, solves in the prior art When big window and wicket show the same person, actually high quality and low quality two-path video can be sent to client, in this way The uplink that will increase server, the problem for causing the speed of service of server slack-off can reduce the uplink of server, promote clothes The load capacity of business device.
Embodiment two
The multi-window display method of video conference provided by the present embodiment can be realized by client executing, then described The agreement of client and the information exchange of the server can use DTLS (Datagram Transport Layer Security), i.e. data packet transport layer security protocol.Preferably, the client includes but is not limited to mobile phone, computer and throwing Image device.
Referring to fig. 4, Fig. 4 is the process of the multi-window display method of another video conference provided in an embodiment of the present invention Figure；Include:
S21, it is instructed in response to subscribing to, subscribes to main window and secondary window to server；Wherein, the main window and the pair Window shows same conference member, and the video quality of the main window is greater than the video quality of the secondary window, the main window The id information of the conference member is equipped with secondary window；
S22, the id information for sending the conference member, so that the id information of the conference member is added to institute by server State the video flowing to be shown of main window；
S23, the video flowing to be shown for having the main window of id information of the conference member is received, by the meeting After the id information of member is matched with the id information of the main window and secondary window respectively, by the view to be shown of the main window Frequency stream is shown in the main window and the secondary window respectively.
Specifically, in the step s 21, when there is any client to be added to video conference, instruction is subscribed in response, can subscribe to Member's display window in client, when any client has subscribed member's display window of two display same conference members When, member's display window of this two display same conference members is the main window and the secondary window.
Specifically, send the id information of the conference member in step S22, so that server is by the conference member Id information be added to the video flowing to be shown of the main window.Preferably, entrained by the video flowing to be shown of the main window Conference member id information be server encode the real-time transport protocol into the video flowing to be shown of the main window in advance In the identifier (CSRC) of (RTP:Real Time Transport Protocol), the identifier (CSRC) is for marking Know the unique identification in the source of the video flowing to be shown.
Specifically, receiving the view to be shown of the main window of the id information with the conference member in step S23 After frequency flows, further includes: parse, mention to the video flowing to be shown of the main window of the id information with the conference member Take the id information of the conference member, so as to by the id information of the conference member respectively with the main window and secondary window Id information matched.
When it is implemented, firstly, subscribing to main window and secondary window when instructing in response to subscribing to；Then, the meeting is sent The id information of member, so that the id information of the conference member is added to the video flowing to be shown of the main window by server； Finally, receive the video flowing to be shown of the main window of the id information with the conference member, by the main window to Display of video streams is shown in the main window and the secondary window respectively.
Compared with prior art, the multi-window display method of video conference disclosed by the invention, solves in the prior art When big window and wicket show the same person, actually high quality and low quality two-path video can be sent to client, in this way The uplink that will increase server, the problem for causing the speed of service of server slack-off can reduce the uplink of server, promote clothes The load capacity of business device.
Embodiment three
The windows display device 10 of video conference provided by the present embodiment can execute realization by server, then institute The agreement for stating the windows display device 10 of video conference and the information exchange of the client can use DTLS (Datagram Transport Layer Security), i.e. data packet transport layer security protocol.Preferably, the client includes but not It is limited to mobile phone, computer and projection arrangement.
It is a kind of structural frames of the windows display device 10 of video conference provided in an embodiment of the present invention referring to Fig. 5, Fig. 5 Figure；Include:
Conference member detection unit 11, the window for sending in response to client subscribe to instruction, and whether detection client Have subscribed the main window and secondary window of display same conference member；Wherein, the video quality of the main window is higher than the secondary window The video quality of mouth, the main window and secondary window are equipped with the id information of the conference member；
Id information adding unit 12, for determine the client subscription show same conference member main window and After secondary window, the id information of the conference member is added to the video flowing to be shown of the main window；
Video flowing to be shown forbids transmission unit 13, for forbidding the video stream to be shown by the secondary window to visitor Family end；
Video stream unit 14 to be shown, the main window of the id information for the conference member will to be had to Display of video streams is sent to client so that the client by the id information of the conference member respectively with the main window and After the id information of secondary window is matched, by the video flowing to be shown of the main window respectively in the main window and the secondary window Mouth is shown.
Preferably, described device further includes id information allocation unit 15, and the id information allocation unit is used to work as and detect The client of video conference is participated in when having subscribed member's display window of same conference member there are two, obtain the meeting at The id information of member, and the id information of the conference member is respectively allocated to the main window and the secondary window.The ID letter Adding unit 12 is ceased, it, will for after determining that the client subscription shows the main window and secondary window of same conference member The id information of the conference member is added in the identifier of the real-time transport protocol of the video flowing to be shown of the main window.
Specifically, client can subscribe to member's display window when there is any client to be added to video conference, when When detecting that the client for participating in video conference has subscribed member's display window of same conference member there are two, the ID letter The id information of the conference member is respectively allocated to the main window and the secondary window by breath allocation unit 15.
Specifically, the conference member detection unit 11, which detects whether to exist, has subscribed identical meeting with member's display window Another member's display window for discussing member, that is, detect in the client at this time whether there are two member's display window show it is identical Conference member.When in the presence of another member's display window of same conference member is had subscribed with member's display window, determine Main window and secondary window in two member's display windows.
Specifically, the conference member detection unit 11 can be by judging the video matter between two member's display windows It measures to determine main window and secondary window.At this point, subscribing to member's display window when there is any client to be added to video conference Server obtains the video quality of each member's display window, each member's display window in the client while mouth It is preset with corresponding video quality, such as 360P, 720P or 1080p etc..When identical in the presence of being had subscribed with member's display window When another member's display window of conference member, judge whether the video quality of member's display window is greater than another member The video quality of display window；When the video quality of member's display window is greater than the video matter of another member's display window When amount, determine that member's display window is the main window having subscribed in two member's display windows of same conference member, it is described Another member's display window is secondary window.
Specifically, after determining the main window and the secondary window, the id information adding unit 12 is by the meeting The id information of view member is added to the video flowing to be shown of the main window.Preferably, the video flowing to be shown of the main window The id information of entrained conference member is the preparatory view to be shown encoded into the main window of the id information adding unit 12 In the identifier (CSRC) of the real-time transport protocol (RTP:Real Time Transport Protocol) of frequency stream, the mark Knowing symbol (CSRC) as the unique identification for identifying the source of the video flowing to be shown.
Specifically, the video flowing to be shown forbids transmission unit 13 to forbid view to be shown corresponding to the secondary window Frequency stream is sent to the client, and remaining remaining video flowing to be shown is all allowed to transmission, the video to be shown Transmission unit 14 is flowed by the video stream to be shown of the main window of the id information with the conference member to client.
Referring to Fig. 3, member's display window A (main window) and member's display window D (secondary window) have subscribed the same client A, member's display window B is held to have subscribed client b, member's display window C has subscribed client c, and the client is receiving When the multichannel that the video stream unit 14 to be shown sends over video flowing to be shown, there is video (i.e. band to be shown all the way Have the video flowing to be shown of the main window of the id information of the conference member) need and meanwhile render member's display window A with Member display window D, the video quality of the video flowing to be shown of the main window of the id information with the conference member For the video quality of member's display window A.If member's display window D has had subscribed content at this time, at this time institute It states client and the subscribed content of member's display window D empties to (server has stopped sending member's display window D The corresponding video flowing to be shown of video quality).So that the client by the id information of the conference member respectively with it is described After the id information of main window and secondary window is matched, will the main window corresponding with member's display window A it is to be shown Video flowing be rendered into member's display window A and member's display window D simultaneously and show.
Further, the conference member detection unit 11 detects whether that there is the member for having subscribed same conference member shows The method for showing window includes but is not limited to detect audio-frequency information and detection control instruction.
Specifically, when detecting whether that the method that there is the member's display window for having subscribed same conference member is detection audio When information, the conference member detection unit 11 determines that the audio-frequency information of which road video flowing to be shown is more than preset value (client The video stream by the conference member of itself shooting is needed uniformly to summarize to server, then by server, therefore server energy Enough detect the audio-frequency information of the video flowing to be shown sended over), the preset value can be 10db, the meeting at this time at Member's judgement of detection unit 11 detects the presence of the member's display window for having subscribed same conference member.Such as when having conference member just It is making a speech, then when getting the audio-frequency information in the corresponding video flowing to be shown of the conference member more than preset value, it may be determined that The conference member needs to subscribe to member's display windows of two display same conference members, i.e. client presence at this time has subscribed phase With member's display window of conference member.It detects whether to exist automatically by detection audio-frequency information to have subscribed same conference member's Member's display window does not need user in conference process and manually selects, convenient and efficient.
Specifically, when detecting whether that the method that there is the member's display window for having subscribed same conference member is detection control When instruction, i.e., client can manually select any conference member needs in the member of two same conference members of client subscription Display window, client sends the control instruction for needing to subscribe to member's display window of two same conference members to described at this time Conference member detection unit 11, the conference member detection unit 11, which then determines to detect when receiving the control instruction, deposits In the member's display window for having subscribed same conference member, the above process needs conference member to manually select.
When it is implemented, being had subscribed firstly, existing by the detection of conference member detection unit 11 with member's display window When another member's display window of same conference member, the main window and secondary window in two member's display windows are determined；So Afterwards, the id information of the conference member is added to the video flowing to be shown of the main window by id information adding unit 12；Finally, Video stream unit 14 to be shown sends out the video flowing to be shown of the main window of the id information with the conference member It send to client, so that the client is by the video flowing to be shown of the main window respectively in the main window and the secondary window Mouth is shown.
Compared with prior art, the windows display device 10 of video conference disclosed by the invention, solves the prior art When middle big window and wicket show the same person, actually high quality and low quality two-path video can be sent to client, this Sample will increase the uplink of server, the problem for causing the speed of service of server slack-off, can reduce the uplink of server, be promoted The load capacity of server.
Example IV
The windows display device 20 of video conference provided by the present embodiment can realize by client executing, then institute The agreement for stating the information exchange of client and the server can use DTLS (Datagram Transport Layer Security), i.e. data packet transport layer security protocol.Preferably, the client includes but is not limited to mobile phone, computer and throwing Image device.
It is the structure of the windows display device 20 of another video conference provided in an embodiment of the present invention referring to Fig. 6, Fig. 6 Block diagram；Include:
Window subscriber units 21 subscribe to instruction for responding, and subscribe to main window and secondary window；Wherein, the main window and The pair window shows same conference member, and the video quality of the main window is greater than the video quality of the secondary window, described Main window and secondary window are equipped with the id information of the conference member；
Id information transmission unit 22, for sending the id information of the conference member so that server by the meeting at The id information of member is added to the video flowing to be shown of the main window；
Video flowing display unit 23, for receive have the conference member id information the main window it is to be shown Video flowing, after the id information of the conference member is matched with the id information of the main window and secondary window respectively, by institute The video flowing to be shown for stating main window is shown in the main window and the secondary window respectively.
Specifically, instruction, the window subscriber units 21 are subscribed in response when there is any client to be added to video conference Member's display window in client can be subscribed to, when the member that any client has subscribed two display same conference members shows When window, member's display window of this two display same conference members is the main window and the secondary window.
Specifically, the id information transmission unit 22 sends the id information of the conference member, so that server will be described The id information of conference member is added to the video flowing to be shown of the main window.Preferably, the video to be shown of the main window The id information of the entrained conference member of stream is that server encodes the real-time biography into the video flowing to be shown of the main window in advance In the identifier (CSRC) of defeated agreement (RTP:Real Time Transport Protocol), the identifier (CSRC) is For identify the video flowing to be shown source unique identification.
Preferably, described device further includes id information extraction unit 24, and the id information extraction unit 24 is for receiving After the video flowing to be shown of the main window of id information with the conference member, the ID with the conference member is believed The video flowing to be shown of the main window of breath is parsed, and the id information of the conference member is extracted, so as to will be described Id information of the id information of conference member respectively with the main window and secondary window is matched.
When it is implemented, firstly, window subscriber units 21 subscribe to main window and secondary window when instructing in response to subscribing to；So Afterwards, id information transmission unit 22 sends the id information of the conference member, so that server is by the id information of the conference member It is added to the video flowing to be shown of the main window；Finally, video flowing display unit 23 receives the ID for having the conference member The video flowing to be shown of the main window of information, by the video flowing to be shown of the main window respectively in the main window and institute Secondary window is stated to be shown.
Compared with prior art, windows display side's device 20 of video conference disclosed by the invention, solves existing skill When big window and wicket show the same person in art, actually high quality and low quality two-path video can be sent to client, The uplink that will increase server in this way, the problem for causing the speed of service of server slack-off can reduce the uplink of server, mention Rise the load capacity of server.
Embodiment five
It is a kind of structural frames of the windows display equipment 30 of video conference provided in an embodiment of the present invention referring to Fig. 7, Fig. 7 Figure；The windows display equipment 30 of the video conference of the embodiment includes: processor 31, memory 32 and is stored in described deposit In reservoir and the computer program that can be run on the processor 31.The processor 31 executes real when the computer program Step in existing above-described embodiment one in the multi-window display method of video conference, such as step S11~S13 shown in FIG. 1.Or Person, the processor 31 realize the function of each module/unit in above-mentioned each Installation practice, example when executing the computer program Such as conference member detection unit 11.
Illustratively, the computer program can be divided into one or more module/units, one or more A module/unit is stored in the memory 32, and is executed by the processor 31, to complete the present invention.It is one Or multiple module/units can be the series of computation machine program instruction section that can complete specific function, the instruction segment is for retouching State implementation procedure of the computer program in the windows display equipment 30 of the video conference.For example, the computer Program can be divided into conference member detection unit 11, id information adding unit 12, video flowing to be shown and forbid transmission unit 13, video stream unit 14 to be shown and id information allocation unit 15.Each module concrete function refers to three institute of above-described embodiment The function of the windows display device 10 for the video conference stated, details are not described herein.
The windows display equipment 30 of the video conference can be desktop PC, notebook, palm PC and cloud Server etc. is held to calculate equipment.The windows display equipment 30 of the video conference may include, but be not limited only to, processor 31, Memory 32.It will be understood by those skilled in the art that the schematic diagram is only the windows display equipment 30 of video conference Example does not constitute the restriction to the windows display equipment 30 of video conference, may include than illustrating more or fewer portions Part perhaps combines certain components or different components, such as the windows display equipment 30 of the video conference can also wrap Include input-output equipment, network access equipment, bus etc..
Alleged processor 31 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor Deng the processor 31 is the control centre of the windows display equipment 30 of the video conference, utilizes various interfaces and route Connect the various pieces of the windows display equipment 30 of entire video conference.
The memory 32 can be used for storing the computer program and/or module, the processor 31 by operation or The computer program and/or module being stored in the memory 32 are executed, and calls the data being stored in memory 32, Realize the various functions of the windows display equipment 30 of the video conference.The memory 32 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory may include high-speed random access memory, it can also include non-volatile Memory, such as hard disk, memory, plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card), at least one disk memory, flush memory device or other Volatile solid-state part.
Wherein, if the integrated module/unit of the windows display equipment 30 of the video conference is with SFU software functional unit Form realize and when sold or used as an independent product, can store in a computer readable storage medium. Based on this understanding, the present invention realizes all or part of the process in above-described embodiment method, can also pass through computer journey Sequence is completed to instruct relevant hardware, and the computer program can be stored in a computer readable storage medium, the meter Calculation machine program by processor 31 when being executed, it can be achieved that the step of above-mentioned each embodiment of the method.Wherein, the computer program Including computer program code, the computer program code can be source code form, object identification code form, executable file Or certain intermediate forms etc..The computer-readable medium may include: can carry the computer program code any Entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read- Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and Software distribution medium etc..It should be noted that the content that the computer-readable medium includes can be according in jurisdiction Legislation and the requirement of patent practice carry out increase and decrease appropriate, such as in certain jurisdictions, according to legislation and patent practice, meter Calculation machine readable medium does not include electric carrier signal and telecommunication signal.
Embodiment six
It is the structure of the windows display equipment 40 of another video conference provided in an embodiment of the present invention referring to Fig. 8, Fig. 8 Block diagram；The windows display equipment 40 of the video conference of the embodiment includes: processor 41, memory 42 and is stored in described In memory and the computer program that can be run on the processor 41.When the processor 41 executes the computer program Realize the step in above-described embodiment two in the multi-window display method of video conference, such as step S21~S23 shown in Fig. 4. Alternatively, the processor 41 realizes the function of each module/unit in above-mentioned each Installation practice when executing the computer program, Such as window subscriber units 21.
Illustratively, the computer program can be divided into one or more module/units, one or more A module/unit is stored in the memory 42, and is executed by the processor 41, to complete the present invention.It is one Or multiple module/units can be the series of computation machine program instruction section that can complete specific function, the instruction segment is for retouching State implementation procedure of the computer program in the windows display equipment 40 of the video conference.For example, the computer Program can be divided into window subscriber units 21, id information transmission unit 22, video flowing display unit 23 and id information and extract Unit 24.The function of the windows display device 20 of each module concrete function video conference with reference to described in above-described embodiment four, Details are not described herein.
The windows display equipment 40 of the video conference can be desktop PC, notebook, palm PC and cloud Server etc. is held to calculate equipment.The windows display equipment 40 of the video conference may include, but be not limited only to, processor 41, Memory 42.It will be understood by those skilled in the art that the schematic diagram is only the windows display equipment 40 of video conference Example does not constitute the restriction to the windows display equipment 40 of video conference, may include than illustrating more or fewer portions Part perhaps combines certain components or different components, such as the windows display equipment 40 of the video conference can also wrap Include input-output equipment, network access equipment, bus etc..
Alleged processor 41 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor Deng the processor 41 is the control centre of the windows display equipment 40 of the video conference, utilizes various interfaces and route Connect the various pieces of the windows display equipment 40 of entire video conference.
The memory 42 can be used for storing the computer program and/or module, the processor 41 by operation or The computer program and/or module being stored in the memory 42 are executed, and calls the data being stored in memory 42, Realize the various functions of the windows display equipment 40 of the video conference.The memory 42 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory may include high-speed random access memory, it can also include non-volatile Memory, such as hard disk, memory, plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card), at least one disk memory, flush memory device or other Volatile solid-state part.
Wherein, if the integrated module/unit of the windows display equipment 40 of the video conference is with SFU software functional unit Form realize and when sold or used as an independent product, can store in a computer readable storage medium. Based on this understanding, the present invention realizes all or part of the process in above-described embodiment method, can also pass through computer journey Sequence is completed to instruct relevant hardware, and the computer program can be stored in a computer readable storage medium, the meter Calculation machine program by processor 41 when being executed, it can be achieved that the step of above-mentioned each embodiment of the method.Wherein, the computer program Including computer program code, the computer program code can be source code form, object identification code form, executable file Or certain intermediate forms etc..The computer-readable medium may include: can carry the computer program code any Entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read- Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and Software distribution medium etc..It should be noted that the content that the computer-readable medium includes can be according in jurisdiction Legislation and the requirement of patent practice carry out increase and decrease appropriate, such as in certain jurisdictions, according to legislation and patent practice, meter Calculation machine readable medium does not include electric carrier signal and telecommunication signal.
Embodiment seven
It is a kind of structural frames of the windows display system 50 of video conference provided in an embodiment of the present invention referring to Fig. 9, Fig. 9 Figure, including server 51 and at least one client 52；Wherein,
The server 51 is the windows display device 10 of the video conference as described in above-described embodiment three；The visitor Family end 52 is the windows display device 20 of the video conference as described in above-mentioned example IV.The server 51 and the visitor The agreement of the information exchange at family end 52 can use DTLS (Datagram Transport Layer Security), i.e. data Packet transport layer security protocol.Preferably, the client 52 includes but is not limited to mobile phone, computer and projection arrangement.
Specifically, it is aobvious that the client 52 can subscribe to the member when there is any client 52 to be added to video conference Show window, when the client 52 has subscribed member's display window of two display same conference members, the client 52 The id information of the conference member is sent to the server 51.When the server 51 detects the client of participation video conference When end 52 has subscribed member's display window of two display same conference members, the server 51 is by the ID of the conference member Information is respectively allocated to the main window and the secondary window.
Another member of same conference member is had subscribed with member's display window when the server 51 is detected the presence of When display window, the server 51 determines main window and secondary window in two member's display windows.
Specifically, the server 51 can determine master by judging the video quality between two member's display windows Window and secondary window.At this point, it is aobvious that the client 52 subscribes to the member when there is any client 52 to be added to video conference While showing window, the server 51 obtains the video quality of each member's display window, each of in the client at Member's display window is all preset with corresponding video quality, such as 360P, 720P or 1080p etc..When presence and member's display window When mouth has subscribed another member's display window of same conference member, the server 51 judges the video of member's display window Whether quality is greater than the video quality of another member's display window；Described in being greater than when the video quality of member's display window When the video quality of another member's display window, the server 51 determine member's display window be have subscribed same conference at Main window in two member's display windows of member, another member's display window are secondary window.
Specifically, after determining the main window and the secondary window, the server 51 is by the conference member Id information is added to the video flowing to be shown of the main window.Preferably, entrained by the video flowing to be shown of the main window The id information of conference member be server encode in advance into the video flowing to be shown of the main window real-time transport protocol (RTP: Real Time Transport Protocol) identifier (CSRC) in, the identifier (CSRC) is for identifying State the unique identification in the source of video flowing to be shown.
The server 51 is forbidden video stream to be shown corresponding to the secondary window to the client 52, and Remaining remaining video flowing to be shown is all allowed to transmission.The client 52 receives the ID with the conference member and believes The video flowing to be shown of the main window of breath, by the id information of the conference member respectively with the main window and pair window After id information is matched, the video flowing to be shown of the main window is shown in the main window and the secondary window respectively Show.
Further, it sends after video flowing to be shown shown to the client 52 in the server 51, also wraps It includes: when the subscribed content of the either window in two member's display windows for having subscribed same conference member changes, institute It states server 51 and sends each client 52 of the corresponding two-way video flowing to be shown of two member's display windows respectively, so that objective Family end 52 renders two member's display windows according to the corresponding two-way video flowing to be shown of two member's display windows respectively.
Further, the server 51 detects whether the side that there is the member's display window for having subscribed same conference member Method includes but is not limited to detect audio-frequency information and detection control instruction.
Specifically, when the server 51 detects whether the side that there is the member's display window for having subscribed same conference member When method is detection audio-frequency information, server 51 determines that the audio-frequency information of which road video flowing to be shown is more than preset value (client 52 It needs the video stream by the conference member of itself shooting uniformly to summarize to server 51, then by server 51, therefore services Device 51 is able to detect that the audio-frequency information of the video flowing to be shown sended over), the preset value can be 10db, service at this time The judgement of device 51 detects the presence of the member's display window for having subscribed same conference member.Such as when there is conference member making a speech, Then the server 51, can when getting the audio-frequency information in the corresponding video flowing to be shown of the conference member more than preset value Determine that the conference member needs to subscribe to member's display windows of two display same conference members, i.e. the presence of client 52 at this time is ordered Member's display window of same conference member is read.It detects whether to exist automatically by detection audio-frequency information to have subscribed same conference Member's display window of member, does not need user in conference process and manually selects, convenient and efficient.
Specifically, when the server 51 detects whether the side that there is the member's display window for having subscribed same conference member When method is detection control instruction, i.e., client can manually select any conference member and need in two identical meetings of client subscription Member's display window of member is discussed, client 52 sends the member's display window for needing to subscribe to two same conference members at this time To server 51, server 51 then determines to detect the presence of to have subscribed identical meeting control instruction when receiving the control instruction Member's display window of member is discussed, the above process needs conference member to manually select.
Same conference member is had subscribed with member's display window when it is implemented, existing first by the detection of server 51 Another member's display window when, determine main window in two member's display windows and secondary window；Then, described in the determination After main window and the secondary window, the id information of the conference member is added to the view to be shown of the main window by server 51 Frequency flows；Finally, server 51 will have the video stream to be shown of the main window of the id information of the conference member extremely Client 52, so that the client 52 is by the video flowing to be shown of the main window respectively in the main window and the secondary window Mouth is shown.
Compared with prior art, the windows display system 50 of video conference disclosed by the invention, solves the prior art When middle big window and wicket show the same person, actually high quality and low quality two-path video can be sent to client, this Sample will increase the uplink of server, the problem for causing the speed of service of server slack-off, can reduce the uplink of server, be promoted The load capacity of server.
The above is a preferred embodiment of the present invention, it is noted that for those skilled in the art For, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also considered as Protection scope of the present invention.

Claims (13)

1. a kind of multi-window display method of video conference characterized by comprising
Instruction is subscribed in response to the window that client is sent, whether detection client has subscribed the main window of display same conference member Mouth and secondary window；Wherein, the video quality of the main window is higher than the video quality of the secondary window, the main window and secondary window Mouth is equipped with the id information of the conference member；
After determining that the client subscription shows the main window and secondary window of same conference member, by the conference member Id information is added to the video flowing to be shown of the main window；
Will the video stream to be shown with the main window of the id information of the conference member to client, and forbid by The video stream to be shown of the pair window is to client, so that the client distinguishes the id information of the conference member After being matched with the id information of the main window and secondary window, by the video flowing to be shown of the main window respectively in the master Window and the secondary window are shown.
2. the multi-window display method of video conference as described in claim 1, which is characterized in that the method also includes:
When detecting that the client for participating in video conference has subscribed there are two member's display window of same conference member, obtain The id information of the conference member is taken, and the id information of the conference member is respectively allocated to the main window and the secondary window Mouthful.
3. the multi-window display method of video conference as described in claim 1, which is characterized in that described by the conference member Id information be added to the video flowing to be shown of the main window, comprising:
The id information of the conference member is added to the mark of the real-time transport protocol of the video flowing to be shown of the main window Fu Zhong.
4. a kind of multi-window display method of video conference characterized by comprising
It is instructed in response to subscribing to, subscribes to main window and secondary window to server；Wherein, the main window and the secondary window are shown Same conference member, the video quality of the main window are greater than the video quality of the secondary window, the main window and secondary window Id information equipped with the conference member；
The id information of the conference member is sent, so that the id information of the conference member is added to the main window by server Video flowing to be shown；
The video flowing to be shown for receiving the main window of the id information with the conference member, by the ID of the conference member After information is matched with the id information of the main window and secondary window respectively, the video flowing to be shown of the main window is distinguished It is shown in the main window and the secondary window.
5. the multi-window display method of video conference as claimed in claim 4, which is characterized in that it is described send the meeting at The id information of member, so that the id information of the conference member is added to the video flowing to be shown of the main window by server, packet It includes:
The id information of the conference member is sent, so that the id information of the conference member is added to the main window by server In the identifier of the real-time transport protocol of the video flowing to be shown of mouth.
6. the multi-window display method of video conference as claimed in claim 4, which is characterized in that described receive has the meeting After the video flowing to be shown for discussing the main window of the id information of member, further includes:
The video flowing to be shown of the main window of id information with the conference member is parsed, the meeting is extracted The id information of member.
7. a kind of windows display device of video conference characterized by comprising
Conference member detection unit, the window for sending in response to client subscribe to instruction, and whether detection client has subscribed Show the main window and secondary window of same conference member；Wherein, the video quality of the main window is higher than the view of the secondary window Frequency quality, the main window and secondary window are equipped with the id information of the conference member；
Id information adding unit, in the main window and secondary window for determining that the client subscription shows same conference member Afterwards, the id information of the conference member is added to the video flowing to be shown of the main window；
Video flowing to be shown forbids transmission unit, for forbidding the video stream to be shown by the secondary window to client；
Video stream unit to be shown, the view to be shown of the main window of the id information for the conference member will to be had Frequency stream is sent to client so that the client by the id information of the conference member respectively with the main window and secondary window Id information matched after, the video flowing to be shown of the main window is carried out in the main window and the secondary window respectively Display.
8. the windows display device of video conference as claimed in claim 7, which is characterized in that described device further includes ID letter Cease allocation unit, the id information allocation unit is used for that there are two to have subscribed phase when detect the client of participating in video conference With conference member member's display window when, obtain the id information of the conference member, and by the id information of the conference member It is respectively allocated to the main window and the secondary window；
The id information adding unit, in the main window and pair for determining that the client subscription shows same conference member After window, the id information of the conference member is added to the mark of the real-time transport protocol of the video flowing to be shown of the main window Know in symbol.
9. a kind of windows display device of video conference characterized by comprising
Window subscriber units subscribe to instruction for responding, and subscribe to main window and secondary window；Wherein, the main window and the pair Window shows same conference member, and the video quality of the main window is greater than the video quality of the secondary window, the main window The id information of the conference member is equipped with secondary window；
Id information transmission unit, for sending the id information of the conference member, so that server is by the ID of the conference member Information is added to the video flowing to be shown of the main window；
Video flowing display unit, for receiving the video to be shown for having the main window of id information of the conference member Stream, after the id information of the conference member is matched with the id information of the main window and secondary window respectively, by the master The video flowing to be shown of window is shown in the main window and the secondary window respectively.
10. the windows display device of video conference as claimed in claim 9, which is characterized in that described device further includes ID Information extraction unit, the id information extraction unit be used for the conference member id information the main window to Display of video streams is parsed, and the id information of the conference member is extracted.
11. a kind of windows display equipment of video conference, which is characterized in that including processor, memory and be stored in institute The computer program executed by the processor is stated in memory and is configured as, the processor executes the computer program The multi-window display method of video conference of the Shi Shixian as described in any one of claims 1 to 3.
12. a kind of windows display equipment of video conference, which is characterized in that including processor, memory and be stored in institute The computer program executed by the processor is stated in memory and is configured as, the processor executes the computer program The multi-window display method of video conference of the Shi Shixian as described in any one of claim 4 to 6.
13. a kind of windows display system of video conference, which is characterized in that including server and at least one client；Its In,
The server is the windows display device of the video conference as described in any one of claim 7~8；
The client is the windows display device of the video conference as described in any one of claim 9~10.
CN201811158872.5A 2018-09-30 2018-09-30 Multi-window display method, device, equipment and system for video conference Active CN109309805B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811158872.5A CN109309805B (en) 2018-09-30 2018-09-30 Multi-window display method, device, equipment and system for video conference

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811158872.5A CN109309805B (en) 2018-09-30 2018-09-30 Multi-window display method, device, equipment and system for video conference

Publications (2)

Publication Number Publication Date
CN109309805A true CN109309805A (en) 2019-02-05
CN109309805B CN109309805B (en) 2021-04-06

Family

ID=65225134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811158872.5A Active CN109309805B (en) 2018-09-30 2018-09-30 Multi-window display method, device, equipment and system for video conference

Country Status (1)

Country Link
CN (1) CN109309805B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112003978A (en) * 2020-08-21 2020-11-27 惠州Tcl云创科技有限公司 Conference management interface display method and device, storage medium and terminal equipment
WO2023082585A1 (en) * 2021-11-15 2023-05-19 深圳市健成云视科技有限公司 Information sharing method and apparatus based on two-way selection right, and device and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547142A (en) * 2010-12-27 2012-07-04 佛山络威网络技术有限公司 Method for managing and controlling video matrix based on conferences
CN103384319A (en) * 2012-05-04 2013-11-06 中兴通讯股份有限公司 Image resizing method and system of double-current video conference terminal
US20140184720A1 (en) * 2012-12-28 2014-07-03 Ittiam Systems Pte. Ltd. Platform for end point and digital content centric real-time shared experience for collaboration
CN104427293A (en) * 2013-08-23 2015-03-18 中兴通讯股份有限公司 Method and device for establishing video conference interface and video terminal
CN104754283A (en) * 2013-12-25 2015-07-01 北京新媒传信科技有限公司 Audio/video communication method, server and system
CN108024087A (en) * 2016-10-31 2018-05-11 北京视联动力国际信息技术有限公司 A kind of method and system of video dispatching

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547142A (en) * 2010-12-27 2012-07-04 佛山络威网络技术有限公司 Method for managing and controlling video matrix based on conferences
CN103384319A (en) * 2012-05-04 2013-11-06 中兴通讯股份有限公司 Image resizing method and system of double-current video conference terminal
US20140184720A1 (en) * 2012-12-28 2014-07-03 Ittiam Systems Pte. Ltd. Platform for end point and digital content centric real-time shared experience for collaboration
CN104427293A (en) * 2013-08-23 2015-03-18 中兴通讯股份有限公司 Method and device for establishing video conference interface and video terminal
CN104754283A (en) * 2013-12-25 2015-07-01 北京新媒传信科技有限公司 Audio/video communication method, server and system
CN108024087A (en) * 2016-10-31 2018-05-11 北京视联动力国际信息技术有限公司 A kind of method and system of video dispatching

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112003978A (en) * 2020-08-21 2020-11-27 惠州Tcl云创科技有限公司 Conference management interface display method and device, storage medium and terminal equipment
WO2023082585A1 (en) * 2021-11-15 2023-05-19 深圳市健成云视科技有限公司 Information sharing method and apparatus based on two-way selection right, and device and medium

Also Published As

Publication number Publication date
CN109309805B (en) 2021-04-06

Similar Documents

Publication Publication Date Title
CN109218653A (en) A kind of multi-window display method of video conference, device, equipment and system
CN108289187B (en) Method and system for accessing live webcast to video conference
US8666042B2 (en) Techniques for performing key frame requests in media servers and endpoint devices
EP3021556A1 (en) Transmission method and device for media stream in video conference
CN112422879B (en) Method and device for dynamically adjusting media capability
TW577237B (en) Load balance system and method of wireless LAN
CN104836981A (en) Intelligent meeting collaborative method and meeting terminal
US20130198635A1 (en) Managing Multiple Participants at the Same Location in an Online Conference
CN104125540A (en) Multipoint communication device and method of performing switching from multipoint communication to point-to-point communication
CN102185856A (en) Team organizing video method, device and system used in team organizing game
CN111432158B (en) Load balancing method and device for media nodes, storage medium and electronic device
CN109391585A (en) Video data handling procedure, device, terminal and computer readable storage medium
WO2020024775A1 (en) Data transmission control method and related apparatus
CN102893603A (en) Video conferencing processing method, apparatus and communication system
CN109309805A (en) A kind of multi-window display method of video conference, device, equipment and system
CN106973253A (en) A kind of method and device for adjusting media flow transmission
US20150326824A1 (en) Method and a device for optimizing large scaled video conferences
US20160134837A1 (en) Methods, devices, and systems for controlling audio and video transmission
CN110602763B (en) Method, system and storage medium for dual-card terminal to select SIM card to access VoWiFi network
US9035992B1 (en) Bandwidth modulation system and method
CN106341646A (en) Conference cascade method and device
US9003557B1 (en) Content sharing system and method
US8489688B2 (en) Managing delivery of electronic meeting content
CN110248138B (en) Method and device for audio and video conference
US10587569B2 (en) Streaming service providing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant