CN112218031A - Video conference data transmission method and system - Google Patents

Video conference data transmission method and system Download PDF

Info

Publication number
CN112218031A
CN112218031A CN202010978221.1A CN202010978221A CN112218031A CN 112218031 A CN112218031 A CN 112218031A CN 202010978221 A CN202010978221 A CN 202010978221A CN 112218031 A CN112218031 A CN 112218031A
Authority
CN
China
Prior art keywords
video
information
acquiring
coordinate information
conference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010978221.1A
Other languages
Chinese (zh)
Inventor
颜海洋
叶恒
孙小权
蒋勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Huaiye Information Technology Co ltd
Original Assignee
Jiangsu Huaiye Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Huaiye Information Technology Co ltd filed Critical Jiangsu Huaiye Information Technology Co ltd
Priority to CN202010978221.1A priority Critical patent/CN112218031A/en
Publication of CN112218031A publication Critical patent/CN112218031A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26241Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the time of distribution, e.g. the best time of the day for inserting an advertisement or airing a children program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2665Gathering content from different sources, e.g. Internet and satellite
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

The invention provides a method and a system for transmitting video conference data, wherein the method comprises the following steps: acquiring the video resolution of a composite picture played by a video conference, and acquiring the coordinate information of a double-click position relative to the video resolution; acquiring meeting terminal information corresponding to the coordinate information according to the coordinate information, and acquiring corresponding original code stream information according to the meeting terminal information; and switching the synthesized video stream sent to the corresponding participating terminal into the original video stream according to the original code stream information. According to the method, the relative coordinates of the double-click position relative to the video are captured, and the video content is switched on the original network connection according to the relative coordinates, so that the calculated amount of the playing terminal is reduced, the problems that the meeting place cannot hear the sound due to the fact that a channel needs to be reestablished when a single-channel picture is checked are solved, and the user experience is improved.

Description

Video conference data transmission method and system
Technical Field
The present invention relates to the field of multimedia communication technologies, and in particular, to a method and a system for transmitting videoconference data, a computer device, and a computer program product.
Background
At present, in the field of video Conferencing, there are two modes, namely, an SFU (Selective Forwarding Unit) mode and an MCU (Multipoint conference Unit) mode, where each individual terminal transmits a video stream to a central server in the SFU mode, and the central server forwards the stream, and in this mode, the requirement on the load capacity of a terminal network is higher and higher as more and more terminals join in the SFU mode. Under the MCU mode, each terminal transmits the code stream to the server, the server performs mixed flow and transmits the mixed flow to each terminal, even if the added terminal only transmits one stream due to the server, the network load of the terminal and the processing capacity requirement of the terminal are greatly reduced.
Due to mixed flow in the MCU mode, the video of each participant is zoomed, and the definition of the picture when the video is transmitted to the terminal brings certain loss relative to the definition of a single-channel video in the SFU mode. The need to view the video of one participant more clearly and still hear the sound of the other participants in a particular scene becomes more urgent and practical.
In the related art, a server transmits a composite screen layout and information of each participant in the layout to a client for processing by the client. After the client obtains the original video address of a certain participant through calculation, a new playing connection is established to play the original code stream or the existing connection is closed to establish new playing. However, there are the following problems: each terminal needs to know the layout and other complex information of the playing picture; the server needs to notify frequently, and the terminal needs to change frequently; the same calculation content has redundancy and the calculation capacities of different terminals are different too much; a connection or a playing window needs to be established, so that terminal resources are wasted; the delay or pause of the playing due to the newly established connection and the playing window is poor in user experience.
Disclosure of Invention
The invention aims to solve the technical problems and provides a transmission method of video conference data, which reduces the calculated amount of a playing terminal by capturing the relative coordinates of a double-click position relative to a video and switching the video content on the original network connection according to the relative coordinates, avoids the problems of black screen, blockage and incapability of hearing conference place sound caused by reestablishing a channel when a single-path picture is checked, and improves the user experience.
The technical scheme adopted by the invention is as follows:
a transmission method of video conference data comprises the following steps: acquiring the video resolution of a composite picture played by a video conference, and acquiring the coordinate information of a double-click position relative to the video resolution; acquiring meeting terminal information corresponding to the coordinate information according to the coordinate information, and acquiring corresponding original code stream information according to the meeting terminal information; and switching the synthesized video stream sent to the corresponding participating terminal into the original video stream according to the original code stream information.
In one embodiment of the invention, acquiring coordinate information of a double-click position relative to a video resolution comprises: acquiring coordinate information of a double-click position relative to the whole window; calculating the coordinate information of the double-click position relative to the playing window according to the proportion of the video rendering area relative to the whole window; and converting the coordinates relative to the playing window into coordinate information relative to the video resolution.
In an embodiment of the present invention, acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information includes: acquiring meeting place information of the video conference; determining a corresponding meeting place processing thread according to the meeting place information; and acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information and the meeting place processing thread.
In an embodiment of the present invention, sending an original video stream to a corresponding participating terminal according to original code stream information, further includes: sending a data transmission request to the original video source; and when the data transmission video frame reaches a preset frame value, switching the composite video stream sent to the corresponding participant terminal into an original video stream.
The invention also provides a system for transmitting the video conference data, which comprises: the conference system comprises a conference server and a conference terminal, wherein the conference terminal is used for acquiring the video resolution of a composite picture played by a video conference and acquiring the coordinate information of a double-click position relative to the video resolution; and the conference server is used for acquiring the information of the conference participating terminals corresponding to the coordinate information according to the coordinate information, acquiring corresponding original code stream information according to the information of the conference participating terminals, and switching the synthesized video stream sent to the corresponding conference participating terminals into the original video stream according to the original code stream information.
In an embodiment of the present invention, the conference terminal, when acquiring coordinate information of a double-click position relative to a video resolution, is specifically configured to: acquiring coordinate information of a double-click position relative to the whole window; calculating the coordinate information of the double-click position relative to the playing window according to the proportion of the video rendering area relative to the whole window; and converting the coordinates relative to the playing window into coordinate information relative to the video resolution.
In one embodiment of the present invention, the conference server includes: the conference server is further used for acquiring meeting place information of the video conference and determining a corresponding meeting place processing thread according to the meeting place information; and the layout processing module is used for acquiring the information of the conference participating terminal corresponding to the coordinate information according to the coordinate information and the conference place processing thread.
In one embodiment of the present invention, the conference server further includes: and the sending module is used for sending a data transmission request to the original video source and switching the synthesized video stream sent to the corresponding participating terminal into the original video stream when the data transmission video frame reaches a preset frame value.
The invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the transmission method of the video conference data is realized.
The invention also proposes a computer program product in which the instructions, when executed by a processor, perform the above-mentioned method of transmitting videoconference data.
The invention has the beneficial effects that:
according to the invention, the relative coordinates of the double-click position relative to the video are captured, and the video content is switched on the original network connection according to the relative coordinates, so that the calculated amount of the playing terminal is reduced, the problems of black screen, blockage and incapability of hearing meeting place sound caused by the fact that a channel needs to be reestablished when a single-channel picture is checked are avoided, and the user experience is improved.
Drawings
Fig. 1 is a flowchart of a method for transmitting videoconference data according to embodiments of the present invention;
fig. 2 is a schematic view of an application scenario of a transmission system of videoconference data according to the embodiments of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 2 is a schematic view of an application scenario of a transmission system of video conference data according to an embodiment of the present invention, as shown in fig. 2, the system may include a conference server and a plurality of terminals, where each terminal sends an original audio/video stream to the conference server after joining a conference, and the conference server synthesizes the video streams, mixes audio streams, and transmits the mixed audio/video to each participating terminal.
The conference server is used for receiving a conference operation request of the conference terminal after the conference terminal is determined to be successfully logged in; and performing relevant processing on the video or the audio according to the operation request. The conference terminal can be a computer, a smart phone or other portable audio and video equipment, after the terminal successfully logs in the video conference server, the terminal sends a creation request to the video conference signaling server, receives a conference entering notice of other terminals in a conference place, obtains an audio and video code stream according to an audio and video playing address given by the video conference server, displays the audio and video code stream, and sends an audio and video signaling to the server to make an operation request.
The following describes in detail the implementation process of video conference data transmission in the above application scenario.
Fig. 1 is a flowchart of a method for transmitting videoconference data according to embodiments of the present invention.
As shown in fig. 1, a method for transmitting videoconference data according to embodiments of the present invention may include the following steps:
and S1, acquiring the video resolution of the composite picture played by the video conference, and acquiring the coordinate information of the double-click position relative to the video resolution.
According to one embodiment of the invention, acquiring coordinate information of a double-click position relative to a video resolution comprises: acquiring coordinate information of a double-click position relative to the whole window; calculating coordinate information of a double-click position relative to a playing window according to the proportion of the video rendering area relative to the whole window; the coordinates relative to the playing window are converted into coordinate information relative to the video resolution.
Specifically, the width and height of the playing window obtained by the conference terminal are respectively W1 and H1, the width and height of the video rendering area are respectively W2 and H2, wherein W2 is not less than W1, and H2 is not less than H1, the position (x1 and y1) of the double-click position relative to the playing window is obtained through an Application Programming Interface (API), and the video resolution ratio obtained from the conference server is W3: h3, calculating the positions (x2, y2) of the double-click positions relative to the rendering area according to W1, H1, W2, H2, (x1, y1), combining and converting the (x2, y2) into coordinates (x3, y3) under the W3: H3 proportion, namely obtaining the coordinate information of the last double-click position relative to the video resolution, and sending the coordinate information and the participated meeting place information to a conference server through signaling. It should be noted that the specific conversion process can be obtained by means of the prior art.
And S2, acquiring the participating terminal information corresponding to the coordinate information according to the coordinate information, and acquiring the corresponding original code stream information according to the participating terminal information, wherein the participating terminal information mainly comprises an original code stream ID.
According to one embodiment of the present invention, acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information includes: acquiring meeting place information of a video conference; determining a corresponding meeting place processing thread according to the meeting place information; and acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information and the meeting place processing thread.
Specifically, the conference server finds a corresponding conference place according to the conference place information, finds a corresponding conference place processing thread according to the conference place ID, and calculates a layout window in which the coordinate falls according to the coordinate information to obtain an original code stream ID corresponding to the layout window. The layout window and the original code stream ID are pre-designated by the conference server when the conference terminal enters the conference place, or can be calibrated by the user according to the situation.
It should be noted that, after logging in the conference server, the conference terminal can already determine the conference site ID.
And S3, switching the composite video stream sent to the corresponding participating terminal into the original video stream according to the original code stream information.
According to an embodiment of the present invention, sending an original video stream to a corresponding participating terminal according to original code stream information, further includes: sending a data transmission request to an original video source; and when the data transmission video frame reaches a preset frame value, switching the composite video stream sent to the corresponding participant terminal into the original video stream.
Specifically, the conference server sends an IDR request according to a participant terminal corresponding to an original code stream ID, and determines whether an IDR video frame reaches a preset frame value, that is, whether the time for playing the original code stream is reached, and when the IDR video frame reaches the preset frame value, video content is switched over on an original network connection, and a synthesized video stream is switched over to the original video stream, so that sound of a conference place is still kept unchanged.
In conclusion, the relative coordinates of the double-click position relative to the video are captured, and the video content is switched on the original network connection according to the relative coordinates, so that the calculated amount of the playing terminal is reduced, the problems of black screen, blockage and incapability of hearing meeting place sound caused by the fact that a channel needs to be reestablished when a single-channel picture is checked are avoided, and the user experience is improved.
Corresponding to the above embodiment, the present invention further provides a transmission system for videoconference data, including: the conference system comprises a conference server and a conference terminal, wherein the conference terminal is used for acquiring the video resolution of a composite picture played by a video conference and acquiring the coordinate information of a double-click position relative to the video resolution; the conference server is used for acquiring the information of the participating terminals corresponding to the coordinate information according to the coordinate information, acquiring the corresponding original code stream information according to the information of the participating terminals, and switching the synthesized video stream sent to the corresponding participating terminals into the original video stream according to the original code stream information.
In an embodiment of the present invention, when the conference terminal acquires coordinate information of a double-click position relative to a video resolution, the method is specifically configured to: acquiring coordinate information of a double-click position relative to the whole window; calculating coordinate information of a double-click position relative to a playing window according to the proportion of the video rendering area relative to the whole window; the coordinates relative to the playing window are converted into coordinate information relative to the video resolution.
In one embodiment of the invention, a conference server comprises: the conference server is also used for acquiring meeting place information of the video conference and determining a corresponding meeting place processing thread according to the meeting place information; and the layout processing module is used for acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information and the meeting place processing thread.
In one embodiment of the present invention, the conference server further comprises: and the sending module is used for sending a data transmission request to the original video source and switching the synthesized video stream sent to the corresponding participant terminal into the original video stream when the data transmission video frame reaches a preset frame value.
It should be noted that details that are not disclosed in the transmission system of the video conference data according to the embodiment of the present invention refer to details disclosed in the transmission method of the video conference data according to the embodiment of the present invention, and details are not described here again.
The system of the invention reduces the calculated amount of the playing terminal by capturing the relative coordinate of the double-click position relative to the video and switching the video content on the original network connection according to the relative coordinate, avoids the problems of black screen, blockage and incapability of hearing meeting place sound caused by reestablishing a channel when checking a single-channel picture, and improves the user experience.
Corresponding to the above embodiment, the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, and when the processor executes the computer program, the method for transmitting the video conference data is implemented.
According to the computer equipment, by executing the video conference data transmission method, the calculation amount of the playing terminal can be reduced, the problems that a channel needs to be reestablished for viewing a single-channel picture, the video conference room is dark, blocked and incapable of hearing the sound of the conference room are solved, and the user experience is improved.
The invention also proposes a computer program product in which the instructions, when executed by a processor, perform the method for transmitting videoconference data described above.
According to the computer program product, by executing the video conference data transmission method, the calculation amount of the playing terminal can be reduced, the problems that a channel needs to be reestablished for viewing a single-channel picture, the video conference room is dark, blocked and incapable of hearing the sound of the conference room are solved, and the user experience is improved.
In the description of the present invention, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The meaning of "plurality" is two or more unless specifically limited otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (10)

1. A method for transmitting videoconference data, comprising the steps of:
acquiring the video resolution of a composite picture played by a video conference, and acquiring the coordinate information of a double-click position relative to the video resolution;
acquiring meeting terminal information corresponding to the coordinate information according to the coordinate information, and acquiring corresponding original code stream information according to the meeting terminal information;
and switching the synthesized video stream sent to the corresponding participating terminal into the original video stream according to the original code stream information.
2. The method of claim 1, wherein obtaining coordinate information of a double click position relative to a video resolution comprises:
acquiring coordinate information of a double-click position relative to the whole window;
calculating the coordinate information of the double-click position relative to the playing window according to the proportion of the video rendering area relative to the whole window;
and converting the coordinates relative to the playing window into coordinate information relative to the video resolution.
3. The method for transmitting videoconference data according to claim 1, wherein obtaining participant terminal information corresponding to the coordinate information according to the coordinate information comprises:
acquiring meeting place information of the video conference;
determining a corresponding meeting place processing thread according to the meeting place information;
and acquiring the information of the participating terminal corresponding to the coordinate information according to the coordinate information and the meeting place processing thread.
4. The method for transmitting videoconference data according to claim 1, wherein the method for transmitting the original video stream to the corresponding participating terminal according to the original code stream information further comprises:
sending a data transmission request to the original video source;
and when the data transmission video frame reaches a preset frame value, switching the composite video stream sent to the corresponding participant terminal into an original video stream.
5. A system for transmitting videoconference data, comprising: a conference server and a conference terminal, wherein,
the conference terminal is used for acquiring the video resolution of a composite picture played by the video conference and acquiring the coordinate information of the double-click position relative to the video resolution; and the conference server is used for acquiring the information of the conference participating terminals corresponding to the coordinate information according to the coordinate information, acquiring corresponding original code stream information according to the information of the conference participating terminals, and switching the synthesized video stream sent to the corresponding conference participating terminals into the original video stream according to the original code stream information.
6. The system for transmitting videoconference data according to claim 5, wherein the conference terminal is configured to, when acquiring the coordinate information of the double-click position with respect to the video resolution, specifically:
acquiring coordinate information of a double-click position relative to the whole window;
calculating the coordinate information of the double-click position relative to the playing window according to the proportion of the video rendering area relative to the whole window;
and converting the coordinates relative to the playing window into coordinate information relative to the video resolution.
7. The system for transmitting videoconference data of claim 5, wherein the conference server comprises: a layout processing module, wherein,
the conference server is also used for acquiring meeting place information of the video conference and determining a corresponding meeting place processing thread according to the meeting place information;
and the layout processing module is used for acquiring the information of the conference participating terminal corresponding to the coordinate information according to the coordinate information and the conference place processing thread.
8. The system for transmitting videoconference data of claim 5, wherein the conference server further comprises:
and the sending module is used for sending a data transmission request to the original video source and switching the synthesized video stream sent to the corresponding participating terminal into the original video stream when the data transmission video frame reaches a preset frame value.
9. Computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a method of transmission of videoconference data according to any of claims 1 to 4 when executing the program.
10. A computer program product, characterized in that instructions in the computer program product, when executed by a processor, perform the method of transmission of videoconference data according to any of claims 1-4.
CN202010978221.1A 2020-09-17 2020-09-17 Video conference data transmission method and system Pending CN112218031A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010978221.1A CN112218031A (en) 2020-09-17 2020-09-17 Video conference data transmission method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010978221.1A CN112218031A (en) 2020-09-17 2020-09-17 Video conference data transmission method and system

Publications (1)

Publication Number Publication Date
CN112218031A true CN112218031A (en) 2021-01-12

Family

ID=74049513

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010978221.1A Pending CN112218031A (en) 2020-09-17 2020-09-17 Video conference data transmission method and system

Country Status (1)

Country Link
CN (1) CN112218031A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113315927A (en) * 2021-05-27 2021-08-27 维沃移动通信有限公司 Video processing method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291398A (en) * 2008-06-02 2008-10-22 深圳华为通信技术有限公司 Method and apparatus of multi-image setting
CN103051865A (en) * 2012-12-28 2013-04-17 华为技术有限公司 Method and terminal for controlling picture and video meeting device
CN103873813A (en) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 Method and system for conference television multi-screen switching
CN108124117A (en) * 2016-11-28 2018-06-05 南宁富桂精密工业有限公司 Menu control method and user terminal
CN110636242A (en) * 2018-06-22 2019-12-31 中兴通讯股份有限公司 Picture switching method in video conference, terminal and MCU

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291398A (en) * 2008-06-02 2008-10-22 深圳华为通信技术有限公司 Method and apparatus of multi-image setting
CN103873813A (en) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 Method and system for conference television multi-screen switching
CN103051865A (en) * 2012-12-28 2013-04-17 华为技术有限公司 Method and terminal for controlling picture and video meeting device
CN108124117A (en) * 2016-11-28 2018-06-05 南宁富桂精密工业有限公司 Menu control method and user terminal
CN110636242A (en) * 2018-06-22 2019-12-31 中兴通讯股份有限公司 Picture switching method in video conference, terminal and MCU

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113315927A (en) * 2021-05-27 2021-08-27 维沃移动通信有限公司 Video processing method and device, electronic equipment and storage medium
CN113315927B (en) * 2021-05-27 2023-04-28 维沃移动通信有限公司 Video processing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US8456510B2 (en) Virtual distributed multipoint control unit
US8514265B2 (en) Systems and methods for selecting videoconferencing endpoints for display in a composite video image
US7864209B2 (en) Audio processing in a multi-participant conference
US9210380B2 (en) Multi-participant conference setup
US9462227B2 (en) Automatic video layouts for multi-stream multi-site presence conferencing system
US8861701B2 (en) Multi-participant conference adjustments
US7949117B2 (en) Heterogeneous video conferencing
EP1875769B1 (en) Multi-participant conferencing
EP2987273B1 (en) Dynamic allocation of encoders
US20060256983A1 (en) Audio based on speaker position and/or conference location
CN102215375B (en) The system of selection of the video source of the sprite of more pictures and device in multimedia conferencing
US10044782B2 (en) Terminal device, data transmission method, and computer-readable recording medium
EP2359531A1 (en) Video conferencing subscription using multiple bit rate streams
CN102648584B (en) Use the system of forward error correction inspection available bandwidth, method and medium
US20110137438A1 (en) Video conference system and method based on video surveillance system
CN112019927A (en) Video live broadcast method, microphone connecting equipment, RTC media server and main broadcast equipment
WO2023071356A1 (en) Video conference processing method and processing device, and conference system and storage medium
CN112218031A (en) Video conference data transmission method and system
CN108574840B (en) Method and device for evaluating video experience quality
US20110279632A1 (en) Multiway Telepresence without a Hardware MCU
CN111405308A (en) Method and device for sending live audio and video data
CN112804471A (en) Video conference method, conference terminal, server and storage medium
CN112055365B (en) Method and device for terminal networking, terminal and readable storage medium
CN113129915B (en) Audio sharing method, device, equipment, storage medium and program product
CN111629219A (en) Multi-party interaction and live broadcast control system and control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210112