CN108965781B - Audio and video stream transmission method and device and display system - Google Patents
Audio and video stream transmission method and device and display system Download PDFInfo
- Publication number
- CN108965781B CN108965781B CN201711321361.6A CN201711321361A CN108965781B CN 108965781 B CN108965781 B CN 108965781B CN 201711321361 A CN201711321361 A CN 201711321361A CN 108965781 B CN108965781 B CN 108965781B
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- conference
- channel
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the invention provides a transmission method, a device and a display system of audio and video streams, wherein the transmission method comprises the following steps: receiving a conference opening instruction of a video network video conference sent by a webpage management server; binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the meeting opening instruction; and transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component for display. In the embodiment of the invention, in the video conference of the video network, the audio and video stream can be effectively controlled to be output to the multi-picture screen corresponding to the browser for display according to the meeting command. The method effectively controls the input and output of the video stream of the video networking conference, solves the problems that the number of devices participating in the conference is limited when the existing multi-picture screen displays, and improves the poor user experience of the video networking conference.
Description
Technical Field
The present invention relates to the field of data transmission technologies, and in particular, to a method, an apparatus, and a display system for transmitting audio/video streams.
Background
In the prior art, most of four-picture display modes of an internet video conference system are based on a webservice technology as an entrance, a video conference example is encapsulated at a lower layer, a conference flow is controlled, equipment is added if a video conference needs to be started, a display corresponding to the added equipment and a channel number to be used are bound, then corresponding audio and video streams are called in through the bound channel number, and finally the audio and video streams are displayed through the bound display. Because such internet video conferences are usually displayed in multiple pictures, for example, in four pictures, each conference can only be added by binding four devices, and the conference contents of the four added devices are displayed, if the number of the added devices exceeds four, the conference contents of the first added devices can only be displayed, and of course, if the conference contents of the later added devices are to be displayed, the conference contents of the newly added devices can only be displayed by replacing the conference contents of the original added devices.
Therefore, the multi-split screen display of the existing internet video conference is fixed, if the number of conferences exceeds the number of split screens, the conferences with the same number as the split screens can only be displayed, for example, the four-split screen display can only display the first four conferences which are added, and if the newly added equipment is required to be displayed, the original equipment needs to be replaced to display, so that the number of the conference equipment which is added is limited by the existing multi-split screen display.
Therefore, in the video conference of the video network, how to display the conference contents of more joining devices through multiple split screens is a technical problem which is urgently solved by the technical personnel in the field at present.
Disclosure of Invention
The technical problem to be solved by the embodiment of the invention is to provide a transmission method of audio and video streams, so as to solve the problem that the user experience of a video conference of a video network is poor due to the limitation of the number of conference devices participating in the existing multi-split-screen display.
Correspondingly, the embodiment of the invention also provides a transmission device of the audio and video stream and a display system of the audio and video stream, which are used for ensuring the realization and the application of the method.
In order to solve the problems, the invention is realized by the following technical scheme:
a first aspect provides a method for transmitting audio and video streams, the method including:
receiving a conference opening instruction of a video network video conference sent by a webpage management server;
binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the meeting opening instruction;
and transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component for display.
Optionally, if the conference opening instruction does not include a screen channel ID number corresponding to an audio/video stream of the designated device, the binding the incoming multiple paths of audio/video streams to the corresponding screen channel according to the conference opening instruction includes:
and sequentially binding the incoming multi-channel audio and video streams to the first screen channel to the Nth screen channel according to the meeting opening instruction, wherein N is a natural number greater than 1.
Optionally, if the conference opening instruction includes a screen channel ID number corresponding to each audio/video in the multiple paths of audio/video streams of the designated device, binding the incoming multiple paths of audio/video streams to the corresponding screen channels according to the conference opening instruction includes:
and binding the multi-channel audio and video streams transmitted by the appointed equipment to the screen channels respectively corresponding to the ID numbers of the screen channels of the appointed equipment according to the conference opening instruction.
Optionally, the method further includes:
receiving a stopping instruction or a conference ending instruction of the video conference of the video network sent by a webpage management server;
and unbinding the screen channel corresponding to the multi-path audio and video stream according to the stop instruction or the conference end instruction.
A second aspect provides an apparatus for transmitting audio and video streams, the apparatus comprising:
the first receiving module is used for receiving a conference opening instruction of the video network video conference sent by the webpage management server;
the binding module is used for binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the conference opening instruction;
and the transmission module is used for transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component so as to facilitate the browser multi-picture screen to display the multi-path audio and video stream.
Optionally, the conference opening instruction received by the first receiving module does not include: a screen channel ID number corresponding to the audio and video stream of the equipment is specified;
the binding module is specifically configured to sequentially bind the incoming multiple paths of audio and video streams to a first screen channel to an nth screen channel according to the conference opening instruction through a default rule, where N is a natural number greater than 1.
Optionally, the conference opening instruction received by the first receiving module includes: and if the screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the specified device is specified, the binding module comprises:
and the binding module is specifically used for binding the multi-channel audio and video streams transmitted by the specified equipment to the screen channels respectively corresponding to the ID numbers of the specified screen channels according to the conference opening instruction.
Optionally, the apparatus further comprises:
the second receiving module is used for receiving a stopping instruction or a conference ending instruction of the video conference of the video network sent by the webpage management server;
and the unbinding module is used for unbinding the screen channel corresponding to the multi-path audio and video stream according to the stopping instruction or the conference ending instruction.
A third aspect provides a display system for audio and video streams, the system comprising:
the webpage management server is used for receiving a conference opening instruction of the video network video conference sent by a user through a webpage service interface and forwarding the conference opening instruction to the scheduling server;
the scheduling server is used for receiving a conference opening instruction of the video network video conference sent by the webpage management server, binding the incoming multi-path audio and video stream to a corresponding screen channel according to the conference opening instruction, and transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM (component object model) component;
and the browser multi-picture screen is used for displaying the multi-path audio and video stream transmitted by the scheduling server.
Alternatively to this, the first and second parts may,
the dispatch server is further configured to, when the conference opening instruction does not include: when a screen channel ID number corresponding to the audio and video stream of the equipment is specified, sequentially binding the incoming multi-channel audio and video stream to a first screen channel to an Nth screen channel according to the conference opening instruction through a default rule, wherein N is a natural number greater than 1; or
And the scheduling server is further used for binding the multi-path audio and video stream transmitted by the appointed equipment to the screen channels respectively corresponding to the appointed screen channel ID numbers according to the conference opening instruction when the conference opening instruction comprises the screen channel ID numbers corresponding to each path of audio and video in the multi-path audio and video stream of the appointed equipment.
Optionally, the web page management server is further configured to receive a stop instruction or a conference end instruction of the video conference over internet sent by the user through a page service interface, and forward the stop instruction or the conference end instruction to the scheduling server;
and the scheduling server is also used for unbinding the incoming multi-path audio and video stream from the corresponding screen channel according to the stop instruction or the conference end instruction.
Compared with the prior art, the embodiment of the invention has the following advantages:
in the embodiment of the invention, in the video networking video conference, the scheduling server can effectively control the audio and video streams to be output to the multi-picture screen corresponding to the browser for display according to the meeting opening instruction, and when receiving the stopping instruction or the conference ending instruction of the video networking video conference, the scheduling server unbundles the screen channels corresponding to the multiple paths of audio and video streams according to the stopping instruction or the conference ending instruction. The method effectively controls the input and output of audio and video streams, solves the problems that the number of conference participating devices is limited during the display of the traditional multi-picture screen, and the user experience of the video network video conference is poor.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
Fig. 1 is a flowchart of a transmission method of audio and video streams according to an embodiment of the present invention;
fig. 2 is another flowchart of a transmission method of audio and video streams according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an apparatus for transmitting audio and video streams according to an embodiment of the present invention;
fig. 4 is another schematic structural diagram of an apparatus for transmitting audio/video streams according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a display system of audio and video streams according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart of a method for transmitting audio/video stream according to an embodiment of the present invention may specifically include the following steps:
step 101: receiving a conference opening instruction of a video network video conference sent by a webpage management server;
in this step, a web page management server (or a web page management platform) receives a conference opening instruction of a video conference on internet sent by a user through a web service interface (webservice), and forwards the conference opening instruction to the scheduling server, that is, the scheduling server receives the conference opening instruction of the video conference on internet sent by the web page management server.
In this embodiment, a user can create an appointment and real-time schedule for a video conference via a web page management server, and receive conference opening messages from the video network and the internet when the conference starts to be executed.
In this embodiment, the start instruction may include a screen channel ID number corresponding to each channel of audio and video in the multiple channels of audio and video streams of the designated device, that is, a designated device ID number and a screen channel ID number; or not including the screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the designated device. And the screen channel ID number and the corresponding screen ID number are pre-bound or set.
The ID is an Identifier (Identifier), the specified device ID number is a specified device Identifier, the screen channel ID number is a screen channel Identifier, and the screen ID number is a screen display Identifier.
Step 102: binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the meeting opening instruction;
in this step, the scheduling server binds the incoming multi-channel audio and video stream to the corresponding screen channel according to whether the conference opening instruction includes the screen channel ID number corresponding to each channel of audio and video in the specified multi-channel audio and video stream, and divides the incoming multi-channel audio and video stream into two cases:
in one case, if the conference opening instruction includes a screen channel ID number corresponding to each audio/video in the multiple paths of audio/video streams of the designated device, the scheduling server binds the multiple paths of audio/video streams transmitted by the designated device to screen channels respectively corresponding to the designated screen channel ID numbers according to the conference opening instruction.
For example, if the conference opening instruction includes an ID number of a specific device, a screen channel ID number of an audio/video stream for transmitting the specific device, and a screen ID number for split-screen display; wherein, the screen channel ID number and the screen ID number are bound or set in advance. The designated device is a device for accessing the video conference of the video network.
In this embodiment, the scheduling server first binds the ID number of the specified device, the screen channel ID number, and the screen ID number according to the meeting opening instruction, that is, binds the multiple audio/video streams transmitted by the specified device to the screen channels corresponding to the screen channel ID numbers of the specified device, respectively.
If the conference opening instruction does not include the screen channel ID number corresponding to the audio and video stream of the designated device, the scheduling server sequentially binds the incoming multiple paths of audio and video streams to the first screen channel to the Nth screen channel according to the conference opening instruction, wherein N is a natural number greater than 1.
That is, if the meeting opening instruction does not include the screen channel ID number corresponding to the audio/video stream of the designated device, the scheduling server sequentially binds the incoming multiple paths of audio/video streams to the first screen channel to the nth screen channel according to the default rule, where N is a natural number greater than 1.
For example, if four audio and video streams are received, the scheduling server binds the first audio and video stream to the first screen channel, binds the second audio and video stream to the second screen channel, binds the third audio and video stream to the third screen channel, and binds the fourth audio and video stream to the fourth screen channel.
Step 103: and transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component for display.
In the step, the scheduling server sends each path of video stream in the multi-path audio and video stream to a multi-picture screen of a browser pre-bound with the scheduling server through a corresponding screen channel through a COM component for displaying.
For example, if the multi-screen of the browser is a four-screen of the browser, the scheduling server sends four paths of audio and video streams to the corresponding four-screen of the browser through the COM component and the corresponding screen channels respectively for display.
The COM component object model (COM component) in this embodiment is an object-oriented programming model, and COM components are well known to those skilled in the art and will not be described herein.
It should be noted that the audio/video stream in this embodiment may be a common audio/video stream, or a high-definition audio/video stream, and the like; the multi-screen of the browser may be a browser split screen, a browser split screen 4, a browser split screen 9, and the like, which is not limited in this embodiment.
In the embodiment of the invention, when a meeting command of a video network video conference is received, the incoming audio and video stream can be bound to the corresponding screen channel and transmitted to the corresponding browser multi-picture screen through the COM component for display. In other words, in the embodiment of the invention, in the video networking video conference, the video network audio and video stream can be effectively controlled to be output to the multi-picture screen corresponding to the browser for display according to the meeting opening instruction, so that the problems that the number of conference devices is limited when the multi-picture screen of the existing browser is displayed, and the user experience of the video networking video conference is poor are solved.
Referring to fig. 2, another flow chart of a method for transmitting audio/video streams according to an embodiment of the present invention is shown, where the difference between the embodiment and the above embodiment is that a stop instruction or a conference end instruction is received; and unbundling the incoming multi-path audio and video stream from the corresponding screen channel. The method specifically comprises the following steps:
step 201: receiving a conference opening instruction of a video network video conference sent by a webpage management server;
step 202: binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the meeting opening instruction;
step 203: transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component for display;
the steps 201 to 203 are the same as the steps 101 to 103, and are described in detail above, and are not described herein again.
Step 204: receiving a stopping instruction or a conference ending instruction of the video conference of the video network sent by a webpage management server;
in this step, if the user wants to stop or end the video conference, the user may send a stop instruction or a conference and end instruction through the web management server, that is, the scheduling server receives the stop instruction or the conference end instruction of the video conference sent by the web management server.
Wherein, the stop instruction or the conference end instruction may include: the ID number of the specified device, the screen channel ID number, and the screen ID number displayed in the split screen may also be adaptively included, and this embodiment is not limited.
Step 205: and unbinding the screen channel corresponding to the multi-path audio and video stream according to the stop instruction or the conference end instruction.
When receiving the stop instruction or the conference end instruction, the scheduling server unbundles the audio and video stream from the corresponding screen channel, that is, the multi-path audio and video stream cannot be displayed on the multi-screen of the browser, but the designated device outputting the multi-path audio and video stream still exists in the video conference without exiting the video conference. And if the multi-path audio and video stream of the specified equipment needs to be displayed on the browser before the video conference is finished, the multi-path audio and video stream can be bound to the corresponding screen channel, and the multi-path audio and video stream is transmitted to the corresponding browser multi-picture screen through the COM component for display.
Optionally, in yet another embodiment, on the basis of the above embodiment, the method may further include: if the meeting fails or the multiple paths of audio and video streams are wrong, the scheduling server feeds the meeting failure or the multiple paths of audio and video streams are wrong back to the page management server, and the page management server prompts information such as the meeting failure or the multiple paths of audio and video streams are wrong on a page.
In the embodiment of the invention, when a stop instruction or a conference end instruction of the video network video conference is received, the screen channel corresponding to the multi-path audio and video stream is unbound according to the stop instruction or the conference end instruction. The method effectively controls the input and output of the video stream of the video networking conference, solves the problems that the number of devices participating in the conference is limited when the existing multi-picture screen displays, and improves the poor user experience of the video networking conference.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 3, a schematic structural diagram of a transmission device for audio and video streams according to an embodiment of the present invention may specifically include the following modules: a first receiving module 31, a binding module 32 and a transmitting module 33, wherein,
the first receiving module 31 is configured to receive a conference opening instruction of a video conference on the internet sent by the web page management server;
the binding module 32 is used for binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the conference opening instruction;
and the transmission module 33 is configured to transmit the multiple audio and video streams to the corresponding browser multi-screen through the COM component, so that the browser multi-screen displays the multiple audio and video streams.
Optionally, in another embodiment, on the basis of the foregoing embodiment, if the conference opening instruction received by the first receiving module 31 does not include: a screen channel ID number corresponding to the audio and video stream of the equipment is specified;
the binding module 32 is specifically configured to sequentially bind the incoming multiple paths of audio and video streams to the first screen channel to the nth screen channel according to the conference opening instruction through a default rule, where N is a natural number greater than 1.
Optionally, in another embodiment, on the basis of the foregoing embodiment, if the conference opening instruction received by the first receiving module 31 includes: and if the screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the specified device is specified, the binding module comprises:
the binding module 32 is specifically configured to bind, according to the conference opening instruction, the multiple paths of audio and video streams transmitted by the designated device to the screen channels respectively corresponding to the ID numbers of the designated screen channels.
Optionally, in another embodiment, on the basis of the embodiment in fig. 3, the apparatus may further include: the second receiving module 41 and the unbinding module 42 are schematically shown in fig. 4, wherein,
a second receiving module 41, configured to receive a stop instruction or a conference end instruction of the video conference over internet sent by the web page management server;
and the unbinding module 42 is configured to unbind the screen channel corresponding to the multiple paths of audio and video streams according to the stop instruction or the conference end instruction.
Optionally, in yet another embodiment, on the basis of the above embodiment, the apparatus may further include: and the sending unit (not shown) is used for feeding back the session failure or the multi-path audio/video stream error to the page management server when the session failure or the multi-path audio/video stream error occurs, so that the page management server can prompt the user of the session failure or the multi-path audio/video stream error on the page.
Optionally, the apparatus may be based on a scheduling server, or may be deployed independently, and this embodiment is not limited to this.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
Referring to fig. 5, a schematic structural diagram of a display system of audio and video streams provided in an embodiment of the present invention is shown, where the system includes: a web page management server 51, a scheduling server 52, and a browser 53, wherein,
the webpage management server 51 is used for receiving a conference opening instruction of a video conference on the internet sent by a user through a webpage service interface and forwarding the conference opening instruction to the scheduling server;
in the embodiment, a user can create a conference reservation and real-time scheduling through the webpage management server, and a conference starting execution receives a conference opening message from the video network and the internet.
The scheduling server 52 is configured to receive a conference opening instruction of the video conference over the internet sent by the web page management server, bind the incoming multiple paths of audio and video streams to corresponding screen channels according to the conference opening instruction, and transmit the multiple paths of audio and video streams to corresponding multi-picture screens of the browser through the COM component;
and the browser multi-picture screen 53 is used for displaying the multi-path audio and video stream transmitted by the scheduling server.
Of course, in this embodiment, the browser may also display the multiple audio and video streams sent by the dispatch server through its own multi-screen.
Alternatively, in another embodiment, which is based on the above-described embodiment,
the dispatch server is further configured to, when the conference opening instruction does not include: when a screen channel ID number corresponding to the audio and video stream of the equipment is specified, sequentially binding the incoming multi-channel audio and video stream to a first screen channel to an Nth screen channel according to the conference opening instruction through a default rule, wherein N is a natural number greater than 1; or
And the scheduling server is further used for binding the multi-path audio and video stream transmitted by the appointed equipment to the screen channels respectively corresponding to the appointed screen channel ID numbers according to the conference opening instruction when the conference opening instruction comprises the screen channel ID numbers corresponding to each path of audio and video in the multi-path audio and video stream of the appointed equipment.
Alternatively, in another embodiment, which is based on the above-described embodiment,
the webpage management server is further used for receiving a video network video conference stopping instruction or a conference ending instruction sent by the user through a page service interface, and forwarding the stopping instruction or the conference ending instruction to the scheduling server;
and the scheduling server is also used for unbinding the incoming multi-path audio and video stream from the corresponding screen channel according to the stop instruction or the conference end instruction.
For the system embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
In the embodiment of the invention, in the video networking video conference, the scheduling server can effectively control the audio and video streams to be output to the multi-picture screen corresponding to the browser for display according to the meeting opening instruction, and when receiving the stopping instruction or the conference ending instruction of the video networking video conference, the scheduling server unbundles the screen channels corresponding to the multiple paths of audio and video streams according to the stopping instruction or the conference ending instruction. The input and the output of the video and audio stream of the video network are effectively controlled, the problem that the number of conference participating devices is limited when the existing multi-picture screen is displayed is solved, and the problem of poor user experience of the video and audio conference of the video network is improved.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method and the device for transmitting the audio and video stream and the display system of the audio and video stream provided by the invention are introduced in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (6)
1. A method for transmitting audio/video streams, comprising:
receiving a conference opening instruction of a video network video conference sent by a webpage management server;
binding the incoming multi-channel audio and video streams to corresponding screen channels according to the meeting opening instruction, wherein one channel of audio and video streams is bound with one screen channel;
transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component for display;
if the conference opening instruction does not comprise a screen channel ID number corresponding to the audio and video stream of the designated equipment, sequentially binding the incoming multi-channel audio and video stream to a first screen channel to an Nth screen channel according to the conference opening instruction, wherein N is a natural number greater than 1;
and if the conference opening instruction comprises a screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the designated equipment, the conference opening instruction binds the multi-channel audio and video stream transmitted by the designated equipment to the screen channels respectively corresponding to the screen channel ID numbers of the designated equipment.
2. The method of any of claim 1, further comprising:
receiving a stopping instruction or a conference ending instruction of the video conference of the video network sent by a webpage management server;
and unbinding the screen channel corresponding to the multi-path audio and video stream according to the stop instruction or the conference end instruction.
3. An apparatus for transmitting audio/video stream, comprising:
the first receiving module is used for receiving a conference opening instruction of the video network video conference sent by the webpage management server;
the binding module is used for binding the incoming multi-channel audio and video stream to the corresponding screen channel according to the conference opening instruction, wherein one channel of audio and video stream is bound with one screen channel;
the transmission module is used for transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM component so as to facilitate the browser multi-picture screen to display the multi-path audio and video stream;
wherein the conference opening instruction received by the first receiving module does not include: a screen channel ID number corresponding to the audio and video stream of the equipment is specified;
the binding module is specifically used for sequentially binding the incoming multi-channel audio and video streams to a first screen channel to an Nth screen channel according to the conference opening instruction through a default rule, wherein N is a natural number greater than 1;
the conference opening instruction received by the first receiving module includes: appointing a screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the equipment;
and the binding module is specifically used for binding the multi-channel audio and video streams transmitted by the specified equipment to the screen channels respectively corresponding to the ID numbers of the specified screen channels according to the conference opening instruction.
4. The apparatus of any of claim 3, further comprising:
the second receiving module is used for receiving a stopping instruction or a conference ending instruction of the video conference of the video network sent by the webpage management server;
and the unbinding module is used for unbinding the screen channel corresponding to the multi-path audio and video stream according to the stopping instruction or the conference ending instruction.
5. A display system for audio and video streams, comprising:
the webpage management server is used for receiving a conference opening instruction of the video network video conference sent by a user through a webpage service interface and forwarding the conference opening instruction to the scheduling server;
the scheduling server is used for receiving a conference opening instruction of a video network video conference sent by the webpage management server, binding the incoming multi-path audio and video stream to a corresponding screen channel according to the conference opening instruction, and transmitting the multi-path audio and video stream to a corresponding browser multi-picture screen through a COM (component object model) component, wherein one path of audio and video stream is bound with one screen channel;
the browser multi-picture screen is used for displaying the multi-path audio and video stream transmitted by the scheduling server;
wherein the scheduling server is specifically configured to:
if the conference opening instruction does not comprise a screen channel ID number corresponding to the audio and video stream of the designated equipment, sequentially binding the incoming multiple paths of audio and video streams to a first screen channel to an Nth screen channel according to the conference opening instruction, wherein N is a natural number greater than 1;
and if the conference opening instruction comprises a screen channel ID number corresponding to each channel of audio and video in the multi-channel audio and video stream of the designated equipment, the conference opening instruction binds the multi-channel audio and video stream transmitted by the designated equipment to the screen channels respectively corresponding to the screen channel ID numbers of the designated equipment.
6. The system of claim 5,
the webpage management server is further used for receiving a video network video conference stopping instruction or a conference ending instruction sent by the user through a page service interface, and forwarding the stopping instruction or the conference ending instruction to the scheduling server;
and the scheduling server is also used for unbinding the incoming multi-path audio and video stream from the corresponding screen channel according to the stop instruction or the conference end instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711321361.6A CN108965781B (en) | 2017-12-12 | 2017-12-12 | Audio and video stream transmission method and device and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711321361.6A CN108965781B (en) | 2017-12-12 | 2017-12-12 | Audio and video stream transmission method and device and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108965781A CN108965781A (en) | 2018-12-07 |
| CN108965781B true CN108965781B (en) | 2021-08-06 |
Family
ID=64495360
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711321361.6A Active CN108965781B (en) | 2017-12-12 | 2017-12-12 | Audio and video stream transmission method and device and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965781B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109768964B (en) * | 2018-12-13 | 2022-03-29 | 视联动力信息技术股份有限公司 | Audio and video display method and device |
| CN110784452B (en) * | 2019-09-26 | 2022-07-12 | 视联动力信息技术股份有限公司 | Video data pushing method and device |
| CN110719435B (en) * | 2019-10-12 | 2021-11-16 | 视联动力信息技术股份有限公司 | Method and system for carrying out terminal conference |
| CN111131757B (en) * | 2019-12-27 | 2022-12-23 | 视联动力信息技术股份有限公司 | Video conference display method, device and storage medium |
| CN112672205A (en) * | 2020-11-25 | 2021-04-16 | 紫光云技术有限公司 | Multi-channel video stream loading method for mobile terminal |
| CN113194277B (en) * | 2021-03-12 | 2023-02-28 | 广州朗国电子科技股份有限公司 | Method, device and storage medium for multi-screen video of conference terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104168443A (en) * | 2013-05-16 | 2014-11-26 | 杭州海康威视数字技术股份有限公司 | Method for carrying out video recording on video monitor and network video recorder |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
| CN106534891A (en) * | 2016-12-06 | 2017-03-22 | 讯美科技股份有限公司 | Multichannel coding remote transmission display method and system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5211430B2 (en) * | 2006-03-02 | 2013-06-12 | 富士ゼロックス株式会社 | Electronic conference system, electronic conference support program, electronic conference support method, electronic conference control device, conference server computer |
| CN101198008A (en) * | 2008-01-03 | 2008-06-11 | 中兴通讯股份有限公司 | Method and system for implementing multi-screen and multi-picture |
| WO2012149796A1 (en) * | 2011-10-08 | 2012-11-08 | 华为技术有限公司 | Method and device for managing video resources in video conference |
| CN104754305A (en) * | 2015-03-26 | 2015-07-01 | 北京德普视讯科技有限公司 | Tiled display control system based on cloud computing technology, image display method adopting system and application of system |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN105245820B (en) * | 2015-10-12 | 2019-04-02 | 苏州科达科技股份有限公司 | A kind of multiple video strems switching display methods, device and Videoconference Management System |
-
2017
- 2017-12-12 CN CN201711321361.6A patent/CN108965781B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104168443A (en) * | 2013-05-16 | 2014-11-26 | 杭州海康威视数字技术股份有限公司 | Method for carrying out video recording on video monitor and network video recorder |
| CN104661085A (en) * | 2013-11-22 | 2015-05-27 | 中兴通讯股份有限公司 | Multi-way wireless display method and device |
| CN106534891A (en) * | 2016-12-06 | 2017-03-22 | 讯美科技股份有限公司 | Multichannel coding remote transmission display method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108965781A (en) | 2018-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108965781B (en) | Audio and video stream transmission method and device and display system | |
| US9787945B2 (en) | System and method for interactive video conferencing | |
| US9148627B2 (en) | System and method for interactive internet video conferencing | |
| CN106789914B (en) | Multimedia conference control method and system | |
| US8909704B2 (en) | Network-attached display device as an attendee in an online collaborative computing session | |
| US20170366784A1 (en) | Displaying Concurrently Presented Versions in Web Conferences | |
| US20120017149A1 (en) | Video whisper sessions during online collaborative computing sessions | |
| US20110320961A1 (en) | Method and apparatus for sharing virtual workspaces | |
| WO2014036642A1 (en) | System and method for broadcasting interactive content | |
| CN105763832A (en) | Video interaction and control method and device | |
| AU2015279941B2 (en) | Methods, systems, and media for recommending collaborators of media content based on authenticated media content input | |
| EP2933982B1 (en) | Media stream transfer method and user equipment | |
| US20160344780A1 (en) | Method and system for controlling communications for video/audio-conferencing | |
| DE202011110535U1 (en) | An image display device for providing a remote control service | |
| CN112616066B (en) | Group discussion system and method based on live broadcast | |
| CN105763831A (en) | Method of realizing video conference, apparatus and system thereof | |
| WO2015144024A1 (en) | Multi-screen interaction method and device | |
| CN107959817A (en) | A kind of caption presentation method and device | |
| EP3342158A1 (en) | System and method for interactive video conferencing | |
| US20160316252A1 (en) | System, method and apparatus for enhanced internet broadcasting | |
| CN105681162A (en) | Method, device and system for synchronizing information | |
| US8332903B2 (en) | System, apparatus and method of providing personal broadcasting service according to scheduling | |
| CN111212043A (en) | Multimedia file generation method and device | |
| CN111556275A (en) | Audio and video stream scheduling method and device, commanding and scheduling terminal and storage medium | |
| CN114189649A (en) | Video conference live broadcasting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Applicant after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Address before: 100000 Beijing Dongcheng District Qinglong Hutong 1 Song Hua Building A1103-1113 Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |