CN112616089A - Live broadcast splicing and stream pushing method, system and medium for network lessons - Google Patents
Live broadcast splicing and stream pushing method, system and medium for network lessons Download PDFInfo
- Publication number
- CN112616089A CN112616089A CN202011358551.7A CN202011358551A CN112616089A CN 112616089 A CN112616089 A CN 112616089A CN 202011358551 A CN202011358551 A CN 202011358551A CN 112616089 A CN112616089 A CN 112616089A
- Authority
- CN
- China
- Prior art keywords
- video stream
- mixed
- splicing
- video
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000000926 separation method Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method, a system and a medium for splicing and pushing live broadcast of a network course, wherein the method comprises the following steps: acquiring a first video stream and a second video stream of a local live broadcast end; splicing the first video stream and the second video stream frame by frame according to a time sequence, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server; and when a viewer terminal initiates a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, receiving a mixed video stream pushed by the live broadcast server, separating the mixed video stream frame by frame according to a time sequence, and displaying the first video stream and the second video stream. According to the embodiment of the invention, the two paths of video streams of the local live broadcast end are spliced locally and then mixed stream pushing is carried out to realize double-area live broadcast, so that the problem of asynchronous delay of the double-area live broadcast is solved, and meanwhile, the extra flow cost is not increased.
Description
Technical Field
The invention relates to the technical field of computer networks, in particular to a live-broadcast splicing and stream-pushing method, a live-broadcast splicing and stream-pushing system and a live-broadcast splicing and stream-pushing medium.
Background
Currently, live broadcast in a Network course generally includes a teacher video area and a PPT courseware video area, and during the live broadcast process, live broadcast Content needs to be live broadcast to a user through a Content Delivery Network (CDN) for watching. However, for technical reasons, two video streams at CDN level are not processed additionally, so that two video streams pulled by students during watching are not synchronized.
The current solution is to combine two videos into one video by using a mixed-flow server, and then push the video to the CDN, so that the synchronization problem can be solved, but the mixed-flow operation performed on the mixed-flow server will generate extra cost overhead, and increase a large amount of live broadcast cost.
Accordingly, the prior art is yet to be improved and developed.
Disclosure of Invention
In view of the defects of the prior art, the present invention aims to provide a live-splicing streaming method, system and medium for web lesson, and aims to solve the problem that the live broadcast cost cannot be controlled while the asynchronous live broadcast of two paths of video streams is ensured in the prior art.
The technical scheme of the invention is as follows:
a live-broadcast splicing and stream-pushing method for a network course comprises the following steps:
acquiring a first video stream and a second video stream of a local live broadcast end;
splicing the first video stream and the second video stream frame by frame according to a time sequence, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server;
and when a viewer terminal initiates a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, receiving a mixed video stream pushed by the live broadcast server, separating the mixed video stream frame by frame according to a time sequence, and displaying the first video stream and the second video stream.
In the live-broadcast splicing and stream-pushing method for the web lessons, outputting a mixed video stream after splicing the first video stream and the second video stream frame by frame according to a time sequence and pushing the mixed video stream to a live broadcast server includes:
acquiring a first video frame image of the first video stream and a second video frame image of the second video stream frame by frame according to a time sequence;
and splicing the first video frame image and the second video frame image in a one-to-one correspondence manner according to preset splicing position information, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server.
In the live-broadcast splicing and stream-pushing method for the web lessons, the step of splicing the first video frame image and the second video frame image in a one-to-one correspondence manner according to preset splicing position information, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server comprises the following steps:
correspondingly splicing the first video frame image and the second video frame image according to time sequence to generate a mixed frame image;
and respectively setting the display positions of the first video frame image and the second video frame image on the mixed frame image according to the preset splicing position information, outputting the mixed video stream and pushing the mixed video stream to a live broadcast server.
In the live-broadcast splicing and stream-pushing method for the network course, the displaying of the first video stream and the second video stream after separating the mixed video stream frame by frame according to the time sequence comprises the following steps:
acquiring mixed frame images of the mixed video stream frame by frame according to a time sequence;
sequentially separating each frame of mixed frame image to obtain a first video frame image and a second video frame image which are in one-to-one correspondence;
respectively arranging the first video frame image and the second video frame image according to time sequence to obtain a first video stream and a second video stream;
and respectively setting the display positions of the first video stream and the second video stream according to the preset splicing position information.
In the live-broadcast splicing and stream-pushing method for the network course, after the first video frame image and the second video frame image are spliced one by one according to the time sequence to generate a mixed frame image, the method further comprises the following steps:
and when the mixed frame image has an information-free area, converting preset additional information into an additional picture and storing the additional picture in the information-free area.
In the live-splicing streaming method for web lessons, after the mixed video stream is separated frame by frame according to the time sequence and the first video stream and the second video stream are displayed, the method further comprises the following steps:
and acquiring an additional picture stored in an information-free area in the mixed frame image, and identifying and acquiring preset additional information in the additional picture.
In the live-splicing streaming method for web lessons, after the mixed video stream is separated frame by frame according to the time sequence and the first video stream and the second video stream are displayed, the method further comprises the following steps:
and when a top setting request is received, the first video stream or the second video stream is displayed on the topmost layer after the playing size is adaptively adjusted according to the resolution of the current display screen according to the top setting request.
In the online course live broadcast splicing and stream pushing method, the first video stream is a teacher video stream, and the second video stream is a courseware video stream.
The invention also provides a live-broadcast splicing and stream-pushing system for the network lessons, which comprises at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the live webcast splicing plug flow method described above.
Another embodiment of the present invention also provides a non-transitory computer-readable storage medium storing computer-executable instructions, which, when executed by one or more processors, cause the one or more processors to perform the live lesson splicing plug flow method described above.
Has the advantages that: compared with the prior art, the embodiment of the invention realizes double-region live broadcast by carrying out mixed stream pushing after two paths of video streams of a local live broadcast end are locally spliced, and the problem of asynchronous delay of the double-region live broadcast is solved without increasing extra flow cost.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a flowchart of a preferred embodiment of a live-live web-broadcasting splicing streaming method according to the present invention;
fig. 2 is a schematic hardware structure diagram of a preferred embodiment of a live-network splicing streaming system according to the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is described in further detail below. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a flowchart illustrating a live-broadcasting splicing and streaming method according to a preferred embodiment of the present invention. As shown in fig. 1, it includes the following steps:
s100, acquiring a first video stream and a second video stream of a local live broadcast end;
s200, splicing the first video stream and the second video stream frame by frame according to a time sequence, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server;
s300, when a viewer terminal initiates a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, receiving a mixed video stream pushed by the live broadcast server, separating the mixed video stream frame by frame according to a time sequence, and displaying the first video stream and the second video stream.
In this embodiment, when a teacher starts a live broadcast in a live broadcast session, a first video stream and a second video stream of a teacher user at a local live broadcast end are obtained first, and when the live broadcast is implemented specifically, the first video stream is a teacher video stream, the second video stream is a courseware video stream, that is, a teacher gives a lesson in one area of the local live broadcast end, and the other area is a PPT courseware picture. And in the aspect of audience terminals, when the audience terminals initiate a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, the mixed video stream pushed by the live broadcast server is received, and the mixed video stream is separated frame by frame according to the time sequence and then displayed, the first video stream and the second video stream are displayed, and the mixed flow is realized by local image splicing, so that the live broadcast flow cost is not greatly increased, and meanwhile, because the video pictures are processed frame by frame according to the time sequence during splicing and separation, the problem of delay asynchronization does not occur when students watch the two separated video streams, and the problem between the asynchronization of double-area live broadcast and the live broadcast cost is well balanced.
Further, the outputting a mixed video stream after splicing the first video stream and the second video stream frame by frame according to a time sequence and pushing the mixed video stream to a live broadcast server includes:
acquiring a first video frame image of the first video stream and a second video frame image of the second video stream frame by frame according to a time sequence;
and splicing the first video frame image and the second video frame image in a one-to-one correspondence manner according to preset splicing position information, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server.
In this embodiment, when local splicing is performed, frame images of two paths of video streams are obtained frame by frame according to a time sequence, a first video frame image and a second video frame image which are obtained are spliced in a one-to-one correspondence manner according to preset splicing position information, and then a mixed video stream is output, that is, a path of mixed video stream can be obtained after each frame image in two paths of videos is correspondingly spliced, and the mixed video stream is pushed to a live broadcast server for live broadcast, so that an accurate, delay-free and low-cost live broadcast mixed flow scheme is realized.
Further, the outputting of the mixed video stream and the pushing to the live broadcast server after the one-to-one corresponding splicing of the first video frame image and the second video frame image is performed according to the preset splicing position information includes:
correspondingly splicing the first video frame image and the second video frame image according to time sequence to generate a mixed frame image;
and respectively setting the display positions of the first video frame image and the second video frame image on the mixed frame image according to the preset splicing position information, outputting the mixed video stream and pushing the mixed video stream to a live broadcast server.
In the embodiment, during specific splicing, each frame of image in two paths of videos is first subjected to one-to-one correspondence according to time sequence, that is, a first video frame image and a second video frame image with the same time sequence are spliced one-to-one to generate a mixed frame image, and then the positions of the first video frame image and the second frame image are adjusted according to splicing position requirements, that is, preset splicing position information is preset, wherein the preset splicing position information comprises time sequence information and position information, that is, the display positions of the first video frame image and the second video frame image on each mixed frame image can be specifically set through the preset splicing position information, so that flexible adjustment of the display positions of the first video frame image and the second video frame image after splicing is realized, diversified live broadcast requirements are met, and the application scenes and the range of the live broadcast splicing stream pushing method provided by the invention are enriched.
Further, the displaying the first video stream and the second video stream after separating the mixed video stream frame by frame according to time sequence includes:
acquiring mixed frame images of the mixed video stream frame by frame according to a time sequence;
sequentially separating each frame of mixed frame image to obtain a first video frame image and a second video frame image which are in one-to-one correspondence;
respectively arranging the first video frame image and the second video frame image according to time sequence to obtain a first video stream and a second video stream;
and respectively setting the display positions of the first video stream and the second video stream according to the preset splicing position information.
In this embodiment, after receiving the mixed video stream from the live broadcast server, the audience terminal needs to perform separate playing, and first obtains the mixed frame images of the mixed video stream frame by frame according to the time sequence, each mixed frame image includes two paths of image information under the current time sequence, therefore, after each frame of mixed frame image is sequentially reversely separated, a first video frame image and a second video frame image which are in one-to-one correspondence can be obtained, and when needing to be explained, the invention can be carried out by a preset rule when carrying out image splicing and image separation, for example, the first video frame image and the second video frame image are preset with corresponding data identifications and stored in the spliced data header, the data position of the first video frame image and the second video frame image can be analyzed according to the header in the received mixed frame image data during image separation, and then acquiring data corresponding to the first video frame image and the second video frame image to realize image separation. The method comprises the steps of arranging all separated first video frame images and second video frame images according to a time sequence to obtain a first video stream and a second video stream, and further setting display positions of the first video stream and the second video stream respectively according to preset splicing position information to restore and obtain two paths of videos and positions of the videos in a local live broadcast end, so that when students start double-area live broadcast to watch teachers in class, the comprehensive synchronization of live broadcast contents and positions can be realized, and the students can better follow teaching progress to improve teaching effects.
Further, after the first video frame image and the second video frame image are spliced in a one-to-one correspondence manner according to a time sequence to generate a mixed frame image, the method further includes:
and when the mixed frame image has an information-free area, converting preset additional information into an additional picture and storing the additional picture in the information-free area.
After the first video stream and the second video stream are displayed after the mixed video stream is separated frame by frame according to time sequence, the method further comprises the following steps:
and acquiring an additional picture stored in an information-free area in the mixed frame image, and identifying and acquiring preset additional information in the additional picture.
In this embodiment, since there may be a mismatch in size in many cases between the first video frame image and the second video frame image in an actual live broadcast, when the sizes of the two are not matched, an information-free region is inevitably generated during image splicing, for example, when the size of the first video frame image is a × b and the size of the second video frame image is a × c, where c < b, if the two frame images are transversely spliced, an information-free region with size a (b-c) appears, the unit of the above size is a pixel, and this portion of region has no actual information but still occupies a storage space, which causes a waste of bandwidth during transmission, and therefore, when there is an information-free region in the mixed frame image, preset additional information such as voice, chat text, commands, and the like is converted into an additional picture and then stored in the information-free region for transmission, specifically, during splicing, preset header information can be added at the beginning of the no-information area to serve as a mark for starting the area, preset additional information is stored in the area in an image format for transmission so as to improve the resource utilization rate, and at a receiving end, if the no-information area exists in the current mixed frame image, the additional image stored in the no-information area is acquired, the preset additional information in the additional image is acquired in an identification manner, for example, the preset additional information is acquired in a character identification manner, and bandwidth resources can be utilized to the maximum extent while splicing push streams are not affected.
Further, after the displaying the first video stream and the second video stream after separating the mixed video stream frame by frame in time sequence, the method further includes:
and when a top setting request is received, the first video stream or the second video stream is displayed on the topmost layer after the playing size is adaptively adjusted according to the resolution of the current display screen according to the top setting request.
In this embodiment, after the mixed video stream is separated frame by frame according to a time sequence, the first video stream and the second video stream are played according to positions in preset splicing position information by default, so as to be synchronized with a local live broadcast end, when a student user wants to change according to own requirements, a set-top request can be input, the first video stream or the second video stream is set on the top layer in a full screen manner, for example, two set-top keys of 'only see teacher' and 'only see courseware' are arranged on a live broadcast picture, the student can select one of the two set-top keys to control the current display content, the selected video stream adaptively adjusts the play size according to the resolution of the current display screen, and then the set-top display is performed in a key type full screen manner, so that the individual requirements of different students are met, and the flexibility of web lesson teaching is improved.
It should be noted that, a certain sequence does not necessarily exist between the above steps, and those skilled in the art can understand, according to the description of the embodiments of the present invention, that in different embodiments, the above steps may have different execution sequences, that is, may also be executed in parallel, may also be executed interchangeably, and the like.
Another embodiment of the present invention provides a live-broadcasting splicing streaming system in a web-based lecture, as shown in fig. 2, the system 10 includes:
one or more processors 110 and a memory 120, where one processor 110 is illustrated in fig. 2, the processor 110 and the memory 120 may be connected by a bus or other means, and the connection by the bus is illustrated in fig. 2.
The memory 120 is used as a non-volatile computer-readable storage medium, and can be used to store a non-volatile software program, a non-volatile computer-executable program, and a module, such as a program instruction corresponding to the live telecast splicing plug flow method in the embodiment of the present invention. The processor 110 executes various functional applications and data processing of the system 10 by executing nonvolatile software programs, instructions and units stored in the memory 120, that is, implements the live webcast splicing plug flow method in the above method embodiment.
The memory 120 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the system 10, and the like. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 120 optionally includes memory located remotely from processor 110, which may be connected to system 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more units are stored in the memory 120, and when executed by the one or more processors 110, perform the live webcast splicing plug flow method in any of the above-described method embodiments, for example, performing the above-described method steps S100 to S300 in fig. 1.
Embodiments of the present invention provide a non-transitory computer-readable storage medium storing computer-executable instructions for execution by one or more processors, for example, to perform method steps S100-S300 of fig. 1 described above.
By way of example, non-volatile storage media can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Synchronous RAM (SRAM), dynamic RAM, (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The disclosed memory components or memory of the operating environment described herein are intended to comprise one or more of these and/or any other suitable types of memory.
Another embodiment of the present invention provides a computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the live webcasting streaming method of the above method embodiment. For example, the method steps S100 to S300 in fig. 1 described above are performed.
In summary, in the method, system and medium for splicing and streaming live broadcast in network lessons disclosed by the present invention, the method includes: acquiring a first video stream and a second video stream of a local live broadcast end; splicing the first video stream and the second video stream frame by frame according to a time sequence, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server; and when a viewer terminal initiates a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, receiving a mixed video stream pushed by the live broadcast server, separating the mixed video stream frame by frame according to a time sequence, and displaying the first video stream and the second video stream. According to the embodiment of the invention, the two paths of video streams of the local live broadcast end are spliced locally and then mixed stream pushing is carried out to realize double-area live broadcast, so that the problem of asynchronous delay of the double-area live broadcast is solved, and meanwhile, the extra flow cost is not increased.
The above-described embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a general hardware platform, and may also be implemented by hardware. With this in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer electronic device (which may be a personal computer, a server, or a network electronic device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Conditional language such as "can," "might," or "may" is generally intended to convey that a particular embodiment can include (yet other embodiments do not include) particular features, elements, and/or operations, among others, unless specifically stated otherwise or otherwise understood within the context as used. Thus, such conditional language is also generally intended to imply that features, elements, and/or operations are in any way required for one or more embodiments or that one or more embodiments must include logic for deciding, with or without input or prompting, whether such features, elements, and/or operations are included or are to be performed in any particular embodiment.
What has been described herein in this specification and the accompanying drawings includes examples that can provide a live-splicing plug-streaming method, system, and medium. It will, of course, not be possible to describe every conceivable combination of components and/or methodologies for purposes of describing the various features of the disclosure, but it can be appreciated that many further combinations and permutations of the disclosed features are possible. It is therefore evident that various modifications can be made to the disclosure without departing from the scope or spirit thereof. In addition, or in the alternative, other embodiments of the disclosure may be apparent from consideration of the specification and drawings and from practice of the disclosure as presented herein. It is intended that the examples set forth in this specification and the drawings be considered in all respects as illustrative and not restrictive. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Claims (10)
1. A live broadcast splicing and stream pushing method for a network course is characterized by comprising the following steps:
acquiring a first video stream and a second video stream of a local live broadcast end;
splicing the first video stream and the second video stream frame by frame according to a time sequence, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server;
and when a viewer terminal initiates a live broadcast access request to a live broadcast room corresponding to the local live broadcast terminal, receiving a mixed video stream pushed by the live broadcast server, separating the mixed video stream frame by frame according to a time sequence, and displaying the first video stream and the second video stream.
2. The live online lesson splicing and streaming method according to claim 1, wherein the step of splicing the first video stream and the second video stream frame by frame in time sequence, outputting a mixed video stream, and pushing the mixed video stream to a live broadcast server comprises the steps of:
acquiring a first video frame image of the first video stream and a second video frame image of the second video stream frame by frame according to a time sequence;
and splicing the first video frame image and the second video frame image in a one-to-one correspondence manner according to preset splicing position information, outputting a mixed video stream and pushing the mixed video stream to a live broadcast server.
3. The live online lesson splicing and stream pushing method according to claim 2, wherein the step of splicing the first video frame image and the second video frame image in a one-to-one correspondence manner according to preset splicing position information, outputting a mixed video stream and pushing the mixed video stream to a live server comprises the steps of:
correspondingly splicing the first video frame image and the second video frame image according to time sequence to generate a mixed frame image;
and respectively setting the display positions of the first video frame image and the second video frame image on the mixed frame image according to the preset splicing position information, outputting the mixed video stream and pushing the mixed video stream to a live broadcast server.
4. The live online lesson splicing and stream pushing method according to claim 3, wherein the displaying the first video stream and the second video stream after separating the mixed video stream frame by frame in time sequence comprises:
acquiring mixed frame images of the mixed video stream frame by frame according to a time sequence;
sequentially separating each frame of mixed frame image to obtain a first video frame image and a second video frame image which are in one-to-one correspondence;
respectively arranging the first video frame image and the second video frame image according to time sequence to obtain a first video stream and a second video stream;
and respectively setting the display positions of the first video stream and the second video stream according to the preset splicing position information.
5. The live online lesson splicing and streaming method according to claim 4, wherein after the first video frame image and the second video frame image are spliced in a one-to-one correspondence in time sequence to generate the mixed frame image, the method further comprises:
and when the mixed frame image has an information-free area, converting preset additional information into an additional picture and storing the additional picture in the information-free area.
6. The live online lesson splicing and stream pushing method according to claim 5, wherein after the displaying the first video stream and the second video stream after separating the mixed video stream frame by frame in time sequence, the method further comprises:
and acquiring an additional picture stored in an information-free area in the mixed frame image, and identifying and acquiring preset additional information in the additional picture.
7. The live online lesson splicing and stream pushing method as claimed in claim 1, wherein after the step of separating the mixed video stream frame by frame in time sequence and then displaying the first video stream and the second video stream, the method further comprises:
and when a top setting request is received, the first video stream or the second video stream is displayed on the topmost layer after the playing size is adaptively adjusted according to the resolution of the current display screen according to the top setting request.
8. The live online-lesson splicing and plug-flow method according to any one of claims 1 to 7, wherein the first video stream is a teacher video stream, and the second video stream is a courseware video stream.
9. A network course live broadcast splicing stream pushing system is characterized by comprising at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the live video splicing streaming method of any one of claims 1-8.
10. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the live webcast splicing plug flow method of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011358551.7A CN112616089A (en) | 2020-11-27 | 2020-11-27 | Live broadcast splicing and stream pushing method, system and medium for network lessons |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011358551.7A CN112616089A (en) | 2020-11-27 | 2020-11-27 | Live broadcast splicing and stream pushing method, system and medium for network lessons |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112616089A true CN112616089A (en) | 2021-04-06 |
Family
ID=75227968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011358551.7A Pending CN112616089A (en) | 2020-11-27 | 2020-11-27 | Live broadcast splicing and stream pushing method, system and medium for network lessons |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112616089A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891103A (en) * | 2021-08-24 | 2022-01-04 | 广州方硅信息技术有限公司 | Live broadcast display method and device, storage medium and computer equipment |
| CN113905188A (en) * | 2021-09-24 | 2022-01-07 | 安徽尚趣玩网络科技有限公司 | Video stitching dynamic adjustment method and system, electronic device and storage medium |
| CN115209222A (en) * | 2022-06-15 | 2022-10-18 | 深圳市锐明技术股份有限公司 | Video playing method and device, electronic equipment and readable storage medium |
| CN115334353A (en) * | 2022-08-11 | 2022-11-11 | 北京达佳互联信息技术有限公司 | Information display method and device, electronic equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102340681A (en) * | 2010-07-26 | 2012-02-01 | 深圳市锐取软件技术有限公司 | 3D (three-dimensional) stereo video single-file double-video stream recording method |
| CN104243849A (en) * | 2014-09-02 | 2014-12-24 | 苏州阔地网络科技有限公司 | Online classroom directed broadcasting control method and system |
| CN107239503A (en) * | 2017-05-10 | 2017-10-10 | 北京潘达互娱科技有限公司 | Video display method and device |
| CN107333164A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
| CN107331222A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
| CN108833823A (en) * | 2018-06-06 | 2018-11-16 | 威创集团股份有限公司 | Implementation method, device, computer equipment and the storage medium of video conference |
| CN108848390A (en) * | 2018-05-28 | 2018-11-20 | 北京文香信息技术有限公司 | A kind of multithread live streaming copic viewing system |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111464830A (en) * | 2020-05-19 | 2020-07-28 | 广州酷狗计算机科技有限公司 | Method, device, system, equipment and storage medium for image display |
-
2020
- 2020-11-27 CN CN202011358551.7A patent/CN112616089A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102340681A (en) * | 2010-07-26 | 2012-02-01 | 深圳市锐取软件技术有限公司 | 3D (three-dimensional) stereo video single-file double-video stream recording method |
| CN104243849A (en) * | 2014-09-02 | 2014-12-24 | 苏州阔地网络科技有限公司 | Online classroom directed broadcasting control method and system |
| CN107333164A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
| CN107331222A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
| CN107239503A (en) * | 2017-05-10 | 2017-10-10 | 北京潘达互娱科技有限公司 | Video display method and device |
| CN108848390A (en) * | 2018-05-28 | 2018-11-20 | 北京文香信息技术有限公司 | A kind of multithread live streaming copic viewing system |
| CN108833823A (en) * | 2018-06-06 | 2018-11-16 | 威创集团股份有限公司 | Implementation method, device, computer equipment and the storage medium of video conference |
| CN110798697A (en) * | 2019-11-22 | 2020-02-14 | 广州华多网络科技有限公司 | Video display method, device and system and electronic equipment |
| CN111464830A (en) * | 2020-05-19 | 2020-07-28 | 广州酷狗计算机科技有限公司 | Method, device, system, equipment and storage medium for image display |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891103A (en) * | 2021-08-24 | 2022-01-04 | 广州方硅信息技术有限公司 | Live broadcast display method and device, storage medium and computer equipment |
| CN113905188A (en) * | 2021-09-24 | 2022-01-07 | 安徽尚趣玩网络科技有限公司 | Video stitching dynamic adjustment method and system, electronic device and storage medium |
| CN115209222A (en) * | 2022-06-15 | 2022-10-18 | 深圳市锐明技术股份有限公司 | Video playing method and device, electronic equipment and readable storage medium |
| CN115209222B (en) * | 2022-06-15 | 2024-02-09 | 深圳市锐明技术股份有限公司 | Video playing method and device, electronic equipment and readable storage medium |
| CN115334353A (en) * | 2022-08-11 | 2022-11-11 | 北京达佳互联信息技术有限公司 | Information display method and device, electronic equipment and storage medium |
| CN115334353B (en) * | 2022-08-11 | 2024-03-12 | 北京达佳互联信息技术有限公司 | Information display method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112616089A (en) | Live broadcast splicing and stream pushing method, system and medium for network lessons | |
| US20210314657A1 (en) | Receiving device, transmitting device, and data processing method | |
| CN111163360B (en) | Video processing method, video processing device, computer-readable storage medium and computer equipment | |
| WO2015062205A1 (en) | Teaching method and system | |
| US11949937B2 (en) | Method and device to create interactivity between a main device and at least one secondary device | |
| CN105898501A (en) | Video display method, video player and electronic device | |
| CN113038220A (en) | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium | |
| KR101535809B1 (en) | Method for providing Cloud Streaming Service, system and apparatus therefor | |
| KR20150092928A (en) | Method for displaying video considered latency, apparatus and cloud streaming service system therefor | |
| CN106331763B (en) | Method for seamlessly playing fragmented media file and device for implementing method | |
| JP7253477B2 (en) | Methods for synchronizing and generating streams, and corresponding computer programs, storage media, and rendering, execution, and generation devices | |
| US10567837B2 (en) | System for providing cloud-based user interfaces and method thereof | |
| CN113259753B (en) | Teaching method, device and system of integrated machine equipment based on broadcast television network | |
| KR20200050774A (en) | HTML5-based web-responsive content interactive social learning system | |
| CN107852523B (en) | Method, terminal and equipment for synchronizing media rendering between terminals | |
| US11102540B2 (en) | Method, device and system for synchronously playing message stream and audio-video stream | |
| US20220109915A1 (en) | Pseudo seamless switching method, device and media for web playing different video sources | |
| US10491948B2 (en) | Service acquisition for special video streams | |
| KR20120009981A (en) | Method of presentation virtualization of set-top-box, and its system | |
| CN111766998A (en) | Data interaction method and device, electronic equipment and computer readable storage medium | |
| CN114374860B (en) | Video service processing method and device | |
| Shams et al. | Towards sustainable learning materials for MOOC in poor network environments | |
| WO2014169634A1 (en) | Media playing processing method, apparatus and system, and media server | |
| JP7288251B2 (en) | APPLICATION ENGINE, INFORMATION COMMUNICATIONS TERMINAL DEVICE INSTALLING THE SAME, CAPTION DISPLAY CONTROL METHOD, AND COMPUTER PROGRAM FOR PERFORMING THIS METHOD | |
| CN113573100B (en) | Advertisement display method, equipment and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210406 |