CN101883270A - Method for inserting related media in independent video streams - Google Patents

Method for inserting related media in independent video streams Download PDF

Info

Publication number
CN101883270A
CN101883270A CN 201010197497 CN201010197497A CN101883270A CN 101883270 A CN101883270 A CN 101883270A CN 201010197497 CN201010197497 CN 201010197497 CN 201010197497 A CN201010197497 A CN 201010197497A CN 101883270 A CN101883270 A CN 101883270A
Authority
CN
China
Prior art keywords
video
video streams
video flowing
special frames
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010197497
Other languages
Chinese (zh)
Inventor
高军
刘广钟
杨国东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Maritime University
Original Assignee
Shanghai Maritime University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Maritime University filed Critical Shanghai Maritime University
Priority to CN 201010197497 priority Critical patent/CN101883270A/en
Publication of CN101883270A publication Critical patent/CN101883270A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a method for inserting related media in independent video streams, which comprises the following steps of: acquiring primary video streams and secondary video streams coordinated with the primary video streams, and specifying time stamps of the multimedia information inserted into the original video streams; coding the primary video streams by using a coder, and independently coding the secondary video streams by using an optional coder; in the coding process, coding the multimedia information customized by a user into special frames, performing time stamp comparison between the special frames and the common video frames, and arranging the positions of the frames again according to a certain time sequence; at a receiving end, decoding the received video streams, and particularly considering the decoding of the special frames of the user; if the special frames comprise data such as texts, displaying the texts at a proper position of the original video streams; and if the special frames comprise pictures or the secondary video streams, displaying the content in a new image. The method simulates the teaching effect in real classrooms, and provides more information and more vivid scenes for the user.

Description

A kind of method of in independent video streams, inserting related media
Technical field
The present invention relates to computer network-based video, especially handle the remote live transmission technology of multi-path video stream.
Background technology
Along with development of internet technology, remote teaching develop rapidly become people obtain education a kind of important way.The remote teaching scene of can in real time the teacher being given lessons on the spot is transferred on class in face of the person with the form of video flowing, also video stream compression can be become multimedia file to be distributed to person on class, and this is a kind of non real-time video.And present this video is given lessons and can not be kept the sort of vividness of giving lessons on the spot.In present video is given lessons, be cutaway between the teacher and the lecture notes of giving lessons mostly, and can not the content of teacher's the body movement own and the lecture notes of giving lessons be represented simultaneously to the participant, therefore also just lost certain vividness of giving lessons on the spot.Yet traditional live video stream generally is the mixed transport of one road video flowing and multichannel voice frequency, this demand that is not adapted at while transmitting multi-path video stream in long-range the giving lessons.
In order more vivo to represent the scene of giving lessons in real time, need when playing, one tunnel master's Media Stream represent the Media Stream of other several roads subordinates.The Media Stream of subordinate is the additional and note to main Media Stream, just for real-time scene increases a plurality of camera lenses, a plurality of camera lenses is encoded respectively; At the Media Stream of receiving terminal, give lively scene with a plurality of picture exhibition subordinates.The Media Stream of subordinate can be information such as the picture that compressed or literal.
Patent " a kind of simulate true classroom give lessons the long-range video creating method of giving lessons of effect ", showed a kind of give lessons manufacture method of the long-range video of giving lessons of effect of true classroom of simulating, process on class with the teacher, be decomposed into writing on the blackboard on the blackboard and teacher two processes of teaching, make blackboard video and teaching video respectively, make this two-path video synchronous fully, simulate the effect of giving lessons in true classroom.This method has certain limitation, and it can only handle two-path video stream, and can not handle more video flowing.
Patent " in procedure of buffering network living broadcast, playing method, system and the client of advertisement ", a kind of method, system and client of playing advertisement in procedure of buffering network living broadcast disclosed, but the application that the object that its is handled is not given lessons at long-distance video, but mainly consider the fluency of Internet video.
Therefore, at present the long-distance video form of giving lessons of single channel video flowing has not satisfied now the demand to the better effect of real-time scene, remains to be developed at the Real-time Video Transport Technology of multi-path video stream.
Summary of the invention
Purpose of the present invention is in order to simulate the effect of giving lessons in true classroom, satisfy current demand to the better effect of real-time scene, in video flowing, insert the multimedia messages of customization, realization to the note in the video flowing, explanation, replenish etc., when being applied in during long-distance video gives lessons, the real-time scene of giving lessons can be showed with a plurality of video pictures, more lively video is provided.Video flowing combines with the multimedia messages of customization, makes the comprehensive scene that represents the video expression of multimedia messages of customization as far as possible, makes these multimedia messagess express more details, presents video flowing with many visual format to the user.Be that the present invention can be for encoding more than one tunnel video flowing or picture stream and transmitting, at the Real-time Video Transport Technology of multi-path video stream.
Technical scheme of the present invention comprises:
A kind of method of inserting the multimedia messages of customization in original video stream may further comprise the steps:
1, gathers main video flowing, and subordinate video flowing that will be collaborative, comprise style, picture or other video flowing, and specify the timestamp in the original video stream of being inserted into of these multimedia messagess with main video flowing.
2, utilize a kind of encoder to encode to main video flowing, the optional encoder of video flowing utilization of subordinate is encoded separately.The multimedia messages of customization will be encoded into some special frames when coding, after the stamp contrast of common video frame elapsed time, rearrange the position of frame according to certain time sequence.
3, at receiving terminal, the video flowing of receiving is decoded, consider the decoding of user's special frames especially.If what this special frames comprised is caption data such as text, then as required with text display on the correct position of original video stream; If what this special frames comprised is picture or subordinate video flowing, then in a new picture, show these contents.
Beneficial effect
The method of inserting associated multimedia in video flowing provided by the invention can conveniently be inserted user's customizing multimedia information in video flowing, the display function of video is expanded, at receiving terminal by a plurality of picture exhibition scenes, perhaps details is replenished, give to receive the user with more information, more lively scene.
Description of drawings
Further specify the present invention below in conjunction with accompanying drawing and case study on implementation.
Fig. 1 cataloged procedure schematic diagram;
Fig. 2 two road decoding video stream schematic diagrames;
Fig. 3 puts in order the system coding structure chart;
Fig. 4 whole structure figure.
Embodiment
Below application implementation step of the present invention and advantage thereof will be described with the case that long-distance video is given lessons.
When video was given lessons, video flowing can have two camera lenses: the aligning person of giving lessons, aim at lecture notes for one.The person's of giving lessons action is as main video flowing, and we are called main medium; And lecture notes are inserted into as multimedia messages with the picture form and transmit in the main video flowing, and we are called subordinate stream.In the following description, be example with one tunnel subordinate stream, implementation step is described:
With the subordinate stream encryption is special frames in the main flow.In general video flowing, three class frames are arranged: I frame, P frame and B frame.We can self-defined a kind of new type frame: U frame, representative of consumer multimedia frame.Like this, subordinate stream also can be encoded as frame, can adopt existing frame coding techniques that subordinate stream is handled, but U frame and I, P and B frame it doesn't matter, each U frame all carries out intraframe coding, and is not the reference frame of other frames.In the process of coding side as shown in Figure 1.
At receiving terminal,, video flowing is decoded according to the coding method of transmitting terminal.Decoded video stream is divided into two parts and shows, a picture shows the person's of giving lessons action, and another picture shows lecture notes.Like this, the participant can watch the content of lecture notes again in the body language that can see the person of giving lessons.(referring to Fig. 4)
The decode procedure schematic diagram is as shown in Figure 2:
When multi-path video stream is encoded, can define more frame of video, as U1, U2 etc., the process of Code And Decode and two tunnel video stream class are seemingly.The benefit of doing like this is that the data that all users add are all treated as special frames, these frames carry out intraframe coding, and can use the encoding and decoding means different with main medium, and have very big flexibility like this, make the processing of multi-path video stream is not disturbed mutually.
The present invention has very strong autgmentability.The data type that special frames transmits is restriction not, and therefore, we both can utilize special frames to expand transmissible video flowing number of active lanes; Also can utilize special frames to carry out other data services, as some control commands etc.(referring to Fig. 3)
The present invention is the expansion on present encoding scheme basis, with present encoding scheme compatibility.The coding of one road video flowing is a special case of encoding scheme of the present invention.

Claims (3)

1. a method of inserting related media in independent video streams is characterized in that, may further comprise the steps:
1), gather main video flowing, and subordinate video flowing that will be collaborative with main video flowing comprises style, picture or other video flowing, and specifies the timestamp in the original video stream of being inserted into of these multimedia messagess;
2), utilize a kind of encoder to encode, the optional encoder of video flowing utilization of subordinate is encoded separately to main video flowing; The multimedia messages of customization will be encoded into some special frames when coding, after the stamp contrast of common video frame elapsed time, rearrange the position of frame according to certain time sequence;
3), at receiving terminal, the video flowing of receiving is decoded, consider the decoding of user's special frames especially; If what this special frames comprised is caption data such as text, then as required with text display on the correct position of original video stream; If what this special frames comprised is picture or subordinate video flowing, then in a new picture, show these contents.
2. method according to claim 1, it is characterized in that: in the described step 2, when multi-path video stream is encoded, can define more frame of video, the data that all users add are all treated as special frames, these frames carry out intraframe coding, can use the encoding and decoding means different with main medium, and the process of Code And Decode and two tunnel video stream class are seemingly.
3. method according to claim 1 is characterized in that: in the described step 3, the data type that described special frames transmits can be extended for transmissible video flowing number of active lanes without limits; Also can carry out other control command data business.
CN 201010197497 2010-06-10 2010-06-10 Method for inserting related media in independent video streams Pending CN101883270A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010197497 CN101883270A (en) 2010-06-10 2010-06-10 Method for inserting related media in independent video streams

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010197497 CN101883270A (en) 2010-06-10 2010-06-10 Method for inserting related media in independent video streams

Publications (1)

Publication Number Publication Date
CN101883270A true CN101883270A (en) 2010-11-10

Family

ID=43055144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010197497 Pending CN101883270A (en) 2010-06-10 2010-06-10 Method for inserting related media in independent video streams

Country Status (1)

Country Link
CN (1) CN101883270A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106327929A (en) * 2016-08-23 2017-01-11 北京汉博信息技术有限公司 Visualized data control method and system for informatization
CN106462576A (en) * 2013-12-11 2017-02-22 维亚科姆国际公司 Systems and methods for media application including interactive grid display
CN109587556A (en) * 2019-01-03 2019-04-05 腾讯科技(深圳)有限公司 Method for processing video frequency, video broadcasting method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1767601A (en) * 2005-10-21 2006-05-03 西安交通大学 Synchronous broadcast controlling method capable of supporting multi-source stream media
CN101064851A (en) * 2006-04-30 2007-10-31 神州亿品科技有限公司 Method for displaying subtitling in video
CN101374321A (en) * 2007-08-22 2009-02-25 华为技术有限公司 Processing method and system for switching evolvement network
WO2009049974A2 (en) * 2007-10-15 2009-04-23 Siemens Aktiengesellschaft Method and device for establishing a coded output video stream from at least two coded input video streams and use of the device and coded input video stream
CN101436353A (en) * 2007-11-16 2009-05-20 北京新学堂网络科技有限公司 Preparation method for remote schoolteaching video simulating true teaching room schoolteaching effect

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1767601A (en) * 2005-10-21 2006-05-03 西安交通大学 Synchronous broadcast controlling method capable of supporting multi-source stream media
CN101064851A (en) * 2006-04-30 2007-10-31 神州亿品科技有限公司 Method for displaying subtitling in video
CN101374321A (en) * 2007-08-22 2009-02-25 华为技术有限公司 Processing method and system for switching evolvement network
WO2009049974A2 (en) * 2007-10-15 2009-04-23 Siemens Aktiengesellschaft Method and device for establishing a coded output video stream from at least two coded input video streams and use of the device and coded input video stream
CN101436353A (en) * 2007-11-16 2009-05-20 北京新学堂网络科技有限公司 Preparation method for remote schoolteaching video simulating true teaching room schoolteaching effect

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106462576A (en) * 2013-12-11 2017-02-22 维亚科姆国际公司 Systems and methods for media application including interactive grid display
CN106462576B (en) * 2013-12-11 2020-11-06 维亚科姆国际公司 System and method for media applications including interactive grid displays
CN106327929A (en) * 2016-08-23 2017-01-11 北京汉博信息技术有限公司 Visualized data control method and system for informatization
CN109587556A (en) * 2019-01-03 2019-04-05 腾讯科技(深圳)有限公司 Method for processing video frequency, video broadcasting method, device, equipment and storage medium
CN109587556B (en) * 2019-01-03 2021-10-15 腾讯科技(深圳)有限公司 Video processing method, video playing method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN106816055B (en) A kind of low-power consumption live teaching broadcast recording and broadcasting system interacted and method
CN103426336B (en) Digitized Teaching Resources in Campus system and using method
CN102752667B (en) Multi-stream media live broadcast interaction system and live broadcast interaction method
CN102129346B (en) Video interaction method and device
CN106375296A (en) Multimedia courseware teaching live broadcast method
CN104539436A (en) Lesson content real-time live broadcasting method and system
CN112468822A (en) Multimedia recording and broadcasting course interaction method based on video SEI message
CN108173873B (en) Solution for realizing screen recording and stream pushing with camera acquisition by Android
CN101883270A (en) Method for inserting related media in independent video streams
CN113141346B (en) VR one-to-multiple system and method based on series flow
Hansen et al. Norskov and the logic of place: The soft effect of local Danish TV drama production
CN102724522A (en) Method and system for realizing 4D digital film based on DCI standard
KR20010056342A (en) Effective user interfaces and data structure of a multi-media lecture, and a system structure for transferring and management of the multi-media lecture for distance education in computer networks
CN112312066A (en) Synchronous teaching technology based on multi-terminal real-time green screen synthesis and application
KR20110047389A (en) Method and system for learning contents
CN107426487A (en) A kind of panoramic picture recorded broadcast method and system
CN104506565A (en) Remote education system and equipment based on fourth generation Internet
CN209710240U (en) A kind of image generation system and digital signage system
Zhang et al. On-Site Dance Teaching Live Broadcast System Based on Internet Streaming Media Technology
Cohen et al. Virtual Presenting: A Guide to Formats, Production and Authentic Delivery
Brandão et al. The museum of all: institutional communication practices in a participatory networked world
Wei et al. Integration of Traditional Culture into Commodity Subject Teaching Material Innovation under Multimedia Information Technology
Wei et al. Enabling active engagement in e-tutelage using interactive multimedia system
Telecom Related Conferences
CN105719521A (en) Remote education system and device based on mobile internet

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20101110