CN107465952B - A kind of method and system that broadcasted content is played simultaneously with supplemental information - Google Patents
A kind of method and system that broadcasted content is played simultaneously with supplemental information Download PDFInfo
- Publication number
- CN107465952B CN107465952B CN201710817097.9A CN201710817097A CN107465952B CN 107465952 B CN107465952 B CN 107465952B CN 201710817097 A CN201710817097 A CN 201710817097A CN 107465952 B CN107465952 B CN 107465952B
- Authority
- CN
- China
- Prior art keywords
- video frame
- supplemental information
- server
- endowed
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The present invention provides a kind of method and system that broadcasted content is played simultaneously with supplemental information, the system includes content server, broadcasting server, supplemental information server, mobile terminal and processing server, the method and system being played simultaneously can play out played broadcasted content by time shift program request, overcome the defect that can not resynchronize supplemental information to played video in the prior art；And corresponding supplemental information is easily found by the comparison of label, when synchronizing broadcasting, the present invention uses endowed form, and there is no supplemental informations and corresponding video frame there are problems that offset, what is be played simultaneously is more accurate, improves the viewing experience of user.
Description
Technical field
The invention belongs to content synchronizations to play field, the in particular to side that a kind of broadcasted content and supplemental information are played simultaneously
Method and system.
Background technique
Currently, than wide, in mobile data communication service, various contents are provided for mobile data communication service range
Most of attention business diversity, marketability and skill have been attracted to the field of the wireless broadcast service of mobile terminal
The advanced aspect of art.Data broadcasting service is mainly taken by content provider (CP), broadcast service provider and mobile communication at present
Supplier be engaged in provide.
Existing data broadcasting service supplemental information relevant to broadcasted content program is transmitted by broadcasting network for example,
URL, however, additional broadcasting frequency resource must be used by transmitting supplemental information on broadcasting network, even if since viewer does not have
Ask the visitor in asks supplemental information also to transmit information, causes broadcast network transmission inefficiency, and because identical information is sent to
All users and to service limited.
In addition, there is a method in which being exactly to be deposited in this way by communication network transmission supplemental information relevant to broadcasted content
The problem of be exactly broadcasted content and supplemental information there are the deviations of play time, cause broadcasted content and its supplemental information to play
Can not synchronize；In order to solve this problem, the prior art discloses a kind of system for keeping broadcasted content synchronous with supplemental information
And method, it is that content supplier by content to be broadcast while being sent to supplemental information server and broadcasting station, passes through ratio
The synchronizing information generated compared with supplemental information server is compared with the broadcast message that broadcasting station plays, and is determined according to comparison result
Then time migration is synchronized by sync server, mainly solve the problems, such as be by the timestamp of each video frame and
Location information carries out time migration comparison, when not comparing, cannot realize selected video frame and supplemental information
It is played simultaneously, influences user's viewing experience.
Summary of the invention
In order to solve the problems in the existing technology, the present invention provides a kind of broadcasted content and is played simultaneously with supplemental information
Method and system, this method and system can transfer according to the demand of user relevant supplemental information and with each broadcasted content
It plays simultaneously, improves user's viewing experience.
Specific technical solution of the present invention is as follows:
The present invention provides a kind of method that broadcasted content is played simultaneously with supplemental information, and this method comprises the following steps:
Content server is handled from the received program of content supplier, is extracted and is formed each all videos of program
Each video frame, and it is supplied to broadcasting server and supplemental information server；
The program that broadcasting server reception content server provides adds label XYZE for each video frame, and X indicates program
Title is corresponding endowed, and Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, and E indicates that video frame is corresponding
Timestamp, then make presenting programs playback progress first time axis, the second time shaft and contracting corresponding with each video frame
Sketch map, and it is sent to mobile terminal, while being broadcasted in the form of streaming by multicast channel, by unicast channel to received
Program is cached；
The program that supplemental information server reception content server provides, and generate supplement letter corresponding with each video frame
Breath, and label XYZF is added for supplemental information, F indicates that type of supplemental information is corresponding endowed, is sent to processing server；
Mobile terminal receives first time axis, the second time shaft and the thumbnail that broadcasting server is sent, and broadcasts when playing
When the program of server broadcast, first time axis and the second time shaft are shown on broadcast interface, and according to user first
The instruction inputted on time shaft and the second time shaft judges the request issued to processing server；
The supplemental information that processing server receives the request that mobile terminal is sent and supplemental information server is sent, and to asking
It asks and is judged, it is endowed to corresponding supplemental information and be sent to mobile terminal according to judging result, while to broadcasting server
It sends corresponding video frame is endowed and multicast channel is switched into the instruction that unicast channel is broadcasted；
After broadcasting server receives instruction, finds out corresponding video frame and carry out endowed, while cutting and switching multicast channel
It is broadcasted at unicast channel；
Mobile terminal receive and playback process server send by endowed supplemental information and broadcasting server broadcasts
Program, broadcast interface only shows the second time shaft at this time.
Further to improve, first time axis is made of the corresponding timestamp of the n-th-m video frame to the (n-1)th video frame, n >
1, indicate the video frame being currently played, m >=2 are indicated from the previous of the corresponding timestamp of video frame being currently played
The number of video frame, the second time shaft are made of video frame n to the corresponding timestamp of the n-th+a video frame in the section time, a >=1,
Indicate the number of the video frame in rear a period of time since the corresponding timestamp of video frame being currently played, the second time shaft
It is equipped with cursor point, is used to indicate the video frame being currently played.
Further to improve, within a preset period of time, mobile terminal receives k instruction of user's input, and k >=1 records defeated
Enter the label of the corresponding video frame of each instruction, and the position of instruction is judged, when the corresponding video frame of instruction is located at the n-th-m
When between (n-1)th video frame, to processing server send viewing instruct corresponding video frame related supplemental information request and
The request that channel switches, the request is interior containing each label for instructing corresponding video frame, when the corresponding video frame of instruction is positioned at n-th
When video frame is between n+a video frame, request viewing is sent to processing server and instructs corresponding video frame related supplemental information
Request, the label for instructing corresponding video frame is contained in the request.
It is further to improve, when processing server receives the request of viewing supplemental information and channel switching, processing clothes
Business device proceeds as follows:
Supplemental information corresponding with the label of each video frame is searched out of supplemental information, and is the endowed A of supplemental information, A
For broadcast start time；
It is sent to broadcasting server and searches view identical with the label of each video frame from the video cached in unicast channel
Frequency frame, and be the endowed A of video frame that finds out, while being sent to broadcasting server and multicast channel being switched into unicast channel and from tax
The corresponding video frame of code A starts the instruction of broadcast.
Further to improve, processing server also proceeds as follows:
It further include to broadcast while sending the instruction broadcasted since the corresponding video frame of endowed A to broadcasting server
Connection device, which is sent, to be stopped switching to the instruction that unicast channel is broadcasted, in the instruction containing stop unicast channel broadcast when
Between, specific judgment method are as follows:
The number for judging k, as k=1, the time for stopping unicast channel broadcast is the presentation of video frames end time.
Further to improve, as k > 1, the time for stopping unicast channel broadcast is that the last one instructs corresponding video frame
It plays the end time, and further includes to wide when the corresponding video frame of each instruction for judging input is not successive video frames
It broadcasts server and sends fast-forward play instruction, contain F.F. starting and end time and F.F. times in fast-forward play instruction
Number, when F.F. starting and end time is respectively the broadcasting end time of discontinuous two video frames and plays beginning
Between.
It is further to improve, when processing server receives only request viewing related supplemental information, processing server into
The following operation of row:
The Pianli since first instruction of input has searched whether supplement letter relevant to the corresponding video frame of the instruction
Breath, if so, B is the timestamp for instructing corresponding video frame by the supplemental information endowed B.
Further to improve, when the relevant supplemental information of video frame not corresponding to the instruction, computations are corresponding
The endowed difference J of the endowed Z of sequence of frames of video sequence of frames of video corresponding with received supplemental information newest in processing server, and with
Sequence difference threshold value J1 is compared, and as J≤J1, multicast channel is switched to unicast to broadcasting server transmission and led to by processing server
Road and the instruction broadcasted since the corresponding video frame of the endowed Z1 of sequence of frames of video, Z1=Z-J, and will new received supplemental information
Endowed C, C=Z1 correspond to the timestamp of video frame.
Further to improve, as J > J1, processing server wouldn't be processed, video frame to be currently played with
When newest supplemental information corresponds to the endowed difference J2=J1 of sequence of frames of video in processing server, processing server is to broadcast service
Device sends the instruction that multicast channel is switched to unicast channel and broadcasted since the video frame being currently played, and will newly connect
The endowed D of the supplemental information of receipts, the video frame that D=is currently played correspond to corresponding video after the endowed+JI of sequence of frames of video
The timestamp of frame.
The present invention provides a kind of system that broadcasted content is played simultaneously with supplemental information, which includes:
It is all to extract each program of composition for handling from the received program of content supplier for content server
Each video frame of video, and it is supplied to broadcasting server and supplemental information server；
Broadcasting server adds label XYZE, X table for the program that reception content server provides for each video frame
Show that programm name is corresponding endowed, Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, and E indicates video
The corresponding timestamp of frame, then make the first time axis of presenting programs playback progress, the second time shaft and with each video frame pair
The thumbnail answered, and it is sent to mobile terminal, while being broadcasted in the form of streaming by multicast channel, pass through unicast channel pair
Received program is cached；
Supplemental information server for the program that reception content server provides, and generates corresponding with each video frame
Supplemental information, and label XYZF is added for supplemental information, F indicates that type of supplemental information is corresponding endowed, is sent to processing service
Device；
Mobile terminal works as broadcasting for receiving first time axis, the second time shaft and the thumbnail of broadcasting server transmission
When the program of broadcasting server broadcasts, first time axis and the second time shaft are shown on broadcast interface, and is existed according to user
The instruction inputted on first time axis and the second time shaft judges the request issued to processing server, and playback process takes again
The program by endowed supplemental information and broadcasting server broadcasts that business device is sent, when playing again, broadcast interface is only shown
Second time shaft；
Processing server, the supplemental information that request and supplemental information server for receiving mobile terminal transmission are sent,
And request is judged, it is endowed to corresponding supplemental information and be sent to mobile terminal according to judging result, while to broadcast
Server sends corresponding video frame is endowed and multicast channel is switched to the instruction that unicast channel is broadcasted.
Beneficial effects of the present invention are as follows:
The present invention provides a kind of method and system that broadcasted content is played simultaneously with supplemental information, mainly passes through content
Server handles the content to be broadcast provided from content supplier, is each after then broadcasting server receives program
The video frame of program adds label, and makes two time shafts and be sent to mobile terminal, and broadcasting server is logical equipped with multicast
Road and unicast channel, multicast channel is for being broadcast live, unicast channel user's program request time shift；After supplemental information server receives program,
A supplemental information is generated for each video frame, and adds label for supplemental information, the label of supplemental information addition adds with video frame
The label added programm name having the same is endowed, technology is endowed, sequence of frames of video is endowed；Supplemental information server is by generation
Information is sent to processing server, and broadcasting server broadcasts received program, and mobile terminal receives broadcaster broadcasts
Program, and play out, first time axis and the second time shaft shown on broadcast interface, it is same for being selected for user
The video frame of supplemental information is walked, user's axis input instruction in different times sends different requests to processing server, handles
After server receives request, request is judged, and endowed for corresponding supplemental information according to the corresponding video frame of request, and
It sends corresponding video frame is endowed to broadcasting server and multicast channel is switched into the instruction that unicast channel is broadcasted, extensively
It after broadcasting server reception instruction, switches to unicast channel and is broadcasted, mobile terminal receives endowed supplemental information and broadcast clothes
The received broadcast of business device simultaneously plays out, and successively realizes being played simultaneously for a certain video frame and supplemental information in broadcasting；The present invention
The synchronous broadcast method of offer can play out played broadcasted content by time shift program request, overcome in the prior art
The defect of supplemental information can not be resynchronized to played video；And corresponding benefit is easily found by the comparison of label
Information is filled, when synchronizing broadcasting, the present invention uses endowed form, and there is no supplemental informations and corresponding video frame to exist partially
The problem of shifting, what is be played simultaneously is more accurate, improves the viewing experience of user.
Detailed description of the invention
Fig. 1 is the flow chart for the method that a kind of broadcasted content of embodiment 1 is played simultaneously with supplemental information；
Fig. 2 is the broadcast interface structure chart of 2 mobile terminal of embodiment；
Fig. 3 is the flow chart that 2 mobile terminal of embodiment sends request；
Fig. 4 is the flow chart of 3 processing server processing method of embodiment；
Fig. 5 is the flow chart of 4 processing server processing method of embodiment；
Fig. 6 is the structure chart for the system that 5 broadcasted content of embodiment is played simultaneously with supplemental information.
Specific embodiment
Invention is further described in detail with following embodiment with reference to the accompanying drawing.
Embodiment 1
The embodiment of the present invention 1 provides a kind of method that broadcasted content is played simultaneously with supplemental information, as shown in Figure 1, the party
Method includes the following steps:
S1: content server is handled from the received program of content supplier, is extracted and is formed each all views of program
Each video frame of frequency, and it is supplied to broadcasting server and supplemental information server；
S2: the program that broadcasting server reception content server provides adds label XYZE for each video frame, and X is indicated
Programm name is corresponding endowed, and Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, and E indicates video frame
Then corresponding timestamp makes the first time axis of presenting programs playback progress, the second time shaft and corresponding with each video frame
Thumbnail, and be sent to mobile terminal, while being broadcasted in the form of streaming by multicast channel, docked by unicast channel
The program of receipts is cached；
S3: the program that supplemental information server reception content server provides, and generate benefit corresponding with each video frame
Information is filled, and adds label XYZF for supplemental information, F indicates that type of supplemental information is corresponding endowed, is sent to processing server；
Supplemental information may include the URL of video, narration information, actor information, a certain Item Information, a certain article in each video frame
Or personage's picture etc.；
S4: mobile terminal receives first time axis, the second time shaft and the thumbnail that broadcasting server is sent, wide when playing
When broadcasting the program of server broadcast, first time axis and the second time shaft are shown on broadcast interface, and according to user
The instruction inputted on one time shaft and the second time shaft judges the request issued to processing server；
S5: the supplemental information that processing server receives the request that mobile terminal is sent and supplemental information server is sent, and
Request is judged, it is endowed to corresponding supplemental information and be sent to mobile terminal according to judging result, while being taken to broadcast
Business device sends corresponding video frame is endowed and multicast channel is switched to the instruction that unicast channel is broadcasted；
S6: it after broadcasting server receives instruction, finds out corresponding video frame and carries out endowed, while cutting and cutting multicast channel
Unicast channel is changed into be broadcasted；
S7: mobile terminal receives the wide by endowed supplemental information and broadcasting server of simultaneously playback process server transmission
The program broadcast, broadcast interface only shows the second time shaft at this time.
The present invention provides a kind of method that broadcasted content is played simultaneously with supplemental information, mainly passes through content server
The content to be broadcast provided from content supplier is handled, is each program after then broadcasting server receives program
Video frame adds label, and makes two time shafts and be sent to mobile terminal, and broadcasting server is equipped with multicast channel and list
Channel is broadcast, multicast channel is for being broadcast live, unicast channel user's program request time shift；It is each after supplemental information server receives program
Video frame generates a supplemental information, and adds label, the label of supplemental information addition and the mark of video frame addition for supplemental information
Sign that programm name having the same is endowed, technology is endowed, sequence of frames of video is endowed, such as programm name is " discriminating Huan to pass " first collection
The label of 100th sequence of frames of video can be 2,152 1,110 000,100 0810, add tagged purpose and be easy for video frame
With the matching of supplemental information；The information of generation is sent to processing server by supplemental information server, and broadcasting server is to reception
Program broadcasted, mobile terminal receives the program of broadcaster broadcasts, and plays out, and the is shown on broadcast interface
One time shaft and the second time shaft, for synchronize the video frame of supplemental information for user's selection, user's axis in different times
Input instruction sends different requests to processing server and judges request, and root after processing server receives request
According to requesting corresponding video frame to be that corresponding supplemental information is endowed, and to broadcasting server send will corresponding video frame it is endowed and
Multicast channel is switched into the instruction that unicast channel is broadcasted, after broadcasting server receives instruction, switch to unicast channel into
Row broadcast, mobile terminal receive the received broadcast of endowed supplemental information and broadcasting server and play out, successively realize wide
Broadcast being played simultaneously for interior a certain video frame and supplemental information；Synchronous broadcast method provided by the invention can be to played broadcast
Content is played out by time shift program request, and lacking for supplemental information can not be resynchronized to played video in the prior art by overcoming
It falls into；And corresponding supplemental information is easily found by the comparison of label, when synchronizing broadcasting, the present invention is using tax
Code form, there is no supplemental informations and corresponding video frame there are problems that offset, and what is be played simultaneously is more accurate, improves user
Viewing experience.
Embodiment 2
The embodiment of the present invention 2 provides a kind of method that broadcasted content is played simultaneously with supplemental information, this method and embodiment 1
It is essentially identical, unlike, broadcast interface that mobile terminal is shown as shown in Fig. 2, first time axis by the n-th-m video frame to
(n-1)th video frame corresponding timestamp composition, n > 1 indicate the video frame being currently played, m >=2, indicate from currently
The number of the video frame interior for the previous period of the corresponding timestamp of the video frame of broadcasting, the second time shaft is by video frame n to n-th
The corresponding timestamp composition of+a video frame, a >=1 indicates latter since the corresponding timestamp of video frame being currently played
The number of video frame in the section time, the second time shaft are equipped with cursor point, are used to indicate the video frame being currently played；
With reference to Fig. 3, within a preset period of time, mobile terminal receives k instruction of user's input, and k >=1, record inputs each
The label of corresponding video frame is instructed, and the position of instruction is judged, when instructing corresponding video frame to be located at the n-th-m to the
When between n-1 video frame, request and the channel that viewing instructs corresponding video frame related supplemental information are sent to processing server
The request of switching, the request is interior containing each label for instructing corresponding video frame, when the corresponding video frame of instruction is located at n-th of video
When frame is between n+a video frame, request viewing is sent to processing server and instructs asking for corresponding video frame related supplemental information
It asks, the label for instructing corresponding video frame is contained in the request.By being defined to first time axis and the second time shaft, user
Selection accuracy can be improved by selecting to synchronize the video frame of supplemental information in first time axis or the second time shaft,
And it can judge the request sent to processing server according to the time shaft where the video frame of selection, be asked according to different
It asks processing server to make different processing, improves the efficiency of whole system running.
Embodiment 3
The embodiment of the present invention 3 provides a kind of method that broadcasted content is played simultaneously with supplemental information, this method and embodiment 2
It is essentially identical, unlike, when processing server receive viewing supplemental information and channel switching request when, such as Fig. 4 institute
Show, processing server proceeds as follows:
S51: supplemental information corresponding with the label of each video frame is searched out of supplemental information, and endowed for supplemental information
A, A are broadcast start time；
S52: it is identical as the label of each video frame that the lookup from the video cached in unicast channel is sent to broadcasting server
Video frame, and be the endowed A of video frame that finds out；
S53: it is sent to broadcasting server and multicast channel is switched into unicast channel and since the corresponding video frame of endowed A
The instruction of broadcast, while further including that the instruction for stopping switching to unicast channel and being broadcasted, the instruction are sent to broadcast connection device
It is interior to contain the time for stopping unicast channel broadcast, specific judgment method are as follows:
S531: judging the number of k, as k=1, carries out step S532, as k > 1, carries out step S533；
S532: the time for stopping unicast channel broadcast is the presentation of video frames end time；
S533: the time for stopping unicast channel broadcast is the last one instruction corresponding presentation of video frames end time, and
It further include sending F.F. to broadcasting server to broadcast when the corresponding video frame of each instruction for judging input is not successive video frames
Instruction is put, contains F.F. starting and end time and F.F. multiple, F.F. time started and knot in fast-forward play instruction
The beam time is respectively broadcasting end time and the play start time of discontinuous two video frames.
The present invention judges the processing method of processing server, specifically: when receiving viewing supplemental information simultaneously
With channel switching command, the corresponding supplemental information of each instruction is first found out, it is then endowed, that is, broadcast start time is marked out, then
The video frame for finding out same label from the video cached in unicast channel is sent to broadcasting server, and is opened to my endowed broadcast
Begin the time, and sends the instruction for switching to unicast channel and being broadcasted to broadcasting server, and this method is further to defeated
The number for entering instruction is judged, after the instruction of input is to play the corresponding video frame of the instruction and supplemental information for one,
Just directly terminate unicast channel broadcast, be converted into multicast channel and continue to play, if the instruction of input is greater than 1, if respectively referred to
It is continuously, directly to terminate unicast channel broadcast after all instructions corresponds to presentation of video frames between order, if each instruction corresponds to
Video frame is not continuous, then fast-forward play is carried out to nonoptional video frame after playing continuous video frame, it is to be achieved
When having selected the video frame of synchronous supplemental information, according still further to normal speed forward, limited in this way so that entire time shift program request and benefit
Filling the playing process of synchronizing information, the operation is more convenient, the case where constantly switching there is no multiple unicast and multicast, Neng Gouti
While height viewing fluency, guarantees that played video frame is synchronous with supplemental information, improve user's viewing experience.
Embodiment 4
The embodiment of the present invention 4 provides a kind of method that broadcasted content is played simultaneously with supplemental information, this method and embodiment 3
It is essentially identical, unlike, as shown in figure 5, when processing server receive only request viewing related supplemental information when, processing
Server proceeds as follows:
S54: the Pianli since first instruction of input has searched whether supplement relevant to the corresponding video frame of the instruction
Information, if so, B is the timestamp for instructing corresponding video frame by the supplemental information endowed B；
S55: when the relevant supplemental information of video frame not corresponding to the instruction, computations correspond to sequence of frames of video
Endowed Z sequence of frames of video corresponding with received supplemental information newest in processing server endowed difference J, and with sequence difference threshold value
J1 is compared, and as J≤J1, carries out step S56, as J > J1, carries out step S57；
S56: processing server sends to broadcasting server and multicast channel is switched to unicast channel and from sequence of frames of video
The corresponding video frame of endowed Z1 starts the instruction of broadcast, Z1=Z-J, and will the new received endowed C of supplemental information, C=Z1 is corresponding
The timestamp of video frame；
S57: processing server wouldn't process, newest benefit in video frame to be currently played and processing server
When filling information and corresponding to the endowed difference J2=J1 of sequence of frames of video, processing server is sent to broadcasting server switches multicast channel
The instruction broadcasted at unicast channel and since the video frame being currently played, and will the new received endowed D of supplemental information, D
=the video frame being currently played corresponds to the timestamp of corresponding video frame after the endowed+JI of sequence of frames of video.
When is viewing supplemental information separately is requested in the received instruction of processing server, processing server is first determined whether in it
Instruct the relevant supplemental information of corresponding video frame, if so, directly by supplemental information service the instruction correspond to video frame when
Between stab, then realize and be played simultaneously, when, without supplemental information, judging that received supplemental information corresponds to video frame in processing server
The several video frames of difference between video frame corresponding with instruction, if the video frame of difference is few, processing server is to broadcasting server
Transmission switches to the instruction of unicast channel broadcast, and the video frame which starts is that a little the corresponding video frame of preceding instruction is poor to being pushed forward
Video frame number, to receive supplemental information be that unicast channel has also just been played to the corresponding video frame of present instruction when being played to,
It realizes that selection video frame is synchronous with supplemental information in turn, if the video frame number of difference is relatively more, just waits a period of time,
Video frame before being played again by unicast channel, and then when being played to present instruction selection video frame, processing server
Supplemental information has been received, and then has realized and is played simultaneously, the purpose being arranged in this way is, since supplemental information is to pass through network transmission
To supplemental information server generate, it is understood that there may be network delay, in this way if when selecting video frame being played on, possibility
It is synchronous not come out supplemental information, and then synchronization cannot be achieved, then we are corresponding according to supplemental information in order to realize synchronization
Video frame and selection video frame difference, Lai Jinhang time shift program request, it is such while play while wait supplemental information, when supplemental information send out
It brings, also played the corresponding video frame of present instruction, and then realize that video frame is synchronous with supplemental information, improve same
The efficiency of step, and meet the synchronisation requirement of user.
Embodiment 5
The embodiment of the present invention 5 provides a kind of system that broadcasted content is played simultaneously with supplemental information, as shown in fig. 6, this is
System includes:
It is all to extract each program of composition for handling from the received program of content supplier for content server 1
Each video frame of video, and it is supplied to broadcasting server 2 and supplemental information server 3；
Broadcasting server 2 adds label XYZE, X for the program that reception content server 1 provides for each video frame
Indicate that programm name is corresponding endowed, Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, and E indicates view
The corresponding timestamp of frequency frame, then make the first time axis of presenting programs playback progress, the second time shaft and with each video frame
Corresponding thumbnail, and it is sent to mobile terminal 4, while being broadcasted in the form of streaming by multicast channel, it is logical by unicast
Road caches received program；
Supplemental information server 3 for the program that reception content server 1 provides, and generates corresponding with each video frame
Supplemental information, and for supplemental information add label XYZF, F indicate type of supplemental information it is corresponding endowed, be sent to processing clothes
Business device 5；
Mobile terminal 4, for receiving first time axis, the second time shaft and the thumbnail of the transmission of broadcasting server 2, when broadcasting
When putting the program of the broadcast of broadcasting server 2, first time axis and the second time shaft are shown on broadcast interface, and according to user
The instruction inputted on first time axis and the second time shaft judges the request issued to processing server 5, again playback process
The program broadcasted by endowed supplemental information and broadcasting server 2 that server 5 is sent, when playing again, broadcast interface is only
Show the second time shaft；
Processing server 5, the supplement letter that request and supplemental information server 3 for receiving the transmission of mobile terminal 4 are sent
Breath, and judges request, endowed to corresponding supplemental information and be sent to mobile terminal 4 according to judging result, while to
Broadcasting server 2 sends corresponding video frame is endowed and multicast channel is switched to the instruction that unicast channel is broadcasted.
The system that broadcasted content provided by the invention and supplemental information are played simultaneously can be realized to played video frame
With being played simultaneously for supplemental information, it is more accurate to be played simultaneously, and there is no time deviations, provide user's viewing experience.
The present invention is not limited to above-mentioned preferred forms, anyone can show that other are various under the inspiration of the present invention
The product of form, however, make any variation in its shape or structure, it is all that there is skill identical or similar to the present application
Art scheme, is within the scope of the present invention.
Claims (10)
1. a kind of method that broadcasted content and supplemental information are played simultaneously, which is characterized in that described method includes following steps:
Content server is handled from the received program of content supplier, is extracted and is formed each of each all videos of program
Video frame, and it is supplied to broadcasting server and supplemental information server；
The program that broadcasting server reception content server provides adds label XYZE for each video frame, and X indicates programm name
Corresponding endowed, Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, when E indicates that video frame is corresponding
Between stab, then make presenting programs playback progress first time axis, the second time shaft and thumbnail corresponding with each video frame,
And it is sent to mobile terminal, while being broadcasted in the form of streaming by multicast channel, by unicast channel to received program
It is cached；
The program that supplemental information server reception content server provides, and supplemental information corresponding with each video frame is generated,
And label XYZF is added for supplemental information, F indicates that type of supplemental information is corresponding endowed, is sent to processing server；
Mobile terminal receives first time axis, the second time shaft and the thumbnail that broadcasting server is sent, when broadcasting broadcast service
When the program of device broadcast, first time axis and the second time shaft are shown on broadcast interface, and according to user at the first time
The instruction inputted on axis and the second time shaft judges the request issued to processing server；
Processing server receive mobile terminal send request and supplemental information server send supplemental information, and to request into
Row judgement, it is endowed to corresponding supplemental information and be sent to mobile terminal according to judging result, while being sent to broadcasting server
Will corresponding video frame it is endowed and multicast channel is switched into the instruction that unicast channel is broadcasted；
After broadcasting server receives instruction, finds out corresponding video frame and carry out endowed, while cutting and multicast channel is switched into list
Channel is broadcast to be broadcasted；
The section by endowed supplemental information and broadcasting server broadcasts that mobile terminal receives and playback process server is sent
Mesh, broadcast interface only shows the second time shaft at this time.
2. the method as described in claim 1, which is characterized in that first time axis is by the n-th-m video frame to the (n-1)th video frame pair
The timestamp composition answered, n > 1 indicate the video frame being currently played, and m >=2 are indicated from the video frame being currently played
The number of the video frame interior for the previous period of corresponding timestamp, the second time shaft are corresponding to the n-th+a video frame by video frame n
Timestamp composition, a >=1 indicates the video in rear a period of time since the corresponding timestamp of video frame being currently played
The number of frame, the second time shaft are equipped with cursor point, are used to indicate the video frame being currently played.
3. method according to claim 2, which is characterized in that within a preset period of time, mobile terminal receives the k of user's input
A instruction, k >=1, the label of the corresponding video frame of each instruction of record input, and the position of instruction is judged, when instruction pair
When the video frame answered is located between the n-th-m to (n-1)th video frame, viewing is sent to processing server and instructs corresponding video frame phase
The request of request and the channel switching of supplemental information is closed, viewing instructs in the request of corresponding video frame related supplemental information containing each
The label for instructing corresponding video frame, when instructing corresponding video frame to be located at n-th of video frame between n+a video frame, to
Processing server sends the request that request viewing instructs corresponding video frame related supplemental information, contains the corresponding view of instruction in the request
The label of frequency frame.
4. method as claimed in claim 3, which is characterized in that when processing server receive viewing supplemental information and channel cut
When the request changed, processing server is proceeded as follows:
Supplemental information corresponding with the label of each video frame is searched out of supplemental information, and is the endowed A of supplemental information, and A is wide
Broadcast the time started；
It is sent to broadcasting server and searches video frame identical with the label of each video frame from the video cached in unicast channel,
And the endowed A of video frame to find out, while being sent to broadcasting server and multicast channel being switched into unicast channel and from endowed A pairs
The video frame answered starts the instruction of broadcast.
5. method as claimed in claim 4, which is characterized in that processing server also proceeds as follows:
It further include being hinged with to broadcast while sending the instruction broadcasted since the corresponding video frame of endowed A to broadcasting server
It sets transmission to stop switching to the instruction that unicast channel is broadcasted, the time for stopping unicast channel broadcast, tool is contained in the instruction
Body judgment method are as follows:
The number for judging k, as k=1, the time for stopping unicast channel broadcast is the presentation of video frames end time.
6. method as claimed in claim 5, which is characterized in that
As k > 1, the time for stopping unicast channel broadcast is the last one instruction corresponding presentation of video frames end time, and
It further include sending F.F. to broadcasting server to broadcast when the corresponding video frame of each instruction for judging input is not successive video frames
Instruction is put, contains F.F. starting and end time and F.F. multiple, F.F. time started and knot in fast-forward play instruction
The beam time is respectively broadcasting end time and the play start time of discontinuous two video frames.
7. method as claimed in claim 3, which is characterized in that when processing server receives only request viewing related supplemental letter
When breath, processing server is proceeded as follows:
The Pianli since first instruction of input, has searched whether supplemental information relevant to the corresponding video frame of the instruction, such as
Fruit has, and is the timestamp for instructing corresponding video frame by the endowed B of the supplemental information, B.
8. the method for claim 7, which is characterized in that when the relevant supplement of video frame not corresponding to the instruction is believed
When breath, computations correspond to the endowed Z of sequence of frames of video video frame corresponding with received supplemental information newest in processing server
The endowed difference J of sequence, and be compared with sequence difference threshold value J1, as J≤J1, processing server is sent to broadcasting server by group
Broadcast channel switch to unicast channel and since the corresponding video frame of the endowed Z1 of sequence of frames of video broadcast instruction, Z1=Z-J, and
Newly the received endowed C of supplemental information, C=Z1 it will correspond to the timestamp of video frame.
9. method according to claim 8, which is characterized in that as J > J1, processing server wouldn't be processed, to current
When the endowed difference J2=J1 of video frame being played on sequence of frames of video corresponding with supplemental information newest in processing server, place
Reason server sends to broadcasting server and multicast channel is switched to unicast channel and since the video frame being currently played
The instruction of broadcast, and newly the received endowed D of supplemental information, the video frame that D=is currently played will correspond to sequence of frames of video
The timestamp of corresponding video frame after endowed+JI.
10. the system that a kind of broadcasted content and supplemental information are played simultaneously, which is characterized in that the system comprises:
Content server (1) extracts for handling from the received program of content supplier and forms each all views of program
Each video frame of frequency, and it is supplied to broadcasting server (2) and supplemental information server (3)；
Broadcasting server (2) adds label XYZE, X for the program that reception content server (1) provides for each video frame
Indicate that programm name is corresponding endowed, Y indicates that collection number is corresponding endowed, and Z indicates that sequence of frames of video is corresponding endowed, and E indicates view
The corresponding timestamp of frequency frame, then make the first time axis of presenting programs playback progress, the second time shaft and with each video frame
Corresponding thumbnail, and mobile terminal (4) are sent to, while being broadcasted in the form of streaming by multicast channel, pass through unicast
Channel caches received program；Supplemental information server (3), for the program that reception content server (1) provides, and
Supplemental information corresponding with each video frame is generated, and adds label XYZF for supplemental information, F indicates that type of supplemental information is corresponding
It is endowed, be sent to processing server (5)；
Mobile terminal (4), for receiving first time axis, the second time shaft and the thumbnail of broadcasting server (2) transmission, when broadcasting
Put broadcasting server (2) broadcast program when, first time axis and the second time shaft are shown on broadcast interface, and according to
The instruction that family inputs on first time axis and the second time shaft judges the request issued to processing server (5), plays again
The program broadcasted by endowed supplemental information and broadcasting server (2) that processing server (5) is sent, when playing again, broadcasts
It puts interface and only shows the second time shaft；
Processing server (5), the supplement that request and supplemental information server (3) for receiving mobile terminal (4) transmission are sent
Information, and request is judged, it is endowed to corresponding supplemental information and be sent to mobile terminal (4) according to judging result, together
When to broadcasting server (2) send will corresponding video frame it is endowed and multicast channel is switched into the finger that unicast channel is broadcasted
It enables.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710817097.9A CN107465952B (en) | 2017-09-12 | 2017-09-12 | A kind of method and system that broadcasted content is played simultaneously with supplemental information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710817097.9A CN107465952B (en) | 2017-09-12 | 2017-09-12 | A kind of method and system that broadcasted content is played simultaneously with supplemental information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107465952A CN107465952A (en) | 2017-12-12 |
| CN107465952B true CN107465952B (en) | 2019-08-16 |
Family
ID=60552348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710817097.9A Active CN107465952B (en) | 2017-09-12 | 2017-09-12 | A kind of method and system that broadcasted content is played simultaneously with supplemental information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107465952B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108259924B (en) * | 2017-12-15 | 2021-07-02 | 上海聚力传媒技术有限公司 | Method for displaying real-time data of events, terminal equipment, video system and storage medium |
| CN110933449B (en) * | 2019-12-20 | 2021-10-22 | 北京奇艺世纪科技有限公司 | Method, system and device for synchronizing external data and video pictures |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1429455A (en) * | 2000-05-25 | 2003-07-09 | 汤姆森许可贸易公司 | Device and method for synchronising broadcast audio-visual programmes and complementary data |
| CN101554054A (en) * | 2006-11-20 | 2009-10-07 | Sk电信有限公司 | System, server and method for providing supplementary information service related to broadcast content |
| CN101569192A (en) * | 2007-01-08 | 2009-10-28 | Sk电信有限公司 | System and method for synchroning broadcast content with supplementary information |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9788058B2 (en) * | 2000-04-24 | 2017-10-10 | Comcast Cable Communications Management, Llc | Method and system for automatic insertion of interactive TV triggers into a broadcast data stream |
| KR101398135B1 (en) * | 2007-08-31 | 2014-05-20 | 엘지전자 주식회사 | mobile terminal and method to output broadcast and additional information data |
-
2017
- 2017-09-12 CN CN201710817097.9A patent/CN107465952B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1429455A (en) * | 2000-05-25 | 2003-07-09 | 汤姆森许可贸易公司 | Device and method for synchronising broadcast audio-visual programmes and complementary data |
| CN101554054A (en) * | 2006-11-20 | 2009-10-07 | Sk电信有限公司 | System, server and method for providing supplementary information service related to broadcast content |
| CN101569192A (en) * | 2007-01-08 | 2009-10-28 | Sk电信有限公司 | System and method for synchroning broadcast content with supplementary information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107465952A (en) | 2017-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220303599A1 (en) | Synchronizing Program Presentation | |
| CN101060617B (en) | A video-on-demand control method, customer terminal equipment and switching control device | |
| US8407741B2 (en) | System, server and method for providing supplementary information service related to broadcast content | |
| CN103024464B (en) | System and method with video-frequency playing content relevant information is provided | |
| EP2391086B1 (en) | Method and apparatus for playing live content | |
| CN101854533B (en) | Frequency channel switching method, device and system | |
| CN107509094B (en) | A kind of method of smart television programme televised live association request program | |
| US9843613B2 (en) | Synchronization of multimedia contents on second screen | |
| CN106507186B (en) | Media information switching method, server and storage medium | |
| JP2004525545A (en) | Webcast method and system for synchronizing multiple independent media streams in time | |
| CN102685561B (en) | Program carousel method and system, terminal equipment and program on-demand device | |
| CN101917390A (en) | Multifunctional network player | |
| AU2013283255B2 (en) | Provision of a personalized media content | |
| CN105072458A (en) | Method for realizing time shifting in live broadcasting process of set top box based on HLS protocol | |
| CN107465952B (en) | A kind of method and system that broadcasted content is played simultaneously with supplemental information | |
| CN1972440A (en) | An implementation method for picture-in-picture in IPTV | |
| EP3852380B1 (en) | Method and device for switching media service channels | |
| CN110381340A (en) | Video file processing system | |
| US11711574B2 (en) | Content-modification system with determination of input-buffer switching delay feature | |
| CN107197394A (en) | A kind of method of video playback sound intermediate frequency switching | |
| CN102172035A (en) | Manufacturing method and system of audio special | |
| CN101662689B (en) | Method and system for switching interactive TV channels and method and device for sending audio and video streams | |
| Kim et al. | Analysis and improvement of MPEG-DASH-based internet live broadcasting Services in Real-world Environments | |
| KR20200053178A (en) | Method and Apparatus for Switching Media Service Channel | |
| WO2008017192A1 (en) | An interactive television system and method for implementing interactive television |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and system for broadcasting content and supplementary information synchronously Effective date of registration: 20210622 Granted publication date: 20190816 Pledgee: Beijing culture science and technology financing Company limited by guarantee Pledgor: CBC CLOUD TECHNOLOGY Co.,Ltd. Registration number: Y2021980005035 |