CN108111896A - A kind of captioning synchronization method and device - Google Patents
A kind of captioning synchronization method and device Download PDFInfo
- Publication number
- CN108111896A CN108111896A CN201810040905.XA CN201810040905A CN108111896A CN 108111896 A CN108111896 A CN 108111896A CN 201810040905 A CN201810040905 A CN 201810040905A CN 108111896 A CN108111896 A CN 108111896A
- Authority
- CN
- China
- Prior art keywords
- video frame
- caption information
- subtitle
- current video
- counting value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Studio Circuits (AREA)
Abstract
The present invention provides a kind of captioning synchronization method and device, this method includes：Obtain current video frame and subtitle keeping count position；If the counting value of subtitle keeping count position is 0, and there are the corresponding caption information of current video frame, then obtains the corresponding caption information of current video frame, caption information is inserted into current video frame, the current video frame after insertion operation is transferred to receiving terminal；If the counting value of subtitle keeping count position is more than 0, current video frame is directly transferred to receiving terminal.Transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame in the present invention so that caption information becomes a part for video requency frame data, and the video frame that when transmitting video caption information can be made corresponding reaches receiving terminal simultaneously.Realize that subtitle is synchronous with video pictures when receiving terminal plays video, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
Description
Technical field
The present invention relates to technical field of video processing, in particular to a kind of captioning synchronization method and device.
Background technology
At present, real-time video all exists in many application scenarios such as live streaming, instant messaging and security monitoring, is regarded in real time
Processing caption information is needed during frequency remote playing, so that the video frame synchronization that caption information is corresponding.
Currently, caption information is not shown when major applications scene plays real-time video.In fraction application scenarios, connect
Receiving end in advance from transmitting terminal obtain caption information, receive transmitting terminal transmission real-time video when again simultaneously caption playing information
Corresponding video frame.But receiving terminal needs just to can determine that caption information and which video by extremely complex operating process
Frame corresponds to, and the synchronous efficiency of caption information and video frame is very low, and synchronous accuracy is low.
Caption information is not shown during due to currently playing real-time video or shows complicated for operation, the efficiency of caption information
And accuracy is low, therefore is badly in need of a kind of new captioning synchronization scheme, to simplify subtitle synchronizing process, improves synchronous efficiency and accurate
Property.
The content of the invention
In view of this, the embodiment of the present invention is designed to provide a kind of captioning synchronization method and device, existing to solve
Technology does not show caption information or shows the complicated for operation of caption information when playing real-time video, efficiency and accuracy is low
Problem.
In a first aspect, an embodiment of the present invention provides a kind of captioning synchronization method, the described method includes：
Obtain current video frame and subtitle keeping count position；
If the counting value of the subtitle keeping count position is 0, and there are the corresponding caption information of the current video frame,
The corresponding caption information of the current video frame is then obtained, the caption information is inserted into the current video frame, will be inserted into
The current video frame after operation is transferred to receiving terminal；
If the counting value of the subtitle keeping count position is more than 0, the current video frame is directly transferred to reception
End.
With reference to first aspect, an embodiment of the present invention provides the first possible realization method of above-mentioned first aspect,
In, it is described that the caption information is inserted into the current video frame, including：
The current video frame is parsed, supplemental enhancement information cell S EI is oriented from the current video frame；
The caption information is inserted into the SEI.
With reference to first aspect, an embodiment of the present invention provides second of possible realization method of above-mentioned first aspect,
In, it is described the caption information is inserted into the current video frame after, further include：
The caption information includes subtitle file and subtitle continues frame number；If the subtitle continues frame number more than 1, cache
The subtitle continues frame number, and the counting value of the subtitle keeping count position is added one；Alternatively,
The caption information includes subtitle file and subtitle duration；If the subtitle duration is more than described current
The corresponding display duration of video frame, then cache the subtitle duration, and by the counting value of the subtitle keeping count position
Increase the corresponding display duration of the current video frame.
With reference to first aspect, an embodiment of the present invention provides the third possible realization method of above-mentioned first aspect,
In, it is described the current video frame is directly transferred to receiving terminal after, further include：
Obtain the caption information of current cache；
If the caption information continues frame number including subtitle, the counting value of the subtitle keeping count position is added one；
If plus after an operation it is described count value and be equal to the subtitle that includes of the caption information continue frame number, by the counting value
0 is reset to, and deletes the caption information of caching；
If the caption information includes subtitle duration, the counting value of the subtitle keeping count position is increased into institute
State the corresponding display duration of current video frame；If the value that counts is equal to the institute that the caption information includes after increasing operation
Subtitle duration is stated, then the counting value is reset to 0, and deletes the caption information of caching.
Second aspect, an embodiment of the present invention provides a kind of captioning synchronization method, the described method includes：
Receive the current video frame of transmitting terminal transmission；
The counting value of subtitle keeping count position is obtained, if the counting value is 0, it is determined that in the current video frame
Whether comprising caption information, if it is, the corresponding caption information of the current video frame is extracted from the current video frame,
The current video frame is played, and shows the caption information simultaneously；If it is not, then directly play the current video frame；
If the counting value is more than 0, the caption information of current cache is obtained, plays the current video frame, and it is same
When show the caption information of current cache.
With reference to second aspect, an embodiment of the present invention provides the first possible realization method of above-mentioned second aspect,
In, it is described that the corresponding caption information of the current video frame is extracted from the current video frame, including；
The current video frame is parsed, SEI is oriented from the current video frame；
The corresponding caption information of the current video frame is extracted from the SEI.
With reference to second aspect, an embodiment of the present invention provides second of possible realization method of above-mentioned second aspect,
In, it is described the corresponding caption information of the current video frame is extracted from the current video frame after, further include：
The caption information includes subtitle file and subtitle continues frame number；If the subtitle continues frame number more than 1, cache
The caption information, and the counting value of the subtitle keeping count position is added one；
The caption information includes subtitle file and subtitle duration；If the subtitle duration is more than described current
The corresponding display duration of video frame then caches the caption information, and the counting value of the subtitle keeping count position is increased
The corresponding display duration of the current video frame.
With reference to second aspect, an embodiment of the present invention provides the third possible realization method of above-mentioned second aspect,
In, it is described to play the current video frame, and after showing the caption information of current cache simultaneously, further include：
If the caption information continues frame number including subtitle, the counting value of the subtitle keeping count position is added one；
If plus after an operation it is described count value and be equal to the subtitle that includes of caption information of current cache continue frame number, by the counting
Value is reset to 0, and deletes the caption information of caching；
If the caption information includes subtitle duration, the counting value of the subtitle keeping count position is increased into institute
State the corresponding display duration of current video frame；If the value that counts includes equal to the caption information of current cache after increasing operation
Subtitle duration, then the counting value is reset to 0, and deletes the caption information of caching.
The third aspect, an embodiment of the present invention provides a kind of captioning synchronization device, described device includes：
Acquisition module, for obtaining current video frame and subtitle keeping count position；
Module is inserted into, is 0 for working as the counting value for the subtitle keeping count position that the acquisition module obtains, and deposits
In the corresponding caption information of the current video frame, the corresponding caption information of the current video frame is obtained, by the subtitle
Information is inserted into the current video frame；
Transport module, for the current video frame after insertion operation to be transferred to receiving terminal；It is additionally operable to obtain when described
When the counting value for the subtitle keeping count position that modulus block obtains is more than 0, directly the current video frame is transferred to and is connect
Receiving end.
Fourth aspect, an embodiment of the present invention provides a kind of captioning synchronization device, described device includes：
Receiving module, for receiving the current video frame of transmitting terminal transmission；
Extraction module, for obtaining the counting value of subtitle keeping count position, if the counting value is 0, it is determined that institute
It states whether comprising caption information in current video frame, if it is, extracting the current video frame from the current video frame
Corresponding caption information；
Playing module, for work as it is described counting value be 0, and in the current video frame include caption information when, play
The current video frame, and the caption information is shown simultaneously；And for working as the counting value be 0, and described work as forward sight
When not including caption information in frequency frame, the current video frame is directly played；And if for the subtitle keeping count position
It counts value and is more than 0, then obtain the caption information of current cache, play the current video frame, and show current cache simultaneously
The caption information.
In embodiments of the present invention, transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame so that word
Curtain information becomes a part for video requency frame data, will be inserted into the video frame transmission of caption information to receiving terminal.Receiving terminal receives
After being inserted into the video frame of caption information, its corresponding caption information is shown while video frame is played.The present invention is regarded in transmission
The video frame that during frequency caption information can be made corresponding reaches receiving terminal simultaneously.Receiving terminal play video when realize subtitle with
The synchronization of video pictures, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
For the above objects, features and advantages of the present invention is enable to be clearer and more comprehensible, preferred embodiment cited below particularly, and coordinate
Appended attached drawing, is described in detail below.
Description of the drawings
It in order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 shows a kind of flow chart for captioning synchronization method that the embodiment of the present invention 1 is provided；
Fig. 2 shows the flow chart for another captioning synchronization method that the embodiment of the present invention 1 is provided；
Fig. 3 shows a kind of flow chart for captioning synchronization method that the embodiment of the present invention 2 is provided；
Fig. 4 shows the flow chart for another captioning synchronization method that the embodiment of the present invention 2 is provided；
Fig. 5 shows a kind of structure diagram for captioning synchronization device that the embodiment of the present invention 3 is provided；
Fig. 6 shows a kind of structure diagram for captioning synchronization device that the embodiment of the present invention 4 is provided；
Fig. 7 shows a kind of structure diagram for captioning synchronization device that the embodiment of the present invention 6 is provided；
Fig. 8 shows a kind of structure diagram for captioning synchronization device that the embodiment of the present invention 8 is provided.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
The technical solution in the embodiment of the present invention is clearly and completely described in middle attached drawing, it is clear that described embodiment is only
It is part of the embodiment of the present invention, instead of all the embodiments.The present invention being usually described and illustrated herein in the accompanying drawings is real
Applying the component of example can configure to arrange and design with a variety of.Therefore, below to provide in the accompanying drawings the present invention
The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of the selected reality of the present invention
Apply example.Based on the embodiment of the present invention, institute that those skilled in the art are obtained on the premise of creative work is not made
There is other embodiment, belong to the scope of protection of the invention.
Caption information is not shown during in view of currently playing real-time video or shows the complicated for operation of caption information, effect
Rate and accuracy are low, therefore are badly in need of a kind of new captioning synchronization scheme, to simplify subtitle synchronizing process, improve synchronous efficiency and standard
True property.Based on this, an embodiment of the present invention provides a kind of captioning synchronization method and devices, are described below by embodiment.
Embodiment 1
Referring to Fig. 1, an embodiment of the present invention provides a kind of captioning synchronization method, this method specifically includes following steps：
Step 101：Obtain current video frame and subtitle keeping count position.
The executive agent of the embodiment of the present invention is real-time video transmitting terminal.Since there are the subtitles of multiple video frame in video
The identical situation of information, therefore the embodiment of the present invention is provided with subtitle keeping count position in transmitting terminal, is persistently counted by subtitle
Numerical digit marks current subtitle to believe the frame number that marks current subtitle information continuously display or by subtitle keeping count position
The continuously display duration of breath.
When subtitle keeping count position for the frame number for marking current subtitle information continuously display, and there is currently persistently show
During the caption information shown, as soon as whenever transmitting terminal has sent a video frame, the counting value of subtitle keeping count position is added one, and
Judge that whether corresponding with the caption information counting value frame number that continues of subtitle keeping count position be equal, if equal, by word
The counting value of curtain keeping count position is reset to 0.When subtitle keeping count position is used for marking current subtitle information continuously display
Duration, and there is currently during continuously display caption information, as soon as whenever transmitting terminal has sent a video frame, subtitle is continued
The counting value of meter digital increases the corresponding display duration of the video frame, and judge subtitle keeping count position counting value whether
Duration corresponding with the caption information is equal, if equal, the counting value of subtitle keeping count position is reset to 0.
While transmitting terminal obtains current video frame, the current counting value in subtitle keeping count position is obtained.Judge subtitle
Whether the counting value of keeping count position is 0, if it is, show there is currently no the continuously display caption information of needs, after
The continuous operation for performing step 102.If it is not, then show that there is currently need continuously display caption information, subsequent execution step
103 operation.
Step 102：If the counting value of subtitle keeping count position is 0, and there are the corresponding caption information of current video frame,
The corresponding caption information of current video frame is then obtained, caption information is inserted into current video frame, it will be current after insertion operation
Video frame transmission is to receiving terminal.
When it is 0 that transmitting terminal, which judges the counting value of subtitle keeping count position, further determines whether to exist and work as forward sight
The corresponding caption information of frequency frame, if being not present, is directly transferred to receiving terminal by current video frame.If in the presence of acquisition is current
The corresponding caption information of video frame, and caption information is inserted into current video frame in the following way, it specifically includes：
Current video frame is parsed, SEI (Supplemental Enhancement are oriented from current video frame
Information, supplemental enhancement information unit)；It will be in the SEI of caption information insertion current video frame.
After in the SEI of caption information insertion current video frame, the current video frame for being inserted into caption information is transferred to and is connect
Receiving end.In the embodiment of the present invention, the corresponding caption information of video frame is inserted into the SEI of video frame by transmitting terminal, so that regarding
The corresponding caption information of frequency frame can reach receiving terminal simultaneously with video frame, and subtitle and video are realized when receiving terminal plays video
The synchronization of picture avoids subtitle and video pictures is unmatched happens.
Due to there is a situation where that the caption information of multiple video frame is identical in video, if the subtitle included in current video frame
Information is exactly to need continuously display caption information, if packet drop occurs for the current video frame in transmission process, can be led
Continuously multiple video frame can not caption playing information during cause receiving terminal broadcasting video.Therefore in the embodiment of the present invention, transmitting terminal
When the current video frame for being inserted into caption information is transferred to receiving terminal, in order to reduce in transmission process because packet loss causes caption information
The situation of loss, the embodiment of the present invention are with the addition of packet loss re-transmission policy in video transmitting procedure.Insertion caption information is worked as
Preceding video frame enables the transmission based on reliable UDP (User Datagram Protocol, user datagram transport protocol), such as
The current video frame of insertion caption information is transmitted by KCP (fast and reliable agreement).
Worked as by KCP agreements come when transmitting the current video frame of insertion caption information, caption information is inserted by transmitting terminal
After preceding video frame, the current video frame is cached, and unique mark is distributed for the current video frame, it then should by KCP agreements
Current video frame and its unique mark are transferred to receiving terminal.After receiving terminal receives the current video frame and unique mark, by this
Unique mark returns to transmitting terminal.Transmitting terminal confirms that the current video frame is sent successfully when receiving the unique mark, continue into
The processing of row subsequent video frame.Do not have if transmitting terminal is sent to receiving terminal after the current video frame and its unique mark in a period of time
There is the unique mark for receiving receiving terminal return, then confirm the current video frame packet loss, this of transmitting terminal acquisition caching is current
The current video frame and its unique mark are sent to receiving terminal by video frame again by KCP agreements.Transmitting terminal should until confirming
Until current video frame is successfully sent to receiving terminal, the current video frame of caching is deleted, is further continued for carrying out subsequent video frame
Processing.
In embodiments of the present invention, after caption information is inserted into current video frame, also need to judge current video frame pair
It is continuously display whether the caption information answered needs.Whether caption information needs continuously display to continue frame number or subtitle with subtitle
Duration identifies.When caption information includes subtitle file and subtitle continues frame number, transmitting terminal judges that caption information includes
Subtitle continue whether frame number is more than 1, if subtitle continues frame number more than 1, it is continuously display to show that the caption information needs, transmission
End caches the subtitle and continues frame number, and the counting value of subtitle keeping count position is added one.If subtitle continues frame number equal to 1,
Show the caption information without continuously display.
When caption information includes subtitle file and subtitle duration, the subtitle that transmitting terminal judges caption information and includes is held
Whether continuous duration is more than the corresponding display duration of current video frame, if subtitle duration is more than the corresponding display of current video frame
It is continuously display then to show that the caption information needs for duration, and transmitting terminal caches the subtitle duration, and by subtitle keeping count position
Counting value increase the corresponding display duration of current video frame.If subtitle duration is equal to the corresponding display of current video frame
Duration then shows the caption information without continuously display.
Step 103：If the counting value of subtitle keeping count position is more than 0, current video frame is directly transferred to reception
End.
When transmitting terminal judges that the current count value of subtitle keeping count position is more than 0, confirm that there is currently need to continue
The caption information of display, and the caption information be inserted into current video frame before video frame and be transferred to receiving terminal.Institute
Without repeating to transmit the caption information, need not the caption information be inserted into current video frame at this time, but will directly work as forward sight
Frequency frame is transferred to receiving terminal.For not including the video frame of caption information, transmitting terminal both may be employed unreliable udp protocol and carry out
Transmission, can also be transmitted using reliable UDP agreement.
When the counting value of subtitle keeping count position is more than 0, although without caption information is inserted into current video frame,
But it also needs to modify to the counting value of subtitle keeping count position.For needing continuously display caption information, inciting somebody to action
When in caption information insertion video frame and being transferred to receiving terminal, transmitting terminal has cached the caption information, therefore when subtitle is persistently counted
After the counting value of numerical digit is more than 0, and current video frame is transferred directly to receiving terminal by transmitting terminal, the word of current cache is also obtained
If the caption information includes subtitle file and subtitle continues frame number, the counting value of subtitle keeping count position is added for curtain information
One.Then judge plus an operation after countings value whether the subtitle included equal to caption information continues frame number, if it is,
Show the continuously display cut-off of the caption information, the counting value of subtitle keeping count position is reset to 0, and deletes the word of caching
Curtain information.If it is not, then show that the continuously display of the caption information is not yet terminated.
If the caption information of current cache storage includes subtitle file and subtitle duration, by subtitle keeping count position
Counting value increases the corresponding display duration of current video frame.Then judge to increase whether the counting value after operating is equal to subtitle
The subtitle duration that information includes, if it is, showing the continuously display cut-off of the caption information, by subtitle keeping count
The counting value of position is reset to 0, and deletes the caption information of caching.If it is not, then show the caption information it is continuously display still
Do not terminate.
In embodiments of the present invention, after getting current video frame in step 101, also need to judge whether that subtitle is believed
Breath update, if it is, newer caption information is sent to encoder and is preserved.If it is not, then by step 102 or
Captioning synchronization is realized in 103 operation.
For the ease of understanding the core synchronization policy of captioning synchronization scheme provided in an embodiment of the present invention, below in conjunction with the accompanying drawings
It is specifically described.As shown in Fig. 2, S1：Judge whether that caption information updates, if so, step S2 is performed, if not,
Perform step S4.S2：Newer caption information is sent to encoder and is preserved, then performs step S4.S3：It obtains and works as
Preceding video frame.S4：The corresponding caption information of current video frame is judged whether, if so, step S5 is performed, if not, holding
Row step S6.S5：It will be in the SEI of caption information insertion current video frame.S6：Current video frame is transferred to receiving terminal.
All identical with current video frame for each video frame, transmitting terminal is according to method provided in an embodiment of the present invention
Realize captioning synchronization.
In embodiments of the present invention, transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame so that word
Curtain information becomes a part for video requency frame data, will be inserted into the video frame transmission of caption information to receiving terminal.Receiving terminal receives
After being inserted into the video frame of caption information, its corresponding caption information is shown while video frame is played.The present invention is regarded in transmission
The video frame that during frequency caption information can be made corresponding reaches receiving terminal simultaneously.Receiving terminal play video when realize subtitle with
The synchronization of video pictures, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
Embodiment 2
Referring to Fig. 3, an embodiment of the present invention provides a kind of captioning synchronization method, this method specifically includes following steps：
Step 201：Receive the current video frame of transmitting terminal transmission.
The executive agent of the embodiment of the present invention is video receiver.Receiving terminal receives the current video frame of transmitting terminal transmission.
Step 202：Obtain the counting value of subtitle keeping count position, if it is 0 to count value, determine be in current video frame
It is no to include caption information, if it is, extracting caption information from current video frame, current video frame is played, and is shown simultaneously
Caption information；If it is not, then directly play current video frame.
After receiving terminal receives the current video frame of transmitting terminal transmission, the corresponding word of the current video frame is judged whether
Curtain information.Specifically, the frame number or continuously display for marking caption information continuously display is equally provided in receiving terminal
Duration subtitle keeping count position.Receiving terminal obtains the counting value of subtitle keeping count position, judges the subtitle keeping count
Whether the counting value of position is 0.If the counting value of subtitle keeping count position is 0, show continuously display there is currently no needing
Caption information.Whether receiving terminal is judged in the current video frame comprising caption information afterwards.Specifically, receiving terminal parsing is current
Video frame orients SEI from current video frame.It checks whether comprising caption information in the SEI of current video frame, if comprising,
The caption information is then obtained from current video frame, the caption information is shown while playing current video frame.If not including,
Show, there is no the corresponding caption information of current video frame, directly to play the current video frame.
The embodiment of the present invention obtains the caption information from current video frame in the following way, specifically includes：Parsing is worked as
Preceding video frame, orients SEI from current video frame；The corresponding caption information of current video frame is extracted from SEI.
In the embodiment of the present invention, the corresponding caption information of video frame is inserted into the SEI of video frame by transmitting terminal, so that
The corresponding caption information of video frame can reach receiving terminal simultaneously with video frame, realize subtitle with regarding when receiving terminal plays video
The synchronization of frequency picture avoids subtitle and video pictures is unmatched happens.
Transmitting terminal is transmitted across when sending the current video frame of insertion caption information in order to reduce in above-described embodiment 1
Because packet loss causes the situation of caption information loss in journey, transmitting terminal enables packet loss re-transmission policy, i.e., insertion caption information is worked as
Preceding video frame enables the transmission based on reliable UDP agreement, such as the current video of insertion caption information is transmitted by KCP agreements
Frame.When transmitting terminal transmits current video frame to receiving terminal by KCP agreements, also the unique mark of current video frame is transferred to
Receiving terminal.After receiving terminal receives the current video frame and unique mark, which is returned into transmitting terminal, so as to send
Termination confirms that the current video frame is sent successfully when receiving the unique mark, so as to continue the processing of subsequent video frame.If
Packet drop has occurred in the transmission of current video frame, then receiving terminal does not receive current video frame and its unique mark, so sends out
Sending end does not receive the unique mark of receiving terminal return after a certain time, then confirms the current video frame packet loss, and transmitting terminal will
The current video frame can be transmitted again, until confirming that the current video frame is successfully sent to receiving terminal.
Subtitle keeping count position be 0, and in current video frame include caption information when, receiving terminal is from current video frame
After extracting the corresponding caption information of current video frame, also need to judge whether the corresponding caption information of current video frame needs to continue
Display.Whether caption information needs continuously display to continue frame number or subtitle duration with subtitle to identify.When from current video
When the caption information obtained in frame continues frame number including subtitle file and subtitle, the subtitle that receiving terminal judges caption information and includes is held
Whether continuous frame number is more than 1, if subtitle continues frame number more than 1, it is continuously display to show that the caption information needs, receiving terminal caching should
Caption information, and the counting value of subtitle keeping count position is added one.If subtitle continues frame number equal to 1, show that the subtitle is believed
Breath is without continuously display.
When the caption information obtained from current video frame includes subtitle file and subtitle duration, receiving terminal judges
Whether the subtitle duration that caption information includes is more than the corresponding display duration of current video frame, if subtitle duration is more than
It is continuously display then to show that the caption information needs for the corresponding display duration of current video frame, and receiving terminal caches the caption information, and
The counting value of subtitle keeping count position is increased into the corresponding display duration of current video frame.If subtitle duration is equal to current
The corresponding display duration of video frame then shows the caption information without continuously display.
Step 203：If the counting value of subtitle keeping count position is more than 0, the caption information of current cache is obtained, is played
Current video frame, and the caption information of current cache is shown simultaneously.
If the counting value for the subtitle keeping count position that step 202 obtains is more than 0, confirm continuously display there is currently needing
Caption information, and receiving terminal obtains from the video frame before current video frame and has cached the caption information.It therefore can
To determine in current video frame and not comprising caption information.Receiving terminal directly obtains caption information from caching, and works as playing
The caption information of current cache is shown while preceding video frame.
Above-mentioned broadcasting current video frame, and after showing the caption information of current cache simultaneously, receiving terminal is also needed to word
The counting value of curtain keeping count position is modified.Specific to take, receiving terminal obtains the caption information of current cache, if the subtitle is believed
Breath includes subtitle file and subtitle continues frame number, then the counting value of subtitle keeping count position is added one.Then judge plus one grasps
The subtitle that whether the counting value after work, which is equal to caption information, includes continues frame number, if it is, showing the caption information
The counting value of subtitle keeping count position is reset to 0, and deletes the caption information of caching by continuously display cut-off.If it is not, then
Show that the continuously display of the caption information is not yet terminated.
If the caption information of current cache storage includes subtitle file and subtitle duration, by subtitle keeping count position
Counting value increases the corresponding display duration of current video frame, then judges to increase whether the counting value after operating is equal to subtitle
The subtitle duration that information includes if it is, showing the continuously display cut-off of the caption information, will count value and reset
For 0, and delete the caption information of caching.If it is not, then show that the continuously display of the caption information is not yet terminated.
For the ease of understanding the core synchronization policy of captioning synchronization scheme provided in an embodiment of the present invention, below in conjunction with the accompanying drawings
It is specifically described.As shown in figure 4, A1：Analyze the current video frame of transmitting terminal transmission.A2：Judge whether current video frame wraps
Containing SEI, if so, step A3 is performed, if not, performing step A5.A3：Whether judge in the SEI of current video frame comprising word
Curtain information, if so, step A4 is performed, if not, performing step A5.A4：Caption information is attached to and decoded works as forward sight
On frequency frame.A5：Show current video frame.
For each video frame that transmitting terminal transmits, all identical with current video frame, receiving terminal is according to the present invention
The method that embodiment provides realizes captioning synchronization.
In embodiments of the present invention, transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame so that word
Curtain information becomes a part for video requency frame data, will be inserted into the video frame transmission of caption information to receiving terminal.Receiving terminal receives
After being inserted into the video frame of caption information, its corresponding caption information is shown while video frame is played.The present invention is regarded in transmission
The video frame that during frequency caption information can be made corresponding reaches receiving terminal simultaneously.Receiving terminal play video when realize subtitle with
The synchronization of video pictures, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
Embodiment 3
Referring to Fig. 5, an embodiment of the present invention provides a kind of captioning synchronization device, which is used to perform above-described embodiment 1
The captioning synchronization method provided, the device include：
Acquisition module 30, for obtaining current video frame and subtitle keeping count position；
Module 31 is inserted into, the counting value for working as the subtitle keeping count position of the acquisition of acquisition module 30 is 0, and exists and work as
During the corresponding caption information of preceding video frame, the corresponding caption information of current video frame is obtained, caption information is inserted into current video
In frame；
Transport module 32, for the current video frame after insertion operation to be transferred to receiving terminal；It is additionally operable to work as acquisition module
When the counting value of the subtitle keeping count position of acquisition is more than 0, current video frame is directly transferred to receiving terminal.
Above-mentioned insertion module 31 for parsing current video frame, orients supplemental enhancement information list from current video frame
First SEI；Caption information is inserted into SEI.
In embodiments of the present invention.The device further includes：For changing the modified module of subtitle keeping count position；
When caption information includes subtitle file and subtitle continues frame number, if subtitle continues frame number more than 1, mould is changed
Block continues frame number for caching subtitle, and the counting value of subtitle keeping count position is added one；Alternatively,
When caption information includes subtitle file and subtitle duration, if subtitle duration is more than current video frame pair
The display duration answered, then modified module, for caching subtitle duration, and the counting value of subtitle keeping count position is increased
The corresponding display duration of current video frame.
After current video frame directly is transferred to receiving terminal, which, which further includes, resets module, current for obtaining
The caption information of caching；If caption information continues frame number including subtitle, the counting value of subtitle keeping count position is added one；If
Counting value continues frame number equal to the subtitle that caption information includes after adding an operation, then will count value and be reset to 0, and delete
The caption information of caching；If caption information includes subtitle duration, the counting value of subtitle keeping count position is increased and is worked as
The corresponding display duration of preceding video frame；If value is counted after increasing operation is equal to the subtitle duration that caption information includes,
Value will then be counted and be reset to 0, and delete the caption information of caching.
In embodiments of the present invention, transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame so that word
Curtain information becomes a part for video requency frame data, will be inserted into the video frame transmission of caption information to receiving terminal.Receiving terminal receives
After being inserted into the video frame of caption information, its corresponding caption information is shown while video frame is played.The present invention is regarded in transmission
The video frame that during frequency caption information can be made corresponding reaches receiving terminal simultaneously.Receiving terminal play video when realize subtitle with
The synchronization of video pictures, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
Embodiment 4
Referring to Fig. 6, an embodiment of the present invention provides a kind of captioning synchronization device, which is used to perform above-described embodiment 2
The captioning synchronization method provided, the device include：
Receiving module 40, for receiving the current video frame of transmitting terminal transmission；
Extraction module 41, for obtaining the counting value of subtitle keeping count position, if it is 0 to count value, it is determined that current
Whether comprising caption information in video frame, if it is, extracting the corresponding caption information of current video frame from current video frame；
Playing module 42, for when count value be 0, and in current video frame include caption information when, broadcasting work as forward sight
Frequency frame, and caption information is shown simultaneously；And for when count value be 0, and in current video frame do not include caption information when,
Directly play current video frame；And if be more than 0 for the counting value of subtitle keeping count position, obtain the word of current cache
Curtain information, plays current video frame, and shows the caption information of current cache simultaneously.
Said extracted module 41 for parsing current video frame, orients SEI from current video frame；It is extracted from SEI
Go out the corresponding caption information of current video frame.
After the corresponding caption information of current video frame is extracted from current video frame, which further includes to change word
The modified module of curtain persistence techniques position.
When caption information includes subtitle file and subtitle continues frame number, if subtitle continues frame number more than 1, mould is changed
The counting value of subtitle keeping count position for caching caption information, and is added one by block；
When caption information includes subtitle file and subtitle duration, if subtitle duration is more than current video frame pair
The display duration answered, then modified module, for caching caption information, and the counting value of subtitle keeping count position is increased currently
The corresponding display duration of video frame.
The device, which further includes, resets module, play current video frame, and show simultaneously current cache caption information it
Afterwards, if caption information continues frame number including subtitle, module is reseted, for the counting value of subtitle keeping count position to be added one；
If plus counting value continues frame number equal to the subtitle that the caption information of current cache includes after an operation, will count value and resets
For 0, and delete the caption information of caching；
If caption information includes subtitle duration, module is reseted, for by the counting value of subtitle keeping count position
Increase the corresponding display duration of current video frame；If count what value included equal to the caption information of current cache after increasing operation
Subtitle duration will then count value and be reset to 0, and deletes the caption information of caching.
In embodiments of the present invention, transmitting terminal will be in the SEI of the corresponding caption information insertion video frame of video frame so that word
Curtain information becomes a part for video requency frame data, will be inserted into the video frame transmission of caption information to receiving terminal.Receiving terminal receives
After being inserted into the video frame of caption information, its corresponding caption information is shown while video frame is played.The present invention is regarded in transmission
The video frame that during frequency caption information can be made corresponding reaches receiving terminal simultaneously.Receiving terminal play video when realize subtitle with
The synchronization of video pictures, subtitle missing or subtitle and picture unmatched problem when avoiding video playing.
Embodiment 5
An embodiment of the present invention provides a kind of nonvolatile computer storage media, which is stored with meter
Calculation machine executable instruction, the computer executable instructions can perform the captioning synchronization method in above-described embodiment 1, it is specific perform with
Lower method：Obtain current video frame and subtitle keeping count position；If the counting value of subtitle keeping count position is 0, and exists and work as
The corresponding caption information of preceding video frame, then obtain the corresponding caption information of current video frame, caption information be inserted into current video
In frame, the current video frame after insertion operation is transferred to receiving terminal；If the counting value of subtitle keeping count position is more than 0,
Current video frame is directly transferred to receiving terminal.
After the computer executable instructions of computer storage media storage perform, the corresponding caption information of video frame is inserted
In the SEI for entering video frame so that when transmitting video, caption information can corresponding video frame reach receiving terminal simultaneously.
It realizes that subtitle is synchronous with video pictures when receiving terminal plays video, avoids subtitle and video pictures are unmatched happens.
Embodiment 6
As shown in fig. 7, an embodiment of the present invention provides a kind of captioning synchronization device, which includes：Place
Device 61, memory 62 and bus 63 are managed, memory 62, which is stored with, to be executed instruction, when the apparatus is operative, processor 61 and storage
It is communicated between device 62 by bus 63, what is stored in the execution memory 62 of processor 61 executes instruction as follows：Obtain current video
Frame and subtitle keeping count position；If the counting value of subtitle keeping count position is 0, and there are the corresponding subtitle letters of current video frame
Breath, then obtain the corresponding caption information of current video frame, and caption information is inserted into current video frame, by working as after insertion operation
Preceding video frame is transferred to receiving terminal；If the counting value of subtitle keeping count position is more than 0, directly current video frame is transferred to
Receiving terminal.
The captioning synchronization device performs above-metioned instruction by processor 61, and the corresponding caption information of video frame is inserted into video
In the SEI of frame so that when transmitting video, caption information can corresponding video frame reach receiving terminal simultaneously.It is receiving
End realizes that subtitle is synchronous with video pictures when playing video, avoids subtitle and video pictures are unmatched happens.
Embodiment 7
An embodiment of the present invention provides a kind of nonvolatile computer storage media, which is stored with meter
Calculation machine executable instruction, the computer executable instructions can perform the captioning synchronization method in above-described embodiment 2, it is specific perform with
Lower method：Receive the current video frame of transmitting terminal transmission；The counting value of subtitle keeping count position is obtained, if it is 0 to count value,
It then determines whether comprising caption information in current video frame, is corresponded to if it is, extracting current video frame from current video frame
Caption information, play current video frame, and show caption information simultaneously；If it is not, then directly play current video frame；If meter
Number value is more than 0, then obtains the caption information of current cache, plays current video frame, and shows the subtitle of current cache simultaneously
Information.
The corresponding caption information of video frame is inserted into the SEI of video frame by transmitting terminal, and by video frame transmission to receiving terminal.
After the computer executable instructions of computer storage media storage perform, receiving terminal receives the video of insertion caption information
Frame, and show caption information while video frame is played.The corresponding video frame of caption information reaches receiving terminal simultaneously.
Receiving terminal realizes that subtitle is synchronous with video pictures when playing video, avoids subtitle and video pictures are unmatched happens.
Embodiment 8
As shown in figure 8, an embodiment of the present invention provides a kind of captioning synchronization device, which includes：Place
Device 81, memory 82 and bus 83 are managed, memory 82, which is stored with, to be executed instruction, when the apparatus is operative, processor 81 and storage
It is communicated between device 82 by bus 83, what is stored in the execution memory 82 of processor 81 executes instruction as follows：Transmitting terminal is received to pass
Defeated current video frame；The counting value of subtitle keeping count position is obtained, if it is 0 to count value, it is determined that in current video frame
Whether comprising caption information, if it is, extracting the corresponding caption information of current video frame from current video frame, play current
Video frame, and caption information is shown simultaneously；If it is not, then directly play current video frame；If counting value is more than 0, obtain
The caption information of current cache plays current video frame, and shows the caption information of current cache simultaneously.
The captioning synchronization device performs above-metioned instruction by processor 81, and transmitting terminal inserts the corresponding caption information of video frame
In the SEI for entering video frame, and by video frame transmission to receiving terminal.Receiving terminal receive insertion caption information video frame, and
Caption information is shown while playing video frame.The corresponding video frame of caption information reaches receiving terminal simultaneously.In receiving terminal
It realizes that subtitle is synchronous with video pictures when playing video, avoids subtitle and video pictures are unmatched happens.
The captioning synchronization device that the embodiment of the present invention is provided can be equipment on specific hardware or be installed on equipment
On software or firmware etc..The technique effect of the device that the embodiment of the present invention is provided, realization principle and generation and foregoing side
Method embodiment is identical, and to briefly describe, device embodiment part does not refer to part, can refer in corresponding in preceding method embodiment
Hold.It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, device
With the specific work process of unit, the corresponding process in above method embodiment is may be referred to, details are not described herein.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, it can be by others side
Formula is realized.The apparatus embodiments described above are merely exemplary, for example, the division of the unit, is only that one kind is patrolled
The division of volume function, can there is other dividing mode in actual implementation, in another example, multiple units or component can combine or can
To be integrated into another system or some features can be ignored or does not perform.Another, shown or discussed is mutual
Coupling, direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some communication interfaces, device or unit
It connects, can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit
The component shown may or may not be physical location, you can be located at a place or can also be distributed to multiple
In network element.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in embodiment provided by the invention can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units integrate in a unit.
If the function is realized in the form of SFU software functional unit and is independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contribute to the prior art or the part of the technical solution can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, is used including some instructions so that a computer equipment (can be
People's computer, server or network equipment etc.) perform all or part of the steps of the method according to each embodiment of the present invention.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
It should be noted that：Similar label and letter represents similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent attached drawing in a attached drawing, in addition, term " the
One ", " second ", " the 3rd " etc. are only used for distinguishing description, and it is not intended that instruction or hint relative importance.
Finally it should be noted that：Embodiment described above is only the specific embodiment of the present invention, to illustrate the present invention
Technical solution, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those of ordinary skill in the art that：Any one skilled in the art
In the technical scope disclosed by the present invention, can still modify to the technical solution recorded in previous embodiment or can be light
It is readily conceivable that variation or equivalent substitution is carried out to which part technical characteristic；And these modifications, variation or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical solution of the embodiment of the present invention.The protection in the present invention should all be covered
Within the scope of.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
- A kind of 1. captioning synchronization method, which is characterized in that the described method includes：Obtain current video frame and subtitle keeping count position；If the counting value of the subtitle keeping count position is 0, and there are the corresponding caption information of the current video frame, is then obtained The corresponding caption information of the current video frame is taken, the caption information is inserted into the current video frame, by insertion operation The current video frame afterwards is transferred to receiving terminal；If the counting value of the subtitle keeping count position is more than 0, the current video frame is directly transferred to receiving terminal.
- 2. according to the method described in claim 1, it is characterized in that, described be inserted into the current video frame by the caption information In, including：The current video frame is parsed, supplemental enhancement information cell S EI is oriented from the current video frame；The caption information is inserted into the SEI.
- 3. according to the method described in claim 1, it is characterized in that, described be inserted into the current video frame by the caption information In after, further include：The caption information includes subtitle file and subtitle continues frame number；If the subtitle continues frame number more than 1, described in caching Subtitle continues frame number, and the counting value of the subtitle keeping count position is added one；Alternatively,The caption information includes subtitle file and subtitle duration；If the subtitle duration is more than the current video The corresponding display duration of frame then caches the subtitle duration, and the counting value of the subtitle keeping count position is increased The corresponding display duration of the current video frame.
- 4. according to the method described in claim 1, it is characterized in that, described be directly transferred to receiving terminal by the current video frame Afterwards, further include：Obtain the caption information of current cache；If the caption information continues frame number including subtitle, the counting value of the subtitle keeping count position is added one；If plus The value that counts continues frame number equal to the subtitle that the caption information includes after one operation, then resets the counting value For 0, and delete the caption information of caching；If the caption information includes subtitle duration, the counting value of the subtitle keeping count position is increased into described work as The corresponding display duration of preceding video frame；If the value that counts is equal to the word that the caption information includes after increasing operation The counting value is then reset to 0, and deletes the caption information of caching by curtain duration.
- A kind of 5. captioning synchronization method, which is characterized in that the described method includes：Receive the current video frame of transmitting terminal transmission；The counting value of subtitle keeping count position is obtained, if the counting value is 0, it is determined that in the current video frame whether Comprising caption information, if it is, extracting the corresponding caption information of the current video frame from the current video frame, play The current video frame, and the caption information is shown simultaneously；If it is not, then directly play the current video frame；If the counting value is more than 0, the caption information of current cache is obtained, the current video frame is played, and shows simultaneously Show the caption information of current cache.
- 6. according to the method described in claim 5, it is characterized in that, described work as forward sight from the current video frame described in extraction The corresponding caption information of frequency frame, including；The current video frame is parsed, SEI is oriented from the current video frame；The corresponding caption information of the current video frame is extracted from the SEI.
- 7. according to the method described in claim 5, it is characterized in that, described work as forward sight from the current video frame described in extraction After the corresponding caption information of frequency frame, further include：The caption information includes subtitle file and subtitle continues frame number；If the subtitle continues frame number more than 1, described in caching Caption information, and the counting value of the subtitle keeping count position is added one；The caption information includes subtitle file and subtitle duration；If the subtitle duration is more than the current video The corresponding display duration of frame then caches the caption information, and will be described in the counting value increase of the subtitle keeping count position The corresponding display duration of current video frame.
- 8. according to the method described in claim 5, it is characterized in that, described play the current video frame, and display is worked as simultaneously After the caption information of preceding caching, further include：If the caption information continues frame number including subtitle, the counting value of the subtitle keeping count position is added one；If plus The value that counts continues frame number equal to the subtitle that the caption information of current cache includes after one operation, then by the counting value 0 is reset to, and deletes the caption information of caching；If the caption information includes subtitle duration, the counting value of the subtitle keeping count position is increased into described work as The corresponding display duration of preceding video frame；If the value that counts is equal to the word that the caption information of current cache includes after increasing operation The counting value is then reset to 0, and deletes the caption information of caching by curtain duration.
- 9. a kind of captioning synchronization device, which is characterized in that described device includes：Acquisition module, for obtaining current video frame and subtitle keeping count position；Module is inserted into, is 0 for working as the counting value for the subtitle keeping count position that the acquisition module obtains, and there are institutes When stating the corresponding caption information of current video frame, the corresponding caption information of the current video frame is obtained, by the caption information It is inserted into the current video frame；Transport module, for the current video frame after insertion operation to be transferred to receiving terminal；It is additionally operable to when the acquisition mould When the counting value for the subtitle keeping count position that block obtains is more than 0, the current video frame is directly transferred to receiving terminal.
- 10. a kind of captioning synchronization device, which is characterized in that described device includes：Receiving module, for receiving the current video frame of transmitting terminal transmission；Extraction module, for obtaining the counting value of subtitle keeping count position, if the counting value is 0, it is determined that described to work as Whether comprising caption information in preceding video frame, corresponded to if it is, extracting the current video frame from the current video frame Caption information；Playing module is 0 for working as the counting value, and when caption information is included in the current video frame, described in broadcasting Current video frame, and the caption information is shown simultaneously；And for working as the counting value be 0, and the current video frame In do not include caption information when, directly play the current video frame；If the and counting for the subtitle keeping count position Value is more than 0, then obtains the caption information of current cache, play the current video frame, and show the institute of current cache simultaneously State caption information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810040905.XA CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810040905.XA CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108111896A true CN108111896A (en) | 2018-06-01 |
| CN108111896B CN108111896B (en) | 2020-05-05 |
Family
ID=62220179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810040905.XA Active CN108111896B (en) | 2018-01-16 | 2018-01-16 | Subtitle synchronization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108111896B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112887781A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Subtitle processing method and device |
| CN113382291A (en) * | 2020-03-09 | 2021-09-10 | 海信视像科技股份有限公司 | Display device and streaming media playing method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160212399A1 (en) * | 2013-08-20 | 2016-07-21 | Sony Corporation | Reproduction device, reproduction method, and recording medium |
| CN105959772A (en) * | 2015-12-22 | 2016-09-21 | 合网络技术（北京）有限公司 | Streaming media and caption instant synchronization display and matching processing method, device and system |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
| US20170188084A1 (en) * | 2015-12-28 | 2017-06-29 | International Business Machines Corporation | Automatic synchronization of subtitles based on audio fingerprinting |
| CN107005733A (en) * | 2014-12-19 | 2017-08-01 | 索尼公司 | Dispensing device, sending method, reception device and method of reseptance |
| CN107211170A (en) * | 2015-02-20 | 2017-09-26 | 索尼公司 | Transmitting device, transmission method, reception device and method of reseptance |
| CN107431835A (en) * | 2015-04-13 | 2017-12-01 | 索尼公司 | Dispensing device, sending method, transcriber and reproducting method |
-
2018
- 2018-01-16 CN CN201810040905.XA patent/CN108111896B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160212399A1 (en) * | 2013-08-20 | 2016-07-21 | Sony Corporation | Reproduction device, reproduction method, and recording medium |
| CN107005733A (en) * | 2014-12-19 | 2017-08-01 | 索尼公司 | Dispensing device, sending method, reception device and method of reseptance |
| CN107211170A (en) * | 2015-02-20 | 2017-09-26 | 索尼公司 | Transmitting device, transmission method, reception device and method of reseptance |
| CN107431835A (en) * | 2015-04-13 | 2017-12-01 | 索尼公司 | Dispensing device, sending method, transcriber and reproducting method |
| CN105959772A (en) * | 2015-12-22 | 2016-09-21 | 合网络技术（北京）有限公司 | Streaming media and caption instant synchronization display and matching processing method, device and system |
| US20170188084A1 (en) * | 2015-12-28 | 2017-06-29 | International Business Machines Corporation | Automatic synchronization of subtitles based on audio fingerprinting |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113382291A (en) * | 2020-03-09 | 2021-09-10 | 海信视像科技股份有限公司 | Display device and streaming media playing method |
| CN112887781A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Subtitle processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108111896B (en) | 2020-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105227963B (en) | Streaming Media collection automatic identification direction and the method and system adjusted are carried out to terminal | |
| CN104125429B (en) | The adjusting method and device of video data transmission | |
| EP3086561A1 (en) | Information pushing method, device, and system | |
| CN106162235A (en) | Method and apparatus for Switch Video stream | |
| CN106576097A (en) | Error handling for files exchanged over a network | |
| CN109640113A (en) | A kind of processing method and proxy server of dilatory video data | |
| US10701461B2 (en) | Video Processing Method, Terminal and Server | |
| CN102857730A (en) | Method and system for caching frame data | |
| CN106791997B (en) | Method and system for processing streaming media data at receiving end and television terminal | |
| US20200304391A1 (en) | Network Performance Detection Method and Related Apparatus | |
| CN108111896A (en) | A kind of captioning synchronization method and device | |
| CN114979023A (en) | Data transmission method, system, electronic equipment and storage medium | |
| CN113259779B (en) | Video processing method, device, equipment and storage medium | |
| CN108989907A (en) | Live data streams processing method and system, electronic device and computer readable storage medium | |
| CN115442572A (en) | Data transmission method and device | |
| CN108810575B (en) | Method and device for sending target video | |
| CN108881119A (en) | A kind of methods, devices and systems of video concentration | |
| CN108024222A (en) | Flow list generating method and device | |
| CN106686466B (en) | Video data positioning method | |
| CN110267062A (en) | Optimization method, device, readable storage medium storing program for executing and the system of assembled video frame | |
| CN101448136A (en) | Method for realizing video on-demand function and system thereof | |
| CN105263062B (en) | A kind of live broadcasting method and device | |
| CN104219538B (en) | A kind of audio frequency and video gather upload and data processing method and system in real time | |
| CN113973215A (en) | Data deduplication method and device and storage medium | |
| WO2016078212A1 (en) | Packet processing method and device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210302 Address after: Room 1702-03, Lantian Hesheng building, 32 Zhongguancun Street, Haidian District, Beijing 100082 Patentee after: BEIJING CENTURY TAL EDUCATION TECHNOLOGY Co.,Ltd. Address before: 102200 a1-05-001 maker Plaza, 338 Huilongguan East Street, Changping District, Beijing Patentee before: BEIJING SANTICLOUD TECHNOLOGY Co.,Ltd. |