CN108882010A - A kind of method and system that multi-screen plays - Google Patents
A kind of method and system that multi-screen plays Download PDFInfo
- Publication number
- CN108882010A CN108882010A CN201810694586.4A CN201810694586A CN108882010A CN 108882010 A CN108882010 A CN 108882010A CN 201810694586 A CN201810694586 A CN 201810694586A CN 108882010 A CN108882010 A CN 108882010A
- Authority
- CN
- China
- Prior art keywords
- data
- terminal device
- coding
- multiplex data
- multiplex
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present embodiments relate to set-top box technique fields, disclose a kind of method and system that multi-screen plays, wherein the method includes：The interaction playing request that receiving terminal apparatus is sent；It according to the interaction playing request, is demultiplexed to the program data received, after obtaining audio data and video data, adjusts the System Clock Reference and display time of both the audio data and video data；The audio data adjusted and video data are multiplexed, multiplex data is obtained；According to pre-arranged code algorithm, the multiplex data is encoded, and the multiplex data after coding is sent to terminal device；So that the terminal device is decoded broadcasting to the multiplex data after the coding, by being encoded to multiplex data, the multiplex data after coding is sent to terminal device and is played out, avoids the occurrence of codec format mismatch, the generation of the phenomenon that decoding delay occur.
Description
Technical field
The present embodiments relate to the method and system that set-top box technique field more particularly to a kind of multi-screen play.
Background technique
Multi-screen interactive be it is a kind of by DLNA agreement by the mobile devices such as mobile phone, tablet computer multimedia (audio, depending on
Frequently, picture) content projects the new technology on TV.Multi-screen interactive software just can be achieved on mobile phone, tablet computer, TV it
Between multi-screen interactive software.Smart television or set-top box based on android system are most of all to support multi-screen interactive, supports
Multiple and different systems.
In current set-top box functionality development process and application scenarios, there are the application scenarios of some multi-screen interactives, i.e., will
Mirror screen (OSD layers and video layer) data in STB, live data are passed through at the terminal by playing in network share to terminal
Gesture or the mode of sensor manipulate set-top box.But manipulation is completed by terminal, since network or decoding are nonsynchronous
Reason leads to mobile phone and video screen, or two screen-pictures are asynchronous when live streaming, and delay is serious, influences user's body
It tests.
The present inventor in the implementation of the present invention, has found：In the related art, since set-top box obtains number
When according to slow and terminal device decoding data, codec format is mismatched, and the phenomenon that decoding delay occurs.
Summary of the invention
The present application embodiment provides a kind of method and system that multi-screen plays, it is possible to prevente effectively from due to terminal device
When decoding data, there is the phenomenon that decoding delay.
The embodiment of the invention discloses following technical solutions：
In a first aspect, the embodiment of the invention provides a kind of method that multi-screen plays, the method includes：Terminal is received to set
The interaction playing request that preparation is sent；According to the interaction playing request, demultiplexes, obtain to the program data received
After audio data and video data, when adjusting the System Clock Reference and display of both the audio data and video data
Between；The audio data adjusted and video data are multiplexed, multiplex data is obtained；It is right according to pre-arranged code algorithm
The multiplex data coding, and the multiplex data after coding is sent to terminal device；Make the terminal device to the volume
Multiplex data after code is decoded broadcasting.
Preferably, the step of data by after coding are sent to terminal device include：Obtain the terminal device
Mailing address；Multiplexing number by the udp protocol, and in conjunction with the mailing address of the terminal device, after broadcast code
According to.
Preferably, the multiplex data after the coding supports single frames decoding；The pre-arranged code algorithm H264 encryption algorithm
Or AAC encryption algorithm.
Preferably, it is described make the terminal device to the multiplex data after the coding be decoded including：Described in acquisition
The hardware configuration of terminal device；Judge whether the hardware configuration meets default hard decoder condition；If satisfied, then calling the end
The hardware resource of end equipment executes hard decoder to the multiplex data stated after encoding；If not satisfied, then being calculated according to default decoding
Method executes soft decoding to the multiplex data stated after encoding, and the default decoding algorithm is opposite with the pre-arranged code algorithm
It answers.
Preferably, the method also includes：Multiplex data after coding is cached in the slow of the spatial cache of terminal device
It deposits in queue；It is described to make the terminal device be decoded broadcasting to the multiplex data after the coding to further include：According to advanced
First go out sequence, the multiplex data after extracting the coding in the buffer queue, and by answering after the coding extracted
Broadcasting is decoded with data.
Second aspect, the embodiment of the invention provides a kind of multi-screen play systems, including display device, set-top box and terminal
Equipment, the set-top box are used for：The interaction playing request that receiving terminal apparatus is sent, according to the interaction playing request, right
The program data received is demultiplexed, after obtaining audio data and video data, to described in display device push
Sound regards data and video data, and when the System Clock Reference for both adjusting the audio data and video data and display
Between, the audio data adjusted and video data are multiplexed, multiplex data is obtained, and, it is calculated according to pre-arranged code
Method encodes the multiplex data, and the multiplex data after coding is sent to terminal device, and the terminal device is used for
Broadcasting is decoded to the multiplex data after the coding.
Preferably, the set-top box is also used to execute the step of data by after coding are sent to terminal device, packet
It includes：Obtain the mailing address of the terminal device；By the udp protocol, and in conjunction with the mailing address of the terminal device,
Multiplex data after broadcast code.
Preferably, the multiplex data after the coding supports single frames decoding；The pre-arranged code algorithm is that H264 coding is calculated
Method or AAC encryption algorithm.
Preferably, the set-top box be also used to execute it is described make the terminal device to the multiplex data after the coding into
Row decoding, specifically includes：Obtain the hardware configuration of the terminal device；Judge whether the hardware configuration meets default hard decoder
Condition；If satisfied, then calling the hardware resource of the terminal device, hard decoder is executed to the multiplex data stated after encoding；
If not satisfied, executing soft decoding to the multiplex data stated after encoding, the default decoding is calculated then according to decoding algorithm is preset
Method is corresponding with the pre-arranged code algorithm.
Preferably, the set-top box is also used to execute：Multiplex data after the terminal device receives the coding
When, the multiplex data after coding is cached in the buffer queue of the spatial cache of terminal device；It is described to make the terminal device
Being decoded broadcasting to the multiplex data after the coding further includes：According to first in first out sequence, mentioned from the buffer queue
Multiplex data after taking the coding, and the multiplex data after the coding extracted is decoded broadcasting.
The third aspect, the embodiment of the invention provides a kind of electronic equipment, including：At least one processor；And with institute
State the memory of at least one processor communication connection；Wherein, be stored with can be by least one described processor for the memory
The instruction of execution, described instruction are executed by least one described processor, so that at least one described processor is able to carry out
The method stated.
Fourth aspect, the embodiment of the invention provides a kind of computer program product, the computer program product includes
The computer program being stored on non-volatile computer readable storage medium storing program for executing, the computer program include program instruction, when
When described program instruction is computer-executed, the computer is made to execute the method that multi-screen as described above plays.
5th aspect, the embodiment of the invention also provides a kind of non-volatile computer readable storage medium storing program for executing, the calculating
Machine readable storage medium storing program for executing is stored with computer executable instructions, and the computer executable instructions are as above for executing computer
The method that the multi-screen plays.
In embodiments of the present invention, when the interaction playing request that set-top box receiving terminal apparatus is sent, and according to described
Playing request is interacted, is demultiplexed to the program data received, after obtaining audio data and video data, adjusts institute
State System Clock Reference and the display time of both audio data and video data；Then be multiplexed audio data adjusted and
Video data obtains multiplex data, according to pre-arranged code algorithm, encodes to the multiplex data, and by the multiplexing after coding
Data are sent to terminal device；It after being decoded the terminal device to the multiplex data after the coding and plays, passes through
System Clock Reference and the display time for adjusting audio data and video data, keep audio data synchronous with video data holding,
And pre-arranged code is carried out to data adjusted are multiplexed, it is unmatched existing codec format occur when avoiding the occurrence of terminal device decoding
As occurring, occurs the technical issues of time delay in decoding process to solve, realize that multi-screen synchronous plays, increase user experience.
Detailed description of the invention
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element in attached drawing with same reference numbers label are expressed as similar element, remove
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 is the structural schematic diagram of multi-screen play system in the embodiment of the present invention；
Fig. 2 is the flow diagram for the method that a kind of present invention multi-screen that wherein an embodiment provides plays；
Fig. 3 is the flow diagram of method and step 40 in Fig. 2；
Fig. 4 is the flow diagram of method and step 50 in Fig. 2；
Fig. 5 is the flow diagram for the method that another multi-screen provided in an embodiment of the present invention plays；
Fig. 6 is the hardware structural diagram of a kind of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention is described, and shows
So, described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on the implementation in the present invention
Example, every other embodiment obtained by those of ordinary skill in the art without making creative efforts belong to
The scope of protection of the invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not
Constituting conflict can be combined with each other.
Multi-screen playback method of the invention and multi-screen play system mainly set-top box, user terminal and display device it
Between interacted, by between set-top box, terminal device and display device establish communication connection to realize set-top box, terminal device
Mutually send data and playing request between display device, realize between set-top box, terminal device and display device synchronize broadcast
It puts, multi-screen playback method and multi-screen play system of the invention is exemplified below.
Referring to Fig. 1, Fig. 1 is the structural schematic diagram of multi-screen play system in the embodiment of the present invention.
Multi-screen play system includes：Set-top box 100, terminal device 200 and display device 300, terminal device 200 and display
Device 300 is connect with set top box communication simultaneously, and terminal device 200 is by sending interaction playing request to set-top box 100, wherein
Terminal device 200 can be mobile phone, tablet computer etc., and set-top box 100 is sent according to terminal device 200 and display device 300
The corresponding audio data of request and video data are interacted, and the audio data and video data information are pushed into terminal and set
Standby 200 and display device 300, terminal device 200 and display device 300 receives above-mentioned audio data and video data information is gone forward side by side
Row plays, and above-mentioned display device 300 can be TV, computer etc..
The embodiment of the invention also provides a kind of methods that multi-screen plays, and are applied to above-mentioned multi-screen play system, please refer to
Fig. 2, Fig. 2 are the flow diagram for the method that a kind of multi-screen provided in an embodiment of the present invention plays, the method packet which plays
Include following steps：
S10：The interaction playing request that receiving terminal apparatus is sent；
Above-mentioned playing request includes the instruction information of the content that request plays and terminal device, the content that above-mentioned request plays
Including audio data and video data, above-mentioned instruction information is used to indicate out the recipient for requesting the content played, i.e. set-top box,
The instruction information of set-top box can be the identity information of set-top box, such as：ID network address etc. is set.
S20：According to the interaction playing request, is demultiplexed to the program data received, obtain audio data
After video data, the System Clock Reference and display time of both the audio data and video data are adjusted；
Above-mentioned to demultiplex to the program data received, i.e. program data includes audio data and video data,
By demultiplex by program data audio data and video data separate, obtain independent audio data and video data,
Wherein, demultiplexing has the characteristics that high-throughput, high-speed and low transmission delay, and the network of high cost can support user's
The requirement of low transmission cost.
After set-top box obtains audio data and video data, when due to transmitting audio data and video data simultaneously, due to
Network speed is different with passed size of data, causes set-top box to receive the time irreversibility of audio data and video data, there is delay
Phenomenon is easy the presence of delay phenomenon, makes if the audio data and video data are sent to display device plays by set-top box
Nonsynchronous phenomenon is played at audio data and video data, the good experience of client is influenced, therefore, is being transmitted to display equipment
Need to adjust the System Clock Reference and display time of both the audio data and video data when broadcasting.
Above system reference clock is the standard time of system reference, and if it is in China, then System Clock Reference is north
The capital time, if it is in the U.S., then system reference time is the New York time；Above system shows that the time can be Beijing time eight
Eight o'clock sharp of o'clock sharp or New York time, such as：The time that system receives audio data is Beijing time 7: 50, receives view
The time of frequency evidence is Beijing time 7 52, then adjusts system reference time and the display time is 8 points of Beijing time
It is whole, realize being played simultaneously for audio data and video data.
It is understood that in some embodiments, if receiving the time consistency of audio data and video data, no
Need to adjust the System Clock Reference and display time of both the audio data and video data.
S30：The audio data adjusted and video data are multiplexed, multiplex data is obtained.
It is above-mentioned that the audio data adjusted and video data are multiplexed, it can be understood as to above-mentioned adjusted
Audio data and video data are summarized, and merging forms multiplex data, which is used to be sent to terminal device,
In, terminal device can be mobile phone, tablet computer etc..
S40：According to pre-arranged code algorithm, the multiplex data is encoded, and the multiplex data after coding is sent to
Terminal device.
Above-mentioned pre-arranged code algorithm be H264 encryption algorithm perhaps AAC encryption algorithm according to H264 encryption algorithm or AAC
Encryption algorithm encodes multiplex data, and the multiplex data after coding is sent to terminal device.
Referring to Fig. 3, the above-mentioned data by after coding include the step of being sent to terminal device：
S401：Obtain the mailing address of the terminal device.
The mailing address of the above-mentioned acquisition terminal device is：The IP address of terminal device and identity information etc., by obtaining
The IP address for taking terminal device determines the information of terminal device, is convenient for data transmission.
S402：Multiplexing by the udp protocol, and in conjunction with the mailing address of the terminal device, after broadcast code
Data.
Above-mentioned " UDP " agreement is User Datagram Protocol, it is used to handle data packet as Transmission Control Protocol in a network,
UDP is a kind of connectionless transport layer protocol in OSI Reference Model, it is mainly used for the transmission for not requiring order of packets to reach
In, the inspection for being grouped transmission sequence is completed with sequence by application layer, and the simple unreliable information transmission service towards affairs is provided.
Udp protocol is substantially the interface of IP agreement and upper-layer protocol.Udp protocol is applicable in port and is separately operable on the same device
Multiple application programs.
Above-mentioned multiplex data terminal device is sent to by the mailing address of udp protocol combination terminal device to carry out extensively
It broadcasts.
S50：The terminal device is set to be decoded broadcasting to the multiplex data after the coding.
Terminal device described above is decoded the multiplex data after the coding, wherein the multiplex data branch after coding
Hold single frames decoding, that is to say, that multiplex data can pass through list by the data of H264 algorithm coding or AAC algorithm coding
Frame decoding, if passing through single frames not over H264 algorithm coding or AAC algorithm coding, terminal device before multiplex data transmission
When decoding, it may appear that decoding time is long or even encoded information and decodes unmatched phenomenon, causes to go out between different terminal equipment
The phenomenon that being now delayed.
Referring to Fig. 4, above-mentioned be decoded the terminal device including following step to the multiplex data after the coding
Suddenly：
S501：Obtain the hardware configuration of the terminal device.
The hardware configuration of above-mentioned terminal device includes CPU and hard disk, memory, CD-ROM drive information etc..
S502：Judge whether the hardware configuration meets default hard decoder condition.
Above-mentioned default hard decoder condition is that interior whether there is of terminal device can be in decoded hardware or terminal device
Hardware whether meet the condition of hard decoder, citing is illustrated below.
Such as：CPU, that is, central processing unit is divided into INTEL and AMD, and INTEL points are Celeron, Duo 13, Duo 15 and Duo 17
Deng, AMD is divided into malicious dragon, athlon, A4, A6, A10 and FX bull-dozer etc. again, if default hard decoder condition is Duo 15, and terminal
CPU in equipment is Duo 13, then does not meet default hard decoder condition, cannot go to decode above-mentioned multiplex data using hard decoder；
If default hard decoder condition is A10, and the hardware device in terminal device is A6, since the processing capacity of A10 is stronger, symbol
Close default hard decoder condition.
S503：If satisfied, then calling the hardware resource of the terminal device, the multiplex data stated after encoding is executed
Hard decoder；
S504：If not satisfied, soft decoding is executed to the multiplex data stated after encoding then according to decoding algorithm is preset,
The default decoding algorithm is corresponding with the pre-arranged code algorithm.
Default decoding algorithm described above is corresponding with the pre-arranged code algorithm, it can be understood as, set-top box will encode
Encryption algorithm is also sent to terminal device while multiplex data afterwards is sent to terminal device, after terminal device receives coding
Multiplex data and encryption algorithm, and multiplex data is decoded according to the encryption algorithm, the solution of terminal device can be improved
Code efficiency reduces the phenomenon that terminal device is delayed.
Referring to Fig. 5, Fig. 5 is the flow diagram for the method that another multi-screen provided in an embodiment of the present invention plays.
The method that above-mentioned multi-screen plays further includes：
S10：The interaction playing request that receiving terminal apparatus is sent.
S20：According to the interaction playing request, is demultiplexed to the program data received, obtain audio data
After video data, the System Clock Reference and display time of both the audio data and video data are adjusted.
S30：The audio data adjusted and video data are multiplexed, multiplex data is obtained.
S40：According to pre-arranged code algorithm, the multiplex data is encoded, and the multiplex data after coding is sent to
Terminal device.
S60：In the multiplex data after the terminal device receives the coding, the multiplex data after coding is cached
In the buffer queue of the spatial cache of terminal device.
In the buffer queue for the spatial cache that the above-mentioned multiplex data by after coding is cached in terminal device, specifically, will
It when multiplex data is sent to terminal device, does not play first, is temporarily stored into the buffer queue of spatial cache, when needing to play, eventually
End equipment is obtaining the multiplex data in the spatial cache, and citing is illustrated below.
If user terminal is computer, for set-top box by the multiplex data after transmission coding to computer, computer will be after the coding
Multiplex data be cached in the buffer queue in the spatial cache of computer, it is such as default to play by setting preset play time
After time can finish 10min for data buffer storage, set-top box and computer start simultaneously at broadcasting, and set-top box and computer is avoided to play not
Synchronous phenomenon occurs.
If terminal device is mobile phone and computer, since the configuration of mobile phone and computer is different, if the configuration of computer is compared
Height, processing speed is relatively fast, and mobile phone configuration is relatively low, and processing speed is relatively slow, if set-top box will be after coding
When multiplex data sends mobile phone and computer to simultaneously, if playing when passing, since computer processing speeds are very fast, it is easy
Existing mobile phone and computer occur playing nonsynchronous phenomenon when playing the same data content.
I.e.：If the time used in the multiplex data of handset receiver top box transmission is 20s, computer receives the same set-top box
Time used in the same multiplex data of transmission is 18s, if being played out in transmission process, the picture of mobile phone broadcasting
The picture played with computer will appear delay phenomenon.If mobile phone and the received multiplex data of computer are cached in corresponding to it
In the buffer queue of spatial cache, after having cached, in preset play time, plays, can be broadcast to avoid mobile phone and computer simultaneously
Inconsistent phenomenon is put to occur.
It is understood that above-mentioned spatial cache is memory space, memory space is used for the received number of storage terminal device
According to content.
S70：According to first in first out sequence, multiplex data after extracting the coding in the buffer queue, and will mention
Multiplex data after the coding got is decoded broadcasting.
Above-mentioned first in first out sequence, it can be understood as time sequencing is lined up based on the received, such as：Above-mentioned multiplex data
In include audio data and video data, audio data specifically includes MP3, voice communication etc., video data include animation file,
Image file etc..If terminal device is computer, computer can produce a date while receiving audio data and video data,
The date includes date and Hour Minute Second, if computer was tapped 27 days 10: 50 June in 2018 receives a mp3 file, 2 seconds
After receiving, date of generation is 50 minutes and 2 seconds 10 points of on June 27th, 2018, if computer was 40 minutes 10 points of on June 27th, 2018
An animation file is received, is received after 10, then the date generated is 40 minutes and 10 seconds 10 points of on June 27th, 2018, with most
Throughout one's life at date be reference, then according to the successive queuing of receiving time, extract data, the date is forward to be first extracted,
Data after extraction are decoded according to coding method, after decoding, are played out.
The embodiment of the present invention has the advantages that：When the interaction playing request that set-top box receiving terminal apparatus is sent
When, and according to the interaction playing request, it is demultiplexed to the program data received, obtains audio data and video counts
According to the System Clock Reference and display time for later, adjusting both the audio data and video data；Then it is adjusted in multiplexing
Audio data and video data afterwards, obtain multiplex data, according to pre-arranged code algorithm, encode to the multiplex data, and
Multiplex data after coding is sent to terminal device；It is decoded the terminal device to the multiplex data after the coding
It afterwards and plays, by adjusting the System Clock Reference of audio data and video data and display time, makes audio data and video
Data keep synchronizing, and carry out pre-arranged code to data adjusted are multiplexed, and decode when avoiding the occurrence of terminal device decoding
The phenomenon that format mismatching, occurs, and occurs the technical issues of time delay in decoding process to solve, and realizes that multi-screen synchronous plays,
Increase user experience.
As shown in fig. 6, Fig. 6 is the structural schematic diagram of a kind of electronic equipment provided in an embodiment of the present invention.Wherein, electronics is set
Standby to be independent electronic equipment, the electronic equipment 600 includes：At least one processor 601；And with it is described at least
The memory 602 of one processor 601 communication connection；Wherein, the memory 602 be stored with can by it is described at least one processing
The instruction that device 601 executes, described instruction is executed by least one described processor 601, so that at least one described processor 601
It is able to carry out above-mentioned method.In Fig. 6 by taking a processor 601 as an example.
Processor 601 can be connected with memory 602 by bus or other modes, and memory 602 is as a kind of non-
Volatile computer readable storage medium storing program for executing can be used for storing non-volatile software program, non-volatile computer executable program
And module, such as the corresponding program instruction/module of the method for upgrading software in the embodiment of the present invention.Processor 601 passes through operation
Non-volatile software program, instruction and the unit of storage in the memory 602, are answered thereby executing the various functions of electronic equipment
With and data processing, i.e., realization the method embodiment multi-screen play method.
Memory 602 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area, which can be stored, uses created data according to electronic equipment
Deng.In addition, memory 602 may include high-speed random access memory, it can also include nonvolatile memory, for example, at least
One disk memory, flush memory device or other non-volatile solid state memory parts.In some embodiments, memory 602
Optional includes the memory remotely located relative to processor 601, these remote memories can pass through network connection to electronics
Equipment.The embodiment of the network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
One or more of units are stored in the memory 602, when by one or more of processors
When 601 execution, the method that above-mentioned multi-screen plays is executed.
The embodiment of the invention provides a kind of computer program product, the computer program product is non-easy including being stored in
Computer program on the property lost computer readable storage medium, the computer program includes program instruction, when described program refers to
When order is executed by electronic equipment, the electronic equipment is made to execute multi-screen playback method.For example, executing in Fig. 2 described above
Method and step 10 is to step 50.
The embodiment of the invention provides a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable storage mediums
Matter is stored with computer executable instructions, and the computer executable instructions are used to that electronic equipment to be made to execute the side that multi-screen plays
Method.
The electronic equipment of the embodiment of the present application can exist in a variety of forms, including but not limited to：Smart phone, calculating
Machine, smartwatch, Intelligent bracelet, tablet computer, palm PC etc. have the electronic equipment of store function.
It should be noted that the apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit that part illustrates may or may not be physically separated, and component shown as a unit can be or can also
Not to be physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to reality
Need that some or all of the modules therein is selected to achieve the purpose of the solution of this embodiment.
By the description of above embodiment, those of ordinary skill in the art can be understood that each embodiment can borrow
Help software that the mode of general hardware platform is added to realize, naturally it is also possible to pass through hardware.Those of ordinary skill in the art can manage
All or part of the process in the solution realization embodiment method is can be by the relevant hardware of computer program instructions come complete
At the program can be stored in computer-readable storage medium, and the program is when being executed, it may include such as each method
Embodiment process.Wherein, the storage medium can be magnetic disk, CD, read-only memory (Read-Only
Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；At this
It under the thinking of invention, can also be combined between the technical characteristic in above embodiments or different embodiment, step can be with
It is realized with random order, and there are many other variations of different aspect present invention as described above, for simplicity, they do not have
Have and is provided in details；Although the present invention is described in detail referring to the foregoing embodiments, the ordinary skill people of this field
Member should understand that：It is still possible to modify the technical solutions described in the foregoing embodiments, or to part of skill
Art feature is equivalently replaced；And these are modified or replaceed, each reality of the present invention that it does not separate the essence of the corresponding technical solution
Apply the range of a technical solution.
Claims (10)
1. a kind of method that multi-screen plays, which is characterized in that the method includes：
The interaction playing request that receiving terminal apparatus is sent；
According to the interaction playing request, is demultiplexed to the program data received, obtain audio data and video counts
According to the System Clock Reference and display time for later, adjusting both the audio data and video data；
The audio data adjusted and video data are multiplexed, multiplex data is obtained；
According to pre-arranged code algorithm, the multiplex data is encoded, and the multiplex data after coding is sent to terminal device；
The terminal device is set to be decoded broadcasting to the multiplex data after the coding.
2. the method according to claim 1, wherein
The step of data by after coding are sent to terminal device include：
Obtain the mailing address of the terminal device；
Multiplex data by the udp protocol, and in conjunction with the mailing address of the terminal device, after broadcast code.
3. according to claim 1 or claim 2, which is characterized in that
Multiplex data after the coding supports single frames decoding；
The pre-arranged code algorithm is H264 encryption algorithm or AAC encryption algorithm.
4. the method according to claim 1, wherein described make the terminal device to the multiplexing after the coding
Data be decoded including：
Obtain the hardware configuration of the terminal device；
Judge whether the hardware configuration meets default hard decoder condition；
If satisfied, then calling the hardware resource of the terminal device, hard decoder is executed to the multiplex data stated after encoding；
If not satisfied, executing soft decoding, the default solution to the multiplex data stated after encoding then according to decoding algorithm is preset
Code algorithm is corresponding with the pre-arranged code algorithm.
5. the method according to claim 1, wherein the method also includes：
In the multiplex data after the terminal device receives the coding, the multiplex data after coding is cached in terminal and is set
In the buffer queue of standby spatial cache；
According to first in first out sequence, multiplex data after extracting the coding in the buffer queue, and the institute that will be extracted
Multiplex data after stating coding is decoded broadcasting.
6. a kind of multi-screen play system, including display device, set-top box and terminal device, which is characterized in that
The set-top box is used for：
The interaction playing request that receiving terminal apparatus is sent,
According to the interaction playing request, is demultiplexed to the program data received, obtain audio data and video counts
According to later, the sound view data and video data are pushed to the display device, and adjust the audio data and video counts
System Clock Reference and display time according to the two,
The audio data adjusted and video data are multiplexed, multiplex data is obtained, and,
According to pre-arranged code algorithm, the multiplex data is encoded, and the multiplex data after coding is sent to terminal device,
The terminal device, for being decoded broadcasting to the multiplex data after the coding.
7. multi-screen play system according to claim 6, which is characterized in that the set-top box is also used to execute described by volume
The step of data after code are sent to terminal device, including：
Obtain the mailing address of the terminal device；
Multiplex data by the udp protocol, and in conjunction with the mailing address of the terminal device, after broadcast code.
8. multi-screen play system according to claim 7, which is characterized in that
Multiplex data after the coding supports single frames decoding；
The pre-arranged code algorithm is H264 encryption algorithm or AAC encryption algorithm.
9. multi-screen play system according to claim 8, which is characterized in that the set-top box, which is also used to execute, described makes institute
It states terminal device to be decoded the multiplex data after the coding, specifically include：
Obtain the hardware configuration of the terminal device；
Judge whether the hardware configuration meets default hard decoder condition；
If satisfied, then calling the hardware resource of the terminal device, hard decoder is executed to the multiplex data stated after encoding；
If not satisfied, executing soft decoding, the default solution to the multiplex data stated after encoding then according to decoding algorithm is preset
Code algorithm is corresponding with the pre-arranged code algorithm.
10. multi-screen play system according to claim 9, which is characterized in that the set-top box is also used to execute：
In the multiplex data after the terminal device receives the coding, the multiplex data after coding is cached in terminal and is set
In the buffer queue of standby spatial cache；
It is described to make the terminal device be decoded broadcasting to the multiplex data after the coding to further include：It is suitable according to first in first out
Sequence, the multiplex data after extracting the coding in the buffer queue, and by the multiplex data after the coding extracted
It is decoded broadcasting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810694586.4A CN108882010A (en) | 2018-06-29 | 2018-06-29 | A kind of method and system that multi-screen plays |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810694586.4A CN108882010A (en) | 2018-06-29 | 2018-06-29 | A kind of method and system that multi-screen plays |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108882010A true CN108882010A (en) | 2018-11-23 |
Family
ID=64296814
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810694586.4A Pending CN108882010A (en) | 2018-06-29 | 2018-06-29 | A kind of method and system that multi-screen plays |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108882010A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111327934A (en) * | 2020-02-28 | 2020-06-23 | 海信集团有限公司 | Communication terminal, control equipment and video multi-equipment synchronous playing method |
| CN112423118A (en) * | 2020-10-26 | 2021-02-26 | 深圳Tcl新技术有限公司 | Multimedia file decoding method and device, terminal equipment and storage medium |
| CN112788430A (en) * | 2021-01-19 | 2021-05-11 | 深圳乐播科技有限公司 | Detection method and device for screen projection black screen and computer readable storage medium |
| CN114760486A (en) * | 2022-03-16 | 2022-07-15 | 深圳市宏电技术股份有限公司 | Live broadcasting method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188770A (en) * | 2007-12-17 | 2008-05-28 | 上海广电（集团）有限公司中央研究院 | An audio and video synchronization output method for multi-process control |
| CN101977324A (en) * | 2010-11-09 | 2011-02-16 | 青岛海信宽带多媒体技术有限公司 | Method for realizing screen sharing |
| US20120011542A1 (en) * | 2010-07-12 | 2012-01-12 | Comcast Cable Communications, Llc | Linear Interactive Television Data Insertion |
| CN104980788A (en) * | 2015-02-11 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| CN105142037A (en) * | 2015-09-10 | 2015-12-09 | 北京暴风科技股份有限公司 | Distributed transcoded audio and video synthesis method and system |
| CN107005681A (en) * | 2014-10-23 | 2017-08-01 | 应用程序动态有限责任公司 | Generic mirror is as receiver |
-
2018
- 2018-06-29 CN CN201810694586.4A patent/CN108882010A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188770A (en) * | 2007-12-17 | 2008-05-28 | 上海广电（集团）有限公司中央研究院 | An audio and video synchronization output method for multi-process control |
| US20120011542A1 (en) * | 2010-07-12 | 2012-01-12 | Comcast Cable Communications, Llc | Linear Interactive Television Data Insertion |
| CN101977324A (en) * | 2010-11-09 | 2011-02-16 | 青岛海信宽带多媒体技术有限公司 | Method for realizing screen sharing |
| CN107005681A (en) * | 2014-10-23 | 2017-08-01 | 应用程序动态有限责任公司 | Generic mirror is as receiver |
| CN104980788A (en) * | 2015-02-11 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| CN105142037A (en) * | 2015-09-10 | 2015-12-09 | 北京暴风科技股份有限公司 | Distributed transcoded audio and video synthesis method and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111327934A (en) * | 2020-02-28 | 2020-06-23 | 海信集团有限公司 | Communication terminal, control equipment and video multi-equipment synchronous playing method |
| CN112423118A (en) * | 2020-10-26 | 2021-02-26 | 深圳Tcl新技术有限公司 | Multimedia file decoding method and device, terminal equipment and storage medium |
| CN112788430A (en) * | 2021-01-19 | 2021-05-11 | 深圳乐播科技有限公司 | Detection method and device for screen projection black screen and computer readable storage medium |
| CN114760486A (en) * | 2022-03-16 | 2022-07-15 | 深圳市宏电技术股份有限公司 | Live broadcasting method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107846633B (en) | Live broadcast method and system | |
| KR102301333B1 (en) | Method and apparatus for streaming dash content over broadcast channels | |
| CN108882010A (en) | A kind of method and system that multi-screen plays | |
| WO2016150317A1 (en) | Method, apparatus and system for synthesizing live video | |
| EP2908535A1 (en) | Content transmission device, content playback device, content distribution system, method for controlling content transmission device, method for controlling content playback device, control program, and recording medium | |
| WO2016063780A1 (en) | Receiving device, transmitting device, and data processing method | |
| CN107819809B (en) | Method and device for synchronizing content | |
| EP3295674A1 (en) | Transferring media data using a websocket subprotocol | |
| JP5738865B2 (en) | Distribution of MPEG-2TS multiplexed multimedia stream by selecting elementary packets of MPEG-2TS multiplexed multimedia stream | |
| US10887646B2 (en) | Live streaming with multiple remote commentators | |
| KR20160139020A (en) | Broadcast and broadband hybrid service with mmt and dash | |
| Boronat et al. | HbbTV-compliant platform for hybrid media delivery and synchronization on single-and multi-device scenarios | |
| EP2827596A1 (en) | Transmitting and receiving method of multimedia video data and corresponding device | |
| WO2018028547A1 (en) | Channel switching method and device | |
| CN113661692B (en) | Method, apparatus and non-volatile computer-readable storage medium for receiving media data | |
| JP2018509060A5 (en) | ||
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| KR101668283B1 (en) | Method for displaying video considered latency, apparatus and cloud streaming service system therefor | |
| EP3162033B1 (en) | Method and apparatus for transmission and reception of media data | |
| WO2017092433A1 (en) | Method and device for video real-time playback | |
| CN114554277B (en) | Multimedia processing method, device, server and computer readable storage medium | |
| CN105812961B (en) | Adaptive stream media processing method and processing device | |
| US20210195256A1 (en) | Decoder equipment with two audio links | |
| JP7253477B2 (en) | Methods for synchronizing and generating streams, and corresponding computer programs, storage media, and rendering, execution, and generation devices | |
| US20170048291A1 (en) | Synchronising playing of streaming content on plural streaming clients |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |
|
| RJ01 | Rejection of invention patent application after publication |