CN104602127B - Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment - Google Patents
Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment Download PDFInfo
- Publication number
- CN104602127B CN104602127B CN201410441820.4A CN201410441820A CN104602127B CN 104602127 B CN104602127 B CN 104602127B CN 201410441820 A CN201410441820 A CN 201410441820A CN 104602127 B CN104602127 B CN 104602127B
- Authority
- CN
- China
- Prior art keywords
- window
- video
- adjustment
- attribute information
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000001360 synchronised effect Effects 0.000 claims abstract description 61
- 230000015654 memory Effects 0.000 claims description 84
- 238000004891 communication Methods 0.000 claims description 10
- 238000005070 sampling Methods 0.000 claims description 9
- 230000003068 static effect Effects 0.000 claims description 5
- 238000013519 translation Methods 0.000 description 26
- 230000014616 translation Effects 0.000 description 26
- 230000008569 process Effects 0.000 description 13
- 238000006243 chemical reaction Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 241001269238 Data Species 0.000 description 4
- 238000013500 data storage Methods 0.000 description 4
- 238000009432 framing Methods 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4408—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment, wherein, this method includes：Operational order is received, wherein, operational order is used to be adjusted the first window in the first area of video guide's equipment；The operation of operational order instruction, the first window after being adjusted are performed to first window；The multi-medium data that video guide's equipment is currently read is played in first window after the adjustment；First attribute information of the first window after adjustment and the multi-medium data currently read are synchronized to video playback apparatus.The present invention solves the problems, such as that the edit operation that the multi-medium data played in instructor in broadcasting's equipment carries out can not be synchronized in playback equipment.
Description
Technical field
The present invention relates to computer realm, in particular to a kind of instructor in broadcasting's audio video synchronization playback method and system and
Video guide's equipment.
Background technology
Nowadays, existing many commercial software director systems all possess the function of picture-in-picture, wherein, picture-in-picture refers to
The mode being superimposed using different video picture, while above-mentioned multiple vision signals are presented, it is common in TV, monitoring device, game.
However, these commercial software director systems also bring the operation of complexity substantially all towards professional user under powerful function,
Numerous and diverse button and layout so that ordinary user hangs back, and can not also be realized to straight using existing director system
The video of recording is broadcast into Mobile state editor, changes each element in picture-in-picture, for example, the window for playing video.
The real-time live broadcast to video is realized on existing picture-in-picture, is generally required pre-adjusted before live recording
Image content, for example, being operated beforehand through button mapping to the location layout of each element in picture-in-picture and size etc., obtains
To it is live when broadcasting pictures.In addition, generally using vertical scheme to the picture editing of picture-in-picture, it is specifically included：First gather
Data source file to be played, for example, local video, game picture, external equipment input picture etc.；Then, to be played
Data source file is into edlin, the data source file after being edited after completing whole editor；By the data source after editor
File is transferred in playback equipment and plays.That is, in the prior art, can not be in the mistake to data source file into edlin
Edit operation is synchronized in above-mentioned playback equipment in journey.
For it is above-mentioned the problem of, not yet propose effective solution at present.
The content of the invention
An embodiment of the present invention provides a kind of instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment, so that
It is few to solve to ask the technology that the edit operation that the multi-medium data played in instructor in broadcasting's equipment carries out is synchronized in playback equipment
Topic.
One side according to embodiments of the present invention, there is provided a kind of instructor in broadcasting's audio video synchronization broadcasting side, including：Receive operation
Instruction, wherein, aforesaid operations instruction is used to be adjusted the first window in the first area of video guide's equipment；To above-mentioned
First window performs the operation of aforesaid operations instruction instruction, the above-mentioned first window after being adjusted；It is upper after above-mentioned adjustment
State and the multi-medium data that above-mentioned video guide's equipment is currently read is played in first window；By above-mentioned first window after above-mentioned adjustment
The first attribute information and the above-mentioned multi-medium data currently read of mouth are synchronized to video playback apparatus.
Another aspect according to embodiments of the present invention, additionally provides a kind of video guide's equipment, including：Receiving unit, is used
In reception operational order, wherein, aforesaid operations instruction is used for the first window in the first area of above-mentioned video guide's equipment
It is adjusted；Operating unit, it is upper after being adjusted for performing the operation of aforesaid operations instruction instruction to above-mentioned first window
State first window；Broadcast unit, it is current for playing above-mentioned video guide's equipment in the above-mentioned first window after above-mentioned adjustment
The multi-medium data of reading；First synchronization unit, for by the first attribute information of the above-mentioned first window after above-mentioned adjustment with
And the above-mentioned multi-medium data currently read is synchronized to video playback apparatus.
Another aspect according to embodiments of the present invention, additionally provides a kind of instructor in broadcasting's audio video synchronization play system, video guide
Equipment, for receiving operational order, wherein, aforesaid operations instruction is used for the first window in the first area of video guide's equipment
Mouth is adjusted；The operation of aforesaid operations instruction instruction, the above-mentioned first window after being adjusted are performed to above-mentioned first window；
The multi-medium data that above-mentioned video guide's equipment is currently read is played in above-mentioned first window after above-mentioned adjustment；Video playing
Equipment, for the first above-mentioned video playback apparatus of attribute information synchronous adjustment according to the above-mentioned first window after above-mentioned adjustment
The second window in second area, above-mentioned second window after being adjusted, and in above-mentioned second window after above-mentioned adjustment
The above-mentioned multi-medium data currently read is played, wherein, above-mentioned first attribute information is used to indicate above-mentioned the after above-mentioned adjustment
The position of one window and size.
In embodiments of the present invention, the operational order received by basis, to the first area in video guide's equipment
Interior first window is adjusted, wherein, the multi-medium data currently read is being played in above-mentioned first window, by above-mentioned tune
First attribute information of the first window after whole and the multi-medium data currently read are synchronized to video playback apparatus, so that
The multimedia number read in video guide's equipment can be played simultaneously in second window of the second area in video playback apparatus
According to, and then the edit operation for solving the multi-medium data progress to being played in instructor in broadcasting's equipment can not be synchronized in playback equipment
Technical problem.
Further, in embodiments of the present invention, by by the currently playing multi-medium data of above-mentioned first window and with
And second attribute information storage, wherein, above-mentioned second attribute information be used for indicate to the first window in video guide's equipment into
The position of second window and size after row adjustment operation, in order to which video playback apparatus is read out, without completing to the
The editor customized in advance of first window in one region and then the problem of carry out video playing, and then realize
The effect that the synchronization of video plays in real time in director system.
Brief description of the drawings
Attached drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is a kind of application scenarios signal of optional instructor in broadcasting's audio video synchronization playback method according to embodiments of the present invention
Figure；
Fig. 2 is a kind of flow diagram of optional instructor in broadcasting's audio video synchronization playback method according to embodiments of the present invention；
Fig. 3 is the schematic diagram that a kind of optional instructor in broadcasting's audio video synchronization according to embodiments of the present invention plays；
Fig. 4 is the schematic diagram that the optional instructor in broadcasting's audio video synchronization of another kind according to embodiments of the present invention plays；
Fig. 5 is the schematic diagram that another optional instructor in broadcasting's audio video synchronization according to embodiments of the present invention plays；
Fig. 6 is a kind of schematic diagram of optional video guide's equipment according to embodiments of the present invention；
Fig. 7 is a kind of schematic diagram of optional instructor in broadcasting's audio video synchronization play system according to embodiments of the present invention；
Fig. 8 is the schematic diagram that another optional instructor in broadcasting's audio video synchronization according to embodiments of the present invention plays；
Fig. 9 is the schematic diagram that another optional instructor in broadcasting's audio video synchronization according to embodiments of the present invention plays；And
Figure 10 is the schematic diagram that another optional instructor in broadcasting's audio video synchronization according to embodiments of the present invention plays.
Embodiment
In order to make those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Attached drawing, is clearly and completely described the technical solution in the embodiment of the present invention, it is clear that described embodiment is only
The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
Member's all other embodiments obtained without making creative work, should all belong to the model that the present invention protects
Enclose.
It should be noted that term " first " in description and claims of this specification and above-mentioned attached drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so use
Data can exchange in the appropriate case, so as to the embodiment of the present invention described herein can with except illustrating herein or
Order beyond those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment
Those steps or unit clearly listed, but may include not list clearly or for these processes, method, product
Or the intrinsic other steps of equipment or unit.
Embodiment 1
According to embodiments of the present invention, there is provided a kind of instructor in broadcasting's audio video synchronization playback method embodiment, above-mentioned instructor in broadcasting's video are same
Step playback method can be, but not limited to be applied in network environment as shown in Figure 1, and above-mentioned terminal 102 is from one or more terminals
104 obtain the multi-medium data to be played, and above-mentioned multi-medium data is operated accordingly, above-mentioned to be in mode of operation
Multimedia data information will be sent to terminal 106, with realize can be played simultaneously in terminal 106 it is above-mentioned in operation shape
The multimedia data information of state.Wherein, in embodiments of the present invention, the above-mentioned network for being used to connect each terminal device can include
But it is not limited at least one of：Wide area network, Metropolitan Area Network (MAN), LAN, above-mentioned terminal can include but is not limited to it is following at least it
One：Mobile phone, tablet computer, laptop, PC machine.Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method
It but can also be not limited to be integrated in a terminal 102 and realize, that is to say, that first area in above-mentioned terminal 102 can be with
Realize and the multi-medium data to be played got is operated, the second area in above-mentioned terminal 102 is realized will be upper
The multi-medium data for stating mode of operation is played simultaneously.The example above is a kind of example, and the present embodiment does not do this any restriction.
According to embodiments of the present invention, there is provided a kind of instructor in broadcasting's audio video synchronization playback method, as shown in Fig. 2, this method includes：
S202, receives operational order, wherein, operational order is used for the first window in the first area of video guide's equipment
Mouth is adjusted；
S204, performs first window the operation of operational order instruction, the first window after being adjusted；
S206, the multi-medium data that video guide's equipment is currently read is played in first window after the adjustment；
S208, the first attribute information of the first window after adjustment and the multi-medium data currently read are synchronized to and regarded
Frequency playback equipment.
Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method can be, but not limited to be applied to regard online
In the director system of frequency real-time live broadcast, wherein, above-mentioned instructor in broadcasting's video can include but is not limited to the director system in real-time live broadcast
The middle all multi-medium datas to be played.Specifically, can by the multi-medium data played in video guide's equipment with it is right
Window shown by above-mentioned multi-medium data be adjusted after attribute information simultaneous display into video playback apparatus, with realize
Each adjustment of multi-medium data in video guide's equipment will be operated, be mapped in real time in video playback apparatus, and nothing
It need to carry out window adjustment operation in advance to all multi-medium datas to be played in video guide's equipment, edit and preserve completing
Afterwards, it can just play out, and then improve real-time of the director system in live recording.The example above is that one kind is shown
Example, the present embodiment do not do this any restriction.
Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method can be, but not limited to so that video playing
Equipment adjusts the second window in the second area of video playback apparatus according to the first attribute information of the first window after adjustment,
The second window after being adjusted, and the multi-medium data currently read is played in the second window after the adjustment, wherein, first
Attribute information is used for position and the size for indicating the first window after adjusting.
Alternatively, in the present embodiment, before aforesaid operations instruction is received, further include：
S1, reads the multi-medium data to be played simultaneously.
Alternatively, in the present embodiment, above-mentioned multi-medium data can be, but not limited to be stored in above-mentioned video guide's equipment
In, it can also be stored in third party's external equipment in addition to above-mentioned video guide's equipment.Wherein, above-mentioned multi-medium data bag
Include at least one of：Video, word, image.For example, game snapshot picture, desktop screen image, text, this map
Piece or local video, the data of external equipment collection.Alternatively, in the present embodiment, video guide's equipment is currently read
Display mode of the multi-medium data in first area can include but is not limited at least one of：
1) resolution ratio of multi-medium data is less than or equal to the resolution ratio of above-mentioned video guide's equipment, then is used to play above-mentioned more
The first window of media data will be according to 1:1 ratio is shown in first area；
2) resolution ratio of multi-medium data is more than the resolution ratio of above-mentioned video guide's equipment, then is used to play above-mentioned multimedia
The first window of data will be shown according to the resolution ratio of acquiescence, for example, resolution ratio is 320 × 240.
Alternatively, in the present embodiment, the first area of above-mentioned video guide's equipment can include but is not limited to be used for pre-
Look at the multi-medium data to be played simultaneously, instructor in broadcasting preview region as shown in Figure 3, wherein, the first window in first area can
To include but not limited to one or more windows, window A as shown in Figure 3, window B, window C；Further, above-mentioned window can be with
But transparent figure layer is not limited to, for the display carrier as multi-medium data, in order to which user is operated.
Alternatively, in the present embodiment, the indicated operation of aforesaid operations instruction can include but is not limited to it is following at least
One of：Translation, scaling, addition, deletion, for indicating position and the size of adjustment first window.Specifically, in the present embodiment
In, only need user to carry out choosing the shirtsleeve operations such as mobile, the frame stretching of target, mouse, to realize the broadcasting to instructor in broadcasting's video
The control of window.
Specifically, with reference to shown in Fig. 3, it is assumed that certain public good is publicized in above-mentioned director system and carries out real-time live broadcast,
Window A is provided with caption (such as " public good promotes day ") in instructor in broadcasting preview region, and video (such as public good is being played in window B
Advertisement), window C is in display public good LOGO, then when receiving to the operational order of window A (for example, window A is amplified twice)
When, corresponding operation is performed according to aforesaid operations instruction to window A so that above-mentioned public service ads video is exaggerated twice.With this
Meanwhile the multi-medium data that is currently read in the multi-medium data in above-mentioned instructor in broadcasting preview region, i.e. window A- windows C and to window
The amplifieroperation of mouth A will be synchronized to video playback apparatus, e.g., in the broadcast area of video playback apparatus will also show at the same time above-mentioned
The multi-medium data currently read in window A- windows C, the amplifieroperation of above-mentioned window A also will be by simultaneous display.
Alternatively, in the present embodiment, read the first attribute information of the first window after adjustment and currently more
The mode that media data is synchronized to video playback apparatus can include but is not limited to：Belong to according to first of the first window after adjustment
Property information obtains the second attribute information being adjusted to the second window in video playback apparatus, and then by above-mentioned second attribute
Information and the multi-medium data currently read preserve, in order to which video guide's equipment and video playback apparatus can obtain respectively
Take, can be played simultaneously so as to fulfill in video guide's equipment and video playback apparatus.
Alternatively, in the present embodiment, above-mentioned second attribute information and the multi-medium data currently read are compiled
Code can be located at to obtain the coded system of video stream data but is not limited in following at least one equipment：Video guide's equipment,
Belong to the equipment of same LAN with video guide's equipment.Alternatively, in the present embodiment, above-mentioned coded system will be after adjustment
The multi-medium data that obtained the second attribute information and first window is currently read is encoded to obtain corresponding video fluxion
According to, wherein, multi-medium data that above-mentioned second attribute information and first window are currently read and above-mentioned video stream data
Storage mode includes at least one of：
1) video guide's equipment and video playback apparatus are integrated in same equipment, the second attribute information after above-mentioned adjustment with
And the video stream data obtained after the multi-medium data and coding currently read can be stored in the different zones in device memory
It is upper that (for example, the multi-medium data that the second attribute information and first window are currently read is stored in a-quadrant, video stream data is deposited
Storage is in B area).
Alternatively, when video guide's equipment and video playback apparatus are integrated in same equipment, above-mentioned video guide is with regarding
Frequency, which plays, not to be limited in any way this for the different application of the equipment, the present embodiment.
Alternatively, in the present embodiment, above-mentioned video guide is applied is adjusted by accessing the a-quadrant in memory with directly acquiring
The second attribute information after whole and the multi-medium data currently read, obtaining being used for through corresponding inverse conversion should in video guide
First attribute information of the first window after the adjustment played in real time in first area (e.g., instructor in broadcasting preview region) and current
The multi-medium data of reading, first so as to fulfill the first window that can be played in real time in being applied in video guide after adjustment belongs to
Property information and the multi-medium data currently read；Alternatively, in the present embodiment, above-mentioned coded system can also be by a-quadrant
The second attribute information after the adjustment of middle storage and the multi-medium data currently read carry out corresponding coding to be used for
The second attribute information and current reading after the adjustment played in real time in the second area (e.g., broadcast area) of video playing application
The multi-medium data taken, and be saved into the B area of memory, above-mentioned video playing is applied by accessing the B areas in memory
Domain with directly acquire the second attribute information after adjustment and the multi-medium data that currently reads of first window it is encoded after obtain
Video stream data, in order to directly video playing application second area (e.g., broadcast area) in play above-mentioned adjustment in real time
Rear the second attribute information and the multi-medium data currently read.
2) video guide's equipment is different equipment from video playback apparatus, the second attribute information after above-mentioned adjustment and
The multi-medium data currently read is stored in the memory of video guide's equipment, and the video stream data obtained after above-mentioned coding can be with
It is stored in the different node devices in content distributing network (CDN, Content Delivery Network).
Alternatively, in the present embodiment, after above-mentioned video guide is applied by accessing local memory to directly acquire adjustment
The second attribute information and the multi-medium data that currently reads of first window, obtain being used in video guide through corresponding inverse conversion
Broadcast the first window after the adjustment played in real time in the first area (e.g., instructor in broadcasting preview region) of application the first attribute information and
The multi-medium data currently read, so as to fulfill the of the first window that can be played in real time in being applied in video guide after adjustment
One attribute information and the multi-medium data currently read；Alternatively, in the present embodiment, above-mentioned video playing application passes through visit
Ask that the memory of in CDN node device is currently read to directly acquire the second attribute information after adjustment and first window
Multi-medium data it is encoded after obtained corresponding video stream data, in order to directly in the second area of video playing application
The second attribute information after above-mentioned adjustment and the multi-medium data currently read are played in (e.g., broadcast area) in real time.
Specifically it is described with reference to the example below, it is assumed that window A has been only inserted in instructor in broadcasting preview region, when to above-mentioned window A
When zooming in and out operation, the public service ads video in above-mentioned window A will also amplify therewith, where it is assumed that being related in amplification process
And change to three data frames, such as F1, F2, F3, the data frame after adjustment is respectively F1 ', F2 ', F3 ', using a frame data frame F as
Example, each data frame F ' after adjustment include the attribute information U1 changed during source data frame F and adjustment, example
Such as, positional information.Above-mentioned F ' is converted to obtain in video playback apparatus further according to the wide height of video playback apparatus
The F " of broadcasting is synchronized in broadcast area, wherein, above-mentioned F " includes source data frame F and needed for video playback apparatus
Attribute information U2, for example, positional information.Data frame F " after adjustment is preserved into A areas in memory in a manner of covering frame by frame
Domain.Assuming that above-mentioned video playback apparatus and video guide's equipment are same equipment, that is to say, that realize multimedia in same equipment
Data are played simultaneously, then video guide, which applies, the data frame F " after adjusting is obtained from above-mentioned a-quadrant, and converts through inverse
To the data frame F ' played for the first area in being applied in video playing.Data frame coding F " after above-mentioned adjustment is encoded
Obtained video stream data, which will be stored to the B area in memory, video playing application, can directly pass through the B areas in local memory
Domain obtains the video stream data for being used for being played simultaneously, and video playing application decompresses the data frame after being adjusted by decoding again
F ", and then realize being played simultaneously for the multi-medium data in being applied with video guide.
Alternatively, in the present embodiment, the first attribute information of the first window after by adjustment and currently read
When multi-medium data is synchronized to video playback apparatus, further include：3rd attribute information of first area is synchronized to second area,
Wherein, the 3rd attribute information is used to indicate to be located in first area the first background information outside first window so that video is broadcast
Put equipment and the second background information being located in second area outside the second window is adjusted to the first background information.
It is described further with reference to above-mentioned data frame, the data frame F " after above-mentioned adjustment, can also be in conjunction with above-mentioned
It is located at (assuming that the first background information is still image, then only including for the first background information outside first window in one region
One frame data frame) data frame O is overlapped, to obtain the frame hybrid frame F played out for being mapped to video playback apparatusi
(n, n are natural number for i=1,2,3 ...), as shown in figure 4, and by above-mentioned hybrid frame FiIt is saved in the memory of video guide's equipment.
Assuming that above-mentioned video playback apparatus and video guide's equipment are distinct device, above-mentioned coded system will be to multiple above-mentioned
Hybrid frame FiEncoded to obtain the video stream data for being played out in video playback apparatus, and by above-mentioned video stream data
It is saved in the memory of different CDN node equipment, and generates corresponding stream address, when video playback apparatus is according to nearby principle
When accessing corresponding node device, it will replicate and obtain needing synchronous video stream data, above-mentioned video stream data is stored in and is regarded
In the caching of frequency playback equipment, and corresponding decoding process is carried out, need synchronous above-mentioned hybrid frame F to obtaini, so that regarding
The realization of frequency playback equipment is played simultaneously with video guide's equipment.
Specifically illustrated with reference to the example below, assume online live Beijing day of following one week with reference to Fig. 5 (a)-(b)
Gas forecasts, wherein, the instructor in broadcasting preview region of video guide's equipment includes presiding over the video of report weather comprising host
Window A, and the window B comprising Beijing's map, receive the operational order that translation is performed to window A, according to above-mentioned
The window A that operational order is playing host the video of weather performs translation (for example, moving down), for example, the upper left corner
The coordinate on vertex moves to coordinate (x2, y2) by (x1, y1), then by the map in the video in above-mentioned window A and window B flat
The data frame superposition produced during shifting forms hybrid frame and is preserved, and then above-mentioned hybrid frame is carried out at corresponding coding
Above-mentioned video stream data is stored in one of CDN by reason to obtain accessing the video stream data obtained easy to video playback apparatus
In node device, while generate corresponding stream address so that video playback apparatus obtained in stream address reproduction accordingly it is above-mentioned
Video stream data, after the video stream data to getting carries out corresponding decoding process, obtains broadcasting in video playback apparatus
Put the video that is played simultaneously in area in above-mentioned window A and the map in window B, wherein, it is above-mentioned in video guide's equipment to bag
The downward translation that the window A progress for the video for reporting weather is being presided over containing host also plays real-time synchronization.It is above-mentioned
Citing is a kind of example, and the present embodiment does not do this any restriction.
The embodiment provided by the application, by according to the operational order that receives, to the in video guide's equipment
First window in one region is adjusted, the first window after being adjusted, wherein, playing and working as in above-mentioned first window
The multi-medium data of preceding reading, the first attribute information of the first window after adjustment and the multi-medium data currently read is same
Walk to video playback apparatus, so as to fulfill the second area in the video playback apparatus after being adjusted according to the first attribute information
The multi-medium data read in video guide's equipment can be played simultaneously in second window, overcome needs in advance in the prior art
Instructor in broadcasting's video playing picture is customized, instructor in broadcasting's equipment multimedia to be played can not be realized in playback equipment in editing process
Synchronous the problem of playing in real time, the effect for improving the real-time that audio video synchronization plays in director system is reached.
As a kind of optional scheme, by the first attribute information of the first window after adjustment and the more matchmakers currently read
Volume data, which is synchronized to video playback apparatus, to be included：
S1, obtains according to the size of the second area of the first attribute information, the size of first area and video playback apparatus
Second attribute information of the second window after to adjustment, wherein, the second attribute information is used to indicate the second window after adjusting
Position and size, the second window after adjustment are located in second area, and for playing the multi-medium data currently read；
S2, is synchronized to video playback apparatus so that video is broadcast by the second attribute information and the multi-medium data currently read
Put in the second window of equipment after the adjustment and play the multi-medium data currently read.
Alternatively, in the present embodiment, can include but is not limited in above-mentioned first attribute information first window width,
Highly, the coordinate of left upper apex, can include but is not limited in above-mentioned second attribute information the second window after adjustment width,
Highly, the coordinate of left upper apex.
Alternatively, in the present embodiment, according to the size of above-mentioned first area and the ratio of the size of second area, conversion
Obtain the second attribute information of above-mentioned second window.
Specifically it is described with reference to the example below, it is assumed that the width of first area is x1, is highly y1, second area width
It is highly y2 for x2, the width of first window is 320, is highly 240, the coordinate of left upper apex is (10,20).Receiving
After the operational order of 10 units of translation downwards is performed to above-mentioned first window, according to the size of first area and second area ratio
Example conversion obtains the second attribute information being adjusted to the second window, and the second window is adjusted according to second attribute information, i.e.
Second window will translate corresponding distance downwards, and more matchmakers that first window is currently read are played in the second window after the adjustment
Volume data.
Alternatively, in the present embodiment, to multi-medium data in the first window in first area in video guide's equipment
Processing can be, but not limited to zoom in and out superposition by video card hardware so that reduce CPU occupancy, so as to greatly promote performance.
By the application provide embodiment, by the size according to first attribute information, the first area with
And the size of the second area obtains the second attribute information of second window after the adjustment, realizes in video playing
The data that currently read of first window are played in the second window after equipment synchronous adjustment in real time, are realized to the of first area
While one window carries out real-time operation, it can realize in the second window of the second area of video playback apparatus and reflect in real time
Penetrate, the effect being played simultaneously, thus improve existing director system can not realize to instructor in broadcasting's video of video guide's equipment into
While row operation, the multi-medium data in video guide's equipment is played in real time, and then realize can when carrying out live recording
Directly to carry out real-time instructor in broadcasting's processing to playing video, without etc. handled after the completion of review.
As a kind of optional scheme, the second attribute information and the multi-medium data currently read are synchronized to video playing
Equipment includes：
S1, video guide's equipment are encoded the second attribute information and the multi-medium data currently read, and will coding
The video stream data obtained afterwards is stored into memory, wherein, memory is positioned to allow for being accessed by video playback apparatus.
Alternatively, in the present embodiment, above-mentioned video guide's equipment is by the second attribute information and the multimedia currently read
Data storage can include but is not limited to store the data frame after each framing control into memory into memory, wherein,
Before above-mentioned storage, can also include according to the frame per second of video playback apparatus, the frame per second of multi-medium data is carried out it is unified, on
State the unified mode of frame per second and can include but is not limited at least one of：
1) when multi-medium data is static data, i.e. only include a frame data frame, then repeat to above-mentioned frame data frame
Operation is adjusted accordingly, until meeting the frame per second (such as 20 frames/s) that video playback apparatus is specified.
For example, with reference to shown in Fig. 5,1s translations are performed to Beijing's map in window B, are translated in place from position 1
2 are put, then a frame data of above-mentioned map are added into 20 frames, wherein, corresponding translation is performed frame by frame to above-mentioned each frame,
For example, using the coordinate of the left upper apex of original map as (x1, y1) exemplified by, then during translation, by produce 20 frames be used for
Showing the translation motion of above-mentioned map, coordinate is changed to (x2, y2) ... until (x20, y20) by (x1, y1), wherein, (x1,
Y1 it is) coordinate of position 1, (x20, y20) is the coordinate of position 2.
2) when multi-medium data is dynamic video data, then the frame per second specified according to video playback apparatus (such as 20 frames/
S), sampled again according to sampling theorem to above-mentioned multi-medium data.
As an alternative embodiment, when the frame per second of above-mentioned dynamic video data is less than the frame per second specified, then it is right
The data frame of above-mentioned dynamic video carries out interleave processing, for example, some data frames in 15 frame data frames of selection carry out repeating to insert
Enter, until 20 frames, so that the data frame after adjustment meets the frame per second (such as 20 frames/s) that video playback apparatus is specified.
As another optional embodiment, when the frame per second of above-mentioned dynamic video data is more than the frame per second specified, then
Sampled again to the data frame of above-mentioned dynamic video in the case of distortionless according to sampling theorem, for example, from 25 frame numbers
According to 20 frames of sampling again in frame, so that the data frame after adjustment meets the frame per second (such as 20 frames/s) that video playback apparatus is specified.
Alternatively, in the present embodiment, above-mentioned memory can include but is not limited to a memory or two memories,
Wherein, when above-mentioned video guide's equipment and video playback apparatus are same equipment, above-mentioned memory will be a memory (example
Such as, the memory of equipment), then above-mentioned second attribute information and the above-mentioned multi-medium data currently read after encoded conversion with obtaining
To the different zones that will be respectively stored in the said equipment memory of video stream data, above-mentioned video playing application will be to slave device
The video stream data got in memory obtains the multimedia data information for being played simultaneously after being decoded；When above-mentioned video
When instructor in broadcasting's equipment and video playback apparatus are distinct device, above-mentioned memory can be different memory, video guide's equipment
The multi-medium data that second attribute information and above-mentioned first window are currently read is stored into the memory of video guide's equipment,
The video obtained after the encoded conversion of multi-medium data that above-mentioned second attribute information and above-mentioned first window are currently read
Flow data will be stored in the memory of a node device of CDN, while generates corresponding stream address, in order to which video playing is set
Standby access obtains corresponding video stream data.
Alternatively, in the present embodiment, above-mentioned storage can include but is not limited to：Covering storage.In other words, one is often obtained
Data frame after framing control, in storage all by covering before the data frame that stores, to ensure temporal synchronization, further,
Compressed package of the data frame after encoded processing after above-mentioned adjustment can also but be not limited to store in a manner of covering and store
Into the node device of CDN, wherein, the memory space in the memory of above-mentioned CDN node equipment is smaller, and video guide's equipment is with regarding
The delay being played simultaneously between frequency playback equipment is shorter.
For example, only allowing to store a compressed data packets in the memory of CDN node equipment, then often receive video guide and set
One compressed data packets of standby storage.The compressed data packets that have obtained before all covering, so that video playback apparatus can be with
Remain synchronous with the data in video guide's equipment while play.In another example only allow in the memory of CDN node equipment
Three compressed data packets are stored successively, then the 4th compressed data packets will cover first compressed data packets, the 5th compression number
Second compressed data packets will be covered according to bag, and so on.Assuming that the time that video playback apparatus starts is receiving the just
During four compressed data packets, then video playback apparatus will be played simultaneously the 4th compressed data packets institute uncompressed encoding and be obtained more matchmakers
Volume data, without repeating the data played in first to the 3rd compressed data packets, equipment is won to realize with tv channel
Be played simultaneously；Assuming that the time that video playback apparatus starts just when receiving second compressed data packets, then video is broadcast
Putting equipment also needs to obtain the first compressed data, then obtains the second compressed data packets, then there will be one for the above-mentioned process being played simultaneously
Fixed delay.
The embodiment provided by the application, by video guide's equipment by the second attribute information and the more matchmakers currently read
Volume data is stored into memory, so that video guide's equipment can directly access acquisition with video playback apparatus, so as to ensure
Video guide equipment and video playback apparatus are played simultaneously.
As a kind of optional scheme, the second attribute information and the multi-medium data currently read are synchronized to video playing
Equipment includes：
S1, video playback apparatus read the second attribute information and multi-medium data from memory；
The size of second window is adjusted to the size of the second attribute information instruction by S2, video playback apparatus, and by second
The position that position adjustment of the window in second area is indicated to the second attribute information, the second window after being adjusted；
S3, plays the multi-medium data currently read in the second window of video playback apparatus after the adjustment.
Specifically it is described with reference to the example below, it is assumed that with reference to shown in Fig. 5, in the first area in video guide's equipment
Beijing's map of window B translated, for example, the coordinate of top left corner apex moves to coordinate (x2, y2) by (x1, y1),
A frame data frame corresponding to above-mentioned map, and the second attribute information will be then stored in memory, wherein, above-mentioned second attribute
Information is used for Beijing's map for indicating the window B in second area after adjustment, for example, being translated accordingly, for example, with a left side
Exemplified by the coordinate of upper angular vertex, coordinate (x2 ', y2 ') is moved to by (x1 ', y1 '), with the window B after being adjusted, and in window
Above-mentioned Beijing's map is still shown in mouth B.
By the application provide embodiment, video playback apparatus by read from memory the second attribute information and
Multi-medium data, and the size of the second window is adjusted to the size indicated by the second attribute information and position, and adjusting
The data currently read are played in the second window afterwards, so as to fulfill the synchronization of director system multi-medium data.
As a kind of optional scheme, the size of the first window after adjustment first including the first window after adjustment is wide
Degree and the first height, the size of the second window after adjustment include the second width and the second height of the second window after adjustment,
The size of first area includes the 3rd width and third height of first area, and the size of second area includes the of second area
Four width and the 4th height；
S1, the position of the first window after adjustment include left upper apex in the first window after adjustment in first area
The first abscissa and the first ordinate, the position of the second window after adjustment includes the upper left top in the second window after adjustment
Second abscissa and second ordinate of the point in second area；
Wherein, after being adjusted according to the size of the first attribute information, the size of first area and second area
Second attribute information of two windows includes：The second attribute information of the second window after adjustment is calculated by the following formula：
Wherein, X1WidthRepresent the first width, X2WidthRepresent the second width；L1WidthRepresent the 3rd width, L2WidthRepresent the 4th
Width；X1HighlyRepresent the first height, X2HighlyRepresent the second height；L1HighlyRepresent third height, L2HighlyRepresent the 4th height；
X1AbscissaRepresent the first abscissa, X2AbscissaRepresent the second abscissa；X1OrdinateRepresent the first ordinate, X2OrdinateRepresent the second vertical seat
Mark.
Specifically illustrated with reference to the example below, it is assumed that by taking 10 unit translations to the right as an example, the width of first window
X1LengthFor 320, the height X1 of first windowHighlyFor 240, the width L1 of first areaLengthFor 800, the height L1 of first areaHighly
For 450, the width L2 of second areaLengthFor 1280；The height L2 of second areaHighlyFor 720.By taking left upper apex as an example, before translation,
The coordinate position of left upper apex is (10,20)；The coordinate position of left upper apex is (20,20), then according to above-mentioned Computing Principle meter
Calculate, the abscissa of left upper apex of second window before translation is that should beOrdinate isAnd the abscissa of left upper apex of second window after translation isOrdinate isCorrespondingly, the coordinate position of other pixels in window can be obtained by above-mentioned calculating, so that root
According to the window's position and size after the adjustment being calculated.
The embodiment provided by the application, by above-mentioned calculation formula, is realized the firstth area in video guide's equipment
The attribute information and multi-medium data of first window in domain are mapped to second in the second area in video playback apparatus
In window, so that the real-time during improving video guide, realizes to the multimedia number to be played in director system
According to be played simultaneously.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should know, the present invention and from the limitation of described sequence of movement because
According to the present invention, some steps can use other orders or be carried out at the same time.Secondly, those skilled in the art should also know
Know, embodiment described in this description belongs to preferred embodiment, and involved action and module are not necessarily of the invention
It is necessary.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but very much
In the case of the former be more preferably embodiment.Based on such understanding, technical scheme is substantially in other words to existing
The part that technology contributes can be embodied in the form of software product, which is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, calculate
Machine, server, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiment 2
According to embodiments of the present invention, there is provided a kind of video guide's apparatus embodiments, above-mentioned video guide's equipment can with but
It is not limited to be applied in network environment as shown in Figure 1, above-mentioned terminal 102 obtains to be played from one or more terminals 104
Multi-medium data, and above-mentioned multi-medium data is operated accordingly, the above-mentioned multi-medium data letter in mode of operation
Breath will be sent to terminal 106, and the above-mentioned multi-medium data in mode of operation can be played simultaneously in terminal 106 to realize
Information.Wherein, in embodiments of the present invention, it is above-mentioned be used for connect each terminal device network can include but is not limited to down toward
It is one of few：Wide area network, Metropolitan Area Network (MAN), LAN, above-mentioned terminal can include but is not limited at least one of：Mobile phone, tablet electricity
Brain, laptop, PC machine.Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method can also but be not limited to
It is integrated in a terminal 102 and realizes, that is to say, that first area in above-mentioned terminal 102 can be realized to getting
The multi-medium data to be played is operated, and the second area in above-mentioned terminal 102 is realized the more of aforesaid operations state
Media data is played simultaneously.The example above is a kind of example, and the present embodiment does not do this any restriction.
According to embodiments of the present invention, a kind of video guide's equipment is additionally provided, as shown in fig. 6, the device includes：
1) receiving unit 602, for receiving operational order, wherein, operational order is used for the first of video guide's equipment
First window in region is adjusted；
2) operating unit 604, for performing the operation of operational order instruction, the first window after being adjusted to first window
Mouthful；
3) broadcast unit 606, the more matchmakers currently read for playing video guide's equipment in first window after the adjustment
Volume data；
4) the first synchronization unit 608, for reading the first attribute information of the first window after adjustment and currently
Multi-medium data is synchronized to video playback apparatus.
Alternatively, in the present embodiment, above-mentioned video guide's equipment can be, but not limited to straight in real time applied to Online Video
In the director system broadcast, wherein, above-mentioned instructor in broadcasting's video can include but is not limited to be broadcast in the director system of real-time live broadcast
All multi-medium datas put.Specifically, can be by the multi-medium data played in video guide's equipment and to above-mentioned more matchmakers
Window shown by volume data be adjusted after attribute information simultaneous display into video playback apparatus, with realize will be to video
Each adjustment operation of multi-medium data in instructor in broadcasting's equipment, is mapped in video playback apparatus, without to video in real time
All multi-medium datas to be played carry out window adjustment operation, after completing to edit and preserve, ability in advance in instructor in broadcasting's equipment
Play out, and then improve real-time of the director system in live recording.The example above is a kind of example, this implementation
Example does not do this any restriction.
Alternatively, in the present embodiment, above-mentioned video guide's equipment can be, but not limited to so that video playback apparatus according to
The second window in the second area of the first attribute information adjustment video playback apparatus of first window after adjustment, is adjusted
The second window afterwards, and the multi-medium data currently read is played in the second window after the adjustment, wherein, the first attribute information
For indicating position and the size of the first window after adjusting.
Alternatively, in the present embodiment, before aforesaid operations instruction is received, further include：
S1, reads the multi-medium data to be played simultaneously.
Alternatively, in the present embodiment, above-mentioned multi-medium data can be, but not limited to be stored in above-mentioned video guide's equipment
In, it can also be stored in third party's external equipment in addition to above-mentioned video guide's equipment.Wherein, above-mentioned multi-medium data bag
Include at least one of：Video, word, image.For example, game snapshot picture, desktop screen image, text, this map
Piece or local video, the data of external equipment collection.Alternatively, in the present embodiment, video guide's equipment is currently read
Display mode of the multi-medium data in first area can include but is not limited at least one of：
1) resolution ratio of multi-medium data is less than or equal to the resolution ratio of above-mentioned video guide's equipment, then is used to play above-mentioned more
The first window of media data will be according to 1:1 ratio is shown in first area；
2) resolution ratio of multi-medium data is more than the resolution ratio of above-mentioned video guide's equipment, then is used to play above-mentioned multimedia
The first window of data will be shown according to the resolution ratio of acquiescence, for example, resolution ratio is 320 × 240.
Alternatively, in the present embodiment, the first area of above-mentioned video guide's equipment can include but is not limited to be used for pre-
Look at the multi-medium data to be played simultaneously, instructor in broadcasting preview region as shown in Figure 3, wherein, the first window in first area can
To include but not limited to one or more windows, window A as shown in Figure 3, window B, window C；Further, above-mentioned window can be with
But transparent figure layer is not limited to, for the display carrier as multi-medium data, in order to which user is operated.
Alternatively, in the present embodiment, the indicated operation of aforesaid operations instruction can include but is not limited to it is following at least
One of：Translation, scaling, addition, deletion, for indicating position and the size of adjustment first window.Specifically, in the present embodiment
In, only need user to carry out choosing the shirtsleeve operations such as mobile, the frame stretching of target, mouse, to realize the broadcasting to instructor in broadcasting's video
The control of window.
Specifically, with reference to shown in Fig. 3, it is assumed that certain public good is publicized in above-mentioned director system and carries out real-time live broadcast,
Window A is provided with caption (such as " public good promotes day ") in instructor in broadcasting preview region, and video (such as public good is being played in window B
Advertisement), window C is in display public good LOGO, then when receiving to the operational order of window A (for example, window A is amplified twice)
When, corresponding operation is performed according to aforesaid operations instruction to window A so that above-mentioned public service ads video is exaggerated twice.With this
Meanwhile the multi-medium data that is currently read in the multi-medium data in above-mentioned instructor in broadcasting preview region, i.e. window A- windows C and to window
The amplifieroperation of mouth A will be synchronized to video playback apparatus, e.g., in the broadcast area of video playback apparatus will also show at the same time above-mentioned
The multi-medium data currently read in window A- windows C, the amplifieroperation of above-mentioned window A also will be by simultaneous display.
Alternatively, in the present embodiment, read the first attribute information of the first window after adjustment and currently more
The mode that media data is synchronized to video playback apparatus can include but is not limited to：Belong to according to first of the first window after adjustment
Property information obtains the second attribute information being adjusted to the second window in video playback apparatus, and then by above-mentioned second attribute
Information and the multi-medium data currently read preserve, in order to which video guide's equipment and video playback apparatus can be straight respectively
Obtain and take, can be played simultaneously so as to fulfill in video guide's equipment and video playback apparatus.
Alternatively, in the present embodiment, above-mentioned second attribute information and the multi-medium data currently read are compiled
Code can be located at to obtain the coded system of video stream data but is not limited in following at least one equipment：Video guide's equipment,
Belong to the equipment of same LAN with video guide's equipment.Alternatively, in the present embodiment, above-mentioned coded system will be after adjustment
The multi-medium data that obtained the second attribute information and first window is currently read is encoded to obtain corresponding video fluxion
According to, wherein, multi-medium data that above-mentioned second attribute information and first window are currently read and above-mentioned video stream data
Storage mode includes at least one of：
1) video guide's equipment and video playback apparatus are integrated in same equipment, the second attribute information after above-mentioned adjustment with
And the video stream data obtained after the multi-medium data and coding currently read can be stored in the different zones in device memory
It is upper that (for example, the multi-medium data that the second attribute information and first window are currently read is stored in a-quadrant, video stream data is deposited
Storage is in B area).
Alternatively, when video guide's equipment and video playback apparatus are integrated in same equipment, above-mentioned video guide is with regarding
Frequency, which plays, not to be limited in any way this for the different application of the equipment, the present embodiment.
Alternatively, in the present embodiment, above-mentioned video guide is applied is adjusted by accessing the a-quadrant in memory with directly acquiring
The second attribute information after whole and the multi-medium data currently read, obtaining being used for through corresponding inverse conversion should in video guide
First attribute information of the first window after the adjustment played in real time in first area (e.g., instructor in broadcasting preview region) and current
The multi-medium data of reading, first so as to fulfill the first window that can be played in real time in being applied in video guide after adjustment belongs to
Property information and the multi-medium data currently read；Alternatively, in the present embodiment, above-mentioned coded system can also be by a-quadrant
The second attribute information after the adjustment of middle storage and the multi-medium data currently read carry out corresponding coding to be used for
The second attribute information and current reading after the adjustment played in real time in the second area (e.g., broadcast area) of video playing application
The multi-medium data taken, and be saved into the B area of memory, above-mentioned video playing is applied by accessing the B areas in memory
Domain with directly acquire the second attribute information after adjustment and the multi-medium data that currently reads of first window it is encoded after obtain
Video stream data, in order to directly video playing application second area (e.g., broadcast area) in play above-mentioned adjustment in real time
Rear the second attribute information and the multi-medium data currently read.
2) video guide's equipment is different equipment from video playback apparatus, the second attribute information after above-mentioned adjustment and
The multi-medium data currently read is stored in the memory of video guide's equipment, and the video stream data obtained after above-mentioned coding can be with
It is stored in the different node devices in content distributing network (CDN, Content Delivery Network).
Alternatively, in the present embodiment, after above-mentioned video guide is applied by accessing local memory to directly acquire adjustment
The second attribute information and the multi-medium data that currently reads of first window, obtain being used in video guide through corresponding inverse conversion
Broadcast the first window after the adjustment played in real time in the first area (e.g., instructor in broadcasting preview region) of application the first attribute information and
The multi-medium data currently read, so as to fulfill the of the first window that can be played in real time in being applied in video guide after adjustment
One attribute information and the multi-medium data currently read；Alternatively, in the present embodiment, above-mentioned video playing application passes through visit
Ask that the memory of in CDN node device is currently read to directly acquire the second attribute information after adjustment and first window
Multi-medium data it is encoded after obtained corresponding video stream data, in order to directly in the second area of video playing application
The second attribute information after above-mentioned adjustment and the multi-medium data currently read are played in (e.g., broadcast area) in real time.
Specifically it is described with reference to the example below, it is assumed that window A has been only inserted in instructor in broadcasting preview region, when to above-mentioned window A
When zooming in and out operation, the public service ads video in above-mentioned window A will also amplify therewith, where it is assumed that being related in amplification process
And change to three data frames, such as F1, F2, F3, the data frame after adjustment is respectively F1 ', F2 ', F3 ', using a frame data frame F as
Example, each data frame F ' after adjustment include the attribute information U1 changed during source data frame F and adjustment, example
Such as, positional information.Above-mentioned F ' is converted to obtain in video playback apparatus further according to the wide height of video playback apparatus
The F " of broadcasting is synchronized in broadcast area, wherein, above-mentioned F " includes source data frame F and needed for video playback apparatus
Attribute information U2, for example, positional information.Data frame F " after adjustment is preserved into A areas in memory in a manner of covering frame by frame
Domain.Assuming that above-mentioned video playback apparatus and video guide's equipment are same equipment, that is to say, that realize multimedia in same equipment
Data are played simultaneously, then video guide, which applies, the data frame F " after adjusting is obtained from above-mentioned a-quadrant, and converts through inverse
To the data frame F ' played for the first area in being applied in video playing.Data frame coding F " after above-mentioned adjustment is encoded
Obtained video stream data, which will be stored to the B area in memory, video playing application, can directly pass through the B areas in local memory
Domain obtains the video stream data for being used for being played simultaneously, and video playing application decompresses the data frame after being adjusted by decoding again
F ", and then realize being played simultaneously for the multi-medium data in being applied with video guide.
Alternatively, in the present embodiment, the first attribute information of the first window after by adjustment and currently read
When multi-medium data is synchronized to video playback apparatus, further include：3rd attribute information of first area is synchronized to second area,
Wherein, the 3rd attribute information is used to indicate to be located in first area the first background information outside first window so that video is broadcast
Put equipment and the second background information being located in second area outside the second window is adjusted to the first background information.
It is described further with reference to above-mentioned data frame, the data frame F " after above-mentioned adjustment, can also be in conjunction with above-mentioned
It is located at (assuming that the first background information is still image, then only including for the first background information outside first window in one region
One frame data frame) data frame O is overlapped, to obtain the frame hybrid frame F played out for being mapped to video playback apparatusi
(n, n are natural number for i=1,2,3 ...), as shown in figure 4, and by above-mentioned hybrid frame FiIt is saved in the memory of video guide's equipment.
Assuming that above-mentioned video playback apparatus and video guide's equipment are distinct device, above-mentioned coded system will be to multiple above-mentioned
Hybrid frame FiEncoded to obtain the video stream data for being played out in video playback apparatus, and by above-mentioned video stream data
It is saved in the memory of different CDN node equipment, and generates corresponding stream address, when video playback apparatus is according to nearby principle
When accessing corresponding node device, it will replicate and obtain needing synchronous video stream data, above-mentioned video stream data is stored in and is regarded
In the caching of frequency playback equipment, and corresponding decoding process is carried out, need synchronous above-mentioned hybrid frame F to obtaini, so that regarding
The realization of frequency playback equipment is played simultaneously with video guide's equipment.
Specifically illustrated with reference to the example below, assume online live Beijing day of following one week with reference to Fig. 5 (a)-(b)
Gas forecasts, wherein, the instructor in broadcasting preview region of video guide's equipment includes presiding over the video of report weather comprising host
Window A, and the window B comprising Beijing's map, receive the operational order that translation is performed to window A, according to above-mentioned
The window A that operational order is playing host the video of weather performs translation (for example, moving down), for example, the upper left corner
The coordinate on vertex moves to coordinate (x2, y2) by (x1, y1), then by the map in the video in above-mentioned window A and window B flat
The data frame superposition produced during shifting forms hybrid frame and is preserved, and then above-mentioned hybrid frame is carried out at corresponding coding
Above-mentioned video stream data is stored in one of CDN by reason to obtain accessing the video stream data obtained easy to video playback apparatus
In node device, while generate corresponding stream address so that video playback apparatus obtained in stream address reproduction accordingly it is above-mentioned
Video stream data, after the video stream data to getting carries out corresponding decoding process, obtains broadcasting in video playback apparatus
Put the video that is played simultaneously in area in above-mentioned window A and the map in window B, wherein, it is above-mentioned in video guide's equipment to bag
The downward translation that the window A progress for the video for reporting weather is being presided over containing host also plays real-time synchronization.It is above-mentioned
Citing is a kind of example, and the present embodiment does not do this any restriction.
The embodiment provided by the application, by according to the operational order that receives, to the in video guide's equipment
First window in one region is adjusted, the first window after being adjusted, wherein, playing and working as in above-mentioned first window
The multi-medium data of preceding reading, the first attribute information of the first window after adjustment and the multi-medium data currently read is same
Walk to video playback apparatus, so as to fulfill the second area in the video playback apparatus after being adjusted according to the first attribute information
The multi-medium data read in video guide's equipment can be played simultaneously in second window, overcome needs in advance in the prior art
Instructor in broadcasting's video playing picture is customized, instructor in broadcasting's equipment multimedia to be played can not be realized in playback equipment in editing process
Synchronous the problem of playing in real time, the effect for improving the real-time that audio video synchronization plays in director system is reached.
As a kind of optional scheme, above-mentioned first synchronization unit 608 includes：
1) module is adjusted, for second according to the first attribute information, the size of first area and video playback apparatus
The size in region be adjusted after the second window the second attribute information, wherein, the second attribute information be used for indicate adjustment after
The second window position and size, the second window after adjustment be located in second area, and for play currently read it is more
Media data；
2) synchronization module, sets for the second attribute information and the multi-medium data currently read to be synchronized to video playing
It is standby so as to play the multi-medium data currently read in the second window of video playback apparatus after the adjustment.
Alternatively, in the present embodiment, can include but is not limited in above-mentioned first attribute information first window width,
Highly, the coordinate of left upper apex, can include but is not limited in above-mentioned second attribute information the second window after adjustment width,
Highly, the coordinate of left upper apex.
Alternatively, in the present embodiment, according to the size of above-mentioned first area and the ratio of the size of second area, conversion
Obtain the second attribute information of above-mentioned second window.
Specifically it is described with reference to the example below, it is assumed that the width of first area is x1, is highly y1, second area width
It is highly y2 for x2, the width of first window is 320, is highly 240, the coordinate of left upper apex is (10,20).Receiving
After the operational order of 10 units of translation downwards is performed to above-mentioned first window, according to the size of first area and second area ratio
Example conversion obtains the second attribute information being adjusted to the second window, and the second window is adjusted according to second attribute information, i.e.
Second window will translate corresponding distance downwards, and more matchmakers that first window is currently read are played in the second window after the adjustment
Volume data.
Alternatively, in the present embodiment, to multi-medium data in the first window in first area in video guide's equipment
Processing can be, but not limited to zoom in and out superposition by video card hardware so that reduce CPU occupancy, so as to greatly promote performance.
By the application provide embodiment, by the size according to first attribute information, the first area with
And the size of the second area obtains the second attribute information of second window after the adjustment, realizes in video playing
The data that currently read of first window are played in the second window after equipment synchronous adjustment in real time, are realized to the of first area
While one window carries out real-time operation, it can realize in the second window of the second area of video playback apparatus and reflect in real time
Penetrate, the effect being played simultaneously, thus improve existing director system can not realize to instructor in broadcasting's video of video guide's equipment into
While row operation, the multi-medium data in video guide's equipment is played in real time, and then realize can when carrying out live recording
Directly to carry out real-time instructor in broadcasting's processing to playing video, without etc. handled after the completion of review.
As a kind of optional scheme, above-mentioned synchronization module includes：
1) sub-module stored, for the second attribute information and the multi-medium data currently read to be encoded, and by institute
The video stream data obtained after coding is stated to store into memory, wherein, memory is positioned to allow for being visited by video playback apparatus
Ask.
Alternatively, in the present embodiment, above-mentioned video guide's equipment is by the second attribute information and the multimedia currently read
Data storage can include but is not limited to store the data frame after each framing control into memory into memory, wherein,
Before above-mentioned storage, can also include according to the frame per second of video playback apparatus, the frame per second of multi-medium data is carried out it is unified, on
State the unified mode of frame per second and can include but is not limited at least one of：
1) when multi-medium data is static data, i.e. only include a frame data frame, then repeat to above-mentioned frame data frame
Operation is adjusted accordingly, until meeting the frame per second (such as 20 frames/s) that video playback apparatus is specified.
For example, with reference to shown in Fig. 5,1s translations are performed to Beijing's map in window B, are translated in place from position 1
2 are put, then a frame data of above-mentioned map are added into 20 frames, wherein, corresponding translation is performed frame by frame to above-mentioned each frame,
For example, using the coordinate of the left upper apex of original map as (x1, y1) exemplified by, then during translation, by produce 20 frames be used for
Showing the translation motion of above-mentioned map, coordinate is changed to (x2, y2) ... until (x20, y20) by (x1, y1), wherein, (x1,
Y1 it is) coordinate of position 1, (x20, y20) is the coordinate of position 2.
2) when multi-medium data is dynamic video data, then the frame per second specified according to video playback apparatus (such as 20 frames/
S), sampled again according to sampling theorem to above-mentioned multi-medium data.
As an alternative embodiment, when the frame per second of above-mentioned dynamic video data is less than the frame per second specified, then it is right
The data frame of above-mentioned dynamic video carries out interleave processing, for example, some data frames in 15 frame data frames of selection carry out repeating to insert
Enter, until 20 frames, so that the data frame after adjustment meets the frame per second (such as 20 frames/s) that video playback apparatus is specified.
As another optional embodiment, when the frame per second of above-mentioned dynamic video data is more than the frame per second specified, then
Sampled again to the data frame of above-mentioned dynamic video in the case of distortionless according to sampling theorem, for example, from 25 frame numbers
According to 20 frames of sampling again in frame, so that the data frame after adjustment meets the frame per second (such as 20 frames/s) that video playback apparatus is specified.
Alternatively, in the present embodiment, above-mentioned memory can include but is not limited to a memory or two memories,
Wherein, when above-mentioned video guide's equipment and video playback apparatus are same equipment, above-mentioned memory will be a memory (example
Such as, the memory of equipment), then above-mentioned second attribute information and the above-mentioned multi-medium data currently read after encoded conversion with obtaining
To the different zones that will be respectively stored in the said equipment memory of video stream data, above-mentioned video playing application will be to slave device
The video stream data got in memory obtains the multimedia data information for being played simultaneously after being decoded；When above-mentioned video
When instructor in broadcasting's equipment and video playback apparatus are distinct device, above-mentioned memory can be different memory, video guide's equipment
The multi-medium data that second attribute information and above-mentioned first window are currently read is stored into the memory of video guide's equipment,
The video obtained after the encoded conversion of multi-medium data that above-mentioned second attribute information and above-mentioned first window are currently read
Flow data will be stored in the memory of a node device of CDN, while generates corresponding stream address, in order to which video playing is set
Standby access obtains corresponding video stream data.
Alternatively, in the present embodiment, above-mentioned storage can include but is not limited to：Covering storage.In other words, one is often obtained
Data frame after framing control, in storage all by covering before the data frame that stores, to ensure temporal synchronization, further,
Compressed package of the data frame after encoded processing after above-mentioned adjustment can also but be not limited to store in a manner of covering and store
Into the node device of CDN, wherein, the memory space in the memory of above-mentioned CDN node equipment is smaller, and video guide's equipment is with regarding
The delay being played simultaneously between frequency playback equipment is shorter.
For example, only allowing to store a compressed data packets in the memory of CDN node equipment, then often receive video guide and set
One compressed data packets of standby storage.The compressed data packets that have obtained before all covering, so that video playback apparatus can be with
Remain synchronous with the data in video guide's equipment while play.In another example only allow in the memory of CDN node equipment
Three compressed data packets are stored successively, then the 4th compressed data packets will cover first compressed data packets, the 5th compression number
Second compressed data packets will be covered according to bag, and so on.Assuming that the time that video playback apparatus starts is receiving the just
During four compressed data packets, then video playback apparatus will be played simultaneously the 4th compressed data packets institute uncompressed encoding and be obtained more matchmakers
Volume data, without repeating the data played in first to the 3rd compressed data packets, equipment is won to realize with tv channel
Be played simultaneously；Assuming that the time that video playback apparatus starts just when receiving second compressed data packets, then video is broadcast
Putting equipment also needs to obtain the first compressed data, then obtains the second compressed data packets, then there will be one for the above-mentioned process being played simultaneously
Fixed delay.
The embodiment provided by the application, by video guide's equipment by the second attribute information and the more matchmakers currently read
Volume data is stored into memory, so that video guide's equipment can directly access acquisition with video playback apparatus, so as to ensure
Video guide equipment and video playback apparatus are played simultaneously.
As a kind of optional scheme, the size of the first window after above-mentioned adjustment includes the of the first window after adjustment
One width and the first height, second width and second of the size of the second window after adjustment including the second window after adjustment are high
Degree, the size of first area include the 3rd width and third height of first area, and the size of second area includes second area
The 4th width and the 4th height；The left upper apex that the position of first window after adjustment is included in the first window after adjustment exists
The first abscissa and the first ordinate in first area, the position of the second window after adjustment include the second window after adjustment
In second abscissa and second ordinate of the left upper apex in second area；Wherein, above-mentioned adjustment module includes：
1) calculating sub module, for the second attribute information of the second window after adjustment to be calculated by the following formula：
Wherein, X1WidthRepresent the first width, X2WidthRepresent the second width；L1WidthRepresent the 3rd width, L2WidthRepresent the 4th
Width；X1HighlyRepresent the first height, X2HighlyRepresent the second height；L1HighlyRepresent third height, L2HighlyRepresent the 4th height；
X1AbscissaRepresent the first abscissa, X2AbscissaRepresent the second abscissa；X1OrdinateRepresent the first ordinate, X2OrdinateRepresent the second vertical seat
Mark.
Specifically illustrated with reference to the example below, it is assumed that by taking 10 unit translations to the right as an example, the width of first window
X1WidthFor 320, the height X1 of first windowHighlyFor 240, the width L1 of first areaWidthFor 800, the height L1 of first areaHighly
For 450, the width L2 of second areaWidthFor 1280；The height L2 of second areaHighlyFor 720.By taking left upper apex as an example, before translation,
The coordinate position of left upper apex is (10,20)；The coordinate position of left upper apex is (20,20), then according to above-mentioned Computing Principle meter
Calculate, the abscissa of left upper apex of second window before translation is that should beOrdinate isAnd the abscissa of left upper apex of second window after translation isOrdinate isCorrespondingly, the coordinate position of other pixels in window can be obtained by above-mentioned calculating, so that according to
The window's position and size after the adjustment being calculated.
The embodiment provided by the application, by above-mentioned calculation formula, is realized the firstth area in video guide's equipment
The attribute information and multi-medium data of first window in domain are mapped to second in the second area in video playback apparatus
In window, so that the real-time during improving video guide, realizes to the multimedia number to be played in director system
According to be played simultaneously.
As a kind of optional scheme, the said equipment further includes：
1) the second synchronization unit, for the first window after by adjustment the first attribute information and currently read more
When media data is synchronized to video playback apparatus, the 3rd attribute information of first area is synchronized to second area, wherein, the 3rd
Attribute information is used to indicate the first background information outside the first window the first area in so that video playback apparatus is by the
It is located at the second background information outside the second window in two regions and is adjusted to the first background information.
Be described further with reference to above-mentioned data frame, the data frame F ' after above-mentioned adjustment, will with above-mentioned first area
The first background information outside first window (assuming that the first background information is still image, then only includes a frame data
Frame) a frame data frame O is overlapped, to obtain the frame hybrid frame played out for being mapped to video playback apparatus, such as Fig. 4
Shown, multiple above-mentioned hybrid frames constitute the multi-medium data for being played out in video playback apparatus, then to above-mentioned more matchmakers
Volume data carries out Video coding, so as to export the video flowing played out in video playback apparatus.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Embodiment 3
According to embodiments of the present invention, there is provided a kind of instructor in broadcasting's audio video synchronization play system embodiment, above-mentioned instructor in broadcasting's video are same
Step play system can be, but not limited to be applied in network environment as shown in Figure 1, and above-mentioned terminal 102 is from one or more terminals
104 obtain the multi-medium data to be played, and above-mentioned multi-medium data is operated accordingly, above-mentioned to be in mode of operation
Multimedia data information will be sent to terminal 106, with realize can be played simultaneously in terminal 106 it is above-mentioned in operation shape
The multimedia data information of state.Wherein, in embodiments of the present invention, the above-mentioned network for being used to connect each terminal device can include
But it is not limited at least one of：Wide area network, Metropolitan Area Network (MAN), LAN, above-mentioned terminal can include but is not limited to it is following at least it
One：Mobile phone, tablet computer, laptop, PC machine.Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method
It but can also be not limited to be integrated in a terminal 102 and realize, that is to say, that first area in above-mentioned terminal 102 can be with
Realize and the multi-medium data to be played got is operated, the second area in above-mentioned terminal 102 is realized will be upper
The multi-medium data for stating mode of operation is played simultaneously.The example above is a kind of example, and the present embodiment does not do this any restriction.
According to embodiments of the present invention, a kind of instructor in broadcasting's audio video synchronization play system is additionally provided, as shown in fig. 7, the system bag
Include：
1) video guide's equipment 702, for receiving operational order, wherein, operational order is used for video guide's equipment
First window in first area is adjusted；The operation of operational order instruction is performed to first window, the after being adjusted
One window；The multi-medium data that video guide's equipment is currently read is played in first window after the adjustment；
2) video playback apparatus 704, for the first attribute information synchronous adjustment video according to the first window after adjustment
The second window in the second area of playback equipment, the second window after being adjusted, and broadcast in the second window after the adjustment
The multi-medium data currently read is put, wherein, the first attribute information is used for position and the size for indicating the first window after adjusting.
Alternatively, in the present embodiment, above-mentioned video guide's equipment can be, but not limited to the terminal in above-mentioned network environment
102, above-mentioned video playback apparatus can be, but not limited to the terminal 106 in above-mentioned network environment.
As a kind of optional scheme, video guide's equipment includes the first communication component, for by the first window after adjustment
First attribute information of mouth and the multi-medium data currently read are synchronized to video playback apparatus, wherein, the first communication component
Including：
1) first processor, for being obtained according to the size of the first attribute information, the size of first area and second area
Second attribute information of the second window after to adjustment, wherein, the second attribute information is used to indicate the second window after adjusting
Position and size；
2) communicator, for the second attribute information and the multi-medium data currently read to be synchronized to video playback apparatus,
So that play the multi-medium data currently read in the second window of video playback apparatus after the adjustment.
As a kind of optional scheme, communicator is realized the second attribute information and currently read more by following steps
Media data is synchronized to video playback apparatus：
S1, video guide's equipment are encoded the second attribute information and the multi-medium data currently read, and by described in
The video stream data obtained after coding is stored into memory, wherein, memory is positioned to allow for being accessed by video playback apparatus.
As a kind of optional scheme, video playback apparatus includes the second communication component, wherein, the second communication component passes through
Following steps are realized is synchronized to video playback apparatus by the second attribute information and the multi-medium data currently read：
S1, reads the second attribute information and multi-medium data from memory；
The size of second window, is adjusted to the size of the second attribute information instruction by S2, and by the second window in the secondth area
The position that position adjustment in domain is indicated to the second attribute information, the second window after being adjusted；
S3, plays the multi-medium data currently read in the second window after the adjustment.
Alternatively, the specific example in the present embodiment may be referred to showing described in above-described embodiment 1 and embodiment 2
Example, details are not described herein for the present embodiment.
Embodiment 4
An embodiment of the present invention provides a kind of terminal for being used to implement above-mentioned instructor in broadcasting's audio video synchronization playback method, the embodiment
Application environment and embodiment 1 it is same as Example 2, details are not described herein for the present embodiment.
Alternatively, in the present embodiment, above-mentioned terminal can be, but not limited to following at least one terminal：Used in director system
For being used for the terminal of video record in the terminal of video playing, director system in terminal, director system in video guide.Its
In, above-mentioned terminal can include but is not limited at least one of：Mobile phone, tablet computer, laptop, PC machine.Further,
The above-mentioned terminal for video record can also include but not limited to camera, and the above-mentioned terminal for video playing can also wrap
Include but be not limited to DTV.
For example, above-mentioned instructor in broadcasting's audio video synchronization playback method is applied to the live recording process to life match or performance
In.Specifically it is described with reference to Fig. 8-Figure 10, for example, by taking mobile phone as an example, it is assumed that above-mentioned mobile phone A, mobile phone B are to be used in director system
In the terminal of video record, mobile phone C is the terminal for being used for video guide in director system, and mobile phone D is to be used to regard in director system
The terminal that frequency plays.Mobile phone A collection is recorded to goalkeeper's video near the football pitch goal as shown in Fig. 8 (a), and mobile phone B is adopted
Collection is recorded to the close shot video for the sportsman that dribbles in the football pitch as shown in Fig. 8 (b), and the mobile phone C as instructor in broadcasting can be right in real time
The video that mobile phone A and mobile phone B collection are recorded carries out unified edit operation, it is assumed that and sportsman is in field position for dribbling, in order to
The video of viewing dribbling sportsman, as shown in figure 9, instructor in broadcasting reduces the picture that mobile phone A collection is recorded, and gathers mobile phone B
The picture amplification of recording, is dragged to picture center, in order to user not at the scene by mobile phone D can also direct viewing to mobile phone
Live ball match after C operations is live, is adjusted so as to fulfill by the real-time operation of mobile phone C so that user at the scene does not pass through
Mobile phone D can directly share the picture of mobile phone C, as shown in Figure 10.Further, mobile phone C can also be according to user not at the scene
Different demands, adjust corresponding video pictures in real time, thus reach ordinary user can also realize to live broadcast record
Picture carry out real-time instructor in broadcasting's adjustment, and with the picture of users to share adjustment not at the scene.
In another example the security monitoring that can also be applied to above-mentioned instructor in broadcasting's audio video synchronization playback method to certain environment is recorded
During.For example, the above-mentioned terminal for video record is different cameras, the just real-time road in real-time recording different sections of highway
Condition, the terminal for video guide are instructor in broadcasting's PC machine of monitoring room, and the terminal for video playing can be any mobile terminal.
Assuming that traffic accident occurs at the A of section, then instructor in broadcasting's PC machine of monitoring room can directly acquire the video of section A, and be regarded from this
The image of hit-run driver is obtained in frequency, the current picture of monitoring room PC machine is then adjusted, for example, reducing the straight of other sections
Recording picture is broadcast, section A is recorded into picture and the image magnification of hit-run driver, and above-mentioned picture is passed through into this implementation
Described method is synchronized on the mobile terminal of neighbouring traffic police in example, can be by above-mentioned picture with finding accident easy to traffic police
Point, also can nearby search accident driver.Further, the PC machine of above-mentioned monitoring room can also obtain neighbouring hospital by network
Distribution map, by above-mentioned distribution map drag and drop to picture center, so that reaching the personnel at scene can be played by mobile terminal synchronization
Picture directly the wounded is sent to nearby hospitals.
Alternatively, the specific example in the present embodiment may be referred to showing described in above-described embodiment 1 and embodiment 2
Example, details are not described herein for the present embodiment.
Embodiment 5
According to embodiments of the present invention, there is provided a kind of storage medium embodiment, above-mentioned storage medium can be, but not limited to position
In terminal 102 in network environment as shown in Figure 1, above-mentioned terminal 102 obtains to be played from one or more terminals 104
Multi-medium data, and above-mentioned multi-medium data is operated accordingly, the above-mentioned multi-medium data letter in mode of operation
Breath will be sent to terminal 106, and the above-mentioned multi-medium data in mode of operation can be played simultaneously in terminal 106 to realize
Information.Wherein, in embodiments of the present invention, it is above-mentioned be used for connect each terminal device network can include but is not limited to down toward
It is one of few：Wide area network, Metropolitan Area Network (MAN), LAN, above-mentioned terminal can include but is not limited at least one of：Mobile phone, tablet electricity
Brain, laptop, PC machine, DTV.Alternatively, in the present embodiment, above-mentioned instructor in broadcasting's audio video synchronization playback method also may be used
With but be not limited to be integrated in a terminal 102 and realize.The example above is a kind of example, and the present embodiment does not do this any limit
It is fixed.
Alternatively, the embodiment of the present invention additionally provides a kind of storage medium.
Alternatively, in the present embodiment, storage medium is arranged to the program code that storage is used to perform following steps：
S1, receives operational order, wherein, operational order is used for the first window in the first area of video guide's equipment
It is adjusted；
S2, performs first window the operation of operational order instruction, the first window after being adjusted；
S3, the multi-medium data that video guide's equipment is currently read is played in first window after the adjustment；
S4, video is synchronized to by the first attribute information of the first window after adjustment and the multi-medium data currently read
Playback equipment so that video playback apparatus adjusts video playback apparatus according to the first attribute information of the first window after adjustment
The second window in second area, the second window after being adjusted, and current read is played in the second window after the adjustment
Multi-medium data, wherein, the first attribute information be used for indicate adjustment after first window position and size.
Alternatively, in the present embodiment, above-mentioned storage medium can include but is not limited to：USB flash disk, read-only storage (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disc or
CD etc. is various can be with the medium of store program codes.
Alternatively, the specific example in the present embodiment may be referred to showing described in above-described embodiment 1 and embodiment 2
Example, details are not described herein for the present embodiment.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
If the integrated unit in above-described embodiment is realized in the form of SFU software functional unit and is used as independent product
Sale or in use, the storage medium that above computer can be read can be stored in.Based on such understanding, skill of the invention
The part or all or part of the technical solution that art scheme substantially in other words contributes the prior art can be with soft
The form of part product embodies, which is stored in storage medium, including some instructions are used so that one
Platform or multiple stage computers equipment (can be personal computer, server or network equipment etc.) perform each embodiment institute of the present invention
State all or part of step of method.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not have in some embodiment
The part of detailed description, may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed client, can be by others side
Formula is realized.Wherein, device embodiment described above is only schematical, such as the division of the unit, is only one
Kind of division of logic function, can there is an other dividing mode when actually realizing, for example, multiple units or component can combine or
Another system is desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or discussed it is mutual it
Between coupling, direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
Connect, can be electrical or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit
The component shown may or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
In network unit.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (11)
- A kind of 1. instructor in broadcasting's audio video synchronization playback method, it is characterised in that including：Receive operational order, wherein, the operational order be used for the first window in the first area of video guide's equipment into Row adjustment；The operation of the operational order instruction, the first window after being adjusted are performed to the first window；The multi-medium data that video guide's equipment is currently read is played in the first window after the adjustment；First attribute information of the first window after the adjustment and the multi-medium data currently read is synchronous To video playback apparatus；Wherein, the first attribute information of the first window by after the adjustment and the multimedia currently read Data, which are synchronized to video playback apparatus, to be included：According to first attribute information, the first area size and described regard The size of the second area of frequency playback equipment be adjusted after the second window the second attribute information, wherein, it is described second belong to Property information be used for the position and the size that indicate second window after the adjustment, the second window position after the adjustment In in the second area, and for playing the multi-medium data currently read；By second attribute information and described The multi-medium data currently read is synchronized to video playback apparatus so that the video playback apparatus is described in after the adjustment The multi-medium data currently read is played in second window；Wherein, it is described that second attribute information and the multi-medium data currently read are synchronized to video playback apparatus bag Include：Video guide's equipment is encoded second attribute information and the multi-medium data currently read, and will The video stream data obtained after the coding is stored into memory, wherein, the memory is positioned to allow for by the video Playback equipment accesses；Wherein, the memory further includes the frame per second according to video playback apparatus, unites to the frame per second of the multi-medium data One；Wherein, the frame per second of the multi-medium data is uniformly included：When the multi-medium data is static data, then weigh It is multiple that operation is adjusted accordingly to previous frame data frame, until meeting the frame per second that the video playback apparatus is specified；When described more When media data is dynamic video data, the frame per second specified according to the video playback apparatus, to the multi-medium data according to Sampling theorem is sampled again.
- 2. according to the method described in claim 1, it is characterized in that, described by second attribute information and described current read Multi-medium data be synchronized to video playback apparatus and include：The video playback apparatus reads second attribute information and the multi-medium data from the memory；The size of second window is adjusted to the size of the second attribute information instruction by the video playback apparatus, and will The position that position adjustment of second window in the second area is indicated to second attribute information, obtains the tune Second window after whole；The video playback apparatus plays the multi-medium data currently read in second window after the adjustment.
- 3. according to the method described in claim 1, it is characterized in that, the size of the first window after the adjustment includes institute The first width and the first height, the size of second window after the adjustment for stating the first window after adjustment include Second width of second window after the adjustment and the second height, the size of the first area include firstth area 3rd width and third height in domain, fourth width and fourth of the size including the second area of the second area are high Degree；The left upper apex that the position of the first window after the adjustment is included in the first window after the adjustment exists The first abscissa and the first ordinate in the first area, the position of second window after the adjustment is including described Second abscissa and second ordinate of the left upper apex in second window in the second area after adjustment；Wherein, the size according to first attribute information, the size of the first area and the second area obtains Second attribute information of second window after to the adjustment includes：After the adjustment is calculated by the following formula Second attribute information of second window：The X1WidthRepresent first width, the X2WidthRepresent second width；The L1WidthRepresent the 3rd width, the L2WidthRepresent the 4th width；The X1HighlyRepresent first height, the X2HighlyRepresent second height；The L1HighlyRepresent the third height, the L2HighlyRepresent the 4th height；The X1AbscissaRepresent first abscissa, the X2AbscissaRepresent second abscissa；The X1OrdinateRepresent first ordinate, the X2OrdinateRepresent second ordinate.
- 4. according to the method described in claim 1, it is characterized in that, the first category of the first window after by the adjustment When property information and the multi-medium data currently read are synchronized to video playback apparatus, further include：3rd attribute information of the first area is synchronized to the second area, wherein, the 3rd attribute information is used for Indicate to be located at the first background information outside the first window in the first area so that the video playback apparatus is by institute State the second background information being located in second area outside second window and be adjusted to first background information.
- 5. according to the described method of any one of claim 1-4, it is characterised in that the multi-medium data include it is following at least One of：Video, word, image.
- A kind of 6. video guide's equipment, it is characterised in that including：Receiving unit, for receiving operational order, wherein, the operational order is used for the firstth area to video guide's equipment First window in domain is adjusted；Operating unit, for performing the operation of operational order instruction to the first window, described the after being adjusted One window；Broadcast unit, for played in the first window after the adjustment video guide's equipment currently read it is more Media data；First synchronization unit, for by the first attribute information of the first window after the adjustment and described current reading Multi-medium data be synchronized to video playback apparatus；Wherein, first synchronization unit includes：Module is adjusted, for according to first attribute information, the size of the first area and the video playback apparatus Second area size be adjusted after the second window the second attribute information, wherein, second attribute information is used for Indicate position and the size of second window after the adjustment, second window after the adjustment is located at described second In region, and for playing the multi-medium data currently read；Synchronization module, for second attribute information and the multi-medium data currently read to be synchronized to video playing and set It is standby so that the video playback apparatus plays the multimedia number currently read in second window after the adjustment According to；Wherein, the synchronization module includes：Sub-module stored, for second attribute information and the multi-medium data currently read to be encoded, and will The video stream data obtained after the coding is stored into memory, wherein, the memory is positioned to allow for by the video Playback equipment accesses；Wherein, the memory further includes the frame per second according to video playback apparatus, unites to the frame per second of the multi-medium data One；Wherein, the frame per second of the multi-medium data is uniformly included：When the multi-medium data is static data, then weigh It is multiple that operation is adjusted accordingly to previous frame data frame, until meeting the frame per second that the video playback apparatus is specified；When described more When media data is dynamic video data, the frame per second specified according to the video playback apparatus, to the multi-medium data according to Sampling theorem is sampled again.
- 7. equipment according to claim 6, it is characterised in that the size of the first window after the adjustment includes institute The first width and the first height, the size of second window after the adjustment for stating the first window after adjustment include Second width of second window after the adjustment and the second height, the size of the first area include firstth area 3rd width and third height in domain, fourth width and fourth of the size including the second area of the second area are high Degree；The left upper apex that the position of the first window after the adjustment is included in the first window after the adjustment exists The first abscissa and the first ordinate in the first area, the position of second window after the adjustment is including described Second abscissa and second ordinate of the left upper apex in second window in the second area after adjustment；Wherein, the adjustment module includes：Calculating sub module, described in being calculated by the following formula after the adjustment Second attribute information of the second window：The X1WidthRepresent first width, the X2WidthRepresent second width；The L1WidthRepresent the 3rd width, the L2WidthRepresent the 4th width；The X1HighlyRepresent first height, the X2HighlyRepresent second height；The L1HighlyRepresent the third height, the L2HighlyRepresent the 4th height；The X1AbscissaRepresent first abscissa, the X2AbscissaRepresent second abscissa；The X1OrdinateRepresent first ordinate, the X2OrdinateRepresent second ordinate.
- 8. equipment according to claim 6, it is characterised in that further include：Second synchronization unit, the first attribute information and the current reading for the first window after by the adjustment When the multi-medium data taken is synchronized to video playback apparatus, the 3rd attribute information of the first area is synchronized to described second Region, wherein, the 3rd attribute information is used to indicate to be located in the first area first back of the body outside the first window Scape information so that the second background information that the video playback apparatus will be located at outside second window in the second area It is adjusted to first background information.
- 9. according to the equipment any one of claim 6-8, it is characterised in that the multi-medium data include it is following at least One of：Video, word, image.
- A kind of 10. instructor in broadcasting's audio video synchronization play system, it is characterised in that including：Video guide's equipment, for receiving operational order, wherein, the operational order is used for the firstth area to video guide's equipment First window in domain is adjusted；The operation of the operational order instruction is performed to the first window, after being adjusted The first window；The multimedia that video guide's equipment is currently read is played in the first window after the adjustment Data；Video playback apparatus, for being regarded described in the first attribute information synchronous adjustment according to the first window after the adjustment The second window in the second area of frequency playback equipment, second window after being adjusted, and the institute after the adjustment State and the multi-medium data currently read is played in the second window, wherein, first attribute information is used to indicate the tune The position of the first window after whole and size；Wherein, video guide's equipment includes the first communication component, for by of the first window after the adjustment One attribute information and the multi-medium data currently read are synchronized to video playback apparatus, wherein, first communication unit Part includes：First processor, for according to first attribute information, the size of the first area and the second area Size obtain the second attribute information of second window after the adjustment, wherein, second attribute information be used for refer to Show position and the size of second window after the adjustment；Communicator, for by second attribute information and it is described work as The multi-medium data of preceding reading is synchronized to video playback apparatus so that the video playback apparatus after the adjustment described The multi-medium data currently read is played in two windows；Wherein, the communicator is realized described by second attribute information and the more matchmakers currently read by following steps Volume data is synchronized to video playback apparatus：Video guide's equipment is encoded second attribute information and the multi-medium data currently read, and will The video stream data obtained after the coding is stored into memory, wherein, the memory is positioned to allow for by the video Playback equipment accesses；Wherein, the memory further includes the frame per second according to video playback apparatus, unites to the frame per second of the multi-medium data One；Wherein, the frame per second of the multi-medium data is uniformly included：When the multi-medium data is static data, then weigh It is multiple that operation is adjusted accordingly to previous frame data frame, until meeting the frame per second that the video playback apparatus is specified；When described more When media data is dynamic video data, the frame per second specified according to the video playback apparatus, to the multi-medium data according to Sampling theorem is sampled again.
- 11. system according to claim 10, it is characterised in that the video playback apparatus includes the second communication component, Wherein, second communication component by following steps realize it is described by second attribute information and it is described currently read it is more Media data is synchronized to video playback apparatus：Second attribute information and the multi-medium data are read from the memory；The size of second window is adjusted to the size of the second attribute information instruction, and by second window in institute The position that the position adjustment in second area is indicated to second attribute information is stated, obtains second window after the adjustment Mouthful；The multi-medium data currently read is played in second window after the adjustment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410441820.4A CN104602127B (en) | 2014-09-01 | 2014-09-01 | Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410441820.4A CN104602127B (en) | 2014-09-01 | 2014-09-01 | Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104602127A CN104602127A (en) | 2015-05-06 |
| CN104602127B true CN104602127B (en) | 2018-05-04 |
Family
ID=53127560
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410441820.4A Active CN104602127B (en) | 2014-09-01 | 2014-09-01 | Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104602127B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105872795A (en) * | 2015-11-20 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Video playing method and device |
| CN105915839A (en) * | 2015-12-07 | 2016-08-31 | 乐视云计算有限公司 | Multi-channel video display method of broadcast instructing platform and multi-channel video display device thereof |
| CN106993194A (en) * | 2016-01-20 | 2017-07-28 | 上海慧体网络科技有限公司 | A kind of method that use mobile phone carries out long-range instructor in broadcasting |
| CN105933738B (en) * | 2016-06-27 | 2019-01-04 | 徐文波 | Net cast methods, devices and systems |
| CN106028120A (en) * | 2016-06-27 | 2016-10-12 | 徐文波 | Method and device for performing video direction in mobile terminal |
| CN107027045A (en) * | 2017-04-11 | 2017-08-08 | 广州华多网络科技有限公司 | Pushing video streaming control method, device and video flowing instructor in broadcasting end |
| CN108243345A (en) * | 2017-06-20 | 2018-07-03 | 广州华多网络科技有限公司 | A kind of video stream pushing method |
| CN107257506A (en) * | 2017-06-29 | 2017-10-17 | 徐文波 | Many picture special efficacy loading methods and device |
| CN108965899A (en) * | 2017-11-22 | 2018-12-07 | 北京视联动力国际信息技术有限公司 | A kind of method of video image processing and device based on view networking |
| CN109862410B (en) * | 2017-11-30 | 2021-12-10 | 腾讯科技（深圳）有限公司 | Recommendation information insertion method, device and storage medium |
| CN110505489A (en) * | 2019-08-08 | 2019-11-26 | 咪咕视讯科技有限公司 | Video processing method, communication device, and computer-readable storage medium |
| CN114449309B (en) * | 2022-02-14 | 2023-10-13 | 杭州登虹科技有限公司 | Dynamic diagram playing method for cloud guide |
| CN114840124B (en) * | 2022-03-30 | 2024-08-02 | 神力视界(深圳)文化科技有限公司 | Display control method, device, electronic equipment, medium and program product |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100417155C (en) * | 2003-05-08 | 2008-09-03 | 上海交通大学 | Multiple mode real-time multimedia interaction system for long distance teaching |
| CN100345102C (en) * | 2004-11-30 | 2007-10-24 | 北京中科大洋科技发展股份有限公司 | Multiple picture frame splitting system |
| CN102186038A (en) * | 2011-05-17 | 2011-09-14 | 浪潮(山东)电子信息有限公司 | Method for synchronously playing multi-viewing-angle pictures on digital television screen |
| CN103164991A (en) * | 2013-03-01 | 2013-06-19 | 广州市信和电信发展有限公司 | Network interactive teaching and research application system |
| CN103813199A (en) * | 2013-11-29 | 2014-05-21 | 乐视致新电子科技（天津）有限公司 | Desktop display method and device and intelligent television |
| CN103700360A (en) * | 2013-12-09 | 2014-04-02 | 乐视致新电子科技（天津）有限公司 | Screen display proportion regulating method and electronic equipment |
| CN103796076A (en) * | 2014-03-03 | 2014-05-14 | 联想(北京)有限公司 | Data processing method and corresponding media playing device and playing control device |
-
2014
- 2014-09-01 CN CN201410441820.4A patent/CN104602127B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN104602127A (en) | 2015-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104602127B (en) | Instructor in broadcasting's audio video synchronization playback method and system and video guide's equipment | |
| US9363542B2 (en) | Techniques to provide an enhanced video replay | |
| US10691202B2 (en) | Virtual reality system including social graph | |
| CN108713322B (en) | Method and apparatus for preparing video content and playing back encoded content | |
| US8745657B2 (en) | Inserting interactive objects into video content | |
| KR102434832B1 (en) | Method for providing artificial intelligence based virtual travel service using real-time background segmentation and object synthesis model | |
| US20110066929A1 (en) | System and method for providing information of selectable objects in a still image file and/or data stream | |
| US10701426B1 (en) | Virtual reality system including social graph | |
| CN107801083A (en) | A kind of network real-time interactive live broadcasting method and device based on three dimensional virtual technique | |
| WO2019192509A1 (en) | Media data processing method and apparatus | |
| CN106162221A (en) | The synthetic method of live video, Apparatus and system | |
| CN108833937A (en) | Method for processing video frequency and device | |
| CN113891117B (en) | Immersion medium data processing method, device, equipment and readable storage medium | |
| CN107027070A (en) | Method, terminal and the system of information are implanted into video | |
| WO2019007120A1 (en) | Method and device for processing media data | |
| WO2023202095A1 (en) | Point cloud media encoding method and apparatus, point cloud media decoding method and apparatus, and electronic device and storage medium | |
| CN114245228B (en) | Page link release method and device and electronic equipment | |
| JP2019514313A (en) | Method, apparatus and stream for formatting immersive video for legacy and immersive rendering devices | |
| CN104301657A (en) | Conference television terminal and auxiliary flow data access method thereof | |
| CN104270681B (en) | video information playing method and device | |
| CN103442202B (en) | Video communication method and device | |
| CN112771878B (en) | Method, client and server for processing media data | |
| CN108320331A (en) | A kind of method and apparatus for the augmented reality video information generating user's scene | |
| CN106792219B (en) | It is a kind of that the method and device reviewed is broadcast live | |
| KR101221540B1 (en) | Interactive media mapping system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |