CN102223569A - Multi-path video processing method - Google Patents
Multi-path video processing method Download PDFInfo
- Publication number
- CN102223569A CN102223569A CN2011101586153A CN201110158615A CN102223569A CN 102223569 A CN102223569 A CN 102223569A CN 2011101586153 A CN2011101586153 A CN 2011101586153A CN 201110158615 A CN201110158615 A CN 201110158615A CN 102223569 A CN102223569 A CN 102223569A
- Authority
- CN
- China
- Prior art keywords
- information
- video
- audiovisual information
- terminal
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The embodiment of the invention relates to a multi-path video processing method. In the method, transmitted audio and video information is filtered so as to implement multi-path video transmission; and multi-path decoding of the video is implemented through multiplexing of a single decoder, so that network bandwidth resource is saved, cost is reduced and video transmission efficiency is improved.
Description
Technical field
The invention belongs to the communications field, relate in particular to a kind of multipath video processing method.
Background technology
Existing program browsing solution is that media server issues about the literal of program or pictorial information on terminal, and terminal represents literal or pictorial information in the program guide face that receives to the user.Because literal and information that picture provides have limitation, and the content in the direct broadcast band program is real-time change, and common literal or picture browsing can't intuitively reflect the direct broadcast band programme content.
Utilize video tour to replace literal or picture browsing in the prior art one.Media server issues the video information of relevant program, and the user can be more directly perceived by browsing the video information that has rich content, and understand programme content in real time.But because the restriction of the network bandwidth and terminal chip disposal ability, terminal equipment is generally only supported one tunnel video playback at present, can't realize the function that multi-channel video is browsed.If realize that by improving the network bandwidth and terminal chip disposal ability multi-channel video browses, cost is higher, generally will not adopt.
In the prior art two, in video information compression to a video of media server encoder with a plurality of programs, terminal realizes " a plurality of " program browsing by playing through the video of overcompression again.There is following defective in the method that this multi-channel video is browsed: encoder needs the function of compression multi-channel video to one road video, and cost is higher; Owing to rely on encoder and media server, make that video information control and browse operation are dumb, realize that difficulty is big.
Summary of the invention
The embodiment of the invention provides a kind of multipath video processing method, browses the cost height, realizes defectives such as difficulty is big in order to carry out multi-channel video in the solution prior art, realizes that the multiplexing of video information is browsed.
A kind of multipath video processing method comprises:
Terminal and media server are set up a plurality of paths that communicate to connect;
Filtered audio information is looked in described terminal setting, and the filtered audio information of looking of described setting is sent to described media server;
Described terminal is based on described a plurality of paths that communicate to connect, receive the audiovisual information through filtration treatment, described audiovisual information through filtration treatment is that described media server carries out sending by described a plurality of paths that communicate to connect after the filtration treatment to audiovisual information;
The described audiovisual information that described end-on is received is decoded.
The multipath video processing method that the embodiment of the invention provides passes through the filtration treatment to the audiovisual information that sends, and realizes the multi-channel video transmission, has saved network bandwidth resources, has reduced cost, improves video transmission efficient.
Description of drawings
Fig. 1 is a video transmission method flow chart in the embodiments of the invention multipath video processing method;
Fig. 2 is another video transmission method flow chart in the embodiments of the invention multipath video processing method;
Fig. 3 is a video encoding/decoding method flow chart in the embodiments of the invention multipath video processing method;
Fig. 4 is multipath video processing method embodiment one flow chart of the present invention;
Fig. 5 is multipath video processing method embodiment two flow charts of the present invention;
Fig. 6 is many video tours schematic diagram among the multipath video processing method embodiment two of the present invention;
Fig. 7 is multipath video processing method embodiment three flow charts of the present invention;
Fig. 8 is way of output embodiment one schematic diagram of multi channel surfing of the present invention;
Fig. 9 is way of output embodiment two schematic diagrames of multi channel surfing of the present invention;
Figure 10 is way of output embodiment three schematic diagrames of multi channel surfing of the present invention;
Figure 11 is multipath video processing method embodiment four flow charts of the present invention;
Figure 12 is multipath video processing method embodiment five flow charts of the present invention;
Figure 13 is multipath video processing method embodiment six flow charts of the present invention;
Figure 14 is terminal embodiment one structural representation of the present invention;
Figure 15 is terminal embodiment two structural representations of the present invention;
Figure 16 is a media server example structure schematic diagram of the present invention;
Figure 17 is a multi-channel video treatment system example structure schematic diagram of the present invention.
Embodiment
Further specify technical scheme of the present invention below in conjunction with the drawings and specific embodiments.
Video transmission method embodiment
Fig. 1 as shown in Figure 1, comprises the steps: for video transmission method flow chart among the multipath video processing method embodiment of the present invention
Media server issues the multichannel audiovisual information, and each road audiovisual information should transmit by the path that communicates to connect of one tunnel correspondence.According to the way of the audiovisual information that will transmit, set up the communicate to connect path identical between media server and the terminal with its way, finish the multiplexing of audiovisual information.
The filtered audio information of looking that step 101, basis receive is handled the audiovisual information that will send;
Under the prerequisite that is implemented in the low bandwidth transmission, carry out the audiovisual information transmission of multichannel, the audiovisual information on each road that reply is transmitted carries out suitable processing.Before media server issues video information, will be to the filtering policy of terminal inquiry audiovisual information processing, according to the filtered audio information of looking that receives each road audiovisual information that will transmit is at first carried out filtration treatment, reduce the bandwidth resources that each road audiovisual information takies, realize that the multichannel audiovisual information issues simultaneously.
Media server will be through the audiovisual information on each road of filtration treatment, is handed down to terminal by the path that communicates to connect for the correspondence of its foundation.Be that the multichannel audiovisual information sends to terminal by each self-corresponding path that communicates to connect when issuing.Under the prerequisite of low bandwidth, realize that the multichannel audiovisual information transmits simultaneously.
Further, according to the filtered audio information of looking that receives the audiovisual information that will send is handled in the step 101, be specifically as follows the described filtered audio information of looking, the audio frame in the described audiovisual information is carried out filtration treatment according to filtration fraction or all audio frequency frame.Be that media server is to filter out all audio frames to the filtering policy that audiovisual information carries out filtration treatment.Since the image information during video tour in the general main concern program, and do not need sound, so can abandon part or all of audio frame, keep frame of video, like this to not influence of video tour.By filtering out audio-frequency information, reduce the bandwidth resources that take, transmission when the multichannel audiovisual information can be realized effectively.
According to the filtered audio information of looking that receives the audiovisual information that will send is handled in the step 101, specifically can also carry out filtration treatment to the non-video key frame in the described audiovisual information for the described filtered audio information of looking according to filtration fraction or whole non-video key frames.Be that media server carries out the filtering policy of filtration treatment for filtering out part or all of non-video key frame to audiovisual information.Audiovisual information comprises key frame of video and non-video key frame, because key frame of video is the frame that can independently decode, so abandon the decoding that non-key frame can not influence key frame of video.Under the prerequisite that does not influence video decode, abandon part or all of non-video key frame, can reduce the bandwidth resources that take equally, realize the audiovisual information multiplexing.
In order to reduce the bandwidth resources that each road audiovisual information takies again further, can also on the basis that abandons part or all of non-video key frame, abandon the key frame of video of part, send the part key frame of video, thereby further reduce transmission bandwidth.Media server can also carry out filtration treatment to audiovisual information according to the percent information that key frame of video in the filtering policy abandons.
According to the filtered audio information of looking that receives the audiovisual information that will send is handled in the step 101, concrete again can be for according to the described filtered audio information of looking that sends and abandon the audiovisual information duration, control sending and abandoning described audiovisual information, be that media server is the transmission of the every audiovisual information on the way of control and abandons the time the filtering policy that audiovisual information carries out filtration treatment, with one road audiovisual information send last till the transmitting time of setting after, stop to send, then will descend audiovisual information on the way to send according to transmitting time.Each road sends by turns.Only have one road audiovisual information to send in the transmission course, the audiovisual information on other each roads all is in discarding state.Be implemented in the purpose that sends the audiovisual information of multichannel in a period of time by sending by turns of each road.Media server can carry out transmission process according to the transmission and the time that abandons set, and also can carry out transmission process according to the time scale that sends and abandon.
Above-described various filtering policy can be used alone or in combination, and also can unite use in conjunction with the control method of the reduction bandwidth that has other now.In the present embodiment, media server can carry out filtration treatment to looking audio frame according to filtering policy when terminal equipment sends media data, discards part and looks audio frame, reduces video transmission bandwidth, thereby realizes the purpose of transmitting multi-path video stream under the low bandwidth.
Another video transmission method embodiment
Fig. 2 as shown in Figure 2, comprises the steps: for another video transmission method flow chart among the multipath video processing method embodiment of the present invention
Terminal receives the multichannel audiovisual information, each road audiovisual information should receive by the path that communicates to connect of one tunnel correspondence, way according to the audiovisual information that will receive, set up the communicate to connect path identical between terminal and the media server, finish the reception of multichannel audiovisual information with its quantity.
Filtered audio information is looked in step 201, setting;
Under the prerequisite that is implemented in the low bandwidth transmission, receive the audiovisual information of multichannel simultaneously, the audiovisual information on each road that reply is transmitted carries out suitable processing.Terminal is according to the quantity of video tour, and the filtering policy that audiovisual information is set is adjusted the transmission bandwidth on each road, thereby is implemented in transmission when realizing multi-path video stream under the limited bandwidth.
Terminal receives the audiovisual information through the media server filtration treatment by the path that communicates to connect of the correspondence set up for the video flowing on each road.
Further, be provided with in the step 201 look filtered audio information can be for looking the filtering information that the filtered audio information setting is filtration fraction or all audio frequency frame with described; By abandoning part or all of audio frame, reduce the bandwidth resources that each road takies; Terminal also can will be looked the filtering information that the filtered audio information setting is filtration fraction or whole non-video key frames, and requiring media server to filter out does not influence the non-key frame of video of video decode, reaches the purpose that lowers occupied bandwidth; On the basis of filtration fraction or whole non-key frame of video, can also abandon the part key frame of video, further reduce the bandwidth resources that take; Terminal also can be provided with described looking in the filtered audio information duration that sends and abandon described audiovisual information in looking filtered audio information, the duration that sends and abandon audiovisual information in each road is controlled.The duration ratio that sends and abandon audiovisual information also can be set.
Above-described various filtering policy can be provided with alone or in combination, also can unite setting in conjunction with the control method of the reduction bandwidth that has other now.
In above-described each video transmission method, control protocol between terminal equipment and the media server and Data Transport Protocol both can adopt the stream media protocol of standard, as RTSP, RTP, TS etc., also can on the Streaming Media host-host protocol of standard, expand, also can adopt privately owned agreement.
Video encoding/decoding method embodiment
Fig. 3 as shown in Figure 3, comprises the steps: for video encoding/decoding method flow chart among the multipath video processing method embodiment of the present invention
Terminal and media server set up according to video tour quantity equal number communicate to connect path after, receive before the multi-path video stream, at first distribute corresponding core buffer for each communicates to connect path in internal memory, pending buffer receives the multi-channel video stream information.When upright one tunnel video tour of every establishment connects, the frame of video that playing program is used for this road connection of buffer memory can for this road core buffer of video tour distribution.
Media server is each road Video stream information, and the path that communicates to connect by correspondence is handed down to terminal, and terminal is stored in it in core buffer of the correspondence of allocating in advance after receiving each road video flowing.The buffer memory task is saved in the frame of video that receives in the core buffer of every road video tour connection, if buffering area is full, then overrides stored video frames at first.
In order to realize the multiplexed of decoder, the decoding task of playing program can be checked the core buffer of the video tour program correspondence on every road according to multiplex strategy, if the frame of video of new reception is arranged in the core buffer of certain video tour program of discovery, then calls the interface of decoder the frame of video of this buffering area is decoded.
The decoding multiplexing strategy can be the poll strategy, promptly checks described core buffer in regular turn, and the described audiovisual information that is stored in the described core buffer is decoded; Decoding task is checked the core buffer that each video tour connects in order successively, if find that buffering area has frame of video just to decode.
The decoding multiplexing strategy can also be notification strategy, promptly according to the decoding solicited message that receives, the described audiovisual information that is stored in the described core buffer is decoded; When having in certain core buffer can decoded video frames the time, playing program sends the decoding solicited message, and the proactive notification decoding task is decoded.
Above decoding multiplexing strategy can be used alone or in combination, and also can unite use in conjunction with the multiplexed coding/decoding method of single decoder that has other now.In the video encoding/decoding method that present embodiment provides, playing program is core buffer of program distribution of every road video tour, the media data that playing program will receive every road video flowing is saved in separately the core buffer, playing program is checked the core buffer of every road program according to multiplex strategy simultaneously, if find that having data then to take out in the buffering area decodes.By decoding multiplexing, only need one tunnel media decoder just can finish the function that multi-channel program is decoded simultaneously.
Multipath video processing method embodiment one
Fig. 4 is multipath video processing method embodiment one flow chart of the present invention, based on aforesaid video transmission method and video encoding/decoding method embodiment, as shown in Figure 4, comprises the steps:
Terminal receives the multichannel audiovisual information, each road audiovisual information should receive by the path that communicates to connect of one tunnel correspondence, way according to the audiovisual information that will receive, set up the communicate to connect path identical between terminal and the media server, finish the reception of multichannel audiovisual information with its quantity.Under the prerequisite that is implemented in the low bandwidth transmission, receive the audiovisual information of multichannel simultaneously, the audiovisual information on each road that reply is transmitted carries out suitable processing.Terminal is according to the quantity of video tour, and the filtering policy that audiovisual information is set is adjusted the transmission bandwidth on each road, thereby is implemented in transmission when realizing multi-path video stream under the limited bandwidth.Media server sends to terminal after according to the filtered audio information of looking of terminal setting the audiovisual information that will send being carried out filtration treatment, and terminal receives the audiovisual information of every road through filtration treatment by the path of setting up that communicates to connect again.
The filtered audio information of looking of terminal setting can be for looking the filtering information that the filtered audio information setting is filtration fraction or all audio frequency frame with described; By abandoning part or all of audio frame, reduce the bandwidth resources that each road takies; Terminal also can will be looked the filtering information that the filtered audio information setting is filtration fraction or whole non-video key frames, and requiring media server to filter out does not influence the non-key frame of video of video decode, reaches the purpose that lowers occupied bandwidth; On the basis of filtration fraction or whole non-key frame of video, can also abandon the part key frame of video, further reduce the bandwidth resources that take; Terminal also can be provided with described looking in the filtered audio information duration that sends and abandon described audiovisual information in looking filtered audio information, the duration that sends and abandon audiovisual information in each road is controlled.The duration ratio that sends and abandon audiovisual information also can be set.Above-described various filtering policy can be provided with alone or in combination, also can unite setting in conjunction with the control method of the reduction bandwidth that has other now.
Terminal and media server set up according to video tour quantity equal number communicate to connect path after, receive before the multi-path video stream, terminal is at first distributed corresponding core buffer for each communicates to connect path in internal memory, pending buffer receives the multi-channel video stream information.Media server is each road Video stream information, and the path that communicates to connect by correspondence is handed down to terminal, and terminal is stored in it in core buffer of the correspondence of allocating in advance after receiving each road video flowing.The decoding task of playing program can be checked the core buffer of the video tour program correspondence on every road according to multiplex strategy, if the frame of video of new reception is arranged in the core buffer of certain video tour program of discovery, then calls the interface of decoder the frame of video of this buffering area is decoded.
The decoding multiplexing strategy can be the poll strategy, promptly checks described core buffer in regular turn, and the described audiovisual information that is stored in the described core buffer is decoded; Decoding task is checked the core buffer that each video tour connects in order successively, if find that buffering area has frame of video just to decode.The decoding multiplexing strategy can also be notification strategy, promptly according to the decoding solicited message that receives, the described audiovisual information that is stored in the described core buffer is decoded; When having in certain core buffer can decoded video frames the time, playing program sends the decoding solicited message, and the proactive notification decoding task is decoded.By decoding multiplexing, only need one tunnel media decoder just can finish the function that multi-channel program is decoded simultaneously and browsed.Above decoding multiplexing strategy can be used alone or in combination, and also can unite use in conjunction with the multiplexed coding/decoding method of single decoder that has other now.
Control protocol between terminal equipment and the media server and Data Transport Protocol both can adopt the stream media protocol of standard, as RTSP, RTP, TS etc., also can expand on the Streaming Media host-host protocol of standard, also can adopt privately owned agreement.
After the multi-path video stream information via decoding processing, also comprise the described audiovisual information of output through decoding.Audiovisual information will be exported by display terminal, but because terminal generally only provides the output of one road video, in order to realize that the multi-channel video image is in different positions, according to different size output, playing program is transcoded into the graphical format that can directly export by graphic interface with decoded video image earlier, according to the output control information of described video information, export again according to described figure output format.Be specially according to feature size output control information, video information is handled; According to graph position output control information, video information is exported according to described figure output format, be about to video image and carry out stretch processing according to the size and the position of output, the figure output interface that calls terminal then outputs to corresponding position with the processed video image.
The multipath video processing method that present embodiment provides not only is implemented under the prerequisite that does not increase transmission bandwidth, and Internet resources have been saved in transmission when finishing multi-path video stream; Also, finish the function that multi-channel program is decoded simultaneously and browsed by one tunnel media decoder by decoding multiplexing.
Multipath video processing method embodiment two
Based on multipath video processing method embodiment one, Fig. 5 is multipath video processing method embodiment two flow charts of the present invention, as shown in Figure 5, comprises the steps:
Terminal sends program downloading page request information to the program server, and the program server sends the required programs page info to terminal according to request, and terminal receives this program pages information.
After terminal received program pages information, browser showed the program pages information that receives, and the address information of audiovisual informations all in this program pages is notified to playing program; Playing program is according to the address information of audiovisual information, and the video tour of setting up these all audiovisual informations of program pages with media server communicates to connect path; Terminal is provided with filtering policy, and media server carries out filtration treatment according to the filtered audio information of looking of terminal setting to audiovisual information.
The audiovisual information of step 502, reception process filtration treatment;
Media server sends frame of video according to looking the path that communicates to connect of filtered audio information by correspondence to terminal, and terminal receives the audiovisual information through filtration treatment.
Playing program is decoded to the audiovisual information of storage by single channel decoder multiplexing technique, and exports the video pictures of all video tour programs.
Fig. 6 is many video tours schematic diagram among the multipath video processing method embodiment two of the present invention, as shown in Figure 6, mode by video tour on a program guide page is browsed a plurality of program request/programme televised lives simultaneously, the user can browse the content of each playing programs of this page very directly perceived, in real time, and the user can find required programs to watch quickly; The video tour window of each program all refreshes at the up-to-date video pictures with the current in progress program of this channel among the figure, and different filtering policys has the different effects that refreshes.
Among the embodiment of the method for processing video frequency of multichannel program request/programme televised live that present embodiment provides, filtered audio information is looked in relevant terminal setting, server carries out filtration treatment according to the filtered audio information of looking of terminal setting to audiovisual information, and after terminal receives the audiovisual information of the process filtration treatment that server issues, utilize one road decoder to finish multichannel by decoding multiplexing and look the implementation method that audio frequency is decoded simultaneously, also have multiwindow to browse the method for output, all can distinguish the video transmission method embodiment of application of aforementioned, implementation method described in video encoding/decoding method embodiment and the multipath video processing method embodiment one repeats no more in the present embodiment.
Multipath video processing method embodiment three
Based on multipath video processing method embodiment one, Fig. 7 is multipath video processing method embodiment three flow charts of the present invention, as shown in Figure 7, comprises the steps:
Terminal sends download channels list request information to the program server, and the program server sends required channel list to terminal according to request, and terminal receives this channel list.
After terminal receives channel list, when carrying out the channel switching, playing program will be selected one group of channel program, then when switching channels, playing program is selected one group of channel program, sets up this video tour of organizing whole programs with media server then and communicates to connect path; Filtered audio information is looked in the terminal setting, and media server carries out filtration treatment according to the filtered audio information of looking of terminal setting to the audiovisual information that sends.
The audiovisual information of step 602, reception process filtration treatment;
Media server sends frame of video according to looking the path that communicates to connect of filtered audio information by correspondence to terminal, and terminal receives the audiovisual information through filtration treatment.
Playing program is decoded to the audiovisual information of storage by single channel decoder multiplexing technique, and display video is browsed the video pictures of program.
Can realize the function that many pictures channel switches by multipath video processing method, when being a channel switching of the each operation of user, the window of browsing that can show a plurality of channels simultaneously, each channel browsing window all refreshes at the up-to-date video pictures with the current in progress program of this channel; The user can also select required programs to watch by the direction of operating key simultaneously, only need carry out a channel by this function user and switch the content that just can browse simultaneously a plurality of channel programs, can allow the user find required channel program very intuitively and easily, reduced the user search channel program the time.For example terminal is supported 100 channel programs, common channel switching mode, and needing to carry out 100 channel switchings could be with all channel program once-over; And the many pictures channel handoff functionality that adopts present embodiment to provide, if terminal is supported 9 video tour windows, so the user only need carry out that 12 channels switch just can be with all channel program once-overs.Simultaneously the user can also (for example CCTV1～CCTV12) be set in the channel-group and browses with of a sort program.
The method that provides in the present embodiment is provided is realized the multi channel surfing, be the different of the way of output with the said method difference.Channel surfing is meant that the user when using various main business (program request, live, web page browsing, video calling, recreation etc.) function, starts the direct broadcast band surfing function by operation " channel surfing " shortcut at any time; After starting channel surfing, the user can carry out the switching of surfing channel by the operation channel switch key, is implemented in when using main business the programme content of current broadcast that can each direct broadcast band of displaying live view.Fig. 8 is way of output embodiment one schematic diagram of multi channel surfing of the present invention; Fig. 9 is way of output embodiment two schematic diagrames of multi channel surfing of the present invention; Figure 10 is way of output embodiment three schematic diagrames of multi channel surfing of the present invention.
Among the embodiment of the multiaspect face channel Switch Video processing method that present embodiment provides, filtered audio information is looked in relevant terminal setting, server carries out filtration treatment according to the filtered audio information of looking of terminal setting to audiovisual information, and after terminal receives the audiovisual information of the process filtration treatment that server issues, utilize one road decoder to finish multichannel by decoding multiplexing and look the implementation method that audio frequency is decoded simultaneously, also have multiwindow to browse the method for output, all can distinguish the video transmission method embodiment of application of aforementioned, implementation method described in video encoding/decoding method embodiment and the multipath video processing method embodiment one repeats no more in the present embodiment.
Multipath video processing method embodiment four
Based on multipath video processing method embodiment one, Figure 11 is multipath video processing method embodiment four flow charts of the present invention, as shown in figure 11, comprises the steps:
During programme information in the terminal normal play current channel, terminal will be set up the path that communicates to connect of current channel adjacent channel and/or history channel with media server.The adjacent channel of described current channel comprises last and the next channel etc. of current channel, and described history channel carries out the channel of playing programs for the terminal last time.
The audiovisual information of step 702, reception process filtration treatment;
Media server carried out filtration treatment according to looking filtered audio information to the audiovisual information that will send, and sent frame of video by the path that communicates to connect of correspondence to terminal, and terminal receives the audiovisual information through filtration treatment.
Step 703, the audiovisual information that receives is decoded, and output.
When users with channel switched, playing program was decoded to the audiovisual information on the channel that will play of storage by single channel decoder multiplexing technique, and output video is browsed the video pictures of program.
Playing program is in channel program of normal play, the video tour of setting up last channel, next channel and/or history channel with media server communicates to connect path respectively, and the filtered audio information of looking is set, media server sends frame of video according to looking filtered audio information to terminal; The frame of video that playing program is used for this road connection of buffer memory for every road core buffer of video tour connection distribution; The buffer memory task can be saved in the frame of video that receives in the core buffer of every road video tour, if buffering area is full, then overrides stored video frames at first; When the user was switched by carrying out channel, playing program at first took out frame of video and decodes from the internal memory of new channel correspondence, and the video image picture behind the output decoder is promptly exported the transition picture then.In output video transition picture, playing program also in the data of buffering new channel, after pending buffer is finished, is just closed the transition picture and is begun this channel program of normal play; If before buffering finished, the user had carried out the channel handover operation again, then stops the buffering of current channel, and begins to export the transition picture of new channel; Carry out channel when switching, playing program all will be again and the next channel of new channel at every turn, and last channel, history channel are set up video tour and connected, and media server sends frame of video according to looking filtered audio information, for next channel switches ready.
The channel fast switch over method that present embodiment provides, makes the user understand the program content information of new channel fast at the stand-by period in the time of can reducing to carry out the channel switching.Generally, the user is when switching channels, after playing back, the video pictures that must wait for new channel could understand the in progress programme content of this channel, the user must wait for that 2～3 seconds time could understand the in progress programme content of this channel when channel switches like this, judge it is to stop to watch and still continue switching channels by this program then.And this method can be understood the video pictures of the in progress program of new channel apace when the user presses the channel switch key, need not to wait for the long period.Can also show excessive picture by showing for example fade effect etc. of special efficacy.
Among the embodiment of the channel fast switch over method that present embodiment provides, filtered audio information is looked in relevant terminal setting, server carries out filtration treatment according to the filtered audio information of looking of terminal setting to audiovisual information, and after terminal receives the audiovisual information of the process filtration treatment that server issues, utilize one road decoder to finish multichannel by decoding multiplexing and look the implementation method that audio frequency is decoded simultaneously, also have multiwindow to browse the method for output, all can distinguish the video transmission method embodiment of application of aforementioned, implementation method described in video encoding/decoding method embodiment and the multipath video processing method embodiment one repeats no more in the present embodiment.
Multipath video processing method embodiment five
Based on multipath video processing method embodiment one, Figure 12 is multipath video processing method embodiment five flow charts of the present invention, as shown in figure 12, comprises the steps:
During programme information in the terminal normal play current channel, terminal will be set up the path that communicates to connect of all channels with media server, switches and prepares for carrying out any channel.
The core buffer that respectively communicates to connect a correspondence of path distribution for setting up in the media server, media server provides buffering area for each road video tour.
Media server carries out filtration treatment according to the filtered audio information of looking of terminal setting to the audiovisual information that will send, and will be stored in through the audiovisual information of filtration treatment in this core buffer as individual road video tour distribution of media server, wait for according to demand sending to terminal.
After terminal receives channel switch request, want the audiovisual information of switching channels to the media server request, the audiovisual information that media server will be stored in the correspondence in the core buffer sends to terminal.
Playing program is decoded to the audiovisual information that receives by single channel decoder multiplexing technique, and output video is browsed the video pictures of program.
Media server is saved in the corresponding buffering area according to the frame of video of filtering policy with each channel, if buffering area is full, then covers frame of video at first; Terminal is when switching channels; terminal elder generation is to the frame of video of server requests new channel; then the frame of receiving is decoded and export; terminal is also in the normal data that cushion this channel program in output transition picture; if buffering finishes just to close the output of transition picture, and beginning regular channel playing programs.
In the method that present embodiment provides, also can be that each road video tour distributes corresponding buffer region on terminal, and the frame of video on each road is stored in the corresponding buffer region, but this implementation method can increase the terminal load; Above-mentioned provide at server side for each road video tour provides the method for buffering area, both reduced the load of terminal, realized the purpose of fast switching channels again.
Among the embodiment of the channel fast switch over method that present embodiment provides, filtered audio information is looked in relevant terminal setting, server carries out filtration treatment according to the filtered audio information of looking of terminal setting to audiovisual information, and after terminal receives the audiovisual information of the process filtration treatment that server issues, utilize one road decoder to finish multichannel by decoding multiplexing and look the implementation method that audio frequency is decoded simultaneously, also have multiwindow to browse the method for output, all can distinguish the video transmission method embodiment of application of aforementioned, implementation method described in video encoding/decoding method embodiment and the multipath video processing method embodiment one repeats no more in the present embodiment.
Multipath video processing method embodiment six
Based on multipath video processing method embodiment one, Figure 13 is multipath video processing method embodiment six flow charts of the present invention, as shown in figure 13, comprises the steps:
After terminal opened a file in local storage medium and presss from both sides, playing program was opened this document and is pressed from both sides all media files, and sets up the path that communicates to connect of similar number according to the quantity of media file; And filtered audio information is looked in setting simultaneously.
The audiovisual information of step 901, reception process filtration treatment;
The terminal plays program is carried out filtration treatment according to the filtered audio information of looking that is provided with to the frame of video in the media file.
Playing program is decoded to the audiovisual information through filtration treatment by single channel decoder multiplexing technique, and output video is browsed the video pictures of program.
The multichannel local media file method for processing video frequency that present embodiment provides is implemented in the video content of browsing a plurality of local media files on the interface simultaneously.With the difference of the video tour of multichannel program request/live be that the frame of video of local media browsing file is that playing program directly reads from local storage medium, rather than obtains from server by network.And filtered audio information is looked in relevant terminal setting in this method, according to looking filtered audio information audiovisual information is carried out filtration treatment, and terminal is utilized one road decoder to finish multichannel by decoding multiplexing to look the implementation method that audio frequency is decoded simultaneously, also have multiwindow to browse the method for output, all can distinguish video transmission method embodiment, the video encoding/decoding method embodiment of application of aforementioned and the implementation method described in the multipath video processing method embodiment one, repeat no more in the present embodiment.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of program command, aforesaid program can be stored in the computer read/write memory medium, this program is carried out the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
Terminal embodiment
Figure 14 is terminal embodiment one structural representation of the present invention, and as shown in figure 14, terminal comprises that module 11 is set is used for being provided with the filtered audio information of looking; Receiver module 12 is used for communicating to connect path based on what set up with media server, and the receiving media server is according to the described audiovisual information of looking after filtered audio information is handled the audiovisual information that will send; Decoder module 13 is used for the described audiovisual information that information receiving module receives is decoded.
Particularly, module 11 is set looks filtered audio information according to the quantity setting of want video tour, receiver module 12 is at first browsed with media server for multi-channel video and is set up the communicate to connect path identical with video tour quantity, and the frame of video information that path receives each road that communicates to connect by setting up; The frame of video information that terminal receives is the audiovisual information through the media server filtration treatment; After terminal receives required frame of video information, carry out decoding processing by 13 pairs of information that receive of decoder module, but the single decoder decoding multiplexing method that provides among the video encoding/decoding method embodiment of processing procedure application of aforementioned.
Figure 15 is terminal embodiment two structural representations of the present invention, as shown in figure 15, based on above-mentioned terminal embodiment one, further, decoder module 13 comprises that caching process submodule 131 is used for the described audiovisual information that receiver module 12 receives is stored in and the described corresponding core buffer of path that communicates to connect; Decoding submodule 132 is used for the described audiovisual information that described core buffer is stored is decoded; Terminal comprises that also display module 14 is used to export the described audiovisual information through decoding.
Caching process submodule 131 at first distributes corresponding core buffer for each road video tour according to setting up the good path that communicates to connect in the terminal internal memory, when receiver module 12 receives the frame of video that server issues, every frame of video is on the way stored in the corresponding core buffer; Decoding submodule 132 carries out decoding processing to the frame of video in each core buffer; After decoding is finished, by drawing together the image information of display module 14 outputs through decoding.
The terminal that above embodiment provides is looked filtered audio information by setting, and utilizes the single decoder multichannel multiplexing method that the audiovisual information that media server sends is carried out decoding processing, has realized that multi-channel video browses.
Media server embodiment
Figure 16 is a media server example structure schematic diagram of the present invention, and as shown in figure 16, media server comprises that filtering module 21 is used for according to the filtered audio information of looking of terminal setting audiovisual information being carried out filtration treatment; Sending module 22 is used for sending by the path that establishes a communications link of correspondence the described audiovisual information of process filtering module 21 filtration treatment.
Particularly, media server and terminal will be set up the same number of path that communicates to connect according to video tour quantity before the transmission of video frame information; After filtering module 21 gets access to and looks filtered audio information, according to this filtering information the audiovisual information that will send is carried out filtration treatment, reduce the bandwidth that each road frame of video takies, sending module 22 sends to terminal with the path that communicates to connect of each road frame of video by correspondence then, realizes the multiplexing of audiovisual information.
For finishing the quick switching of arbitrary channel, media server can comprise that also buffer process module 23 is used for the described audiovisual information of buffer memory through filtering module 21 filtration treatment.Buffer process module 23 is distributed corresponding buffer region for each road according to the path of setting up that communicates to connect in the media server internal memory, and will be stored in through the audiovisual information of filtration treatment in the corresponding core buffer; When the audiovisual information in a certain channel of terminal request, sending module 22 sends to terminal with the frame of video of the corresponding channel in the media server core buffer, realizes the quick switching of channel.
The multi-channel video treatment system
Figure 17 is a multi-channel video treatment system example structure schematic diagram of the present invention, and as shown in figure 17, this system comprises terminal 1 and media server 2.
Wherein, terminal 1 comprises that module 11 is set is used for being provided with the filtered audio information of looking; Receiver module 12 is used for communicating to connect path based on what set up with media server, and the receiving media server is according to the described audiovisual information of looking after filtered audio information is handled the audiovisual information that will send; Decoder module 13 is used for the described audiovisual information that information receiving module receives is decoded.Particularly, module 11 is set looks filtered audio information according to the quantity setting of want video tour, receiver module 12 is at first browsed with media server for multi-channel video and is set up the communicate to connect path identical with video tour quantity, and the frame of video information that path receives each road that communicates to connect by setting up; The frame of video information that terminal receives is the audiovisual information through the media server filtration treatment; After terminal receives required frame of video information, carry out decoding processing by 13 pairs of information that receive of decoder module, but the single decoder decoding multiplexing method that provides among the video encoding/decoding method embodiment of processing procedure application of aforementioned.
Further, decoder module 13 comprises that caching process submodule 131 is used for the described audiovisual information that receiver module 12 receives is stored in and the described corresponding core buffer of path that communicates to connect; Decoding submodule 132 is used for the described audiovisual information that described core buffer is stored is decoded; Terminal comprises that also display module 14 is used to export the described audiovisual information through decoding.
Caching process submodule 131 at first distributes corresponding core buffer for each road video tour according to setting up the good path that communicates to connect in the terminal internal memory, when receiver module 12 receives the frame of video that server issues, every frame of video is on the way stored in the corresponding core buffer; Decoding submodule 132 carries out decoding processing to the frame of video in each core buffer; After decoding is finished, by the image information of display module 14 outputs through decoding.
Particularly, media server and terminal will be set up the same number of path that communicates to connect according to video tour quantity before the transmission of video frame information; After filtering module 21 gets access to and looks filtered audio information, according to this filtering information the audiovisual information that will send is carried out filtration treatment, reduce the bandwidth that each road frame of video takies, sending module 22 sends to terminal with the path that communicates to connect of each road frame of video by correspondence then, realizes the multiplexing of audiovisual information.For finishing the quick switching of arbitrary channel, media server should comprise that also buffer process module 23 is used for the described audiovisual information of buffer memory through filtering module 21 filtration treatment.Buffer process module 23 is distributed corresponding buffer region for each road according to the path of setting up that communicates to connect in the media server internal memory, and will be stored in through the audiovisual information of filtration treatment in the corresponding core buffer; When the audiovisual information in a certain channel of terminal request, sending module 22 sends to terminal with the frame of video of the corresponding channel in the media server core buffer, realizes the quick switching of channel.
The multi-channel video treatment system that present embodiment provides under the prerequisite that does not improve the network bandwidth, has realized the multiplexing of audiovisual information, realizes multiplexed decoding and browse on the terminal that only has one road decoding capability; Save network bandwidth resources, reduced cost, improved video transmission efficient.
It should be noted that at last: above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (8)
1. multipath video processing method is characterized in that comprising:
Terminal and media server are set up a plurality of paths that communicate to connect;
Filtered audio information is looked in described terminal setting, and the filtered audio information of looking of described setting is sent to described media server;
Described terminal is based on described a plurality of paths that communicate to connect, receive the audiovisual information through filtration treatment, described audiovisual information through filtration treatment is that described media server carries out sending by described a plurality of paths that communicate to connect after the filtration treatment to audiovisual information;
The described audiovisual information that described end-on is received is decoded.
2. multi-channel video transmission method according to claim 2 is characterized in that, the filtered audio information of looking of described setting is specially:
Filter the filtering information of the part or all of audio frame in the described audiovisual information;
And/or filter the filtering information of the part or all of non-video key frame in the described audiovisual information;
And/or the described filtering information that sends and abandon the duration of described audiovisual information of looking in the filtered audio information is set.
3. multi-channel video transmission method according to claim 2, it is characterized in that the filtering information of the part or all of non-video key frame in the described filtration audiovisual information is specially: the filtering information of filtration fraction or whole non-video key frame and filtration fraction key frame of video.
4. multipath video processing method according to claim 1 is characterized in that, described the described audiovisual information that receives is decoded after, also comprise: handle carrying out transcoding, export described video information through the described video information of decoding.
5. multipath video processing method according to claim 4 is characterized in that, and is described to carry out the transcoding processing through the described video information of decoding, exports described video information and comprises:
To convert the figure output format to through the output format of video information of decoding;
According to the output control information of described video information, export according to described figure output format.
6. multipath video processing method according to claim 5 is characterized in that, described output control information according to described video information is exported according to described figure output format and to be comprised:
According to feature size output control information, described video information is handled;
According to graph position output control information, described video information is exported according to described figure output format.
7. multipath video processing method according to claim 1 is characterized in that, described reception comprises through the audiovisual information of filtration treatment:
For the described path that communicates to connect distributes corresponding core buffer;
The audiovisual information of the process filtration treatment that receives is stored in the corresponding described core buffer.
8. multipath video processing method according to claim 7 is characterized in that, the described described audiovisual information that receives is decoded comprises:
Check described core buffer in regular turn, the described audiovisual information that is stored in the described core buffer is decoded;
And/or, the described audiovisual information that is stored in the described core buffer is decoded according to the decoding solicited message that receives.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101586153A CN102223569A (en) | 2007-11-28 | 2007-11-28 | Multi-path video processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101586153A CN102223569A (en) | 2007-11-28 | 2007-11-28 | Multi-path video processing method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710178284 Division CN101448152B (en) | 2007-11-28 | 2007-11-28 | Multipath video processing method and system, terminal and medium server thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102223569A true CN102223569A (en) | 2011-10-19 |
Family
ID=44779972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011101586153A Pending CN102223569A (en) | 2007-11-28 | 2007-11-28 | Multi-path video processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102223569A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102404615A (en) * | 2011-11-29 | 2012-04-04 | 广东威创视讯科技股份有限公司 | Video processing system based on cloud computing |
| CN103780923A (en) * | 2014-02-11 | 2014-05-07 | 赛特斯信息科技股份有限公司 | System and method for multi-image playing based on webpage |
| CN104796761A (en) * | 2014-01-20 | 2015-07-22 | 扬智科技股份有限公司 | Streaming method for generating video preview |
| CN105828093A (en) * | 2016-03-21 | 2016-08-03 | 乐视网信息技术（北京）股份有限公司 | Network video live broadcasting method and device |
| CN106060627A (en) * | 2016-06-15 | 2016-10-26 | 乐视控股（北京）有限公司 | Audio processing method and device based on multi-way live broadcast |
| CN111147926A (en) * | 2018-11-02 | 2020-05-12 | 杭州海康威视数字技术股份有限公司 | Data transcoding method and device |
-
2007
- 2007-11-28 CN CN2011101586153A patent/CN102223569A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102404615A (en) * | 2011-11-29 | 2012-04-04 | 广东威创视讯科技股份有限公司 | Video processing system based on cloud computing |
| CN104796761A (en) * | 2014-01-20 | 2015-07-22 | 扬智科技股份有限公司 | Streaming method for generating video preview |
| CN103780923A (en) * | 2014-02-11 | 2014-05-07 | 赛特斯信息科技股份有限公司 | System and method for multi-image playing based on webpage |
| CN105828093A (en) * | 2016-03-21 | 2016-08-03 | 乐视网信息技术（北京）股份有限公司 | Network video live broadcasting method and device |
| WO2017162098A1 (en) * | 2016-03-21 | 2017-09-28 | Le Holdings (Beijing) Co., Ltd. | Online video live cast method and apparatus |
| CN106060627A (en) * | 2016-06-15 | 2016-10-26 | 乐视控股（北京）有限公司 | Audio processing method and device based on multi-way live broadcast |
| CN111147926A (en) * | 2018-11-02 | 2020-05-12 | 杭州海康威视数字技术股份有限公司 | Data transcoding method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101448152B (en) | Multipath video processing method and system, terminal and medium server thereof | |
| JP3788260B2 (en) | Distribution system, distribution method thereof, and distribution program | |
| CN102510541B (en) | Multi-screen interaction video and audio content switching method and media player | |
| US7634794B1 (en) | Broadcasting service system using mobile communication terminal | |
| KR100735233B1 (en) | System for providing personal broadcasting service | |
| CN101588488B (en) | Multiple-position streaming media broadcasting method and system | |
| US8442121B2 (en) | Method, apparatus and system for controlling a scene structure of multiple channels to be displayed on a mobile terminal in a mobile broadcast system | |
| KR20080098668A (en) | Multi-program viewing in a wireless apparatus | |
| CN105407362A (en) | Methods and apparatus for service acquisition | |
| CN101472154A (en) | Method for switching digital channel and device for processing digital video | |
| CN102131106A (en) | Method, device and system for playing streaming media contents | |
| CN102223569A (en) | Multi-path video processing method | |
| KR20020005503A (en) | Base station apparatus, mobile station, and contents provider | |
| CN101267545A (en) | A program switching method and device | |
| US7574169B2 (en) | Contents providing system and mobile communication terminal therefor | |
| JP2017520940A (en) | Method and apparatus for multiplexing hierarchically encoded content | |
| CN102291399A (en) | Streaming media switching platform | |
| JP5428734B2 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN103024441B (en) | A kind of method of playing television program at mobile terminal | |
| CN102664900B (en) | Media business supplying method and device, media business display packing and device | |
| CN100366080C (en) | Method of implementing switching of single picture and multi-pictures in conference television system | |
| CN114598853A (en) | Video data processing method and device and network side equipment | |
| CN101179695A (en) | Method for implementing recorded broadcast of session, session television system and terminal | |
| WO2005022764A1 (en) | Contents providing system and mobile communication terminal therefor | |
| CN100591134C (en) | Playing method for preventing form black screen and flicking screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111019 |