CN100559877C - A kind of network flow-medium player and method of supporting that multi-view point video is synthetic - Google Patents
A kind of network flow-medium player and method of supporting that multi-view point video is synthetic Download PDFInfo
- Publication number
- CN100559877C CN100559877C CNB2007100988232A CN200710098823A CN100559877C CN 100559877 C CN100559877 C CN 100559877C CN B2007100988232 A CNB2007100988232 A CN B2007100988232A CN 200710098823 A CN200710098823 A CN 200710098823A CN 100559877 C CN100559877 C CN 100559877C
- Authority
- CN
- China
- Prior art keywords
- module
- video frame
- hand
- virtual
- viewpoint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The present invention relates to a kind of network flow-medium player of supporting that multi-view point video is synthetic, it comprises that a data receiver module and one present module, and it is characterized in that: it also comprises an above decoder module and a synthesis module; Described data reception module connects the reception compressed video bit stream by one or more IP, and received data is transmitted to an above decoder module, and it is also transmitted from user interface reception viewpoint switching command and to synthesis module in addition; Described decoder module receives compressed video frame data and decoding from data reception module, and transmits decoded original video frame data to synthesis module; Described synthesis module receives the original video frame data and carries out virtually looking synthetic from an above decoder module, will synthesize the result on the other hand to presenting module forwards, and it also receives the viewpoint switching command from data reception module in addition; The described module that presents is transmitted from synthesis module reception virtual video frame and to display device.The present invention can be under a player framework sets up many networks with streaming media server simultaneously and is connected and also receives the decode a plurality of video code flows simultaneously.
Description
Technical field
The present invention relates to multi-view point video and handle and the network flow-medium technical field, particularly about a kind of network flow-medium player and method of supporting that multi-view point video is synthetic.
Background technology
At present, the network flow-medium player based on personal computer has obtained to use widely.As shown in Figure 1, the framework of the DST PLAYER of prior art is mainly by data reception module, decoder module with present module and form, and the data between each module flow and be that a data path finishes by setting up between the input interface of the output interface of sender's module and recipient's module.Except data path, the not more coupling of intermodule can realize module package preferably.The function of each module specifically describes as follows:
Data reception module mainly is responsible for carrying out mutual and receiving media data by network and streaming media server.As shown in Figure 2, in this module, comprise an input interface, a frame of video assembling submodule and an output interface.Input interface is responsible for receiving the IP bag of forming compressed video data from network, frame of video assembling submodule is responsible for resolving the IP bag that receives and its assembling is become one by one compressed video frame, output interface is responsible for the compressed video frame data after the buffer memory assembling, and sends it to the input interface of next module (decoder module).
Decoder module is responsible for the compressed video frame data that receive are decoded, and with the fastest speed decoded original video frame data passes is given then to present module.This process is to finish under the driving of output interface in a last module (data reception module).
Presenting module is responsible for that decoded original video frame data are delivered display device and shows and play.Wherein need to utilize the timestamp of each frame data to carry out time synchronized, to control the demonstration time of each frame.This process is to finish under the driving of output interface in a last module (decoder module).
The DST PLAYER of above-mentioned prior art can satisfy the demand of traditional single view Video service, but it is only applicable to the reception and the broadcast of single view video flowing, promptly simultaneously can only receive the media data that contains one tunnel vision signal from streaming media server by IP network and decode then and play, the user is merely able to watch road video from streaming media server simultaneously.Yet along with the continuous upgrading of Video service in recent years, the multi-view point video technology is arisen at the historic moment.With respect to traditional single-point video, multi-view point video can provide the information of a certain things or scene different angles, different aspects, and can synthesize these information, generates multi-angle, omnibearing freedom or stereoscopic vision.The initial data of multi-view point video is generally formed by the set collection that a plurality of video cameras are formed.Because the video camera of composition set is fixed distance mostly, the scene of taking is also roughly the same, therefore the multi-view point video data have often showed the information of Same Scene or object different angles, make the user to select one of them to watch arbitrarily, perhaps synthesizing a virtual middle scene according to the video sequence of adjacent several shot by camera watches, and realize that seamless between a plurality of viewpoints freely browse and switch promptly so-called free viewpoint video.If the user has selected the captured video sequence of a plurality of adjacent camera simultaneously, and want in client it to be synthesized a virtual intermediate-view when watching, the DST PLAYER of prior art just can't satisfy this demand.
Summary of the invention
At the problems referred to above, the purpose of this invention is to provide a kind of network flow-medium player and method of supporting that multi-view point video is synthetic.
For achieving the above object, the present invention takes following technical scheme: a kind of network flow-medium player of supporting that multi-view point video is synthetic, it comprises that a data receiver module and one present module, and it is characterized in that: it also comprises an above decoder module and a synthesis module; Described data reception module connects from the compressed video bit stream of streaming media server reception sources from an above video camera viewpoint by one or more IP network on the one hand, link to each other with an above decoder module on the other hand, and transmit the compressed video frame data of the different points of view receive to the latter, described data reception module also receives the viewpoint switching command and transmits to synthesis module from user interface; Described decoder module links to each other with data reception module on the one hand, therefrom receives the compressed video frame data and the decoding that assemble at selected viewpoint, links to each other with synthesis module on the other hand, transmits decoded original video frame data to the latter; Described synthesis module links to each other with an above decoder module on the one hand, therefrom receive decoded original video frame data and carry out virtual look synthetic, on the other hand with present module and link to each other, transmit virtual video frame data after synthetic to the latter, described synthesis module also receives the viewpoint switching command from data reception module; The described module that presents links to each other with synthesis module on the one hand, therefrom receives the virtual video frame data after synthesizing, and links to each other with display device on the other hand.
Described data reception module switches the monitoring submodule by an above input interface, an above frame of video assembling submodule, an above output interface and a viewpoint to be formed; Described each input interface connects by IP network and streaming media server on the one hand, and receive the compressed video bit stream of No. one video camera viewpoint from the latter with the form of continuous IP bag, link to each other with a frame of video assembling submodule on the other hand, and the continuous IP bag that receives transmitted to the latter, described each input interface also switch to be monitored submodule with viewpoint and is linked to each other, and therefrom receives the viewpoint switching command and according to the corresponding viewpoint handover operation of command execution; Described each frame of video assembling submodule links to each other with an input interface on the one hand, therefrom receive continuous IP bag, resolve and be assembled into compressed video frame one by one then, link to each other with an output interface on the other hand, transmit the compressed video frame data that assemble to the latter; Described each output interface links to each other with a frame of video assembling submodule on the one hand, therefrom receives the compressed video frame data that assemble, and links to each other with a decoder module on the other hand, transmits the compressed video frame data that receive to the latter; Described viewpoint is switched and is monitored submodule and monitor and receive viewpoint switching command from user interface on the one hand, on the other hand this viewpoint switching command information is transmitted to each input interface and synthesis module.
Described synthesis module is looked the synthon module and an output interface is formed by a master control input interface, at least one common input interface, at least one video frame buffer formation, one are virtual; Described master control input interface links to each other with first decoder module on the one hand and therefrom receives decoded original video frame data, link to each other with the virtual synthon module of looking on the other hand, directly drive the operation of this submodule and provide one tunnel master control original video frame data to it with the form of input parameter; Described each common input interface links to each other with a decoder module on the one hand and therefrom receives decoded original video frame data, links to each other with a video frame buffer formation on the other hand and with the original video frame data person's forwarding backward that receives; Described each video frame buffer formation is a first-in first-out type formation, it links to each other with a common input interface on the one hand and buffer memory is carried out in the original video frame data adding formation that it is received, link to each other with the virtual synthon module of looking on the other hand, and provide one road original video frame data to it with the form of input parameter; The described virtual synthon module of looking links to each other with at least one video frame buffer formation with the master control input interface on the one hand, therefrom receive and be used for virtually looking synthetic above input video frame and under the driving of master control input interface, calling the virtual composition algorithm of looking, link to each other with output interface on the other hand and transmit virtual video frame after synthetic to the latter, described virtual look the synthon module also with data reception module in viewpoint switch to monitor submodule and link to each other, from the latter receive the viewpoint switching command and the information such as proportionate relationship between each viewpoint of parsing as the virtual input parameter of looking composition algorithm; Described each output interface links to each other with the virtual synthon module of looking on the one hand, therefrom receives the virtual video frame data after synthetic, on the other hand with the virtual video frame data that present that module links to each other and receive to latter's forwarding.
Comprise the streaming media server position in the described viewpoint switching command, carry out virtual look involved when synthesizing each actual camera viewpoint code stream and information such as position and proportionate relationship thereof after viewpoint is switched again.
For the rectangle video camera array,, then adopt the URL(uniform resource locator) (URL) of a following form to represent viewpoint switching command a: ftv if adjacent 4 actual view up and down of each employing are at most synthesized virtual looking: //ServerName; N
Lt.sdp; N
Rt.sdp; N
Lb.sdp; N
Rb.sdp; R
LrR
Tb, wherein, ServerName represents the domain name of streaming media server, N
Lt.sdp, N
Rt.sdp, N
Lb.sdp and N
Rb.sdp represent the current selected upper left corner, the upper right corner, the lower left corner and the lower right corner viewpoint media description filename on streaming media server respectively, R
LrAnd R
TbRepresent left and right sides viewpoint and viewpoint shared proportionate relationship when synthetic up and down respectively, its span is 0～1.
A kind of network flow-medium player method of supporting that multi-view point video is synthetic, it is characterized in that the playing process operating procedure is as follows: viewpoint in (1) data reception module switch monitor submodule and monitor at every turn and receive viewpoint switching command from user interface after, form corresponding Streaming Media URL and be sent to corresponding input interface according to streaming media server domain name wherein and the media description filename that switches each viewpoint code stream of back, simultaneously will proportionate relationship information wherein be sent to the virtual synthon module of looking in the synthesis module; (2) each input interface in the data reception module is after receiving the new Streaming Media URL corresponding with it, close with streaming media server between original be connected and use this new URL to rebulid network with streaming media server be connected, continuously receive the IP bag contain compressed video data then and transmit to the frame of video assembling submodule of correspondence; (3) each the frame of video assembling submodule in the data reception module continuously receives the IP bag from the input interface of correspondence, and the output interface to correspondence is transmitted behind what a complete compressed video frame of assembling; (4) each output interface in the data reception module is continuously with the extremely corresponding decoder module of compressed video frame data forwarding that receives; (5) the continuously output interface of correspondence reception compressed video frame data and decoding from data reception module of each decoder module transmitted decoded original video frame data corresponding master control input interface or common input interface in synthesis module then; (6) the common input interface of each in the synthesis module original video frame data that continuously will receive from the decoder module of correspondence join corresponding video frame buffer formation; (7) the master control input interface in the synthesis module continuously receives original video frame from the decoder module of correspondence, whenever receive after the frame of video timestamp with this frame of video and be benchmark from all video frame buffer formations, take out one with stab the frame of video that is complementary this fiducial time, then with all these frame of video and call the virtual synthon module of looking from each viewpoint proportionate relationship information that data reception module receives as input parameter and generate a virtual video frame; (8) output interface in the synthesis module continuously will be sent to from the virtual virtual video frame of looking the output of synthon module and present module; (9) presenting module continuously receives the virtual video frame and delivers to display device from synthesis module and show.
The present invention is owing to take above technical scheme, it has the following advantages: can be under a player framework set up many networks with streaming media server simultaneously and is connected and also receives the decode a plurality of video code flows simultaneously, thereby can realize looking synthetic in decoder end based on multiple vision point video stream virtual, both alleviate the calculating pressure of server end, strengthened the flexibility of system again; Viewpoint is switched the use of monitoring module makes viewpoint switch other submodule that does not have influence in other module even this module, also need not reset player frame structure and state, thus can realize quick viewpoint switching with less expense; Adopt timestamp mechanism that the frame of video in many video code flows is carried out time synchronized, effectively avoided because of the multi-view point videos that reason caused such as the Network Packet Loss phenomenon that do not match.
Description of drawings
Fig. 1 is the system construction drawing of prior art network flow-medium player
Fig. 2 is a data reception module structural representation in the prior art network flow-medium player
Fig. 3 is the synthetic network flow-medium player system structure chart of support multi-view point video provided by the invention
Fig. 4 is a data reception block structural diagram in the synthetic network flow-medium player of support multi-view point video provided by the invention
Fig. 5 is a synthesis module structure chart in the synthetic network flow-medium player of support multi-view point video provided by the invention
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in detail.
As shown in Figure 3, the synthetic network flow-medium player of support multi-view point video provided by the invention presents module 400 by the above decoder module of a data receiver module 100,200, synthesis module 300 and one and is formed, the direction of solid arrow representative of data flow among the figure, dotted arrow is represented the direction of control flows.
Described decoder module 200 links to each other with data reception module 100 on the one hand, therefrom receives the compressed video frame data and the decoding that assemble at certain viewpoint, links to each other with synthesis module 300 on the other hand, transmits decoded original video frame data to the latter.Except next module that its output interface connected is synthesis module 300 rather than presents the module 400, decoder module 200 is identical with the decoder module in the prior art player.
As shown in Figure 4, data reception module 100 is switched by the above frame of video assembling submodule of an above input interface 101,102, above output interface 103 and viewpoint and monitors submodule 104 and formed in the synthetic DST PLAYER of support multi-view point video provided by the invention, the direction of solid arrow representative of data flow among the figure, dotted arrow is represented the direction of control flows.
Each input interface 101 connects by IP network and streaming media server on the one hand, and receive the compressed video bit stream of No. one video camera viewpoint from the latter with the form of continuous IP bag, link to each other with a frame of video assembling submodule 102 on the other hand, and the continuous IP bag that receives is transmitted to the latter.In addition, input interface 101 also switch to be monitored submodule 104 with viewpoint and is linked to each other, and therefrom receives the viewpoint switching command and according to the corresponding viewpoint handover operation of command execution.
Each frame of video assembling submodule 102 links to each other with an input interface 101 on the one hand, therefrom receive continuous IP and wrap the compressed video frame of resolving then and being assembled into one by one, link to each other with an output interface 103 on the other hand, transmit the compressed video frame data that assemble to the latter.
Each output interface 103 links to each other with a frame of video assembling submodule 102 on the one hand, therefrom receives the compressed video frame data that assemble, and links to each other with a decoder module 200 on the other hand, transmits the compressed video frame data that receive to the latter.
Viewpoint switch to be monitored submodule 104 and is monitored and receive viewpoint switching command from user interface on the one hand, on the other hand this viewpoint switching command information is transmitted to each input interface 101 and synthesis module 300.
As shown in Figure 5, in the synthetic DST PLAYER of support multi-view point video provided by the invention synthesis module 300 by a master control input interface 301, at least one common input interface 302, at least one video frame buffer formation 303, one virtually look synthon module 304 and an output interface 305 is formed, the direction of solid arrow representative of data flow among the figure, dotted arrow is represented the direction of control flows.
Master control input interface 301 links to each other with first decoder module 200 on the one hand and therefrom receives decoded original video frame data, link to each other with the virtual synthon module 304 of looking on the other hand, directly drive the operation of this submodule and provide one tunnel master control original video frame data to it with the form of input parameter.
Each common input interface 302 links to each other with a decoder module 200 on the one hand and therefrom receives decoded original video frame data, links to each other with a video frame buffer formation 303 on the other hand and with the original video frame data person's forwarding backward that receives.
Each video frame buffer formation 303 is first-in first-out type formations, it links to each other with a common input interface 302 on the one hand and buffer memory is carried out in each original video frame data adding formation that it is received, link to each other with the virtual synthon module 304 of looking on the other hand, and provide one road original video frame data to it with the form of input parameter.
The virtual synthon module 304 of looking links to each other with at least one video frame buffer formation 303 with master control input interface 301 on the one hand, therefrom receive and be used for virtually looking synthetic above input video frame and under the driving of master control input interface 301, calling the virtual composition algorithm of looking, link to each other with output interface 305 on the other hand and transmit virtual video frame after synthesizing to the latter.In addition, virtual look synthon module 304 also with data reception module 100 in viewpoint switch to monitor submodule 104 and link to each other, from the latter receive the viewpoint switching command and the information such as proportionate relationship between each viewpoint of parsing as the virtual input parameter of looking composition algorithm.
Each output interface 305 links to each other with the virtual synthon module 304 of looking on the one hand, therefrom receives synthetic good virtual video frame data, on the other hand with the virtual video frame data that present that module 400 links to each other and receive to latter's forwarding.
A kind of network flow-medium player method of supporting that multi-view point video is synthetic of the present invention, its operating process is as follows:
(1) after the viewpoint in the data reception module 100 switch to be monitored submodule 104 and is monitored at every turn and receive viewpoint switching command from user interface, according to streaming media server domain name wherein and the media description filename that switches each viewpoint code stream of back form a plurality of corresponding Streaming Media URL (RTSP for example: //ftv.pk.com/N
Lt.sdp) and be sent to corresponding input interface 101, simultaneously will proportionate relationship information wherein be sent to the virtual synthon module 304 of looking in the synthesis module 300;
(2) each input interface 101 is after receiving the new Streaming Media URL corresponding with it, close with streaming media server between original be connected and use this new URL to rebulid network with streaming media server be connected, continuously receive the IP bag contain compressed video data then and transmit to the frame of video assembling submodule 102 of correspondence;
(3) each frame of video assembling submodule 102 continuously receives the IP bag from the input interface 101 of correspondence, and the output interface 103 to correspondence is transmitted behind what a complete compressed video frame of assembling;
(4) each output interface 103 is continuously with the extremely corresponding decoder module 200 of compressed video frame data forwarding that receives;
(5) the master control input interface 301 or the common input interface 302 of original video frame data correspondence in synthesis module 300 after the decoding are transmitted in the continuously output interface 103 reception compressed video frame data and the decodings of correspondence from data reception module of each decoder module 200;
(6) the common input interface 302 of each in the synthesis module 300 original video frame data that continuously will receive from the decoder module 200 of correspondence join corresponding video frame buffer formation 303;
(7) the master control input interface 301 in the synthesis module 300 continuously receives original video frame from the decoder module 200 of correspondence, whenever receive after the frame of video timestamp with this frame of video and be benchmark from all video frame buffer formations 303, take out one with stab the frame of video that is complementary this fiducial time, then with all these frame of video and call the virtual synthon module 304 of looking from each viewpoint proportionate relationship information that data reception module 100 receives as input parameter and generate a virtual video frame;
(8) output interface 305 in the synthesis module 300 continuously will be sent to from the virtual virtual video frame of looking the output of synthon module and present module 400;
(9) presenting module 400 continuously receives the virtual video frames and delivers to display device from synthesis module 300 and show.
Claims (6)
1, a kind of network flow-medium player of supporting that multi-view point video is synthetic, it comprises that a data receiver module and one present module, it is characterized in that: it also comprises an above decoder module and a synthesis module;
Described data reception module connects from the compressed video bit stream of streaming media server reception sources from an above video camera viewpoint by one or more IP network on the one hand, link to each other with an above decoder module on the other hand, and transmit the compressed video frame data of the different points of view receive to the latter, described data reception module also receives the viewpoint switching command and transmits to synthesis module from user interface;
Described decoder module links to each other with data reception module on the one hand, therefrom receives the compressed video frame data and the decoding that assemble at selected viewpoint, links to each other with synthesis module on the other hand, transmits decoded original video frame data to the latter;
Described synthesis module links to each other with an above decoder module on the one hand, therefrom receive decoded original video frame data and carry out virtual look synthetic, on the other hand with present module and link to each other, transmit virtual video frame data after synthetic to the latter, described synthesis module also receives the viewpoint switching command from data reception module;
The described module that presents links to each other with synthesis module on the one hand, therefrom receives the virtual video frame data after synthesizing, and links to each other with display device on the other hand;
Described data reception module switches the monitoring submodule by an above input interface, an above frame of video assembling submodule, an above output interface and a viewpoint to be formed;
Described each input interface connects by IP network and streaming media server on the one hand, and receive the compressed video bit stream of No. one video camera viewpoint from the latter with the form of continuous IP bag, link to each other with a frame of video assembling submodule on the other hand, and the continuous IP bag that receives transmitted to the latter, described each input interface also switch to be monitored submodule with viewpoint and is linked to each other, and therefrom receives the viewpoint switching command and according to the corresponding viewpoint handover operation of command execution;
Described each frame of video assembling submodule links to each other with an input interface on the one hand, therefrom receive continuous IP bag, resolve and be assembled into compressed video frame one by one then, link to each other with an output interface on the other hand, transmit the compressed video frame data that assemble to the latter;
Described each output interface links to each other with a frame of video assembling submodule on the one hand, therefrom receives the compressed video frame data that assemble, and links to each other with a decoder module on the other hand, transmits the compressed video frame data that receive to the latter;
Described viewpoint is switched and is monitored submodule and monitor and receive viewpoint switching command from user interface on the one hand, on the other hand this viewpoint switching command information is transmitted to each input interface and synthesis module.
2, the synthetic network flow-medium player of support multi-view point video as claimed in claim 1 is characterized in that: described synthesis module is looked the synthon module and an output interface is formed by a master control input interface, at least one common input interface, at least one video frame buffer formation, one are virtual;
Described master control input interface links to each other with first decoder module on the one hand and therefrom receives decoded original video frame data, link to each other with the virtual synthon module of looking on the other hand, directly drive the operation of this submodule and provide one tunnel master control original video frame data to it with the form of input parameter;
Described each common input interface links to each other with a decoder module on the one hand and therefrom receives decoded original video frame data, links to each other with a video frame buffer formation on the other hand and with the original video frame data person's forwarding backward that receives;
Described each video frame buffer formation is a first-in first-out type formation, it links to each other with a common input interface on the one hand and buffer memory is carried out in the original video frame data adding formation that it is received, link to each other with the virtual synthon module of looking on the other hand, and provide one road original video frame data to it with the form of input parameter;
The described virtual synthon module of looking links to each other with at least one video frame buffer formation with the master control input interface on the one hand, therefrom receive and be used for virtually looking synthetic above input video frame and under the driving of master control input interface, calling the virtual composition algorithm of looking, link to each other with output interface on the other hand and transmit virtual video frame after synthetic to the latter, described virtual look the synthon module also with data reception module in viewpoint switch to monitor submodule and link to each other, from the latter receive the viewpoint switching command and the information such as proportionate relationship between each viewpoint of parsing as the virtual input parameter of looking composition algorithm;
Described each output interface links to each other with the virtual synthon module of looking on the one hand, therefrom receives the virtual video frame data after synthetic, on the other hand with the virtual video frame data that present that module links to each other and receive to latter's forwarding.
3, the synthetic network flow-medium player of support multi-view point video as claimed in claim 1 is characterized in that: described synthesis module is looked the synthon module and an output interface is formed by a master control input interface, at least one common input interface, at least one video frame buffer formation, one are virtual;
Described master control input interface links to each other with first decoder module on the one hand and therefrom receives decoded original video frame data, link to each other with the virtual synthon module of looking on the other hand, directly drive the operation of this submodule and provide one tunnel master control original video frame data to it with the form of input parameter;
Described each common input interface links to each other with a decoder module on the one hand and therefrom receives decoded original video frame data, links to each other with a video frame buffer formation on the other hand and with the original video frame data person's forwarding backward that receives;
Described each video frame buffer formation is a first-in first-out type formation, it links to each other with a common input interface on the one hand and buffer memory is carried out in the original video frame data adding formation that it is received, link to each other with the virtual synthon module of looking on the other hand, and provide one road original video frame data to it with the form of input parameter;
The described virtual synthon module of looking links to each other with at least one video frame buffer formation with the master control input interface on the one hand, therefrom receive and be used for virtually looking synthetic a plurality of input video frame and under the driving of master control input interface, calling the virtual composition algorithm of looking, link to each other with output interface on the other hand and transmit virtual video frame after synthetic to the latter, described virtual look the synthon module also with data reception module in viewpoint switch to monitor submodule and link to each other, from the latter receive the viewpoint switching command and the information such as proportionate relationship between each viewpoint of parsing as the virtual input parameter of looking composition algorithm;
Described each output interface links to each other with the virtual synthon module of looking on the one hand, therefrom receives the virtual video frame data after synthetic, on the other hand with the virtual video frame data that present that module links to each other and receive to latter's forwarding.
4, as claim 1 or the synthetic network flow-medium player of 2 or 3 described support multi-view point videos, it is characterized in that: comprise the streaming media server position in the described viewpoint switching command, carry out virtual look involved when synthesizing each actual camera viewpoint code stream and position and proportionate relationship information after viewpoint is switched again.
5, the synthetic network flow-medium player of support multi-view point video as claimed in claim 4, it is characterized in that: for the rectangle video camera array, if adjacent 4 actual view up and down of each employing are at most synthesized virtual looking, then adopt the URL(uniform resource locator) (URL) of a following form to represent viewpoint switching command a: ftv: //ServerName; N
Lt.sdp; N
Rt.sdp; N
Lb.sdp; N
Rb.sdp; R
LrR
Tb, wherein, ServerName represents the domain name of streaming media server, N
Lt.sdp, N
Rt.sdp, N
Lb.sdp and N
Rb.sdp represent the current selected upper left corner, the upper right corner, the lower left corner and the lower right corner viewpoint media description filename on streaming media server respectively, R
LrAnd R
TbRepresent left and right sides viewpoint and viewpoint shared proportionate relationship when synthetic up and down respectively, its span is 0～1.
6, a kind of network flow-medium player method of supporting that multi-view point video is synthetic is characterized in that the playing process operating procedure is as follows:
(1) after the viewpoint in the data reception module switch to be monitored submodule and is monitored at every turn and receive viewpoint switching command from user interface, form corresponding Streaming Media URL and be sent to corresponding input interface according to streaming media server domain name wherein and the media description filename that switches each viewpoint code stream of back, simultaneously will proportionate relationship information wherein be sent to the virtual synthon module of looking in the synthesis module;
(2) each input interface in the data reception module is after receiving the new Streaming Media URL corresponding with it, close with streaming media server between original be connected and use this new URL to rebulid network with streaming media server be connected, continuously receive the IP bag contain compressed video data then and transmit to the frame of video assembling submodule of correspondence;
(3) each the frame of video assembling submodule in the data reception module continuously receives the IP bag from the input interface of correspondence, and the output interface to correspondence is transmitted behind what a complete compressed video frame of assembling;
(4) each output interface in the data reception module is continuously with the extremely corresponding decoder module of compressed video frame data forwarding that receives;
(5) the continuously output interface of correspondence reception compressed video frame data and decoding from data reception module of each decoder module transmitted decoded original video frame data corresponding master control input interface or common input interface in synthesis module then;
(6) the common input interface of each in the synthesis module original video frame data that continuously will receive from the decoder module of correspondence join corresponding video frame buffer formation;
(7) the master control input interface in the synthesis module continuously receives original video frame from the decoder module of correspondence, whenever receive after the frame of video timestamp with this frame of video and be benchmark from all video frame buffer formations, take out one with stab the frame of video that is complementary this fiducial time, then with all these frame of video and call the virtual synthon module of looking from each viewpoint proportionate relationship information that data reception module receives as input parameter and generate a virtual video frame;
(8) output interface in the synthesis module continuously will be sent to from the virtual virtual video frame of looking the output of synthon module and present module;
(9) presenting module continuously receives the virtual video frame and delivers to display device from synthesis module and show.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100988232A CN100559877C (en) | 2007-04-27 | 2007-04-27 | A kind of network flow-medium player and method of supporting that multi-view point video is synthetic |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100988232A CN100559877C (en) | 2007-04-27 | 2007-04-27 | A kind of network flow-medium player and method of supporting that multi-view point video is synthetic |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101047848A CN101047848A (en) | 2007-10-03 |
| CN100559877C true CN100559877C (en) | 2009-11-11 |
Family
ID=38772003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2007100988232A Expired - Fee Related CN100559877C (en) | 2007-04-27 | 2007-04-27 | A kind of network flow-medium player and method of supporting that multi-view point video is synthetic |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100559877C (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| BRPI0817508A2 (en) * | 2007-10-05 | 2013-06-18 | Thomson Licensing | METHODS AND APPARATUS FOR INCORPORATING VIDEO USERABILITY INFORMATION (VUI) INTO A MULTI-VIEW VIDEO CODING SYSTEM (MVC) |
| CN104811685B (en) * | 2008-12-18 | 2017-04-12 | Lg电子株式会社 | Method for 3D image signal processing and image display for implementing the same |
| KR101831775B1 (en) * | 2010-12-07 | 2018-02-26 | 삼성전자주식회사 | Transmitter and receiver for transmitting and receiving multimedia content, and reproducing method thereof |
| WO2012077981A2 (en) | 2010-12-07 | 2012-06-14 | 삼성전자 주식회사 | Transmitter for transmitting data for constituting content, receiver for receiving and processing the data, and method therefor |
| TWI517669B (en) | 2012-06-05 | 2016-01-11 | 晨星半導體股份有限公司 | Method and apparatus for image synchronization |
| CN103517062B (en) * | 2012-06-15 | 2016-05-25 | 晨星软件研发(深圳)有限公司 | The synchronous method of image and device thereof |
| CN103873775A (en) * | 2014-03-24 | 2014-06-18 | 联想(北京)有限公司 | Electronic device and information processing method |
| CN103888748B (en) * | 2014-03-24 | 2015-09-23 | 中国人民解放军国防科学技术大学 | For the video frame synchronization method of many viewpoint three-dimensional display systems |
| CN106657871A (en) * | 2015-10-30 | 2017-05-10 | 中国电信股份有限公司 | Multi-angle dynamic video monitoring method and apparatus based on video stitching |
| CN109309808A (en) * | 2017-07-26 | 2019-02-05 | 梭维智能科技（深圳）有限公司 | A kind of monitoring system and method based on recognition of face |
| CN110858925B (en) | 2018-08-22 | 2021-10-15 | 华为技术有限公司 | Method, device, system and storage medium for realizing video stream switching |
| CN110891182B (en) | 2018-09-11 | 2022-04-12 | 华为技术有限公司 | Method, device and system for realizing video stream switching |
-
2007
- 2007-04-27 CN CNB2007100988232A patent/CN100559877C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101047848A (en) | 2007-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100559877C (en) | A kind of network flow-medium player and method of supporting that multi-view point video is synthetic | |
| CN100588250C (en) | Method and system for rebuilding free viewpoint of multi-view video streaming | |
| CN101529907B (en) | Device and method for reducing channel-change time | |
| CN102281391B (en) | Camera chain, video choice device and video system of selection | |
| US20110090970A1 (en) | Terminal and relay node for video conference system | |
| US9392303B2 (en) | Dynamic encoding of multiple video image streams to a single video stream based on user input | |
| US20090207232A1 (en) | Multipoint conference system, multipoint conference method, and program | |
| RU2010134094A (en) | CONTENT TRANSMISSION METHOD AND DISPLAY DEVICE | |
| KR20150038538A (en) | Spatially-segmented content delivery | |
| JPWO2012011467A1 (en) | Data distribution system, data distribution method, distribution side data relay device, and reception side data relay device | |
| CN105376613A (en) | Fast channel switching method, server and IPTV system | |
| RU2634206C2 (en) | Device and method of commutation of media streams in real time mode | |
| US20160227131A1 (en) | Camera system, video selection apparatus and video selection method | |
| CN111447503A (en) | Viewpoint switching method, server and system for multi-viewpoint video | |
| CN102333209A (en) | Data transmission method and equipment applied to video monitoring system | |
| US20110088069A1 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| US9647951B2 (en) | Media stream rate reconstruction system and method | |
| US20060161676A1 (en) | Apparatus for IP streaming capable of smoothing multimedia stream | |
| JP2007281868A (en) | Transmission apparatus and receiving apparatus | |
| WO2010017836A1 (en) | Subdivision of media streams for channel switching | |
| JP2009171294A (en) | Video distribution system, video relay apparatus, and video relay method | |
| JP6166692B2 (en) | IP-based video transmission apparatus and broadcasting system | |
| JP2004015318A (en) | Information transmission system having system clock synchronizing means, and information transmission apparatus thereof | |
| CN101409631B (en) | Method and apparatus for switching channel | |
| WO2017103963A1 (en) | Ip based video transmission device and broadcast system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091111 Termination date: 20190427 |