TWI740547B - Stream media synchonization playing method and stream media synchonization playing system - Google Patents
Stream media synchonization playing method and stream media synchonization playing system Download PDFInfo
- Publication number
- TWI740547B TWI740547B TW109120793A TW109120793A TWI740547B TW I740547 B TWI740547 B TW I740547B TW 109120793 A TW109120793 A TW 109120793A TW 109120793 A TW109120793 A TW 109120793A TW I740547 B TWI740547 B TW I740547B
- Authority
- TW
- Taiwan
- Prior art keywords
- streaming media
- multicast
- server
- playback
- control unit
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/64—Addressing
- H04N21/6405—Multicasting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/64—Addressing
- H04N21/6408—Unicasting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
本發明是有關於一種串流媒體同步播放方法及串流媒體同步播放系統,且特別是有關於一種用於拼接顯示系統的串流媒體同步播放方法及串流媒體同步播放系統。The present invention relates to a method for synchronously playing streaming media and a system for synchronously playing streaming media, and more particularly to a method for synchronously playing streaming media and a system for synchronously playing streaming media for splicing display systems.
影片拼接牆是由多個液晶顯示器(Liquid Crystal Display,LCD)或者發光二極體(Light Emitting Diode,LED)顯示器組成的大型矩形顯示牆,具有高解析度、大尺寸等優點,在安防監控和會議大廳使用較多。The video splicing wall is a large rectangular display wall composed of multiple liquid crystal displays (LCD) or light emitting diode (LED) displays. It has the advantages of high resolution and large size. It is used in security monitoring and Conference halls are used more frequently.
安防監控領域內許多網路攝影機和串流媒體伺服器通常以單播模式進行工作。隨著播放終端增加,串流媒體單播伺服器的負載量越高,這使得不同終端接收到的串流媒體資料時間不一致,最終導致播放畫面不同步。單播是用戶端與伺服器之間的點到點連接。「點到點」指每個用戶端都從伺服器接收遠端串流。僅當用戶端發出請求時,才發送單播串流。單播是在單一發送者和單一接受者之間通過網路進行的通訊。在分散式拼接顯示系統的拼接牆佈局中不同終端播放相同的串流媒體,它們與串流媒體伺服器都以單播方式傳輸媒體串流,所以媒體資料並不是一起發送出來的,所以播放終端顯示的可能不是同一幀畫面,整體就會看到類似畫面撕裂的現象。Many network cameras and streaming media servers in the security surveillance field usually work in unicast mode. As the number of playback terminals increases, the load of the streaming media unicast server becomes higher, which makes the time of streaming media data received by different terminals inconsistent, and eventually causes the playback screen to be out of sync. Unicast is a point-to-point connection between the client and the server. "Point-to-point" means that each client receives a remote stream from the server. Only when the client makes a request, the unicast stream is sent. Unicast is the communication between a single sender and a single receiver over the network. In the splicing wall layout of the distributed splicing display system, different terminals play the same streaming media. They and the streaming media server both transmit the media stream in unicast mode, so the media data is not sent out together, so the playback terminal The display may not be the same frame, and you will see the phenomenon of similar screen tearing as a whole.
串流媒體單播負載能力有限,最終將無法滿足多個終端請求串流媒體的需求。有些網路攝影機雖然支援多播,但是在搭建成型的監控系統中如果都設置為多播,多播位址和埠分配需要考慮,增加了繁瑣的工作。Streaming media unicast has a limited load capacity, and ultimately cannot meet the needs of multiple terminals requesting streaming media. Although some IP cameras support multicast, if they are all set to multicast in the built-in monitoring system, the multicast address and port allocation need to be considered, which adds tedious work.
多播傳輸中的發送者和接收者之間是點對多點網路連接。一台發送者可以同時給多個接收者傳輸相同的資料但只需複製一份相同的數據包,因此提高了資料傳送效率並減少了骨幹網路出現擁塞的可能性。多播解決了單播和廣播方式效率低的問題。當網路中的某些使用者需求特定資訊時,請求加入多播群組,多播資訊發送者僅發送一次資訊,多播路由器借助多播路由式通訊協定為多播數據包建立樹型路由,被傳遞的資訊在盡可能遠的分叉路口才開始複製和分發。The sender and receiver in multicast transmission are point-to-multipoint network connections. A sender can transmit the same data to multiple receivers at the same time but only needs to copy the same data packet, thus improving the efficiency of data transmission and reducing the possibility of congestion in the backbone network. Multicast solves the problem of low efficiency in unicast and broadcast methods. When some users in the network require specific information, they request to join a multicast group. The sender of the multicast information only sends the information once. The multicast router uses the multicast routing protocol to establish a tree-type route for the multicast data packet. , The information to be transmitted begins to be copied and distributed at the fork as far as possible.
有鑑於此,本發明提出一種串流媒體同步播放方法及串流媒體同步播放系統,在分散式顯示系統拼接成一個大型電視牆時可提高各個播放終端播放內容的同步性以減少畫面撕裂的現象。In view of this, the present invention proposes a stream media synchronization playback method and a stream media synchronization playback system. When a distributed display system is spliced into a large TV wall, the synchronization of the playback content of each playback terminal can be improved to reduce screen tearing. Phenomenon.
本發明提出一種串流媒體同步播放方法,包括:藉由控制單元在單播伺服器上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器;藉由多播伺服器根據串流媒體位址產生多播串流媒體位址;藉由控制單元從多播伺服器接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端;藉由單播伺服器傳送串流媒體資料到多播伺服器,並藉由多播伺服器將串流媒體資料多播傳送到播放終端;以及藉由播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。The present invention provides a method for synchronous playback of streaming media, which includes: selecting a streaming media address on a unicast server by a control unit, and registering the streaming media address to the multicast server; by the multicast server Generate a multicast streaming media address according to the streaming media address; receive the multicast streaming media address from the multicast server by the control unit, and transmit the multicast streaming media address to multiple playback terminals; The unicast server sends the streaming media data to the multicast server, and the multicast server multicasts the streaming media data to the playback terminal; and the playback terminal decodes the streaming media data and decodes the decoded Stream media data to multiple displays.
本發明提出一種串流媒體同步播放系統,包括:控制單元;單播伺服器,耦接到控制單元;多播伺服器,耦接到控制單元及單播伺服器;多個播放終端,耦接到控制單元及多播伺服器;以及多個顯示器,耦接到播放終端。控制單元在單播伺服器上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器;多播伺服器根據串流媒體位址產生多播串流媒體位址;控制單元從多播伺服器接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端;單播伺服器傳送串流媒體資料到多播伺服器,並多播伺服器將串流媒體資料多播傳送到播放終端;以及播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。The present invention provides a stream media synchronous playback system, including: a control unit; a unicast server coupled to the control unit; a multicast server coupled to the control unit and the unicast server; multiple playback terminals coupled to To the control unit and the multicast server; and multiple displays, coupled to the playback terminal. The control unit selects the streaming media address on the unicast server, and registers the streaming media address to the multicast server; the multicast server generates the multicast streaming media address according to the streaming media address; the control unit Receive the multicast streaming media address from the multicast server, and send the multicast streaming media address to multiple playback terminals; the unicast server sends the streaming media data to the multicast server, and the multicast server Multicasting the streaming media data to the playback terminal; and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays.
基於上述,本發明的串流媒體同步播放方法及串流媒體同步播放系統由控制單元在單播伺服器上選擇串流媒體位址並將串流媒體位址註冊到多播伺服器以產生多播串流媒體位址,且播放終端從控制單元接收多播串流媒體位址。多播伺服器將從單播伺服器接收的串流媒體資料多播傳送到播放終端,且播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。Based on the above, in the streaming media synchronization playback method and streaming media synchronization playback system of the present invention, the control unit selects the streaming media address on the unicast server and registers the streaming media address to the multicast server to generate multiple The streaming media address is broadcast, and the playback terminal receives the multicast streaming media address from the control unit. The multicast server multicasts the streaming media data received from the unicast server to the playback terminal, and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays.
圖1為根據本發明一實施例的串流媒體同步播放系統的方塊圖。FIG. 1 is a block diagram of a system for synchronously playing streaming media according to an embodiment of the present invention.
請參照圖1,本發明一實施例的串流媒體同步播放系統100包括控制單元110、單播伺服器120、多播伺服器130、播放終端141~149、及顯示器150。圖1中的顯示器150僅為例示說明。在一實施例中,每個播放終端141~149可分別耦接到一個顯示器150。本發明也不限制播放終端141~149的數量。下文中,播放終端140代表一或多個播放終端141~149。Please refer to FIG. 1, a stream media
在一實施例中,控制單元110在單播伺服器120上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器130。串流媒體位址例如是串流媒體統一資源定位符(Uniform Resource Locator ,URL)。多播伺服器130根據串流媒體位址產生多播串流媒體位址。控制單元110從多播伺服器130接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端140。單播伺服器120傳送串流媒體資料到多播伺服器130,並多播伺服器130將串流媒體資料多播傳送到播放終端140。播放終端140解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器150。In one embodiment, the
在一實施例中,多個播放終端140可拼接而成一個拼接影片牆,且控制單元110可根據播放終端140上傳的解析度來編輯每個播放終端140在大型拼接影片牆的座標位置並將各座標位置訊息發送給每個播放終端140。如此一來,每個播放終端140能判斷自己在拼接影片牆的座標,並判斷播放內容是否落在自己的座標區域,從而決定當前播放終端140是否需要播放串流媒體並顯示特定區域的內容。In an embodiment,
在一實施例中,串流媒體註冊功能可由控制單元110主動發起。使用者可選擇一個串流媒體放置到拼接影片牆播放。若播放區域占據多個播放終端140則需要進行註冊服務。若播放區域只占據一個播放終端140則控制單元110只需要選擇播放內容矩形區域內的播放終端140直接播放原始串流媒體而不需要使用多播轉發功能。不在播放區域內的播放終端140不執行任何操作。若使用者將播放內容矩形移動到多個播放終端,則控制單元110需要先發送關閉播放指令以停止原始串流媒體播放,隨後再發送註冊串流媒體服務讓播放終端140根據串流媒體的座標訊息決定當前播放終端是否需要執行播放。In an embodiment, the streaming media registration function can be initiated by the
在一實施例中,播放終端140可為一個運行作業系統的裝置,並執行一個運行在作業系統上的應用程式。串流媒體指令可控制播放終端140的連接狀態。在一實施例中,串流媒體指令使用即時串流協定(Real Time Streaming Protocol,RTSP)並可包括多個指令,例如用於獲取伺服器支援的具體會話(session)互動服務、串流媒體格式描述、串流媒體傳輸的多播位址及通訊埠、開始、暫停、停止等功能的指令。In one embodiment, the
圖2為根據本發明一實施例的控制單元的方塊圖。Fig. 2 is a block diagram of a control unit according to an embodiment of the present invention.
請同時參照圖1及圖2,本發明一實施例的控制單元110包括設備管理模組111、終端布局模組112及控制指令模組113透過網路組件114與外界通訊。1 and 2 at the same time, the
在一實施例中,設備管理模組111可進行單播伺服器120、多播伺服器130及播放終端140的發現、新增、修改、刪除操作。單播伺服器120可為網路攝影機、數位視訊錄影機(Digital Video Recorder,DVR)、網路編碼盒等設備並支援開放網路視訊連接頭論壇(Open Network Video Interface Forum,ONVIF)標準,可提供用戶快速地將串流媒體接入系統。關於不支援ONVIF的其他網路串流媒體,可透過手動輸入串流媒體URL的方式加入系統,並給予不同的命名以便之後的播放管理。修改功能可支援串流媒體URL及別名編輯修改,當實際串流媒體屬性發生變動時可用此方法更新。In an embodiment, the
在一實施例中,串流媒體多播伺服器130及播放終端140的新增可使用私人協定實現。私人協定可包括搜索發現功能,能夠枚舉出當前網路中存在的多播伺服器130及播放終端140等設備。設備訊息可包括網路協定(Internet Protocol,IP)、通訊埠(port)號碼、設備媒體存取控制(Media Access Control,MAC)位址、設備類型、播放終端140耦接的顯示器150的解析度等資訊。IP及通訊埠號碼用於控制單元110與設備建立通訊並發送不同的指令。MAC位址是設備存在唯一性的標誌。由於設備IP可能發生改變,因此設備每次上線都會自動更新設備的上述屬性訊息以確保控制單元110可與已新增的設備正常通訊。In one embodiment, the addition of the streaming
在一實施例中,終端布局模組112用於確定拼接影片牆中各個播放終端140的具體位置。多個播放終端140的拼接可實現高解析度的顯示牆,對於安防監控、會議大廳及大型展廳等有較好的效果且容易實施。控制單元110能獲取已經新增到系統內的每個播放終端140的輸出解析度。圖3為根據本發明一實施例的控制單元進行播放終端布局的座標示意圖。請參照圖3,播放終端141~149的解析度都是1920*1080。終端布局模組112將播放終端141~149布局為3*3的方式,並設置播放終端141~149對應的顯示器150左上角及右下角在x軸及y軸上的位置來標示具體布局位置。舉例來說,播放終端141~149的具體座標分別為(0,0),(1919,1079)、(1920,0),(3839,1079)、(3839,0),(5759,1079)、(0,1080),(1919,2159) 、(1920,1080),(3839,2159) 、(3839,1080),(5759,2159) 、(0,2160),(1919,3239) 、(1920,2160),(3839,3239) 、(3839,2160),(5759,3239)。In one embodiment, the
請再參照圖2,控制指令模組113用於進行系統內不同設備的播放管理,包括在拼接影片牆內播放、停止播放及移動。Referring to FIG. 2 again, the
圖4為根據本發明一實施例的控制單元執行播放指令的流程圖。Fig. 4 is a flowchart of a control unit executing a play instruction according to an embodiment of the present invention.
請參照圖4,在步驟S401中,控制單元發送註冊串流媒體指令到多播伺服器。Referring to FIG. 4, in step S401, the control unit sends a streaming media registration instruction to the multicast server.
在步驟S402中,控制單元發送多播伺服器回傳的多播串流媒體位址到播放終端。In step S402, the control unit sends the multicast streaming media address returned by the multicast server to the playback terminal.
在步驟S403中,播放終端根據多播串流媒體位址與多播伺服器建立會話通訊。In step S403, the playback terminal establishes a session communication with the multicast server according to the multicast streaming media address.
在步驟S404中,多播伺服器與單播伺服器建立會話並開始串流媒體通訊,從單播伺服器接收資料封包以多播發送到播放終端。In step S404, the multicast server establishes a session with the unicast server and starts streaming media communication, receives data packets from the unicast server and sends them to the playback terminal by multicast.
在步驟S405中,播放終端接收串流媒體資料以播放顯示。In step S405, the playback terminal receives the streaming media data for playback and display.
圖5為根據本發明一實施例的控制單元執行停止播放指令的流程圖。Fig. 5 is a flowchart of a control unit executing a stop playing instruction according to an embodiment of the present invention.
請參照圖5,在步驟S501中,控制單元發送關閉媒體指令到播放終端。Referring to FIG. 5, in step S501, the control unit sends a media closing instruction to the playback terminal.
在步驟S502中,播放終端斷開與多播伺服器的通訊並停止播放內容。In step S502, the playback terminal disconnects the communication with the multicast server and stops playing the content.
在步驟S503中,控制單元發送註銷指令到多播伺服器讓多播伺服器斷開與單播伺服器的通訊。In step S503, the control unit sends a logout instruction to the multicast server to make the multicast server disconnect from the unicast server.
請再參照圖2,控制指令模組113還可執行移動播放區域的操作。具體來說,若播放區域的跨終端(即,橫跨播放終端140)狀態發生改變則控制指令模組113需要將播放內容停止,並重新執行預設的播放邏輯判斷。若播放區域的跨終端狀態不變則控制指令模組113直接發送移動播放區域指令。播放終端140需要自行判斷是否停止播放。Please refer to FIG. 2 again, the
圖6為根據本發明一實施例的單播伺服器的方塊圖。Fig. 6 is a block diagram of a unicast server according to an embodiment of the invention.
請參照圖6,單播伺服器120可包括ONVIF設備發現模組121、串流媒體會話模組122、串流媒體編碼RTP封裝發送模組123及網路組件124。ONVIF設備發現模組121支援ONVIF標準並用以新增網路攝影機等設備。ONVIF標準描述網路影片的模型、介面、資料類型及資料互動模式等。串流媒體會話模組122可提供會話互動服務。串流媒體編碼RTP封裝發送模組123可將串流媒體資料進行即時傳輸協定(Real-time Transport Protocol,RTP)封包封裝並發送。網路組件124例如是網路晶片。在一實施例中,音頻及影像串流採用RTSP及RTP協定進行。RTSP協定用於媒體會話以建立並控制一或多個時間同步的連續串流媒體但本身不發送連續串流。RTP協定詳細說明在網路上傳送音頻與影像的標準資料封包格式並創建在用戶資料報協定(User Datagram Protocol,UDP)上,當圖像資料壓縮後依照RTP進行資料分割產生封包並發送出。6, the
圖7為根據本發明一實施例的多播伺服器的方塊圖。FIG. 7 is a block diagram of a multicast server according to an embodiment of the invention.
請參照圖1及圖7,多播伺服器130包括設備發現模組131、註冊及註銷服務模組132、會話模組133、媒體資料讀取模組134、多播轉發模組135及網路組件136。設備發現模組131根據預定協定來描述設備網路IP位址、設備MAC位址及設備類型。註冊及註銷服務模組132接受控制單元110的註冊指令以註冊串流媒體位址並產生多播串流媒體位址,在接收到播放終端140的播放指令後才與單播伺服器120互動,並接收註銷指令以停止接收單播伺服器120的串流媒體資料。會話模組133包括註冊指令、註銷指令、播放指令、暫停指令及停止指令。媒體資料讀取模組134使用RTP封裝格式來處理串流媒體資料。多播轉發模組135從播放終端140接收播放指令並判斷對應播放指令的串流媒體是否已處於轉發狀態,若串流媒體沒處於轉發狀態則與單播伺服器120建立會話通訊以獲得影音資料以多播方式發送出。網路組件136例如是網路晶片。1 and 7, the
圖8為根據本發明一實施例的播放終端的方塊圖。Fig. 8 is a block diagram of a playback terminal according to an embodiment of the present invention.
請參照圖8,播放終端140包括串流媒體播放器810,執行於硬體抽象層840、作業系統830、應用層820之上。播放終端140底層包括處理器851、網路卡852、電源853、音頻組件854及顯示組件855。顯示組件855耦接到顯示器860。串流媒體播放器810包括設備指令模組811、串流媒體獲取模組812、媒體解碼模組813及顯示模組814。設備指令模組811進行播放終端140的設備發現及控制指令處理。設備發現可用私人協定來實現。控制單元110發送固定格式的設備發現請求指令且播放終端140可發送對應的響應。返回訊息包括網路IP、通訊埠號碼、設備MAC位址及設備類型等訊息。控制單元110可根據返回訊息與播放終端140建立連接通訊。播放終端140的控制指令處理用於接收來自控制單元110的播放控制指令,包括播放源的新增、刪除及移動。播放終端140根據當前終端座標位置與播放源是否有重疊區域判斷是否執行播放操作。刪除指令可停止影音串流播放。移動指令會根據播放源與當前終端重疊區域更新顯示,其中顯示區域座標需要轉換為當前終端內的絕對座標才能正確顯示。值得注意的是,控制單元110發送的座標為對應整個拼接影片牆的座標。Referring to FIG. 8, the
串流媒體獲取模組812使用RTSP及RTP協定。RTSP協定以客戶伺服器方式工作並支援多種控制指令,例如暫停/繼續、後退、前進等。RTSP協定為多媒體播放控制協定,讓用戶在播放網際網路下載的即時資料時能進行控制。RTSP協定為應用層協定並提供一個可擴展框架使得串流媒體可受控與點播,但RTSP協定本身並不用於傳送串流媒體資料而利用RTSP協定的子協定RTP及即時傳輸控制協議(Real-time Transport Control Protocol,RTCP)提供的服務來完成串流媒體資料的傳送。RTP及RTCP透過UDP來傳輸資料且RTSP透過傳輸控制協定(Transmission Control Protocol,TCP)來傳輸資料。RTP用於即時傳輸資料。RTP提供的資訊包括:時間戳記、序號、以及負載格式(即,用於說明資料的編碼格式)。RTCP用於服務品質(Quality of Service,QoS)回饋和同步媒體串流。相對於RTP來說,RTCP所占的頻寬非常小(例如,RTP的5%)。播放終端接收到的RTP資料包是經過UDP方式傳輸,因此可能會發生封包遺失或亂序。若發生封包則無法對接收到的資料封包重新組裝成一個完整的視訊壓縮封包(例如,H.264資料封包),只好丟棄同一影片幀的其他資料。The streaming
媒體解碼模組813可根據不同類型的音頻或影片選取對應的解碼器。每個編碼的資料封包均包含有時間戳記。在一實施例中,影片串流時間戳記可作為參考時鐘,用於控制媒體解碼速度和實現媒體同步播放。播放終端140通過RTSP及RTP協定獲取到一幀資料時,可記錄系統本地時鐘和媒體流的時間戳記作為參考時鐘。如此一來,解碼時需要依照參考時鐘將每個媒體資料封包的串流時間戳記轉換為本地時間戳記並加上一個時間延遲,其中時間延遲用於緩衝儲存和同步。若轉換過的時間戳記與當前本地時鐘的誤差在預設閥值以內,則判斷需要進行解碼。若轉換過後的時間大於當前本地時鐘,則無須解碼繼續等待。若轉換過後的時間戳記小於當前本地時鐘,說明當前幀解碼過晚需要丟棄。The media decoding module 813 can select a corresponding decoder according to different types of audio or video. Each encoded data packet contains a time stamp. In one embodiment, the movie stream timestamp can be used as a reference clock to control the media decoding speed and achieve synchronous media playback. When the
顯示模組814將解碼後的圖像根據播放源在拼接影片牆內的位置來顯示。The
綜上所述,本發明的串流媒體同步播放方法及串流媒體同步播放系統由控制單元在單播伺服器上選擇串流媒體位址並將串流媒體位址註冊到多播伺服器以產生多播串流媒體位址,且播放終端從控制單元接收多播串流媒體位址。多播伺服器將從單播伺服器接收的串流媒體資料多播傳送到播放終端,且播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。因此,本發明的串流媒體同步播放方法及串流媒體同步播放系統可解決在分散式拼接顯示系統由於串流媒體服務能力不足而導致顯示系統畫面不同步的問題,並使用較小的網路傳輸負載讓分散式拼接顯示系統能流暢地播放串流媒體。To sum up, in the streaming media synchronization playback method and streaming media synchronization playback system of the present invention, the control unit selects the streaming media address on the unicast server and registers the streaming media address to the multicast server to A multicast streaming media address is generated, and the playback terminal receives the multicast streaming media address from the control unit. The multicast server multicasts the streaming media data received from the unicast server to the playback terminal, and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays. Therefore, the streaming media synchronization playback method and streaming media synchronization playback system of the present invention can solve the problem of unsynchronized display system images caused by insufficient streaming media service capabilities in a distributed splicing display system, and use a smaller network The transmission load allows the distributed splicing display system to play streaming media smoothly.
雖然本揭露已以實施例揭露如上,然其並非用以限定本揭露,任何所屬技術領域中具有通常知識者,在不脫離本揭露的精神和範圍內,當可作些許的更動與潤飾,故本揭露的保護範圍當視後附的申請專利範圍所界定者為準。Although the present disclosure has been disclosed in the above embodiments, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of this disclosure. Therefore, The scope of protection of this disclosure shall be subject to those defined by the attached patent scope.
100:串流媒體同步播放系統
110:控制單元
120:單播伺服器
130:多播伺服器
140、141~149:播放終端
150:顯示器
111:設備管理模組
112:終端布局模組
113:控制指令模組
114:網路組件
S401~S405:控制單元執行播放指令的步驟
S501~S503:控制單元執行停止播放指令的步驟
121:ONVIF設備發現模組
122:串流媒體會話模組
123:串流媒體編碼RTP封裝發送模組
124:網路組件
131:設備發現模組
132:註冊及註銷服務模組
133:會話模組
134:媒體資料讀取模組
135:多播轉發模組
136:網路組件
810:串流媒體播放器
811:設備指令模組
812:串流媒體獲取模組
813:媒體解碼模組
814:顯示模組
820:應用層
830:作業系統
840:硬體抽象層
851:處理器
852:網路卡
853:電源
854:音頻組件
855:顯示組件
860:顯示器100: Streaming media synchronization playback system
110: control unit
120: Unicast server
130:
圖1為根據本發明一實施例的串流媒體同步播放系統的方塊圖。 圖2為根據本發明一實施例的控制單元的方塊圖。 圖3為根據本發明一實施例的控制單元進行播放終端布局的座標示意圖。 圖4為根據本發明一實施例的控制單元執行播放指令的流程圖。 圖5為根據本發明一實施例的控制單元執行停止播放指令的流程圖。 圖6為根據本發明一實施例的單播伺服器的方塊圖。 圖7為根據本發明一實施例的多播伺服器的方塊圖。 圖8為根據本發明一實施例的播放終端的方塊圖。 FIG. 1 is a block diagram of a system for synchronously playing streaming media according to an embodiment of the present invention. Fig. 2 is a block diagram of a control unit according to an embodiment of the present invention. Fig. 3 is a schematic diagram of the coordinates of the playback terminal layout performed by the control unit according to an embodiment of the present invention. Fig. 4 is a flowchart of a control unit executing a play instruction according to an embodiment of the present invention. Fig. 5 is a flowchart of a control unit executing a stop playing instruction according to an embodiment of the present invention. Fig. 6 is a block diagram of a unicast server according to an embodiment of the invention. FIG. 7 is a block diagram of a multicast server according to an embodiment of the invention. Fig. 8 is a block diagram of a playback terminal according to an embodiment of the present invention.
100:串流媒體同步播放系統 100: Streaming media synchronization playback system
110:控制單元 110: control unit
120:單播伺服器 120: Unicast server
130:多播伺服器 130: Multicast server
140、141~149:播放終端 140, 141~149: Play terminal
150:顯示器 150: display
Claims (14)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010400887.9 | 2020-05-13 | ||
CN202010400887.9A CN111447482A (en) | 2020-05-13 | 2020-05-13 | Synchronous playing method and system for streaming media |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI740547B true TWI740547B (en) | 2021-09-21 |
TW202143742A TW202143742A (en) | 2021-11-16 |
Family
ID=71653633
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109120793A TWI740547B (en) | 2020-05-13 | 2020-06-19 | Stream media synchonization playing method and stream media synchonization playing system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111447482A (en) |
TW (1) | TWI740547B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201041401A (en) * | 2009-03-23 | 2010-11-16 | Onlive Inc | System and method for multi-stream video compression |
TW201138464A (en) * | 2009-10-14 | 2011-11-01 | Sony Corp | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system |
CN102264001A (en) * | 2010-05-25 | 2011-11-30 | 华为技术有限公司 | Method for enhancing multicast reliability of Internet protocol television (IPTV), server and system |
CN104717315A (en) * | 2005-12-19 | 2015-06-17 | 艾利森电话股份有限公司 | Method for establishing a unicast media session |
EP1679856B1 (en) * | 2005-01-10 | 2015-08-12 | Thomson Licensing SA | Method of constructing a unique multicast address by a server. |
US9143333B2 (en) * | 2007-03-12 | 2015-09-22 | Upload Technologies S.A. | System and method for multicast transmission |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100490405C (en) * | 2003-09-03 | 2009-05-20 | 北京鼎视通软件技术有限公司 | Flow medium data multi-point transmission method |
CN100433730C (en) * | 2006-08-08 | 2008-11-12 | 杭州华三通信技术有限公司 | Method and system of multicast and video-on-demand |
EP2248300B1 (en) * | 2008-02-25 | 2013-06-12 | Telefonaktiebolaget L M Ericsson (PUBL) | Delivery of multicast data |
CN101998143B (en) * | 2009-08-26 | 2014-03-12 | 中兴通讯股份有限公司 | Method for multicasting video data, unicast server and client |
US8379562B2 (en) * | 2010-10-12 | 2013-02-19 | Ian Pitts | Paging relay controller and methods thereof |
CN109640029B (en) * | 2018-11-16 | 2020-10-02 | 视联动力信息技术股份有限公司 | Method and device for displaying video stream on wall |
-
2020
- 2020-05-13 CN CN202010400887.9A patent/CN111447482A/en active Pending
- 2020-06-19 TW TW109120793A patent/TWI740547B/en active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1679856B1 (en) * | 2005-01-10 | 2015-08-12 | Thomson Licensing SA | Method of constructing a unique multicast address by a server. |
CN104717315A (en) * | 2005-12-19 | 2015-06-17 | 艾利森电话股份有限公司 | Method for establishing a unicast media session |
US9143333B2 (en) * | 2007-03-12 | 2015-09-22 | Upload Technologies S.A. | System and method for multicast transmission |
TW201041401A (en) * | 2009-03-23 | 2010-11-16 | Onlive Inc | System and method for multi-stream video compression |
TW201138464A (en) * | 2009-10-14 | 2011-11-01 | Sony Corp | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system |
CN102264001A (en) * | 2010-05-25 | 2011-11-30 | 华为技术有限公司 | Method for enhancing multicast reliability of Internet protocol television (IPTV), server and system |
Also Published As
Publication number | Publication date |
---|---|
TW202143742A (en) | 2021-11-16 |
CN111447482A (en) | 2020-07-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8988486B2 (en) | Adaptive video communication channel | |
CN109495713B (en) | Video conference control method and device based on video networking | |
CN109640028B (en) | Method and device for carrying out conference combining on multiple video networking terminals and multiple Internet terminals | |
CN110022307B (en) | Control method of monitoring equipment and monitoring access server | |
CN110475094B (en) | Video conference processing method and device and readable storage medium | |
CN109862308B (en) | Batch processing method and system | |
CN110493554B (en) | Method and system for switching speaking terminal | |
RU2634206C2 (en) | Device and method of commutation of media streams in real time mode | |
CN110769310B (en) | Video processing method and device based on video network | |
CN109862307B (en) | Video conference initiating method and device | |
CN110049273B (en) | Video networking-based conference recording method and transfer server | |
CN108989837A (en) | A kind of method and apparatus of picture interception | |
CN110392225B (en) | Control method and video networking video conference system | |
CN112866725A (en) | Live broadcast control method and device | |
CN113194278A (en) | Conference control method and device and computer readable storage medium | |
CN110460898B (en) | Video processing method, system, device and machine readable medium | |
TWI495345B (en) | Video conference system and method using the same | |
CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
CN110769179B (en) | Audio and video data stream processing method and system | |
CN110830763A (en) | Monitoring video inspection method and device | |
CN110022286B (en) | Method and device for requesting multimedia program | |
CN110392275B (en) | Sharing method and device for manuscript demonstration and video networking soft terminal | |
CN111654659B (en) | Conference control method and device | |
CN110769297A (en) | Audio and video data processing method and system | |
CN110891156B (en) | Conference entering method and device of monitoring camera |