TWI740547B - Stream media synchonization playing method and stream media synchonization playing system - Google Patents

Stream media synchonization playing method and stream media synchonization playing system Download PDF

Info

Publication number
TWI740547B
TWI740547B TW109120793A TW109120793A TWI740547B TW I740547 B TWI740547 B TW I740547B TW 109120793 A TW109120793 A TW 109120793A TW 109120793 A TW109120793 A TW 109120793A TW I740547 B TWI740547 B TW I740547B
Authority
TW
Taiwan
Prior art keywords
streaming media
multicast
server
playback
control unit
Prior art date
Application number
TW109120793A
Other languages
Chinese (zh)
Other versions
TW202143742A (en
Inventor
尋亮
崔業勝
金鵬
劉沖
Original Assignee
威盛電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 威盛電子股份有限公司 filed Critical 威盛電子股份有限公司
Application granted granted Critical
Publication of TWI740547B publication Critical patent/TWI740547B/en
Publication of TW202143742A publication Critical patent/TW202143742A/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64Addressing
    • H04N21/6405Multicasting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64Addressing
    • H04N21/6408Unicasting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Abstract

A stream media synchronization playing method and a stream media synchronization playing system are provided. The stream media synchronization playing method includes: selecting a stream media address on a unicast server and registering the stream media address to a multicast server by a control unit; generating a multicast stream media address according to the stream media address by the multicast server; receiving the multicast stream media address from the multicast server and transmitting the multicast stream media address to multiple playing terminals by the control unit; transmitting a stream media data to the multicast server by the unicast server, and transmitting the stream media data to the playing terminals by the multicast server; and decoding the stream media data and transmitting the decoded stream media data to multiple displays by the playing terminals.

Description

串流媒體同步播放方法及串流媒體同步播放系統Streaming media synchronization playing method and streaming media synchronization playing system

本發明是有關於一種串流媒體同步播放方法及串流媒體同步播放系統,且特別是有關於一種用於拼接顯示系統的串流媒體同步播放方法及串流媒體同步播放系統。The present invention relates to a method for synchronously playing streaming media and a system for synchronously playing streaming media, and more particularly to a method for synchronously playing streaming media and a system for synchronously playing streaming media for splicing display systems.

影片拼接牆是由多個液晶顯示器(Liquid Crystal Display,LCD)或者發光二極體(Light Emitting Diode,LED)顯示器組成的大型矩形顯示牆,具有高解析度、大尺寸等優點,在安防監控和會議大廳使用較多。The video splicing wall is a large rectangular display wall composed of multiple liquid crystal displays (LCD) or light emitting diode (LED) displays. It has the advantages of high resolution and large size. It is used in security monitoring and Conference halls are used more frequently.

安防監控領域內許多網路攝影機和串流媒體伺服器通常以單播模式進行工作。隨著播放終端增加,串流媒體單播伺服器的負載量越高,這使得不同終端接收到的串流媒體資料時間不一致,最終導致播放畫面不同步。單播是用戶端與伺服器之間的點到點連接。「點到點」指每個用戶端都從伺服器接收遠端串流。僅當用戶端發出請求時,才發送單播串流。單播是在單一發送者和單一接受者之間通過網路進行的通訊。在分散式拼接顯示系統的拼接牆佈局中不同終端播放相同的串流媒體,它們與串流媒體伺服器都以單播方式傳輸媒體串流,所以媒體資料並不是一起發送出來的,所以播放終端顯示的可能不是同一幀畫面,整體就會看到類似畫面撕裂的現象。Many network cameras and streaming media servers in the security surveillance field usually work in unicast mode. As the number of playback terminals increases, the load of the streaming media unicast server becomes higher, which makes the time of streaming media data received by different terminals inconsistent, and eventually causes the playback screen to be out of sync. Unicast is a point-to-point connection between the client and the server. "Point-to-point" means that each client receives a remote stream from the server. Only when the client makes a request, the unicast stream is sent. Unicast is the communication between a single sender and a single receiver over the network. In the splicing wall layout of the distributed splicing display system, different terminals play the same streaming media. They and the streaming media server both transmit the media stream in unicast mode, so the media data is not sent out together, so the playback terminal The display may not be the same frame, and you will see the phenomenon of similar screen tearing as a whole.

串流媒體單播負載能力有限,最終將無法滿足多個終端請求串流媒體的需求。有些網路攝影機雖然支援多播,但是在搭建成型的監控系統中如果都設置為多播,多播位址和埠分配需要考慮,增加了繁瑣的工作。Streaming media unicast has a limited load capacity, and ultimately cannot meet the needs of multiple terminals requesting streaming media. Although some IP cameras support multicast, if they are all set to multicast in the built-in monitoring system, the multicast address and port allocation need to be considered, which adds tedious work.

多播傳輸中的發送者和接收者之間是點對多點網路連接。一台發送者可以同時給多個接收者傳輸相同的資料但只需複製一份相同的數據包,因此提高了資料傳送效率並減少了骨幹網路出現擁塞的可能性。多播解決了單播和廣播方式效率低的問題。當網路中的某些使用者需求特定資訊時,請求加入多播群組,多播資訊發送者僅發送一次資訊,多播路由器借助多播路由式通訊協定為多播數據包建立樹型路由,被傳遞的資訊在盡可能遠的分叉路口才開始複製和分發。The sender and receiver in multicast transmission are point-to-multipoint network connections. A sender can transmit the same data to multiple receivers at the same time but only needs to copy the same data packet, thus improving the efficiency of data transmission and reducing the possibility of congestion in the backbone network. Multicast solves the problem of low efficiency in unicast and broadcast methods. When some users in the network require specific information, they request to join a multicast group. The sender of the multicast information only sends the information once. The multicast router uses the multicast routing protocol to establish a tree-type route for the multicast data packet. , The information to be transmitted begins to be copied and distributed at the fork as far as possible.

有鑑於此,本發明提出一種串流媒體同步播放方法及串流媒體同步播放系統,在分散式顯示系統拼接成一個大型電視牆時可提高各個播放終端播放內容的同步性以減少畫面撕裂的現象。In view of this, the present invention proposes a stream media synchronization playback method and a stream media synchronization playback system. When a distributed display system is spliced into a large TV wall, the synchronization of the playback content of each playback terminal can be improved to reduce screen tearing. Phenomenon.

本發明提出一種串流媒體同步播放方法,包括:藉由控制單元在單播伺服器上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器;藉由多播伺服器根據串流媒體位址產生多播串流媒體位址;藉由控制單元從多播伺服器接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端;藉由單播伺服器傳送串流媒體資料到多播伺服器,並藉由多播伺服器將串流媒體資料多播傳送到播放終端;以及藉由播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。The present invention provides a method for synchronous playback of streaming media, which includes: selecting a streaming media address on a unicast server by a control unit, and registering the streaming media address to the multicast server; by the multicast server Generate a multicast streaming media address according to the streaming media address; receive the multicast streaming media address from the multicast server by the control unit, and transmit the multicast streaming media address to multiple playback terminals; The unicast server sends the streaming media data to the multicast server, and the multicast server multicasts the streaming media data to the playback terminal; and the playback terminal decodes the streaming media data and decodes the decoded Stream media data to multiple displays.

本發明提出一種串流媒體同步播放系統,包括:控制單元;單播伺服器,耦接到控制單元;多播伺服器,耦接到控制單元及單播伺服器;多個播放終端,耦接到控制單元及多播伺服器;以及多個顯示器,耦接到播放終端。控制單元在單播伺服器上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器;多播伺服器根據串流媒體位址產生多播串流媒體位址;控制單元從多播伺服器接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端;單播伺服器傳送串流媒體資料到多播伺服器,並多播伺服器將串流媒體資料多播傳送到播放終端;以及播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。The present invention provides a stream media synchronous playback system, including: a control unit; a unicast server coupled to the control unit; a multicast server coupled to the control unit and the unicast server; multiple playback terminals coupled to To the control unit and the multicast server; and multiple displays, coupled to the playback terminal. The control unit selects the streaming media address on the unicast server, and registers the streaming media address to the multicast server; the multicast server generates the multicast streaming media address according to the streaming media address; the control unit Receive the multicast streaming media address from the multicast server, and send the multicast streaming media address to multiple playback terminals; the unicast server sends the streaming media data to the multicast server, and the multicast server Multicasting the streaming media data to the playback terminal; and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays.

基於上述,本發明的串流媒體同步播放方法及串流媒體同步播放系統由控制單元在單播伺服器上選擇串流媒體位址並將串流媒體位址註冊到多播伺服器以產生多播串流媒體位址,且播放終端從控制單元接收多播串流媒體位址。多播伺服器將從單播伺服器接收的串流媒體資料多播傳送到播放終端,且播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。Based on the above, in the streaming media synchronization playback method and streaming media synchronization playback system of the present invention, the control unit selects the streaming media address on the unicast server and registers the streaming media address to the multicast server to generate multiple The streaming media address is broadcast, and the playback terminal receives the multicast streaming media address from the control unit. The multicast server multicasts the streaming media data received from the unicast server to the playback terminal, and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays.

圖1為根據本發明一實施例的串流媒體同步播放系統的方塊圖。FIG. 1 is a block diagram of a system for synchronously playing streaming media according to an embodiment of the present invention.

請參照圖1,本發明一實施例的串流媒體同步播放系統100包括控制單元110、單播伺服器120、多播伺服器130、播放終端141~149、及顯示器150。圖1中的顯示器150僅為例示說明。在一實施例中,每個播放終端141~149可分別耦接到一個顯示器150。本發明也不限制播放終端141~149的數量。下文中,播放終端140代表一或多個播放終端141~149。Please refer to FIG. 1, a stream media synchronization playback system 100 according to an embodiment of the present invention includes a control unit 110, a unicast server 120, a multicast server 130, playback terminals 141 to 149, and a display 150. The display 150 in FIG. 1 is for illustration only. In an embodiment, each of the playback terminals 141 to 149 may be coupled to a display 150 respectively. The present invention also does not limit the number of playback terminals 141 to 149. Hereinafter, the playback terminal 140 represents one or more playback terminals 141 to 149.

在一實施例中,控制單元110在單播伺服器120上選擇串流媒體位址,並將串流媒體位址註冊到多播伺服器130。串流媒體位址例如是串流媒體統一資源定位符(Uniform Resource Locator ,URL)。多播伺服器130根據串流媒體位址產生多播串流媒體位址。控制單元110從多播伺服器130接收多播串流媒體位址,並將多播串流媒體位址傳送到多個播放終端140。單播伺服器120傳送串流媒體資料到多播伺服器130,並多播伺服器130將串流媒體資料多播傳送到播放終端140。播放終端140解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器150。In one embodiment, the control unit 110 selects a streaming media address on the unicast server 120, and registers the streaming media address to the multicast server 130. The streaming media address is, for example, a Uniform Resource Locator (URL) for streaming media. The multicast server 130 generates a multicast streaming media address according to the streaming media address. The control unit 110 receives the multicast streaming media address from the multicast server 130 and transmits the multicast streaming media address to a plurality of playback terminals 140. The unicast server 120 transmits the streaming media data to the multicast server 130, and the multicast server 130 multicasts the streaming media data to the playback terminal 140. The playback terminal 140 decodes the streaming media data and transmits the decoded streaming media data to the multiple displays 150.

在一實施例中,多個播放終端140可拼接而成一個拼接影片牆,且控制單元110可根據播放終端140上傳的解析度來編輯每個播放終端140在大型拼接影片牆的座標位置並將各座標位置訊息發送給每個播放終端140。如此一來,每個播放終端140能判斷自己在拼接影片牆的座標,並判斷播放內容是否落在自己的座標區域,從而決定當前播放終端140是否需要播放串流媒體並顯示特定區域的內容。In an embodiment, multiple playback terminals 140 can be spliced to form a spliced video wall, and the control unit 110 can edit the coordinate position of each playback terminal 140 on the large spliced video wall according to the resolution uploaded by the playback terminal 140 Each coordinate position message is sent to each playback terminal 140. In this way, each playback terminal 140 can determine its own coordinates on the splicing video wall, and determine whether the playback content falls within its own coordinate area, thereby determining whether the current playback terminal 140 needs to play streaming media and display content in a specific area.

在一實施例中,串流媒體註冊功能可由控制單元110主動發起。使用者可選擇一個串流媒體放置到拼接影片牆播放。若播放區域占據多個播放終端140則需要進行註冊服務。若播放區域只占據一個播放終端140則控制單元110只需要選擇播放內容矩形區域內的播放終端140直接播放原始串流媒體而不需要使用多播轉發功能。不在播放區域內的播放終端140不執行任何操作。若使用者將播放內容矩形移動到多個播放終端,則控制單元110需要先發送關閉播放指令以停止原始串流媒體播放,隨後再發送註冊串流媒體服務讓播放終端140根據串流媒體的座標訊息決定當前播放終端是否需要執行播放。In an embodiment, the streaming media registration function can be initiated by the control unit 110 actively. The user can select a streaming media and place it on the video wall for playback. If the play area occupies multiple play terminals 140, a registration service is required. If the play area only occupies one play terminal 140, the control unit 110 only needs to select the play terminal 140 in the rectangular area of the play content to directly play the original streaming media without using the multicast forwarding function. The playback terminal 140 that is not in the playback area does not perform any operation. If the user moves the playback content rectangle to multiple playback terminals, the control unit 110 needs to first send a shutdown instruction to stop the original streaming media playback, and then send a registered streaming media service to let the playback terminal 140 according to the coordinates of the streaming media The message determines whether the current playback terminal needs to perform playback.

在一實施例中,播放終端140可為一個運行作業系統的裝置,並執行一個運行在作業系統上的應用程式。串流媒體指令可控制播放終端140的連接狀態。在一實施例中,串流媒體指令使用即時串流協定(Real Time Streaming Protocol,RTSP)並可包括多個指令,例如用於獲取伺服器支援的具體會話(session)互動服務、串流媒體格式描述、串流媒體傳輸的多播位址及通訊埠、開始、暫停、停止等功能的指令。In one embodiment, the playback terminal 140 may be a device that runs an operating system and executes an application program running on the operating system. The streaming media command can control the connection status of the playback terminal 140. In one embodiment, the streaming media command uses Real Time Streaming Protocol (RTSP) and may include multiple commands, for example, used to obtain specific session interactive services and streaming media formats supported by the server. Description, instructions for the multicast address and communication port of streaming media transmission, start, pause, stop and other functions.

圖2為根據本發明一實施例的控制單元的方塊圖。Fig. 2 is a block diagram of a control unit according to an embodiment of the present invention.

請同時參照圖1及圖2,本發明一實施例的控制單元110包括設備管理模組111、終端布局模組112及控制指令模組113透過網路組件114與外界通訊。1 and 2 at the same time, the control unit 110 of an embodiment of the present invention includes a device management module 111, a terminal layout module 112, and a control command module 113 to communicate with the outside world through a network component 114.

在一實施例中,設備管理模組111可進行單播伺服器120、多播伺服器130及播放終端140的發現、新增、修改、刪除操作。單播伺服器120可為網路攝影機、數位視訊錄影機(Digital Video Recorder,DVR)、網路編碼盒等設備並支援開放網路視訊連接頭論壇(Open Network Video Interface Forum,ONVIF)標準,可提供用戶快速地將串流媒體接入系統。關於不支援ONVIF的其他網路串流媒體,可透過手動輸入串流媒體URL的方式加入系統,並給予不同的命名以便之後的播放管理。修改功能可支援串流媒體URL及別名編輯修改,當實際串流媒體屬性發生變動時可用此方法更新。In an embodiment, the device management module 111 can perform the discovery, addition, modification, and deletion operations of the unicast server 120, the multicast server 130, and the playback terminal 140. The unicast server 120 can be a network camera, a digital video recorder (DVR), a network encoding box and other equipment and supports the Open Network Video Interface Forum (ONVIF) standard. Provide users with quick access to streaming media into the system. Regarding other network streaming media that do not support ONVIF, you can manually enter the URL of the streaming media to join the system and give it a different name for later playback management. The modification function supports editing and modification of streaming media URLs and aliases. This method can be used to update when the actual streaming media properties change.

在一實施例中,串流媒體多播伺服器130及播放終端140的新增可使用私人協定實現。私人協定可包括搜索發現功能,能夠枚舉出當前網路中存在的多播伺服器130及播放終端140等設備。設備訊息可包括網路協定(Internet Protocol,IP)、通訊埠(port)號碼、設備媒體存取控制(Media Access Control,MAC)位址、設備類型、播放終端140耦接的顯示器150的解析度等資訊。IP及通訊埠號碼用於控制單元110與設備建立通訊並發送不同的指令。MAC位址是設備存在唯一性的標誌。由於設備IP可能發生改變,因此設備每次上線都會自動更新設備的上述屬性訊息以確保控制單元110可與已新增的設備正常通訊。In one embodiment, the addition of the streaming media multicast server 130 and the playback terminal 140 can be implemented using a private agreement. The private agreement may include a search and discovery function, which can enumerate devices such as the multicast server 130 and the playback terminal 140 existing in the current network. The device information may include Internet Protocol (IP), port number, device Media Access Control (MAC) address, device type, and the resolution of the display 150 to which the playback terminal 140 is coupled. And other information. The IP and the communication port number are used for the control unit 110 to establish communication with the device and send different commands. The MAC address is a unique sign of the existence of a device. Since the device IP may change, the above-mentioned attribute information of the device will be automatically updated every time the device goes online to ensure that the control unit 110 can communicate normally with the newly added device.

在一實施例中,終端布局模組112用於確定拼接影片牆中各個播放終端140的具體位置。多個播放終端140的拼接可實現高解析度的顯示牆,對於安防監控、會議大廳及大型展廳等有較好的效果且容易實施。控制單元110能獲取已經新增到系統內的每個播放終端140的輸出解析度。圖3為根據本發明一實施例的控制單元進行播放終端布局的座標示意圖。請參照圖3,播放終端141~149的解析度都是1920*1080。終端布局模組112將播放終端141~149布局為3*3的方式,並設置播放終端141~149對應的顯示器150左上角及右下角在x軸及y軸上的位置來標示具體布局位置。舉例來說,播放終端141~149的具體座標分別為(0,0),(1919,1079)、(1920,0),(3839,1079)、(3839,0),(5759,1079)、(0,1080),(1919,2159) 、(1920,1080),(3839,2159) 、(3839,1080),(5759,2159) 、(0,2160),(1919,3239) 、(1920,2160),(3839,3239) 、(3839,2160),(5759,3239)。In one embodiment, the terminal layout module 112 is used to determine the specific location of each playback terminal 140 in the spliced video wall. The splicing of multiple playback terminals 140 can realize a high-resolution display wall, which has good effects on security monitoring, conference halls and large exhibition halls, and is easy to implement. The control unit 110 can obtain the output resolution of each playback terminal 140 that has been added to the system. Fig. 3 is a schematic diagram of the coordinates of the playback terminal layout performed by the control unit according to an embodiment of the present invention. Please refer to Figure 3, the resolutions of the playback terminals 141 to 149 are all 1920*1080. The terminal layout module 112 lays out the play terminals 141 to 149 in a 3*3 manner, and sets the positions of the upper left corner and the lower right corner of the display 150 corresponding to the play terminals 141 to 149 on the x-axis and y-axis to indicate the specific layout positions. For example, the specific coordinates of the playback terminals 141 to 149 are (0,0), (1919,1079), (1920,0), (3839,1079), (3839,0), (5759,1079), (0,1080), (1919,2159), (1920,1080), (3839,2159), (3839,1080), (5759,2159), (0,2160), (1919,3239), (1920 ,2160), (3839,3239), (3839,2160), (5759,3239).

請再參照圖2,控制指令模組113用於進行系統內不同設備的播放管理,包括在拼接影片牆內播放、停止播放及移動。Referring to FIG. 2 again, the control instruction module 113 is used for playing management of different devices in the system, including playing in the splicing video wall, stopping playing, and moving.

圖4為根據本發明一實施例的控制單元執行播放指令的流程圖。Fig. 4 is a flowchart of a control unit executing a play instruction according to an embodiment of the present invention.

請參照圖4,在步驟S401中,控制單元發送註冊串流媒體指令到多播伺服器。Referring to FIG. 4, in step S401, the control unit sends a streaming media registration instruction to the multicast server.

在步驟S402中,控制單元發送多播伺服器回傳的多播串流媒體位址到播放終端。In step S402, the control unit sends the multicast streaming media address returned by the multicast server to the playback terminal.

在步驟S403中,播放終端根據多播串流媒體位址與多播伺服器建立會話通訊。In step S403, the playback terminal establishes a session communication with the multicast server according to the multicast streaming media address.

在步驟S404中,多播伺服器與單播伺服器建立會話並開始串流媒體通訊,從單播伺服器接收資料封包以多播發送到播放終端。In step S404, the multicast server establishes a session with the unicast server and starts streaming media communication, receives data packets from the unicast server and sends them to the playback terminal by multicast.

在步驟S405中,播放終端接收串流媒體資料以播放顯示。In step S405, the playback terminal receives the streaming media data for playback and display.

圖5為根據本發明一實施例的控制單元執行停止播放指令的流程圖。Fig. 5 is a flowchart of a control unit executing a stop playing instruction according to an embodiment of the present invention.

請參照圖5,在步驟S501中,控制單元發送關閉媒體指令到播放終端。Referring to FIG. 5, in step S501, the control unit sends a media closing instruction to the playback terminal.

在步驟S502中,播放終端斷開與多播伺服器的通訊並停止播放內容。In step S502, the playback terminal disconnects the communication with the multicast server and stops playing the content.

在步驟S503中,控制單元發送註銷指令到多播伺服器讓多播伺服器斷開與單播伺服器的通訊。In step S503, the control unit sends a logout instruction to the multicast server to make the multicast server disconnect from the unicast server.

請再參照圖2,控制指令模組113還可執行移動播放區域的操作。具體來說,若播放區域的跨終端(即,橫跨播放終端140)狀態發生改變則控制指令模組113需要將播放內容停止,並重新執行預設的播放邏輯判斷。若播放區域的跨終端狀態不變則控制指令模組113直接發送移動播放區域指令。播放終端140需要自行判斷是否停止播放。Please refer to FIG. 2 again, the control instruction module 113 can also perform the operation of moving the playing area. Specifically, if the cross-terminal (ie, cross-playing terminal 140) status of the play area changes, the control instruction module 113 needs to stop the play content and re-execute the preset play logic judgment. If the cross-terminal state of the play area remains unchanged, the control instruction module 113 directly sends a move play area instruction. The playing terminal 140 needs to determine by itself whether to stop playing.

圖6為根據本發明一實施例的單播伺服器的方塊圖。Fig. 6 is a block diagram of a unicast server according to an embodiment of the invention.

請參照圖6,單播伺服器120可包括ONVIF設備發現模組121、串流媒體會話模組122、串流媒體編碼RTP封裝發送模組123及網路組件124。ONVIF設備發現模組121支援ONVIF標準並用以新增網路攝影機等設備。ONVIF標準描述網路影片的模型、介面、資料類型及資料互動模式等。串流媒體會話模組122可提供會話互動服務。串流媒體編碼RTP封裝發送模組123可將串流媒體資料進行即時傳輸協定(Real-time Transport Protocol,RTP)封包封裝並發送。網路組件124例如是網路晶片。在一實施例中,音頻及影像串流採用RTSP及RTP協定進行。RTSP協定用於媒體會話以建立並控制一或多個時間同步的連續串流媒體但本身不發送連續串流。RTP協定詳細說明在網路上傳送音頻與影像的標準資料封包格式並創建在用戶資料報協定(User Datagram Protocol,UDP)上,當圖像資料壓縮後依照RTP進行資料分割產生封包並發送出。6, the unicast server 120 may include an ONVIF device discovery module 121, a streaming media session module 122, a streaming media encoding RTP package sending module 123, and a network component 124. The ONVIF device discovery module 121 supports the ONVIF standard and is used to add devices such as network cameras. The ONVIF standard describes the model, interface, data type, and data interaction mode of online videos. The streaming media session module 122 can provide session interactive services. The streaming media encoding RTP encapsulation sending module 123 can encapsulate and send the streaming media data in Real-time Transport Protocol (RTP) packets. The network component 124 is, for example, a network chip. In one embodiment, audio and video streaming is performed using RTSP and RTP protocols. The RTSP protocol is used for media sessions to establish and control one or more time-synchronized continuous streaming media without sending continuous streaming itself. The RTP protocol specifies the standard data packet format for transmitting audio and video over the network and is created on the User Datagram Protocol (UDP). When the image data is compressed, the data is split according to RTP to generate a packet and send it out.

圖7為根據本發明一實施例的多播伺服器的方塊圖。FIG. 7 is a block diagram of a multicast server according to an embodiment of the invention.

請參照圖1及圖7,多播伺服器130包括設備發現模組131、註冊及註銷服務模組132、會話模組133、媒體資料讀取模組134、多播轉發模組135及網路組件136。設備發現模組131根據預定協定來描述設備網路IP位址、設備MAC位址及設備類型。註冊及註銷服務模組132接受控制單元110的註冊指令以註冊串流媒體位址並產生多播串流媒體位址,在接收到播放終端140的播放指令後才與單播伺服器120互動,並接收註銷指令以停止接收單播伺服器120的串流媒體資料。會話模組133包括註冊指令、註銷指令、播放指令、暫停指令及停止指令。媒體資料讀取模組134使用RTP封裝格式來處理串流媒體資料。多播轉發模組135從播放終端140接收播放指令並判斷對應播放指令的串流媒體是否已處於轉發狀態,若串流媒體沒處於轉發狀態則與單播伺服器120建立會話通訊以獲得影音資料以多播方式發送出。網路組件136例如是網路晶片。1 and 7, the multicast server 130 includes a device discovery module 131, a registration and deregistration service module 132, a session module 133, a media data reading module 134, a multicast forwarding module 135, and a network Component 136. The device discovery module 131 describes the device network IP address, device MAC address, and device type according to a predetermined protocol. The registration and deregistration service module 132 accepts the registration command from the control unit 110 to register the streaming media address and generate the multicast streaming media address, and interacts with the unicast server 120 after receiving the playback command from the playback terminal 140. And receiving a logout command to stop receiving the streaming media data of the unicast server 120. The session module 133 includes a registration command, a logout command, a play command, a pause command, and a stop command. The media data reading module 134 uses the RTP encapsulation format to process the streaming media data. The multicast forwarding module 135 receives the play instruction from the play terminal 140 and determines whether the streaming media corresponding to the play instruction is in the forwarding state. If the streaming media is not in the forwarding state, it establishes a session communication with the unicast server 120 to obtain audiovisual data Send out in multicast mode. The network component 136 is, for example, a network chip.

圖8為根據本發明一實施例的播放終端的方塊圖。Fig. 8 is a block diagram of a playback terminal according to an embodiment of the present invention.

請參照圖8,播放終端140包括串流媒體播放器810,執行於硬體抽象層840、作業系統830、應用層820之上。播放終端140底層包括處理器851、網路卡852、電源853、音頻組件854及顯示組件855。顯示組件855耦接到顯示器860。串流媒體播放器810包括設備指令模組811、串流媒體獲取模組812、媒體解碼模組813及顯示模組814。設備指令模組811進行播放終端140的設備發現及控制指令處理。設備發現可用私人協定來實現。控制單元110發送固定格式的設備發現請求指令且播放終端140可發送對應的響應。返回訊息包括網路IP、通訊埠號碼、設備MAC位址及設備類型等訊息。控制單元110可根據返回訊息與播放終端140建立連接通訊。播放終端140的控制指令處理用於接收來自控制單元110的播放控制指令,包括播放源的新增、刪除及移動。播放終端140根據當前終端座標位置與播放源是否有重疊區域判斷是否執行播放操作。刪除指令可停止影音串流播放。移動指令會根據播放源與當前終端重疊區域更新顯示,其中顯示區域座標需要轉換為當前終端內的絕對座標才能正確顯示。值得注意的是,控制單元110發送的座標為對應整個拼接影片牆的座標。Referring to FIG. 8, the playback terminal 140 includes a streaming media player 810, which is executed on the hardware abstraction layer 840, the operating system 830, and the application layer 820. The bottom layer of the playback terminal 140 includes a processor 851, a network card 852, a power supply 853, an audio component 854, and a display component 855. The display component 855 is coupled to the display 860. The streaming media player 810 includes a device instruction module 811, a streaming media acquisition module 812, a media decoding module 813, and a display module 814. The device instruction module 811 performs device discovery and control instruction processing of the playback terminal 140. Device discovery can be achieved with a private agreement. The control unit 110 sends a device discovery request instruction in a fixed format and the playback terminal 140 can send a corresponding response. The returned information includes information such as network IP, port number, device MAC address, and device type. The control unit 110 can establish a connection communication with the playback terminal 140 according to the returned message. The control instruction processing of the play terminal 140 is used to receive play control instructions from the control unit 110, including adding, deleting, and moving play sources. The playback terminal 140 determines whether to perform a playback operation according to whether there is an overlapping area between the current terminal coordinate position and the playback source. The delete command can stop the video streaming. The movement command will update the display according to the overlapping area of the playback source and the current terminal, and the display area coordinates need to be converted to absolute coordinates in the current terminal to be displayed correctly. It is worth noting that the coordinates sent by the control unit 110 correspond to the coordinates of the entire spliced video wall.

串流媒體獲取模組812使用RTSP及RTP協定。RTSP協定以客戶伺服器方式工作並支援多種控制指令,例如暫停/繼續、後退、前進等。RTSP協定為多媒體播放控制協定,讓用戶在播放網際網路下載的即時資料時能進行控制。RTSP協定為應用層協定並提供一個可擴展框架使得串流媒體可受控與點播,但RTSP協定本身並不用於傳送串流媒體資料而利用RTSP協定的子協定RTP及即時傳輸控制協議(Real-time Transport Control Protocol,RTCP)提供的服務來完成串流媒體資料的傳送。RTP及RTCP透過UDP來傳輸資料且RTSP透過傳輸控制協定(Transmission Control Protocol,TCP)來傳輸資料。RTP用於即時傳輸資料。RTP提供的資訊包括:時間戳記、序號、以及負載格式(即,用於說明資料的編碼格式)。RTCP用於服務品質(Quality of Service,QoS)回饋和同步媒體串流。相對於RTP來說,RTCP所占的頻寬非常小(例如,RTP的5%)。播放終端接收到的RTP資料包是經過UDP方式傳輸,因此可能會發生封包遺失或亂序。若發生封包則無法對接收到的資料封包重新組裝成一個完整的視訊壓縮封包(例如,H.264資料封包),只好丟棄同一影片幀的其他資料。The streaming media acquisition module 812 uses RTSP and RTP protocols. The RTSP protocol works as a client server and supports a variety of control commands, such as pause/continue, back, forward, etc. The RTSP protocol is a multimedia playback control protocol that allows users to control when playing real-time data downloaded from the Internet. The RTSP protocol is an application layer protocol and provides an extensible framework to enable streaming media to be controlled and on-demand. However, the RTSP protocol itself is not used to transmit streaming media data and uses the sub-protocols of the RTSP protocol RTP and Real-Time Transmission Control Protocol (Real-Time Transmission Control Protocol). Time Transport Control Protocol (RTCP) provides services to complete the transmission of streaming media data. RTP and RTCP transmit data through UDP and RTSP transmits data through Transmission Control Protocol (TCP). RTP is used to transmit data in real time. The information provided by RTP includes: timestamp, serial number, and payload format (that is, the encoding format used to describe the data). RTCP is used for Quality of Service (QoS) feedback and synchronized media streaming. Compared with RTP, the bandwidth occupied by RTCP is very small (for example, 5% of RTP). The RTP data packets received by the playback terminal are transmitted via UDP, so packet loss or disorder may occur. If a packet occurs, the received data packet cannot be reassembled into a complete video compression packet (for example, an H.264 data packet), and other data of the same video frame has to be discarded.

媒體解碼模組813可根據不同類型的音頻或影片選取對應的解碼器。每個編碼的資料封包均包含有時間戳記。在一實施例中,影片串流時間戳記可作為參考時鐘,用於控制媒體解碼速度和實現媒體同步播放。播放終端140通過RTSP及RTP協定獲取到一幀資料時,可記錄系統本地時鐘和媒體流的時間戳記作為參考時鐘。如此一來,解碼時需要依照參考時鐘將每個媒體資料封包的串流時間戳記轉換為本地時間戳記並加上一個時間延遲,其中時間延遲用於緩衝儲存和同步。若轉換過的時間戳記與當前本地時鐘的誤差在預設閥值以內,則判斷需要進行解碼。若轉換過後的時間大於當前本地時鐘,則無須解碼繼續等待。若轉換過後的時間戳記小於當前本地時鐘,說明當前幀解碼過晚需要丟棄。The media decoding module 813 can select a corresponding decoder according to different types of audio or video. Each encoded data packet contains a time stamp. In one embodiment, the movie stream timestamp can be used as a reference clock to control the media decoding speed and achieve synchronous media playback. When the playback terminal 140 obtains a frame of data through the RTSP and RTP protocols, it can record the system local clock and the time stamp of the media stream as a reference clock. In this way, it is necessary to convert the streaming time stamp of each media data packet into a local time stamp according to the reference clock during decoding and add a time delay, where the time delay is used for buffer storage and synchronization. If the error between the converted time stamp and the current local clock is within the preset threshold, it is determined that decoding is required. If the time after conversion is greater than the current local clock, there is no need to continue to wait for decoding. If the converted time stamp is less than the current local clock, it means that the current frame is decoded too late and needs to be discarded.

顯示模組814將解碼後的圖像根據播放源在拼接影片牆內的位置來顯示。The display module 814 displays the decoded image according to the position of the playback source in the spliced video wall.

綜上所述,本發明的串流媒體同步播放方法及串流媒體同步播放系統由控制單元在單播伺服器上選擇串流媒體位址並將串流媒體位址註冊到多播伺服器以產生多播串流媒體位址,且播放終端從控制單元接收多播串流媒體位址。多播伺服器將從單播伺服器接收的串流媒體資料多播傳送到播放終端,且播放終端解碼串流媒體資料並將解碼後的串流媒體資料傳送到多個顯示器。因此,本發明的串流媒體同步播放方法及串流媒體同步播放系統可解決在分散式拼接顯示系統由於串流媒體服務能力不足而導致顯示系統畫面不同步的問題,並使用較小的網路傳輸負載讓分散式拼接顯示系統能流暢地播放串流媒體。To sum up, in the streaming media synchronization playback method and streaming media synchronization playback system of the present invention, the control unit selects the streaming media address on the unicast server and registers the streaming media address to the multicast server to A multicast streaming media address is generated, and the playback terminal receives the multicast streaming media address from the control unit. The multicast server multicasts the streaming media data received from the unicast server to the playback terminal, and the playback terminal decodes the streaming media data and transmits the decoded streaming media data to multiple displays. Therefore, the streaming media synchronization playback method and streaming media synchronization playback system of the present invention can solve the problem of unsynchronized display system images caused by insufficient streaming media service capabilities in a distributed splicing display system, and use a smaller network The transmission load allows the distributed splicing display system to play streaming media smoothly.

雖然本揭露已以實施例揭露如上,然其並非用以限定本揭露,任何所屬技術領域中具有通常知識者,在不脫離本揭露的精神和範圍內,當可作些許的更動與潤飾,故本揭露的保護範圍當視後附的申請專利範圍所界定者為準。Although the present disclosure has been disclosed in the above embodiments, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of this disclosure. Therefore, The scope of protection of this disclosure shall be subject to those defined by the attached patent scope.

100:串流媒體同步播放系統 110:控制單元 120:單播伺服器 130:多播伺服器 140、141~149:播放終端 150:顯示器 111:設備管理模組 112:終端布局模組 113:控制指令模組 114:網路組件 S401~S405:控制單元執行播放指令的步驟 S501~S503:控制單元執行停止播放指令的步驟 121:ONVIF設備發現模組 122:串流媒體會話模組 123:串流媒體編碼RTP封裝發送模組 124:網路組件 131:設備發現模組 132:註冊及註銷服務模組 133:會話模組 134:媒體資料讀取模組 135:多播轉發模組 136:網路組件 810:串流媒體播放器 811:設備指令模組 812:串流媒體獲取模組 813:媒體解碼模組 814:顯示模組 820:應用層 830:作業系統 840:硬體抽象層 851:處理器 852:網路卡 853:電源 854:音頻組件 855:顯示組件 860:顯示器100: Streaming media synchronization playback system 110: control unit 120: Unicast server 130: Multicast server 140, 141~149: Play terminal 150: display 111: Device Management Module 112: Terminal layout module 113: Control Command Module 114: network components S401~S405: Steps for the control unit to execute playback instructions S501~S503: The control unit executes the steps to stop playing instructions 121: ONVIF device discovery module 122: Streaming media session module 123: Streaming media encoding RTP package sending module 124: network components 131: Device Discovery Module 132: Register and deregister service modules 133: Conversation Module 134: Media data reading module 135: Multicast forwarding module 136: network components 810: Streaming Media Player 811: Equipment Command Module 812: Streaming Media Acquisition Module 813: Media Decoding Module 814: display module 820: application layer 830: operating system 840: Hardware Abstraction Layer 851: processor 852: network card 853: Power 854: Audio component 855: display component 860: display

圖1為根據本發明一實施例的串流媒體同步播放系統的方塊圖。 圖2為根據本發明一實施例的控制單元的方塊圖。 圖3為根據本發明一實施例的控制單元進行播放終端布局的座標示意圖。 圖4為根據本發明一實施例的控制單元執行播放指令的流程圖。 圖5為根據本發明一實施例的控制單元執行停止播放指令的流程圖。 圖6為根據本發明一實施例的單播伺服器的方塊圖。 圖7為根據本發明一實施例的多播伺服器的方塊圖。 圖8為根據本發明一實施例的播放終端的方塊圖。 FIG. 1 is a block diagram of a system for synchronously playing streaming media according to an embodiment of the present invention. Fig. 2 is a block diagram of a control unit according to an embodiment of the present invention. Fig. 3 is a schematic diagram of the coordinates of the playback terminal layout performed by the control unit according to an embodiment of the present invention. Fig. 4 is a flowchart of a control unit executing a play instruction according to an embodiment of the present invention. Fig. 5 is a flowchart of a control unit executing a stop playing instruction according to an embodiment of the present invention. Fig. 6 is a block diagram of a unicast server according to an embodiment of the invention. FIG. 7 is a block diagram of a multicast server according to an embodiment of the invention. Fig. 8 is a block diagram of a playback terminal according to an embodiment of the present invention.

100:串流媒體同步播放系統 100: Streaming media synchronization playback system

110:控制單元 110: control unit

120:單播伺服器 120: Unicast server

130:多播伺服器 130: Multicast server

140、141~149:播放終端 140, 141~149: Play terminal

150:顯示器 150: display

Claims (14)

一種串流媒體同步播放方法,包括: 藉由一控制單元在一單播伺服器上選擇一串流媒體位址,並將該串流媒體位址註冊到一多播伺服器; 藉由該多播伺服器根據該串流媒體位址產生一多播串流媒體位址; 藉由該控制單元從該多播伺服器接收該多播串流媒體位址,並將該多播串流媒體位址傳送到多個播放終端; 藉由該單播伺服器傳送一串流媒體資料到該多播伺服器,並藉由該多播伺服器將該串流媒體資料多播傳送到該些播放終端;以及 藉由該些播放終端解碼該串流媒體資料並將解碼後的該串流媒體資料傳送到多個顯示器。 A method for synchronously playing streaming media, including: A control unit selects a streaming media address on a unicast server, and registers the streaming media address to a multicast server; Generating a multicast streaming media address according to the streaming media address by the multicast server; Receiving the multicast streaming media address from the multicast server by the control unit, and transmitting the multicast streaming media address to multiple playback terminals; Sending a stream of streaming media data to the multicast server via the unicast server, and multicasting the streaming media data to the playback terminals via the multicast server; and The playback terminals decode the streaming media data and transmit the decoded streaming media data to multiple displays. 如請求項1所述的串流媒體同步播放方法,其中該控制單元發現並新增一網路內的該單播伺服器、一多播伺服器及該些播放終端。The method for synchronously playing streaming media according to claim 1, wherein the control unit discovers and adds the unicast server, a multicast server, and the playback terminals in a network. 如請求項1所述的串流媒體同步播放方法,其中該控制單元新增所有線上的該些播放終端,並根據該些播放終端形成一拼接影片牆,其中該控制單元標記每個該些播放終端在拼接影片牆的一位置訊息並將該位置訊息傳送到每個該些播放終端。The method for synchronous playback of streaming media according to claim 1, wherein the control unit adds all the playback terminals on the line, and forms a spliced video wall according to the playback terminals, wherein the control unit marks each of the playback terminals The terminal is splicing a position information of the video wall and transmitting the position information to each of the playback terminals. 如請求項1所述的串流媒體同步播放方法,其中該單播伺服器包括一網路攝影機,且該控制單元透過一開放網路視訊連接頭論壇(Open Network Video Interface Forum,ONVIF)標準來新增該網路攝影機,其中該開放網路視訊連接頭論壇標準描述一網路影片的一模型、一介面、一資料類型及一資料互動模式。The method for synchronously playing streaming media according to claim 1, wherein the unicast server includes a network camera, and the control unit is implemented through an Open Network Video Interface Forum (ONVIF) standard Add the webcam, where the open web video connector forum standard describes a model, an interface, a data type, and a data interaction mode of a web video. 如請求項1所述的串流媒體同步播放方法,其中該多播伺服器包括: 一設備發現模組,根據一預定協定來描述一設備網路IP位址、一設備MAC位址及一設備類型; 一註冊及註銷服務模組,接受該控制單元的一註冊指令以註冊該串流媒體位址並產生該多播串流媒體位址,在接收到該些播放終端的一播放指令後才與該單播伺服器互動,並接收一註銷指令以停止接收該單播伺服器的該串流媒體資料; 一會話模組,包括該註冊指令、該註銷指令、一播放指令、一暫停指令及一停止指令; 一媒體資料讀取模組,使用一即時傳輸協定(Real-time Transport Protocol,RTP)封裝格式來處理該串流媒體資料;以及 一多播轉發模組,從該些播放終端接收一播放指令並判斷對應該播放指令的一串流媒體是否已處於一轉發狀態,若該串流媒體沒處於該轉發狀態則與該單播伺服器建立一會話通訊以獲得一影音資料。 The method for synchronously playing streaming media according to claim 1, wherein the multicast server includes: A device discovery module, which describes a device network IP address, a device MAC address, and a device type according to a predetermined protocol; A registration and deregistration service module accepts a registration command from the control unit to register the streaming media address and generate the multicast streaming media address, and then communicate with the broadcast terminal after receiving a playback command from the playback terminals. The unicast server interacts and receives a logout command to stop receiving the streaming media data of the unicast server; A session module, including the registration command, the logout command, a play command, a pause command, and a stop command; A media data reading module that uses a Real-time Transport Protocol (RTP) encapsulation format to process the streaming media data; and A multicast forwarding module that receives a play instruction from the play terminals and determines whether a stream of media corresponding to the play instruction is already in a forwarding state, and if the streaming media is not in the forwarding state, it will communicate with the unicast server The device establishes a session communication to obtain an audio-visual data. 如請求項1所述的串流媒體同步播放方法,其中該些播放終端以一多播方式接收該串流媒體資料,其中對應該串流媒體資料的一封包以該即時傳輸協定封裝格式封裝產生,且該封包透過一用戶資料報協定(User Datagram Protocol,UDP)傳送。The streaming media synchronous playback method of claim 1, wherein the playback terminals receive the streaming media data in a multicast manner, and a packet corresponding to the streaming media data is encapsulated in the real-time transmission protocol encapsulation format. , And the packet is transmitted through a User Datagram Protocol (UDP). 如請求項1所述的串流媒體同步播放方法,其中該控制單元、該多播伺服器及該些播放終端耦接到支援多播的一網路,且該單播伺服器耦接到一區域網路或一公用網路。The method for synchronous playback of streaming media according to claim 1, wherein the control unit, the multicast server, and the playback terminals are coupled to a network that supports multicast, and the unicast server is coupled to a Local area network or a public network. 一種串流媒體同步播放系統,包括: 一控制單元; 一單播伺服器,耦接到該控制單元; 一多播伺服器,耦接到該控制單元及該單播伺服器; 多個播放終端,耦接到該控制單元及該多播伺服器;以及 多個顯示器,耦接到該些播放終端,其中 該控制單元在該單播伺服器上選擇一串流媒體位址,並將該串流媒體位址註冊到該多播伺服器; 該多播伺服器根據該串流媒體位址產生一多播串流媒體位址; 該控制單元從該多播伺服器接收該多播串流媒體位址,並將該多播串流媒體位址傳送到該些播放終端; 該單播伺服器傳送一串流媒體資料到該多播伺服器,並該多播伺服器將該串流媒體資料多播傳送到該些播放終端;以及 該些播放終端解碼該串流媒體資料並將解碼後的該串流媒體資料傳送到該些顯示器。 A synchronous playback system for streaming media, including: A control unit; A unicast server, coupled to the control unit; A multicast server, coupled to the control unit and the unicast server; Multiple playback terminals, coupled to the control unit and the multicast server; and Multiple displays, coupled to the playback terminals, where The control unit selects a streaming media address on the unicast server, and registers the streaming media address to the multicast server; The multicast server generates a multicast streaming media address according to the streaming media address; The control unit receives the multicast streaming media address from the multicast server, and transmits the multicast streaming media address to the playback terminals; The unicast server sends a stream of streaming media data to the multicast server, and the multicast server multicasts the streaming media data to the playback terminals; and The playback terminals decode the streaming media data and transmit the decoded streaming media data to the displays. 如請求項8所述的串流媒體同步播放系統,其中該控制單元發現並新增一網路內的該單播伺服器、一多播伺服器及該些播放終端。The stream media synchronous playback system according to claim 8, wherein the control unit discovers and adds the unicast server, a multicast server, and the playback terminals in a network. 如請求項8所述的串流媒體同步播放系統,其中該控制單元新增所有線上的該些播放終端,並根據該些播放終端形成一拼接影片牆,其中該控制單元標記每個該些播放終端在拼接影片牆的一位置訊息並將該位置訊息傳送到每個該些播放終端。The streaming media synchronous playback system according to claim 8, wherein the control unit adds all the playback terminals on the line, and forms a spliced video wall according to the playback terminals, wherein the control unit marks each of the playback terminals The terminal is splicing a position information of the video wall and transmitting the position information to each of the playback terminals. 如請求項8所述的串流媒體同步播放系統,其中該單播伺服器包括一網路攝影機,且該控制單元透過一開放網路視訊連接頭論壇(Open Network Video Interface Forum,ONVIF)標準來新增該網路攝影機,其中該開放網路視訊連接頭論壇標準描述一網路影片的一模型、一介面、一資料類型及一資料互動模式。The streaming media synchronous playback system according to claim 8, wherein the unicast server includes a network camera, and the control unit is implemented through an Open Network Video Interface Forum (ONVIF) standard Add the webcam, where the open web video connector forum standard describes a model, an interface, a data type, and a data interaction mode of a web video. 如請求項8所述的串流媒體同步播放系統,其中該多播伺服器包括: 一設備發現模組,根據一預定協定來描述一設備網路IP位址、一設備MAC位址及一設備類型; 一註冊及註銷服務模組,接受該控制單元的一註冊指令以註冊該串流媒體位址並產生該多播串流媒體位址,在接收到該些播放終端的一播放指令後才與該單播伺服器互動,並接收一註銷指令以停止接收該單播伺服器的該串流媒體資料; 一會話模組,包括該註冊指令、該註銷指令、一播放指令、一暫停指令及一停止指令; 一媒體資料讀取模組,使用一即時傳輸協定(Real-time Transport Protocol,RTP)封裝格式來處理該串流媒體資料;以及 一多播轉發模組,從該些播放終端接收一播放指令並判斷對應該播放指令的一串流媒體是否已處於一轉發狀態,若該串流媒體沒處於該轉發狀態則與該單播伺服器建立一會話通訊以獲得一影音資料。 The streaming media synchronous playback system according to claim 8, wherein the multicast server includes: A device discovery module, which describes a device network IP address, a device MAC address, and a device type according to a predetermined protocol; A registration and deregistration service module accepts a registration command from the control unit to register the streaming media address and generate the multicast streaming media address, and then communicate with the broadcast terminal after receiving a playback command from the playback terminals. The unicast server interacts and receives a logout command to stop receiving the streaming media data of the unicast server; A session module, including the registration command, the logout command, a play command, a pause command, and a stop command; A media data reading module that uses a Real-time Transport Protocol (RTP) encapsulation format to process the streaming media data; and A multicast forwarding module that receives a play instruction from the play terminals and determines whether a stream of media corresponding to the play instruction is already in a forwarding state, and if the streaming media is not in the forwarding state, it will communicate with the unicast server The device establishes a session communication to obtain an audio-visual data. 如請求項8所述的串流媒體同步播放系統,其中該些播放終端以一多播方式接收該串流媒體資料,其中對應該串流媒體資料的一封包以該即時傳輸協定封裝格式封裝產生,且該封包透過一用戶資料報協定(User Datagram Protocol,UDP)傳送。The streaming media synchronous playback system according to claim 8, wherein the playback terminals receive the streaming media data in a multicast manner, and a packet corresponding to the streaming media data is encapsulated in the real-time transmission protocol encapsulation format. , And the packet is transmitted through a User Datagram Protocol (UDP). 如請求項8所述的串流媒體同步播放系統,其中該控制單元、該多播伺服器及該些播放終端耦接到支援多播的一網路,且該單播伺服器耦接到一區域網路或一公用網路。The streaming media synchronous playback system according to claim 8, wherein the control unit, the multicast server and the playback terminals are coupled to a network supporting multicast, and the unicast server is coupled to a Local area network or a public network.
TW109120793A 2020-05-13 2020-06-19 Stream media synchonization playing method and stream media synchonization playing system TWI740547B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010400887.9A CN111447482A (en) 2020-05-13 2020-05-13 Synchronous playing method and system for streaming media
CN202010400887.9 2020-05-13

Publications (2)

Publication Number Publication Date
TWI740547B true TWI740547B (en) 2021-09-21
TW202143742A TW202143742A (en) 2021-11-16

Family

ID=71653633

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109120793A TWI740547B (en) 2020-05-13 2020-06-19 Stream media synchonization playing method and stream media synchonization playing system

Country Status (2)

Country Link
CN (1) CN111447482A (en)
TW (1) TWI740547B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201041401A (en) * 2009-03-23 2010-11-16 Onlive Inc System and method for multi-stream video compression
TW201138464A (en) * 2009-10-14 2011-11-01 Sony Corp Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system
CN102264001A (en) * 2010-05-25 2011-11-30 华为技术有限公司 Method for enhancing multicast reliability of Internet protocol television (IPTV), server and system
CN104717315A (en) * 2005-12-19 2015-06-17 艾利森电话股份有限公司 Method for establishing a unicast media session
EP1679856B1 (en) * 2005-01-10 2015-08-12 Thomson Licensing SA Method of constructing a unique multicast address by a server.
US9143333B2 (en) * 2007-03-12 2015-09-22 Upload Technologies S.A. System and method for multicast transmission

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100490405C (en) * 2003-09-03 2009-05-20 北京鼎视通软件技术有限公司 Flow medium data multi-point transmission method
CN100433730C (en) * 2006-08-08 2008-11-12 杭州华三通信技术有限公司 Method and system of multicast and video-on-demand
CN101946458B (en) * 2008-02-25 2013-11-20 艾利森电话股份有限公司 Delivery of multicast data
CN101998143B (en) * 2009-08-26 2014-03-12 中兴通讯股份有限公司 Method for multicasting video data, unicast server and client
US8379562B2 (en) * 2010-10-12 2013-02-19 Ian Pitts Paging relay controller and methods thereof
CN109640029B (en) * 2018-11-16 2020-10-02 视联动力信息技术股份有限公司 Method and device for displaying video stream on wall

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1679856B1 (en) * 2005-01-10 2015-08-12 Thomson Licensing SA Method of constructing a unique multicast address by a server.
CN104717315A (en) * 2005-12-19 2015-06-17 艾利森电话股份有限公司 Method for establishing a unicast media session
US9143333B2 (en) * 2007-03-12 2015-09-22 Upload Technologies S.A. System and method for multicast transmission
TW201041401A (en) * 2009-03-23 2010-11-16 Onlive Inc System and method for multi-stream video compression
TW201138464A (en) * 2009-10-14 2011-11-01 Sony Corp Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system
CN102264001A (en) * 2010-05-25 2011-11-30 华为技术有限公司 Method for enhancing multicast reliability of Internet protocol television (IPTV), server and system

Also Published As

Publication number Publication date
CN111447482A (en) 2020-07-24
TW202143742A (en) 2021-11-16

Similar Documents

Publication Publication Date Title
US8988486B2 (en) Adaptive video communication channel
CN109495713B (en) Video conference control method and device based on video networking
CN109640028B (en) Method and device for carrying out conference combining on multiple video networking terminals and multiple Internet terminals
CN110022307B (en) Control method of monitoring equipment and monitoring access server
CN109862308B (en) Batch processing method and system
CN110475094B (en) Video conference processing method and device and readable storage medium
CN110493554B (en) Method and system for switching speaking terminal
RU2634206C2 (en) Device and method of commutation of media streams in real time mode
CN110769310B (en) Video processing method and device based on video network
CN110049273B (en) Video networking-based conference recording method and transfer server
CN112866725A (en) Live broadcast control method and device
CN113194278A (en) Conference control method and device and computer readable storage medium
CN110460898B (en) Video processing method, system, device and machine readable medium
TWI495345B (en) Video conference system and method using the same
CN109862307B (en) Video conference initiating method and device
CN110830750A (en) Data transmission method and device based on video network
CN110113558B (en) Data processing method, device, system and computer readable storage medium
CN110769179B (en) Audio and video data stream processing method and system
CN110022286B (en) Method and device for requesting multimedia program
CN110392275B (en) Sharing method and device for manuscript demonstration and video networking soft terminal
CN110769297A (en) Audio and video data processing method and system
CN110891156B (en) Conference entering method and device of monitoring camera
CN109963123B (en) Camera control method and device
CN110677392B (en) Video data transmission method and device
CN110392225B (en) Control method and video networking video conference system