TWI559775B - Network synchronous coordinating performance system - Google Patents

Network synchronous coordinating performance system Download PDF

Info

Publication number
TWI559775B
TWI559775B TW104103648A TW104103648A TWI559775B TW I559775 B TWI559775 B TW I559775B TW 104103648 A TW104103648 A TW 104103648A TW 104103648 A TW104103648 A TW 104103648A TW I559775 B TWI559775 B TW I559775B
Authority
TW
Taiwan
Prior art keywords
video stream
user
cooperative
player
stream
Prior art date
Application number
TW104103648A
Other languages
Chinese (zh)
Other versions
TW201630416A (en
Inventor
林孟賢
李星邑
Original Assignee
林孟賢
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 林孟賢 filed Critical 林孟賢
Priority to TW104103648A priority Critical patent/TWI559775B/en
Priority to CN201510287938.0A priority patent/CN105847887A/en
Publication of TW201630416A publication Critical patent/TW201630416A/en
Application granted granted Critical
Publication of TWI559775B publication Critical patent/TWI559775B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25875Management of end-user data involving end-user authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application

Description

網路協同演奏系統Network cooperative performance system

本發明係有關一種網路協同演奏系統,特別是指一種提供異地演奏者透過網路進行協同演奏,並根據各使用者之使用設定,以調整一協同影音串流中所包含之對應影音串流,並同步下載至各使用者之網路協同演奏系統。 The present invention relates to a network cooperative performance system, and more particularly to providing a remote performer to perform cooperative performance through a network, and adjusting a corresponding video stream included in a coordinated video stream according to usage settings of each user. And simultaneously download to each user's network collaborative performance system.

傳統之協同音樂演奏,為各演奏者位於同一場地或地點,如此方可具同步收音或播放之效果,但無法提供異地之演奏者進行協同演奏。網路上之網路影音服務網站,例如Youtube等,雖可提供不同地點之音樂演奏之影音檔,然其仍無法提供同步協同演奏之功能。 The traditional coordinated music performance is performed at the same venue or place for each performer, so that the effects of simultaneous radio or playback can be achieved, but the performers who perform the performance cannot be provided. Internet video service websites on the Internet, such as Youtube, can provide audio and video files in different locations, but they still cannot provide synchronized cooperative performance.

就其中一個觀點言,本發明提供了一種網路協同演奏系統,包含:一身份辨識單元,接收來自至少兩使用者所分別產生之辨識訊號,以辨識使用者之身分是否允許登入同一協同演奏群組,使用者之身分包含至少兩演奏者;一接收與處理單元,根據各使用者輸入之一使用設定,即時上傳使用者產生之複數個對應影音串流、並結合對應影音串流於一協同影音串流中;以及一傳送單元,根據各使用者輸入之使用設定,即時同步下載協同影音串流之對應 影音串流至各使用者;其中,各對應影音串流分別包含至少一影訊串流與至少一音訊串流。 In one aspect, the present invention provides a network cooperative performance system, comprising: an identity recognition unit that receives identification signals generated by at least two users to identify whether the identity of the user is allowed to log in to the same coordinated performance group. The user identity includes at least two players; a receiving and processing unit, according to one of the user input settings, instantly uploads a plurality of corresponding video streams generated by the user, and combines the corresponding video streams into a collaboration In the video stream; and a transmitting unit, according to the usage setting of each user input, the synchronous synchronization downloads the corresponding video stream correspondence The video stream is streamed to each user; wherein each corresponding video stream includes at least one video stream and at least one audio stream.

在其中一種較佳的實施例中,使用者之身分又包含一觀賞者或一學習者,當使用者之身分包含觀賞者,傳送單元根據使用者輸入之使用設定,上傳對於協同影音串流之評價或下載協同影音串流中對應影音串流;當使用者之身分包含一學習者,傳送單元根據使用者輸入之使用設定,下載協同影音串流中對應影音串流以及一學習輔助資訊。 In a preferred embodiment, the identity of the user includes a viewer or a learner. When the identity of the user includes the viewer, the transmitting unit uploads the coordinated video stream according to the usage setting of the user input. Evaluating or downloading the corresponding video stream in the collaborative video stream; when the user's identity includes a learner, the transmitting unit downloads the corresponding video stream and the learning auxiliary information in the coordinated video stream according to the user input setting.

在其中一種較佳的實施例中,當使用者登入之身分包含觀賞者,使用設定包含一上傳對於協同影音串流之評價、以及一下載選擇項,下載選擇項包含:選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流、消除協同影音串流中背景噪音、協同影音串流中對應影音串流之下載混和選擇、以及協同影音串流全部下載之選擇項其中之一或組合。 In one preferred embodiment, when the user's login identity includes a viewer, the usage setting includes an upload for the collaborative video stream evaluation, and a download selection, the download selection includes: selecting at least one player to Deciding to download the corresponding video stream included in the collaborative video stream, eliminating background noise in the cooperative video stream, downloading and mixing selection of the corresponding video stream in the cooperative video stream, and selecting all the cooperative video stream downloads. One or a combination.

在其中一種較佳的實施例中,當使用者登入之身分包含一學習者,其使用設定之一下載選擇項包含:協同影音串流全部下載、選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流、協同影音串流中對應影音串流之下載混和選擇、以及一學習輔助資訊之選擇項其中之一或組合。一較佳的實施例中,網路協同演奏系統又包含一評比單元,比較學習輔助資訊以及學習者產生之音訊串流,以決定並顯示學習者之學習成果。 In a preferred embodiment, when the user login identity includes a learner, the one of the usage selections downloads the selection item: the collaborative video stream is all downloaded, and at least one player is selected to determine the download of the coordinated video stream. One or a combination of the corresponding video stream, the download and mix selection of the corresponding video stream in the cooperative video stream, and the selection of a learning aid information. In a preferred embodiment, the network collaborative performance system further includes a rating unit that compares the learning assistance information with the audio stream generated by the learner to determine and display the learner's learning outcome.

在其中一種較佳的實施例中,學習輔助資訊包含樂譜資訊或節奏資訊,此樂譜資訊或節奏資訊可分別藉由樂譜畫面或節奏畫面顯示,並可與演奏者之影訊串流顯示於同一顯示器或不同之顯示器。此外,前述節奏資訊又可分別藉由拍點音訊表示,其可結合於與演奏者之音訊串流。 In a preferred embodiment, the learning aid information includes score information or rhythm information, which can be displayed by the score screen or the rhythm screen, respectively, and can be displayed on the same display as the player's video stream. Or a different display. In addition, the aforementioned tempo information can be separately represented by beat audio, which can be combined with the audio stream of the player.

在其中一種較佳的實施例中,當使用者登入之身分包含演奏者,使用設定包含:上傳選擇項與下載選擇項。上傳選擇項包含:對應影音串流現場原音上傳、消除對應影音串流之背景噪音、以及樂音模式上傳對應影音串流;下載選擇項包含:協同影音串流全部下載、選擇至少另一演奏者以決定下載協同影音串流中所包含之對應影音串流、協同影音串流中對應影音串流之下載混和選擇、以及下載之協同影音串流中不包含演奏者之對應影音串流之選擇項其中之一或組合。 In one preferred embodiment, when the user's login identity includes a player, the usage settings include: upload selections and download selections. The upload selection includes: corresponding audio stream uploading of the original sound, eliminating the background noise of the corresponding video stream, and the music pattern uploading the corresponding video stream; the downloading option includes: compiling the cooperative video stream all, selecting at least another player to Determining to download the corresponding video stream included in the collaborative video stream, the downloading and mixing selection of the corresponding video stream in the cooperative video stream, and the downloading of the coordinated video stream without including the player's corresponding video stream. One or a combination.

一種較佳的實施例中,前述之協同影音串流中對應影音串流之下載混和選擇包含:協同影音串流中各演奏者產生之音訊串流為彼此不混音或混音;以及協同影音串流中影訊串流,為各演奏者之畫面組合於同一畫面、或各演奏者之畫面分別為獨立畫面。一實施例中,當下載混和選擇為協同影音串流中各演奏者產生之音訊串流為彼此不混音,各演奏者產生之音訊串流可藉由多個播放器分別播放。另一實施例中,當下載混和選擇為協同影音串流中各演奏者產生之音訊串流為彼此混音,各演奏者之音訊串流可藉由單一播放器播放。又一實施例中,當協同影音串流中影訊串流,為各演奏者分割畫面組合於同一畫面,協同影音串流之畫面可藉由單一顯示器播放;當影訊串流為各演奏者畫面分別為獨立畫面,各演奏者之獨立畫面可藉由多個顯示器播放。 In a preferred embodiment, the downloading and mixing of the corresponding video stream in the cooperative video stream includes: the audio streams generated by the players in the cooperative video stream are unmixed or mixed with each other; and the coordinated video and audio In the streaming video stream, the screens of the respective players are combined on the same screen, or the screens of the respective players are independent screens. In one embodiment, when the downloading mix selects the audio streams generated by the players in the cooperative video stream to be unmixed with each other, the audio stream generated by each player can be played separately by a plurality of players. In another embodiment, when the download mix selects the audio streams generated by the players in the cooperative video stream to be mixed with each other, the audio stream of each player can be played by a single player. In another embodiment, when the video stream is coordinated in the video stream, and the split screens of the players are combined on the same screen, the screen of the cooperative video stream can be played by a single display; when the video stream is separately for each player screen For independent pictures, individual players' independent pictures can be played by multiple displays.

一實施例中,網路協同演奏系統又包含一中央伺服單元,協同演奏群組之使用者之等級包含至少一第一級使用者以及至少一第二級使用者,中央伺服器以及各使用者間分別具有一網路通道以傳遞網路協同演奏系統內之各對應影音串流,中央伺服單元與各第一級使用者間之網路節點數量,少於中央伺服單元與各第二級使用者間之網路節點數量。一實施例中,第一級使用者為一付費者,第二級使用者為一免費者。 In one embodiment, the network cooperative performance system further includes a central servo unit, and the level of the user of the cooperative performance group includes at least one first level user and at least one second level user, the central server, and each user. Each has a network channel to transmit each corresponding video stream in the network cooperative performance system, and the number of network nodes between the central servo unit and each first-level user is less than that of the central servo unit and each second level. The number of network nodes between the two. In one embodiment, the first level user is a payer and the second level user is a free user.

傳送單元又具有一運算裝置,其具有擴增實境之運算功能,運算裝置比對運算各對應影音串流所包含之影訊串流,使其中最少二影訊串流之顯示比例近似或符合正常比例,並將比對運算後的最少二影訊串流透過同一顯示器或同一場景予以顯示與控制。 The transmitting unit further has an arithmetic device, which has an arithmetic function for augmenting the real world, and the computing device compares and calculates the video stream included in each corresponding video stream, so that the display ratio of at least two of the video streams is approximate or conforms to a normal ratio. And display and control the minimum of two video streams after the comparison operation through the same display or the same scene.

接收與處理單元或傳送單元又具有一擷取比對單元,其分別擷取各使用者上傳之對應影音串流或下載之對應影音串流,並分析對應影音串流所對應之屬性,並將此屬性儲存於網路協同演奏系統中一比對資料庫,以根據比對資料庫提供該些使用者對應於該屬性之相關資訊。 The receiving and processing unit or the transmitting unit further has a capturing and comparing unit, which respectively captures the corresponding video stream uploaded by each user or downloads the corresponding video stream, and analyzes the attribute corresponding to the video stream, and This attribute is stored in a comparison database in the network cooperative performance system to provide relevant information corresponding to the attribute to the users according to the comparison database.

就另一個觀點言,本發明提供了一種網路協同演奏系統,其中一協同演奏群組之儲存資料包含一協同影音串流,此網路協同演奏系統包含:一身份辨識單元,接收來自至少一演奏者所產生之辨識訊號,以決定此演奏者與此觀賞者是否允許登入此協同演奏群組;一接收與處理單元,根據演奏者輸入之一使用設定,即時上傳演奏者產生之對應影音串流、並結合對應影音串流於新協同影音串流中;以及一傳送單元,根據演奏者之使用設定,即時下載協同影音串流至演奏者,以及根據觀賞者輸入之另一使用設定,即時下載協同影音串流至觀賞者。 In another aspect, the present invention provides a network cooperative performance system, wherein a stored data of a cooperative performance group includes a coordinated video stream, and the network cooperative performance system includes: an identity recognition unit, and the receiving is from at least one The identification signal generated by the player to determine whether the player and the viewer are allowed to log in to the cooperative performance group; a receiving and processing unit that uses the setting according to one of the player inputs to instantly upload the corresponding video string generated by the player Streaming and combining the corresponding video stream into the new coordinated video stream; and a transmitting unit, according to the player's usage setting, downloading the coordinated video stream to the player immediately, and according to another usage setting input by the viewer, Download the collaborative video stream to the viewer.

底下藉由具體實施例詳加說明,當更容易瞭解本發明之目的、技術內容、特點及其所達成之功效。 The purpose, technical content, features and effects achieved by the present invention will be more readily understood by the detailed description of the embodiments.

10、20、30‧‧‧網路協同演奏系統 10, 20, 30‧‧‧ Network collaborative performance system

11、21‧‧‧身份辨識單元 11, 21‧‧‧identity unit

12、22、32‧‧‧接收與處理單元 12, 22, 32‧‧‧ receiving and processing units

121‧‧‧擷取比對單元 121‧‧‧Collection unit

13、23、33‧‧‧傳送單元 13, 23, 33‧‧‧ transmission unit

131‧‧‧運算裝置 131‧‧‧ arithmetic device

132‧‧‧擷取比對單元 132‧‧‧Collection unit

221‧‧‧儲存單元 221‧‧‧ storage unit

Av1、Av2、Av3‧‧‧上傳之對應影音串流 Corresponding video stream uploaded by Av1, Av2, Av3‧‧‧

C1、C2、C3‧‧‧使用者資訊 C1, C2, C3‧‧‧ User Information

Cav‧‧‧協同影音串流 Cav‧‧‧Collaborative video streaming

Cav1、Cav2、Cav3‧‧‧下載之對應影音串流 Corresponding video stream of Cav1, Cav2, Cav3‧‧‧ download

CS‧‧‧中央伺服單元 CS‧‧‧Central Servo Unit

G1、G2、G3‧‧‧協同演奏群組 G1, G2, G3‧‧‧ collaborative performance group

Id1、Id2、Id3‧‧‧辨識訊號 Id1, Id2, Id3‧‧‧ identification signal

I1、I2‧‧‧相關資訊 I1, I2‧‧‧Related information

L1、L2、L3、L4、L5、L6、L7、L8、L9、L10‧‧‧使用者之地點 Locations of L1, L2, L3, L4, L5, L6, L7, L8, L9, L10‧‧‧ users

U1、U2、U3‧‧‧使用者 U1, U2, U3‧‧‧ users

〔第1圖〕顯示根據本發明之一種網路協同演奏系統;〔第2圖〕顯示根據本發明之下載選擇項; 〔第3圖〕顯示根據本發明之上載選擇項;〔第4A圖〕顯示根據本發明之一實施例,其中不混音之各演奏者產生之音訊串流與播放器之關係;〔第4B圖〕顯示根據本發明之一實施例,其中混音之各演奏者產生之音訊串流與播放器之關係;〔第4C圖〕顯示根據本發明之一實施例,其中各演奏者畫面組合於同一畫面之影訊串流與顯示器之關係;〔第4D圖〕顯示根據本發明之一實施例,其中各演奏者畫面分別為獨立畫面之影訊串流與各顯示器之關係;〔第5圖〕顯示根據本發明之另一種網路協同演奏系統;〔第6圖〕顯示藉由本發明一實施例之運算裝置,其根據影訊串流產生之擴增實境之效果示意;〔第7圖〕顯示根據本發明之一實施例中網路協同演奏系統之邏輯拓墣關係;〔第8圖〕顯示根據本發明之又一種網路協同演奏系統。 [Fig. 1] shows a network cooperative performance system according to the present invention; [Fig. 2] shows a download option according to the present invention; [Fig. 3] shows an upload selection item according to the present invention; [Fig. 4A] shows a relationship between an audio stream generated by each player without unmixing and a player according to an embodiment of the present invention; [4B] Figure 4 is a diagram showing the relationship between an audio stream produced by each player of a mix and a player in accordance with an embodiment of the present invention; [Fig. 4C] showing an embodiment of the present invention in which each player's picture is combined The relationship between the video stream of the same picture and the display; [4D] shows an embodiment of the present invention, wherein each player's picture is a relationship between the video stream of the independent picture and each display; [Fig. 5] Another network cooperative playing system according to the present invention; [Fig. 6] shows an arithmetic device according to an embodiment of the present invention, which is based on the effect of augmented reality generated by the video stream; [Fig. 7] shows A logical topology relationship of a network cooperative performance system in an embodiment of the present invention; [Fig. 8] shows still another network cooperative performance system according to the present invention.

請參閱第1圖,顯示本發明的第一個實施例之網路協同演奏系統10。如圖所示,網路協同演奏系統10包含一身份辨識單元11、一接收與處理單元12、以及一傳送單元13。身份辨識單元11,接收來自至少兩使用者U1、U2所分別產生之辨識訊號Id1、Id2,以辨識使用者U1、U2之身分是否允許登入一協同演奏群組。當身份辨識單元11確認辨識訊號Id1、Id2屬於同一協同演奏群組,網路協同演奏系統10可藉由網頁或通訊軟體、裝置等方式,要求使用者U1、U2分別輸入使用設定(於後詳細說明)。身份辨識單元11根據辨識訊號Id1、Id2以 及使用設定,產生使用者資訊C1(對應於使用者U1)、C2(對應於使用者U2),並傳送使用者資訊C1、C2至接收與處理單元12,接收與處理單元12根據使用者資訊C1、C2,接收使用者U1產生之對應影音串流Av1以及使用者U2產生之對應影音串流Av2,以產生一協同影音串流Cav。然而,前述接收使用者U2產生之對應影音串流Av2僅為說明目的之舉例,本案之使用者之身分可包含演奏者、觀賞者或學習者,例如當使用者U2之身分僅為學習者,接收與處理單元12僅接收使用者U1產生之對應影音串流Av1。前述使用者之數量不限於圖示,可包含更多使用者,例如三位或更多位使用者,且各使用者可具有各種之身分選擇。接收與處理單元12也不限於僅接收使用者U1、U2之產生之對應影音串流Av1、Av2,網路協同演奏系統10也可預存一對應影音串流(第5圖,儲存於儲存單元221中),而接收與處理單元12結合預存之對應影音串流與對應影音串流Av1、Av2於協同影音串流中,其詳細內容請參照後續實施例之說明。此外,傳送單元13為根據各使用者輸入之使用設定(來自接收與處理單元12傳遞之資訊、或來自身份辨識單元11之使用者資訊C1、C2),即時同步下載協同影音串流之對應影音串流Cav1、Cav2至各使用者U1、U2。 Referring to Fig. 1, there is shown a network cooperative playing system 10 of a first embodiment of the present invention. As shown, the network cooperative performance system 10 includes an identity recognition unit 11, a receiving and processing unit 12, and a transmission unit 13. The identity recognition unit 11 receives the identification signals Id1 and Id2 generated by the at least two users U1 and U2 respectively to identify whether the identity of the users U1 and U2 is allowed to log in to a cooperative performance group. When the identity recognition unit 11 confirms that the identification signals Id1 and Id2 belong to the same cooperative performance group, the network cooperative performance system 10 can request the users U1 and U2 to input the usage settings respectively by using a webpage or a communication software or device. Description). The identification unit 11 is based on the identification signals Id1, Id2. And using the settings, generating user information C1 (corresponding to user U1), C2 (corresponding to user U2), and transmitting user information C1, C2 to receiving and processing unit 12, receiving and processing unit 12 according to user information C1 and C2 receive the corresponding video stream Av1 generated by the user U1 and the corresponding video stream Av2 generated by the user U2 to generate a cooperative video stream Cav. However, the corresponding video stream Av2 generated by the receiving user U2 is only an example for illustrative purposes. The user of the present case may include a performer, a viewer or a learner, for example, when the user U2 is only a learner. The receiving and processing unit 12 receives only the corresponding video stream Av1 generated by the user U1. The number of the aforementioned users is not limited to the illustration, and may include more users, such as three or more users, and each user may have various identity choices. The receiving and processing unit 12 is not limited to receiving only the corresponding video streams Av1 and Av2 generated by the users U1 and U2, and the network cooperative playing system 10 may also pre-store a corresponding video stream (Fig. 5, stored in the storage unit 221). The receiving and processing unit 12 combines the pre-stored corresponding video stream and the corresponding video stream Av1 and Av2 in the cooperative video stream. For details, refer to the description of the subsequent embodiments. In addition, the transmitting unit 13 synchronously downloads the corresponding video and audio of the coordinated video stream according to the usage setting input by each user (the information transmitted from the receiving and processing unit 12 or the user information C1 and C2 from the identity recognizing unit 11). Streams Cav1, Cav2 to each user U1, U2.

使用者之身分如演奏者、觀賞者或學習者,單一使用者可依需要而選擇包含多個身分,例如演奏者與觀賞者,當使用者以演奏者身分登入協同演奏群組,完成演奏,下一次登入同一協同演奏群組之身分可換為觀賞者(例如同一演奏部分為多個使用者輪替,前次為演奏者,下一次不演出等)。 The user's identity is such as a player, a viewer or a learner. A single user can select multiple identities, such as a player and a viewer, as needed, and when the user logs into the cooperative performance group as a performer, the performance is completed. The next time you log in to the same collaborative performance group, you can change to the viewer (for example, the same performance part is rotated by multiple users, the previous performance is the player, the next time the performance is not performed, etc.).

辨識訊號Id1、Id2可為一生物特徵,例如臉部辨識、指紋、聲紋等,也可為使用者根據身份辨識單元11發出之樂譜或特定樂器之音訊串流,所回應之音訊串流,藉以確認使用者之身分、或登入使用者之演奏技巧等(例如判斷是否適合所登入之協同演奏群組,以判斷是否允許加入演奏者等)。 The identification signals Id1 and Id2 may be a biometric feature, such as face recognition, fingerprints, voiceprints, etc., and may also be an audio stream that the user responds to according to the musical scores sent by the identification unit 11 or the audio stream of the specific instrument. In order to confirm the identity of the user, or to log in to the user's playing skills, etc. (for example, to determine whether it is suitable for the coordinated playing group to be entered, to determine whether it is allowed to join the player, etc.).

一種較佳的實施例中,使用者之身分又包含一觀賞者或一學習者,當使用者之身分包含觀賞者,傳送單元根據使用者輸入之使用設定,下載協同影音串流中對應影音串流;當使用者之身分包含一學習者,傳送單元根據使用者輸入之使用設定,下載協同影音串流中對應影音串流以及一學習輔助資訊。 In a preferred embodiment, the identity of the user includes a viewer or a learner. When the identity of the user includes the viewer, the transmitting unit downloads the corresponding video string in the coordinated video stream according to the usage setting of the user input. Flow; when the user's identity includes a learner, the transfer unit downloads the corresponding video stream in the collaborative video stream and a learning auxiliary information according to the user input setting.

前述之各對應影音串流分別包含至少一影訊串流與至少一音訊串流。 Each of the corresponding video streams includes at least one video stream and at least one audio stream.

參照第2圖,前述之使用設定包含上傳選擇項與下載選擇項。下載選擇項包含:選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流、消除協同影音串流中背景噪音、協同影音串流中對應影音串流之下載混和選擇、協同影音串流全部下載、或一學習輔助資訊等。下載選擇項之組合可依使用者之身分而具有不同之組合,例如:當使用者登入之身分包含觀賞者,其下載選擇項可包含:選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流、消除協同影音串流中背景噪音、協同影音串流中對應影音串流之下載混和選擇、以及協同影音串流全部下載之選擇項其中之一或組合。當使用者登入之身分包含一學習者,其使用設定之下載選擇項可包含:協同影音串流全部下載、選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流、協同影音串流中對應影音串流之下載混和選擇、以及一學習輔助資訊之其中選擇項之一或組合。當使用者登入之身分包含演奏者,其下載選擇項包含:協同影音串流全部下載、選擇至少另一演奏者以決定下載協同影音串流中所包含之對應影音串流、協同影音串流中對應影音串流之下載混和選擇、以及下載之協同影音串流中不包含演奏者之對應影音串流之選擇項其中之一或組合。 Referring to FIG. 2, the aforementioned usage settings include an upload selection and a download selection. The download selection includes: selecting at least one player to decide to download the corresponding video stream included in the coordinated video stream, eliminating background noise in the coordinated video stream, downloading and mixing selection of the corresponding video stream in the cooperative video stream, and cooperation All video and audio streams are downloaded, or a supplementary information is learned. The combination of the download options may have different combinations according to the user's identity. For example, when the user's login identity includes the viewer, the download selection may include: selecting at least one player to decide to download the collaborative video stream. The one or a combination of the corresponding audio and video streams, the background noise in the coordinated video stream, the download and mix selection of the corresponding video stream in the coordinated video stream, and the selection of all the coordinated video streams are downloaded. When the user login identity includes a learner, the download option selected by the user may include: downloading the cooperative video stream, selecting at least one player to determine the corresponding video stream included in the download cooperative video stream, and collaborating. One or a combination of the selection and selection of the corresponding video stream in the video stream, and one of the learning auxiliary information. When the user's login identity includes the player, the download selection includes: downloading the cooperative video stream, selecting at least another player to determine the corresponding video stream included in the downloaded collaborative video stream, and the cooperative video stream. The download and mix selection corresponding to the video stream, and the downloaded cooperative video stream do not include one or a combination of the choices of the player's corresponding video stream.

前述之選擇至少一演奏者以決定下載協同影音串流中所包含之對應影音串流,為當使用者選擇演奏者,以決定所要下載對應影音串流所產生之演奏者。此選擇項可節省網路資源,也可避免下載不必要之對應影音串流,降低使用者之觀賞時視覺或聽覺之負擔,與降低網路下載時之頻寬負擔。 The foregoing selects at least one player to determine to download the corresponding video stream included in the coordinated video stream, so that the user selects the player to determine the player to be downloaded to generate the corresponding video stream. This option saves network resources, avoids unnecessary downloading of corresponding video streams, reduces the visual or auditory burden of the user's viewing, and reduces the bandwidth burden of network downloads.

前述之學習輔助資訊,可包含與對應影音串流相關之樂譜資訊或節奏資訊,此樂譜資訊或節奏資訊可分別藉由樂譜畫面或節奏畫面顯示,並與演奏者之影訊串流顯示於同一顯示器或不同之顯示器。此外,前述節奏資訊又可分別藉由拍點音訊表示,並結合於與演奏者之音訊串流。此樂譜資訊或節奏資訊可提供使用者模仿演奏者、或練習與樂譜資訊或節奏資訊相關之節奏、舞蹈(例如踢踏舞、爵士舞、芭蕾舞、或國標舞等)、打擊樂等。一較佳的實施例中,網路協同演奏系統又包含一評比單元(未顯示),比較學習輔助資訊以及學習者產生之音訊串流,以決定並顯示學習者之學習成果。 The foregoing learning auxiliary information may include music score information or rhythm information related to the corresponding video stream, and the score information or the rhythm information may be displayed on the score map or the rhythm screen, respectively, and displayed on the same display as the player's video stream. Or a different display. In addition, the aforementioned tempo information can be separately represented by the beat audio and combined with the audio stream of the player. This score information or rhythm information can provide the user to imitate the player, or practice rhythm related to score information or rhythm information, dance (such as tap dance, jazz dance, ballet, or ballroom dance), percussion, and the like. In a preferred embodiment, the network cooperative performance system further includes a rating unit (not shown) that compares the learning assistance information with the audio stream generated by the learner to determine and display the learner's learning outcome.

關於協同影音串流全部下載之選擇項,例如當使用者為一演奏者,其演奏時可選擇其他部分演奏者以決定下載協同影音串流中所包含之對應影音串流之選項,以避免同步下載自己演奏之對應影音串流,造成接收困擾(例如回聲等)。當此演奏者結束演奏,想回顧自己與其他演奏者之協同影音串流,可選擇前述之協同影音串流全部下載之選擇項。 Regarding the selection of all downloads of the coordinated video stream, for example, when the user is a performer, other players may be selected during the performance to determine the option of downloading the corresponding video stream included in the coordinated video stream to avoid synchronization. Download the corresponding video stream of your own performance, causing reception troubles (such as echo, etc.). When the player finishes playing and wants to review the coordinated video stream of himself and other players, the selection of all the cooperative video streams described above can be selected.

前述之消除協同影音串流中背景噪音之選擇項,此背景噪音之消除可藉由收音端(即使用者之設備或軟體)進行,其可包含特定之噪音消除(例如現場演唱會之哨聲或叫喊聲)等,或藉由放大演奏者產生之對應影音串流之比例而降低背景噪音之影響等。此噪音消除也可藉由網路中任一伺服器之軟體進行,讓不喜歡噪音之部分使用者可選擇下載之對應影音串流之方式。此外,消除協同影音串流中背景噪音,可在中央伺服器端或使用者端執行。 The foregoing eliminates the choice of background noise in the cooperative video stream, and the background noise can be eliminated by the radio terminal (ie, the user's device or software), which can include specific noise cancellation (eg, a live concert whistle) Or shouting, etc., or by amplifying the proportion of the corresponding video stream produced by the player to reduce the effects of background noise, and the like. This noise cancellation can also be performed by the software of any server in the network, so that some users who do not like the noise can choose to download the corresponding video stream. In addition, eliminating background noise in the cooperative video stream can be performed on the central server side or on the user side.

前述之協同影音串流中對應影音串流之下載混和選擇,其包含協同影音串流中各演奏者產生之音訊串流為彼此不混音或混音;以及協同影音串流中影訊串流,為各演奏者之畫面組合於同一畫面、或各演奏者之畫面分別為獨立畫面。第4A圖顯示下載混和選擇之一實施例,例如當使用者(例如U1)需要有音訊串流之環場效果(即利用多個播放器以播放各音訊串流),則混和選擇可為協同影音串流中各演奏者產生之音訊串流間彼此不混音。第4B圖顯示下載混和選擇之一實施例,當下載混和選擇為協同影音串流中各演奏者產生之音訊串流為彼此混音,各演奏者之音訊串流可藉由單一播放器播放。另一實施例中,當協同影音串流中影訊串流,為各演奏者畫面組合於同一畫面(例如同一畫面中包含多個分割畫面),協同影音串流之畫面可藉由單一顯示器播放(例如第4C圖);當影訊串流為各演奏者畫面分別為獨立畫面,各演奏者之獨立畫面可藉由多個顯示器播放(例如第4D圖)。 The downloading and mixing selection of the corresponding video stream in the cooperative video stream includes the audio stream generated by each player in the cooperative video stream being unmixed or mixed with each other; and the video stream in the cooperative video stream, The screens for the respective players are combined on the same screen, or the screens of the respective players are independent screens. Figure 4A shows an embodiment of downloading and mixing options. For example, when a user (e.g., U1) needs to have an audio field effect of audio streaming (i.e., using multiple players to play each audio stream), the hybrid selection can be coordinated. The audio streams generated by the players in the video stream are not mixed with each other. Figure 4B shows an embodiment of the download blend selection. When the download mix is selected as the audio stream generated by each player in the cooperative video stream to be mixed with each other, the audio stream of each player can be played by a single player. In another embodiment, when the video stream in the cooperative video stream is combined for the same picture on each player's picture (for example, the plurality of divided pictures are included in the same picture), the picture of the coordinated video stream can be played by using a single display ( For example, FIG. 4C); when the video stream is an independent screen for each player's screen, the independent screen of each player can be played by a plurality of displays (for example, the 4D picture).

參照第3圖,前述之上傳選擇項包含:上傳對於協同影音串流之評價、對應影音串流現場原音上傳、消除對應影音串流之背景噪音、以及樂音模式上傳對應影音串流。根據使用者之身分不同,上傳選擇項可具不同之組合,例如:當使用者登入之身分包含觀賞者,上傳選擇項可包含上傳對於協同影音串流之評價;當使用者登入之身分包含演奏者,其上傳選擇項包含:對應影音串流現場原音上傳、消除對應影音串流之背景噪音、以及樂音模式上傳對應影音串流。樂音模式上傳對應影音串流之樂音模式,為使用者可根據產生對應影音串流之樂器,選擇過濾不必要之雜音或噪音,樂音模式可根據樂器之特性,例如樂器之泛音(Harmonic)或共鳴方式等特性,或自行指定之方式,設定樂音模式。 Referring to FIG. 3, the foregoing upload selection includes: uploading an evaluation of the coordinated video stream, corresponding audio stream uploading of the live sound, canceling the background noise of the corresponding video stream, and uploading the corresponding video stream by the tone mode. Depending on the user's identity, the upload selections can have different combinations. For example, when the user's login status includes the viewer, the upload selection can include uploading the evaluation of the collaborative video stream; when the user logs in, the identity includes the performance. The uploading options include: corresponding audio stream uploading of the original audio stream, eliminating the background noise of the corresponding video stream, and the tone mode uploading corresponding video stream. The tone mode uploads the tone mode corresponding to the video stream, and the user can select to filter unnecessary noise or noise according to the instrument that generates the corresponding video stream. The tone mode can be based on the characteristics of the instrument, such as Harmonic or resonance of the instrument. Set the tone mode by the characteristics of the mode or by the way you specify it.

參照第5圖,就另一個觀點言,本發明提供了一種網路協同演奏系統20,其中一協同演奏群組之儲存資料包含一協同影音串流(例如藉由接收與處理單元22中儲存單元221儲存),此網路協同演奏系統20包含:一身份辨識單元21,接收來自至少一演奏者U3所產生之辨識訊號Id3,以決定此演奏者U3是否允許登入此協同演奏群組;一接收與處理單元22,根據演奏者U3輸入之一使用設定(如前實施例所述,藉由使用者資訊C3傳送至接收與處理單元2),即時上傳演奏者產生之對應影音串流Av3、並結合對應影音串流以更新協同影音串流中,並傳送此協同影音串流Cav至一傳送單元23。傳送單元23根據演奏者U3之使用設定(來自接收與處理單元22傳遞之資訊、或來自身份辨識單元21之使用者資訊C3),即時下載協同影音串流Cav3至演奏者U3。實施時不限於一使用者,使用者之數量可為二個或更多個,使用者之身分也不限於演奏者,也可包含觀賞者或學習者。 Referring to FIG. 5, in another aspect, the present invention provides a network cooperative performance system 20 in which a stored material of a cooperative performance group includes a cooperative video stream (eg, by a storage unit in the receiving and processing unit 22). 221 storage), the network cooperative performance system 20 includes: an identity recognition unit 21, receiving the identification signal Id3 generated by the at least one player U3 to determine whether the player U3 is allowed to log in to the cooperative performance group; And the processing unit 22, according to the input of the player U3, using the setting (as described in the previous embodiment, by the user information C3 to the receiving and processing unit 2), the corresponding video stream Av3 generated by the player is instantly uploaded, and The corresponding video stream is combined to update the coordinated video stream, and the cooperative video stream Cav is transmitted to a transmitting unit 23. The transmitting unit 23 instantly downloads the cooperative video stream Cav3 to the player U3 according to the usage setting of the player U3 (the information transmitted from the receiving and processing unit 22 or the user information C3 from the identity recognizing unit 21). The implementation is not limited to one user, and the number of users may be two or more, and the identity of the user is not limited to the player, but may also include a viewer or a learner.

參照第1、6圖,傳送單元13又具有一運算裝置131,其具有擴增實境(Augmented Reality)之運算功能,運算裝置131比對運算各對應影音串流Av1、Av2所包含之影訊串流,使其中最少二影訊串流之顯示比例近似(例如使用者U1、U2之身高與姿勢類似)或符合正常比例(例如使用者U1、U2之身高不同,或姿勢不同),並將比對運算後的最少二影訊串流重疊以產生一重疊影訊串流,並透過同一顯示器或同一場景中予以顯示與控制重疊影訊串流,顯示器可為一攜帶式載具、電視、智慧型手機、投影機等具顯示功能之裝置。來自不同地點之影訊串流中使用者U1、U2之影訊串流可能有不同之比例,皆須與場景配合,例如使用者U1、U2之比例須與場景中擺設器材配合,以避免使用者過大或過小造成視覺突兀。將比對運算後的最少二影訊串流重疊以產生一重疊影訊串流,例如將使用者U1、U2之影訊串流與一場景之影訊串流重疊後,為藉由一顯示器 顯示場景與使用者之重疊影訊串流(第6圖)。然本案實施不限於此,場景也可為一實體表演場所,而將使用者U1、U2之影訊串流重疊投影於此場景等。此外,藉由擴增實境技術進行重疊之影訊串流不限於前述之數量,也可依需要而調整。 Referring to Figures 1 and 6, the transfer unit 13 further has an arithmetic unit 131 having an arithmetic function of augmented reality, and the arithmetic unit 131 compares the video strings included in the respective video streams Av1 and Av2. Streaming, such that the display ratio of at least two video streams is similar (for example, the heights of the users U1 and U2 are similar to the posture) or conform to the normal ratio (for example, the heights of the users U1 and U2 are different, or the postures are different), and the comparison is performed. The at least two video streams after the operation overlap to generate an overlapping video stream, and display and control the overlapping video stream through the same display or the same scene, the display can be a portable vehicle, a television, a smart phone, a projection A device with a display function, such as a machine. The video streams of users U1 and U2 from different locations may have different proportions, which must be matched with the scene. For example, the ratio of users U1 and U2 must match the equipment in the scene to avoid the user being too large. Or too small to cause visual abruptness. And superimposing the minimum of two video streams after the comparison operation to generate an overlapping video stream, for example, by overlapping the video stream of the user U1 and U2 with the video stream of a scene, by using a display Display overlapping video streams of scenes and users (Figure 6). However, the implementation of the present invention is not limited thereto, and the scene may also be a physical performance place, and the video streams of the users U1 and U2 are superimposed and projected on the scene. In addition, the overlapping video streams by the augmented reality technology are not limited to the foregoing, and may be adjusted as needed.

參照第7圖,顯示一實施例中網路協同演奏系統之邏輯拓墣關係,網路協同演奏系統又包含一中央伺服單元CS,協同演奏群組(例如G1)之使用者之等級包含至少一第一級使用者以及至少一第二級使用者,中央伺服器CS以及各使用者(例如位於地點L1、L2、L3、L8、L9、L10之使用者)間分別具有一網路通道(地點L1、L2、L3、L8、L9、L10之使用者與中央伺服器CS間之實心線代表各網路通道)以傳遞網路協同演奏系統G1內之各對應影音串流。第7圖中從內至外各虛線圓圈,代表距離中央伺服器CS到各使用者間之網路節點,從內往外代表經過之網路節點數量增加,然此為示意,非代表實施時之實際網路節點數量。此網路節點可為網路服務提供者(Internet Service Provider)、或網路連線區域等。中央伺服器CS與各第一級使用者間之網路節點數量,少於中央伺服器CS與各第二級使用者間之網路節點數量。此外,網路協同演奏系統G2包含兩第一級使用者(地點L6、L7之使用者)以及一第二級使用者(地點L5之使用者)、而網路協同演奏系統G3包含一第一級使用者(地點L4之使用者)以及一第二級使用者(地點L5之使用者),其中地點L5之使用者可同時為網路協同演奏系統G2、G3之第二級使用者。中央伺服單元CS可選擇性包含前述之身份辨識單元、接收與處理單元、以及傳送單元,然身份辨識單元、接收與處理單元、以及傳送單元不限於設置於同一個中央伺服單元CS,其可依需要而設置另一個中央伺服單元以包含其中部分單元。 Referring to FIG. 7, a logical topology relationship of a network cooperative playing system in an embodiment is shown. The network cooperative playing system further includes a central servo unit CS, and the level of the user of the cooperative playing group (for example, G1) includes at least one. The first level user and the at least one second level user, the central server CS and each user (for example, users located at the locations L1, L2, L3, L8, L9, and L10) respectively have a network channel (location The solid lines between the users of L1, L2, L3, L8, L9, L10 and the central server CS represent the respective network channels) to convey the respective video streams in the network cooperative performance system G1. In Figure 7, the dotted circles from the inside to the outside represent the network nodes from the central server CS to the users, and the number of network nodes passing through from the inside to the outside increases, but this is a schematic, not representative of the implementation time. The actual number of network nodes. This network node can be an Internet Service Provider, or a network connection area. The number of network nodes between the central server CS and each first-level user is less than the number of network nodes between the central server CS and each second-level user. In addition, the network cooperative performance system G2 includes two first-level users (users of the locations L6, L7) and a second-level user (users of the location L5), and the network cooperative performance system G3 includes a first The user of the level (the user of the location L4) and the user of the second level (the user of the location L5), wherein the user of the location L5 can simultaneously be the second-level user of the network cooperative performance system G2, G3. The central servo unit CS may optionally include the foregoing identity recognition unit, the receiving and processing unit, and the transmitting unit, but the identity recognition unit, the receiving and processing unit, and the transmitting unit are not limited to being disposed in the same central servo unit CS, which may be Another central servo unit is provided to accommodate some of the units.

一實施例中,第一級使用者為一付費者,第二級使用者為一免費者。藉由此設計,可藉由有限之網路頻寬資源,確保即時同步下載協同影音串 流之對應影音串流至第一級使用者。付費者或免費者皆可為演奏者、觀賞者或學習者,例如一初學之演奏者登入一初級協同演奏群組,其身分可為一第二級使用者或一免費者。 In one embodiment, the first level user is a payer and the second level user is a free user. With this design, it is possible to ensure simultaneous simultaneous download of collaborative video strings with limited network bandwidth resources. The corresponding video stream of the stream is streamed to the first level user. The payer or the free person can log in to the primary collaborative performance group for the performer, the viewer or the learner, for example, a beginner performer, and the identity can be a second level user or a free person.

參照第8圖,接收與處理單元32或傳送單元33又具有一擷取比對單元121(接收與處理單元或傳送單元可都具有擷取比對單元、或其中之一具有擷取比對單元),其分別擷取各使用者上傳之對應影音串流Av1、Av2或下載之對應影音串流Cav1、Cav2,並分析對應影音串流所對應之屬性,並將此屬性儲存於網路協同演奏系統中一比對資料庫,以根據比對資料庫提供該些使用者對應於該屬性之相關資訊。對應影音串流所對應之屬性可包含:古典音樂、地區音樂、新創作音樂、合唱曲、電子音樂、戲劇音樂、輕音樂、搖滾音樂、政治音樂、流行音樂、民族音樂等。網路協同演奏系統30可依據比對資料庫中使用者對應之屬性而例如提供最新之協同演奏活動、或提供相關教學、付費之協同影音串流、或其他相關資訊I1、I2之活動給使用者U1、U2。而各使用者可依據收到之相關資訊決定是否加入或登入其活動。 Referring to FIG. 8, the receiving and processing unit 32 or the transmitting unit 33 further has a capturing comparison unit 121 (the receiving and processing unit or the transmitting unit may both have a matching unit, or one of them has a matching unit) ), which respectively captures the corresponding video stream Av1, Av2 uploaded by each user or downloads the corresponding video stream Cav1, Cav2, and analyzes the attribute corresponding to the video stream, and stores the attribute in the network cooperative playing. A comparison database in the system is provided to provide relevant information corresponding to the attribute to the users according to the comparison database. The corresponding attributes corresponding to the video stream may include: classical music, regional music, new creative music, chorus, electronic music, drama music, light music, rock music, political music, pop music, folk music, and the like. The network cooperative performance system 30 can be used according to the attributes corresponding to the users in the database, for example, to provide the latest collaborative performance activities, or to provide related teaching, paid collaborative video streaming, or other related information I1, I2 activities. U1, U2. Each user can decide whether to join or log in to their activities based on the information received.

以上已針對較佳實施例來說明本發明,唯以上所述者,僅係為使熟悉本技術者易於了解本發明的內容而已,並非用來限定本發明之權利範圍。在本發明之相同精神下,熟悉本技術者可以思及各種等效變化。凡此種種,皆可根據本發明的教示類推而得,因此,本發明的範圍應涵蓋上述及其他所有等效變化。 The present invention has been described with reference to the preferred embodiments thereof, and the present invention is not intended to limit the scope of the present invention. In the same spirit of the invention, various equivalent changes can be conceived by those skilled in the art. All such modifications may be made in accordance with the teachings of the present invention, and the scope of the present invention should be construed to cover the above and other equivalents.

10:網路協同演奏系統 11:身份辨識單元 12:接收與處理單元 13:傳送單元 131:運算裝置 Av1、Av2:上傳之對應影音串流 C1、C2:使用者資訊 Cav:協同影音串流 Cav1、Cav2:下載之對應影音串流 Id1、Id2:辨識訊號 U1、U2:使用者10: Network cooperative performance system 11: Identity recognition unit 12: Reception and processing unit 13: Transmission unit 131: Operation device Av1, Av2: Uploaded corresponding video stream C1, C2: User information Cav: Collaborative video stream Cav1 , Cav2: Download corresponding video stream Id1, Id2: identification signal U1, U2: user

Claims (14)

一種網路協同演奏系統,包含:一身份辨識單元,接收來自至少兩使用者所分別產生之辨識訊號,以辨識該使用者之身分、以及是否允許登入一協同演奏群組,以產生一使用者確認訊息,該使用者之身分包含至少兩演奏者;一接收與處理單元,接受該身份辨識單元之使用者確認訊息後,根據各該使用者輸入之一使用設定,即時上傳該些使用者產生之複數個對應影音串流、並結合該些對應影音串流於一協同影音串流中;一傳送單元,根據各該使用者輸入之該使用設定,即時同步下載該協同影音串流之該些對應影音串流至各該使用者;以及一中央伺服單元,該協同演奏群組之該使用者之等級包含至少一第一級使用者以及至少一第二級使用者,該中央伺服器以及各該使用者間分別具有一網路通道以傳遞該網路協同演奏系統內之各該對應影音串流,該中央伺服單元與各該第一級使用者間之網路節點數量,少於該中央伺服單元與各該第二級使用者間之網路節點數量;其中,各該對應影音串流分別包含至少一影訊串流與至少一音訊串流。 A network cooperative performance system includes: an identity recognition unit that receives identification signals generated by at least two users to identify the identity of the user and whether to allow login to a collaborative performance group to generate a user Confirming the message, the identity of the user includes at least two players; a receiving and processing unit, after accepting the user confirmation message of the identity recognition unit, uploading the user according to one of the user input settings The plurality of corresponding video streams are combined with the corresponding video streams in a coordinated video stream; a transmitting unit synchronously downloads the coordinated video streams according to the usage settings input by the user Corresponding to the video stream to each user; and a central servo unit, the level of the user of the cooperative performance group includes at least one first level user and at least one second level user, the central server and each Each of the users has a network channel for transmitting the corresponding video stream in the network cooperative playing system, the center The number of network nodes between the service unit and each of the first-level users is less than the number of network nodes between the central server unit and each of the second-level users; wherein each of the corresponding video streams includes at least one The video stream is streamed with at least one audio stream. 申請專利範圍第1項所述之網路協同演奏系統,其中該使用者之身分又包含一觀賞者或一學習者,當該使用者之身分包含該觀賞者,該傳送單元根據該使用者輸入之使用設定,下載該協同影音串流中該些對應影音串流;當該使用者之身分包含一學習者,該傳送單元根據該使用者輸入之該使用設定,下載該協同影音串流中該些對應影音串流以及一學習輔助資訊。 The network cooperative playing system of claim 1, wherein the user identity further includes a viewer or a learner, and when the identity of the user includes the viewer, the transmitting unit inputs according to the user Downloading the corresponding video stream in the collaborative video stream; when the user identity includes a learner, the transmitting unit downloads the cooperative video stream according to the usage setting input by the user These correspond to video streams and a learning aid. 申請專利範圍第2項所述之網路協同演奏系統,其中當該使用者登入之身分包含該觀賞者,該使用設定包含一上傳對於該協同影音串流之評價、以及一下載選擇項,該下載選擇項包含:選擇至少一該演奏者以決定下載該協同影音串流中包含之該些對應影音串流、消除該協同影音串流中背景噪音、該協同影音串流中該些對應影音串流之下載混和選擇、以及該協同影音串流全部下載之選擇項其中之一或組合。 The network cooperative playing system of claim 2, wherein when the user login identity includes the viewer, the usage setting includes an uploading evaluation of the collaborative video stream, and a download option, Downloading the selection includes: selecting at least one of the performers to determine to download the corresponding video streams included in the coordinated video stream, eliminating background noise in the coordinated video stream, and corresponding audio and video strings in the coordinated video stream One or a combination of the download selection of the stream and the selection of the full download of the collaborative video stream. 申請專利範圍第2項所述之網路協同演奏系統,其中當該使用者登入之身分包含一學習者,該使用設定之一下載選擇項包含:該協同影音串流全部下載、選擇至少一該演奏者以決定下載該協同影音串流中包含之該些對應影音串流、消除該協同影音串流中背景噪音、該協同影音串流中該些對應影音串流之下載混和選擇、以及一學習輔助資訊之選擇項其中之一或組合。 The network cooperative playing system of claim 2, wherein when the user login identity includes a learner, the one of the usage settings downloading the selection comprises: downloading the collaborative video stream, selecting at least one of the The player determines to download the corresponding video stream included in the collaborative video stream, eliminate background noise in the coordinated video stream, download and mix selection of the corresponding video stream in the coordinated video stream, and learn One or a combination of options for assistive information. 申請專利範圍第4項所述之網路協同演奏系統,其中該學習輔助資訊包含樂譜資訊或節奏資訊,該樂譜資訊或該節奏資訊與下載該協同影音串流之影訊串流顯示於同一顯示器或不同之顯示器。 The network cooperative playing system according to claim 4, wherein the learning auxiliary information includes score information or rhythm information, and the music information or the rhythm information is displayed on the same display or the video stream for downloading the coordinated video stream or Different monitors. 申請專利範圍第4項所述之網路協同演奏系統,其中該網路協同演奏系統又包含一評比單元,該評比單元比較該學習輔助資訊以及該學習者產生之該音訊串流,以決定並顯示該學習者之學習成果。 The network cooperative playing system according to claim 4, wherein the network cooperative playing system further comprises a rating unit, wherein the comparing unit compares the learning auxiliary information with the audio stream generated by the learner to determine and Show the learner's learning outcomes. 申請專利範圍第1項所述之網路協同演奏系統,其中當該使用者登入之身分包含該演奏者,該使用設定包含:一上傳選擇項與一下載選擇項,該上傳選擇項包含:該對應影音串流現場原音上傳、消除該對應影音串流之背景噪音、以及樂音模式上傳該對應影音串流;該下載選擇項包含:該協同影音串流 全部下載、選擇至少該另一演奏者以決定下載該協同影音串流中所包含之對應影音串流、該協同影音串流中該些對應影音串流之下載混和選擇、以及下載之該協同影音串流中不包含該演奏者之該對應影音串流之選擇項其中之一或組合。 The network cooperative playing system of claim 1, wherein when the user login identity includes the player, the usage setting comprises: an upload selection item and a download selection item, the upload selection item includes: Corresponding to the video stream uploading the original sound, eliminating the background noise of the corresponding video stream, and the tone mode uploading the corresponding video stream; the download option includes: the coordinated video stream Downloading, selecting at least the other player to determine to download the corresponding video stream included in the collaborative video stream, downloading and mixing the corresponding video stream in the coordinated video stream, and downloading the coordinated video One or a combination of the selections of the corresponding video stream of the performer is not included in the stream. 如申請專利範圍第3、4、或7項所述之網路協同演奏系統,其中該協同影音串流中該些對應影音串流之下載混和選擇包含:該協同影音串流中各該演奏者產生之該音訊串流為彼此不混音或混音;以及該協同影音串流中該些影訊串流,為各該演奏者之畫面組合於同一畫面、或各該演奏者之畫面分別為獨立畫面。 The network cooperative playing system of claim 3, 4, or 7, wherein the downloading and mixing of the corresponding video streams in the collaborative video stream includes: the player in the cooperative video stream The generated audio streams are unmixed or mixed with each other; and the video streams in the cooperative video stream are combined on the same screen for each player's picture, or each player's picture is independent Picture. 如申請專利範圍第8項所述之網路協同演奏系統,其中當下載混和選擇為該協同影音串流中各該演奏者產生之該音訊串流為彼此不混音,各該演奏者產生之音訊串流可藉由多個播放器分別播放;當下載混和選擇為該協同影音串流中各該演奏者產生之該音訊串流為彼此混音,各該演奏者產生之音訊串流可藉由單一播放器播放。 The network cooperative playing system according to claim 8, wherein when the downloading and mixing is selected, the audio stream generated by each of the players in the cooperative video stream is unmixed with each other, and each of the players generates The audio stream can be separately played by a plurality of players; when the downloading and mixing is selected, the audio stream generated by each player in the coordinated video stream is mixed with each other, and the audio stream generated by each player can be borrowed. Played by a single player. 如申請專利範圍第8項所述之網路協同演奏系統,其中當該協同影音串流中該些影訊串流,為各該演奏者畫面組合於同一畫面,該協同影音串流之畫面可藉由單一顯示器播放;當該些影訊串流之各該演奏者畫面分別為獨立畫面,各該演奏者之獨立畫面可藉由多個顯示器播放。 The network cooperative playing system according to claim 8, wherein when the video streams in the cooperative video stream are combined on the same screen for each player picture, the picture of the cooperative video stream can be borrowed. Played by a single display; when the respective player images of the video streams are separate images, the independent pictures of the players can be played by a plurality of displays. 如申請專利範圍第1項所述之網路協同演奏系統,其中該第一級使用者為一付費者,該第二級使用者為一免費者。 The network cooperative playing system according to claim 1, wherein the first level user is a payer and the second level user is a free user. 一種網路協同演奏系統,包含:一身份辨識單元,接收來自至少兩使用者所分別產生之辨識訊號,以辨識該使用者之身分、以及是否允許登入一協同演奏群組,以產生一使用者確認訊息,該使用者之身分包含至少兩演奏者;一接收與處理單元,接受該身份辨識單元之使用者確認訊息後,根據各該使用者輸入之一使用設定,即時上傳該些使用者產生之複數個對應影音串流、並結合該些對應影音串流於一協同影音串流中;以及一傳送單元,根據各該使用者輸入之該使用設定,即時同步下載該協同影音串流之該些對應影音串流至各該使用者,其中該傳送單元又具有一運算裝置,其具有擴增實境之運算功能,該運算裝置比對運算各該對應影音串流所包含之該影訊串流,使其中最少二該影訊串流之顯示比例近似或符合正常比例,並將比對運算後的最少二該影訊串流重疊以產生一重疊影訊串流,透過同一顯示器或同一場景中予以顯示該重疊影訊串流。 A network cooperative performance system includes: an identity recognition unit that receives identification signals generated by at least two users to identify the identity of the user and whether to allow login to a collaborative performance group to generate a user Confirming the message, the identity of the user includes at least two players; a receiving and processing unit, after accepting the user confirmation message of the identity recognition unit, uploading the user according to one of the user input settings a plurality of corresponding video streams and combined with the corresponding video streams in a coordinated video stream; and a transmitting unit that synchronously downloads the coordinated video stream according to the usage setting of each user input The corresponding video stream is streamed to each user, wherein the transmitting unit further has an computing device having an augmented reality computing function, and the computing device compares and operates the video stream included in each of the corresponding video streams. So that at least two of the video streams have a display ratio that approximates or conforms to the normal ratio, and the least two of the images are compared Stream to generate a superimposed overlapping stream telecine, the overlay to be displayed through the same display telecine stream or the same scene. 如申請專利範圍第1項所述之網路協同演奏系統,其中該接收與處理單元或該傳送單元又具有一擷取比對單元,其分別擷取各該使用者上傳之對應影音串流或下載之對應影音串流,以分析該些對應影音串流所對應之屬性,並將該屬性儲存於該網路協同演奏系統中一比對資料庫,以根據該比對資料庫提供該些使用者對應於該屬性之相關資訊。 The network cooperative playing system according to claim 1, wherein the receiving and processing unit or the transmitting unit further has a capturing and comparing unit, which respectively captures corresponding video streams uploaded by each user or Downloading the corresponding video stream to analyze the attributes corresponding to the corresponding video stream, and storing the attribute in a comparison database in the network cooperative performance system to provide the use according to the comparison database Corresponds to information about this attribute. 一種網路協同演奏系統,其中一協同演奏群組之儲存資料包含一協同影音串流,該網路協同演奏系統包含: 一身份辨識單元,接收來自至少一演奏者與一觀賞者所產生之辨識訊號,以決定該演奏者與該觀賞者是否允許登入該協同演奏群組;一接收與處理單元,根據各該演奏者輸入之一使用設定,即時上傳該演奏者產生之對應影音串流、並結合該對應影音串流於該協同影音串流中;以及一傳送單元,根據該演奏者之該使用設定,即時下載該協同影音串流至該演奏者,以及根據該觀賞者輸入之另一使用設定,即時下載該協同影音串流至該演奏者;以及一中央伺服單元,該協同演奏群組之該使用者之等級包含至少一第一級使用者以及至少一第二級使用者,該中央伺服器以及各該使用者間分別具有一網路通道以傳遞該網路協同演奏系統內之各該對應影音串流,該中央伺服單元與各該第一級使用者間之網路節點數量,少於該中央伺服單元與各該第二級使用者間之網路節點數量。 A network cooperative performance system, wherein a stored data of a cooperative performance group includes a coordinated video stream, and the network cooperative performance system includes: An identification unit receives an identification signal generated by at least one player and a viewer to determine whether the player and the viewer are allowed to log in to the cooperative performance group; a receiving and processing unit, according to each of the players Inputting one of the settings to instantly upload the corresponding video stream generated by the player and combining the corresponding video stream into the cooperative video stream; and a transmitting unit that downloads the instant according to the usage setting of the player Synchronizing the video stream to the player, and downloading the coordinated video stream to the player according to another usage setting input by the viewer; and a central servo unit, the user level of the cooperative performance group Included in the at least one first-level user and at least one second-level user, the central server and each of the users respectively have a network channel to transmit the corresponding video stream in the network cooperative playing system. The number of network nodes between the central server unit and each of the first level users is less than between the central server unit and each of the second level users. The number of road nodes.
TW104103648A 2015-02-04 2015-02-04 Network synchronous coordinating performance system TWI559775B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW104103648A TWI559775B (en) 2015-02-04 2015-02-04 Network synchronous coordinating performance system
CN201510287938.0A CN105847887A (en) 2015-02-04 2015-05-29 Network cooperative playing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW104103648A TWI559775B (en) 2015-02-04 2015-02-04 Network synchronous coordinating performance system

Publications (2)

Publication Number Publication Date
TW201630416A TW201630416A (en) 2016-08-16
TWI559775B true TWI559775B (en) 2016-11-21

Family

ID=56580373

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104103648A TWI559775B (en) 2015-02-04 2015-02-04 Network synchronous coordinating performance system

Country Status (2)

Country Link
CN (1) CN105847887A (en)
TW (1) TWI559775B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110460800B (en) * 2019-08-28 2021-02-23 长沙市回音科技有限公司 Remote rehearsal system and rehearsal method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050185621A1 (en) * 2004-02-19 2005-08-25 Raghupathy Sivakumar Systems and methods for parallel communication
US20080084927A1 (en) * 2006-09-18 2008-04-10 Elemental Technologies, Inc. Real-time network adaptive digital video encoding/decoding
US20100095829A1 (en) * 2008-10-16 2010-04-22 Rehearsal Mix, Llc Rehearsal mix delivery
CN102037486A (en) * 2008-02-20 2011-04-27 Oem有限责任公司 System for learning and mixing music
US20120331168A1 (en) * 2011-06-22 2012-12-27 Jenn-Chorng Liou Iterative cloud broadcasting rendering method
CN103226553A (en) * 2011-11-02 2013-07-31 微软公司 Integrating usage information with operation of a system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020112002A1 (en) * 2001-02-15 2002-08-15 Abato Michael R. System and process for creating a virtual stage and presenting enhanced content via the virtual stage
HK1112705A2 (en) * 2007-04-18 2008-09-12 Vibo Telecom Inc A method of providing an audiovisual signal at a remote end in real time and a system thereof
CN101499310A (en) * 2008-12-25 2009-08-05 爱唱数码科技(上海)有限公司 Multimedia files production system and method
CN102036100B (en) * 2010-11-30 2012-09-26 深圳市同洲电子股份有限公司 Method and system for realizing internet fictitious KTV (Karaok TV) entertainment
CN102568460A (en) * 2010-12-28 2012-07-11 张泽铭 Networking multi-person asynchronous chorus video work system and implementation method thereof
TWI508538B (en) * 2012-06-01 2015-11-11 Wistron Corp Video streams playback method and system
TWI516105B (en) * 2012-11-22 2016-01-01 緯創資通股份有限公司 Broadcasting system and associated method for audio/video bitstream

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050185621A1 (en) * 2004-02-19 2005-08-25 Raghupathy Sivakumar Systems and methods for parallel communication
US20080084927A1 (en) * 2006-09-18 2008-04-10 Elemental Technologies, Inc. Real-time network adaptive digital video encoding/decoding
CN102037486A (en) * 2008-02-20 2011-04-27 Oem有限责任公司 System for learning and mixing music
US20100095829A1 (en) * 2008-10-16 2010-04-22 Rehearsal Mix, Llc Rehearsal mix delivery
US20120331168A1 (en) * 2011-06-22 2012-12-27 Jenn-Chorng Liou Iterative cloud broadcasting rendering method
CN103226553A (en) * 2011-11-02 2013-07-31 微软公司 Integrating usage information with operation of a system

Also Published As

Publication number Publication date
TW201630416A (en) 2016-08-16
CN105847887A (en) 2016-08-10

Similar Documents

Publication Publication Date Title
US11368733B2 (en) Digital jukebox device with karaoke and/or photo booth features, and associated methods
CN107027050B (en) Audio and video processing method and device for assisting live broadcast
US20070287141A1 (en) Internet based client server to provide multi-user interactive online Karaoke singing
CN106910491A (en) Karaoke OK system
TWI559775B (en) Network synchronous coordinating performance system
AU2015203639B2 (en) Digital jukebox device with karaoke and/or photo booth features, and associated methods
GB2532644A (en) Digital jukebox device with karaoke and/or photo booth features, and associated methods
AU2019226168A1 (en) Digital jukebox device with karaoke and/or photo booth features, and associated methods
US20210320959A1 (en) System and method for real-time massive multiplayer online interaction on remote events
KR20240044403A (en) Participational contents processing system and control method thereof
JP2001259231A (en) Network game distributing method, network game participating method, key information acquisition method and key information acquiring device and network game system using the same
JP2011215195A (en) Musical piece reproduction system and musical piece reproduction method

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees