TW201627987A - Singing visual effect system and method for processing singing visual effect - Google Patents

Singing visual effect system and method for processing singing visual effect Download PDF

Info

Publication number
TW201627987A
TW201627987A TW104107127A TW104107127A TW201627987A TW 201627987 A TW201627987 A TW 201627987A TW 104107127 A TW104107127 A TW 104107127A TW 104107127 A TW104107127 A TW 104107127A TW 201627987 A TW201627987 A TW 201627987A
Authority
TW
Taiwan
Prior art keywords
visual
special effect
effects
data
control host
Prior art date
Application number
TW104107127A
Other languages
Chinese (zh)
Inventor
胡俊峰
Original Assignee
蘇州樂聚一堂電子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 蘇州樂聚一堂電子科技有限公司 filed Critical 蘇州樂聚一堂電子科技有限公司
Publication of TW201627987A publication Critical patent/TW201627987A/en

Links

Abstract

The present invention relates to a singing visual effect system and a method for processing singing visual effect. The system includes a hand-held incline angle sensing component, a controller and a visual effect outputting device. The hand-held incline angle sensing component sends incline angle data thereof to the controller timely. The controller obtains visual effect data collection corresponding to a multimedia file when playing the multimedia file. The visual effect data collection includes a number of visual effect tags, and each tag defines time configuration data and visual effect configuration data. The controller obtain a matched visual effect tag from the visual effect data collection according to the current time synchronously and produces a synchronous visual effect signal according to both the incline angle data and the matched visual effect tag. The visual effect outputting device outputs the visual effect signal. The above system and method can utilize the incline angle data detected by the hand-held incline angle sensing component to adjust the current visual effect timely and provides a self-controllable visual effect system for the singer.

Description

演唱視覺特效系統及演唱視覺特效處理方法Singing visual effects system and singing visual effects processing method

本發明涉及視覺特效技術領域,特別涉及一種演唱視覺特效系統及一種演唱視覺特效處理方法。The invention relates to the technical field of visual special effects, in particular to a singing visual special effect system and a singing visual special effect processing method.

有演唱系統中,大到專業舞臺,小到KTV房間,為增強現場氣氛,一般都設有燈光特效系統。然而,現有舞臺燈光特效系統一般都是由專門燈光師來控制,而KTV房間裡之燈光效果更是只有幾種可選。亦即,無論是於專業舞臺上還是KTV房間內,演唱者本身一般無法根據自己意願即時調節燈光特效。There are singing systems, large to professional stage, small to KTV room, in order to enhance the atmosphere, generally have a lighting effects system. However, the existing stage lighting effects system is generally controlled by a dedicated lighting engineer, and the lighting effects in the KTV room are only a few options. That is to say, whether on the professional stage or in the KTV room, the singer itself is generally unable to adjust the lighting effects according to his own wishes.

有鑑於此,有必要提供一種演唱視覺特效系統及一種演唱視覺特效處理方法,其能提供更加豐富之視覺特效,尤其是將音樂節拍視覺化。In view of this, it is necessary to provide a singing visual special effect system and a singing visual special effect processing method, which can provide more rich visual effects, especially visualizing music beats.

本發明實施方式提供一種演唱視覺特效系統,包括:手持傾斜感測元件、控制主機及視覺特效輸出裝置;所述手持傾斜感測組件內置感測器,感測所述手持傾斜感測組件之傾斜度數據,所述手持傾斜感測組件還將所述傾斜度數據即時發送給所述控制主機;所述控制主機於播放多媒體檔時,或於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之視覺特效資料集,所述視覺特效資料集內包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料,所述控制主機同步從所述視覺特效資料集中獲取與當前時間匹配之視覺特效標籤,根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號; 所述視覺特效輸出裝置同步輸出視覺特效。Embodiments of the present invention provide a singing visual effect system, including: a handheld tilt sensing component, a control host, and a visual effect output device; the handheld tilt sensing component has a built-in sensor that senses the tilt of the handheld tilt sensing component Degree data, the handheld tilt sensing component also sends the tilt data to the control host in real time; the control host acquires the multimedia file when playing the multimedia file, or when the external device plays the multimedia file Corresponding visual effect data set, the visual special effect data set includes a plurality of visual special effect tags, each visual special effect tag includes time setting data and special effect setting materials, and the control host synchronizes obtaining and current from the visual special effects data set a time-matched visual effect label, generating a special effect parameter according to the inclination data, and jointly generating a visual special effect signal synchronized with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect label; The visual effect output device synchronously outputs visual effects.

於一實施方式中,所述視覺特效輸出裝置為多媒體視頻輸出設備,所述系統還包括視覺特效疊加設備,分別與所述控制主機及所述多媒體視頻輸出設備相連,所述視覺特效疊加設備用於:將所述視覺特效訊號疊加於所述多媒體檔之多媒體視頻主畫面上,並將疊加後之視訊訊號傳輸給所述多媒體視頻輸出設備輸出。In one embodiment, the visual effect output device is a multimedia video output device, and the system further includes a visual special effect superimposing device, which is respectively connected to the control host and the multimedia video output device, and the visual special effect superimposing device is used. And superimposing the visual effect signal on the multimedia video main screen of the multimedia file, and transmitting the superimposed video signal to the multimedia video output device output.

於一實施方式中,所述視覺特效設備包括LED燈陣列,所述LED燈陣列佈滿房間之牆壁、屋頂與地面。In one embodiment, the visual effects device includes an array of LED lights that cover the walls, roof, and ground of the room.

於一實施方式中,所述控制主機獲取與所述多媒體檔對應之視覺特效資料集包括:所述控制主機根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之視覺特效資料集之請求;以及接收所述雲端伺服器系統返回之所述視覺特效資料集。In an embodiment, the controlling host acquires the visual effect data set corresponding to the multimedia file, and the control host sends the corresponding visual special effect data set to the cloud server system according to the identifier of the multimedia file. And receiving the visual effects data set returned by the cloud server system.

於一實施方式中,所述控制主機獲取與所述多媒體檔對應之視覺特效資料集還包括:所述控制主機將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統統驗證所述控制主機是否具有獲取視覺特效資料集之許可權;所述雲端伺服器系統於所述控制主機具有獲取視覺特效資料集之許可權時才返回所述控制主機請求之視覺特效資料集。In an embodiment, the controlling host acquiring the visual effect data set corresponding to the multimedia file further includes: the control host transmitting the identity authentication information to the cloud server system, so that the cloud server system Verifying whether the control host has permission to acquire a visual effects data set; the cloud server system returns a visual special effect data set requested by the control host when the control host has permission to acquire a visual special effects data set .

於一實施方式中,還包括與所述控制主機相連之外部設備;所述外部設備於播放多媒體檔時或者多媒體檔被加入播放清單時將對應之多媒體檔之標識發送給所述控制主機;所述控制主機於接收到所述多媒體檔之標識後向雲端伺服器系統發送獲取所述對應之視覺特效資料集之請求。In an embodiment, the device further includes an external device connected to the control host; the external device sends the identifier of the corresponding multimedia file to the control host when the multimedia file is played or the multimedia file is added to the playlist; After receiving the identifier of the multimedia file, the control host sends a request for acquiring the corresponding visual special effects data set to the cloud server system.

於一實施方式中,所述控制主機還接收所述雲端伺服器系統發送之使用者個性化資訊,所述視覺特效資料集中還包括視頻替換特效標籤,所述視頻替換特效標籤包括時間設定資料、用在於多媒體視頻主畫面中定義出預定形狀之區域之形狀資料以及與所述形狀資料對應之類別資料,所述控制主機還將所述預定形狀之區域內之內容替換為與所述類別資料對應之使用者個性化資訊。In an embodiment, the control host further receives user personalized information sent by the cloud server system, where the visual effect data set further includes a video replacement special effect label, where the video replacement special effect label includes time setting data, The shape data of the area defining the predetermined shape in the main picture of the multimedia video and the category data corresponding to the shape data, the control host further replacing the content in the area of the predetermined shape with the category data User personalized information.

於一實施方式中,所述控制主機還根據使用者輸入之選擇指令分別獲取不同版本之視覺特效資料集。In an embodiment, the control host further acquires different versions of the visual effects data sets according to the selection instruction input by the user.

於一實施方式中,所述控制主機獲取與所述多媒體檔對應之視覺特效資料集包括:從所述多媒體檔內解析出內嵌於所述多媒體檔內之所述視覺特效資料集。In an embodiment, the obtaining, by the control host, the visual effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the visual special effects data set embedded in the multimedia file.

於一實施方式中,所述特效設定資料為:視頻、向量動畫、或者用於生成視頻或者向量動畫之中間資料,所述中間資料是根據預定之協定或者語言生成。In an embodiment, the special effect setting data is: video, vector animation, or intermediate data for generating a video or a vector animation, and the intermediate data is generated according to a predetermined agreement or language.

於一實施方式中,所述特效設定資料所描述之視覺特效是對應之時間設定資料所設定之時間區間內音樂節拍之視覺表達,所述特效設定資料是根據所對應之音樂節拍之快慢、高低、強弱等多項特徵而設計。In one embodiment, the visual effect described by the special effect setting data is a visual expression of a music beat in a time interval set by the corresponding time setting data, and the special effect setting data is based on the speed, height, and low of the corresponding music beat. Designed with multiple features such as strength and weakness.

於一實施方式中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號包括:根據所述傾斜度數據計算傾斜度於三個方向上之分量,並分別根據所述三個分量改變當前視覺特效訊號內紅、綠、藍三原色之比例。In an embodiment, the control host generates a special effect parameter according to the inclination data, and jointly generates a visual effect synchronously played with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect tag. The signal includes: calculating a component of the inclination in three directions according to the inclination data, and changing a ratio of three primary colors of red, green, and blue in the current visual effect signal according to the three components, respectively.

於一實施方式中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號包括:根據所述傾斜度數據計算對應之燈光亮度,所述視覺特效訊號之當前亮度與所述燈光亮度對應。In an embodiment, the control host generates a special effect parameter according to the inclination data, and jointly generates a visual effect synchronously played with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect tag. The signal includes: calculating a corresponding light brightness according to the tilt data, wherein a current brightness of the visual effect signal corresponds to the light brightness.

於一實施方式中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號包括:採用一連續函數由所述傾斜度數據計算所述視覺特效訊號之變化參數,使得所述變化參數隨著所述手持傾斜組件傾斜角度之變化而連續變化。In an embodiment, the control host generates a special effect parameter according to the inclination data, and jointly generates a visual effect synchronously played with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect tag. The signal includes: calculating a variation parameter of the visual effect signal from the inclination data by using a continuous function such that the variation parameter continuously changes as the tilt angle of the handheld tilting component changes.

於一實施方式中,所述控制主機為一智慧電子設備,所述智慧電子設備與所述視覺特效輸出裝置透過無線網路相連,所述智慧電子設備包括內置之麥克風,所述智慧電子設備內安裝有特定之軟體,所述特定之軟體透過所述內置之麥克風錄取外部設備發出之聲音,對錄取之聲音進行特徵採樣與特徵分析以識別出所述外部設備播放之歌曲之標識,並根據所述標識從雲端伺服器處獲取所述視覺特效資料集。In one embodiment, the control host is a smart electronic device, and the smart electronic device is connected to the visual effect output device via a wireless network, where the smart electronic device includes a built-in microphone, and the smart electronic device The specific software is installed, and the specific software transmits the sound emitted by the external device through the built-in microphone, and performs feature sampling and feature analysis on the recorded sound to identify the identifier of the song played by the external device, and according to the The identifier obtains the visual effect data set from the cloud server.

此外,本發明實施方式還提供一種演唱視覺特效處理方法,包括: 透過手持傾斜感測元件即時感測並發送手持電子裝置之傾斜度數據;於播放多媒體檔時,或於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之視覺特效資料集,所述視覺特效資料集內包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料;同步從所述視覺特效資料集中獲取與當前時間匹配之視覺特效標籤;根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號; 根據所述視覺特效訊號同步輸出視覺特效。In addition, an embodiment of the present invention further provides a singing visual special effect processing method, including: instantly sensing and transmitting the tilt data of the handheld electronic device through the handheld tilt sensing component; when playing the multimedia file, or playing the multimedia file on the external device Obtaining a visual special effect data set corresponding to the multimedia file, where the visual special effect data set includes a plurality of visual special effects tags, each visual special effect tag includes a time setting material and special effect setting materials; and synchronizing from the visual special effects data set Obtaining a visual effect label matching the current time; generating a special effect parameter according to the inclination data, and jointly generating a visual effect synchronized with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect label Signal; synchronously output visual effects according to the visual effect signal.

上述技術方案之有益效果為:可利用手持傾斜感測元件之傾斜度數據即時調整當前視覺特效,為演唱者提供自然方便即時控制功能,而且由於傾斜度連續變化特性,使得視覺特效也可連續並平滑地進行調節。The technical solution has the beneficial effects that the current visual effect can be instantly adjusted by using the tilt data of the hand-held tilt sensing component, and the singer is provided with a natural and convenient instant control function, and the visual effects can be continuously and continuously due to the continuously changing characteristics of the inclination. Adjust smoothly.

為讓本發明之上述和其他目的、特徵和優點能更明顯易懂,下文特舉較佳實施方式,並配合所附圖式,作詳細說明如下。The above and other objects, features and advantages of the present invention will become more <RTIgt;

為更進一步闡述本發明為實現預定發明目的所採取之技術手段及功效,以下結合附圖及較佳實施方式,對依據本發明之具體實施方式、結構、特徵及其功效,詳細說明如後。The specific embodiments, structures, features and functions of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

第一實施方式First embodiment

參閱圖1,其為本發明第一實施方式提供之演唱視覺特效系統之架構示意圖。如圖1所示,演唱視覺特效系統100包括手持傾斜感測元件15、控制主機10以及視覺特效輸出裝置11。Referring to FIG. 1 , it is a schematic structural diagram of a singing visual special effects system according to a first embodiment of the present invention. As shown in FIG. 1, the vocal visual effects system 100 includes a hand-held tilt sensing component 15, a control host 10, and a visual effects output device 11.

手持傾斜感測元件15可為一電子裝置,其內設置有感測器,用於感測手持傾斜感測組件15之傾斜角度。感測器可為任意可實現傾斜角度感測之感測器,例如加速度計、陀螺儀等。The hand-held tilt sensing component 15 can be an electronic device having a sensor disposed therein for sensing the tilt angle of the hand-held tilt sensing component 15. The sensor can be any sensor that can realize tilt angle sensing, such as an accelerometer, a gyroscope, and the like.

手持傾斜感測元件15可為專用之電子裝置,即主要用途是向控制主機10發送傾斜度數據,而不實現其他功能之電子裝置。由於其功能單一,此時手持傾斜感測元件15可製作成很小,從而可依附於其它經常需要手持使用之設備,例如麥克風101上。The hand-held tilt sensing component 15 can be a dedicated electronic device, that is, an electronic device whose primary purpose is to transmit tilt data to the control host 10 without implementing other functions. Due to its singular function, the hand-held tilt sensing element 15 can be made small at this time, so that it can be attached to other devices that are often required for handheld use, such as the microphone 101.

手持傾斜感測元件15也可為與其他電子設備例如麥克風、電子螢光棒等集成於一起。當一麥克風與手持傾斜感應元件集成於一起,其外表與一般之麥克風並無區別,差異處在於,除傳遞錄取演唱者112之歌聲外,手持傾斜感測組件還同步其傾斜度數據至控制主機10。The hand-held tilt sensing element 15 can also be integrated with other electronic devices such as microphones, electronic fluorescent bars, and the like. When a microphone is integrated with the hand-held tilt sensing element, its appearance is no different from that of a general microphone. The difference is that in addition to transmitting the singing voice of the singer 112, the hand-held tilt sensing component synchronizes the tilt data to the control host. 10.

手持傾斜感測元件15還可為其他通用型智慧電子裝置,例如智慧手機、智慧手環或其它可穿戴電子設置等。此種類型之手持傾斜感測元件15一般包括各種類型之感測器,透過於手持傾斜感測元件15內運行特定應用程式,可讓手持傾斜感測元件15實現上述之向控制主機10同步傾斜度數據之功能,即智慧電子裝置同時作為手持傾斜感測元件。The handheld tilt sensing component 15 can also be other general purpose smart electronic devices such as smart phones, smart bracelets or other wearable electronic settings. This type of hand-held tilt sensing component 15 generally includes various types of sensors that allow the hand-held tilt sensing component 15 to achieve the above-described simultaneous tilting of the control host 10 by running a particular application within the hand-held tilt sensing component 15. The function of the data, that is, the smart electronic device also serves as a hand-held tilt sensing element.

手持傾斜感測元件15與控制主機之間可透過無線或有線之方式連接。於感測到傾斜度數據後,手持傾斜感測組件15可將其同步給控制主機10。上述之傾斜度數據可為即時採樣並同步發送給控制主機10,還可為每一採樣週期內多次採樣累計平均後同步給控制主機10。可以理解,即使是一採樣週期內多次採樣平均,當採樣週期較小時,依然可認為傾斜度數據之發送是即時。此外,傾斜度數據可為原始資料,即感測器輸出之原始資料。如此,控制主機10於接收到傾斜度數據後需要進行計算以獲取傾斜度。傾斜度數據也可為計算結果或者中間資料。當傾斜度數據為計算結果時,控制主機10可直接使用計算結果作為傾斜度。The handheld tilt sensing component 15 and the control host can be connected by wireless or wired. After sensing the tilt data, the hand held tilt sensing component 15 can synchronize it to the control host 10. The above-mentioned inclination data may be instantaneously sampled and sent to the control host 10 in synchronization, and may also be synchronized to the control host 10 for multiple sampling and average after each sampling period. It can be understood that even if the sampling average is over a sampling period, when the sampling period is small, the transmission of the inclination data can be considered to be instantaneous. In addition, the tilt data can be the original data, that is, the original data output by the sensor. As such, the control host 10 needs to perform calculations to obtain the inclination after receiving the inclination data. The slope data can also be a calculation result or an intermediate data. When the inclination data is the calculation result, the control host 10 can directly use the calculation result as the inclination.

控制主機10之具體實施方式包括,但並不限於,個人電腦、多媒體播放機、單片機、資料播放機、智慧手機、專用之控制晶片。Specific implementations of the control host 10 include, but are not limited to, a personal computer, a multimedia player, a single chip microcomputer, a data player, a smart phone, and a dedicated control chip.

視覺特效輸出裝置11可為任意之可輸出視訊訊號之顯示裝置,例如單個顯示幕、多個顯示幕構成之顯示幕陣列、單個燈具(例如LED燈)、多個燈具構成之燈具陣列、單個投影儀、多個投影儀構成之投影儀陣列等等。The visual effect output device 11 can be any display device capable of outputting video signals, such as a single display screen, a display screen array composed of multiple display screens, a single luminaire (such as an LED lamp), a luminaire array composed of a plurality of luminaires, and a single projection. An instrument, a projector array of multiple projectors, and the like.

於一具體之實施方式中,視覺特效輸出裝置11包括一LED燈陣列,該LED燈陣列中之每個燈可根據輸入之不同訊號分別輸出不同之燈光,所有LED燈之燈光共同構成整體之視覺特效。可以理解,視覺特效之形式並不受任何限制。上述之LED燈陣列可佈滿房間所有牆壁、屋頂以及地面,使得顯示之視覺特效可對房間實現全包圍之效果,最大程度之提升現場舞臺視覺特效。In a specific embodiment, the visual effect output device 11 includes an array of LED lights, each of which can output different lights according to different signals input, and the lights of all the LED lights together constitute a whole vision. Special effects. It can be understood that the form of visual effects is not subject to any restrictions. The LED array described above can cover all the walls, roofs and floors of the room, so that the visual effects of the display can fully enclose the room and maximize the visual effects of the scene.

於一具體之實施方式中,視覺特效輸出裝置11包括一或多個顯示幕,每個顯示幕可顯示相同之顯示訊號,也可被分別控制,即顯示不同之顯示訊號。所有顯示幕之顯示共同構成整體之視覺特效。In a specific implementation manner, the visual effect output device 11 includes one or more display screens, each of which can display the same display signal, or can be separately controlled to display different display signals. The display of all the display screens together constitute the overall visual effect.

於一具體之實施方式中,視覺特效輸出裝置11包括一或多個投影儀,每個投影儀可顯示相同之顯示訊號,也可被分別控制,即顯示不同之顯示訊號。所有投影儀之顯示共同構成整體視覺特效。In a specific embodiment, the visual effect output device 11 includes one or more projectors, each of which can display the same display signal, or can be separately controlled to display different display signals. The display of all projectors together constitutes an overall visual effect.

各種類型之視覺特效輸出裝置11還可組合使用。例如,視覺特效輸出裝置11既可包括一LED燈陣列,還可包括一或多個投影儀或者顯示幕。Various types of visual effects output devices 11 can also be used in combination. For example, the visual effects output device 11 can include both an array of LED lights and one or more projectors or display screens.

控制主機10與視覺特效輸出裝置11之間可透過有線或無線方式連接,當採用有線方式連接之時候,例如可透過數位視訊介面(DVI介面)、高清晰度多媒體介面(HDMI介面)、視頻圖形陣列介面(VGA介面)連接,如此,可直接傳輸視訊訊號。若控制主機10與視覺特效輸出裝置11之間透過無線方式連接,需要於視頻特效輸出裝置11內置無線模組與訊號轉換模組,無線模組用於收發無線資料,訊號轉換模組用於將接收到之無線資料轉換為預定格式之視訊訊號。The control host 10 and the visual effect output device 11 can be connected by wire or wirelessly. When connected by wire, for example, through a digital video interface (DVI interface), a high definition multimedia interface (HDMI interface), video graphics. The array interface (VGA interface) is connected, so that the video signal can be directly transmitted. If the control host 10 and the visual effect output device 11 are connected wirelessly, the video special effect output device 11 needs to have a wireless module and a signal conversion module. The wireless module is used for transmitting and receiving wireless data, and the signal conversion module is used for The received wireless data is converted into a video signal of a predetermined format.

控制主機10於播放多媒體檔時,或者於外部設備播放多媒體檔時獲取與所述多媒體檔對應視覺特效資料集。可以理解,若要於外部設備播放多媒體檔時獲取視覺特效資料集,則外部設備於播放多媒體檔是需要向控制主機10發送一訊號,於上述訊號內包括播放之多媒體檔之標識。The control host 10 acquires a visual special effects data set corresponding to the multimedia file when playing the multimedia file or when the external device plays the multimedia file. It can be understood that if the visual effect data set is acquired when the external device plays the multimedia file, the external device needs to send a signal to the control host 10 for playing the multimedia file, and the identifier of the multimedia file to be played is included in the signal.

上述之外部設備與控制主機10可透過有線網路或者無線網路相互連接,控制主機10內運行有特定應用程式監聽特定之網路埠。而外部設備於播放多媒體檔時可向該特定之網路埠發送被播放之多媒體檔之標識以及開始播放多媒體檔之時間。如此,控制主機10即可接收到外部設備發送之多媒體檔之標識以及開始播放多媒體檔之時間。另外,控制主機10與外部設備還可接入同一伺服器系統中,外部設備於播放多媒體檔時,可將播放之多媒體檔之識別資訊以及開始播放之時間提交給伺服器系統,由該伺服器系統將上述資訊推送給控制主機10或者由控制主機10主動向伺服器系統查詢得到上述之多媒體檔之標識以及開始播放多媒體檔之時間。The above-mentioned external device and control host 10 can be connected to each other through a wired network or a wireless network, and a specific application running in the host 10 can be monitored to monitor a specific network. The external device can send the identifier of the played multimedia file and the time when the multimedia file starts to be played to the specific network. In this way, the control host 10 can receive the identifier of the multimedia file sent by the external device and the time when the multimedia file starts to be played. In addition, the control host 10 and the external device can also be connected to the same server system, and when the external device plays the multimedia file, the identification information of the played multimedia file and the time of starting the playback can be submitted to the server system, and the server The system pushes the above information to the control host 10 or the control host 10 actively queries the server system to obtain the identifier of the multimedia file and the time when the multimedia file starts to be played.

無論是控制主機10自行播放多媒體檔,還是外部設備於播放多媒體檔,於多媒體檔開始播放後,則控制主機10獲取與被播放之多媒體檔對應之視覺特效資料集。Whether the control host 10 plays the multimedia file by itself or the external device plays the multimedia file, after the multimedia file starts playing, the control host 10 acquires the visual special effects data set corresponding to the multimedia file being played.

上述之視覺特效資料集,既可為存儲於控制主機10內,也可為存儲於雲端伺服器系統內。The visual effect data set described above may be stored in the control host 10 or stored in the cloud server system.

視覺特效資料集內可包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料。時間設定資料設定對應之視覺特效標籤之有效時間區間,而特效設定資料用於設定生成視覺特效之方式及其他參數。The visual effects data set may include a plurality of visual effects labels, each visual effect label including time setting data and special effect setting materials. The time setting data sets the effective time interval of the corresponding visual effect label, and the special effect setting data is used to set the manner of generating the visual special effect and other parameters.

可以理解,此處之視覺特效標籤係指時間設定資料與特效設定資料邏輯上之關聯性,但並不意味著視覺特效標籤之具體資料結構以及存儲結構,也就是同一視覺特效標籤之時間設定資料以及特效設定資料並不限於一併保存。It can be understood that the visual effect label here refers to the logical association between the time setting data and the special effect setting data, but does not mean that the specific data structure and storage structure of the visual special effect label, that is, the time setting data of the same visual special effect label. And the settings of the special effects are not limited to being saved.

特效設定資料集之存儲方式即可為以檔之形式存放,也可為存儲於資料庫中。特效設定資料集是預先由人工或者自動化處理系統為每首歌曲定制生成。The storage method of the special effect setting data set can be stored in the form of a file or stored in a database. The special effects setting data set is customized for each song by a manual or automated processing system.

如果每一視覺特效標籤用來表示一節拍,那麼,一具體之實施方式中,視覺特效資料集例如可如下: [00:00.00]特效設定數據1 [00:24.88]特效設定數據2 [01:27.05]特效設定數據3 [02:30.39]特效設定數據4 … …If each visual effect label is used to represent a beat, then in a specific implementation, the visual effect data set can be as follows: [00:00.00] special effect setting data 1 [00:24.88] special effect setting data 2 [01: 27.05] Special effect setting data 3 [02:30.39] Special effect setting data 4 ... ...

其中之每一時間設定資料,例如[00:24.88],是一節拍之視覺特效之起點時間,所述視覺特效於播放完畢後自然結束。Each time setting data, such as [00:24.88], is the starting time of the visual effect of one shot, and the visual effect ends naturally after the playing.

如果一視覺特效標籤中包含多個節拍之視覺特效或者包含靜態之視覺特效,那麼於一具體之實施方式中,視覺特效資料集例如可如下: [00:00.00]特效設定數據1 [00:24.88]特效設定數據2 [01:27.05]特效設定數據3 [02:30.39]特效設定數據4 … …If a visual effect label contains multiple beat visual effects or contains static visual effects, then in a specific embodiment, the visual effects data set can be as follows: [00:00.00] special effect setting data 1 [00:24.88 ] Special effect setting data 2 [01:27.05] Special effect setting data 3 [02:30.39] Special effect setting data 4 ... ...

對於此種格式中之特效設定資料,可為由兩個相鄰之時間起點構成一時間區間,例如,[00:00.00]- [00:24.88]構成之時間區間為特效設定資料1之有效時間區間。For the special effect setting data in this format, a time interval may be formed by two adjacent time starting points. For example, the time interval formed by [00:00.00]-[00:24.88] is the effective time of the special effect setting data 1. Interval.

可以理解,視覺特效標籤之資料格式並不限於此,時間設定資料也可包括更多之資訊,例如直接指定出時間區間,如下: [00:00.00-00:23.86] 特效設定數據1 [00:24.88-01:00.90] 特效設定數據2 [01:27.05-03:29.00] 特效設定數據3 [03:30.39-05:38.86] 特效設定數據4It can be understood that the data format of the visual effect label is not limited thereto, and the time setting data may also include more information, for example, directly specifying the time interval, as follows: [00:00.00-00:23.86] effect setting data 1 [00: 24.88-01:00.90] Effect setting data 2 [01:27.05-03:29.00] Effect setting data 3 [03:30.39-05:38.86] Effect setting data 4

方括號內第一時間為開始時間,而後一時間為結束時間。透過此種方式,可定義出不連續之時間區間,其適應性比只包括開始時間之方式更加靈活。於此情況下,於所有時間區間外(例如於01:10.00時)都不會觸發任何視覺特效。The first time in square brackets is the start time, and the latter time is the end time. In this way, a discontinuous time interval can be defined, and its adaptability is more flexible than just including the start time. In this case, no visual effects are triggered outside of all time intervals (eg at 01:10.00).

此外,還可為採用開始時間加上時間長度來定義每個視覺特效標籤之有效時間區間,可如下: [00:00.00, 00:55.00] 特效設定數據1 [00:24.00, 01:03.00] 特效設定數據2 [01:28.00, 03:02.00] 特效設定數據3 [04:30.00, 08:08.00] 特效設定數據4In addition, the effective time interval for each visual effect label can be defined by using the start time plus the length of time, as follows: [00:00.00, 00:55.00] Effect setting data 1 [00:24.00, 01:03.00] Setting data 2 [01:28.00, 03:02.00] Effect setting data 3 [04:30.00, 08:08.00] Effect setting data 4

從上述之資料定義可看出,特效設定資料1與特效設定資料2對應之視覺特效之有效時間區間有重疊,因此,於本實施方式中,兩個不同之視覺特效是可於同一時間區間內並存。It can be seen from the above data definition that the effective time interval of the visual effect corresponding to the special effect setting data 1 and the special effect setting data 2 overlaps. Therefore, in the present embodiment, two different visual special effects can be in the same time interval. coexist.

進一步地,對應同一時間區間,還可有多個視覺特效,此多個視覺特效可是相同類型之視覺特效,例如多個燈光特效,或者多個視頻疊加特效,也可為多個不同類型之視覺特效,例如,既包括燈光特效,也包括視頻特效。此時,特效設定資料集例如可如下: [00:00.00, 00:55.00] 特效設定數據1-1,特效設定數據1-2 [00:24.00, 01:03.00] 特效設定數據2 [01:28.00, 03:02.00] 特效設定數據3 [04:30.00, 01:08.00] 特效設定數據4-1,特效設定數據4-2。Further, corresponding to the same time interval, there may be multiple visual effects, which may be the same type of visual effects, such as multiple lighting effects, or multiple video overlay effects, or multiple different types of visual effects. Special effects, for example, include both lighting effects and video effects. At this time, the effect setting data set can be as follows: [00:00.00, 00:55.00] Effect setting data 1-1, effect setting data 1-2 [00:24.00, 01:03.00] Effect setting data 2 [01:28.00 , 03:02.00] Effect setting data 3 [04:30.00, 01:08.00] Effect setting data 4-1, effect setting data 4-2.

可以理解,上述第一視覺特效標籤之設定方式等效於以下方式: [00:00.00, 00:55.00] 特效設定數據1-1 [00:00.00, 00:55.00] 特效設定數據1-2It can be understood that the setting manner of the above first visual effect label is equivalent to the following manner: [00:00.00, 00:55.00] Special effect setting data 1-1 [00:00.00, 00:55.00] Special effect setting data 1-2

即,將包括多個特效之視覺特效標籤拆分成多個有效時間區間相同之視覺特效標籤。That is, the visual effect label including a plurality of special effects is split into a plurality of visual effect labels having the same effective time interval.

於以上所列舉之各個實施方式中,時間之表徵方式為時:分:秒,然而,本發明並不限於採用這種方式,例如,可直接採用秒數、毫秒數、分鐘數等任意之單位來表徵。以開始時間00:24.00為例,換算成秒數則為1440,換算成毫秒數為1440000,直接以分鐘數表示即為24。時間設定資料中所記錄之時間資料還可為對時間值進行各種可逆運算之結果,甚至可進行加密運算。以上述之秒數1440為例,例如可將其除以2得到720。亦即於時間設定資料中存儲720,但實際上其表達1440秒。可以理解,經過此運算後,若要計算某個視覺特效標籤之有效時間區間,需要進行逆向運算得到實際之時間區間。In the various embodiments listed above, the time is represented by time: minute: second. However, the present invention is not limited to this method. For example, any unit such as seconds, milliseconds, minutes, etc. can be directly used. To characterize. Taking the start time 00:24.00 as an example, the number of seconds converted is 1440, and the number of milliseconds is 14.40 million, which is 24 in minutes. The time data recorded in the time setting data can also be the result of various reversible operations on the time value, and even cryptographic operations can be performed. Taking the above number of seconds 1440 as an example, for example, it can be divided by 2 to obtain 720. That is, 720 is stored in the time setting data, but it actually expresses 1440 seconds. It can be understood that after this operation, in order to calculate the effective time interval of a visual effect label, a reverse operation is required to obtain an actual time interval.

可以理解,無論經過何種處理,其本質仍然是透過於視覺特效標籤中定義一時間起點或者一時間區間,因此,所有這些方式均應被包括於上述時間設定資料之範圍內。It can be understood that, regardless of the processing, the essence is still to define a time starting point or a time interval in the visual effect label, and therefore all of these methods should be included in the range setting data.

特效設定資料可為視頻、動畫、圖片、文字之原始檔案。The effect setting data can be the original file of video, animation, picture and text.

特效設定資料可為用於設定生成視覺特效之方式及其他參數。此處之視覺特效可包括靜態特效以及動態特效。靜態特效例如可包括燈光顏色、燈光亮度、顯示圖案、顯示文字等內容不變之特效。動態特效例如包括各種動畫,例如顏色變換、亮度變化、圖案變換、文字變化、動畫或其組合。動態特效可對應一節拍,也可對應一系列連續之節拍。上述之動畫效果,例如可包括於伴唱多媒體視頻主畫面上疊加動畫特效,比如顯示全屏之鮮花、下雨、下雪、心形蛋糕等等。特效設定資料還可為用於獲取視覺特效之其他格式之資料,例如,視覺特效資源檔之識別符。而此處之視覺特效資源檔可為預存儲於與控制主機10相連之記憶體內,或者存儲於雲端伺服器內。控制主機10可於記憶體內讀取與視覺特效資源檔之識別符對應之視覺特效資源檔,或者發起網路請求,從雲端伺服器處下載視覺特效資源檔。The effect setting data can be used to set the way to generate visual effects and other parameters. Visual effects here can include static effects as well as dynamic effects. Static effects, for example, can include effects such as light color, light brightness, display patterns, and display text. Dynamic effects include, for example, various animations such as color changes, brightness changes, pattern changes, text changes, animations, or combinations thereof. Dynamic effects can correspond to a single shot or a series of consecutive beats. The animation effects described above, for example, may include superimposed animation effects on the main screen of the chorus multimedia video, such as displaying full-screen flowers, rain, snow, heart-shaped cakes, and the like. The effect setting data can also be information for other formats used to obtain visual effects, such as the identifier of the visual effects resource file. The visual effect resource file here may be pre-stored in the memory connected to the control host 10 or stored in the cloud server. The control host 10 can read the visual special effect resource file corresponding to the identifier of the visual special effect resource file in the memory, or initiate a network request to download the visual special effect resource file from the cloud server.

優選地,特效設定資料所設定之視覺特效,是與音樂節拍相關之,節拍之時間節點是透過上述之時間設定資料來控制。總體上來說,特效設定資料所設定之視覺特效,針對音樂當中之每一節拍,於視覺特效上最好能夠輸出一明顯之視覺特效變化,而且視覺特效變化之幅度、速度、範圍等等參數可為與節拍之特點(透過對音訊參數如音量、頻率進行分析得到)相關。因此,透過視覺特效就能夠反應出音樂之變化,使得音樂除聲音外,還能夠透過視覺特效之方式給人們以更豐富之刺激。換言之,本實施方式中之視覺特效之目將音樂節拍視覺化,強化音樂節拍感。Preferably, the visual special effect set by the special effect setting data is related to the music beat, and the time node of the beat is controlled by the time setting data described above. In general, the visual effects set by the special effects setting data, for each beat of the music, it is best to output an obvious visual special effect change in the visual special effects, and the amplitude, speed, range and the like of the visual special effect change can be It is related to the characteristics of the beat (by analyzing the audio parameters such as volume and frequency). Therefore, through visual effects, it is possible to reflect the changes in music, so that in addition to sound, music can also give people a richer stimulation through visual effects. In other words, the visual effect of the present embodiment visualizes the music beat and enhances the musical beat feeling.

本實施方式之演唱視覺特效系統中,控制主機10還根據手持傾斜感測元件15同步之傾斜度數據即時調整視覺特效裝置11所輸出之視覺特效。In the singing visual effect system of the present embodiment, the control host 10 also adjusts the visual effect output by the visual effect device 11 in real time according to the inclination data synchronized by the hand-held tilt sensing element 15.

於一具體之實施方式中,控制主機10根據預先存儲之規則從傾斜度計算視覺特效之變化參數,並根據所述變化參數改變當前視覺特效訊號。例如,可將傾斜度與視覺特效之亮度對應起來。即,建立傾斜度θ與視覺特效亮度之間之映射函數F(θ)。如此,對應於手持傾斜感測元件15每個週期同步之傾斜度數據,控制主機10即時調整當前視覺特效訊號之亮度。上述之映射函數優選是一連續函數,從而使得所述變化參數隨著手持傾斜組件15傾斜角度之變化而連續變化。In a specific embodiment, the control host 10 calculates a change parameter of the visual effect from the tilt according to a pre-stored rule, and changes the current visual effect signal according to the change parameter. For example, the tilt can be correlated to the brightness of the visual effect. That is, a mapping function F(θ) between the inclination θ and the visual effect brightness is established. Thus, the control host 10 adjusts the brightness of the current visual effect signal in real time corresponding to the inclination data of each cycle of the hand-held tilt sensing element 15. The mapping function described above is preferably a continuous function such that the varying parameters continuously change as the tilt angle of the hand tilt assembly 15 changes.

可以理解,能夠改變之參數並不限於亮度,任意之顯示參數例如對比度、顏色比例、特效面積大小均可與傾斜度關聯起來,而每次變化之也不限於改變一顯示參數,例如,可根據傾斜度同時改變對比度與亮度,以此類推。It can be understood that the parameters that can be changed are not limited to brightness, and any display parameters such as contrast, color ratio, and special effect area size may be associated with the inclination, and each change is not limited to changing a display parameter, for example, according to The tilt changes both contrast and brightness, and so on.

於另一具體之實施方式中,上述之視覺特效資料集內還包括傾斜回應標籤,所述傾斜回應標籤定義某個時間段內視覺特效訊號回應所述傾斜度數據變化而變化之方式。亦即,於不同之時間節點上,控制主機10會按照不同之方式(傾斜回應標籤所定義之方式)改變視覺特效訊號。In another specific implementation, the visual effect data set includes a tilt response tag, and the tilt response tag defines a manner in which the visual effect signal changes in response to the change of the tilt data in a certain period of time. That is, at different time nodes, the control panel 10 changes the visual effect signal in a different manner (as defined by the tilt response tag).

由於每個視覺特效標籤實際上對應於一時間區間,亦即於不同之時間區間內,視覺特效訊號會根據傾斜度變化做出不同之回應。例如,於第一視覺特效標籤內,視覺特效回應傾斜度之變化,其亮度改變,傾斜度越大,亮度越高或者越低。於第二個視覺特效標籤內,視覺特效回應傾斜度之變化,是改變其顏色,傾斜度越大,其顏色越深。於第三個視覺特效標籤內,視覺特效回應傾斜度之變化,是於視覺特效之基礎畫面上疊加顯示附加之動畫效果。綜上所述,任意顯示方式及內容之變更均可用於視覺特效訊號回應傾斜度之變化中。Since each visual effect label actually corresponds to a time interval, that is, in different time intervals, the visual effect signal will respond differently according to the change of the inclination. For example, in the first visual effects label, the visual effect responds to a change in the tilt, the brightness of which changes, the greater the tilt, the higher or lower the brightness. In the second visual effects label, the visual effect responds to the change in tilt by changing its color. The greater the tilt, the darker the color. In the third visual effects tab, the visual effect responds to the change in tilt, which superimposes the additional animation effects on the basic image of the visual effects. In summary, any display mode and content changes can be used to change the visual effect signal response tilt.

於另一具體之實施方式中,傾斜度不僅可用於改變視覺特效訊號,還可用於視覺特效訊號之控制,例如暫停或者繼續播放視覺特效訊號。具體地,當傾斜度比較小或者較大之時候,暫停當前視覺特效之播放,而當傾斜度超過一定角度時或者小於一定角度,播放為當前歌曲預先設定之視覺特效,或者切換不同之視覺特效。In another specific embodiment, the tilt can be used not only to change visual effects signals, but also to control visual effects signals, such as pausing or continuing to play visual effects signals. Specifically, when the inclination is relatively small or large, the playback of the current visual effect is suspended, and when the inclination exceeds a certain angle or is less than a certain angle, the visual effect preset for the current song is played, or different visual effects are switched. .

於另一具體之實施方式中,還可分析某個時間區間內傾斜度之變化特徵,然後將符合預定模式或者條件之傾斜度定義不同之操作,分別用於觸發不同之控制事件,例如改變當前之視覺特效訊號,或者控制視覺特效訊號之暫停、播放或者視覺特效之切換。In another specific implementation manner, the change characteristic of the inclination in a certain time interval may also be analyzed, and then the operation according to the predetermined mode or the condition is defined to be different, and respectively used to trigger different control events, for example, changing the current Visual effects signals, or control the pause, play or visual effects of visual effects signals.

於另一具體之實施方式中,傾斜度還被置於一三維坐標系中,例如XYZ坐標系中,然後將傾斜度分解成三個平面上之分量,此三個平面上之分量可分別用於控制當前視覺特效訊號中之不同參數,例如,三個平面上之分量分別控制紅、綠、藍三種顏色之比例。透過此種方式,演唱者可於演唱之同時動態調整視覺特效以與自己演唱之情緒相匹配,提升演唱現場特效之豐富性。In another specific embodiment, the inclination is also placed in a three-dimensional coordinate system, such as an XYZ coordinate system, and then the inclination is decomposed into components on three planes, and the components on the three planes can be used separately. In controlling the different parameters in the current visual effect signal, for example, the components on the three planes respectively control the ratio of the three colors of red, green and blue. In this way, the singer can dynamically adjust the visual effects at the same time as singing to match the emotions of the singing, and enhance the richness of the special effects of the singing scene.

根據本實施方式之演唱視覺特效系統,可利用手持傾斜感測元件之傾斜度數據即時調整當前之視覺特效,為演唱者提供自然方便之即時控制功能,而且由於傾斜度之連續變化特性,使得視覺特效也可連續地及平滑地進行調節。According to the singing visual special effects system of the present embodiment, the tilting data of the hand-held tilt sensing component can be used to instantly adjust the current visual special effect, providing the singer with a natural and convenient instant control function, and the visual change due to the continuous change characteristic of the tilt Special effects can also be adjusted continuously and smoothly.

第二實施方式Second embodiment

參閱圖2,其為本發明第二實施方式提供之演唱視覺特效系統200之架構示意圖。如圖2所示,本實施方式之演唱視覺特效系統200與圖1之演唱視覺特效系統100相似,其不同之處在於還包括:音訊輸出裝置12以及點歌面板13。2 is a schematic structural diagram of a singing visual effect system 200 according to a second embodiment of the present invention. As shown in FIG. 2, the vocal visual effects system 200 of the present embodiment is similar to the vocal visual effects system 100 of FIG. 1 except that the audio output device 12 and the karaoke panel 13 are further included.

音訊輸出裝置12例如可包括音箱、功放等音訊輸出設備。The audio output device 12 may include, for example, an audio output device such as a speaker or a power amplifier.

點歌面板13提供點歌之介面,使用者例如可透過觸控螢幕進行點歌,選擇之歌曲被提交給控制主機10,控制主機10根據待播放之清單播放與被點歌曲對應之音訊和/或視頻檔,音訊訊號由音訊輸出裝置12進行輸出。The karaoke panel 13 provides a karaoke interface. The user can, for example, sing a song through the touch screen, and the selected song is submitted to the control host 10, and the control host 10 plays the audio corresponding to the selected song according to the list to be played and/ Or the video file, the audio signal is output by the audio output device 12.

根據本實施方式之技術方案,控制主機10既控制視覺特效之輸出,也同時作為點歌系統之主機。亦即,本實施方式之演唱視覺特效系統尤其適用于KTV之應用場景中。According to the technical solution of the embodiment, the control host 10 controls both the output of the visual effects and the host of the karaoke system. That is, the singing visual effect system of the present embodiment is particularly suitable for use in an application scenario of a KTV.

此外,對應於每個多媒體檔,還有多個視覺特效資料集,分別對應視覺特效之多個版本,例如深情版本、搞笑版本、以及裝萌版本。因此,參閱圖3,控制主機10還可於播放歌曲時顯示選擇功能表,提示使用者可切換視覺特效之不同版本。例如,當用戶按下遙控器之某個按鍵後,即使用者輸入特定選擇指令後,即可播放與該按鍵對應之視覺特效版本。可以理解,如圖3所示之提示功能表並不是必須之,而可於遙控器上設置對應之視覺特效版本切換按鍵,當切換按鍵被按下後,即可於不同之視覺版本之間進行切換。In addition, corresponding to each multimedia file, there are a plurality of visual effects data sets corresponding to multiple versions of visual effects, such as a deep version, a funny version, and a cute version. Therefore, referring to FIG. 3, the control host 10 can also display a selection function table when the song is played, prompting the user to switch between different versions of the visual effects. For example, when the user presses a certain button of the remote controller, that is, after the user inputs a specific selection command, the visual effect version corresponding to the button can be played. It can be understood that the prompt function table shown in FIG. 3 is not necessary, and the corresponding visual effect version switching button can be set on the remote controller, and when the switching button is pressed, it can be performed between different visual versions. Switch.

第三實施方式Third embodiment

參閱圖4,其為本發明第三實施方式提供之演唱視覺特效系統300之示意圖。如圖4所示,本實施方式之演唱視覺特效系統300與圖2之演唱視覺特效系統200相似,其不同之處在於,還包括多媒體視頻輸出設備14。Referring to FIG. 4, it is a schematic diagram of a singing visual effects system 300 according to a third embodiment of the present invention. As shown in FIG. 4, the vocal visual effects system 300 of the present embodiment is similar to the vocal visual effects system 200 of FIG. 2, except that it further includes a multimedia video output device 14.

多媒體視頻輸出設備14例如是電視機、投影儀或者顯示幕。多媒體視頻輸出設備14用於輸出多媒體檔之伴唱多媒體視頻主畫面。控制主機10於播放多媒體檔時,將多媒體視頻主畫面發送給多媒體視頻輸出設備14進行輸出。The multimedia video output device 14 is, for example, a television, a projector or a display screen. The multimedia video output device 14 is configured to output a chorus multimedia video home screen of the multimedia file. When the control host 10 plays the multimedia file, the multimedia video main screen is sent to the multimedia video output device 14 for output.

根據本實施方式之技術方案,視覺特效透過視覺特效輸出裝置11進行輸出,而多媒體視頻主畫面透過多媒體視頻輸出設備14進行輸出,兩者互不影響。According to the technical solution of the embodiment, the visual effect is output through the visual effect output device 11, and the multimedia video main picture is output through the multimedia video output device 14, and the two do not affect each other.

進一步地,可以理解,多媒體視頻輸出設備14中仍然可用於輸出視覺特效。當然,此時視覺特效是疊加於多媒體視頻主畫面中。Further, it will be appreciated that the multimedia video output device 14 can still be used to output visual effects. Of course, the visual effects are superimposed on the main screen of the multimedia video at this time.

亦即,特效設定資料中所設定之視覺特效可包括分別由多種類型之設備輸出之視覺特效。例如,燈光特效就由LED燈陣列進行輸出,而視頻疊加特效就由多媒體視頻輸出設備14進行輸出。That is, the visual effects set in the special effect setting data may include visual effects respectively output by a plurality of types of devices. For example, the lighting effects are output by the LED light array, and the video overlay effects are output by the multimedia video output device 14.

第四實施方式Fourth embodiment

參閱圖5,其為本發明第四實施方式提供之演唱視覺特效系統400之示意圖。本實施方式之演唱視覺特效系統400與圖4之演唱視覺特效系統300相似,其不同之處在於,還包括雲端伺服器系統20。Referring to FIG. 5, it is a schematic diagram of a singing visual effect system 400 according to a fourth embodiment of the present invention. The singing visual effects system 400 of the present embodiment is similar to the singing visual effects system 300 of FIG. 4, except that it also includes a cloud server system 20.

具體地,雲端伺服器系統20包括資料庫22以及伺服器24。其中,資料庫22用於存儲不同歌曲之視覺特效資料集。伺服器24用於根據用戶端(如控制主機10)之請求返回視覺特效資料集給用戶端。Specifically, the cloud server system 20 includes a database 22 and a server 24. The database 22 is used to store visual effects data sets of different songs. The server 24 is configured to return a visual effect data set to the client according to the request of the client (such as the control host 10).

圖6示出上述之伺服器24之一實施方式之結構框圖。如圖6所示,伺服器包括記憶體102、存儲控制器104,一或多個(圖中僅示出一)處理器106、外設介面108、以及網路模組110。這些元件透過一條或多條通訊匯流排/訊號線相互通訊。FIG. 6 shows a block diagram of an embodiment of the above-described server 24. As shown in FIG. 6, the server includes a memory 102, a memory controller 104, one or more (only one shown) processor 106, a peripheral interface 108, and a network module 110. These components communicate with one another via one or more communication bus/signal lines.

可以理解,圖6所示之結構僅為示意,上述伺服器還可包括比圖6中所示更多或者更少之元件,或者具有與圖6所示不同之配置。圖6中所示之各元件可採用硬體、軟體或其組合實現。It can be understood that the structure shown in FIG. 6 is merely illustrative, and the above server may further include more or less elements than those shown in FIG. 6, or have a configuration different from that shown in FIG. 6. The elements shown in Figure 6 can be implemented in hardware, software, or a combination thereof.

記憶體102可用於存儲軟體程式以及模組,如本發明實施方式中之各方法及裝置對應之程式指令/模組,處理器106透過運行存儲於記憶體102內之軟體程式以及模組,從而執行各種功能應用以及資料處理,即實現上述之方法。The memory 102 can be used to store software programs and modules, such as the program instructions/modules corresponding to the methods and devices in the embodiments of the present invention. The processor 106 runs the software programs and modules stored in the memory 102, thereby The above methods are implemented by performing various functional applications and data processing.

記憶體102可包括高速隨機記憶體,還可包括非易失性記憶體,如一或者多個磁性存儲裝置、快閃記憶體、或者其他非易失性固態記憶體。於一些實施方式中,記憶體102可進一步包括相對於處理器106遠端設置之記憶體,這些遠端存放器可透過網路連接至上述伺服器。上述網路之實施方式包括但不限於互聯網、企業內部網、局域網、移動通信網及其組合。處理器106以及其他可能之元件對記憶體102之訪問可於存儲控制器104之控制下進行。The memory 102 can include high speed random memory and can also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some embodiments, the memory 102 can further include memory disposed remotely from the processor 106, the remote registers being connectable to the server via a network. Implementations of the above networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof. Access to the memory 102 by the processor 106 and other possible components can be performed under the control of the memory controller 104.

外設介面108將各種輸入/輸出裝置耦合至處理器106。處理器106運行記憶體102內之各種軟體、指令上述伺服器執行各種功能以及進行資料處理。於一些實施方式中,外設介面108、處理器106以及存儲控制器104可於單個晶片中實現。於其他一些實施方式中,他們可分別由獨立之晶片實現。Peripheral interface 108 couples various input/output devices to processor 106. The processor 106 runs various software in the memory 102, instructs the server to perform various functions, and performs data processing. In some embodiments, peripheral interface 108, processor 106, and memory controller 104 can be implemented in a single wafer. In other embodiments, they may be implemented separately from separate wafers.

網路模組110用於接收以及發送網路訊號。上述網路訊號可包括無線訊號或者有線訊號。於一實施方式中,上述網路訊號為有線網路訊號。此時,網路模組110可包括處理器、隨機記憶體、轉換器、晶體振盪器等元件。於一實施方式中,上述之網路訊號為無線訊號(例如射頻訊號)。此時網路模組110實質是射頻模組,接收以及發送電磁波,實現電磁波與電訊號之相互轉換,從而與通訊網路或者其他設備進行通訊。射頻模組可包括各種現有之用於執行這些功能之電路元件,例如,天線、射頻收發器、數位訊號處理器、加密/解密晶片、使用者身份模組(SIM)卡、記憶體等等。射頻模組可與各種網路如互聯網、企業內部網、無線網路進行通訊或者透過無線網路與其他設備進行通訊。上述之無線網路可包括蜂窩式電話網、無線局域網或者都會區網路。上述之無線網路可使用各種通信標準、協定及技術,包括但並不限於全球移動通信系統(Global System for Mobile Communication, GSM)、增強型移動通信技術(Enhanced Data GSM Environment, EDGE),寬頻碼分多址技術(wideband code division multiple access, W-CDMA),碼分多址技術(Code division access, CDMA)、時分多址技術(time division multiple access, TDMA),無線保真技術(Wireless, Fidelity, WiFi)(如美國電氣和電子工程師協會標準 IEEE 802.11a, IEEE 802.11b, IEEE802.11g 和/或 IEEE 802.11n)、網路電話(Voice over internet protocal, VoIP)、全球微波互聯接入(Worldwide Interoperability for Microwave Access, Wi-Max)、其他用於郵件、即時通訊及短消息之協定,以及任何其他合適之通訊協定,甚至可包括那些當前仍未被開發出來之協定。The network module 110 is configured to receive and send network signals. The above network signals may include wireless signals or wired signals. In an embodiment, the network signal is a wired network signal. At this time, the network module 110 may include components such as a processor, a random memory, a converter, a crystal oscillator, and the like. In one embodiment, the network signal is a wireless signal (eg, an RF signal). At this time, the network module 110 is essentially a radio frequency module, which receives and transmits electromagnetic waves, and realizes mutual conversion between electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The radio frequency module can include various existing circuit components for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a user identity module (SIM) card, a memory, and the like. The RF module can communicate with various networks such as the Internet, intranets, wireless networks or with other devices over a wireless network. The wireless network described above may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code. Wideband code division multiple access (W-CDMA), Code division access (CDMA), time division multiple access (TDMA), wireless fidelity (Wireless, Fidelity, WiFi) (such as the Institute of Electrical and Electronics Engineers Standard IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over internet protocal (VoIP), Worldwide Interoperability for Microwave Access ( Worldwide Interoperability for Microwave Access, Wi-Max), other agreements for mail, instant messaging and short messages, and any other suitable communication protocols, even those that are not currently under development.

上述之軟體程式以及模組包括:作業系統122、以及視覺特效服務模組124。作業系統122其可包括各種用於管理系統任務(例如記憶體管理、存放裝置控制、電源管理等)之軟體元件和/或驅動,並可與各種硬體或軟體元件相互通訊,從而提供其他軟體元件之運行環境。視覺特效服務模組124運行於作業系統122之基礎上,用於實現對演唱視覺特效系統之視覺特效資料集之傳輸控制功能,具體描述如下。The software program and module described above include an operating system 122 and a visual effects service module 124. The operating system 122 may include various software components and/or drivers for managing system tasks (eg, memory management, storage device control, power management, etc.) and may communicate with various hardware or software components to provide other software. The operating environment of the component. The visual effect service module 124 runs on the basis of the operating system 122 for realizing the transmission control function of the visual special effects data set of the singing visual special effects system, which is described in detail below.

視覺特效服務模組124包括身份校驗模組126、特效傳輸模組128以及資訊傳輸模組130。The visual effect service module 124 includes an identity verification module 126, a special effect transmission module 128, and an information transmission module 130.

身份校驗模組126用於用戶端進行身份校驗。於一具體之實施方式中,每個控制主機10內存儲有身份認證資訊,例如,主機ID之加密字串。於向視覺特效服務模組124發起視覺特效資料集獲取請求前,控制主機10可發起登陸請求,將身份認證資訊發送給伺服器24。相應地,伺服器24之身份校驗模組126根據預定之加密演算法及金鑰對身份認證資訊進行解密,並驗證該主機ID是否具有獲取視覺特效資料集之許可權。例如,檢索該主機ID對應之繳費標記,若該主機ID並未繳納視覺特效資料集之使用費,則該主機ID不具有獲取視覺特效資料集之許可權,控制主機10之身份認證不透過。相應地,特效傳輸模組128會拒絕控制主機10之獲取視覺特效資料集之請求。The identity verification module 126 is configured to perform identity verification on the user side. In a specific implementation, each control host 10 stores identity authentication information, such as an encrypted string of host IDs. Before initiating the visual effect data set acquisition request to the visual effect service module 124, the control host 10 may initiate a login request to send the identity authentication information to the server 24. Correspondingly, the identity verification module 126 of the server 24 decrypts the identity authentication information according to the predetermined encryption algorithm and the key, and verifies whether the host ID has the permission to acquire the visual effect data set. For example, the payment identifier corresponding to the host ID is retrieved. If the host ID does not pay the usage fee of the visual effect data set, the host ID does not have the permission to acquire the visual special effect data set, and the identity authentication of the control host 10 is not transparent. Accordingly, the effect transmission module 128 rejects the request to control the host 10 to obtain the visual effects data set.

如果某個主機ID具有獲取視覺特效資料集之許可權時,特效傳輸模組128就會根據控制主機10之請求返回對應之視覺特效資料集。可以理解,控制主機10可於開始播放某首歌曲或者其他多媒體檔之時候,或者歌曲進入播放清單後即發起上述之登陸校驗請求以及視覺特效資料集獲取請求,並將要播放之歌曲之識別符包括於上述之視覺特效資料集之獲取請求內。If a host ID has permission to obtain a visual effects data set, the effect transmission module 128 returns a corresponding visual effect data set according to the request of the control host 10. It can be understood that the control host 10 can initiate the above-mentioned login verification request and the visual effect data set acquisition request when starting a certain song or other multimedia file, or after the song enters the playlist, and the identifier of the song to be played. It is included in the request for obtaining the visual effects data set mentioned above.

可以理解,從伺服器24下載視覺特效資料集需要耗費一定之時間,因此如果歌曲開始播放時才開始下載上述之視覺特效資料集,則於視覺特效資料集下載完成後進行視覺特效播放時需要考慮去除下載時間對時間線之影響。具體地,如果歌曲播放後時間T時完成視覺特效資料集之下載並開始播放,則視覺特效之時間線會從時間T處開始,而不是從頭開始以實現與多媒體檔之時間線之同步。這要求控制主機10記錄多媒體檔開始播放之時間以及視覺特效資料集下載完成之時間,兩者之時間差即為上述之時間T。It can be understood that it takes a certain time to download the visual special effects data set from the server 24. Therefore, if the visual effect data set is started to be downloaded when the song starts playing, it needs to be considered when the visual special effects data set is downloaded and the visual special effect is played. Remove the impact of download time on the timeline. Specifically, if the download of the visual effects data set is completed and the playback starts at time T after the song is played, the timeline of the visual effects will start from time T instead of starting from the beginning to synchronize with the timeline of the multimedia file. This requires the control host 10 to record the time when the multimedia file starts to play and the time when the visual effect data set is downloaded. The time difference between the two is the time T described above.

當每首多媒體檔一旦被添加至待播放清單裡時,控制主機10就可開始下載對應之視覺特效資料集。採用這種方式,只有播放清單裡之第一首多媒體檔之視覺特效資料集需要調整時間線,而後續所有歌曲之視覺特效資料集可為於其他歌曲播放之同時於後臺進行下載,因此,於要播放時其視覺特效資料集一般已經下載完成,視覺特效可與視頻、音訊同步播放,無須再調整時間線。Once each multimedia file is added to the to-be-played list, the control host 10 can begin downloading the corresponding visual effects data set. In this way, only the visual effects data set of the first multimedia file in the playlist needs to adjust the timeline, and the visual effects data set of all subsequent songs can be downloaded in the background while other songs are played, therefore, When you want to play, the visual effects data set has been downloaded, and the visual effects can be played synchronously with video and audio. There is no need to adjust the timeline.

可以理解,當歌曲暫停時,控制主機同步會將視覺特效也暫停。It can be understood that when the song is paused, the control panel synchronization will also pause the visual effects.

資訊傳輸模組130用於傳輸除視覺特效資料集外之一些附加資訊。具體地,資訊傳輸模組130可用於傳輸使用者之個性化消息。可以理解,要讓資訊傳輸模組130傳輸使用者之個性化資訊,就需要讓資訊傳輸模組130能夠知道當前之使用者之身份資訊。The information transmission module 130 is configured to transmit some additional information in addition to the visual effects data set. Specifically, the information transmission module 130 can be used to transmit personalized messages of the user. It can be understood that in order for the information transmission module 130 to transmit the personalized information of the user, the information transmission module 130 needs to know the identity information of the current user.

於一具體之實施方式中,控制主機10本身包括一登陸模組,用於讓使用者輸入用戶名與密碼以進行登陸操作後,控制主機10於接收到使用者輸入之用戶名與密碼後可將其上傳至雲端伺服器處進行登陸驗證,若登陸驗證透過,則於每次向雲端伺服器發送網路請求時,可將當前登陸使用者之身份資訊包括於網路請求中,從而資訊傳輸模組130就可根據控制主機10上傳之身份資訊傳輸使用者之個性化資訊。In a specific implementation manner, the control host 10 itself includes a login module for allowing the user to input a username and password for the login operation, and the control host 10 can receive the user name and password input by the user. Upload it to the cloud server for login verification. If the login verification is passed, the identity information of the currently logged-in user can be included in the network request every time a network request is sent to the cloud server, thereby transmitting the information. The module 130 can transmit the personalized information of the user according to the identity information uploaded by the control host 10.

於另一具體之實施方式中,控制主機10可並不直接傳輸使用者之身份資訊,而只是傳輸控制主機10自身之識別字。如此,就需要讓雲端伺服器能夠透過控制主機10自身之識別字唯一確定對應之用戶。亦即,如果控制主機10只上傳控制主機10自身之識別字,則需要預先建立控制主機10與當前使用者之綁定關係。In another specific implementation manner, the control host 10 may not directly transmit the identity information of the user, but only transmit the identification word of the control host 10 itself. In this way, it is necessary for the cloud server to uniquely determine the corresponding user by controlling the identity of the host 10 itself. That is, if the control host 10 uploads only the identification word of the control host 10 itself, it is necessary to establish a binding relationship between the control host 10 and the current user in advance.

例如,於控制主機10上、控制主機10所於之KTV房間內或者與控制主機10相連之電視機14之螢幕上設置有二維碼,該二維碼內可包括控制主機10之ID之加密字串。當使用者於某個特定應用程式中對該二維碼進行掃描後,由該應用程式向預定之網址發起網路請求,將應有程式當前使用者之識別符與該加密字串一併發送給伺服器24。伺服器24於接收到該網路請求後,解析出使用者識別資訊與主機ID後,建立兩者之間之綁定關係。相應地,資訊傳輸模組130可將該使用者之個性化資訊例如,頭像、姓名、使用者編輯之其他資訊傳輸給控制主機10。For example, a two-dimensional code is set on the control host 10, in the KTV room in which the control host 10 is located, or on the screen of the television set 14 connected to the control host 10. The QR code may include an encryption of the ID of the control host 10. String. After the user scans the QR code in a specific application, the application initiates a network request to the predetermined URL, and sends the identifier of the current user of the application to the encrypted string. Give server 24. After receiving the network request, the server 24 parses out the user identification information and the host ID, and establishes a binding relationship between the two. Correspondingly, the information transmission module 130 can transmit the personalized information of the user, for example, an avatar, a name, and other information edited by the user to the control host 10.

可以理解,要實現對當前多媒體視頻內容之替換,控制主機10需要知道於何時以及多媒體視頻主畫面之哪個位置進行替換操作。於一種實施方式中,控制主機10可進行人臉識別操作,當於所播放之多媒體視頻畫面中識別出人臉之時候,即可將人臉替換成當前用戶之人臉。It can be understood that to achieve replacement of the current multimedia video content, the control host 10 needs to know when and where at the multimedia video home screen the replacement operation is performed. In an embodiment, the control host 10 can perform a face recognition operation, and when the face is recognized in the played multimedia video screen, the face can be replaced with the current user's face.

於另一種方式中,視覺特效資料集中除視覺特效標籤外,還包括視頻替換特效標籤,所述視頻替換特效標籤包括時間設定資料、用在於多媒體視頻主畫面中定義出預定形狀之區域之形狀資料以及與所述形狀資料對應之類別資料。視頻替換特效標籤可預先確定。形狀資料定義出要進行視頻或者文字替換之區域,類別資料定義出某個區域要替換之資訊之類別,例如是替換成使用者圖像還是使用者姓名或者任意其他類別之使用者個性化資訊。根據這種方式,視覺特效資料集中除用於生成如上述實施方式中項所述之演唱視覺特效之視覺特效標籤外,還包括用於生成與時間線同步之視頻替換特效之視頻替換特效標籤。In another method, the visual effect data set includes a video replacement special effect label, and the video replacement special effect label includes time setting data, and the shape data of the area defined by the predetermined shape in the main screen of the multimedia video. And category information corresponding to the shape data. The video replacement effect label can be predetermined. The shape data defines an area to be replaced by video or text, and the category data defines a category of information to be replaced in a certain area, for example, a user personalized information that is replaced with a user image or a user name or any other category. In this manner, the visual effects data set includes a video replacement effect tag for generating a video replacement effect synchronized with the timeline in addition to the visual effect tag for generating the singing visual effect as described in the above embodiments.

從而控制主機10可於主畫面上或者LED陣列中顯示使用者之個性化資訊。例如,將主畫面中之頭像替換成使用者之頭像,或者將主畫面中之文字替換成用戶名。可以理解,為防止使用者資訊之洩漏,需要於使用者離開當前之用戶房間後實現使用者與控制主機10之解除綁定操作。Thus, the control host 10 can display the personalized information of the user on the main screen or in the LED array. For example, replace the avatar in the main screen with the avatar of the user, or replace the text in the main screen with the user name. It can be understood that in order to prevent leakage of user information, it is necessary to implement the unbinding operation between the user and the control host 10 after the user leaves the current user room.

於一種實施方式中,每當控制主機10重新開機時,會向伺服器24發送解除綁定請求,以解除所有與控制主機10之使用者綁定。這個方案是基於所有演唱視覺特效系統於不同使用者使用前要進行重啟實施。In one embodiment, whenever the control host 10 is rebooted, an unbinding request is sent to the server 24 to release all user bindings to the control host 10. This solution is based on the fact that all singing visual effects systems are restarted before they are used by different users.

於另一種實施方式中,控制主機10與使用者之綁定關係可由用戶使用綁定時所用之應用程式自行解除。因此,可避免使用者資訊洩露。In another embodiment, the binding relationship between the control host 10 and the user can be released by the user using the application used in the binding. Therefore, user information leakage can be avoided.

根據本實施方式之演唱視覺特效系統,視覺特效資料集存儲於雲端伺服器系統20中,可保證視覺特效資料集僅供授權之使用者訪問,提升視覺特效資料集之安全性。According to the singing visual special effect system of the embodiment, the visual special effect data set is stored in the cloud server system 20, which ensures that the visual special effect data set can be accessed only by the authorized user, and the security of the visual special effect data set is improved.

第五實施方式Fifth embodiment

參閱圖7,其為本發明第五實施方式提供之演唱視覺特效系統500之示意圖。本實施方式之演唱視覺特效系統500與圖5之演唱視覺特效系統400相似,其不同之處在於,還包括特效設備26。Referring to FIG. 7, which is a schematic diagram of a singing visual effect system 500 according to a fifth embodiment of the present invention. The singing visual effects system 500 of the present embodiment is similar to the singing visual effects system 400 of FIG. 5, except that it also includes a special effects device 26.

本實施方式中,視頻特效之處理並不是直接由控制主機10來實現,而是由專門設置之特效設備26實現。具體地,特效設備26根據特效資料生成相應之視訊訊號,並將特效視訊訊號疊加於主畫面上,或者輸出給LED陣列進行顯示。In the present embodiment, the processing of the video special effects is not directly implemented by the control host 10, but is implemented by the specially designed special effect device 26. Specifically, the special effect device 26 generates a corresponding video signal according to the special effect data, and superimposes the special effect video signal on the main screen, or outputs the image to the LED array for display.

特效設備26是具備燈光和/或視頻顯示功能,並具備特效處理功能之獨立電子設備,透過有線或無線方式與所述控制主機10相連。The special effect device 26 is a stand-alone electronic device having a lighting and/or video display function and having a special effect processing function, and is connected to the control host 10 by wire or wirelessly.

根據本實施方式之演唱視覺特效系統,視頻特效由專門設置之特效設備26實現,可降低控制主機10之複雜度。According to the singing visual special effect system of the present embodiment, the video special effect is realized by the specially designed special effect device 26, which can reduce the complexity of the control host 10.

第六實施方式Sixth embodiment

參閱圖8,其為本發明第五實施方式提供之演唱視覺特效系統600之示意圖。本實施方式之聲感視覺特效系統600與圖7所示之聲感特效系統500相似,其不同之處在於,還包括外部設備40。FIG. 8 is a schematic diagram of a singing visual effects system 600 according to a fifth embodiment of the present invention. The sound-sensing visual effects system 600 of the present embodiment is similar to the sound-sensing effect system 500 shown in FIG. 7, except that it also includes an external device 40.

本實施方式中,外部設備40例如為傳統之多媒體播放系統中之主機,其實現點歌以及歌曲之播放控制功能。但相比于傳統之多媒體播放系統,其進一步與控制主機10相連。每當外部設備40播放一首歌曲或者一首歌曲被添加至播放清單中時,外部設備40會將歌曲之標識發送給控制主機10。In this embodiment, the external device 40 is, for example, a host in a conventional multimedia playing system, which implements a song control function of a song and a song. However, it is further connected to the control host 10 than the conventional multimedia playback system. Whenever the external device 40 plays a song or a song is added to the playlist, the external device 40 transmits the identification of the song to the control host 10.

可以理解,為讓外部設備40可向控制主機10發送特定之資訊,可於控制主機10中公開特定應用程式設計發展介面(API),從而可讓外部設備40進行調用,以向控制主機10發送上述之資訊。每當外部設備40播放一首歌曲時外部設備40可將歌曲之標識以及開始播放之時間透過上述之API提交給控制主機10。當然,外部設備40要實現API之調用,需要對現有外部設備40中之程式稍做修改,使得於需要時透過API與控制主機10同步資訊。It can be understood that in order for the external device 40 to send specific information to the control host 10, a specific application design development interface (API) can be disclosed in the control host 10, so that the external device 40 can be called to send to the control host 10. The above information. Whenever the external device 40 plays a song, the external device 40 can submit the identification of the song and the time when the playback starts to the control host 10 through the API described above. Of course, in order to implement the API call, the external device 40 needs to modify the program in the existing external device 40 so that the information is synchronized with the control host 10 through the API when needed.

相應地,控制主機10根據歌曲之標識向雲端伺服器系統20請求獲取視覺特效資料集。可以理解,控制主機10還可如前述實施方式中項所述之步驟進行身份驗證操作。於獲取到視覺特效資料集後,控制主機10根據視覺特效資料集中之視覺特效標籤,生成相應之視頻特效訊號,並將生成之視覺特效訊號發送給特效設備26。當然,考慮到網路下載之延時,控制主機10還可進行視覺特效之時間調整,即給時間設定資料所定義之時間施加一前向之偏移量,使得視覺特效之時間線與檔播放之進度同步。Correspondingly, the control host 10 requests the cloud server system 20 to acquire the visual effect data set according to the identifier of the song. It will be appreciated that the control host 10 can also perform authentication operations as described in the previous embodiments. After obtaining the visual special effects data set, the control host 10 generates a corresponding video special effect signal according to the visual special effect label in the visual special effect data set, and sends the generated visual special effect signal to the special effect device 26. Of course, considering the delay of the network download, the control host 10 can also perform the time adjustment of the visual effects, that is, apply a forward offset to the time defined by the time setting data, so that the timeline and the file of the visual effects are played. The progress is synchronized.

特效設備26將視覺特效訊號疊加於多媒體視頻輸出設備14之主畫面上和/或輸出至視覺特效輸出裝置11中。The effect device 26 superimposes the visual effect signal on the main screen of the multimedia video output device 14 and/or outputs it to the visual effect output device 11.

根據本實施方式之演唱視覺特效系統,透過對現有多媒體播放系統中之外部設備40之軟體稍加改進,就可加入與歌曲同步之視覺特效,可最大程度之相容現有多媒體播放系統中之設備,避免設備升級帶來之成本增加。According to the singing visual special effect system of the present embodiment, by slightly improving the software of the external device 40 in the existing multimedia playing system, the visual effect synchronized with the song can be added, and the device in the existing multimedia playing system can be compatible to the greatest extent. To avoid the cost increase caused by equipment upgrades.

以上實施方式雖然是以KTV系統為例進行說明,然而上述之演唱視覺特效系統還可應用於多媒體教室、舞廳和公園娛樂設施。Although the above embodiment is described by taking the KTV system as an example, the above-described singing visual effects system can also be applied to multimedia classrooms, dance halls, and park entertainment facilities.

特別之,當控制主機10是一智慧電子設備(如智慧手機)時,安裝於所述智慧電子設備中之軟體,可透過無線控制視覺特效輸出裝置11,也可透過無線訪問網路上之視覺特效資料集,同時,透過內置麥克風錄取透過外部設備40播放出來之歌曲聲音,再透過特徵採樣及特徵匹配,直接識別出外部設備40所放之歌曲,從而無需與外部設備40通信就能夠獲得歌曲之標識,然後下載對應之視覺特效資料集,與歌曲同步播放視覺特效。In particular, when the control host 10 is a smart electronic device (such as a smart phone), the software installed in the smart electronic device can wirelessly control the visual effect output device 11 or wirelessly access the visual effects on the network. At the same time, the songs played through the external device 40 are recorded through the built-in microphone, and the songs placed by the external device 40 are directly recognized through feature sampling and feature matching, so that the songs can be obtained without communication with the external device 40. Identify and then download the corresponding visual effects data set to play visual effects in sync with the song.

第七實施方式Seventh embodiment

參閱圖9,其為本發明第七實施方式提供之獲取視覺特效資料集之方法流程圖。如圖9所示,本實施之方法包括以下步驟:Referring to FIG. 9, which is a flowchart of a method for obtaining a visual effect data set according to a seventh embodiment of the present invention. As shown in FIG. 9, the method of the present implementation includes the following steps:

步驟S101,播放多媒體檔;Step S101, playing a multimedia file;

多媒體檔例如可由控制主機10播放,或者由外部40進行播放。The multimedia file can be played, for example, by the control host 10 or by the external 40.

步驟S102,獲取與所述多媒體檔對應之視覺特效資料集。Step S102: Acquire a visual special effects data set corresponding to the multimedia file.

視覺特效資料集例如可包括上述之視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料。當然,無論視覺特效資料集之內容為何,其獲取過程是相似。The visual effects data set may include, for example, the above-mentioned visual special effects labels, and each visual special effects label includes time setting materials and special effect setting materials. Of course, regardless of the content of the visual effects data set, the acquisition process is similar.

具體地,步驟S102可包括:步驟S1022,從所述多媒體檔內解析出內嵌於所述多媒體檔內之所述視覺特效資料集。Specifically, step S102 may include: step S1022, parsing, from the multimedia file, the visual special effect data set embedded in the multimedia file.

根據這種方式,視覺特效資料集是內嵌於多媒體檔內,可與多媒體檔一併保存,降低系統之複雜性。According to this method, the visual effects data set is embedded in the multimedia file and can be saved together with the multimedia file to reduce the complexity of the system.

另外,步驟S102還可包括:步驟S1024,從雲端伺服器處下載視覺特效資料集。In addition, step S102 may further include: step S1024, downloading the visual special effects data set from the cloud server.

進一步參閱圖10,步驟S1024具體可包括以下步驟:With further reference to FIG. 10, step S1024 may specifically include the following steps:

步驟S201,將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統統驗證是否具有獲取視覺特效資料集之許可權;Step S201: Send identity authentication information to the cloud server system, so that the cloud server system can verify whether the permission to obtain the visual special effect data set is obtained;

步驟S202,根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之視覺特效資料集之請求;以及Step S202, sending, according to the identifier of the multimedia file, a request for acquiring the corresponding visual special effect data set to the cloud server system;

步驟S203,接收所述雲端伺服器系統返回之所述視覺特效資料集;Step S203, receiving the visual special effect data set returned by the cloud server system;

根據這種方式,視覺特效資料集存儲於雲端伺服器系統20中,可保證只有授權之使用者才能夠訪問視覺特效資料集,提升視覺特效資料集之安全性。In this way, the visual effects data set is stored in the cloud server system 20, which ensures that only authorized users can access the visual effects data set and improve the security of the visual effects data set.

根據本實施方式之方法,於播放多媒體檔時,還獲取與多媒體檔對應之視覺特效資料集,所述視覺特效資料集可用於與傾斜度數據一起生成與多媒體檔同播放之視覺特效訊號,進而可同步輸出視覺特效。According to the method of the embodiment, when the multimedia file is played, a visual special effect data set corresponding to the multimedia file is further acquired, and the visual special effect data set can be used to generate a visual special effect signal that is played together with the multimedia file together with the inclination data, and further Visual effects can be output simultaneously.

第八實施方式Eighth embodiment

參閱圖11,其為本發明第七實施方式提供之獲取視覺特效資料集之方法流程圖。如圖11所示,本實施之方法與圖9之方法相似,其不同之處在於,於步驟S102之後還包括以下步驟:Referring to FIG. 11 , it is a flowchart of a method for obtaining a visual effect data set according to a seventh embodiment of the present invention. As shown in FIG. 11, the method of the present embodiment is similar to the method of FIG. 9 except that after step S102, the following steps are further included:

步驟S103,接收使用者輸入之切換視覺特效版本之訊號。Step S103, receiving a signal input by the user to switch the visual effect version.

於步驟S103之後,重新執行步驟S102,亦即,重新獲取與多媒體檔對應之視覺特效資料集。但值得注意,此時與多媒體檔對應之視覺特效資料集已經發生變化,獲取得是使用者所選擇版本之視覺特效資料集。After step S103, step S102 is re-executed, that is, the visual effect data set corresponding to the multimedia file is re-acquired. However, it is worth noting that the visual effects data set corresponding to the multimedia file has changed at this time, and the visual special effect data set of the version selected by the user is obtained.

可以理解,於切換視覺特效之版本後,可繼續從當前時間同步輸出視覺特效。It can be understood that after switching the version of the visual effect, the visual effect can be continuously outputted from the current time.

此外,可以理解,步驟S103並不限在於步驟S102之後執行,例如,於步驟S102之前,還可執行步驟S103,即於開始播放多媒體檔時,可讓使用者首先選擇視覺特效之版本,於使用者選擇版本後,步驟S102中獲取之就是使用者選擇版本之視覺特效資料集。In addition, it can be understood that step S103 is not limited to be performed after step S102. For example, before step S102, step S103 may also be performed, that is, when the multimedia file is started to be played, the user may first select the version of the visual special effect for use. After selecting the version, the step S102 obtains the visual effect data set of the user selected version.

根據本實施方式之技術方案,視覺特效具有多個不同之版本,從而可提供更加豐富之視覺特效。According to the technical solution of the embodiment, the visual effects have a plurality of different versions, thereby providing a richer visual effect.

第九實施方式Ninth embodiment

參閱圖12,其為本發明第八實施方式提供之於視覺特效中替換使用者之個性化資訊之流程圖。如圖12所示,本實施方式之方法包括以下步驟:Referring to FIG. 12, it is a flowchart of replacing personalized information of a user in a visual effect according to an eighth embodiment of the present invention. As shown in FIG. 12, the method of this embodiment includes the following steps:

步驟S301,將使用者之身份資訊或者用於確認使用者身份之資訊發送給雲端伺服器系統。In step S301, the identity information of the user or the information for confirming the identity of the user is sent to the cloud server system.

例如,控制主機10可讓使用者輸入用戶名與密碼進行登陸,如此,於透過登陸驗證後,控制主機10即可將使用者之身份資訊與請求獲取視覺特效資料集之網路請求一併發送給雲端伺服器系統。控制主機10還可為僅將其自身之識別字發送給雲端伺服器系統。此時,需要使用者透過其他終端(如手機)向雲端伺服器系統發起綁定請求,以建立該終端之當前使用者與控制主機10之間之綁定關係,如此,透過控制主機10之識別字也可唯一確定對應之用戶。For example, the control host 10 allows the user to enter a username and password to log in. Thus, after verifying through the login, the control host 10 can send the identity information of the user together with the network request requesting the visual effect data set. Give the cloud server system. Control host 10 may also send its own identification only to the cloud server system. At this time, the user needs to initiate a binding request to the cloud server system through another terminal (such as a mobile phone) to establish a binding relationship between the current user of the terminal and the control host 10, and thus, the identification by the control host 10 is performed. The word can also uniquely identify the corresponding user.

步驟S302,接收所述雲端伺服器系統發送之使用者個性化資訊。Step S302: Receive user personalized information sent by the cloud server system.

所述視覺特效資料集中還包括與時間設定資料對應之視頻替換特效標籤,所述視頻替換特效標籤包括時間設定資料、用在於多媒體視頻主畫面中定義出預定形狀之區域之形狀資料以及與所述形狀資料對應之類別資料。The visual effect data set further includes a video replacement special effect label corresponding to the time setting data, where the video replacement special effect label includes a time setting data, a shape data of an area defined by a predetermined shape in the main screen of the multimedia video, and the The category data corresponding to the shape data.

步驟S303,將所述預定形狀之區域內之內容替換為與所述類別資料對應之使用者個性化資訊。Step S303, replacing the content in the area of the predetermined shape with the user personalized information corresponding to the category data.

根據本實施方式之技術方案,可將多媒體檔中之特定內容替換成使用者之個性化資訊,而此種替換操作也可為與時間線同步。According to the technical solution of the embodiment, the specific content in the multimedia file can be replaced with the personalized information of the user, and the replacement operation can also be synchronized with the timeline.

第十實施方式Tenth embodiment

參閱圖13,其為本發明第十實施方式提供之演唱視覺特效處理方法之流程圖。如圖13所示,本實施方式之方法包括以下步驟:Referring to FIG. 13 , it is a flowchart of a method for processing a singing visual effect provided by a tenth embodiment of the present invention. As shown in FIG. 13, the method of this embodiment includes the following steps:

步驟S401,透過手持傾斜感測元件即時感測並發送手持電子裝置之傾斜度數據;Step S401: Instantly sensing and transmitting the inclination data of the handheld electronic device through the handheld tilt sensing component;

步驟S402,於播放多媒體檔時,或於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之視覺特效資料集,所述視覺特效資料集內包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料;Step S402, when the multimedia file is played, or when the multimedia file is played by the external device, the visual special effect data set corresponding to the multimedia file is acquired, where the visual special effect data set includes multiple visual special effects labels, and each visual special effect label Including time setting data and special effect setting materials;

步驟S403,同步從所述視覺特效資料集中獲取與當前時間匹配之視覺特效標籤;Step S403, synchronizing obtaining a visual special effect label matching the current time from the visual special effects data set;

步驟S404,根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號; 以及Step S404, generating a special effect parameter according to the inclination data, and jointly generating a visual special effect signal synchronized with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect tag;

步驟S405,根據所述視覺特效訊號同步輸出視覺特效。Step S405, synchronously outputting visual effects according to the visual effect signal.

本實施方式之技術方案之有益效果是:可利用手持傾斜感測元件之傾斜度數據即時調整當前之視覺特效,為演唱者提供自然方便之即時控制功能,而且由於傾斜度之連續變化特性,使得視覺特效也可連續之平滑之進行調節。The technical solution of the embodiment has the beneficial effects that the current visual effect can be instantly adjusted by using the tilt data of the hand-held tilt sensing component, providing the singer with a natural and convenient instant control function, and due to the continuous change characteristic of the inclination, Visual effects can also be adjusted continuously and smoothly.

此外,本發明實施方式還提供一種電腦可讀存儲介質,其內存儲有電腦可執行指令,上述電腦可讀存儲介質例如為非易失性記憶體例如光碟、硬碟、或者快閃記憶體。上述電腦可執行指令用於讓電腦或者類似之運算裝置完成上述實施方式中之方法。In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, such as a non-volatile memory such as a compact disk, a hard disk, or a flash memory. The computer executable instructions are for causing a computer or similar computing device to perform the method of the above embodiments.

以上所述,僅是本發明之較佳實施方式而已,並非對本發明作任何形式上之限制,雖然本發明已以較佳實施方式揭示如上,然而並非用以限定本發明,任何本領域技術人員,於不脫離本發明技術方案範圍內,當可利用上述揭示之技術內容做出些許更動或修飾為等同變化之等效實施方式,但凡是未脫離本發明技術方案內容,依據本發明之技術實質對以上實施方式所作之任何簡介修改、等同變化與修飾,均仍屬於本發明技術方案之範圍內。The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The present invention has been disclosed in the preferred embodiments, but is not intended to limit the invention, and any person skilled in the art. The equivalents of the technical solutions disclosed above may be modified or modified to equivalent variations, without departing from the technical scope of the present invention, in accordance with the technical essence of the present invention. Any of the above-described modifications, equivalent changes and modifications of the above embodiments are still within the scope of the technical solutions of the present invention.

100、200、300、400、500、600‧‧‧演唱視覺特效系統
10‧‧‧控制主機
11‧‧‧視覺特效輸出裝置
12‧‧‧音訊輸出裝置
13‧‧‧點歌面板
14‧‧‧多媒體視頻輸出設備
15‧‧‧手持傾斜感測組件
20‧‧‧雲端伺服器系統
22‧‧‧資料庫
24‧‧‧伺服器
26‧‧‧特效設備
40‧‧‧外部設備
101‧‧‧麥克風
112‧‧‧演唱者
102‧‧‧記憶體
104‧‧‧存儲控制器
106‧‧‧處理器
108‧‧‧外設介面
110‧‧‧網路模組
122‧‧‧作業系統
124‧‧‧視覺特效服務模組
126‧‧‧身份校驗模組
128‧‧‧特效傳輸模組
130‧‧‧資訊傳輸模組
100, 200, 300, 400, 500, 600‧‧‧Singing visual effects system
10‧‧‧Control host
11‧‧‧Visual effects output device
12‧‧‧Operation output device
13‧‧‧Voice panel
14‧‧‧Multimedia video output equipment
15‧‧‧Handheld tilt sensing assembly
20‧‧‧Cloud Server System
22‧‧‧Database
24‧‧‧Server
26‧‧‧ Special effects equipment
40‧‧‧External equipment
101‧‧‧ microphone
112‧‧‧Singer
102‧‧‧ memory
104‧‧‧Storage Controller
106‧‧‧ Processor
108‧‧‧ peripheral interface
110‧‧‧Network Module
122‧‧‧Operating system
124‧‧‧Visual Effects Service Module
126‧‧‧identity verification module
128‧‧‧Special effect transmission module
130‧‧‧Information Transmission Module

[圖1]係本發明第一實施方式提供之演唱視覺特效系統之架構示意圖; [圖2]係本發明第二實施方式提供之演唱視覺特效系統之架構示意圖; [圖3]係第二實施方式提供之演唱視覺特效系統進行視覺特效版本切換之示意圖; [圖4]係本發明第三實施方式提供之演唱視覺特效系統之架構示意圖; [圖5]係本發明第四實施方式提供之演唱視覺特效系統之架構示意圖; [圖6]係第四實施方式之演唱視覺特效系統中雲端伺服器之模組圖; [圖7]係本發明第五實施方式提供之演唱視覺特效系統之架構示意圖; [圖8]係本發明第六實施方式提供之演唱視覺特效系統之架構示意圖; [圖9]係本發明第七實施方式提供之獲取視覺特效資料集之方法之流程圖; [圖10]係圖9之方法中部分步驟之流程圖; [圖11]係本發明第八實施方式提供之獲取視覺特效資料集之方法之流程圖;[圖12]係本發明第九實施例提供的於視覺特效中替換使用者個性化資訊的流程圖; [圖13]係本發明第十實施例提供之演唱視覺特效處理方法的流程圖。1 is a schematic structural diagram of a singing visual effect system provided by a first embodiment of the present invention; [FIG. 2] is a schematic structural diagram of a singing visual special effects system provided by a second embodiment of the present invention; [FIG. 3] is a second implementation FIG. 4 is a schematic structural diagram of a singing visual effect system provided by a third embodiment of the present invention; FIG. 5 is a schematic diagram of a fourth embodiment of the present invention. Schematic diagram of the visual effect system; [Fig. 6] is a block diagram of the cloud server in the singing visual effect system of the fourth embodiment; [Fig. 7] is a schematic diagram of the structure of the singing visual effect system provided by the fifth embodiment of the present invention FIG. 8 is a schematic structural diagram of a singing visual effect system provided by a sixth embodiment of the present invention; FIG. 9 is a flowchart of a method for acquiring a visual special effects data set provided by a seventh embodiment of the present invention; [FIG. 10] A flowchart of some steps in the method of FIG. 9; [FIG. 11] is a visual effect provided by the eighth embodiment of the present invention. A flowchart of a method for collecting a set of materials; [FIG. 12] is a flowchart for replacing user personalized information in a visual effect provided by a ninth embodiment of the present invention; [FIG. 13] is a singing visual provided by a tenth embodiment of the present invention. Flow chart of the special effect processing method.

100‧‧‧演唱視覺特效系統 100‧‧‧Singing visual effects system

10‧‧‧控制主機 10‧‧‧Control host

11‧‧‧視覺特效輸出裝置 11‧‧‧Visual effects output device

15‧‧‧手持傾斜感測組件 15‧‧‧Handheld tilt sensing assembly

101‧‧‧麥克風 101‧‧‧ microphone

112‧‧‧演唱者 112‧‧‧Singer

Claims (10)

一種演唱視覺特效系統,其中,包括:手持傾斜感測元件、控制主機及視覺特效輸出裝置; 所述手持傾斜感測組件內置感測器,感測所述手持傾斜感測組件之傾斜度數據,並將所述傾斜度數據即時發送給所述控制主機; 所述控制主機於播放多媒體檔時,或於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之視覺特效資料集,所述視覺特效資料集內包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料,所述控制主機同步從所述視覺特效資料集中獲取與當前時間匹配之視覺特效標籤,根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號; 所述視覺特效輸出裝置根據所述控制主機之視覺特效訊號輸出視覺特效。A singing visual special effect system, comprising: a handheld tilt sensing component, a control host and a visual effect output device; the handheld tilt sensing component has a built-in sensor, and senses the tilt data of the handheld tilt sensing component, And sending the tilt data to the control host in an instant; the control host acquires a visual special effect data set corresponding to the multimedia file when playing the multimedia file or when the external device plays the multimedia file, the visual The special effect data set includes a plurality of visual special effects tags, each of the visual special effects tags includes time setting materials and special effect setting materials, and the control host synchronizes obtaining visual special effect tags matching the current time from the visual special effects data set, according to the The tilting data generates a special effect parameter, and jointly generates a visual special effect signal synchronously played with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect label; the visual special effect output device is configured according to the control host The visual effects signal outputs visual effects. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述視覺特效輸出裝置為多媒體視頻輸出設備,所述系統還包括視覺特效疊加設備,分別與所述控制主機及所述多媒體視頻輸出設備相連,所述視覺特效疊加設備用於: 將所述視覺特效訊號疊加於所述多媒體檔之多媒體視頻主畫面上,並將疊加後之視訊訊號傳輸給所述多媒體視頻輸出設備輸出。The vocal visual effects system of claim 1, wherein the visual effect output device is a multimedia video output device, the system further comprising a visual special effect superimposing device, respectively, and the control host and the multimedia video The output device is connected, and the visual special effect superimposing device is configured to: superimpose the visual special effect signal on the multimedia video main screen of the multimedia file, and transmit the superimposed video signal to the multimedia video output device output. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述控制主機獲取與所述多媒體檔對應之視覺特效資料集包括: 所述控制主機根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之視覺特效資料集之請求;以及 接收所述雲端伺服器系統返回之所述視覺特效資料集。The vocal visual effects system of claim 1, wherein the controlling host acquires a visual effect data set corresponding to the multimedia file, comprising: the control host according to the identifier of the multimedia file to a cloud server The system sends a request for obtaining the corresponding visual effect data set; and receiving the visual special effects data set returned by the cloud server system. 如申請專利範圍第3項所述之演唱視覺特效系統,其中,所述控制主機獲取與所述多媒體檔對應之視覺特效資料集還包括: 所述控制主機將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統統驗證所述控制主機是否具有獲取視覺特效資料集之許可權; 所述雲端伺服器系統於所述控制主機具有獲取視覺特效資料集之許可權時才返回所述控制主機請求之視覺特效資料集。The vocal visual effects system of claim 3, wherein the controlling host acquires the visual special effects data set corresponding to the multimedia file, further comprising: the control host transmitting the identity authentication information to the cloud server a system for causing the cloud server system to verify whether the control host has permission to acquire a visual effects data set; the cloud server system only when the control host has permission to acquire a visual effects data set Returns a set of visual effects data requested by the control host. 如申請專利範圍第3項所述之演唱視覺特效系統,其中,還包括與所述控制主機相連之外部設備; 所述外部設備於播放多媒體檔時或者多媒體檔被加入播放清單時將對應之多媒體檔之標識發送給所述控制主機; 所述控制主機於接收到所述多媒體檔之標識後向雲端伺服器系統發送獲取所述對應之視覺特效資料集之請求。The singing visual special effects system of claim 3, further comprising: an external device connected to the control host; the external device is corresponding to multimedia when the multimedia file is played or the multimedia file is added to the playlist. The identifier of the file is sent to the control host; after receiving the identifier of the multimedia file, the control host sends a request for acquiring the corresponding visual special effects data set to the cloud server system. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號包括: 根據所述傾斜度數據計算傾斜度於三個方向上之分量,並按照預先設定之規則改變當前視覺特效訊號內紅、綠、藍三原色之比例。The singing visual special effect system of claim 1, wherein the control host generates a special effect parameter according to the inclination data, and according to the special effect parameter and the special effect setting data of the matched visual special effect label, Generating a visual effect signal synchronized with the multimedia file includes: calculating a component of the inclination in three directions according to the inclination data, and changing three primary colors of red, green, and blue in the current visual special effect signal according to a preset rule. proportion. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成視與所述多媒體檔同步播放之覺特效訊號包括: 根據所述傾斜度數據計算所述視覺特效訊號之特效參數,所述特效參數包括燈光亮度、顏色值、顏色比例、動畫中變換速度或角度、圖形之分佈密度、對比度、特效面積大小其中之一種或多種。The singing visual special effect system of claim 1, wherein the control host generates a special effect parameter according to the inclination data, and according to the special effect parameter and the special effect setting data of the matched visual special effect label, Generating a special effect signal that is synchronously played with the multimedia file includes: calculating a special effect parameter of the visual special effect signal according to the inclination data, where the special effect parameter includes a light brightness, a color value, a color ratio, a transformation speed in the animation, or One or more of the angle, the distribution density of the graphic, the contrast, and the size of the special effect. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述控制主機根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號包括: 採用一連續函數由所述傾斜度數據計算所述視覺特效訊號之變化參數,使得所述變化參數隨著所述手持傾斜組件傾斜角度之變化而連續變化。The singing visual special effect system of claim 1, wherein the control host generates a special effect parameter according to the inclination data, and according to the special effect parameter and the special effect setting data of the matched visual special effect label, Generating a visual effect signal synchronized with the multimedia file includes: calculating a change parameter of the visual effect signal from the tilt data by using a continuous function, such that the change parameter changes with a tilt angle of the handheld tilt component And continuous changes. 如申請專利範圍第1項所述之演唱視覺特效系統,其中,所述視覺特效資料集內還包括傾斜回應設定標籤,所述傾斜回應設定標籤設定某個時間段內視覺特效訊號之特效參數隨著傾斜度變化而變化之方式,於不同之時間段內,傾斜度數據可作為不同之特效參數對視覺特效訊號進行調整。The sing-along visual effects system of claim 1, wherein the visual effect data set further includes a tilt response setting label, and the tilt response setting label sets a special effect parameter of the visual special effect signal in a certain period of time. In the way that the inclination changes and changes, the inclination data can be adjusted as visual effects signals in different special effects parameters in different time periods. 一種演唱視覺特效處理方法,包括: 透過手持傾斜感測元件即時感測並發送手持電子裝置之傾斜度數據; 於播放多媒體檔時,或於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之視覺特效資料集,所述視覺特效資料集內包括多個視覺特效標籤,每個視覺特效標籤包括時間設定資料以及特效設定資料; 同步從所述視覺特效資料集中獲取與當前時間匹配之視覺特效標籤; 根據所述傾斜度數據生成特效參數,並根據所述特效參數以及所述匹配之視覺特效標籤之特效設定資料共同生成與所述多媒體檔同步播放之視覺特效訊號; 以及 根據所述視覺特效訊號同步輸出視覺特效。A method for processing a visual effect, comprising: sensing and transmitting the tilt data of the handheld electronic device through the handheld tilt sensing component; acquiring the multimedia file when playing the multimedia file, or acquiring the multimedia file when the external device plays the multimedia file The visual special effects data set includes a plurality of visual special effects tags, each of the visual special effects tags includes time setting materials and special effect setting materials; and synchronizing from the visual special effects data sets to obtain visual effects matching the current time Generating a special effect parameter according to the inclination data, and jointly generating a visual special effect signal synchronized with the multimedia file according to the special effect parameter and the special effect setting data of the matched visual special effect label; and according to the visual special effect Signal sync output visual effects.
TW104107127A 2015-01-27 2015-03-06 Singing visual effect system and method for processing singing visual effect TW201627987A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510043565.2A CN104580838A (en) 2015-01-27 2015-01-27 Singing visual special effects system and singing visual special effects processing method

Publications (1)

Publication Number Publication Date
TW201627987A true TW201627987A (en) 2016-08-01

Family

ID=53095947

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104107127A TW201627987A (en) 2015-01-27 2015-03-06 Singing visual effect system and method for processing singing visual effect

Country Status (2)

Country Link
CN (1) CN104580838A (en)
TW (1) TW201627987A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI746149B (en) * 2020-09-04 2021-11-11 宏碁股份有限公司 Smart speaker, smart speaker operating system and method for displaying dot matrix pattern on schedule

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11488569B2 (en) 2015-06-03 2022-11-01 Smule, Inc. Audio-visual effects system for augmentation of captured performance based on content thereof
WO2019040492A1 (en) * 2017-08-21 2019-02-28 Smule, Inc. Audio-visual effects system for augmentation of captured performance based on content thereof
CN108648284A (en) * 2018-04-10 2018-10-12 光锐恒宇(北京)科技有限公司 A kind of method and apparatus of video processing
CN108989871B (en) * 2018-06-27 2021-09-17 广州视源电子科技股份有限公司 Parameter adjusting method and device, readable storage medium and video playing equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3577777B2 (en) * 1995-04-25 2004-10-13 ヤマハ株式会社 Karaoke equipment
CN101697277B (en) * 2009-10-23 2013-01-30 罗富强 Method, device and system for realizing multifunction of intelligent wireless microphone
CN103985379A (en) * 2014-05-04 2014-08-13 苏州乐聚一堂电子科技有限公司 Karaoke mobile phone VOD system with special light effect

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI746149B (en) * 2020-09-04 2021-11-11 宏碁股份有限公司 Smart speaker, smart speaker operating system and method for displaying dot matrix pattern on schedule

Also Published As

Publication number Publication date
CN104580838A (en) 2015-04-29

Similar Documents

Publication Publication Date Title
TWI574256B (en) Interactive beat effect system and method for processing interactive beat effect
TW201627988A (en) Synchronous visual effect system and method for processing synchronous visual effect
CN105451413B (en) Lamp light control method, apparatus and system
US8391671B2 (en) Information processing device and method, recording medium, and program
TW201627987A (en) Singing visual effect system and method for processing singing visual effect
TWI555013B (en) Sound visual effect system and method for processing sound visual effect
WO2021249318A1 (en) Screen projection method and terminal
WO2022135527A1 (en) Video recording method and electronic device
CN104320735A (en) Sound box internally provided with projection module and projection curtain
TWI545452B (en) Accompaniment visual effect system and method for processing accompaniment visual effect
CN112073761B (en) Bluetooth function realization method and device and dual-hardware system display equipment
TWI559299B (en) Singing visual effect system and method for processing singiing visual effect
CN109873905A (en) Audio frequency playing method, audio synthetic method, device and storage medium
TWI585614B (en) Composite beat effect system and method for processing composite beat effect
TW201627982A (en) Pressure sensitive visual effect system and method for processing pressure sensitive visual effect
WO2019114582A1 (en) Video image processing method and computer storage medium and terminal
CN104822094A (en) Polyrhythm special-effect system and polyrhythm special-effect processing method
US10951951B2 (en) Haptics metadata in a spectating stream
JP6601615B2 (en) Movie processing system, movie processing program, and portable terminal
KR102588620B1 (en) A light stick control system including a light stick control message transmitter, a light stick control message transmitter, and a light stick control method using a light stick control message transmitter
CN113691841B (en) Singing label adding method, rapid audition method and display device
WO2023045687A1 (en) Screen projection method, device and system
JP2009088627A (en) Viewing and listening device, parameter management means, viewing and listening system
TW201619953A (en) Composite beat effect system and method for processing composite beat effect
CN114390048A (en) Cloud VR screen projection system and method