TW201535358A - Interactive beat effect system and method for processing interactive beat effect - Google Patents

Interactive beat effect system and method for processing interactive beat effect Download PDF

Info

Publication number
TW201535358A
TW201535358A TW104106115A TW104106115A TW201535358A TW 201535358 A TW201535358 A TW 201535358A TW 104106115 A TW104106115 A TW 104106115A TW 104106115 A TW104106115 A TW 104106115A TW 201535358 A TW201535358 A TW 201535358A
Authority
TW
Taiwan
Prior art keywords
beat
special effect
effect
prompt
signal
Prior art date
Application number
TW104106115A
Other languages
Chinese (zh)
Other versions
TWI574256B (en
Inventor
jun-feng Hu
Original Assignee
Partyok Suzhou Digital Technology Ltd Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Partyok Suzhou Digital Technology Ltd Corp filed Critical Partyok Suzhou Digital Technology Ltd Corp
Publication of TW201535358A publication Critical patent/TW201535358A/en
Application granted granted Critical
Publication of TWI574256B publication Critical patent/TWI574256B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25816Management of client data involving client authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof

Abstract

The present invention relates to an interactive beat effect system and a method for processing interactive beat effect. The system includes a controller, a beat sensing device and a beat effect outputting device. The controller obtains beat effect data collection corresponding to a multimedia file when playing the multimedia file. The beat effect data collection includes a number of beat effect tags, and each tag defines time configuration data. The controller obtains a matched beat effect tag from the beat effect data collection according to the current time and produces a corresponding tip signal. The beat effect outputting device outputs the tip signal to hint a user to do a beat motion. The beat sensing device produces a beat triggering signal after sensing the user's beat motion. If the controller receives a timely beat motion then the controller produces a corresponding beat effect signal. The beat effect outputting device outputs the beat effect signal. The beat effect system and method provides the interactive experience in the KTV room.

Description

互動節拍特效系統及互動節拍特效處理方法Interactive beat special effects system and interactive beat special effects processing method

本發明涉及多媒體特效技術領域,特別涉及一種互動節拍特效系統及一種互動節拍特效處理方法。The invention relates to the field of multimedia special effects technology, in particular to an interactive beat special effect system and an interactive beat special effect processing method.

卡拉OK係一種多媒體伴奏演唱系統,演唱者可以於預先錄製之音樂伴奏下參與歌唱。卡拉OK能透過聲音處理使演唱者之聲音得到美化與潤飾,當再與音樂伴奏有機結合時,就變成渾然一體之身歷聲歌曲。這種伴奏方式,給歌唱愛好者們帶來極大方便和愉悅,成為人們休閒娛樂之一種方式,而現於多稱為KTV。Karaoke is a multimedia accompaniment system where singers can participate in singing with pre-recorded music. Karaoke can beautify and refine the voice of the singer through sound processing. When combined with music accompaniment, it becomes a sound song of the same body. This accompaniment method brings great convenience and pleasure to the singing enthusiasts, and becomes a way for people to entertain and entertainment, and is now called KTV.

普通KTV系統中,使用者之歌聲和伴奏音樂可以混合於一起播放,但用戶無法改變包房內燈光特效以及視頻特效。亦即,現有KTV系統之互動性很弱。In a normal KTV system, the user's singing and accompaniment music can be mixed and played together, but the user cannot change the lighting effects and video effects in the private room. That is, the interaction of the existing KTV system is very weak.

有鑑於此,有必要提供一種互動節拍特效系統及一種互動節拍特效處理方法,其能提供豐富之節拍特效,特別是鼓勵並引導用戶做出節拍動作。In view of this, it is necessary to provide an interactive beat special effect system and an interactive beat special effect processing method, which can provide rich beat special effects, especially to encourage and guide the user to make a beat action.

本發明實施方式提供一種互動節拍特效系統,其包括:控制主機、節拍感應裝置及特效輸出設備; 所述控制主機於播放多媒體檔時獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點; 所述控制主機同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點生成提示特效訊號; 所述特效輸出設備輸出所述提示特效訊號以提示使用者及時做出節拍動作; 所述節拍感應裝置感應到使用者回應於所述提示特效訊號所做出之節拍動作後生成節拍觸發訊號; 如果所述控制主機及時接收到正確之節拍觸發訊號,則生成節拍特效訊號; 所述特效輸出設備還輸出所述節拍特效訊號。An embodiment of the present invention provides an interactive beat special effect system, including: a control host, a beat sensing device, and a special effect output device; the control host acquires a beat special effect data set corresponding to the multimedia file when the multimedia file is played, the beat The special effect data set includes a plurality of beat effect labels, each beat special effect label includes a time node; the control host synchronizes the corresponding beat special effect label from the beat special effect data set, and generates a prompt special effect signal at the time node; The output device outputs the prompt effect signal to prompt the user to make a beat action in time; the beat sensing device senses a beat trigger signal generated by the user in response to the prompt effect signal; if the control The host receives the correct beat trigger signal in time to generate a beat special effect signal; the special effect output device also outputs the beat special effect signal.

於一實施方式中,所述節拍特效標籤內還包括特效設定資料,所述特效設定資料設定一或多個節拍特效訊號。In an embodiment, the beat effect label further includes special effect setting data, and the special effect setting data sets one or more beat special effects signals.

於一實施方式中,所述節拍特效標籤內還包括與所述特效設定資料對應之提示設定資料,所述提示設定資料設定所述提示特效訊號,所述提示特效訊號提示使用者及時做出預設之節拍動作。In an embodiment, the beat special effect label further includes prompt setting data corresponding to the special effect setting data, where the prompt setting data sets the prompt special effect signal, and the prompt special effect signal prompts the user to make a timely advance Set the beat action.

於一實施方式中,所述節拍特效標籤內還包括節拍觸發訊號設定資料和對應之提示設定資料,設定一或多個節拍觸發訊號,並提示使用者及時做出對應之節拍動作,所述節拍動作包括:發出特定聲音、做出特定動作、操作特定節拍設備以及如何操作節拍設備中之一種或多種。In an embodiment, the beat effect label further includes a beat trigger signal setting data and a corresponding prompt setting data, setting one or more beat trigger signals, and prompting the user to make a corresponding beat action in time, the beat Actions include: emitting a specific sound, making a specific action, operating a particular beat device, and how to operate one or more of the beat devices.

於一實施方式中,所述控制主機接收到節拍觸發訊號後,如果所述節拍觸發訊號符合對應之所述節拍特效標籤中之節拍觸發訊號設定資料,且當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則所述控制主機判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號; 所述控制主機還根據節拍觸發訊號之正確與否及時間準確性進行評分,於所述多媒體檔結束播放後所述控制主機對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。In an embodiment, after the control host receives the beat trigger signal, if the beat trigger signal meets the beat trigger signal setting data in the corresponding beat effect label, and the current time and the corresponding beat special effect label If the difference between the time nodes is less than the specified value, the control host determines that the beat trigger signal is a timely and correct beat trigger signal, and generates a beat special effect signal; the control host also determines whether the beat signal is correct according to the beat. The time accuracy is scored, and after the multimedia file ends playing, the control host summarizes the scores to obtain an overall evaluation, and each time the score and the overall score are output through the special effect output device.

於一實施方式中,所述提示設定資料設定如何向使用者發出視覺提示,所述提示設定資料包括設備設定資料和提示內容; 所述設備設定資料設定節拍設備、特效輸出設備和多媒體視頻輸出設備中之一或多個; 所述提示內容是文字、圖形或動畫中之一種或多種; 所述控制主機於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處根據提示設定資料生成提示特效訊號以提示使用者做出節拍動作。In an embodiment, the prompt setting data setting provides a visual prompt to the user, the prompt setting data includes device setting data and prompt content; and the device setting data sets a beat device, a special effect output device, and a multimedia video output device. One or more of the prompts; the prompt content is one or more of a text, a graphic, or an animation; the control host synchronously acquires a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, at the time node According to the prompt setting data, a prompt special effect signal is generated to prompt the user to make a beat action.

於一實施方式中,所述控制主機接收到節拍觸發訊號後,如果當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則所述控制主機判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號;In an embodiment, after the control host receives the beat trigger signal, if the difference between the current time and the corresponding time node in the corresponding beat effect label is less than a specified value, the control host determines the beat trigger signal. It is a timely and correct beat trigger signal and generates a beat special effect signal;

所述控制主機還根據節拍觸發訊號之時間準確性進行評分,於所述多媒體檔結束播放後所述控制主機對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。The control host further performs scoring according to the time accuracy of the beat trigger signal, and after the multimedia file ends playing, the control host summarizes the scores to obtain an overall evaluation, and each time the score and the overall score pass through The effect output device output.

於一實施方式中,所述提示特效訊號還提示使用者及時做出正確之節拍動作後會呈現何種節拍特效。In an embodiment, the prompt effect signal further prompts the user to perform a beat effect after the correct beat action is performed in time.

於一實施方式中,所述系統還包括:節拍設備,用於根據使用者之操作發出所述節拍觸發訊號至所述控制主機、所述特效輸出設備或者所述節拍感應裝置,所述節拍設備內置燈光部件以閃爍顯示所接收到之燈光或燈光陣列圖案,和/或內置視頻顯示部件以閃爍顯示接收到之提示圖案或播放提示動畫。In an embodiment, the system further includes: a beat device, configured to send the beat trigger signal to the control host, the special effect output device, or the beat sensing device according to an operation of a user, the beat device A built-in light component flashes the received light or light array pattern, and/or a built-in video display component to flash the received cue pattern or play cue animation.

於一實施方式中,所述控制主機於播放多媒體檔時獲取與所述多媒體檔對應之節拍特效資料集包括: 所述控制主機根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之節拍特效資料集之請求;以及 接收所述雲端伺服器系統返回之所述節拍特效資料集。In an embodiment, the controlling host acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the control host sends the corresponding information to the cloud server system according to the identifier of the multimedia file. a request for a beat effect data set; and receiving the beat effect data set returned by the cloud server system.

於一實施方式中,所述控制主機於播放多媒體檔時獲取與所述多媒體檔對應之節拍特效資料集還包括: 所述控制主機將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統驗證所述控制主機是否具有獲取節拍特效資料集之許可權; 所述雲端伺服器系統於所述控制主機具有獲取節拍特效資料集之許可權時才返回所述控制主機請求之節拍特效資料集。In an embodiment, the controlling host acquiring the beat special effect data set corresponding to the multimedia file when playing the multimedia file further includes: the control host transmitting the identity authentication information to the cloud server system, so as to enable the Determining, by the cloud server system, whether the control host has permission to acquire a beat special effect data set; the cloud server system returns to the control host request when the control host has permission to acquire a beat special effect data set Beat effect data set.

於一實施方式中,所述系統還包括與所述控制主機相連之外部設備;所述外部設備於播放多媒體檔時或者多媒體檔被加入播放清單時將對應之多媒體檔之標識發送給所述控制主機; 所述控制主機於接收到所述多媒體檔之標識後執行所述控制主機根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之節拍特效資料集之請求之步驟。In an embodiment, the system further includes an external device connected to the control host; the external device sends the identifier of the corresponding multimedia file to the control when the multimedia file is played or the multimedia file is added to the playlist. After receiving the identifier of the multimedia file, the control host performs a step of the control host sending a request for acquiring the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file.

於一實施方式中,所述控制主機於播放多媒體檔時獲取與所述多媒體檔對應之節拍特效資料集包括:從所述多媒體檔內解析出內嵌於所述多媒體檔內之所述節拍特效資料集。In an embodiment, the acquiring, by the control host, the beat effect data set corresponding to the multimedia file when playing the multimedia file comprises: parsing, from the multimedia file, the beat effect embedded in the multimedia file Data set.

於一實施方式中,所述特效輸出設備包括:音訊輸出裝置、視頻輸出裝置以及燈光特效裝置; 所述特效設定資料包括音訊特效資料、燈光特效資料以及視頻特效資料,所述音訊特效資料設定所述音訊輸出裝置發出之聲音特效,所述燈光特效資料設定所述燈光特效裝置燈光之變化方式,所述視頻特效資料設定所述視頻輸出裝置之圖像變化方式包括圖案、顏色、位置、角度、大小等變化中之一種或多種。In an embodiment, the special effect output device includes: an audio output device, a video output device, and a light special effect device; the special effect setting data includes audio special effect data, light special effect data, and video special effect data, and the audio special effect data setting office. a sound effect sent by the audio output device, the light effect data setting a change manner of the light of the light special effect device, wherein the video special effect data sets an image change mode of the video output device, including a pattern, a color, a position, an angle, One or more of changes in size, etc.

於一實施方式中,所述節拍感應裝置包括錄音模組以及音訊分析模組,所述錄音模組用於採集外部之聲音,所述音訊分析模組用於根據所述錄音模組採集之聲音分析其音訊特徵是否符合預設之節拍音訊特徵,若是,則所述音訊分析模組生成所述節拍觸發訊號。In one embodiment, the beat sensing device includes a recording module and an audio analysis module, the recording module is configured to collect external sound, and the audio analysis module is configured to collect sound according to the recording module. Analyzing whether the audio feature meets a preset beat audio feature, and if so, the audio analysis module generates the beat trigger signal.

於一實施方式中,所述節拍感應裝置包括視頻捕捉模組以及視頻分析模組,所述視頻捕捉模組用於拍攝使用者之視頻,所述視頻分析模組用於分析所述視頻捕捉模組拍攝之使用者視頻,以識別出使用者之動作是否符合預定之特徵,若是,則所述視頻分析模組生成所述節拍觸發訊號。In one embodiment, the beat sensing device includes a video capture module and a video analysis module, the video capture module is configured to capture a video of a user, and the video analysis module is configured to analyze the video capture module. The group of user videos is captured to identify whether the user's action conforms to the predetermined feature, and if so, the video analysis module generates the beat trigger signal.

於一實施方式中,所述節拍設備為用於發出特定音訊訊號之無源發聲設備。In an embodiment, the beat device is a passive sound emitting device for emitting a specific audio signal.

於一實施方式中,所述節拍設備為電子裝置,所述電子裝置於使用者按鈕、拍打、觸摸、旋轉、移動時發出特定之訊號給所述控制主機、所述特效輸出設備或者所述節拍感應裝置。In an embodiment, the beat device is an electronic device that sends a specific signal to the control host, the special effect output device, or the beat when the user buttons, taps, touches, rotates, and moves. Induction device.

本發明實施方式還提供一種互動節拍特效處理方法,所述方法包括: 於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點; 於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處生成提示特效訊號; 輸出所述提示特效訊號以提示使用者及時做出節拍動作; 當感應到用戶之節拍動作後生成節拍觸發訊號; 如果及時接收到正確之節拍觸發訊號,則生成節拍特效訊號;以及 根據所述節拍特效訊號輸出對應之節拍特效。The embodiment of the present invention further provides an interactive beat special effect processing method, the method comprising: acquiring a beat special effect data set corresponding to the multimedia file when the multimedia file is played, or when the external device plays the multimedia file, the beat special effect The data set includes a plurality of beat effect labels, each beat special effect label includes a time node; synchronously acquires a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, and generates a prompt special effect signal at the time node; The prompting effect signal is used to prompt the user to make a beat action in time; when the user's beat action is sensed, a beat trigger signal is generated; if the correct beat trigger signal is received in time, a beat special effect signal is generated; and the beat effect signal is generated according to the beat Output the corresponding beat effect.

於一實施方式中,所述節拍特效標籤內還包括特效設定資料,所述特效設定資料設定一或多個節拍特效訊號。In an embodiment, the beat effect label further includes special effect setting data, and the special effect setting data sets one or more beat special effects signals.

於一實施方式中,所述節拍特效標籤內還包括與所述特效設定資料對應之提示設定資料,所述提示設定資料設定所述提示特效訊號,所述提示特效訊號提示使用者及時做出預設之節拍動作。In an embodiment, the beat special effect label further includes prompt setting data corresponding to the special effect setting data, where the prompt setting data sets the prompt special effect signal, and the prompt special effect signal prompts the user to make a timely advance Set the beat action.

於一實施方式中,所述節拍特效標籤內還包括節拍觸發訊號設定資料和對應之提示設定資料,設定一或多個節拍觸發訊號,並提示使用者及時做出對應之節拍動作,所述節拍動作包括:發出特定聲音、做出特定動作、操作特定節拍設備以及如何操作節拍設備中之一種或多種。In an embodiment, the beat effect label further includes a beat trigger signal setting data and a corresponding prompt setting data, setting one or more beat trigger signals, and prompting the user to make a corresponding beat action in time, the beat Actions include: emitting a specific sound, making a specific action, operating a particular beat device, and how to operate one or more of the beat devices.

於一實施方式中,於接收到節拍觸發訊號後,如果所述節拍觸發訊號符合對應之所述節拍特效標籤中之節拍觸發訊號設定資料,且當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號; 所述方法還包括:根據節拍觸發訊號之正確與否及時間準確性進行評分,於所述多媒體檔結束播放後對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過特效輸出設備輸出。In an embodiment, after the beat trigger signal is received, if the beat trigger signal meets the beat trigger signal setting data in the corresponding beat effect label, and the current time and the corresponding time in the beat special effect label If the difference between the nodes is less than the specified value, the beat trigger signal is determined to be a timely and correct beat trigger signal, and a beat special effect signal is generated; the method further includes: scoring according to the correctness of the beat trigger signal and the time accuracy. And summarizing the scores after the multimedia file ends playing to obtain an overall evaluation, and each time the score and the overall score are output through the special effect output device.

於一實施方式中,所述提示設定資料設定如何向使用者發出視覺提示,所述提示設定資料包括設備設定資料和提示內容; 所述設備設定資料設定節拍設備、特效輸出設備和多媒體視頻輸出設備中之一或多個; 所述提示內容是文字、圖形或動畫中之一種或多種; 於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處根據提示設定資料生成提示特效訊號以提示使用者做出節拍動作。In an embodiment, the prompt setting data setting provides a visual prompt to the user, the prompt setting data includes device setting data and prompt content; and the device setting data sets a beat device, a special effect output device, and a multimedia video output device. One or more of the prompts; the prompt content is one or more of a text, a graphic, or an animation; when the multimedia file is played, the corresponding beat special effect label is obtained from the beat special effect data set, and the prompt is set according to the prompt at the time node. The data generation prompts a special effect signal to prompt the user to make a beat action.

於一實施方式中,於接收到節拍觸發訊號後,如果當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號; 所述方法還包括:根據節拍觸發訊號之時間準確性進行評分,於所述多媒體檔結束播放後對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。In an embodiment, after receiving the beat trigger signal, if the difference between the current time and the corresponding time node in the beat effect label is less than the specified value, determining that the beat trigger signal is a timely and correct beat trigger a signal, and generating a beat effect signal; the method further includes: scoring according to the time accuracy of the beat trigger signal, and summarizing the scores after the end of the multimedia file to obtain an overall evaluation, each time rating and The overall score is output through the effect output device.

於一實施方式中,所述方法還包括:根據使用者之操作發出所述節拍觸發訊號至控制主機、特效輸出設備或者節拍感應裝置,所述節拍設備內置燈光部件以閃爍顯示所接收到之燈光或燈光陣列圖案,和/或內置視頻顯示部件以閃爍顯示接收到之提示圖案或播放提示動畫。In an embodiment, the method further includes: issuing the beat trigger signal to a control host, a special effect output device, or a beat sensing device according to an operation of a user, wherein the beat device has a built-in light component to flash the received light Or a light array pattern, and/or a built-in video display component to flash the received cue pattern or play cue animation.

於一實施方式中,所述提示特效訊號還提示使用者及時做出正確之節拍動作後會呈現何種節拍特效。In an embodiment, the prompt effect signal further prompts the user to perform a beat effect after the correct beat action is performed in time.

於一實施方式中,所述獲取與所述多媒體檔對應之節拍特效資料集包括: 根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之節拍特效資料集之請求;以及 接收所述雲端伺服器系統返回之所述節拍特效資料集。In an embodiment, the acquiring the beat effect data set corresponding to the multimedia file includes: sending, according to the identifier of the multimedia file, a request for acquiring the corresponding beat special effect data set to the cloud server system; and receiving the location The set of the beat effect data returned by the cloud server system.

於一實施方式中,所述獲取與所述多媒體檔對應之節拍特效資料集還包括: 將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統驗證是否具有獲取節拍特效資料集之許可權 ; 所述雲端伺服器系統於控制主機具有獲取節拍特效資料集之許可權時才返回所述節拍特效資料集。In an embodiment, the acquiring the beat effect data set corresponding to the multimedia file further includes: sending the identity authentication information to the cloud server system, so that the cloud server system verifies whether the beat effect is obtained. The permission of the data set; the cloud server system returns to the beat special effect data set when the control host has the permission to acquire the beat special effect data set.

於一實施方式中,所述方法還包括: 於所述外部設備播放多媒體檔時,接收所述外部設備發送之所述多媒體檔之標識;所述獲取與所述多媒體檔對應之節拍特效資料集之步驟於接收到所述多媒體檔之標識後進行。In an embodiment, the method further includes: receiving an identifier of the multimedia file sent by the external device when the external device plays a multimedia file; and acquiring a beat special effect data set corresponding to the multimedia file The step is performed after receiving the identification of the multimedia file.

於一實施方式中,所述獲取與所述多媒體檔對應之節拍特效資料集包括:從所述多媒體檔內解析出內嵌於所述多媒體檔內之所述節拍特效資料集。In an embodiment, the acquiring a beat effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the beat special effect data set embedded in the multimedia file.

於一實施方式中,所述特效設定資料包括音訊特效資料、燈光特效資料、以及視頻特效資料,所述音訊特效資料設定所述音訊輸出裝置發出之聲音特效,所述燈光特效資料設定所述燈光特效裝置燈光之變化方式,所述視頻特效資料設定所述視頻輸出裝置之圖像變化方式包括圖案、顏色、位置、角度、大小等變化中之一種或多種。In an embodiment, the special effect setting data includes audio special effect data, lighting special effect data, and video special effect data, wherein the audio special effect data sets a sound effect sent by the audio output device, and the lighting special effect data sets the light. The mode of changing the light of the special effect device, wherein the video special effect data sets the image change mode of the video output device to include one or more of a change of a pattern, a color, a position, an angle, a size, and the like.

於一實施方式中,所述方法還包括:採集外部之聲音,並根據採集之聲音分析其音訊特徵是否符合預設之節拍音訊特徵,若是,則生成所述節拍觸發訊號。In an embodiment, the method further includes: collecting an external sound, and analyzing whether the audio feature meets the preset beat audio feature according to the collected sound, and if yes, generating the beat trigger signal.

於一實施方式中,所述方法還包括:拍攝使用者之視頻,並根據拍攝之使用者視頻識別出使用者之動作是否符合預定之特徵,若是,則生成所述節拍觸發訊號。In one embodiment, the method further includes: capturing a video of the user, and identifying, according to the captured user video, whether the user's motion meets a predetermined feature, and if so, generating the beat trigger signal.

於一實施方式中,所述方法還包括:接收節拍設備根據使用者之操作發出之所述節拍觸發訊號。In an embodiment, the method further includes: receiving the beat trigger signal sent by the beat device according to a user operation.

上述技術方案之有益效果為:上述互動節拍特效系統及方法於播放多媒體檔時還獲取與多媒體檔對應之節拍特效資料集,節拍特效資料集中包括分別針對不同時間節點之節拍特效標籤,於播放音樂之過程中顯示提示資訊,讓使用者於指定之時間節點做出對應之節拍動作,當於播放音樂之過程中感應到用戶之節拍動作時且用戶之節拍動作與節拍特效標籤之設定相匹配,控制主機透過音訊、視頻或者燈光等方式輸出一明顯之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能,尤其適用於KTV等場合。而且節拍訊號除由專門之電子設備觸發外,使用者於KTV裡之常見操作例如搖動鈴鼓都可以觸發節拍動作,因此可以讓用戶無需學習就能自然之啟動節拍特效,提升用戶於KTV房間裡之使用感受。The beneficial effects of the above technical solution are as follows: the interactive beat special effect system and method also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes the beat special effect label for different time nodes respectively, and plays the music During the process, the prompt information is displayed, and the user makes a corresponding beat action at the designated time node. When the user's beat action is sensed during the playing of the music and the user's beat action matches the setting of the beat effect label, The control host outputs an obvious beat effect through audio, video or lighting, thereby visualizing the user's beat action and enhancing the interactive function of the multimedia file play system, especially for KTV and other occasions. Moreover, besides the triggering of the special electronic device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings.

為讓本發明之上述和其他目的、特徵和優點能更明顯易懂,下文特舉較佳實施方式,並配合所附圖式,作詳細說明如下。The above and other objects, features and advantages of the present invention will become more <RTIgt;

為更進一步闡述本發明為實現預定發明目的所採取之技術手段及功效,以下結合附圖及較佳實施方式,對依據本發明之具體實施方式、結構、特徵及其功效,詳細說明如後。The specific embodiments, structures, features and functions of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

第一實施方式First embodiment

參閱圖1,其為本發明第一實施方式提供之互動節拍特效系統之架構示意圖。如圖1所示,互動節拍特效系統100包括控制主機10、點歌終端11、節拍感應裝置12、音訊輸出裝置13、多媒體視頻輸出裝置14、燈光特效裝置15以及視頻輸出裝置16。可以理解,圖1之架構僅為示意,互動節拍特效系統100還可包括更多之設備,例如功放、麥克風等等。Referring to FIG. 1 , it is a schematic structural diagram of an interactive beat special effect system according to a first embodiment of the present invention. As shown in FIG. 1, the interactive beat special effects system 100 includes a control host 10, a song-song terminal 11, a beat sensing device 12, an audio output device 13, a multimedia video output device 14, a lighting effect device 15, and a video output device 16. It can be understood that the architecture of FIG. 1 is merely illustrative, and the interactive beat effect system 100 can also include more devices such as a power amplifier, a microphone, and the like.

點歌終端11提供點歌之介面,使用者例如可以透過點歌介面進行點歌,選擇之歌曲被提交給控制主機10,控制主機10根據待播放之清單播放與被點歌曲對應之伴唱音及伴唱視頻,即將音訊與視頻分別傳輸給音訊輸出裝置13以及多媒體視頻輸出裝置14輸出。The karaoke terminal 11 provides a karaoke interface. The user can, for example, sing a song through the karaoke interface, and the selected song is submitted to the control host 10, and the control host 10 plays the accompaniment sound corresponding to the selected song according to the list to be played and The singer video transmits the audio and video to the audio output device 13 and the multimedia video output device 14 respectively.

點歌終端11具體地可以是與控制主機10相連之輸入/輸出裝置,例如與控制主機10相連之觸控面板,此時,點歌終端11之應用程式介面實質上是由控制主機10控制,點歌終端11僅作為輸入/輸出裝置。用戶透過觸控面板點播之歌曲直接被控制主機10獲取到。The karaoke terminal 11 may specifically be an input/output device connected to the control host 10, such as a touch panel connected to the control host 10. At this time, the application interface of the karaoke terminal 11 is substantially controlled by the control host 10, The karaoke terminal 11 serves only as an input/output device. The songs that the user orders through the touch panel are directly acquired by the control host 10.

點歌終端11還可以是單獨之電子裝置,例如安裝有特定之應用程式之電子裝置如手機、平板電腦等等。使用者可以透過該應用程式進行點歌,而所點歌曲之資訊由該應用程式傳輸給控制主機10。其具體之傳輸方式例如可包括以下幾種:當控制主機10與點歌終端11處於同一局域網內時,點歌終端11可以透過預定之網路埠直接將使用者所點歌曲之資訊經由該網路埠發送給控制主機10。可以理解,此種方式需要控制主機10開放相應之埠與網路服務。當控制主機10與點歌終端11不處於同一局域網內時,可以透過伺服器中轉以傳輸使用者所點歌曲之資訊。即,應用程式先將使用者所點歌曲之資訊提交至伺服器,然後,當同一使用者於控制主機10中登陸時,控制主機10就可以從伺服器處獲取或由伺服器主動推送當前登陸用戶點播之歌曲。The karaoke terminal 11 can also be a separate electronic device, such as an electronic device such as a mobile phone, a tablet, or the like, to which a specific application is installed. The user can click through the application, and the information of the clicked song is transmitted by the application to the control host 10. The specific transmission manner may include the following: when the control host 10 and the karaoke terminal 11 are in the same local area network, the karaoke terminal 11 can directly directly feed the information of the songs clicked by the user through the network through the predetermined network. The switch is sent to the control host 10. It can be understood that this method requires the control host 10 to open corresponding network services. When the control host 10 and the karaoke terminal 11 are not in the same local area network, the server can be relayed to transmit the information of the songs clicked by the user. That is, the application first submits the information of the songs clicked by the user to the server, and then, when the same user logs in to the control host 10, the control host 10 can obtain from the server or actively push the current login by the server. User-on-demand songs.

節拍感應裝置12用在於控制主機10播放所述多媒體檔時感應到使用者之節拍動作後生成節拍觸發訊號。此處之節拍動作係指使用者回應於提示特效訊號所做出之動作。使用者回應於提示特效訊號所做出之動作之具體實施包括但並不限於:歡呼、搖動鈴鼓、搖動手臂、操控手機、按鍵遙控器、跳舞等等。The beat sensing device 12 is configured to generate a beat trigger signal after sensing the user's beat motion when the host computer 10 plays the multimedia file. The beat action here refers to the action that the user responds to in response to the prompt effect signal. Specific implementations of the actions taken by the user in response to the prompting effect signal include, but are not limited to, cheering, shaking the tambourine, shaking the arm, manipulating the phone, pressing the remote control, dancing, and the like.

總體上來說,節拍動作可以分為兩類:聲音與動作。In general, the beat action can be divided into two categories: sound and action.

因此,於一具體之實施方式中,參閱圖2,節拍感應裝置12是基於音訊分析實現,其包括錄音模組122以及音訊分析模組124,錄音模組122用於採集外部之聲音,音訊分析模組124用於根據錄音模組122採集之聲音分析其音訊特徵是否符合預設之節拍音訊特徵,若是,則音訊分析模組124生成節拍觸發訊號。Therefore, in a specific implementation manner, referring to FIG. 2, the beat sensing device 12 is implemented based on audio analysis, and includes a recording module 122 and an audio analysis module 124. The recording module 122 is used for collecting external sounds and audio analysis. The module 124 is configured to analyze whether the audio feature meets the preset beat audio feature according to the sound collected by the recording module 122. If so, the audio analysis module 124 generates a beat trigger signal.

例如,於KTV設施中最為常見之鈴鼓被晃動時,除發出清脆之聲音外,還會發出超聲波。因此,當音訊分析模組124檢測到預定頻率之超聲波後,則生成節拍觸發訊號。For example, when the most common tambourine in a KTV facility is shaken, it emits ultrasonic waves in addition to a crisp sound. Therefore, when the audio analysis module 124 detects the ultrasonic wave of the predetermined frequency, a beat trigger signal is generated.

音訊分析模組124還可透過音訊識別之方式,識別錄取之音訊是否是預定之內容,例如當使用者歡呼“我愛你”時,則生成節拍觸發訊號。The audio analysis module 124 can also identify whether the recorded audio is a predetermined content by means of audio recognition. For example, when the user cheers "I love you", a beat trigger signal is generated.

參閱圖3,於另一具體之實施方式中,節拍感應裝置12是基於視頻分析使用者之動作實現,其包括視頻捕捉模組126以及視頻分析模組128,視頻捕捉模組126用於拍攝使用者之視頻,視頻分析模組128用於分析視頻捕捉模組126拍攝之使用者視頻,以識別出使用者之動作是否符合預定之特徵,若是,則視頻分析模組128生成節拍觸發訊號。Referring to FIG. 3, in another specific implementation manner, the beat sensing device 12 is implemented based on the motion of the video analysis user, and includes a video capture module 126 and a video analysis module 128. The video capture module 126 is used for shooting. The video analysis module 128 is configured to analyze the user video captured by the video capture module 126 to identify whether the user's motion conforms to the predetermined feature. If so, the video analysis module 128 generates a beat trigger signal.

例如,透過視頻分析,獲取到使用者雙手同時晃動手臂之操作,則視頻分析模組128生成節拍觸發訊號。For example, the video analysis module 128 generates a beat trigger signal by video analysis to obtain an operation of the user shaking the arm at the same time.

於另一具體之實施方式中,節拍感應裝置12是基於節拍設備發送之節拍訊號實現之。例如,節拍感應裝置12包括藍牙模組、紅外模組或者WIFI模組。In another specific embodiment, the beat sensing device 12 is implemented based on a beat signal transmitted by the beat device. For example, the beat sensing device 12 includes a Bluetooth module, an infrared module, or a WIFI module.

節拍設備例如可為一遙控器,其上設有多個按鍵,當使用者按下某個按鍵時,遙控器發射對應之紅外訊號給所述節拍感應裝置12。亦即,遙控器發送之紅外訊號即為上述之節拍訊號。The beat device can be, for example, a remote controller having a plurality of buttons thereon. When the user presses a button, the remote controller transmits a corresponding infrared signal to the beat sensing device 12. That is, the infrared signal sent by the remote controller is the above-mentioned beat signal.

節拍設備例如還可為一專用之電子設備,其內也設有藍牙模組,從而可與節拍感應裝置12之藍牙模組配對,配對成功後,當檢測到使用者按下某個按鍵,或者晃動該節拍設備時,節拍設備向節拍感應裝置12發送對應之藍牙訊號。亦即,節拍設備發送之藍牙訊號即為上述之節拍訊號。The beat device can also be, for example, a dedicated electronic device, which is also provided with a Bluetooth module, so as to be paired with the Bluetooth module of the beat sensing device 12, after successful pairing, when detecting that the user presses a certain button, or When the beat device is shaken, the beat device transmits a corresponding Bluetooth signal to the beat sensing device 12. That is, the Bluetooth signal sent by the beat device is the above-mentioned beat signal.

節拍設備例如還可為一手機,手機透過WIFI與節拍感應裝置12相連,手機內安裝有特定之應用程式,該應用程式透過手機內置之加速度計獲取節拍設備之運動參數,並進一步計算節拍設備之運動軌跡,當節拍設備之運動軌跡符合預設之特徵時,手機透過WIFI網路向節拍感應裝置12發送預定之網路訊號。亦即,上述手機發送之網路訊號即為上述之節拍訊號。The beat device can also be, for example, a mobile phone connected to the beat sensing device 12 via WIFI. The mobile phone is equipped with a specific application program, and the application obtains the motion parameters of the beat device through the built-in accelerometer of the mobile phone, and further calculates the beat device. The motion track, when the motion track of the beat device conforms to the preset feature, the mobile phone transmits a predetermined network signal to the beat sensing device 12 through the WIFI network. That is to say, the network signal sent by the above mobile phone is the above-mentioned beat signal.

此外,可以理解,節拍設備並不限於僅為上述之某一種類型,各種類型之節拍設備還可以組合使用。亦即,節拍感應裝置12會接收不同節拍設備發出之節拍訊號;或者控制主機10檢測多個使用者之動作或者音訊。Further, it can be understood that the beat device is not limited to only one of the above types, and various types of beat devices can also be used in combination. That is, the beat sensing device 12 receives the beat signal sent by the different beat devices; or the control host 10 detects the actions or audio of the plurality of users.

音訊輸出裝置13例如可為音箱,而多媒體視頻輸出裝置14和視頻輸出裝置16例如可為電視機、顯示器、投影儀等任意輸出視頻圖像之設備。燈光特效裝置15包括至少一燈具,其可根據控制訊號輸出燈光訊號。優選地,燈光特效裝置15可以包括LED燈陣列以及對應之驅動裝置,該LED燈陣列可以佈滿房間之所有牆壁、屋頂甚至地面。當LED燈陣列中每個LED燈被單獨驅動時,整個LED燈陣列實質上也構成一顯示器,可用於顯示複雜之圖像訊號,此時,燈光特效裝置15與視頻輸出裝置16之不同之處在於顯示尺度之不同。The audio output device 13 can be, for example, a speaker, and the multimedia video output device 14 and the video output device 16 can be any device that outputs a video image, such as a television, a display, a projector, or the like. The light effect device 15 includes at least one light fixture that can output a light signal according to the control signal. Preferably, the light effect device 15 can include an array of LED lights and corresponding drive devices that can cover all of the walls, roofs and even the ground of the room. When each LED light in the LED light array is separately driven, the entire LED light array substantially constitutes a display, which can be used to display complex image signals. In this case, the difference between the light effect device 15 and the video output device 16 It is the difference in display scale.

多媒體視頻輸出裝置14例如是用於顯示多媒體伴唱檔之視頻主畫面以及疊加於視頻主畫面上之視頻特效,而視頻輸出裝置16例如是用於顯示視頻特效。The multimedia video output device 14 is, for example, a video home screen for displaying a multimedia vocal file and a video effect superimposed on the video home screen, and the video output device 16 is, for example, for displaying a video effect.

可以理解,互動節拍特效系統100中還可以包括多個多媒體視頻輸出裝置14和多個視頻輸出裝置16。It can be understood that the interactive beat effect system 100 can also include a plurality of multimedia video output devices 14 and a plurality of video output devices 16.

本實施方式之互動節拍特效系統100於播放歌曲或者其他多媒體檔時,控制主機10除獲取歌曲之原始檔案外,還獲取與當前歌曲對應之節拍特效資料集。When the interactive beat special effect system 100 of the present embodiment plays a song or other multimedia file, the control host 10 acquires the beat special effect data set corresponding to the current song in addition to the original file of the song.

於一具體之實施方式中,上述之節拍特效資料集是嵌入歌曲之原始檔案內。因此,控制主機10要從歌曲之原始檔案中解析出對應之節拍特效資料集。可以理解,歌曲之原始檔案既可以是存儲於本地之記憶體(指透過資料匯流排與控制主機相連之記憶體),也可以是存儲於網路記憶體內。此處之網路記憶體,既可以包括局域網、企業內部網,也可以包括互聯網。In a specific implementation manner, the above-mentioned beat effect data set is embedded in the original file of the song. Therefore, the control host 10 needs to parse the corresponding beat effect data set from the original file of the song. It can be understood that the original file of the song can be stored in the local memory (referring to the memory connected to the control host through the data bus), or can be stored in the network memory. The network memory here can include a local area network, an intranet, or the Internet.

於另一具體之實施方式,上述之節拍特效資料集是與歌曲之原始檔案相互獨立存儲之檔。與歌曲之原始檔案相似,節拍特效資料集,既可以是存儲於本地之記憶體,也可以是存儲於網路記憶體內。In another specific implementation manner, the above-mentioned beat effect data set is stored separately from the original file of the song. Similar to the original file of the song, the beat effect data set can be stored in local memory or stored in network memory.

上述之節拍特效資料集是採用預定義之協定或者語言描述之節拍特效資料集。例如,於一具體之實施方式中,節拍特效資料集可包括多個有序之節拍特效標籤,每個節拍特效標籤包括時間設定資料以及特效設定資料。時間設定資料用於設定節拍特效有效之時間。特效設定資料既可以直接為音訊、視頻或者向量動畫,也可以是用於描述、生成或者獲取節拍特效之其他格式之資料。The above-mentioned beat effect data set is a beat special effect data set using a predefined agreement or language description. For example, in a specific implementation manner, the beat effect data set may include a plurality of ordered beat special effects labels, and each beat special effect label includes time setting data and special effect setting materials. The time setting data is used to set the time when the beat effect is effective. Special effects settings can be either directly for audio, video or vector animation, or for other formats that describe, generate, or acquire beat effects.

於一具體之實施方式中,節拍特效資料集例如可如下: [00:00.00] [00:24.88] [01:27.05] [02:30.39] … …In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] [00:24.88] [01:27.05] [02:30.39] ...

於此種情形下,節拍特效標籤內只有時間節點,控制主機10會於每一節拍特效標籤之時間節點發出預設之提示特效訊號提示使用者及時做出預設之節拍動作,當控制主機10於允許之時間誤差內接收到任意一節拍觸發訊號時,就生成預設之節拍特效。例如,無論是用戶透過晃動鈴鼓還是歡呼“我愛你”,都會觸發同一節拍特效。上述預設之提示特效訊號例如是文字、圖示或者動畫。In this case, there is only a time node in the beat special effect label, and the control host 10 will issue a preset prompt special effect signal at the time node of each beat special effect label to prompt the user to make a preset beat action in time, when the control host 10 A preset beat effect is generated when any beat trigger signal is received within the allowed time error. For example, whether the user shakes the tambourine or cheers "I love you", it will trigger the same beat effect. The preset preset effect signal is, for example, text, graphic or animation.

於一具體之實施方式中,節拍特效資料集例如可如下: [00:00.00] 特效設定數據1 [00:24.88] 特效設定數據2 [01:27.05] 特效設定數據3 [02:30.39] 特效設定數據4 … …In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] effect setting data 1 [00:24.88] effect setting data 2 [01:27.05] effect setting data 3 [02:30.39] effect setting Data 4...

於此種情形下,節拍特效標籤內包括特效設定資料。例如:控制主機10會於每一節拍特效標籤之時間節點發出預設之提示特效訊號提示使用者及時做出預設之節拍動作,但用戶於此時之4個時間節點及時做出節拍動作會觸發對應之節拍特效。In this case, the special effects settings are included in the beat effect label. For example, the control host 10 will issue a preset prompt effect signal at the time node of each beat special effect label to prompt the user to make a preset beat action in time, but the user can make a beat action in time at the four time nodes at this time. Trigger the corresponding beat effect.

於一具體之實施方式中,節拍特效資料集例如可如下: [00:00.00] 提示設定數據1 特效設定數據1 [00:24.88] 提示設定數據2 特效設定數據2 [01:27.05] 提示設定數據3 特效設定數據3 [02:30.39] 提示設定數據4 特效設定數據4 … …In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] prompt setting data 1 effect setting data 1 [00:24.88] prompt setting data 2 effect setting data 2 [01:27.05] prompt setting data 3 Special effect setting data 3 [02:30.39] Prompt setting data 4 Special effect setting data 4 ... ...

於此種情形下,節拍特效標籤內包括特效設定資料和對應之提示設定資料。提示設定資料設定提示特效訊號之內容,例如文字、圖示、動畫或者其組合。例如:若提示設定資料包括之提示特效訊號之內容是一蠟燭之小圖示,則控制主機10會於某一時間節點於視頻特效顯示裝置上顯示一蠟燭之小圖示。優選地,上述之對應之提示設定資料係指提示設定資料和特效設定資料所設定之節拍特效之內容相關聯。例如,當特效設定資料1所設定之節拍特效為一蠟燭點燃之動畫時,提示設定資料1所設定之提示特效訊號就可為一蠟燭之小圖示,表示使用者及時做出默認之節拍動作會啟動蠟燭點燃之特效動畫。亦即,提示設定資料所設定之提示特效訊號提示使用者及時做出正確之節拍動作後會呈現何種節拍特效。In this case, the beat effect label includes the special effect setting data and the corresponding prompt setting data. The prompt setting data sets the content of the prompt effect signal, such as text, graphic, animation, or a combination thereof. For example, if the content of the prompting effect signal included in the prompt setting data is a small icon of a candle, the control host 10 displays a small icon of a candle on the video special effect display device at a certain time node. Preferably, the corresponding prompt setting data refers to that the prompt setting data is associated with the content of the beat special effect set by the special effect setting data. For example, when the beat effect set by the special effect setting data 1 is an animation of a candle igniting, the prompt effect signal set by the prompt setting data 1 can be a small icon of a candle, indicating that the user makes a default beat action in time. A special effect animation that ignites the candle will be activated. That is, the prompt effect signal set by the prompt setting data prompts the user to display what kind of beat special effect is performed after the correct beat action is made in time.

於一具體之實施方式中,節拍特效資料集例如可如下: [00:00.00] 提示設定資料1 節拍觸發訊號設定資料1 [00:24.00] 提示設定資料2 節拍觸發訊號設定資料2 [01:28.00] 提示設定資料3 節拍觸發訊號設定資料3 [04:30.00] 提示設定資料4 節拍觸發訊號設定資料4In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] prompt setting data 1 beat trigger signal setting data 1 [00:24.00] prompt setting data 2 beat trigger signal setting data 2 [01:28.00] ] Prompt setting data 3 Beat trigger signal setting data 3 [04:30.00] Prompt setting data 4 Beat trigger signal setting data 4

於此種情形下,節拍特效標籤內包括節拍觸發訊號設定資料和對應之提示設定資料。上述之對應之提示設定資料例如係指提示設定資料所設定之提示特效訊號是與節拍觸發訊號設定資料所設定之節拍觸發訊號之具體種類相關聯之。此時之提示特效訊號用於提示使用者及時做出什麼樣之節拍動作(即對應之節拍觸發訊號設定資料所設定之節拍動作),一般來說,是提示文字如“雙手高舉”、“鈴鼓”、“我愛你”,或圖示或動畫以代表要做之動作或者要操作之設備。上述之節拍動作之具體實例可包括:發出特定聲音、做出特定動作、操作特定節拍設備以及如何操作節拍設備中之一種或多種。In this case, the beat effect label includes the beat trigger signal setting data and the corresponding prompt setting data. The corresponding prompt setting information is, for example, that the prompt effect signal set by the prompt setting data is associated with the specific type of the beat trigger signal set by the beat trigger signal setting data. At this time, the prompt effect signal is used to prompt the user to make what kind of beat action in time (that is, the beat action set by the corresponding beat trigger signal setting data), generally speaking, the prompt text is “hands up”, “ A tambourine, "I love you", or a graphic or animation to represent the action to be done or the device to be operated. Specific examples of the above-described beat action may include one or more of emitting a specific sound, making a specific action, operating a specific beat device, and operating a beat device.

當控制主機10於允許之時間誤差內接收到正確之節拍觸發訊號時,就生成預設之節拍特效。例如,於[00:24.00]前後使用者需要晃動鈴鼓才能啟動節拍特效,而於[01:28.00]前後則需要歡呼“我愛你”,才能觸發同一節拍特效。When the control panel 10 receives the correct beat trigger signal within the allowed time error, a preset beat effect is generated. For example, before [00:24.00], the user needs to shake the tambourine to start the beat effect, and before [01:28.00], you need to cheer "I love you" to trigger the same beat effect.

可以理解,節拍特效標籤內還可能包括節拍觸發訊號設定資料和對應之提示設定資料,同時還有對應之特效設定資料。此時,提示設定資料所設定之提示特效訊號可以同時提示使用者要做出之節拍動作以及及時做出正確之節拍動作後會顯示什麼樣之節拍特效,即提示特效訊號內可同時包括用於提示節拍動作之資訊以及提示節拍特效之資訊。例如,提示特效訊號內可包括兩個圖示,分別提示節拍動作以及節拍特效。It can be understood that the beat effect label may also include the beat trigger signal setting data and the corresponding prompt setting data, and the corresponding special effect setting data. At this time, the prompt effect signal set by the prompt setting data can simultaneously prompt the user to make a beat action and what kind of beat special effect is displayed after the correct beat action is performed in time, that is, the prompt special effect signal can be simultaneously included for Information about the beat action and information about the beat effect. For example, the prompt effect signal may include two icons, respectively prompting the beat action and the beat effect.

於以上所列舉之各個實施方式中,時間之表徵方式為時:分:秒,然而,本發明並不限於採用這種方式,例如,可以直接採用秒數、毫秒數、分鐘數等任意之單位來表徵。以開始時間00:24.00為例,換算成秒數則為1440,換算成毫秒數為1440000,直接以分鐘數表示即為24。時間設定資料中所記錄之時間資料還可以是對時間值進行各種可逆運算之結果,甚至可以進行加密運算。以上述之秒數1440為例,例如可以將其除以2得到720。亦即於時間設定資料中存儲之720,但實際上其表達之1440秒。可以理解,經過此運算後,若要計算某個節拍特效標籤之實際時間節點,需要進行逆向運算。In the various embodiments listed above, the time is represented by time: minute: second. However, the present invention is not limited to this method. For example, any unit such as seconds, milliseconds, minutes, etc. can be directly used. To characterize. Taking the start time 00:24.00 as an example, the number of seconds converted is 1440, and the number of milliseconds is 14.40 million, which is 24 in minutes. The time data recorded in the time setting data may also be the result of various reversible operations on the time value, and may even perform an encryption operation. Taking the above number of seconds 1440 as an example, for example, it can be divided by 2 to obtain 720. That is, 720 is stored in the time setting data, but in fact it is expressed in 1440 seconds. It can be understood that after this operation, in order to calculate the actual time node of a beat effect label, a reverse operation is required.

可以理解,無論經過何種處理,以上這些方式其本質仍然是透過於節拍特效標籤中定義一時間節點,並比較當前時間與定義之時間節點以獲取對應之節拍特效標籤之方式,因此,所有這些方式均應被包括於上述時間設定資料之範圍內。It can be understood that, regardless of the processing, the essence of the above methods is still to define a time node in the beat effect label, and compare the current time with the defined time node to obtain the corresponding beat effect label, therefore, all of these The method should be included in the scope of the above time setting data.

例如,於一具體之實施方式中,特效設定資料是採用預定義之協定或者語言對要實現之節拍特效之一種描述資料。此描述資料可以定義節拍特效之類型及參數。上述之類型例如可包括音訊、視頻、燈光或者其任意組合。上述之參數可包括具體之特效變化參數,例如要輸出之聲音、燈光之顏色、圖案及亮度之變化參數如速度、比例及範圍。For example, in a specific embodiment, the effect setting data is a description of a beat effect to be achieved using a predefined agreement or language. This description can define the type and parameters of the beat effect. The types described above may include, for example, audio, video, lighting, or any combination thereof. The above parameters may include specific effects of the specific parameters such as the sound to be output, the color of the light, the pattern and the brightness, such as speed, scale and range.

例如,於另一具體之實施方式中,特效設定資料是用於獲取節拍特效之其他格式之資料,例如,某個視頻特效檔之識別符。而此處之視頻特效檔可以是預存儲於與控制主機10相連之記憶體內,或者存儲於雲端伺服器內。控制主機10可以於記憶體內讀取該視頻檔,或者發起網路請求,從雲端伺服器處下載該視頻檔。For example, in another specific embodiment, the special effect setting data is information for obtaining other formats of the beat effect, for example, an identifier of a video special effect file. The video effect file here may be pre-stored in the memory connected to the control host 10 or stored in the cloud server. The control host 10 can read the video file in the memory or initiate a network request to download the video file from the cloud server.

可以理解,節拍特效資料集可以由專門之系統根據對每首歌曲之音訊資料分析結果自動生成,也可以由人工根據歌曲之內容編輯生成。但總體上,無論節拍特效資料集是如何製作,其目的在於提示使用者按照歌曲之節拍做出互動節拍動作,如果動作及時且正確,則透過音訊、視頻、燈光等方式來回應並於輸出一明顯,能夠被用戶感知之變化。It can be understood that the beat effect data set can be automatically generated by the special system according to the analysis result of the audio data of each song, or can be manually generated according to the content of the song. But in general, no matter how the beat special effects data set is made, the purpose is to prompt the user to make an interactive beat action according to the beat of the song. If the action is timely and correct, the voice, video, light, etc. are used to respond and output one. Obviously, the changes that can be perceived by the user.

控制主機10於播放多媒體檔時,或者於外部設備播放多媒體檔時同步從節拍特效資料集中根據時間節點獲取對應之節拍特效標籤,如從中解析出提示設定資料,則根據提示設定資料生成提示特效訊號並將提示特效訊號發送給提示特效輸出設備進行輸出,否則輸出預設之提示特效訊號。此處之提示特效輸出設備例如可為上述之多媒體視頻輸出裝置14、燈光特效裝置15以及視頻輸出裝置16中之一或多個。When the multimedia host file is played, or when the multimedia file is played by the external device, the corresponding special effect label is obtained from the beat special effect data set according to the time node, and if the prompt setting data is parsed, the prompt special effect signal is generated according to the prompt setting data. The prompt effect signal is sent to the prompt effect output device for output, otherwise the preset special effect signal is output. The prompt effect output device herein may be, for example, one or more of the multimedia video output device 14, the light effect device 15, and the video output device 16 described above.

使用者於看到提示特效訊號後,可以根據提示特效訊號之提示做出對應之節拍動作,例如擺動手臂、說出特定之語音內容、晃動鈴鼓等等。After the user sees the special effect signal, the user can make a corresponding beat action according to the prompt of the special effect signal, such as swinging the arm, speaking a specific voice content, shaking the tambourine, and the like.

相應地,節拍感應裝置12會感應到使用者之節拍動作。於感應到用戶之節拍動作之後,節拍感應裝置12生成節拍觸發訊號,並將節拍觸發訊號發送給控制主機10。Accordingly, the beat sensing device 12 senses the user's beat motion. After sensing the user's beat action, the beat sensing device 12 generates a beat trigger signal and transmits the beat trigger signal to the control host 10.

控制主機10於接收到節拍觸發訊號後計算當前時間是否與對應之節拍特效標籤內之時間節點相符,和節拍觸發訊號本身是否與上述之節拍特效標籤內之節拍觸發訊號設定資料一致,若是,則生成節拍特效訊號發送給特效輸出裝置進行輸出。After receiving the beat trigger signal, the control host 10 calculates whether the current time matches the time node in the corresponding beat effect label, and whether the beat trigger signal itself is consistent with the beat trigger signal setting data in the above-mentioned beat effect label, and if so, The beat effect signal is generated and sent to the effect output device for output.

具體地,控制主機10計算接收到節拍觸發訊號之時間與節拍特效標籤中之時間節點之差值,如果差值小於指定值則為及時。當節拍特效標籤內不包括節拍觸發訊號設定資料時,任意及時之節拍觸發訊號就被視為是正確之節拍觸發訊號;而當節拍特效標籤中包括節拍觸發訊號設定資料時,只有節拍觸發訊號設定資料所設定之節拍觸發訊號才是正確之節拍觸發訊號。Specifically, the control host 10 calculates the difference between the time when the beat trigger signal is received and the time node in the beat effect label, and is timely if the difference is less than the specified value. When the beat trigger signal setting data is not included in the beat effect label, any timely beat trigger signal is regarded as the correct beat trigger signal; and when the beat effect label includes the beat trigger signal setting data, only the beat trigger signal setting is set. The beat trigger signal set by the data is the correct beat trigger signal.

於一具體之實施方式中,節拍特效為音訊特效。如此,當感應到用戶之節拍動作及時又正確,即及時接收到正確之節拍觸發訊號時,可透過音訊輸出裝置13播放預設之或者當前之節拍特效標籤內特效設定資料所對應之音訊。In a specific implementation manner, the beat effect is an audio special effect. In this way, when the user's beat action is sensed in time and correctly, that is, when the correct beat trigger signal is received in time, the audio corresponding to the preset effect data in the preset or current beat effect label can be played through the audio output device 13.

於一具體之實施方式中,節拍特效為視頻特效。如此,當感應到用戶之節拍動作及時又正確,即及時接收到正確之節拍觸發訊號時,可透過視頻輸出裝置16播放預設之或者當前之節拍特效標籤內特效設定資料所對應之視頻特效。In a specific implementation manner, the beat effect is a video effect. In this way, when the user's beat action is sensed in time and correctly, that is, when the correct beat trigger signal is received in time, the video effect corresponding to the special effect setting data in the preset or current beat effect label can be played through the video output device 16.

於一具體之實施方式中,節拍特效為燈光特效。如此,當感應到用戶之節拍動作及時又正確,即及時接收到正確之節拍觸發訊號時,可透過燈光特效裝置15播放預設之或者當前之節拍特效標籤內特效設定資料所對應之燈光特效。In a specific embodiment, the beat effect is a lighting effect. In this way, when the user's beat action is sensed and correct, that is, when the correct beat trigger signal is received in time, the light effect corresponding to the special effect setting data in the preset or current beat effect label can be played through the light effect device 15.

進一步地,以上各種類型之特效還可以組合使用。亦即,一節拍特效標籤內可包括多種類型之特效,例如,可以包括聲音特效、視頻特效或者燈光特效之任意組合。Further, the above various types of special effects can also be used in combination. That is, the shot special effects label can include various types of special effects, for example, any combination of sound effects, video effects, or lighting effects.

進一步地,當接收到節拍觸發訊號且節拍特效標籤內包含節拍觸發訊號設定資料,則控制主機10還根據節拍觸發訊號之正確與否及時間準確性進行評分,於所述多媒體檔結束播放後所述控制主機對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。具體地,控制主機10可採用一函數,將接收節拍觸發訊號之時間與發出提示之時間節點之間之差值作為輸入,累計計算對應之評分,錯誤之節拍動作加一大之分數作為懲罰。可以理解,時間差值越小,累計之積分越少,成績越好。而具體之評分規則並不受任何限制。Further, when the beat trigger signal is received and the beat trigger signal setting data is included in the beat effect label, the control host 10 further scores according to the correctness of the beat trigger signal and the time accuracy, after the multimedia file ends playing. The control host summarizes the scores to obtain an overall rating, and each score and the overall score are output through the effect output device. Specifically, the control host 10 may use a function to input the difference between the time when the beat trigger signal is received and the time node that issued the prompt, and calculate the corresponding score cumulatively, and the wrong beat action plus a large score as a penalty. It can be understood that the smaller the time difference, the less accumulated points and the better the score. The specific scoring rules are not subject to any restrictions.

本實施方式之互動節拍特效系統於播放多媒體檔時還獲取與多媒體檔對應之節拍特效資料集,節拍特效資料集中包括分別針對不同時間節點之節拍特效標籤,於播放音樂之過程中顯示提示資訊,讓使用者於指定之時間節點做出對應之節拍動作,當於播放音樂之過程中感應到用戶之節拍動作時且用戶之節拍動作與節拍特效標籤之設定相匹配,控制主機透過音訊、視頻或者燈光等方式輸出一明顯之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能,尤其適用於KTV等場合。而且節拍訊號除由專門之電子設備觸發外,使用者於KTV裡之常見操作例如搖動鈴鼓都可以觸發節拍動作,因此可以讓用戶無需學習就能自然之啟動節拍特效,提升用戶於KTV房間裡之使用感受。The interactive beat special effect system of the embodiment also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes the beat special effect labels for different time nodes respectively, and displays the prompt information during the playing of the music. Let the user make a corresponding beat action at the designated time node. When the user's beat action is sensed during the playing of the music and the user's beat action matches the setting of the beat special effect label, the control host transmits the audio, video or Lights and other methods output an obvious beat effect, which visualizes the user's beat action and enhances the interactive function of the multimedia file playback system, especially for KTV and other occasions. Moreover, besides the triggering of the special electronic device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings.

第二實施方式Second embodiment

參閱圖4,其為本發明第二實施方式提供之互動節拍特效系統200之示意圖。本實施方式之互動節拍特效系統200與圖1之互動節拍特效系統相似,其不同之處在於還包括:外部設備20。Referring to FIG. 4, it is a schematic diagram of an interactive beat special effect system 200 according to a second embodiment of the present invention. The interactive beat special effect system 200 of the present embodiment is similar to the interactive beat special effect system of FIG. 1 except that the external device 20 is further included.

外部設備20例如可為安裝有點歌應用程式之電腦。點歌面板11、音訊輸出裝置13及多媒體視頻輸出裝置14是與外部設備20相連。從而,點歌面板11、音訊輸出裝置13及多媒體視頻輸出裝置14與外部設備20自身構成一常見之可用於KTV等場合之多媒體點播系統。節拍感應裝置12、視頻輸出裝置16與燈光特效裝置15仍然與控制主機10相連。The external device 20 can be, for example, a computer that installs a song app. The karaoke panel 11, the audio output device 13, and the multimedia video output device 14 are connected to the external device 20. Thus, the song panel 11, the audio output device 13, and the multimedia video output device 14 and the external device 20 themselves constitute a common multimedia on-demand system that can be used in KTV and the like. The beat sensing device 12, the video output device 16 and the light effect device 15 are still connected to the control host 10.

本實施方式中,外部設備20例如為傳統之點歌系統主機,其實現點歌以及歌曲之播放控制功能。但相比于傳統之點歌系統主機,其進一步與控制主機10相連。每當外部設備20播放一首歌曲或者一首歌曲被添加至播放清單中時,外部設備20會將歌曲之標識發送給控制主機10。In the present embodiment, the external device 20 is, for example, a conventional karaoke system host, which implements a song control function of songs and songs. However, it is further connected to the control host 10 compared to the conventional VOD system host. Whenever the external device 20 plays a song or a song is added to the playlist, the external device 20 transmits the identification of the song to the control host 10.

可以理解,為讓外部設備20可以向控制主機10發送特定之資訊,可以於控制主機10中公開特定之應用程式設計發展介面(API),從而可讓外部設備20進行調用,而向控制主機10發送上述之資訊。每當外部設備20播放一首歌曲時外部設備20可將歌曲之標識以及開始播放之時間透過上述之API提交給控制主機10。當然,外部設備20要實現API之調用,需要對現有點歌播放程式稍做修改,使得於需要時透過API與控制主機10同步資訊。It can be understood that in order for the external device 20 to send specific information to the control host 10, a specific application design development interface (API) can be disclosed in the control host 10, so that the external device 20 can make a call to the control host 10. Send the above information. Whenever the external device 20 plays a song, the external device 20 can submit the identification of the song and the time when the playback starts to the control host 10 via the API described above. Of course, in order to implement the API call, the external device 20 needs to slightly modify the existing karaoke player so that the information is synchronized with the control host 10 through the API when needed.

控制主機10於接收到外部設備20同步之歌曲資訊後,獲取與歌曲對應之節拍特效資料集,並開始監測來自節拍感應裝置12之節拍觸發訊號,當接收到來自節拍感應裝置12之及時且正確之節拍觸發訊號後控制主機10根據當前之節拍特效標籤生成節拍特效,並進一步透過燈光特效裝置15輸出節拍特效。After receiving the song information synchronized by the external device 20, the control host 10 acquires the beat effect data set corresponding to the song, and starts monitoring the beat trigger signal from the beat sensing device 12, when receiving the timely and correct from the beat sensing device 12 After the beat trigger signal, the control host 10 generates a beat effect according to the current beat effect label, and further outputs the beat effect through the light effect device 15.

於本實施方式中,音訊輸出裝置13、以及多媒體視頻輸出裝置14還可以同時輸出來自外部設備20之音視頻和來自控制主機10之節拍特效。以音訊為例,此時需要另外設置音訊疊加設備,其包括兩個輸入端,分別與外部設備20以及控制主機10之音訊輸出埠相連,音訊疊加設備之輸出埠與音訊輸出裝置13之音訊輸入口相連。音訊疊加設備透過音訊處理技術將外部設備20以及控制主機10輸出之音訊疊加至一起,然後傳輸給音訊輸出裝置13進行輸出。與音訊類似,如果要實現視頻疊加,此時需要另外設置視頻疊加設備。In the present embodiment, the audio output device 13 and the multimedia video output device 14 can simultaneously output audio and video from the external device 20 and beat effects from the control host 10. In the case of audio, for example, an audio superimposing device is additionally provided, which includes two input terminals respectively connected to the external device 20 and the audio output port of the control host 10, and the output of the audio superimposing device and the audio input device 13 are used for audio input. The mouth is connected. The audio superimposing device superimposes the audio outputted by the external device 20 and the control host 10 through the audio processing technology, and then transmits the audio to the audio output device 13 for output. Similar to audio, if you want to achieve video overlay, you need to set up a video overlay device.

根據本實施方式之互動節拍特效系統,透過對現有之點歌系統軟體稍加改進,就可以實現節拍特效功能,最大程度之相容現有設備,避免設備升級帶來之成本增加。According to the interactive beat special effect system of the present embodiment, by slightly improving the existing software of the song system, the beat special effect function can be realized, and the existing equipment can be compatible to the greatest extent, and the cost increased by the equipment upgrade can be avoided.

特別地,當控制主機10是一智慧電子設備時,安裝於所述智慧電子設備中之軟體,可以透過無線控制音訊輸出裝置13、燈光特效裝置15和視頻輸出裝置16以輸出節拍特效,也可以透過無線訪問網路上之節拍特效資料集,同時,透過內置麥克風錄取透過外部設備20播放出來之歌曲聲音,再透過特徵採樣及特徵匹配,直接識別出外部設備20所放之歌曲,從而無需與外部設備20通信就能夠獲得歌曲之標識,然後下載對應之節拍特效資料集。In particular, when the control host 10 is a smart electronic device, the software installed in the smart electronic device can wirelessly control the audio output device 13, the light effect device 15 and the video output device 16 to output a beat effect, or By wirelessly accessing the beat effect data set on the network, the song sound played through the external device 20 is recorded through the built-in microphone, and the songs placed by the external device 20 are directly recognized through feature sampling and feature matching, thereby eliminating the need for external The device 20 can communicate to obtain the logo of the song, and then download the corresponding beat effect data set.

第三實施方式Third embodiment

參閱圖5,其為本發明第三實施方式提供之互動節拍特效系統300之示意圖。本實施方式之互動節拍特效系統300與圖1之互動節拍特效系統100相似,其不同之處在於,還包括雲端伺服器系統20。Referring to FIG. 5, it is a schematic diagram of an interactive beat special effect system 300 according to a third embodiment of the present invention. The interactive beat special effect system 300 of the present embodiment is similar to the interactive beat special effect system 100 of FIG. 1 except that it also includes a cloud server system 20.

具體地,雲端伺服器系統20包括資料庫22以及伺服器24。其中,資料庫22用於存儲不同歌曲之節拍特效資料集。伺服器24用於根據用戶端(如控制主機10)之請求返回節拍特效資料集給用戶端。Specifically, the cloud server system 20 includes a database 22 and a server 24. The database 22 is used to store a beat effect data set of different songs. The server 24 is configured to return a beat effect data set to the client according to the request of the user end (such as the control host 10).

圖6示出上述之伺服器24之一實施方式之結構框圖。如圖6所示,伺服器包括記憶體102、存儲控制器104,一或多個(圖中僅示出一)處理器106、外設介面108、以及網路模組110。這些元件透過一條或多條通訊匯流排/訊號線相互通訊。FIG. 6 shows a block diagram of an embodiment of the above-described server 24. As shown in FIG. 6, the server includes a memory 102, a memory controller 104, one or more (only one shown) processor 106, a peripheral interface 108, and a network module 110. These components communicate with one another via one or more communication bus/signal lines.

可以理解,圖6所示之結構僅為示意,上述伺服器還可包括比圖6中所示更多或者更少之元件,或者具有與圖6所示不同之配置。圖6中所示之各元件可以採用硬體、軟體或其組合實現。It can be understood that the structure shown in FIG. 6 is merely illustrative, and the above server may further include more or less elements than those shown in FIG. 6, or have a configuration different from that shown in FIG. 6. The elements shown in Figure 6 can be implemented in hardware, software, or a combination thereof.

記憶體102可用於存儲軟體程式以及模組,如本發明實施方式中之各方法及裝置對應之程式指令/模組,處理器106透過運行存儲於記憶體102內之軟體程式以及模組,從而執行各種功能應用以及資料處理,即實現上述之方法。The memory 102 can be used to store software programs and modules, such as the program instructions/modules corresponding to the methods and devices in the embodiments of the present invention. The processor 106 runs the software programs and modules stored in the memory 102, thereby The above methods are implemented by performing various functional applications and data processing.

記憶體102可包括高速隨機記憶體,還可包括非易失性記憶體,如一或者多個磁性存儲裝置、快閃記憶體、或者其他非易失性固態記憶體。於一些實例中,記憶體102可進一步包括相對於處理器106遠端設置之記憶體,這些遠端存放器可以透過網路連接至上述伺服器。上述網路之實例包括但不限於互聯網、企業內部網、局域網、移動通信網及其組合。處理器106以及其他可能之元件對記憶體102之訪問可於存儲控制器104之控制下進行。The memory 102 can include high speed random memory and can also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 102 can further include memory disposed remotely relative to processor 106, which can be connected to the server via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof. Access to the memory 102 by the processor 106 and other possible components can be performed under the control of the memory controller 104.

外設介面108將各種輸入/輸出裝置耦合至處理器106。處理器106運行記憶體102內之各種軟體、指令上述伺服器執行各種功能以及進行資料處理。於一些實施方式中,外設介面108、處理器106以及存儲控制器104可以於單個晶片中實現。於其他一些實例中,他們可以分別由獨立之晶片實現。Peripheral interface 108 couples various input/output devices to processor 106. The processor 106 runs various software in the memory 102, instructs the server to perform various functions, and performs data processing. In some embodiments, peripheral interface 108, processor 106, and memory controller 104 can be implemented in a single wafer. In other instances, they can be implemented separately from separate wafers.

網路模組110用於接收以及發送網路訊號。上述網路訊號可包括無線訊號或者有線訊號。於一實例中,上述網路訊號為有線網路訊號。此時,網路模組110可包括處理器、隨機記憶體、轉換器、晶體振盪器等元件。於一實施方式中,上述之網路訊號為無線訊號(例如射頻訊號)。此時網路模組110實質是射頻模組,接收以及發送電磁波,實現電磁波與電訊號之相互轉換,從而與通訊網路或者其他設備進行通訊。射頻模組可包括各種現有之用於執行這些功能之電路元件,例如,天線、射頻收發器、數位訊號處理器、加密/解密晶片、使用者身份模組(SIM)卡、記憶體等等。射頻模組可與各種網路如互聯網、企業內部網、無線網路進行通訊或者透過無線網路與其他設備進行通訊。上述之無線網路可包括蜂窩式電話網、無線局域網或者都會區網路。上述之無線網路可以使用各種通信標準、協定及技術,包括但並不限於全球移動通信系統(Global System for Mobile Communication, GSM)、增強型移動通信技術(Enhanced Data GSM Environment, EDGE),寬頻碼分多址技術(wideband code division multiple access, W-CDMA),碼分多址技術(Code division access, CDMA)、時分多址技術(time division multiple access, TDMA),無線保真技術(Wireless, Fidelity, WiFi)(如美國電氣和電子工程師協會標準 IEEE 802.11a, IEEE 802.11b, IEEE802.11g 和/或 IEEE 802.11n)、網路電話(Voice over internet protocal, VoIP)、全球微波互聯接入(Worldwide Interoperability for Microwave Access, Wi-Max)、其他用於郵件、即時通訊及短消息之協定,以及任何其他合適之通訊協定,甚至可包括那些當前仍未被開發出來之協定。The network module 110 is configured to receive and send network signals. The above network signals may include wireless signals or wired signals. In one example, the network signal is a wired network signal. At this time, the network module 110 may include components such as a processor, a random memory, a converter, a crystal oscillator, and the like. In one embodiment, the network signal is a wireless signal (eg, an RF signal). At this time, the network module 110 is essentially a radio frequency module, which receives and transmits electromagnetic waves, and realizes mutual conversion between electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The radio frequency module can include various existing circuit components for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a user identity module (SIM) card, a memory, and the like. The RF module can communicate with various networks such as the Internet, intranets, wireless networks or with other devices over a wireless network. The wireless network described above may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code. Wideband code division multiple access (W-CDMA), Code division access (CDMA), time division multiple access (TDMA), wireless fidelity (Wireless, Fidelity, WiFi) (such as the Institute of Electrical and Electronics Engineers Standard IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over internet protocal (VoIP), Worldwide Interoperability for Microwave Access ( Worldwide Interoperability for Microwave Access, Wi-Max), other agreements for mail, instant messaging and short messages, and any other suitable communication protocols, even those that are not currently under development.

上述之軟體程式以及模組包括:作業系統112、以及服務模組114。作業系統112其可包括各種用於管理系統任務(例如記憶體管理、存放裝置控制、電源管理等)之軟體元件和/或驅動,並可與各種硬體或軟體元件相互通訊,從而提供其他軟體元件之運行環境。服務模組114運行於作業系統112之基礎上,用於實現對互動節拍特效系統之節拍特效資料集之傳輸控制功能,具體描述如下。The software program and module described above include an operating system 112 and a service module 114. The operating system 112 may include various software components and/or drivers for managing system tasks (eg, memory management, storage device control, power management, etc.) and may communicate with various hardware or software components to provide other software. The operating environment of the component. The service module 114 runs on the basis of the operating system 112, and is used to implement the transmission control function of the beat special effect data set of the interactive beat special effect system, which is described in detail below.

服務模組114包括身份校驗模組116、特效傳輸模組118以及資訊傳輸模組130。The service module 114 includes an identity verification module 116, a special effect transmission module 118, and an information transmission module 130.

身份校驗模組116用於用戶端進行身份校驗。於一具體之實施方式中,每個控制主機10內存儲有身份認證資訊,例如,主機ID之加密字串。於向服務模組114發起節拍特效資料集獲取請求前,控制主機10可以發起登陸請求,將身份認證資訊發送給伺服器24。相應地,伺服器24之身份校驗模組116根據預定之加密演算法及金鑰對身份認證資訊進行解密,並驗證該主機ID是否具有獲取節拍特效資料集之許可權。例如,檢索該主機ID對應之繳費標記,若該主機ID並未繳納節拍特效資料集之使用費,則該主機ID不具有獲取節拍特效資料集之許可權,控制主機10之身份認證不透過。相應地,特效傳輸模組128會拒絕控制主機10之獲取節拍特效資料集之請求。The identity verification module 116 is used for identity verification by the UE. In a specific implementation, each control host 10 stores identity authentication information, such as an encrypted string of host IDs. Before initiating the beat effect data set acquisition request to the service module 114, the control host 10 may initiate a login request and send the identity authentication information to the server 24. Correspondingly, the identity verification module 116 of the server 24 decrypts the identity authentication information according to the predetermined encryption algorithm and the key, and verifies whether the host ID has the permission to acquire the beat special effect data set. For example, the payment identifier corresponding to the host ID is retrieved. If the host ID does not pay the usage fee of the beat special effect data set, the host ID does not have the permission to acquire the beat special effect data set, and the identity authentication of the control host 10 is not transparent. Accordingly, the effect transmission module 128 rejects the request to control the host 10 to acquire the beat effect data set.

如果某個主機ID具有獲取節拍特效資料集之許可權時,特效傳輸模組128就會根據控制主機10之請求返回對應之節拍特效資料集。可以理解,控制主機10可以於開始播放某首歌曲或者其他多媒體檔之時候,或者歌曲進入播放清單後即發起上述之登陸校驗請求以及節拍特效資料集獲取請求,並將要播放之歌曲之識別符包括於上述之節拍特效資料集之獲取請求內。If a host ID has permission to acquire a beat effect data set, the effect transmission module 128 returns a corresponding beat effect data set according to the request of the control host 10. It can be understood that the control host 10 can initiate the above-mentioned login verification request and the beat special effect data set acquisition request when starting a certain song or other multimedia file, or after the song enters the playlist, and the identifier of the song to be played. It is included in the request for acquisition of the above-mentioned beat effect data set.

可以理解,從伺服器24下載節拍特效資料集需要耗費一定之時間,因此如果歌曲開始播放時才開始下載上述之節拍特效資料集,則於節拍特效資料集下載完成後進行節拍特效播放時需要考慮去除下載時間對時間線之影響。具體地,如果歌曲播放後時間T時完成節拍特效資料集之下載並開始播放,則節拍特效之時間線會從時間T處開始,而不是從頭開始以實現與多媒體檔之時間線之同步。這要求控制主機10記錄多媒體檔開始播放之時間以及節拍特效資料集下載完成之時間,兩者之時間差即為上述之時間T。It can be understood that it takes a certain time to download the beat effect data set from the server 24. Therefore, if the above-mentioned beat effect data set is started to be downloaded when the song starts playing, it is necessary to consider the beat special effect play after the download of the beat special effect data set is completed. Remove the impact of download time on the timeline. Specifically, if the download of the beat effect data set is completed and the playback starts when the song is played at time T, the timeline of the beat effect starts from time T instead of starting from the beginning to synchronize with the timeline of the multimedia file. This requires the control host 10 to record the time when the multimedia file starts to play and the time when the beat effect data set is downloaded. The time difference between the two is the time T described above.

當每首多媒體檔一旦被添加至待播放清單裡時,控制主機10就可以開始下載對應之節拍特效資料集。採用這種方式,只有播放清單裡之第一首多媒體檔之節拍特效資料集需要調整時間線,而後續所有歌曲之節拍特效資料集可以是於其他歌曲播放之同時於後臺進行下載,因此,於要播放時其節拍特效資料集一般已經下載完成,節拍特效可以與視頻、音訊同步播放,無須再調整時間線。When each multimedia file is added to the to-be-played list, the control host 10 can start downloading the corresponding beat effect data set. In this way, only the beat effect data set of the first multimedia file in the playlist needs to adjust the timeline, and the beat effect data set of all subsequent songs can be downloaded in the background while other songs are played, therefore, When you want to play, its beat effect data set has been downloaded, and the beat effect can be played synchronously with video and audio. There is no need to adjust the timeline.

可以理解,當歌曲暫停時,控制主機10同步會將節拍特效也暫停。It can be understood that when the song is paused, the control host 10 will also pause the beat effect.

根據本實施方式之互動節拍特效系統,節拍特效資料集存儲於雲端伺服器系統20中,可以保證節拍特效資料集僅供授權之用戶訪問,提升節拍特效資料集之安全性。According to the interactive beat special effect system of the embodiment, the beat special effect data set is stored in the cloud server system 20, and the beat special effect data set can be ensured only for authorized users to access, and the security of the beat special effect data set is improved.

第四實施方式Fourth embodiment

參閱圖7,其為本發明第四實施方式提供之獲取節拍特效資料集之方法流程圖。如圖7所示,本實施之方法包括以下步驟:Referring to FIG. 7, which is a flowchart of a method for acquiring a beat special effect data set according to a fourth embodiment of the present invention. As shown in FIG. 7, the method of the present implementation includes the following steps:

步驟S101,播放多媒體檔;Step S101, playing a multimedia file;

多媒體檔例如可由控制主機10播放,或者由外部設備20進行播放。The multimedia file can be played, for example, by the control host 10 or by the external device 20.

步驟S102,獲取與所述多媒體檔對應之節拍特效資料集。Step S102: Acquire a beat special effect data set corresponding to the multimedia file.

節拍特效資料集例如可包括上述之節拍特效標籤,每個節拍特效標籤包括時間設定資料以及特效設定資料。當然,無論節拍特效資料集之內容為何,其獲取過程是相似之。The beat effect data set may include, for example, the beat effect label described above, and each beat special effect label includes time setting data and special effect setting data. Of course, regardless of the content of the beat special effects data set, the acquisition process is similar.

具體地,步驟S102可包括:步驟S1022,從所述多媒體檔內解析出內嵌於所述多媒體檔內之所述節拍特效資料集。Specifically, step S102 may include: step S1022, parsing, from the multimedia file, the beat effect data set embedded in the multimedia file.

根據這種方式,節拍特效資料集是內嵌於多媒體檔內,可以與多媒體檔一併保存,降低系統之複雜性。According to this method, the beat effect data set is embedded in the multimedia file, and can be saved together with the multimedia file, thereby reducing the complexity of the system.

另外,步驟S102還可包括:步驟S1024,從雲端伺服器處下載節拍特效資料集。In addition, step S102 may further include: step S1024, downloading a beat effect data set from the cloud server.

進一步參閱圖8,步驟S1024具體可包括以下步驟:With further reference to FIG. 8, step S1024 may specifically include the following steps:

步驟S201,將身份認證資訊發送給所述雲端伺服器系統,以使所述雲端伺服器系統統驗證是否具有獲取節拍特效資料集之許可權;Step S201: Send identity authentication information to the cloud server system, so that the cloud server system can verify whether the permission to acquire the beat special effect data set is obtained;

步驟S202,根據所述多媒體檔之標識向雲端伺服器系統發送獲取所述對應之節拍特效資料集之請求;以及Step S202, sending, according to the identifier of the multimedia file, a request for acquiring the corresponding beat effect data set to the cloud server system;

步驟S203,接收所述雲端伺服器系統返回之所述節拍特效資料集;Step S203, receiving the beat special effect data set returned by the cloud server system;

根據這種方式,節拍特效資料集存儲於雲端伺服器系統20中,可以保證只有授權之用戶才能夠訪問節拍特效資料集,提升節拍特效資料集之安全性。According to this manner, the beat special effect data set is stored in the cloud server system 20, which can ensure that only authorized users can access the beat special effect data set, and improve the security of the beat special effect data set.

根據本實施方式之方法,於播放多媒體檔時,還獲取與多媒體檔對應之節拍特效資料集,所述節拍特效資料集可用于生成節拍特效訊號,進而可以輸出節拍特效。According to the method of the embodiment, when the multimedia file is played, a beat special effect data set corresponding to the multimedia file is also acquired, and the beat special effect data set can be used to generate a beat special effect signal, thereby outputting a beat special effect.

第五實施方式Fifth embodiment

參閱圖9,本實施方式提供一種互動節拍特效處理方法,其可用於圖1、圖4或圖5所示之互動節拍特效系統中。如圖9所示,本實施方式之方法包括以下步驟:Referring to FIG. 9, the embodiment provides an interactive beat special effect processing method, which can be used in the interactive beat special effect system shown in FIG. 1, FIG. 4 or FIG. 5. As shown in FIG. 9, the method of this embodiment includes the following steps:

步驟S401,於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點;In step S401, when the multimedia file is played, or when the multimedia file is played by the external device, the beat effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Including time nodes;

步驟S402,於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處生成系統預設之提示特效訊號;Step S402, synchronously acquiring a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, and generating a system preset prompt special effect signal at the time node;

步驟S403,輸出所述提示特效訊號以提示使用者及時做出節拍動作;Step S403, outputting the prompt special effect signal to prompt the user to make a beat action in time;

步驟S404,當感應到用戶節拍動作後生成節拍觸發訊號;Step S404, generating a beat trigger signal after sensing the user's beat motion;

步驟S405,如果及時接收到節拍觸發訊號,則生成節拍特效訊號;以及Step S405, if a beat trigger signal is received in time, a beat special effect signal is generated;

步驟S406,根據所述節拍特效訊號輸出對應之節拍特效。Step S406, outputting a corresponding beat effect according to the beat effect signal.

根據本實施方式之方法,於播放多媒體檔時,根據節拍特效資料集內之節拍特效標籤生成預設之提示特效訊號提示使用者及時做出節拍動作,當用戶及時完成節拍動作時,就輸出對應之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能。According to the method of the embodiment, when the multimedia file is played, the preset special effect signal is generated according to the beat special effect label in the beat special effect data set to prompt the user to make a beat action in time, and when the user completes the beat action in time, the corresponding output is output. The beat effect is specially designed to visualize the user's beat action and enhance the interactive function of the multimedia file playback system.

第六實施方式Sixth embodiment

參閱圖10,本實施方式提供一種互動節拍特效處理方法,其可用於圖1、圖4或圖5所示之互動節拍特效系統中。如圖10所示,本實施方式之方法包括以下步驟:Referring to FIG. 10, the embodiment provides an interactive beat special effect processing method, which can be used in the interactive beat special effect system shown in FIG. 1, FIG. 4 or FIG. 5. As shown in FIG. 10, the method of this embodiment includes the following steps:

步驟S401a,於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點、特效設定資料以及對應之提示設定資料;In step S401, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Including time node, special effect setting data and corresponding prompt setting data;

步驟S402a,於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處根據與特效設定資料對應之提示設定資料生成對應之提示特效訊號;Step S402a, synchronously acquiring a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, and generating a corresponding prompt special effect signal according to the prompt setting data corresponding to the special effect setting data at the time node;

步驟S403a,輸出所述提示特效訊號以提示使用者及時做出節拍動作以及用戶做出節拍動作後會有何種節拍特效;Step S403a, outputting the prompt special effect signal to prompt the user to make a beat action in time and what kind of beat special effect the user will make after the beat action is performed;

步驟S404,當感應到用戶節拍動作後生成節拍觸發訊號;Step S404, generating a beat trigger signal after sensing the user's beat motion;

步驟S405,如果及時接收到節拍觸發訊號,則生成節拍特效訊號;以及Step S405, if a beat trigger signal is received in time, a beat special effect signal is generated;

步驟S406,根據所述節拍特效訊號輸出對應之節拍特效。Step S406, outputting a corresponding beat effect according to the beat effect signal.

根據本實施方式之方法,於播放多媒體檔時,根據節拍特效資料集內之節拍特效標籤生成與其中特效設定資料對應之提示特效訊號提示使用者及時做出節拍動作以及用戶做出節拍動作後會有何種節拍特效,當用戶及時完成節拍動作時,就輸出對應之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能,更讓用戶及時瞭解會有何種節拍特效,從而可選擇性之做不做節拍動作。According to the method of the embodiment, when the multimedia file is played, the prompt special effect signal corresponding to the special effect setting data is generated according to the beat special effect label in the beat special effect data set, and the user is prompted to make the beat action in time and the user makes the beat action. What kind of beat special effects, when the user completes the beat action in time, the corresponding beat effect is output, thereby visualizing the user's beat action, enhancing the interactive function of the multimedia file play system, and letting the user know in time which beat effect Therefore, it is optional to do the beat action.

第七實施方式Seventh embodiment

參閱圖11,本實施方式提供一種互動節拍特效處理方法,其可用於圖1、圖4或圖5所示之互動節拍特效系統中。如圖11所示,本實施方式之方法包括以下步驟:Referring to FIG. 11, the embodiment provides an interactive beat special effect processing method, which can be used in the interactive beat special effect system shown in FIG. 1, FIG. 4 or FIG. 5. As shown in FIG. 11, the method of this embodiment includes the following steps:

步驟S401b,於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點、節拍觸發訊號設定資料以及對應之提示設定資料;In step S401b, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Including time node, beat trigger signal setting data and corresponding prompt setting data;

步驟S402b,於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處根據與節拍觸發訊號設定資料對應之提示設定資料生成對應之提示特效訊號;Step S402b: synchronously acquiring a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, and generating a corresponding prompt special effect signal according to the prompt setting data corresponding to the beat trigger signal setting data at the time node;

步驟S403b,輸出所述提示特效訊號以提示使用者及時做出正確之節拍動作;Step S403b, outputting the prompt special effect signal to prompt the user to make a correct beat action in time;

步驟S404,當感應到用戶節拍動作後生成節拍觸發訊號;Step S404, generating a beat trigger signal after sensing the user's beat motion;

步驟S405b,如果及時接收到正確之節拍觸發訊號,則生成節拍特效訊號;以及Step S405b, if a correct beat trigger signal is received in time, a beat special effect signal is generated;

步驟S406,根據所述節拍特效訊號輸出對應之節拍特效。Step S406, outputting a corresponding beat effect according to the beat effect signal.

根據本實施方式之方法,於播放多媒體檔時,根據節拍特效資料集內之節拍特效標籤生成與其中節拍觸發設定資料對應之提示特效訊號提示使用者及時做出節拍動作以及用戶應做出何種節拍動作,當用戶及時完成正確之節拍動作時,就輸出對應之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能。According to the method of the embodiment, when the multimedia file is played, the prompt special effect signal corresponding to the beat trigger setting data is generated according to the beat special effect label in the beat special effect data set to prompt the user to make the beat action in time and what the user should make. The beat action, when the user completes the correct beat action in time, outputs the corresponding beat effect, thereby visualizing the user's beat action and enhancing the interactive function of the multimedia file play system.

第八實施方式Eighth embodiment

參閱圖12,本實施方式提供一種互動節拍特效處理方法中生成並輸出提示特效訊號之方法流程圖。如圖12所示,本實施方式之方法包括以下步驟:Referring to FIG. 12, the embodiment provides a flowchart of a method for generating and outputting a prompt effect signal in an interactive beat effect processing method. As shown in FIG. 12, the method of this embodiment includes the following steps:

步驟S501,根據當前時間獲取一節拍特效標籤。Step S501: Acquire a one-shot special effect label according to the current time.

如上所述,於播放多媒體檔時,會首先獲取節拍特效資料集。於步驟S501中,若當前時間與某一節拍特效標籤內之時間節點相等之時候就獲取該節拍特效標籤,然後對該節拍特效標籤內包含之資料進行解析。As described above, when playing a multimedia file, the beat effect data set is first acquired. In step S501, if the current time is equal to the time node in a certain beat effect label, the beat effect label is acquired, and then the data included in the beat effect label is parsed.

步驟S502,判斷獲取之節拍特效標籤內是否包括提示設定資料,若是,則執行步驟S503,否則執行步驟S504。In step S502, it is determined whether the prompt setting data is included in the acquired beat effect label, and if yes, step S503 is performed, otherwise step S504 is performed.

步驟S503,根據提示設定資料生成並輸出對應之提示特效訊號。Step S503, generating and outputting a corresponding prompt effect signal according to the prompt setting data.

步驟S504,生成並輸出預設之提示特效訊號。Step S504, generating and outputting a preset prompt effect signal.

於步驟S503中,依據提示設定資料生成對應之提示特效訊號。具體地,步驟S503例如可包括:In step S503, a corresponding reminder effect signal is generated according to the prompt setting data. Specifically, step S503 may include, for example:

步驟S5032,提示使用者要做何種節拍動作;Step S5032, prompting the user what kind of beat action to be performed;

步驟S5034,提示使用者及時做出正確之節拍動作後會出現何種節拍特效。Step S5034, prompting the user to make a correct beat effect after the correct beat action is made in time.

參閱圖13,於步驟S5032中,例如可顯示文字601,提示使用者喊出對應之內容“我愛你”,而於步驟S5034中,例如可顯示圖示602,提示使用者若及時喊出與文字601對應之內容,會出現何種節拍特效,例如一心形之動畫。可以理解,圖13所示之介面例如是多媒體視頻輸出裝置14所輸出之視頻主畫面,而提示特效訊號是被疊加於視頻主畫面上。Referring to FIG. 13, in step S5032, for example, the character 601 can be displayed to prompt the user to call out the corresponding content "I love you", and in step S5034, for example, a graphic 602 can be displayed to prompt the user to promptly shout out What is the corresponding content of the text 601, such as a heart-shaped animation. It can be understood that the interface shown in FIG. 13 is, for example, a video main screen output by the multimedia video output device 14, and the prompt effect signal is superimposed on the video main screen.

於步驟S503中,也可僅包括步驟S5032或者僅包括步驟S5034。而且,文字601或者圖示602也可以採用其他形式進行替換,例如顯示其他文字、圖示或者動畫。In step S503, only step S5032 or only step S5034 may be included. Moreover, the text 601 or the graphic 602 may be replaced with other forms, such as displaying other text, graphics, or animations.

根據本實施方式之方法,會自動根據節拍特效標籤內是否包括提示設定資料生成不同之提示特效訊號,提示使用者及時做出節拍動作以及用戶做出何種節拍動作,當用戶及時完成正確之節拍動作時,就輸出對應之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能。According to the method of the embodiment, different prompt effect signals are automatically generated according to whether the prompt setting data is included in the beat special effect label, prompting the user to make a beat action in time and what kind of beat action the user makes, when the user completes the correct beat in time. When the action is performed, the corresponding beat effect is output, thereby visualizing the user's beat action and enhancing the interactive function of the multimedia file play system.

本發明實施方式之互動節拍特效系統於播放多媒體檔時還獲取與多媒體檔對應之節拍特效資料集,節拍特效資料集中包括分別針對不同時間節點之節拍特效標籤,於播放音樂之過程中顯示提示資訊,讓使用者於指定之時間節點做出對應之節拍動作,當於播放音樂之過程中感應到用戶之節拍動作時且用戶之節拍動作與節拍特效標籤之設定相匹配,控制主機透過音訊、視頻或者燈光等方式輸出一明顯之節拍特效,從而將用戶之節拍動作視覺化,提升多媒體檔播放系統之互動功能,尤其適用於KTV等場合。而且節拍訊號除由專門之電子設備觸發外,使用者於KTV裡之常見操作例如搖動鈴鼓都可以觸發節拍動作,因此可以讓用戶無需學習就能自然之啟動節拍特效,提升用戶於KTV房間裡之使用感受。The interactive beat special effect system of the embodiment of the present invention also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes the beat special effect labels for different time nodes respectively, and displays the prompt information during the playing of the music. Allowing the user to make a corresponding beat action at the specified time node. When the user's beat action is sensed during the playing of the music and the user's beat action matches the setting of the beat special effect label, the control host transmits the audio and video. Or a light and other means to output an obvious beat effect, thereby visualizing the user's beat action, and enhancing the interactive function of the multimedia file playback system, especially for KTV and other occasions. Moreover, besides the triggering of the special electronic device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings.

此外,本發明實施方式還提供一種電腦可讀存儲介質,其內存儲有電腦可執行指令,上述之電腦可讀存儲介質例如為非易失性記憶體例如光碟、硬碟、或者快閃記憶體。上述之電腦可執行指令用於讓電腦或者類似之運算裝置完成上述實施方式中之方法。In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, such as a non-volatile memory such as a compact disk, a hard disk, or a flash memory. . The computer executable instructions described above are used to cause a computer or similar computing device to perform the methods of the above embodiments.

以上所述,僅是本發明之較佳實施方式而已,並非對本發明作任何形式上之限制,雖然本發明已以較佳實施方式揭示如上,然而並非用以限定本發明,任何本領域技術人員,於不脫離本發明技術方案範圍內,當可利用上述揭示之技術內容做出些許更動或修飾為等同變化之等效實施方式,但凡是未脫離本發明技術方案內容,依據本發明之技術實質對以上實施方式所作之任何簡介修改、等同變化與修飾,均仍屬於本發明技術方案之範圍內。The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The present invention has been disclosed in the preferred embodiments, but is not intended to limit the invention, and any person skilled in the art. The equivalents of the technical solutions disclosed above may be modified or modified to equivalent variations, without departing from the technical scope of the present invention, in accordance with the technical essence of the present invention. Any of the above-described modifications, equivalent changes and modifications of the above embodiments are still within the scope of the technical solutions of the present invention.

100、200、300‧‧‧互動節拍特效系統
10‧‧‧控制主機
11‧‧‧點歌終端
12‧‧‧節拍感應裝置
13‧‧‧音訊輸出裝置
14‧‧‧多媒體視頻輸出裝置
15‧‧‧燈光特效裝置
16‧‧‧視頻輸出裝置
20‧‧‧外部設備
102‧‧‧記憶體
104‧‧‧存儲控制器
106‧‧‧處理器
108‧‧‧外設介面
110‧‧‧網路模組
112‧‧‧作業系統
114‧‧‧視覺特效服務模組
116‧‧‧身份校驗模組
118‧‧‧特效傳輸模組
130‧‧‧資訊傳輸模組
122‧‧‧錄音模組
124‧‧‧音訊分析模組
126‧‧‧視頻捕捉模組
128‧‧‧視頻分析模組
100, 200, 300‧‧‧ interactive beat special effects system
10‧‧‧Control host
11‧‧‧歌歌终端
12‧‧‧ beat sensing device
13‧‧‧Audio output device
14‧‧‧Multimedia video output device
15‧‧‧Lighting effect device
16‧‧‧Video output device
20‧‧‧External equipment
102‧‧‧ memory
104‧‧‧Storage Controller
106‧‧‧ Processor
108‧‧‧ peripheral interface
110‧‧‧Network Module
112‧‧‧Operating system
114‧‧‧Visual Effects Service Module
116‧‧‧identity verification module
118‧‧‧Special effect transmission module
130‧‧‧Information Transmission Module
122‧‧‧Recording module
124‧‧‧Audio Analysis Module
126‧‧‧Video Capture Module
128‧‧‧Video Analysis Module

[圖1]係本發明第一實施方式提供之同步視覺特效系統之架構示意圖; [圖2]係第一實施方式提供之互動節拍特效系統之節拍感應裝置之模組圖; [圖3]係第一實施方式提供之互動節拍特效系統之節拍感應裝置之另一模組圖; [圖4]係本發明第二實施方式提供之互動節拍特效系統之架構示意圖; [圖5]係本發明第三實施方式提供之互動節拍特效系統之架構示意圖; [圖6]係第三實施方式之互動節拍特效系統中雲端伺服器之模組圖; [圖7]係本發明第四實施方式提供之獲取節拍特效資料集之方法之流程圖; [圖8]係圖7之方法中部分步驟之流程圖; [圖9]係本發明第五實施方式提供之互動節拍特效處理方法流程圖; [圖10]係本發明第六實施方式提供之互動節拍特效處理方法流程圖; [圖11]係本發明第七實施方式提供之互動節拍特效處理方法流程圖; [圖12]係本發明第七實施方式提供之互動節拍特效處理方法中生成提示特效訊號之步驟流程圖; [圖13]係圖12之方法之介面示意圖。1 is a schematic structural diagram of a synchronous visual effect system provided by a first embodiment of the present invention; [FIG. 2] is a block diagram of a beat sensing device of an interactive beat special effect system provided by the first embodiment; [FIG. 3] Another module diagram of the beat sensing device of the interactive beat special effect system provided by the first embodiment; [Fig. 4] is a schematic structural diagram of the interactive beat special effect system provided by the second embodiment of the present invention; [Fig. 5] 3 is a schematic diagram of an architecture of an interactive beat special effect system provided by the third embodiment; [FIG. 6] is a module diagram of a cloud server in the interactive beat special effect system of the third embodiment; [FIG. 7] is obtained by the fourth embodiment of the present invention. A flowchart of a method for the beat effect data set; [Fig. 8] is a flowchart of a part of the steps of the method of Fig. 7; [Fig. 9] is a flowchart of a method for processing the interactive beat effect provided by the fifth embodiment of the present invention; [Fig. 10 The flowchart of the interactive beat special effect processing method provided by the sixth embodiment of the present invention; [FIG. 11] is an interactive beat special effect section provided by the seventh embodiment of the present invention. The method of flowchart; [12] Step-based interactive prompt effect of the beat signal processing method provides effects of a seventh embodiment of the present invention in flowchart generated; [13] The method of schematic line interface 12 of FIG.

100‧‧‧同步節拍特效系統 100‧‧‧Synchronous Beat Special Effects System

10‧‧‧控制主機 10‧‧‧Control host

11‧‧‧點歌終端 11‧‧‧歌歌终端

12‧‧‧節拍感應裝置 12‧‧‧ beat sensing device

13‧‧‧音訊輸出裝置 13‧‧‧Audio output device

14‧‧‧多媒體視頻輸出裝置 14‧‧‧Multimedia video output device

15‧‧‧燈光特效裝置 15‧‧‧Lighting effect device

16‧‧‧視頻輸出裝置 16‧‧‧Video output device

Claims (10)

一種互動節拍特效系統,其中,包括:控制主機、節拍感應裝置及特效輸出設備; 所述控制主機於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點; 所述控制主機同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點生成提示特效訊號; 所述特效輸出設備輸出所述提示特效訊號以提示使用者及時做出節拍動作; 所述節拍感應裝置感應到使用者回應於所述提示特效訊號所做出之節拍動作後生成節拍觸發訊號; 如果所述控制主機及時接收到正確之節拍觸發訊號,則生成節拍特效訊號; 所述特效輸出設備還輸出所述節拍特效訊號。An interactive beat special effect system, comprising: a control host, a beat sensing device and a special effect output device; the control host acquires a beat effect corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device a data set, the beat effect data set includes a plurality of beat effect labels, each beat special effect label includes a time node; the control host synchronizes the corresponding beat special effect label from the beat special effect data set, and generates a prompt at the time node The effect output device outputs the prompt effect signal to prompt the user to make a beat action in time; the beat sensing device senses that the user generates a beat trigger after responding to the beat action made by the prompt effect signal. a signal; if the control host receives the correct beat trigger signal in time, generating a beat effect signal; and the effect output device further outputs the beat effect signal. 如申請專利範圍第1項所述之互動節拍特效系統,其中,所述節拍特效標籤內還包括特效設定資料,所述特效設定資料設定一或多個節拍特效訊號。The interactive beat special effect system of claim 1, wherein the beat special effect label further includes special effect setting data, and the special effect setting data sets one or more beat special effect signals. 如申請專利範圍第2項所述之互動節拍特效系統,其中,所述節拍特效標籤內還包括與所述特效設定資料對應之提示設定資料,所述提示設定資料設定所述提示特效訊號,所述提示特效訊號提示使用者及時做出預設之節拍動作。The interactive beat special effect system of claim 2, wherein the beat special effect label further includes prompt setting data corresponding to the special effect setting data, and the prompt setting data sets the prompt special effect signal, The prompt special effect signal prompts the user to make a preset beat action in time. 如申請專利範圍第1項所述之互動節拍特效系統,其中,所述節拍特效標籤內還包括節拍觸發訊號設定資料和對應之提示設定資料,設定一或多個節拍觸發訊號,並提示使用者及時做出對應之節拍動作,所述節拍動作包括:發出特定聲音、做出特定動作、操作特定節拍設備以及如何操作節拍設備中之一種或多種。The interactive beat special effect system of claim 1, wherein the beat special effect label further includes a beat trigger signal setting data and a corresponding prompt setting data, setting one or more beat trigger signals, and prompting the user The corresponding beat action is made in time, and the beat action includes one or more of emitting a specific sound, making a specific action, operating a specific beat device, and how to operate the beat device. 如申請專利範圍第4項所述之互動節拍特效系統,其中,所述控制主機接收到節拍觸發訊號後,如果所述節拍觸發訊號符合對應之所述節拍特效標籤中之節拍觸發訊號設定資料,且當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則所述控制主機判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號; 所述控制主機還根據節拍觸發訊號之正確與否及時間準確性進行評分,於所述多媒體檔結束播放後所述控制主機對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。The interactive beat special effect system of claim 4, wherein, after the control host receives the beat trigger signal, if the beat trigger signal meets the beat trigger signal setting data in the corresponding beat effect label, And the control host determines that the beat trigger signal is a timely and correct beat trigger signal, and generates a beat special effect signal, and the difference between the current time and the time node in the corresponding beat effect label is less than a specified value; The control host also scores according to the correctness of the beat trigger signal and the time accuracy. After the multimedia file ends playing, the control host summarizes the scores to obtain an overall evaluation, each time score and the overall score. Output through the effect output device. 如申請專利範圍第3或4項所述之互動節拍特效系統,其中,所述提示設定資料設定如何向使用者發出視覺提示,所述提示設定資料包括設備設定資料和提示內容; 所述設備設定資料設定節拍設備、特效輸出設備和多媒體視頻輸出設備中之一或多個; 所述提示內容是文字、圖形或動畫中之一種或多種; 所述控制主機於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處根據提示設定資料生成提示特效訊號以提示使用者做出節拍動作。The interactive beat special effect system of claim 3 or 4, wherein the prompt setting data setting provides a visual prompt to the user, the prompt setting data including device setting data and prompt content; Setting one or more of a beat device, a special effect output device, and a multimedia video output device; the prompt content is one or more of text, graphics, or animation; and the control host synchronizes the beat effect data when playing the multimedia file The corresponding beat special effect label is collected intensively, and the special effect signal is generated according to the prompt setting data at the time node to prompt the user to make a beat action. 如申請專利範圍第1-3項任一項所述之互動節拍特效系統,其中,所述控制主機接收到節拍觸發訊號後,如果當前時間與對應之所述節拍特效標籤中之時間節點之差值小於指定值,則所述控制主機判斷所述節拍觸發訊號是及時且正確之節拍觸發訊號,並生成節拍特效訊號; 所述控制主機還根據節拍觸發訊號之時間準確性進行評分,於所述多媒體檔結束播放後所述控制主機對所述評分進行匯總得出總體評價,每次之評分和所述總體評分透過所述特效輸出設備輸出。The interactive beat special effect system according to any one of claims 1-3, wherein, after the control host receives the beat trigger signal, if the current time is different from the time node in the corresponding beat effect label If the value is less than the specified value, the control host determines that the beat trigger signal is a timely and correct beat trigger signal, and generates a beat special effect signal; the control host further scores according to the time accuracy of the beat trigger signal, After the multimedia file ends playing, the control host summarizes the scores to obtain an overall evaluation, and each time the score and the overall score are output through the special effects output device. 如申請專利範圍第1-5項任一項所述之互動節拍特效系統,其中,還包括:節拍設備,用於根據使用者之操作發出所述節拍觸發訊號至所述控制主機、所述特效輸出設備或者所述節拍感應裝置,所述節拍設備內置燈光部件以閃爍顯示所接收到之燈光或燈光陣列圖案,和/或內置視頻顯示部件以閃爍顯示接收到之提示圖案或播放提示動畫。The interactive beat special effect system according to any one of claims 1-5, further comprising: a beat device, configured to send the beat trigger signal to the control host according to an operation of a user, and the special effect An output device or the beat sensing device, the beat device having a built-in light component to flash display the received light or light array pattern, and/or a built-in video display component to flash display the received cue pattern or play cue animation. 如申請專利範圍第1-5項任一項所述之互動節拍特效系統,其中,所述提示特效訊號還提示使用者及時做出正確之節拍動作後會呈現何種節拍特效。The interactive beat special effect system according to any one of claims 1-5, wherein the prompt special effect signal further prompts the user to make a beat special effect after making a correct beat action in time. 一種互動節拍特效處理方法,所述方法包括: 於播放多媒體檔時,或者於外部設備播放多媒體檔時,獲取與所述多媒體檔對應之節拍特效資料集,所述節拍特效資料集內包括多個節拍特效標籤,每個節拍特效標籤包括時間節點; 於播放多媒體檔時同步從節拍特效資料集中獲取對應之節拍特效標籤,於所述時間節點處生成提示特效訊號; 輸出所述提示特效訊號以提示使用者及時做出節拍動作; 當感應到用戶之節拍動作後生成節拍觸發訊號; 如果及時接收到正確之節拍觸發訊號,則生成節拍特效訊號;以及 根據所述節拍特效訊號輸出對應之節拍特效。An interactive beat effect processing method, the method includes: when playing a multimedia file, or when playing an multimedia file by an external device, acquiring a beat special effect data set corresponding to the multimedia file, where the beat special effect data set includes multiple The beat effect label, each beat special effect label includes a time node; synchronously acquires a corresponding beat special effect label from the beat special effect data set when playing the multimedia file, generates a prompt special effect signal at the time node; and outputs the prompt special effect signal to prompt The user makes a beat action in time; generates a beat trigger signal after sensing the user's beat motion; generates a beat special effect signal if the correct beat trigger signal is received in time; and outputs a corresponding beat effect according to the beat special effect signal.
TW104106115A 2014-02-26 2015-02-25 Interactive beat effect system and method for processing interactive beat effect TWI574256B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410065209 2014-02-26
CN201510056266.2A CN104754421A (en) 2014-02-26 2015-02-02 Interactive beat effect system and interactive beat effect processing method

Publications (2)

Publication Number Publication Date
TW201535358A true TW201535358A (en) 2015-09-16
TWI574256B TWI574256B (en) 2017-03-11

Family

ID=53593417

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104106115A TWI574256B (en) 2014-02-26 2015-02-25 Interactive beat effect system and method for processing interactive beat effect

Country Status (2)

Country Link
CN (1) CN104754421A (en)
TW (1) TWI574256B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017093803A (en) * 2015-11-24 2017-06-01 富士通株式会社 Evaluation program, evaluation method and evaluation device
CN105996305A (en) * 2016-05-03 2016-10-12 苏州乐聚堂电子科技有限公司 Intelligent shoe buckle and intelligent shoe buckle lamplight synchronous display method
CN107464548A (en) * 2017-08-03 2017-12-12 京东方科技集团股份有限公司 Contactless music sensing device and musical performance method
CN107682642A (en) * 2017-09-19 2018-02-09 广州艾美网络科技有限公司 Identify the method, apparatus and terminal device of special video effect triggered time point
CN108877838B (en) * 2018-07-17 2021-04-02 黑盒子科技(北京)有限公司 Music special effect matching method and device
CN110801626A (en) * 2018-08-06 2020-02-18 南京芝兰人工智能技术研究院有限公司 LED lamp array game method and system based on intelligent interaction of children
CN111857482B (en) * 2020-07-24 2022-05-17 北京字节跳动网络技术有限公司 Interaction method, device, equipment and readable medium
CN112333464B (en) * 2020-10-30 2022-08-02 北京字跳网络技术有限公司 Interactive data generation method and device and computer storage medium
CN112333473B (en) * 2020-10-30 2022-08-23 北京字跳网络技术有限公司 Interaction method, interaction device and computer storage medium
CN114845145B (en) * 2021-01-30 2024-04-12 华为技术有限公司 Action prompt icon sequence generation method, electronic device and readable storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1110779C (en) * 1996-10-31 2003-06-04 传感电子公司 Intelligent management system for video frequency information
JP2000237455A (en) * 1999-02-16 2000-09-05 Konami Co Ltd Music production game device, music production game method, and readable recording medium
JP2001013964A (en) * 1999-06-25 2001-01-19 Yamaha Corp Playing device and recording medium therefor
CN100361051C (en) * 2004-12-30 2008-01-09 集嘉通讯股份有限公司 Device and method for analyzing operation of movable product
US8467566B2 (en) * 2005-10-06 2013-06-18 Pitney Bowes Inc. Method for detecting fraud in a printed image
CN101483012B (en) * 2008-01-10 2011-03-30 肖伟 Dance teaching machine and detection method thereof
JP2009189569A (en) * 2008-02-14 2009-08-27 Namco Bandai Games Inc Music game apparatus
CN101306249B (en) * 2008-05-30 2011-09-14 北京中星微电子有限公司 Motion analysis device and method
TW201022982A (en) * 2008-12-02 2010-06-16 Univ Nat Changhua Education A personalized rhythm authentication system
TW201322051A (en) * 2011-11-18 2013-06-01 Asustek Comp Inc Method for unlocking screen

Also Published As

Publication number Publication date
CN104754421A (en) 2015-07-01
TWI574256B (en) 2017-03-11

Similar Documents

Publication Publication Date Title
TWI574256B (en) Interactive beat effect system and method for processing interactive beat effect
TWI574252B (en) Synchronous beat effect system and method for processing synchronous beat effect
WO2019101015A1 (en) Audio data processing method and apparatus, and storage medium
US20190304448A1 (en) Audio playback device and voice control method thereof
WO2016177296A1 (en) Video generation method and apparatus
CN112511850B (en) Wheat connecting method, live broadcast display device, equipment and storage medium
CN104811829A (en) Karaoke interactive multifunctional special effect system
TW201627988A (en) Synchronous visual effect system and method for processing synchronous visual effect
CN109729372A (en) Method for switching between, device, terminal, server and storage medium is broadcast live
CN110087149A (en) A kind of video image sharing method, device and mobile terminal
TW201627987A (en) Singing visual effect system and method for processing singing visual effect
CN104822095A (en) Composite beat special effect system and composite beat special effect processing method
TWI555013B (en) Sound visual effect system and method for processing sound visual effect
TWI545452B (en) Accompaniment visual effect system and method for processing accompaniment visual effect
TWI585614B (en) Composite beat effect system and method for processing composite beat effect
CN104866477B (en) Information processing method and electronic equipment
CN105657510B (en) Image display device and information providing method thereof
WO2019114582A1 (en) Video image processing method and computer storage medium and terminal
WO2016051534A1 (en) Acoustic system, communication device, and program
CN112188226B (en) Live broadcast processing method, device, equipment and computer readable storage medium
JP7078743B2 (en) Information processing system, information processing device and content file generation method
US10951951B2 (en) Haptics metadata in a spectating stream
JP6422286B2 (en) Karaoke management system
JP6139214B2 (en) Information terminal, information terminal program and karaoke apparatus
TW201619953A (en) Composite beat effect system and method for processing composite beat effect

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees