CN104754421A - Interactive beat effect system and interactive beat effect processing method - Google Patents

Interactive beat effect system and interactive beat effect processing method Download PDF

Info

Publication number
CN104754421A
CN104754421A CN201510056266.2A CN201510056266A CN104754421A CN 104754421 A CN104754421 A CN 104754421A CN 201510056266 A CN201510056266 A CN 201510056266A CN 104754421 A CN104754421 A CN 104754421A
Authority
CN
China
Prior art keywords
beat
special efficacy
signal
prompting
special
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510056266.2A
Other languages
Chinese (zh)
Inventor
胡俊峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Lejuyitang Electronic Technology Co Ltd
Original Assignee
Suzhou Lejuyitang Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Lejuyitang Electronic Technology Co Ltd filed Critical Suzhou Lejuyitang Electronic Technology Co Ltd
Priority to CN201510056266.2A priority Critical patent/CN104754421A/en
Priority to TW104106115A priority patent/TWI574256B/en
Publication of CN104754421A publication Critical patent/CN104754421A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25816Management of client data involving client authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to an interactive beat effect system and in interactive beat effect processing method. The system comprises a control host, a beat sensing device and effect output equipment, wherein the control host is used for acquiring a beat effect data set when a multi-media document is played; the beat effect data seat comprises a plurality of beat effect tags, and the beat effect bags comprise time nodes; when the control host is used for playing the multi-media document, the corresponding beat effect tags can be obtained in the beat effect data seat synchronously, and prompting effect signals are generated by the time nodes; the effect output equipment is used for outputting the prompting effect signals to reminder the user of doing beat actions timely, the beat sensing device is used for sensing that the user can generate beat trigger signals after the beat actions are done by the user corresponding to the prompting effect signals, the beat effect signals are generated if the control host timely receives correct bite trigger signals and the effect output equipment is used for outputting the prompting effect signals and the beat effect signals. According to the interactive beat effect system and the interactive beat effect method, the interactive beat experience can be brought to KTV (Keyboard Tape Verifier) users.

Description

Interactive beat Special Effect System and interactive beat effect processing method
Technical field
The present invention relates to multimedia special efficacy technical field, particularly one interactive beat Special Effect System and a kind of interactive beat effect processing method.
Background technology
Karaoke is a kind of multimedia accompaniment type singing system, and singer can participate in singing under the musical background of prerecording.Karaoke makes the sound of singer obtain beautifying and retouching by acoustic processing, when organically combining with musical background, just becomes the stereo song of one integrated mass again.This accompaniment mode, bringing great convenience with joyful to singing fans, becoming a kind of mode of people's amusement and recreation, and being called KTV now more.
In common KTV system, song and the accompaniment music of user may be mixed together broadcasting, but user cannot change lamp light specific effect in private room and special video effect.That is, existing KTV system is interactive very weak.
Summary of the invention
In view of this, be necessary to provide a kind of interactive beat Special Effect System and a kind of interactive beat effect processing method, it can provide abundant beat special efficacy, particularly encourages and guides user to make beat actions.
The embodiment of the present invention provides a kind of interactive beat Special Effect System, and it comprises: main control system, beat induction installation and special efficacy output equipment;
Described main control system obtains the beat special effects data collection corresponding with described multimedia file when play multimedia file, comprises multiple beat special efficacy label in described beat special effects data collection, and each beat special efficacy label comprises timing node;
Described main control system is synchronously concentrated from beat special effects data and is obtained corresponding beat special efficacy label, generates prompting special efficacy signal at described timing node;
Described special efficacy output equipment exports described prompting special efficacy signal and makes beat actions in time to point out user;
Described beat induction installation generates beat triggering signal after sensing the beat actions that user makes in response to described prompting special efficacy signal;
If described main control system receives correct beat triggering signal in time, then generate beat special efficacy signal;
Described special efficacy output equipment also exports described beat special efficacy signal.
In one embodiment, also comprise special efficacy setting data in described beat special efficacy label, described special efficacy setting data sets one or more beat special efficacy signal.
In one embodiment, the prompting setting data corresponding with described special efficacy setting data is also comprised in described beat special efficacy label, described prompting setting data sets described prompting special efficacy signal, and described prompting special efficacy signal prompt user makes the beat actions of acquiescence in time.
In one embodiment, beat triggering signal setting data and corresponding prompting setting data is also comprised in described beat special efficacy label, set one or more beat triggering signal, and point out user to make corresponding beat actions in time, described beat actions comprises: send specific sound, make specific action, operation particular beat equipment and how to operate in beat equipment one or more.
In one embodiment, after described main control system receives beat triggering signal, if described beat triggering signal meets the beat triggering signal setting data in corresponding described beat special efficacy label, and current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then described main control system judges that described beat triggering signal is timely and correct beat triggering signal, and generates beat special efficacy signal;
Described main control system is also marked according to the correctness of beat triggering signal and time accuracy, after described multimedia file terminates to play, described main control system to gather described scoring and draws overall assessment, and each scoring and described TOP SCORES are exported by described special efficacy output equipment.
In one embodiment, how described prompting setting data setting sends visual cues to user, and described prompting setting data comprises equipment setting data and suggestion content;
One or more in described equipment setting data setting beat equipment, special efficacy output equipment and multimedia video output equipment;
Described suggestion content is one or more in word, figure or animation;
Described main control system is synchronously concentrated from beat special effects data when play multimedia file and is obtained corresponding beat special efficacy label, generates prompting special efficacy signal make beat actions to point out user at described timing node place according to prompting setting data.
In one embodiment, after described main control system receives beat triggering signal, if current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then described main control system judges that described beat triggering signal is timely and correct beat triggering signal, and generates beat special efficacy signal;
Described main control system is also marked according to the time accuracy of beat triggering signal, after described multimedia file terminates to play, described main control system to gather described scoring and draws overall assessment, and each scoring and described TOP SCORES are exported by described special efficacy output equipment.
In one embodiment, which kind of beat special efficacy can be presented after described prompting special efficacy signal also points out user to make correct beat actions in time.
In one embodiment, described system also comprises: beat equipment, for sending described beat triggering signal according to the operation of user to described main control system, described special efficacy output equipment or described beat induction installation, the built-in light parts of described beat equipment are with the light received by flickering display or lamplight array pattern, and/or the prompting pattern that receives with flickering display of built in video display unit or play cuing animation.
In one embodiment, described main control system obtains the beat special effects data collection corresponding with described multimedia file and comprises when play multimedia file:
Described main control system sends the request of the beat special effects data collection obtaining described correspondence to cloud server system according to the mark of described multimedia file; And
Receive the described beat special effects data collection that described cloud server system returns.
In one embodiment, described main control system obtains the beat special effects data collection corresponding with described multimedia file and also comprises when play multimedia file:
Authentication information is sent to described cloud server system by described main control system, whether has to make main control system described in described cloud server system verification the authority obtaining beat special effects data collection;
Described cloud server system just returns the beat special effects data collection of described main control system request when described main control system has the authority obtaining beat special effects data collection.
In one embodiment, described system also comprises the external equipment be connected with described main control system; The mark of the multimedia file of correspondence is sent to described main control system by described external equipment when play multimedia file or when multimedia file is added into playlist;
Described main control system performs described main control system according to the step of the mark of described multimedia file to the request of the beat special effects data collection of the described correspondence of cloud server system transmission acquisition afterwards in the mark receiving described multimedia file.
In one embodiment, described main control system obtains the beat special effects data collection corresponding with described multimedia file and comprises when play multimedia file: in described multimedia file, parse the described beat special effects data collection be embedded in described multimedia file.
In one embodiment, described special efficacy output equipment comprises: audio output device, video output device and lamp light specific effect device;
Described special efficacy setting data comprises audio frequency special effects data, lamp light specific effect data and special video effect data, described audio frequency special effects data sets the sound special efficacy that described audio output device sends, the variation pattern of lamp light specific effect device light described in described lamp light specific effect data setting, the image change mode of video output device described in described special video effect data setting comprise in the change such as pattern, color, position, angle, size one or more.
In one embodiment, described beat induction installation comprises recording module and audio analysis module, described recording module is for gathering outside sound, whether its audio frequency characteristics of phonetic analysis that described audio analysis module is used for gathering according to described recording module meets default beat audio frequency characteristics, if so, then beat triggering signal described in described audio analysis CMOS macro cell.
In one embodiment, described beat induction installation comprises video capture module and analysis module, described video capture module is for taking the video of user, described analysis module is for analyzing the user video of described video capture module shooting, predetermined feature whether is met with the action identifying user, if so, then described analysis module generates described beat triggering signal.
In one embodiment, described beat equipment is the passive audible device for sending particular audio signal.
In one embodiment, described beat equipment is electronic installation, and described electronic installation sends specific signal to described main control system, described special efficacy output equipment or described beat induction installation when user button, beating, touch, rotation, movement.
The embodiment of the present invention also provides a kind of interactive beat effect processing method, and described method comprises:
When play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises timing node;
Synchronously concentrate from beat special effects data when play multimedia file and obtain corresponding beat special efficacy label, generate prompting special efficacy signal at described timing node place;
Export described prompting special efficacy signal and make beat actions in time to point out user;
When generating beat triggering signal after the beat actions sensing user;
If receive correct beat triggering signal in time, then generate beat special efficacy signal;
Corresponding beat special efficacy is exported according to described beat special efficacy signal.
In one embodiment, also comprise special efficacy setting data in described beat special efficacy label, described special efficacy setting data sets one or more beat special efficacy signal.
In one embodiment, the prompting setting data corresponding with described special efficacy setting data is also comprised in described beat special efficacy label, described prompting setting data sets described prompting special efficacy signal, and described prompting special efficacy signal prompt user makes the beat actions of acquiescence in time.
In one embodiment, beat triggering signal setting data and corresponding prompting setting data is also comprised in described beat special efficacy label, set one or more beat triggering signal, and point out user to make corresponding beat actions in time, described beat actions comprises: send specific sound, make specific action, operation particular beat equipment and how to operate in beat equipment one or more.
In one embodiment, after receiving beat triggering signal, if described beat triggering signal meets the beat triggering signal setting data in corresponding described beat special efficacy label, and current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then judge that described beat triggering signal is timely and correct beat triggering signal, and generate beat special efficacy signal;
Described method also comprises: mark according to the correctness of beat triggering signal and time accuracy, gather described scoring after described multimedia file terminates broadcasting and draw overall assessment, each scoring and described TOP SCORES are exported by special efficacy output equipment.
In one embodiment, how described prompting setting data setting sends visual cues to user, and described prompting setting data comprises equipment setting data and suggestion content;
One or more in described equipment setting data setting beat equipment, special efficacy output equipment and multimedia video output equipment;
Described suggestion content is one or more in word, figure or animation;
Synchronously concentrate from beat special effects data when play multimedia file and obtain corresponding beat special efficacy label, generate prompting special efficacy signal at described timing node place according to prompting setting data and make beat actions to point out user.
In one embodiment, after receiving beat triggering signal, if current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then judges that described beat triggering signal is timely and correct beat triggering signal, and generate beat special efficacy signal;
Described method also comprises: the time accuracy according to beat triggering signal is marked, gather described scoring after described multimedia file terminates broadcasting and draw overall assessment, each scoring and described TOP SCORES are exported by described special efficacy output equipment.
In one embodiment, described method also comprises: send described beat triggering signal to main control system, special efficacy output equipment or beat induction installation according to the operation of user, the built-in light parts of described beat equipment are with the light received by flickering display or lamplight array pattern, and/or the prompting pattern that receives with flickering display of built in video display unit or play cuing animation.
In one embodiment, which kind of beat special efficacy can be presented after described prompting special efficacy signal also points out user to make correct beat actions in time.
In one embodiment, the beat special effects data collection that described acquisition is corresponding with described multimedia file comprises:
Send the request of the beat special effects data collection obtaining described correspondence to cloud server system according to the mark of described multimedia file; And
Receive the described beat special effects data collection that described cloud server system returns.
In one embodiment, the beat special effects data collection that described acquisition is corresponding with described multimedia file also comprises:
Authentication information is sent to described cloud server system, to make described cloud server system verification, whether there is the authority obtaining beat special effects data collection;
Described cloud server system just returns described beat special effects data collection when main control system has the authority obtaining beat special effects data collection.
In one embodiment, described method also comprises:
When described external equipment play multimedia file, receive the mark of the described multimedia file that described external equipment sends; The step of the beat special effects data collection that described acquisition is corresponding with described multimedia file is carried out after the mark receiving described multimedia file.
In one embodiment, the beat special effects data collection that described acquisition is corresponding with described multimedia file comprises: in described multimedia file, parse the described beat special effects data collection be embedded in described multimedia file.
In one embodiment, described special efficacy setting data comprises audio frequency special effects data, lamp light specific effect data and special video effect data, described audio frequency special effects data sets the sound special efficacy that described audio output device sends, the variation pattern of lamp light specific effect device light described in described lamp light specific effect data setting, the image change mode of video output device described in described special video effect data setting comprise in the change such as pattern, color, position, angle, size one or more.
In one embodiment, described method also comprises: gather outside sound, and whether meets default beat audio frequency characteristics according to its audio frequency characteristics of phonetic analysis gathered, and if so, then generates described beat triggering signal.
In one embodiment, described method also comprises: the video of shooting user, and whether meets predetermined feature according to the action that the user video of shooting identifies user, if so, then generates described beat triggering signal.
In one embodiment, described method also comprises: receive the described beat triggering signal that beat equipment sends according to the operation of user.
The beneficial effect of technique scheme is: above-mentioned interactive beat Special Effect System and method also obtain the beat special effects data collection corresponding with multimedia file when play multimedia file, beat special effects data is concentrated and is comprised respectively for the beat special efficacy label of different time node, display reminding information in the process playing music, user is allowed to make corresponding beat actions at the timing node of specifying, when sensing the beat actions of user in the process playing music and the setting of the beat actions of user and beat special efficacy label match, main control system passes through audio frequency, the mode such as video or light exports an obvious beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system, be particularly useful for the occasions such as KTV.And cadence signal is except being triggered by special electronic equipment, the common operation of user in KTV such as shakes tambourine can trigger beat actions, therefore user can be allowed just naturally to activate beat special efficacy without the need to study, improve the use sense of user in KTV room and be subject to.
For above and other object of the present invention, feature and advantage can be become apparent, preferred embodiment cited below particularly, and coordinate institute's accompanying drawings, be described in detail below.
Accompanying drawing explanation
The configuration diagram of the interactive beat Special Effect System that Fig. 1 provides for first embodiment of the invention.
The module map of the beat induction installation of the interactive beat Special Effect System that Fig. 2 provides for the first embodiment.
Another module map of the beat induction installation of the interactive beat Special Effect System that Fig. 3 provides for the first embodiment.
The configuration diagram of the interactive beat Special Effect System that Fig. 4 provides for second embodiment of the invention.
The configuration diagram of the interactive beat Special Effect System that Fig. 5 provides for third embodiment of the invention.
Fig. 6 is the module map of cloud server in the interactive beat Special Effect System of the 3rd embodiment.
The flow chart of the method for the acquisition beat special effects data collection that Fig. 7 provides for fourth embodiment of the invention.
Fig. 8 is the flow chart of part steps in the method for Fig. 7.
The interactive beat effect processing method flow chart that Fig. 9 provides for fifth embodiment of the invention.
The interactive beat effect processing method flow chart that Figure 10 provides for sixth embodiment of the invention.
The interactive beat effect processing method flow chart that Figure 11 provides for seventh embodiment of the invention.
The flow chart of steps of prompting special efficacy signal is generated in the interactive beat effect processing method that Figure 12 provides for seventh embodiment of the invention.
Figure 13 is the interface schematic diagram of the method for Figure 12.
Embodiment
For further setting forth the present invention for the technological means that realizes predetermined goal of the invention and take and effect, below in conjunction with accompanying drawing and preferred embodiment, to according to the specific embodiment of the present invention, structure, feature and effect thereof, be described in detail as follows.
First embodiment
Consult Fig. 1, the configuration diagram of its interactive beat Special Effect System provided for first embodiment of the invention.As shown in Figure 1, interactive beat Special Effect System 100 comprises main control system 10, requesting song terminal 11, beat induction installation 12, audio output device 13, multimedia video output device 14, lamp light specific effect device 15 and video output device 16.Be appreciated that the framework of Fig. 1 is only signal, interactive beat Special Effect System 100 also can comprise more equipment, such as power amplifier, microphone etc.
Requesting song terminal 11 provides the interface of requesting song, user such as can be requested a song by requesting song interface, the song selected is submitted to main control system 10, main control system 10 according to list to be played play with by vocal accompaniment sound corresponding to a song and video of accompanying, be transferred to audio output device 13 respectively by audio & video and multimedia video output device 14 exports.
Requesting song terminal 11 can be the input/output device be connected with main control system 10 particularly, the contact panel be such as connected with main control system 10, now, the Application Program Interface of requesting song terminal 11 is in fact controlled by main control system 10, and requesting song terminal 11 is only as input/output device.User is directly got by main control system 10 by the song of contact panel program request.
Requesting song terminal 11 can also be independent electronic installation, such as, be provided with the electronic installation of specific application program as mobile phone, panel computer etc.User can be requested a song by this application program, and put song information by this application transfer to main control system 10.Its concrete transmission means such as can comprise following several: when main control system 10 is in same local area network (LAN) with requesting song terminal 11, requesting song terminal 11 can by the predetermined network port directly by user put song information send to main control system 10 via this network port.Be understandable that, this kind of mode needs the open corresponding port of main control system 10 and network service.When main control system 10 is not in same local area network (LAN) with requesting song terminal 11, can by transit server with transmission user put the information of song.That is, application program first by user put song information be committed to server, then, when same user logs in main control system 10, main control system 10 just can to obtain or by the song of the current login user program request of server active push from server.
Beat induction installation 12 for sense user when main control system 10 plays described multimedia file beat actions after generate beat triggering signal.Beat actions herein refers to the action that user makes in response to prompting special efficacy signal.User includes, but are not limited in response to the concrete enforcement of the action that prompting special efficacy signal is made: hail, shake tambourine, shake arm, manipulation mobile phone, button remote controller, dancing etc.
In general, beat actions can be divided into two classes: sound and action.
Therefore, in a concrete execution mode, consult Fig. 2, beat induction installation 12 realizes based on audio analysis, it comprises recording module 122 and audio analysis module 124, and recording module 122 is for gathering outside sound, and whether audio analysis module 124 meets default beat audio frequency characteristics for its audio frequency characteristics of phonetic analysis gathered according to recording module 122, if so, then audio analysis module 124 generates beat triggering signal.
Such as, when tambourine the most common in KTV facility is rocked, except sending clear and melodious sound, also ultrasonic wave can be sent.Therefore, after audio analysis module 124 detects the ultrasonic wave of preset frequency, then generate beat triggering signal.
Audio analysis module 124, also by the mode of audio identification, identifies whether the audio frequency of admission is predetermined content, such as, when user hails " I Love You ", then generates beat triggering signal.
Consult Fig. 3, in another particular embodiment of the invention, beat induction installation 12 realizes based on the action of video analysis user, it comprises video capture module 126 and analysis module 128, video capture module 126 is for taking the video of user, and whether the user video that analysis module 128 is taken for analyzing video capture module 126, meet predetermined feature with the action identifying user, if so, then analysis module 128 generates beat triggering signal.
Such as, by video analysis, get the operation that user's both hands rock arm simultaneously, then analysis module 128 generates beat triggering signal.
In another particular embodiment of the invention, beat induction installation 12 is that the cadence signal sent based on beat equipment realizes.Such as, beat induction installation 12 comprises bluetooth module, infrared module or WIFI module.
Beat equipment such as can be a remote controller, which is provided with multiple button, and when user presses certain button, remote controller launches corresponding infrared signal to described beat induction installation 12.That is, the infrared signal that remote controller sends is above-mentioned cadence signal.
Beat equipment such as also can be a special electronic equipment, also bluetooth module is provided with in it, thus can match with the bluetooth module of beat induction installation 12, after successful matching, when detecting that user presses certain button, or when rocking this beat equipment, beat equipment sends corresponding Bluetooth signal to beat induction installation 12.That is, the Bluetooth signal that beat equipment sends is above-mentioned cadence signal.
Beat equipment such as also can be a mobile phone, mobile phone is connected with beat induction installation 12 by WIFI, specific application program is installed in mobile phone, this application program obtains the kinematic parameter of beat equipment by the accelerometer of embedded in mobile phone, and calculate the movement locus of beat equipment further, when the movement locus of beat equipment meets default feature, mobile phone sends predetermined network signal by WIFI network to beat induction installation 12.That is, the network signal that above-mentioned mobile phone sends is above-mentioned cadence signal.
In addition, understandable, beat equipment is not limited to be only above-mentioned a certain type, and various types of beat equipment can also combinationally use.That is, beat induction installation 12 can receive the cadence signal that different beat equipment sends; Or main control system 10 detects action or the audio frequency of multiple user.
Audio output device 13 such as can be audio amplifier, and multimedia video output device 14 and video output device 16 such as can be the equipment of any output video image such as television set, display, projecting apparatus.Lamp light specific effect device 15 comprises at least one light fixture, and it can export light signal according to control signal.Preferably, lamp light specific effect device 15 can comprise the drive unit of LED array and correspondence, this LED array can all walls of cloth roomful, even ground, roof.When LED each in LED array is driven separately, whole LED array also constitutes in fact a display, can be used for showing complicated picture signal, now, lamp light specific effect device 15 and the difference of video output device 16 are to show the different of yardstick.
Multimedia video output device 14 is such as video key frame for showing multimedia vocal accompaniment file and the special video effect that is superimposed upon on video key frame, and video output device 16 is such as display video special efficacy.
Understandable, multiple multimedia video output device 14 and multiple video output device 16 can also be comprised in interactive beat Special Effect System 100.
The interactive beat Special Effect System 100 of the present embodiment is when played songs or other multimedia files, and main control system 10, except obtaining the source file of song, also obtains the beat special effects data collection corresponding with current song.
In a concrete execution mode, above-mentioned beat special effects data collection embeds in the source file of song.Therefore, main control system 10 will parse corresponding beat special effects data collection from the source file of song.Be understandable that, the source file of song both can be stored in local memory (referring to the memory be connected with main control system by data/address bus), also can be stored in network memory.Network memory herein, both can comprise local area network (LAN), intranet, also can comprise the Internet.
At the execution mode that another is concrete, above-mentioned beat special effects data collection is the file with the separate storage of the source file of song.Similar to the source file of song, beat special effects data collection, both can be stored in local memory, also can be stored in network memory.
Above-mentioned beat special effects data collection is the beat special effects data collection adopting predefined agreement or language description.Such as, in a concrete execution mode, beat special effects data collection can comprise multiple orderly beat special efficacy label, and each beat special efficacy label comprises time setting data and special efficacy setting data.Time setting data is for setting the beat special efficacy effective time.Special efficacy setting data can be both directly audio frequency, video or vector animation, also can be the data of the extended formatting for describing, generating or obtain beat special efficacy.
In a concrete execution mode, beat special effects data collection such as can be as follows:
[00:00.00]
[00:24.88]
[01:27.05]
[02:30.39]
……
In which case, only time node in beat special efficacy label, the prompting special efficacy signal prompt user that main control system 10 can send acquiescence at the timing node of each beat special efficacy label makes the beat actions of acquiescence in time, when main control system 10 receives any one beat triggering signal in the time error allowed, just generate the beat special efficacy of acquiescence.Such as, no matter be that user passes through to rock tambourine or cheer " I Love You ", all can trigger same beat special efficacy.The prompting special efficacy signal of above-mentioned acquiescence is such as word, icon or animation.
In a concrete execution mode, beat special effects data collection such as can be as follows:
[00:00.00] special efficacy setting data 1
[00:24.88] special efficacy setting data 2
[01:27.05] special efficacy setting data 3
[02:30.39] special efficacy setting data 4
……
In which case, special efficacy setting data is included in beat special efficacy label.Such as: the prompting special efficacy signal prompt user that main control system 10 can send acquiescence at the timing node of each beat special efficacy label makes the beat actions of acquiescence in time, but user's 4 timing nodes at this moment make beat actions in time and can trigger corresponding beat special efficacy.
In a concrete execution mode, beat special effects data collection such as can be as follows:
[00:00.00] points out setting data 1 special efficacy setting data 1
[00:24.88] points out setting data 2 special efficacy setting data 2
[01:27.05] points out setting data 3 special efficacy setting data 3
[02:30.39] points out setting data 4 special efficacy setting data 4
……
In which case, special efficacy setting data and corresponding prompting setting data is included in beat special efficacy label.Prompting setting data sets the content of prompting special efficacy signal, such as word, icon, animation or its combination.Such as: if the content of the prompting special efficacy signal of pointing out setting data to comprise is the small icon of a candle, then main control system 10 can show the small icon of a candle on special video effect display device at some timing nodes.Preferably, the prompting setting data of above-mentioned correspondence refers to that the content of prompting setting data and the beat special efficacy set by special efficacy setting data is associated.Such as, when the beat special efficacy set by special efficacy setting data 1 be a candle light animation time, the prompting special efficacy signal of prompting set by setting data 1 just can be the small icon of a candle, represents the special efficacy animation that beat actions that user makes acquiescence in time can activate candle and lights.That is, which kind of beat special efficacy can be presented after the prompting special efficacy signal prompt user of prompting set by setting data makes correct beat actions in time.
In a concrete execution mode, beat special effects data collection such as can be as follows:
[00:00.00] points out setting data 1 beat triggering signal setting data 1
[00:24.00] points out setting data 2 beat triggering signal setting data 2
[01:28.00] points out setting data 3 beat triggering signal setting data 3
[04:30.00] points out setting data 4 beat triggering signal setting data 4
In which case, beat triggering signal setting data and corresponding prompting setting data is included in beat special efficacy label.The prompting setting data of above-mentioned correspondence such as refers to that the prompting special efficacy signal of prompting set by setting data is associated with the concrete kind of the beat triggering signal set by beat triggering signal setting data.Prompting special efficacy signal now makes which type of beat actions (beat actions set by namely corresponding beat triggering signal setting data) in time for pointing out user, in general, be prompt text as " hands held high ", " tambourine ", " I Love You ", or icon or animation are to represent the action that will do or the equipment that will operate.The instantiation of above-mentioned beat actions can comprise: send specific sound, make specific action, operation particular beat equipment and how to operate in beat equipment one or more.
When main control system 10 receives correct beat triggering signal in the time error allowed, just generate the beat special efficacy of acquiescence.Such as, need to rock tambourine [00:24.00] front and back user and could activate beat special efficacy, then need to hail " I Love You " before and after [01:28.00], same beat special efficacy could be triggered.
Understandable, also may comprise beat triggering signal setting data and corresponding prompting setting data in beat special efficacy label, also have corresponding special efficacy setting data simultaneously.Now, the beat actions that the prompting special efficacy signal of prompting set by setting data can point out user to make simultaneously and can show which type of beat special efficacy after having made correct beat actions in time, namely points out in special efficacy signal the information that can simultaneously comprise for the information and prompting beat special efficacy pointing out beat actions.Such as, two icons can be comprised in prompting special efficacy signal, point out beat actions and beat special efficacy respectively.
In above each cited embodiment, when the characteristic manner of time is: point: second, but the present invention is not limited to adopt in this way, such as, can directly adopt the arbitrary unit such as number of seconds, millisecond number, the number of minutes to characterize.For time started 00:24.00, being converted into number of seconds is then 1440, and being converted into millisecond number is 1440000, directly represents with the number of minutes and is 24.The time data recorded in time setting data can also be to time value carry out various can the result of inverse operation, even can be encrypted computing.For above-mentioned number of seconds 1440, such as, it can be obtained 720 divided by 2.That is store in time setting data 720, but in fact its express 1440 seconds.Being understandable that, after this computing, to calculate the real time node of certain beat special efficacy label, needing to carry out reverse operation.
Be understandable that, which kind of no matter through process, above its essence of these modes remains by defining a timing node in beat special efficacy label, and the timing node comparing current time and definition is to obtain the mode of corresponding beat special efficacy label, therefore, these all modes all should be included in the scope of above-mentioned time setting data.
Such as, in a concrete execution mode, special efficacy setting data adopts predefined agreement or language to a kind of data of description of the beat special efficacy that will realize.This data of description can define type and the parameter of beat special efficacy.Above-mentioned type such as can comprise audio frequency, video, light or its combination in any.Above-mentioned parameter can comprise concrete special efficacy running parameter, and the running parameter of the sound that such as will export, the color of light, pattern and brightness is as speed, ratio and scope.
Such as, in another particular embodiment of the invention, special efficacy setting data is the data of the extended formatting for obtaining beat special efficacy, such as, and the identifier of certain special video effect file.And special video effect file herein can be pre-stored in the memory that is connected with main control system 10, or be stored in cloud server.Main control system 10 can read this video file in memory, or initiates network request, downloads this video file from cloud server.
Be understandable that, beat special effects data collection can be generated according to the audio data analysis result of every song automatically by special system, also can be generated by the artificial Edition Contains according to song.But generally, no matter how beat special effects data collection makes, its object is to prompting user and make interactive beat actions according to the beat of song, if action is timely and correct, then to be responded by modes such as audio frequency, video, light and obvious output one, the change that can be perceived by the user.
Main control system 10 is when play multimedia file, or synchronously concentrate from beat special effects data when outside device plays multimedia file and obtain corresponding beat special efficacy label according to timing node, as therefrom parsed prompting setting data, then generate prompting special efficacy signal according to prompting setting data and sent to by prompting special efficacy signal prompting special efficacy output equipment to export, otherwise exporting the prompting special efficacy signal of acquiescence.It is one or more that prompting special efficacy output equipment herein such as can be in above-mentioned multimedia video output device 14, lamp light specific effect device 15 and video output device 16.
User, after seeing prompting special efficacy signal, can make corresponding beat actions according to the prompting of prompting special efficacy signal, such as swinging arm, say specific voice content, rock tambourine etc.
Correspondingly, beat induction installation 12 can sense the beat actions of user.After the beat actions sensing user, beat induction installation 12 generates beat triggering signal, and beat triggering signal is sent to main control system 10.
Whether main control system 10 calculates current time and conforms to the timing node in corresponding beat special efficacy label after receiving beat triggering signal, whether consistent with the beat triggering signal setting data in above-mentioned beat special efficacy label with beat triggering signal itself, if so, then generating beat special efficacy signal sends to special efficacy output device to export.
Particularly, main control system 10 calculates the difference of the timing node in the time and beat special efficacy label receiving beat triggering signal, if difference is less than designated value, is timely.When not comprising beat triggering signal setting data in beat special efficacy label, beat triggering signal is just considered to be correct beat triggering signal timely arbitrarily; And when beat special efficacy label comprises beat triggering signal setting data, only have the beat triggering signal set by beat triggering signal setting data to be only correct beat triggering signal.
In a concrete execution mode, beat special efficacy is audio frequency special efficacy.So, when sensing that the beat actions of user is correct again in time, when namely have received correct beat triggering signal in time, the audio frequency in that play acquiescence by audio output device 13 or current beat special efficacy label corresponding to special efficacy setting data.
In a concrete execution mode, beat special efficacy is special video effect.So, when sensing that the beat actions of user is correct again in time, when namely have received correct beat triggering signal in time, the special video effect in that play acquiescence by video output device 16 or current beat special efficacy label corresponding to special efficacy setting data.
In a concrete execution mode, beat special efficacy is lamp light specific effect.So, when sensing that the beat actions of user is correct again in time, when namely have received correct beat triggering signal in time, the lamp light specific effect in that play acquiescence by lamp light specific effect device 15 or current beat special efficacy label corresponding to special efficacy setting data.
Further, above various types of special efficacy can also combinationally use.That is, polytype special efficacy can be comprised in a beat special efficacy label, such as, the combination in any of sound special efficacy, special video effect or lamp light specific effect can be comprised.
Further, when receiving beat triggering signal and comprising beat triggering signal setting data in beat special efficacy label, then main control system 10 is also marked according to the correctness of beat triggering signal and time accuracy, after described multimedia file terminates to play, described main control system to gather described scoring and draws overall assessment, and each scoring and described TOP SCORES are exported by described special efficacy output equipment.Particularly, main control system 10 can adopt a function, and using the difference that receives between the time of beat triggering signal and the timing node sending prompting as input, the scoring that cumulative calculation is corresponding, the beat actions of mistake adds a large mark as punishment.Understandable, time difference is less, and accumulative integration is fewer, and achievement is better.And concrete code of points unrestricted.
The interactive beat Special Effect System of the present embodiment also obtains the beat special effects data collection corresponding with multimedia file when play multimedia file, beat special effects data is concentrated and is comprised respectively for the beat special efficacy label of different time node, display reminding information in the process playing music, user is allowed to make corresponding beat actions at the timing node of specifying, when sensing the beat actions of user in the process playing music and the setting of the beat actions of user and beat special efficacy label match, main control system passes through audio frequency, the mode such as video or light exports an obvious beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system, be particularly useful for the occasions such as KTV.And cadence signal is except being triggered by special electronic equipment, the common operation of user in KTV such as shakes tambourine can trigger beat actions, therefore user can be allowed just naturally to activate beat special efficacy without the need to study, improve the use sense of user in KTV room and be subject to.
Second embodiment
Consult Fig. 4, the schematic diagram of its interactive beat Special Effect System 200 provided for second embodiment of the invention.The interactive beat Special Effect System 200 of the present embodiment is similar to the interactive beat Special Effect System of Fig. 1, and its difference is also to comprise: external equipment 20.
External equipment 20 such as can be the computer being provided with requesting song application program.Requesting song panel 11, audio output device 13 and multimedia video output device 14 are connected with external equipment 20.Thus requesting song panel 11, audio output device 13 and multimedia video output device 14 and external equipment 20 self constitute a common multimedia order programme system that can be used for the occasions such as KTV.Beat induction installation 12, video output device 16 are still connected with main control system 10 with lamp light specific effect device 15.
In the present embodiment, external equipment 20 is such as traditional order programme main frame, and it realizes the Play Control function of requesting song and song.But compared to traditional order programme main frame, it is connected with main control system 10 further.Whenever external equipment 20 play a song song or a song be added in playlist time, the mark of song can be sent to main control system 10 by external equipment 20.
Be appreciated that, specific information can be sent to main control system 10 to allow external equipment 20, specific application programming interface (API) can be disclosed in main control system 10, thus external equipment 20 can be allowed to call, and send above-mentioned information to main control system 10.When external equipment 20 plays a song song, the mark of song and the time starting to play can be submitted to main control system 10 by above-mentioned API by external equipment 20.Certainly, external equipment 20 will realize calling of API, needs slightly to make an amendment existing requesting song playing program, makes when needed by API and main control system 10 synchronizing information.
Main control system 10 is after receiving the synchronous song information of external equipment 20, obtain the beat special effects data collection corresponding with song, and start to monitor the beat triggering signal from beat induction installation 12, after receiving the timely and correct beat triggering signal from beat induction installation 12, main control system 10 generates beat special efficacy according to current beat special efficacy label, and exports beat special efficacy further by lamp light specific effect device 15.
In the present embodiment, audio output device 13 and multimedia video output device 14 can also export the audio frequency and video from external equipment 20 and the beat special efficacy from main control system 10 simultaneously.For audio frequency, now need to arrange audio frequency superimpose device in addition, it comprises two inputs, is connected respectively with the audio output port of external equipment 20 and main control system 10, and the output port of audio frequency superimpose device is connected with the audio input port of audio output device 13.The audio frequency that external equipment 20 and main control system 10 export is superimposed to together by audio signal processing technique by audio frequency superimpose device, is then transferred to audio output device 13 and exports.With audio class seemingly, if will video superimpose be realized, now need to arrange video superimpose device in addition.
According to the interactive beat Special Effect System of the present embodiment, by improving a little existing order programme software, just can realize beat special effective function, maximum compatible existing equipment, the cost avoiding device upgrade to bring increases.
Especially, when main control system 10 is intelligent electronic devices, be arranged on the software in described intelligent electronic device, controlled in wireless audio frequency output device 13 can be passed through, lamp light specific effect device 15 and video output device 16 are to export beat special efficacy, also can by the beat special effects data collection in radio access network, simultaneously, the song sound played back by external equipment 20 is enrolled by built-in microphone, sampled and characteristic matching by feature again, Direct Recognition goes out the song that external equipment 20 is put, thus just can obtain the mark of song without the need to communicating with external equipment 20, then corresponding beat special effects data collection is downloaded.
3rd embodiment
Consult Fig. 5, the schematic diagram of its interactive beat Special Effect System 300 provided for third embodiment of the invention.The interactive beat Special Effect System 300 of the present embodiment is similar to the interactive beat Special Effect System 100 of Fig. 1, and its difference is, also comprises cloud server system 20.
Particularly, cloud server system 20 comprises database 22 and server 24.Wherein, database 22 is for storing the beat special effects data collection of different song.Server 24 is for returning beat special effects data collection to client according to the request of client (as main control system 10).
Fig. 6 shows the structured flowchart of an embodiment of above-mentioned server 24.As shown in Figure 6, server comprises memory 102, storage control 104, one or more (only illustrating one in figure) processor 106, Peripheral Interface 108 and mixed-media network modules mixed-media 110.These assemblies are by the mutual communication of one or more communication bus/holding wire.
Be appreciated that the structure shown in Fig. 6 is only signal, above-mentioned server also can comprise than assembly more or less shown in Fig. 6, or has the configuration different from shown in Fig. 6.Each assembly shown in Fig. 6 can adopt hardware, software or its combination to realize.
Memory 102 can be used for storing software program and module, as each method in the embodiment of the present invention and program command/module corresponding to device, processor 106 is by running the software program and module that are stored in memory 102, thus perform the application of various function and data processing, namely realize above-mentioned method.
Memory 102 can comprise high speed random asccess memory, also can comprise nonvolatile memory, as one or more magnetic storage device, flash memory or other non-volatile solid state memories.In some instances, memory 102 can comprise the memory relative to the long-range setting of processor 106 further, and these remote memories can be connected to above-mentioned server by network.The example of above-mentioned network includes but not limited to the Internet, intranet, local area network (LAN), mobile radio communication and combination thereof.Processor 106 and other possible assemblies can carry out the access of memory 102 under the control of storage control 104.
Various input/output device is coupled to processor 106 by Peripheral Interface 108.Various softwares in processor 106 run memory 102, the above-mentioned server of instruction perform various function and carry out data processing.In certain embodiments, Peripheral Interface 108, processor 106 and storage control 104 can realize in one single chip.In some other example, they can respectively by independently chip realization.
Mixed-media network modules mixed-media 110 is for receiving and sending network signal.Above-mentioned network signal can comprise wireless signal or wire signal.In an example, above-mentioned network signal is cable network signal.Now, mixed-media network modules mixed-media 110 can comprise the elements such as processor, random asccess memory, transducer, crystal oscillator.In one embodiment, above-mentioned network signal is wireless signal (such as radiofrequency signal).Now mixed-media network modules mixed-media 110 essence is radio-frequency module, receives and sends electromagnetic wave, realizing the mutual conversion of electromagnetic wave and the signal of telecommunication, thus carry out communication with communication network or other equipment.Radio-frequency module can comprise the various existing circuit element for performing these functions, such as, and antenna, radio-frequency (RF) transceiver, digital signal processor, encrypt/decrypt chip, subscriber identity module (SIM) card, memory etc.Radio-frequency module can with various network as the Internet, intranet, wireless network carry out communication or carry out communication by wireless network and other equipment.Above-mentioned wireless network can comprise cellular telephone networks, WLAN (wireless local area network) or metropolitan area network.Above-mentioned wireless network can use various communication standard, agreement and technology, include, but are not limited to global system for mobile communications (Global System for MobileCommunication, GSM), enhancement mode mobile communication technology (Enhanced Data GSMEnvironment, EDGE), Wideband CDMA Technology (wideband code division multipleaccess, W-CDMA), CDMA (Code Division Multiple Access) (Code division access, CDMA), tdma (time division multiple access, TDMA), adopting wireless fidelity technology (Wireless, Fidelity, WiFi) (as IEEE-USA standard IEEE 802.11a, IEEE 802.11b, IEEE802.11g and/or IEEE 802.11n), the networking telephone (Voice over internet protocal, VoIP), worldwide interoperability for microwave access (WorldwideInteroperability for Microwave Access, Wi-Max), other are for mail, the agreement of instant messaging and short message, and any other suitable communications protocol, even can comprise those current agreements be developed not yet.
Above-mentioned software program and module comprise: operating system 122 and service module 124.Operating system 122 its can comprise the various component software for management system task (such as memory management, memory device control, power management etc.) and/or driving, and can with various hardware or the mutual communication of component software, thus provide the running environment of other component softwares.Service module 124 operates on the basis of operating system 122, for realizing the transmission controlling functions of the beat special effects data collection to interactive beat Special Effect System, specifically describes as follows.
Service module 124 comprises proof of identity module 126, special efficacy transport module 128 and information transmission modular 130.
Proof of identity module 126 carries out proof of identity for client.In a concrete execution mode, in each main control system 10, store authentication information, such as, the encrypted characters string of host id.Before initiating beat special effects data collection to service module 124 and obtaining request, main control system 10 can initiate log on request, authentication information is sent to server 24.Correspondingly, the proof of identity module 126 of server 24 is decrypted according to predetermined cryptographic algorithm and double secret key authentication information, and verifies whether this host id has the authority obtaining beat special effects data collection.Such as, retrieve the payment mark that this host id is corresponding, if this host id does not pay the usage charges of beat special effects data collection, then this host id does not have the authority obtaining beat special effects data collection, and the authentication of main control system 10 is not passed through.Correspondingly, special efficacy transport module 128 can refuse the request of the acquisition beat special effects data collection of main control system 10.
If when certain host id has the authority obtaining beat special effects data collection, special efficacy transport module 128 will return corresponding beat special effects data collection according to the request of main control system 10.Be appreciated that, main control system 10 can when starting to play certain song or other multimedia files, or namely song is initiated after entering playlist above-mentioned to log in check request and beat special effects data collection obtains request, and the identifier of the song that will play is included in the acquisition request of above-mentioned beat special effects data collection.
Be understandable that, download beat special effects data collection from server 24 to need to expend the regular hour, if just start when therefore song starts to play to download above-mentioned beat special effects data collection, then need when carrying out beat special effect play after beat special effects data collection has been downloaded to consider to remove download time to the impact of timeline.Particularly, if complete the download of beat special effects data collection after playback of songs during time T and start to play, then the timeline of beat special efficacy can from time T place, instead of it is synchronous to start anew to realize with the timeline of multimedia file.This requires main control system 10 to record time that multimedia file starts to play and beat special effects data collection time of having downloaded, and both time differences are above-mentioned time T.
When every first multimedia file is once be added in list to be played, main control system 10 just can start to download corresponding beat special effects data collection.Adopt in this way, the beat special effects data collection of the First multimedia file in playlist is only had to need regulation time line, and the beat special effects data collection of follow-up all songs can be download on backstage other playback of songs while, therefore, when playing, its beat special effects data collection has generally been downloaded, beat special efficacy can be play with Transpot stream, need not regulation time line again.
Understandable, when song is suspended, beat special efficacy synchronously can also be suspended by main control system 10.
According to the interactive beat Special Effect System of the present embodiment, beat special effects data collection is stored in cloud server system 20, can ensure beat special effects data collection only for user's access of authorizing, improve the fail safe of beat special effects data collection.
4th embodiment
Consult Fig. 7, the method flow diagram of its acquisition beat special effects data collection provided for fourth embodiment of the invention.As shown in Figure 7, the method for this enforcement comprises the following steps:
Step S101, play multimedia file;
Multimedia file such as can be play by main control system 10, or is play by external equipment 20.
Step S102, obtains the beat special effects data collection corresponding with described multimedia file.
Beat special effects data collection such as can comprise above-mentioned beat special efficacy label, and each beat special efficacy label comprises time setting data and special efficacy setting data.Certainly, no matter the content of beat special effects data collection why, its acquisition process is similar.
Particularly, step S102 can comprise: step S1022, parses the described beat special effects data collection be embedded in described multimedia file in described multimedia file.
According to this mode, beat special effects data collection is embedded in multimedia file, can preserve in the lump with multimedia file, reduces the complexity of system.
In addition, step S102 also can comprise: step S1024, downloads beat special effects data collection from cloud server.
Consult Fig. 8 further, step S1024 specifically can comprise the following steps:
Step S201, sends to described cloud server system by authentication information, the authority verified and whether have acquisition beat special effects data collection of uniting to make described cloud server system;
Step S202, sends the request of the beat special effects data collection obtaining described correspondence to cloud server system according to the mark of described multimedia file; And
Step S203, receives the described beat special effects data collection that described cloud server system returns;
According to this mode, beat special effects data collection is stored in cloud server system 20, can ensure to only have the user of mandate can access beat special effects data collection, improves the fail safe of beat special effects data collection.
According to the method for the present embodiment, when play multimedia file, also obtain the beat special effects data collection corresponding with multimedia file, described beat special effects data collection can be used for generating beat special efficacy signal, and then can export beat special efficacy.
5th embodiment
Consult Fig. 9, the present embodiment provides a kind of interactive beat effect processing method, and it can be used in the interactive beat Special Effect System shown in Fig. 1, Fig. 4 or Fig. 5.As shown in Figure 9, the method for the present embodiment comprises the following steps:
Step S401, when play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises timing node;
Step S402, synchronously concentrates from beat special effects data when play multimedia file and obtains corresponding beat special efficacy label, at the prompting special efficacy signal of described timing node place generation system acquiescence;
Step S403, exports described prompting special efficacy signal and makes beat actions in time to point out user;
Step S404, generates beat triggering signal after sensing user's beat actions;
Step S405, if receive beat triggering signal in time, then generates beat special efficacy signal; And
Step S406, exports corresponding beat special efficacy according to described beat special efficacy signal.
According to the method for the present embodiment, when play multimedia file, the prompting special efficacy signal prompt user generating acquiescence according to the beat special efficacy label in beat special effects data collection makes beat actions in time, when user completes beat actions in time, just export corresponding beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system.
6th embodiment
Consult Figure 10, the present embodiment provides a kind of interactive beat effect processing method, and it can be used in the interactive beat Special Effect System shown in Fig. 1, Fig. 4 or Fig. 5.As shown in Figure 10, the method for the present embodiment comprises the following steps:
Step S401a, when play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises the prompting setting data of timing node, special efficacy setting data and correspondence;
Step S402a, synchronously concentrates from beat special effects data when play multimedia file and obtains corresponding beat special efficacy label, generate corresponding prompting special efficacy signal at described timing node place according to the prompting setting data corresponding with special efficacy setting data;
Step S403a, exports described prompting special efficacy signal and has which kind of beat special efficacy to point out user to make in time after beat actions and user make beat actions;
Step S404, generates beat triggering signal after sensing user's beat actions;
Step S405, if receive beat triggering signal in time, then generates beat special efficacy signal; And
Step S406, exports corresponding beat special efficacy according to described beat special efficacy signal.
According to the method for the present embodiment, when play multimedia file, generate the prompting special efficacy signal prompt user corresponding with wherein special efficacy setting data according to the beat special efficacy label in beat special effects data collection and make after beat actions and user make beat actions having which kind of beat special efficacy in time, when user completes beat actions in time, just export corresponding beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system, more allow user understand in time and have which kind of beat special efficacy, thus optionally do beat actions.
7th embodiment
Consult Figure 11, the present embodiment provides a kind of interactive beat effect processing method, and it can be used in the interactive beat Special Effect System shown in Fig. 1, Fig. 4 or Fig. 5.As shown in figure 11, the method for the present embodiment comprises the following steps:
Step S401b, when play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises the prompting setting data of timing node, beat triggering signal setting data and correspondence;
Step S402b, synchronously concentrates from beat special effects data when play multimedia file and obtains corresponding beat special efficacy label, generate corresponding prompting special efficacy signal at described timing node place according to the prompting setting data corresponding with beat triggering signal setting data;
Step S403b, exports described prompting special efficacy signal and makes correct beat actions in time to point out user;
Step S404, generates beat triggering signal after sensing user's beat actions;
Step S405b, if receive correct beat triggering signal in time, then generates beat special efficacy signal; And
Step S406, exports corresponding beat special efficacy according to described beat special efficacy signal.
According to the method for the present embodiment, when play multimedia file, generate according to the beat special efficacy label in beat special effects data collection and to trigger prompting special efficacy signal prompt user corresponding to setting data with wherein beat and make beat actions in time and which kind of beat actions user should make, when user completes correct beat actions in time, just export corresponding beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system.
8th embodiment
Consult Figure 12, the present embodiment provides in a kind of interactive beat effect processing method and generates and export the method flow diagram of pointing out special efficacy signal.As shown in figure 12, the method for the present embodiment comprises the following steps:
Step S501, obtains a beat special efficacy label according to current time.
As mentioned above, when play multimedia file, can first obtain beat special effects data collection.In step S501, if just obtain this beat special efficacy label time current time is equal with the timing node in some beat special efficacy labels, then the data comprised in this beat special efficacy label are resolved.
Step S502, judge obtain beat special efficacy label in whether comprise prompting setting data, if so, then perform step S503, otherwise perform step S504.
Step S503, generates according to prompting setting data and exports corresponding prompting special efficacy signal.
Step S504, generates and exports the prompting special efficacy signal given tacit consent to.
In step S503, generate corresponding prompting special efficacy signal according to prompting setting data.Particularly, step S503 such as can comprise:
Step S5032, which kind of beat actions prompting user will do;
Which kind of beat special efficacy step S5034, there will be after prompting user has made correct beat actions in time.
Consult Figure 13, in step S5032, such as can show word 601, prompting user barks out corresponding content " I Love You ", and in step S5034, such as can display icon 602, if prompting user has barked out the content corresponding with word 601 in time, there will be which kind of beat special efficacy, such as one heart-shaped animation.Be appreciated that the interface shown in Figure 13 is such as the video key frame that multimedia video output device 14 exports, and point out special efficacy signal to be superimposed on video key frame.
In step S503, also only can comprise step S5032 or only comprise step S5034.Such as, and word 601 or icon 602 also can adopt other forms to replace, and show other words, icon or animation.
According to the method for the present embodiment, automatically different prompting special efficacy signals can be generated according to whether comprising prompting setting data in beat special efficacy label, prompting user makes beat actions in time and which kind of beat actions user makes, when user completes correct beat actions in time, just export corresponding beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system.
The interactive beat Special Effect System of the embodiment of the present invention also obtains the beat special effects data collection corresponding with multimedia file when play multimedia file, beat special effects data is concentrated and is comprised respectively for the beat special efficacy label of different time node, display reminding information in the process playing music, user is allowed to make corresponding beat actions at the timing node of specifying, when sensing the beat actions of user in the process playing music and the setting of the beat actions of user and beat special efficacy label match, main control system passes through audio frequency, the mode such as video or light exports an obvious beat special efficacy, thus by visual for the beat actions of user, improve the interaction function of multimedia file playing system, be particularly useful for the occasions such as KTV.And cadence signal is except being triggered by special electronic equipment, the common operation of user in KTV such as shakes tambourine can trigger beat actions, therefore user can be allowed just naturally to activate beat special efficacy without the need to study, improve the use sense of user in KTV room and be subject to.
In addition, the embodiment of the present invention also provides a kind of computer-readable recording medium, is stored with computer executable instructions, and above-mentioned computer-readable recording medium is such as nonvolatile memory such as CD, hard disk or flash memory.Above-mentioned computer executable instructions completes method in above-described embodiment for allowing computer or similar arithmetic unit.
The above, it is only preferred embodiment of the present invention, not any pro forma restriction is done to the present invention, although the present invention discloses as above with preferred embodiment, but and be not used to limit the present invention, any those skilled in the art, do not departing within the scope of technical solution of the present invention, make a little change when the technology contents of above-mentioned announcement can be utilized or be modified to the Equivalent embodiments of equivalent variations, in every case be do not depart from technical solution of the present invention content, according to any brief introduction amendment that technical spirit of the present invention is done above embodiment, equivalent variations and modification, all still belong in the scope of technical solution of the present invention.

Claims (10)

1. interactive beat Special Effect System and an interactive beat effect processing method, is characterized in that, comprising: main control system, beat induction installation and special efficacy output equipment;
Described main control system is when play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises timing node;
Described main control system is synchronously concentrated from beat special effects data and is obtained corresponding beat special efficacy label, generates prompting special efficacy signal at described timing node;
Described special efficacy output equipment exports described prompting special efficacy signal and makes beat actions in time to point out user;
Described beat induction installation generates beat triggering signal after sensing the beat actions that user makes in response to described prompting special efficacy signal;
If described main control system receives correct beat triggering signal in time, then generate beat special efficacy signal;
Described special efficacy output equipment also exports described beat special efficacy signal.
2. interactive beat Special Effect System as claimed in claim 1, is characterized in that, also comprises special efficacy setting data in described beat special efficacy label, and described special efficacy setting data sets one or more beat special efficacy signal.
3. interactive beat Special Effect System as claimed in claim 2, it is characterized in that, the prompting setting data corresponding with described special efficacy setting data is also comprised in described beat special efficacy label, described prompting setting data sets described prompting special efficacy signal, and described prompting special efficacy signal prompt user makes the beat actions of acquiescence in time.
4. interactive beat Special Effect System as claimed in claim 1, it is characterized in that, beat triggering signal setting data and corresponding prompting setting data is also comprised in described beat special efficacy label, set one or more beat triggering signal, and point out user to make corresponding beat actions in time, described beat actions comprises: send specific sound, make specific action, operation particular beat equipment and how to operate in beat equipment one or more.
5. interactive beat Special Effect System as claimed in claim 4, it is characterized in that, after described main control system receives beat triggering signal, if described beat triggering signal meets the beat triggering signal setting data in corresponding described beat special efficacy label, and current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then described main control system judges that described beat triggering signal is timely and correct beat triggering signal, and generates beat special efficacy signal;
Described main control system is also marked according to the correctness of beat triggering signal and time accuracy, after described multimedia file terminates to play, described main control system to gather described scoring and draws overall assessment, and each scoring and described TOP SCORES are exported by described special efficacy output equipment.
6. the interactive beat Special Effect System as described in claim 3 or 4, is characterized in that, how described prompting setting data setting sends visual cues to user, and described prompting setting data comprises equipment setting data and suggestion content;
One or more in described equipment setting data setting beat equipment, special efficacy output equipment and multimedia video output equipment;
Described suggestion content is one or more in word, figure or animation;
Described main control system is synchronously concentrated from beat special effects data when play multimedia file and is obtained corresponding beat special efficacy label, generates prompting special efficacy signal make beat actions to point out user at described timing node place according to prompting setting data.
7. the interactive beat Special Effect System as described in any one of claim 1-3, it is characterized in that, after described main control system receives beat triggering signal, if current time is less than designated value with the difference of the timing node in corresponding described beat special efficacy label, then described main control system judges that described beat triggering signal is timely and correct beat triggering signal, and generates beat special efficacy signal;
Described main control system is also marked according to the time accuracy of beat triggering signal, after described multimedia file terminates to play, described main control system to gather described scoring and draws overall assessment, and each scoring and described TOP SCORES are exported by described special efficacy output equipment.
8. the interactive beat Special Effect System as described in any one of claim 1-5, it is characterized in that, also comprise: beat equipment, for sending described beat triggering signal according to the operation of user to described main control system, described special efficacy output equipment or described beat induction installation, the built-in light parts of described beat equipment are with the light received by flickering display or lamplight array pattern, and/or the prompting pattern that receives with flickering display of built in video display unit or play cuing animation.
9. the interactive beat Special Effect System as described in any one of claim 1-5, is characterized in that, can present which kind of beat special efficacy after described prompting special efficacy signal also points out user to make correct beat actions in time.
10. an interactive beat effect processing method, described method comprises:
When play multimedia file, or when outside device plays multimedia file, obtain the beat special effects data collection corresponding with described multimedia file, comprise multiple beat special efficacy label in described beat special effects data collection, each beat special efficacy label comprises timing node;
Synchronously concentrate from beat special effects data when play multimedia file and obtain corresponding beat special efficacy label, generate prompting special efficacy signal at described timing node place;
Export described prompting special efficacy signal and make beat actions in time to point out user;
When generating beat triggering signal after the beat actions sensing user;
If receive correct beat triggering signal in time, then generate beat special efficacy signal;
Corresponding beat special efficacy is exported according to described beat special efficacy signal.
CN201510056266.2A 2014-02-26 2015-02-02 Interactive beat effect system and interactive beat effect processing method Pending CN104754421A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510056266.2A CN104754421A (en) 2014-02-26 2015-02-02 Interactive beat effect system and interactive beat effect processing method
TW104106115A TWI574256B (en) 2014-02-26 2015-02-25 Interactive beat effect system and method for processing interactive beat effect

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2014100652096 2014-02-26
CN201410065209 2014-02-26
CN201510056266.2A CN104754421A (en) 2014-02-26 2015-02-02 Interactive beat effect system and interactive beat effect processing method

Publications (1)

Publication Number Publication Date
CN104754421A true CN104754421A (en) 2015-07-01

Family

ID=53593417

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510056266.2A Pending CN104754421A (en) 2014-02-26 2015-02-02 Interactive beat effect system and interactive beat effect processing method

Country Status (2)

Country Link
CN (1) CN104754421A (en)
TW (1) TWI574256B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105996305A (en) * 2016-05-03 2016-10-12 苏州乐聚堂电子科技有限公司 Intelligent shoe buckle and intelligent shoe buckle lamplight synchronous display method
CN107008002A (en) * 2015-11-24 2017-08-04 富士通株式会社 Non-transient computer readable storage medium storing program for executing, appraisal procedure and apparatus for evaluating
CN107464548A (en) * 2017-08-03 2017-12-12 京东方科技集团股份有限公司 Contactless music sensing device and musical performance method
CN107682642A (en) * 2017-09-19 2018-02-09 广州艾美网络科技有限公司 Identify the method, apparatus and terminal device of special video effect triggered time point
CN108877838A (en) * 2018-07-17 2018-11-23 黑盒子科技(北京)有限公司 Music special efficacy matching process and device
CN110801626A (en) * 2018-08-06 2020-02-18 南京芝兰人工智能技术研究院有限公司 LED lamp array game method and system based on intelligent interaction of children
CN111857482A (en) * 2020-07-24 2020-10-30 北京字节跳动网络技术有限公司 Interaction method, device, equipment and readable medium
CN112333464A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Interactive data generation method and device and computer storage medium
CN112333473A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Interaction method, interaction device and computer storage medium
CN114845145A (en) * 2021-01-30 2022-08-02 华为技术有限公司 Action prompt icon sequence generation method, electronic equipment and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1029565A2 (en) * 1999-02-16 2000-08-23 Konami Co., Ltd. Music staging game apparatus, music staging game method, and readable storage medium
JP2001013964A (en) * 1999-06-25 2001-01-19 Yamaha Corp Playing device and recording medium therefor
CN1797283A (en) * 2004-12-30 2006-07-05 集嘉通讯股份有限公司 Device and method for analyzing operation of movable product
CN101306249A (en) * 2008-05-30 2008-11-19 北京中星微电子有限公司 Motion analysis device and method
CN101483012A (en) * 2008-01-10 2009-07-15 肖伟 Dance teaching machine and detection method thereof
CN201524406U (en) * 2008-02-14 2010-07-14 株式会社万代南梦宫游戏 Music game apparatus

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1110779C (en) * 1996-10-31 2003-06-04 传感电子公司 Intelligent management system for video frequency information
US8467566B2 (en) * 2005-10-06 2013-06-18 Pitney Bowes Inc. Method for detecting fraud in a printed image
TW201022982A (en) * 2008-12-02 2010-06-16 Univ Nat Changhua Education A personalized rhythm authentication system
TW201322051A (en) * 2011-11-18 2013-06-01 Asustek Comp Inc Method for unlocking screen

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1029565A2 (en) * 1999-02-16 2000-08-23 Konami Co., Ltd. Music staging game apparatus, music staging game method, and readable storage medium
JP2001013964A (en) * 1999-06-25 2001-01-19 Yamaha Corp Playing device and recording medium therefor
CN1797283A (en) * 2004-12-30 2006-07-05 集嘉通讯股份有限公司 Device and method for analyzing operation of movable product
CN101483012A (en) * 2008-01-10 2009-07-15 肖伟 Dance teaching machine and detection method thereof
CN201524406U (en) * 2008-02-14 2010-07-14 株式会社万代南梦宫游戏 Music game apparatus
CN101306249A (en) * 2008-05-30 2008-11-19 北京中星微电子有限公司 Motion analysis device and method

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107008002A (en) * 2015-11-24 2017-08-04 富士通株式会社 Non-transient computer readable storage medium storing program for executing, appraisal procedure and apparatus for evaluating
CN105996305A (en) * 2016-05-03 2016-10-12 苏州乐聚堂电子科技有限公司 Intelligent shoe buckle and intelligent shoe buckle lamplight synchronous display method
CN107464548A (en) * 2017-08-03 2017-12-12 京东方科技集团股份有限公司 Contactless music sensing device and musical performance method
CN107682642A (en) * 2017-09-19 2018-02-09 广州艾美网络科技有限公司 Identify the method, apparatus and terminal device of special video effect triggered time point
CN108877838B (en) * 2018-07-17 2021-04-02 黑盒子科技(北京)有限公司 Music special effect matching method and device
CN108877838A (en) * 2018-07-17 2018-11-23 黑盒子科技(北京)有限公司 Music special efficacy matching process and device
CN110801626A (en) * 2018-08-06 2020-02-18 南京芝兰人工智能技术研究院有限公司 LED lamp array game method and system based on intelligent interaction of children
CN111857482A (en) * 2020-07-24 2020-10-30 北京字节跳动网络技术有限公司 Interaction method, device, equipment and readable medium
CN112333464A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Interactive data generation method and device and computer storage medium
CN112333473A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Interaction method, interaction device and computer storage medium
CN112333464B (en) * 2020-10-30 2022-08-02 北京字跳网络技术有限公司 Interactive data generation method and device and computer storage medium
CN112333473B (en) * 2020-10-30 2022-08-23 北京字跳网络技术有限公司 Interaction method, interaction device and computer storage medium
CN114845145A (en) * 2021-01-30 2022-08-02 华为技术有限公司 Action prompt icon sequence generation method, electronic equipment and readable storage medium
CN114845145B (en) * 2021-01-30 2024-04-12 华为技术有限公司 Action prompt icon sequence generation method, electronic device and readable storage medium

Also Published As

Publication number Publication date
TWI574256B (en) 2017-03-11
TW201535358A (en) 2015-09-16

Similar Documents

Publication Publication Date Title
CN104754421A (en) Interactive beat effect system and interactive beat effect processing method
CN108595970B (en) Configuration method and device of processing assembly, terminal and storage medium
US20210049899A1 (en) System and method of controlling external apparatus connected with device
WO2019101015A1 (en) Audio data processing method and apparatus, and storage medium
EP2683147B1 (en) Method and apparatus for pairing user devices using voice
TWI511125B (en) Voice control method, mobile terminal apparatus and voice controlsystem
CN104754372A (en) Beat-synchronized special effect system and beat-synchronized special effect handling method
CN109637548A (en) Voice interactive method and device based on Application on Voiceprint Recognition
CN104754394A (en) Vision-synchronized special effect system and vision-synchronized special effect handling method
CN107113520A (en) The system and method for the media device used in media environment for test and certification connection
KR102243027B1 (en) Apparatus, method and system for local wireless data communication of hybrid form
CN111966441A (en) Information processing method and device based on virtual resources, electronic equipment and medium
CN109509472A (en) Method, apparatus and system based on voice platform identification background music
US10755707B2 (en) Selectively blacklisting audio to improve digital assistant behavior
CN114121028A (en) Voice playing method, device, equipment and storage medium
CN104822095A (en) Composite beat special effect system and composite beat special effect processing method
CN104822085A (en) Interactive beat special effect system and interactive beat special effect processing method
TW201627987A (en) Singing visual effect system and method for processing singing visual effect
CN110908638A (en) Operation flow creating method and electronic equipment
CN104853238A (en) Combined beat special effect system and combined beat special effect processing method
KR102330576B1 (en) Singing rooms system and control method thereof
CN104581348A (en) Vocal accompaniment special visual effect system and method for processing vocal accompaniment special visual effects
CN115150501A (en) Voice interaction method and electronic equipment
CN107995612A (en) Equipment finding method, device and electronic equipment
CN104822094A (en) Polyrhythm special-effect system and polyrhythm special-effect processing method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150701