TW201619954A - Composite beat effect system and method for processing composite beat effect - Google Patents

Abstract

The present invention relates to a composite beat effect system and a method for processing composite beat effect. The system includes a controller, a beat sensing device and a beat effect outputting device. The controller obtains a beat effect data collection corresponding to a multimedia file when playing the multimedia file. The beat effect data collection includes a number of beat effect tags, and each tag defines time configuration data and synchronous beat effect configuration data. The beat sensing device produces a beat triggering signal after sensing the user's beat motion and sends the beat triggering signal to the controller. If never receives or doesn't receive the beat triggering signal exceeding a predetermined time period the controller produces a synchronous beat effect signal according to the synchronous beat effect configuration data. If the controller receives the beat triggering signal, the controller produces a corresponding interactive beat effect signal according to the beat triggering signal. The beat effect outputting device outputs the beat effect signal. The composite beat effect system and method can provide rich visual effect and can also respond to the user's beat motion.

Description

Compound beat special effect system and composite beat special effect processing method

The invention relates to the field of multimedia special effects, in particular to a compound beat special effect system and a composite beat special effect processing method.

Karaoke is a multimedia accompaniment system where singers can participate in singing with pre-recorded multimedia music. Karaoke can beautify and refine the voice of the singer through sound processing. When combined with music accompaniment, it becomes a sound song of the same body. This accompaniment method brings great convenience and pleasure to the singing enthusiasts, and becomes a way for people to entertain and entertain, and is now called KTV.

In the ordinary KTV system, the user's singing voice and accompaniment music can be mixed and played together, but the user cannot change the lighting effects and video special effects in the private room. That is, the existing KTV system is very weak.

In view of this, it is necessary to provide a composite beat special effect system and a composite beat special effect processing method, which can bring a visual effect with rich beat feeling to the user, and can respond to the user's own beat action.

An embodiment of the present invention provides a composite beat special effect system, including: a control host, a beat sensing device, and a special effect output device; and the control host acquires the multimedia file when playing a multimedia file or when playing an multimedia file by an external device Corresponding to the beat effect data set, the beat special effect data set includes a plurality of beat special effect labels, each beat special effect label includes a time node and a synchronous beat special effect setting data; when the user makes a beat motion, the beat sensing device senses Generating a beat trigger signal to the control unit after the user's beat action, and transmitting the beat trigger signal to the control host during the playing of the multimedia file; if the multimedia file is not received or received for a predetermined period of time The beat trigger signal is generated, and the control host generates a synchronous beat special effect signal corresponding to the synchronous beat special effect setting data at a time node defined by the beat special effect label; if the beat trigger signal is received, the control unit receives the beat trigger signal The control host generates an interactive beat according to the beat trigger signal Signal; the output apparatus to effect the beat synchronization signal or effect interaction effects beat signal output.

In an embodiment, if the time from the last time the beat trigger signal is received does not exceed the predetermined time period, the control host also ignores the beat effect label whose time node matches the current time.

In an embodiment, the control host generates an interactive beat special effect signal according to the beat trigger signal, including: generating a beat special effect signal that is the same as the previous synchronous beat special effect signal for any received beat trigger signal; or receiving any The beat trigger signal generates a beat effect signal that is the same as the next sync beat effect signal; or generates a beat effect signal that is the same as the synchronous beat effect signal that is closest to the current time for any received beat trigger signal; or any received The beat trigger signal generates the same preset interactive beat effect signal; or randomly or sequentially selects one of the pre-existing interactive beat effect signal lists as the generated interactive beat special effect signal; or generates corresponding interactive beat special effects according to different beat trigger signals Signal.

In an embodiment, the system further includes an external device, the external device selects or generates an interactive beat special effect setting data according to the input of the user, and sends the interactive beat special effect setting data to the control host; The host changes the preset interactive beat special effect signal or changes the pre-stored interactive beat special effect signal list according to the interactive beat special effect setting data.

In an embodiment, the external device further sets a beat trigger signal corresponding to the interactive beat effect setting data according to a user input.

In an embodiment, the external device further includes the interactive beat effect setting data in the beat trigger signal according to the input of the user, and sends the data to the control host.

In an embodiment, the controlling host acquires a beat special effect data set corresponding to the multimedia file, and the control host sends the corresponding beat special effect data set to the cloud server system according to the identifier of the multimedia file. And receiving the beat effect data set returned by the cloud server system.

In an embodiment, the controlling host acquiring the beat special effect data set corresponding to the multimedia file further includes: the control host transmitting the identity authentication information to the cloud server system, so that the cloud server system Verifying that the control host has permission to acquire a beat effect data set; the cloud server system returns to the beat effect data set requested by the control host when the control host has permission to acquire a beat special effect data set.

In an embodiment, the system further includes an external device connected to the control host; the external device sends the identifier of the corresponding multimedia file to the control when the multimedia file is played or the multimedia file is added to the playlist. After receiving the identifier of the multimedia file, the control host performs the step of the control host sending a request for acquiring the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file.

In an embodiment, the controlling host acquiring the beat special effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the beat special effect data set embedded in the multimedia file.

In an embodiment, the special effect output device includes: an audio output device, a video output device, and a light special effect device; the synchronous beat special effect setting data includes audio special effect data, lighting special effect data, and video special effect data, and the audio special effect data. Setting a sound effect emitted by the audio output device, the light effect data setting a mode of changing the light of the light special effect device, wherein the video special effect data sets an image change mode of the video output device, including a pattern, a color, a position, One or more of changes in angle, size, and the like.

In one embodiment, the beat sensing device includes a recording module and an audio analysis module, the recording module is configured to collect external sound, and the audio analysis module is configured to collect sound according to the recording module. Analyzing whether the audio feature meets a preset beat audio feature, and if so, the audio analysis module generates the beat trigger signal.

In one embodiment, the beat sensing device includes a video capture module and a video analysis module, the video capture module is configured to capture a video of a user, and the video analysis module is configured to analyze the video capture module. The group of user videos is captured to identify whether the user's action conforms to the predetermined feature, and if so, the video analysis module generates the beat trigger signal.

In an embodiment, the system further includes: a beat device, configured to send the beat trigger signal to the control host, the special effect output device, or the beat sensing device according to a user operation.

In an embodiment, the beat device is a passive sound emitting device for emitting a specific audio signal.

In an embodiment, the beat device is an electronic device that sends a specific signal to the control host, the special effect output device, or the beat when the user buttons, taps, touches, rotates, and moves. Induction device.

The embodiment of the present invention further provides a composite beat effect processing method, the method comprising: acquiring a beat special effect data set corresponding to the multimedia file when the multimedia file is played, or when the external device plays the multimedia file, the beat special effect The data set includes a plurality of beat special effects labels, each beat special effect label includes a time node and a synchronous beat special effect setting data; when the user makes a beat motion, the beat trigger signal is generated after sensing the user's beat motion; in the multimedia file During the playing process, if the beat trigger signal is not received or received for more than a predetermined period of time, a synchronous beat corresponding to the synchronous beat effect setting data is generated at a time node defined by the beat special effect label. The special effect signal; if the beat trigger signal is received, generating an interactive beat special effect signal according to the beat trigger signal; and outputting the synchronous beat special effect signal or the interactive beat special effect signal.

In an embodiment, if the time from the last time the beat trigger signal is received does not exceed the predetermined time period, the beat effect label whose time node matches the current time is ignored.

In an embodiment, the generating an interactive beat effect signal according to the beat trigger signal includes: generating a beat effect signal that is the same as a previous sync beat effect signal for any received beat trigger signal; or for any received beat The trigger signal generates a beat effect signal that is the same as the next sync beat effect signal; or generates a beat effect signal that is the same as the sync beat effect signal closest to the current time for any received beat trigger signal; or triggers any beat that is received The signal generates the same preset interactive beat effect signal; or randomly or sequentially selects a generated interactive beat special effect signal from a pre-stored interactive beat special effect signal list; or generates a corresponding interactive beat special effect signal according to different beat trigger signals.

In an embodiment, the method further includes: selecting or generating an interactive beat special setting data according to the input of the user; changing the preset interactive beat special effect signal according to the interactive special effect setting data or changing the pre-existing interactive beat A list of special effects signals.

In an embodiment, the method further includes: setting a beat trigger signal corresponding to the interactive beat effect setting data according to a user input.

In an embodiment, the method further includes: transmitting, according to an input of the user, the interactive beat effect setting data in the beat trigger signal.

In an embodiment, the acquiring the beat effect data set corresponding to the multimedia file includes: sending, according to the identifier of the multimedia file, a request for acquiring the corresponding beat special effect data set to the cloud server system; and receiving the The set of the beat effect data returned by the cloud server system.

In an embodiment, the acquiring the beat effect data set corresponding to the multimedia file further includes: sending the identity authentication information to the cloud server system, so that the cloud server system verifies whether the beat effect is obtained. The permission of the data set; the cloud server system returns to the beat special effect data set when the control host has permission to acquire a beat special effect data set.

In an embodiment, the method further includes: receiving an identifier of the multimedia file sent by the external device when the external device plays a multimedia file; and acquiring a beat special effect data set corresponding to the multimedia file The step is performed after receiving the identification of the multimedia file.

In an embodiment, the acquiring a beat effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the beat special effect data set embedded in the multimedia file.

In an embodiment, the synchronous beat effect setting data and the interactive beat special effect setting data all include audio special effect data, lighting special effect data, and video special effect data, and the audio special effect data sets a sound effect sent by the audio output device, The light effect data sets a manner of changing the light of the light special effect device, and the video special effect data sets an image change mode of the video output device to include one or more of a change of a pattern, a color, a position, an angle, a size, and the like.

In an embodiment, the method further includes: collecting an external sound, and analyzing whether the audio feature meets the preset beat audio feature according to the collected sound, and if yes, generating the beat trigger signal.

In one embodiment, the method further includes: capturing a video of the user, and identifying, according to the captured user video, whether the user's motion meets a predetermined feature, and if so, generating the beat trigger signal.

In an embodiment, the method further includes: receiving the beat trigger signal sent by the beat device according to a user operation.

The beneficial effect of the above technical solution is that the composite beat special effect system of the embodiment also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes a beat special effect label, which is in the process of playing the music according to The time node defined by the beat effect label generates a synchronized beat effect signal set by the sync beat effect setting data, and outputs an obvious beat effect by means of audio, video or light, and enhances the special effect type of the multimedia playing system. Moreover, when the user's beat action is sensed, the default sync beat effect is paused, and the interactive beat effect signal is immediately output according to the user's beat trigger signal, in particular, the user's beat action is visualized, and the multimedia file is played. The interactive function of the system is especially suitable for occasions such as KTV. Moreover, in addition to the triggering of the special electronic beat device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings inside.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

The specific embodiments, structures, features and functions of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

First embodiment

Referring to FIG. 1 , it is a schematic structural diagram of a composite beat special effect system according to a first embodiment of the present invention. As shown in FIG. 1, the composite beat special effect system 100 includes a control host 10, a song-song terminal 11, a beat sensing device 12, an audio output device 13, a multimedia video output device 14, a lighting effect device 15, and a video output device 16. It can be understood that the architecture of FIG. 1 is merely illustrative, and the composite beat effect system 100 may also include more devices such as a power amplifier, a microphone, and the like.

The karaoke terminal 11 provides a karaoke interface, for example, the user can click the song interface to make a song, and the selected song is submitted to the control host 10, and the control host 10 plays the accompaniment sound corresponding to the selected song according to the list to be played and The singer video transmits the audio and video to the audio output device 13 and the multimedia video output device 14 respectively.

The karaoke terminal 11 is specifically an input/output device connected to the control host 10, for example, a touch panel connected to the control host 10. At this time, the application interface of the karaoke terminal 11 is substantially controlled by the control host 10, The song terminal 11 serves only as an input/output device. The songs that the user orders through the touch panel are directly acquired by the control host 10.

The karaoke terminal 11 can also be a separate electronic device, such as an electronic device such as a mobile phone, a tablet, or the like, to which a specific application is installed. The user can make a song through the application, and the information of the song is transmitted to the control host 10 by the application. The specific transmission manner may include the following: when the control host 10 and the karaoke terminal 11 are in the same local area network, the karaoke terminal 11 can directly directly feed the information of the songs clicked by the user through the network through the predetermined network. The switch is sent to the control host 10. It can be understood that this method requires the control host 10 to open corresponding network services. When the control host 10 and the karaoke terminal 11 are not in the same local area network, the server can be relayed to transmit the information of the songs clicked by the user. That is, the application first submits the information of the songs clicked by the user to the server, and then, when the same user logs in to the control host 10, the control host 10 can obtain from the server or actively push the current login by the server. User-on-demand songs.

The beat sensing device 12 is configured to generate a beat trigger signal after sensing the user's beat motion when the host computer 10 plays the multimedia file. The beat action here refers to the action made by the user in response to the rhythm of the music, and the specific implementation includes but is not limited to: cheering, shaking the tambourine, shaking the arm, manipulating the mobile phone, pressing the remote controller, dancing, and the like.

In general, the beat action can be divided into two categories: sound and action.

Therefore, in a specific implementation manner, referring to FIG. 2, the beat sensing device 12 is implemented based on audio analysis, and includes a recording module 122 and an audio analysis module 124. The recording module 122 is configured to collect external sounds and audio. The analysis module 124 is configured to analyze whether the audio feature meets the preset beat audio feature according to the sound collected by the recording module 122. If so, the audio analysis module 124 generates a beat trigger signal.

For example, when the most common tambourine in a KTV facility is shaken, it emits ultrasonic waves in addition to a crisp sound. Therefore, when the audio analysis module 124 detects the ultrasonic wave of the predetermined frequency, a beat trigger signal is generated.

The audio analysis module 124 can also identify whether the recorded audio is a predetermined content by means of audio recognition. For example, when the user cheers "I love you", a beat trigger signal is generated.

Referring to FIG. 3, in another specific embodiment, the beat sensing device 12 is implemented based on the motion of the video analysis user, and includes a video capture module 126 and a video analysis module 128. The video capture module 126 is used for shooting. The video analysis module 128 is configured to analyze the user video captured by the video capture module 126 to identify whether the user's motion conforms to the predetermined feature. If so, the video analysis module 128 generates a beat trigger signal.

For example, the video analysis module 128 generates a beat trigger signal by video analysis to obtain an operation of the user shaking the arm at the same time.

In another specific embodiment, the beat sensing device 12 is implemented based on a beat signal transmitted by the beat device. For example, the beat sensing device 12 includes a Bluetooth module, an infrared module, or a WIFI module.

The beat device can be, for example, a remote controller having a plurality of buttons thereon. When the user presses a button, the remote controller transmits a corresponding infrared signal to the beat sensing device 12. That is, the infrared signal sent by the remote controller is the above-mentioned beat signal.

The beat device can also be, for example, a dedicated electronic device, which is also provided with a Bluetooth module, so as to be paired with the Bluetooth module of the beat sensing device 12, after successful pairing, when detecting that the user presses a certain button, or When the beat device is shaken, the beat device transmits a corresponding Bluetooth signal to the beat sensing device 12. That is, the Bluetooth signal sent by the beat device is the above-mentioned beat signal.

The beat device can also be, for example, a mobile phone connected to the beat sensing device 12 via WIFI. The mobile phone is equipped with a specific application program, and the application obtains the motion parameters of the beat device through the built-in accelerometer of the mobile phone, and further calculates the beat device. The motion track, when the motion track of the beat device conforms to the preset feature, the mobile phone transmits a predetermined network signal to the beat sensing device 12 through the WIFI network. That is to say, the network signal sent by the above mobile phone is the above-mentioned beat signal.

Further, it can be understood that the beat device is not limited to only one of the above types, and various types of beat devices can be used in combination. That is, the beat sensing device 12 receives the beat signal sent by the different beat devices; or the control host 10 detects the actions or audio of the plurality of users.

The audio output device 13 can be, for example, a speaker, and the multimedia video output device 14 and the video output device 16 can be any device that outputs a video image, such as a television, a display, a projector, or the like. The light effect device 15 includes at least one light fixture that can output a light signal according to the control signal. Preferably, the light effect device 15 can include an array of LED lights and corresponding drive devices that can cover all of the walls, roofs, and even the ground of the room. When each LED light in the LED light array is separately driven, the entire LED light array substantially constitutes a display, which can be used to display complex image signals. In this case, the difference between the light effect device 15 and the video output device 16 It is the difference in display scale.

The multimedia video output device 14 is, for example, a video home screen for displaying a multimedia vocal file and a video effect superimposed on the video home screen, and the video output device 16 is, for example, for displaying a video effect.

It will be appreciated that the composite beat effect system 100 can also include a plurality of multimedia video output devices 14 and a plurality of video output devices 16.

When the composite beat special effect system 100 of the present embodiment plays a song or other multimedia file, the control host 10 acquires the beat special effect data set corresponding to the current song in addition to the original file of the song.

In a specific implementation manner, the above-mentioned beat effect data set is embedded in the original file of the song. Therefore, the control host 10 needs to parse the corresponding beat effect data set from the original file of the song. It can be understood that the original file of the song can be stored in the local memory (referring to the memory connected to the control host through the data bus), or stored in the network memory. The network memory here can include a local area network, an intranet, or the Internet.

In another specific implementation manner, the above-mentioned beat effect data set is stored separately from the original file of the song. Similar to the original file of the song, the beat effect data set can be stored in local memory or stored in network memory.

The above-mentioned beat effect data set is a beat special effect data set using a predefined agreement or language description.

In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] Synchronous beat effect setting data 1 [00:24.88] Synchronous beat effect setting data 2 [01:27.05] Synchronous beat effect setting data 3 [ 02:30.39] Synchronous beat effect setting data 4...

In this case, only the time node and the synchronized beat special effect setting data are included in the beat special effect label. In the preset situation, the control host 10 generates and synchronizes the beat special effect setting data according to the current time synchronized with the time node defined by the beat special effect label. Corresponding synchronous beat effect signal, and send the generated synchronous beat special effect signal to the effect output device output.

In the example of the beat effect data set listed above, the time is represented by time: minute: second, but the present invention is not limited to this method, for example, the number of seconds, milliseconds, minutes, etc. can be directly used. Characterized by any unit. Taking the start time 00:24.00 as an example, the number of seconds converted is 1440, and the number of milliseconds is 14.40 million, which is 24 in minutes. The time data recorded in the time setting data may also be the result of various reversible operations on the time value, and may even perform an encryption operation. Taking the above number of seconds 1440 as an example, for example, it can be divided by 2 to obtain 720. That is, 720 is stored in the time setting data, but it actually expresses 1440 seconds. It can be understood that after this operation, in order to calculate the effective time of a beat effect label, it is necessary to perform a reverse operation to obtain the actual time.

It can be understood that no matter what kind of processing, the essence is still to define a time node in the beat effect label and compare the current time with the defined time node to obtain the matching beat effect label. Therefore, all these methods should be It is included in the scope of the above time setting data.

In a specific implementation manner, the synchronization beat effect setting data is a description of a synchronous beat effect to be implemented by using a predefined agreement or language. This description defines the type and parameters of the synchronized beat effect. The types described above may include, for example, audio, video, lighting, or any combination thereof. The above parameters may include specific effects of the specific parameters such as the sound to be output, the color of the light, the pattern and the brightness, such as speed, scale and range.

In another specific embodiment, the synchronization beat effect setting data is information for acquiring other formats of the beat effect, for example, an identifier of a video special effect file. The video effect file here may be pre-stored in the memory connected to the control host 10 or stored in the cloud server. The control host 10 can read the video file in the memory or initiate a network request to download the video file from the cloud server.

It can be understood that the beat effect data set can be automatically generated by the special system according to the analysis result of the audio data of each song, or can be manually generated according to the content of the song. But in general, no matter how the beat special effects data set is produced, its purpose is to output an obvious change that can be perceived by the user through audio, video, lighting, and the like.

In the present embodiment, the preset situation refers to that the control host 10 never receives the beat trigger signal sent by the beat sensing device 12, or the time from the last time the beat trigger signal sent by the beat sensing device 12 is received exceeds the predetermined time. period.

The control host 10 can determine whether the time from the last time the beat trigger signal sent by the beat sensing device 12 is received exceeds the predetermined time period before acquiring the beat effect label matching the current time. If not, the matching beat effect is not obtained. Label; if it is exceeded, try to get a matching beat effect label.

Of course, the control host 10 may first obtain the matching beat special effect label, and then determine whether the time from the last time the beat effect signal sent by the beat sensing device 12 is received exceeds the predetermined time period; if not, the synchronization is no longer generated. The beat effect signal; if it has been exceeded, a sync beat effect signal is generated at the time node defined by the matching beat effect label.

After receiving the beat trigger signal sent by the beat sensing device 12, the control host 10 generates a corresponding interactive beat special effect signal according to the received beat trigger signal.

In a specific implementation manner, the control host 10 generates the same preset interactive beat effect signal for any received beat trigger signal. It can be understood that the above-mentioned default interactive beat special effect signal or other materials for generating an interactive beat special effect signal can be pre-stored in the memory in the control host 10. The control host 10 generates the above-mentioned preset interactive beat effect signal without exchanging data with other devices. That is, the same default interactive beat effect is generated regardless of whether the user shakes his or her arms or shakes the tambourine.

In a specific implementation manner, the control host 10 randomly or sequentially selects a generated interactive beat effect signal from a pre-stored interactive beat effect signal list for any received beat trigger signal. The above list may also be pre-stored in the memory within the control unit 10. In this way, two identical beats may trigger different interactive beat effects.

In a specific implementation manner, the control host 10 also generates corresponding interactive beat special effects signals according to different beat trigger signals. For example, when the user shouts "I love you", a heart-shaped animation is generated, and when the user cheers, an animation of the applause is generated.

In addition, after receiving the beat trigger signal, in addition to immediately outputting a corresponding interactive beat effect signal, the default sync beat effect (ie, the beat effect defined by the beat effect label) is paused for the next predetermined period of time. That is, during the predetermined period of time, even if there is a beat effect matching tag matched by the time node, the control host 10 ignores the beat effect label and does not output the corresponding sync beat effect.

In a specific implementation manner, the above-mentioned beat effects (including synchronous beat effects and interactive beat effects) are audio special effects. Thus, when the beat trigger signal is received or at the time node defined by the beat effect tag, the audio output device 13 can play the audio.

In a specific implementation manner, the above-mentioned beat effects (including synchronous beat effects and interactive beat effects) are video effects. Thus, when a beat trigger signal is received or at a time node defined by the beat effect tag, the video effect can be played through the video output device 16.

In a specific implementation manner, the above-mentioned beat effects (including synchronous beat effects and interactive beat effects) are lighting effects. Thus, when a beat trigger signal is received or at a time node defined by the beat effect label, the light effect device 15 can be played through the light effect device 15.

Further, the above various types of special effects can also be used in combination. That is, a synchronous beat effect or an interactive beat effect may include various types of special effects, for example, may include any combination of sound effects, video effects, or lighting effects.

The composite beat special effect system of the embodiment also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes a beat special effect label, and the time node defined by the beat special effect label during the playing of the music Generate a synchronized beat effect signal corresponding to the sync beat effect setting data, and output an obvious beat effect by means of audio, video or light, and increase the special effects of the multimedia play system. Moreover, when the user's beat action is sensed, the default sync beat effect is paused, and the interactive beat effect signal is immediately output according to the user's beat trigger signal, in particular, the user's beat action is visualized, and the multimedia file is played. The interactive function of the system is especially suitable for occasions such as KTV. Moreover, in addition to the triggering of the special electronic beat device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings inside.

Second embodiment

Referring to FIG. 4, it is a schematic diagram of a composite beat special effect system 200 according to a second embodiment of the present invention. The composite beat special effect system 200 of the present embodiment is similar to the composite beat special effect system of FIG. 1 except that it further includes: an external device 20.

The external device 20 can be, for example, a computer that installs a song app. The karaoke panel 11, the audio output device 13, and the multimedia video output device 14 are connected to the external device 20. Thus, the song panel 11, the audio output device 13, and the multimedia video output device 14 and the external device 20 themselves constitute a common multimedia on-demand system that can be used in KTV and the like. The beat sensing device 12, the video output device 16 and the light effect device 15 are still connected to the control host 10.

In the present embodiment, the external device 20 is, for example, a conventional karaoke system host, which implements a song control function of songs and songs. However, compared with the traditional VOD system host, it is further connected to the control host 10 for transmitting the interactive beat effect setting data selected or edited by the user to the control host 10.

It can be understood that in order for the external device 20 to send specific information to the control host 10, a specific application design development interface (API) can be disclosed in the control host 10, so that the external device 20 can make a call to the control host 10. Send the above information.

In a specific implementation manner, referring to FIG. 5, the external device 20 provides an interface 210 for the user to select or edit the interactive beat effect setting data. In the interface 210, all available interactive beat effects can be listed for the user to select, or provide user editing. The interactive beat effect interface allows the user to arbitrarily select, combine, and edit the desired interactive beat effect. After completing the selection or editing, the user can click the button 220. After the button 220 is clicked, the control host 10 is based on the user. The input generates corresponding interactive beat effect setting data, and the interactive beat special effect setting data may include an identifier of the interactive beat effect selected by the user, an original file of the interactive beat effect selected by the user, or an original file of the interactive beat effect edited by the user. The external device 20 can transmit the interactive beat effect setting data to the control host 10. Specific examples of the above editing may include, for example, allowing a user to set parameters of an animation, writing a text, drawing a picture, making an animation, and the like.

After receiving the interactive beat effect setting data sent by the external device 20, the control host 10 changes the preset interactive beat special effect signal or changes the pre-stored interactive beat special effect signal list according to the interactive beat special effect setting data.

Further, the external device 20 further sets a beat trigger signal corresponding to the interactive beat effect setting data according to the input of the user, and the beat trigger signal corresponding to the interactive beat special effect data can be sent to the control host 10 through the API described above. . In this way, the control host 10 can generate corresponding interactive beat effects for different beat trigger signals according to the correspondence between the interactive beat effect setting data and the beat trigger signal. For example, when the interactive beat effect setting data sent by the external device 20 sets a special effect of the heart-shaped pattern, the corresponding beat trigger signal is the voice “I love you”. In this way, when the control host 10 receives the voice command "I love you", the effect of the corresponding heart-shaped pattern can be output.

Further, the interactive beat effect setting data may be included in the beat trigger signal and sent to the control host 10. For example, when the user clicks the button 220, the control host 10 generates a one-shot trigger signal, and the interactive beat effect setting data is included in the beat trigger signal and sent to the control host 10.

In this case, the control host 10 parses the interactive beat effect setting data from the beat trigger signal, generates a corresponding interactive beat special effect signal according to the interactive beat special effect setting data, and sends the interactive beat special effect signal to the special effect output device for output. According to this method, the interactive beat effect setting data in the beat trigger signal is used to instantly output a corresponding interactive beat special effect signal, and the interactive beat special effect setting data is one-time effective. If the beat trigger signal that does not include the interactive beat effect setting data is received next time, the generated interactive beat special effect signal is still the preset interactive beat special effect signal.

Further, the amplitude, brightness, range, and the like of the interactive beat effect may be related to the intensity of the beat action (through analysis of audio parameters such as volume and frequency) or to the user's motion range (by video) The analysis is relevant). For example, when the volume is higher, the amplitude of the interactive beat effect is larger, and the higher the frequency, the brighter the brightness of the interactive beat effect is.

However, the manner in which the interactive beat effect setting data is used in the embodiment is not limited thereto. For example, the control host 10 may also change the preset interactive beat special effect signal or change the pre-existing interactive beat special effect according to the interactive beat special effect setting data. A list of signals. At this time, the interactive beat effect setting data sent once will be used again to generate the corresponding interactive beat special effect signal when the beat trigger signal is subsequently received.

In addition to the synchronization/interaction beat effect setting data selected or edited by the user, the external device 20 can also send the identifier of the song to the control host 10 when the user clicks the song, so that the control host 10 can acquire the corresponding beat effect data set.

In the present embodiment, the audio output device 13 and the multimedia video output device 14 can simultaneously output audio and video from the external device 20 and beat effects from the control host 10. In the case of audio, for example, an audio superimposing device is additionally provided, which includes two input terminals respectively connected to the external device 20 and the audio output port of the control host 10, and the output of the audio superimposing device and the audio input device 13 are used for audio input. The mouth is connected. The audio superimposing device superimposes the audio outputted by the external device 20 and the control host 10 through the audio processing technology, and then transmits the audio to the audio output device 13 for output. Similar to audio, if you want to achieve video overlay, you need to set up a video overlay device.

When the control host 10 is a smart electronic device, the software installed in the smart electronic device can wirelessly control the audio output device 13, the light effect device 15 and the video output device 16 to output a beat effect.

In addition, the external device 20 is not limited to the host of the VOD system, and may be other smart electronic devices such as smart phones, tablets, and the like. In this way, users can use their own devices to perform instant editing of interactive beat effects.

Further, the control host 10, the external device 20, and the beat sensing device 12 can be operated by the same intelligent electronic device, which can allow the user to edit or select the interactive beat effect, shake the start trigger signal, and control the special effect output device.

According to the composite beat special effect system of the present embodiment, the interactive beat effect is instantly selected or edited through an external device to provide the most timely KTV special effects interactive experience.

Third embodiment

Referring to FIG. 6, the embodiment provides a composite beat special effect processing method, which can be used in the composite beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 6, the method of this embodiment includes the following steps:

In step S101, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Including time node and synchronization beat effect setting data;

Step S102, when the user makes a beat action, and generates a beat trigger signal after sensing the user's beat motion;

Step S103, in the playing process of the multimedia file, if the beat trigger signal is not received or received for a predetermined period of time, then generated and synchronized with the time node defined by the beat effect label. The synchronization beat special effect signal corresponding to the special effect setting data;

Step S104, if the beat trigger signal is received, generating an interactive beat special effect signal according to the beat trigger signal;

Step S105, output the synchronous beat special effect signal or the interactive beat special effect signal.

The composite beat special effect method of the embodiment also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes a synchronous beat special effect label, and the time defined by the beat special effect label during the playing of the music The node generates a synchronous beat special effect signal corresponding to the synchronous beat special effect setting data, and outputs an obvious beat effect by means of audio, video or lighting, thereby improving the special effect type of the multimedia playing system. Moreover, when the user's beat action is sensed, the default sync beat effect is paused, and the interactive beat effect signal is immediately output according to the user's beat trigger signal, in particular, the user's beat action is visualized, and the multimedia file is played. The interactive function of the system is especially suitable for occasions such as KTV. Moreover, in addition to the triggering of the special electronic beat device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. Use feelings inside.

Fourth embodiment

Referring to FIG. 7, the embodiment provides a composite beat special effect processing method, which can be used in the composite beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 7, the method of this embodiment includes the following steps:

In step S101, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Including time node and synchronization beat effect setting data;

After step S101, two round-trip processes are respectively performed, where the first sub-process includes:

In step S201, the beat trigger signal is monitored. The beat trigger signal here is, for example, sent by the beat sensing device 12 or obtained by the control host 10 by analyzing the sensed data of the sensor.

Step S202, after receiving the beat trigger signal, generate an interactive beat special effect signal and record the time of receiving the beat trigger signal.

Step S203, outputting an interactive beat special effect signal.

After step S203, the first sub-flow returns to step S201, that is, the process of monitoring the beat trigger signal is performed continuously during the playback or singing of the multimedia file.

On the other hand, after the step S101, a second sub-flow is further performed, which includes:

In step S204, it is determined whether the beat trigger signal has not been received or has not been received for a predetermined period of time; if yes, step S205 is performed; otherwise, the flow returns to step S204.

Step S205: Synchronize a synchronization beat effect signal corresponding to the synchronization beat effect setting data at a time node defined by the beat effect label. Specifically, if the current time matches the time node defined by the beat special effect label, a synchronous beat special effect signal corresponding to the synchronous beat special effect setting data is generated.

Step S206, outputting the generated synchronous beat special effect signal.

After step S206, the flow returns to step S204. That is to say, the second sub-flow is also carried out continuously during the playback or singing of the multimedia file.

According to the method of the embodiment, in the process of playing the multimedia file, the synchronous beat effect defined by the beat effect label is output in a preset state, and each time a beat trigger signal is received, a corresponding interactive beat effect is output. And the synchronous beat effect defined by the beat effect label is paused for a predetermined period of time thereafter.

Fifth embodiment

Referring to FIG. 8 , the embodiment provides a composite beat special effect processing method, which can be used in the composite beat special effect system shown in FIG. 1 or FIG. 4 . As shown in FIG. 8, the method of the present embodiment is similar to the method shown in FIG. 7, except that the second sub-flow includes the following steps:

Step S301: Acquire a matching beat effect label according to the current time. The matching beat effect label is, for example, a beat effect label whose time node matches the current time.

In step S204, it is determined whether the beat trigger signal has not been received or has not been received for a predetermined period of time; if yes, step S302 is performed; otherwise, the flow returns to step S301.

Step S302, generating a synchronous beat special effect signal corresponding to the synchronization beat effect setting data according to the matched beat special effect label.

According to the method of the present embodiment, the matched beat special effect label is obtained first, and then it is determined whether the synchronous beat special effect signal is generated and output, thereby providing an embodiment different from the fourth embodiment.

Sixth embodiment

Referring to FIG. 9, the embodiment provides a composite beat special effect processing method, which can be used in the composite beat special effect system shown in FIG. 4. As shown in FIG. 9, the method of the present embodiment is similar to the method shown in FIG. 7, except that the first sub-flow includes the following steps:

In step S201, the beat trigger signal is monitored. The beat trigger signal is sent by the external device 20, for example, and the beat trigger signal includes interactive beat effect setting data, and the interactive beat effect setting data is selected or edited by the user.

Step S202a, receiving the beat trigger signal, parsing the interactive beat special effect setting data from the beat trigger signal, and generating an interactive beat special effect signal according to the interactive beat special effect setting data.

Further, in addition to generating an interactive beat special effect signal according to the interactive beat effect setting data, the preset preset interactive beat special effect signal or the interactive beat special effect signal list may be updated.

According to the method of the embodiment, the interactive beat special effect signal is generated according to the interactive beat special effect setting data sent immediately, thereby maximizing the interactive function of the KTV system.

In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, such as a non-volatile memory such as a compact disk, a hard disk, or a flash memory. The computer executable instructions are for causing a computer or similar computing device to perform the method of the above embodiments.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The present invention has been disclosed in the preferred embodiments, but is not intended to limit the present invention, and any person skilled in the art. The equivalents of the technical solutions disclosed above may be modified or modified to equivalent variations, without departing from the technical scope of the present invention, in accordance with the technical essence of the present invention. Any of the above-described modifications, equivalent changes and modifications of the above embodiments are still within the scope of the technical solutions of the present invention.

100, 200‧‧‧ synchronized beat special effects system
10‧‧‧Control host
11‧‧‧歌歌终端
12‧‧‧ beat sensing device
13‧‧‧Audio output device
14‧‧‧Multimedia video output device
15‧‧‧Lighting effect device
16‧‧‧Video output device
20‧‧‧External equipment
122‧‧‧Recording module
124‧‧‧Audio Analysis Module
126‧‧‧Video Capture Module
128‧‧‧Video Analysis Module
210‧‧‧ interface
220‧‧‧ button

1 is a schematic structural diagram of a composite beat special effect system provided by a first embodiment of the present invention; [FIG. 2] is a block diagram of a beat sensing device of a composite beat special effect system provided by the first embodiment; [FIG. 3] Another module diagram of the beat sensing device of the composite beat special effect system provided by the first embodiment; [FIG. 4] is a schematic structural diagram of a composite beat special effect system provided by the second embodiment of the present invention; [FIG. 5] The interface diagram of the external device of the composite beat special effect system of the second embodiment; [FIG. 6] is a flowchart of the composite beat special effect processing method provided by the third embodiment of the present invention; [FIG. 7] is a composite provided by the fourth embodiment of the present invention. FIG. 8 is a flowchart of a composite beat special effect processing method according to a fifth embodiment of the present invention; FIG. 9 is a flowchart of a composite beat special effect processing method according to a sixth embodiment of the present invention.

100‧‧‧Complex Beat Special Effects System

10‧‧‧Control host

11‧‧‧歌歌终端

12‧‧‧ beat sensing device

13‧‧‧Audio output device

14‧‧‧Multimedia video output device

15‧‧‧Lighting effect device

16‧‧‧Video output device

Claims (10)

A composite beat special effect system, comprising: a control host, a beat sensing device and a special effect output device; the control host acquires a beat effect corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device a data set, the beat special effect data set includes a plurality of beat special effect labels, each beat special effect label includes a time node and a synchronous beat special effect setting data; when the user makes a beat motion, the beat sensing device senses the user Generating a beat trigger signal after the beat action, and transmitting the beat trigger signal to the control host; during the playing of the multimedia file, if the beat trigger signal is not received or received for a predetermined period of time And the control host generates a synchronous beat special effect signal corresponding to the synchronous beat special effect setting data at a time node defined by the beat special effect label; if the beat trigger signal is received, the control host is configured according to the control host The beat trigger signal generates an interactive beat special effect signal; Output device effect the synchronization signal beat effect or interaction effect beat signal output. The composite beat special effect system of claim 1, wherein the control host ignores the time node and the current time if the time from the last time the beat trigger signal is received does not exceed the predetermined time period. Match the beat effect label. The composite beat special effect system of claim 1, wherein the control host generates an interactive beat special effect signal according to the beat trigger signal, comprising: generating an arbitrary beat beat effect signal and a previous synchronous beat special effect signal. The same beat effect signal; or generate a beat effect signal that is the same as the next sync beat effect signal for any received beat trigger signal; or generate the same beat beat effect signal that is closest to the current time for any received beat trigger signal The beat effect signal; or generate the same preset interactive beat effect signal for any received beat trigger signal; or randomly or sequentially select a generated interactive beat special effect signal from a pre-stored interactive beat special effect list; or Different beat trigger signals generate corresponding interactive beat special effects signals. The composite beat special effect system of claim 3, further comprising: an external device, wherein the external device selects or generates an interactive beat special effect setting data according to a user input, and sets the interactive beat special effect setting data. Sending to the control host; the control host changes the preset interactive beat special effect signal or changes the pre-stored interactive beat special effect signal list according to the interactive beat special effect setting data. The composite beat special effect system of claim 4, wherein the external device further sets a beat trigger signal corresponding to the interactive beat effect setting data according to a user input. The composite beat special effect system of claim 5, wherein the external device further sends the beat special effect setting data to the beat trigger signal according to a user input, and sends the control to the control. Host. The composite beat special effect system according to any one of claims 1-6, wherein the beat sensing device comprises a recording module and an audio analysis module, wherein the recording module is configured to collect an external sound, the audio The analysis module is configured to analyze whether the audio feature meets the preset beat audio feature according to the sound collected by the recording module, and if so, the audio analysis module generates the beat trigger signal. The composite beat special effect system according to any one of claims 1-6, wherein the beat sensing device comprises a video capture module and a video analysis module, wherein the video capture module is used to capture a video of a user. The video analysis module is configured to analyze a user video captured by the video capture module to identify whether the user's motion conforms to a predetermined feature, and if so, the video analysis module generates the beat trigger signal. The composite beat special effect system according to any one of claims 1-6, the system further comprising: a beat device, configured to send the beat trigger signal to the control host according to an operation of a user, A special effect output device or the beat sensing device. A method for processing a composite beat effect, the method comprising: acquiring a beat effect data set corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device, where the beat special effect data set includes multiple The beat effect label, each beat special effect label includes a time node and a synchronized beat special effect setting data; when the user makes a beat motion, the beat trigger signal is generated after sensing the user's beat motion; during the playing of the multimedia file, if If the beat trigger signal is not received or received for a predetermined period of time, a synchronous beat special effect signal corresponding to the synchronous beat special effect setting data is generated at a time node defined by the beat special effect label; The beat trigger signal generates an interactive beat special effect signal according to the beat trigger signal; and outputs the synchronous beat special effect signal or the interactive beat special effect signal.