TWI574252B - Synchronous beat effect system and method for processing synchronous beat effect - Google Patents

Description

Synchronous beat special effect system and synchronous beat special effect processing method

The invention relates to the technical field of multimedia special effects, in particular to a synchronous beat special effect system and a synchronous beat special effect processing method.

Karaoke is a multimedia accompaniment system where singers can participate in singing with pre-recorded music. Karaoke can beautify and refine the voice of the singer through sound processing. When combined with music accompaniment, it becomes a sound song of the same body. This accompaniment method brings great convenience and pleasure to the singing enthusiasts, and becomes a way for people to entertain and entertainment, and is now called KTV.

In a normal KTV system, the user's singing and accompaniment music can be mixed and played together, but the user cannot change the lighting effects and video effects in the private room. That is, the interaction of the existing KTV system is very weak.

In view of this, it is necessary to provide a synchronous beat special effect system and a synchronous beat special effect processing method, which can provide a richer beat effect, especially visualizing the user's beat action.

An embodiment of the present invention provides a synchronous beat special effect system, including: a control host, a beat sensing device, and a beat special effect output device;

The control host acquires a beat special effect data set corresponding to the multimedia file when the multimedia file is played, or when the external device plays the multimedia file, the beat special effect data set includes a plurality of beat special effects labels, and each beat special effect The label includes time setting data and corresponding special effect setting materials;

The beat sensing device generates a beat trigger signal after sensing the user's beat motion when the control host plays the multimedia file;

After receiving the beat trigger signal, the control host obtains a matching beat effect label from the beat special effect data set according to the current time, and generates a beat special effect signal according to the acquired beat special effect label;

The beat effect output device outputs a corresponding beat effect according to the beat effect signal of the control host.

In one embodiment, the beat effect label further includes a beat trigger signal setting data; the matched beat special effect label refers to a beat special effect label that simultaneously satisfies the time setting data and the beat trigger signal setting data.

In one embodiment, the special effect setting data sets a plurality of beat special effects, and the beat trigger signal setting data settings respectively correspond to the beat trigger signals of the plurality of beat special effects, wherein the plurality of beat trigger signals respectively correspond to different beats Equipment or user;

After receiving the plurality of beat trigger signals sent by the beat sensing device, the control host generates a corresponding beat effect signal for each matched beat trigger signal;

The beat effect output device outputs a beat effect.

In one embodiment, the control host acquires a beat effect data set corresponding to the multimedia file when playing the multimedia file, including:

Sending, by the control host, a request for acquiring the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file;

Receiving the beat effect data set returned by the cloud server system.

In one embodiment, the acquiring, by the control host, the beat effect data set corresponding to the multimedia file when playing the multimedia file further includes:

Sending, by the control host, identity authentication information to the cloud server system, so that the cloud server system verifies whether the control host has permission to acquire a beat special effect data set;

The cloud server system returns to the beat effect data set requested by the control host when the control host has the permission to acquire the beat special effect data set.

In an embodiment, the system further includes an external device connected to the control host; the external device sends the identifier of the corresponding multimedia file to the control when the multimedia file is played or the multimedia file is added to the playlist. Host

After receiving the identifier of the multimedia file, the control host performs the step of the control host sending a request for acquiring the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file.

In one embodiment, the acquiring, by the control host, the beat effect data set corresponding to the multimedia file when playing the multimedia file comprises: parsing the beat effect embedded in the multimedia file from the multimedia file Data set.

In one embodiment, the beat effect output device includes: an audio output device, a video output device, and a light special effect device;

The special effect setting data includes audio special effect data, lighting special effect data and video special effect data, wherein the audio special effect data sets a sound special effect issued by the audio output device, and the lighting special effect data sets a manner of changing the light of the lighting special effect device, The video special effect data sets an image change mode of the video output device to include one or more of a change of a pattern, a color, a position, an angle, a size, and the like.

In one embodiment, the beat sensing device includes a recording module and an audio analysis module, the recording module is configured to collect external sound, and the audio analysis module is configured to collect sound according to the recording module. Analyzing whether the audio feature meets a preset beat audio feature, and if so, the audio analysis module generates the beat trigger signal.

In one embodiment, the beat sensing device includes a video capture module for capturing a video of a user, and a video analysis module for analyzing the video capture module. The group of user videos is captured to identify whether the user's action conforms to the predetermined feature, and if so, the video analysis module generates the beat trigger signal.

In one embodiment, the system further includes: a beat device for issuing the beat trigger signal to the control host, the beat effect output device, or the beat sensing device according to a user operation.

In one embodiment, the beat device is a passive sound emitting device for emitting a specific audio signal.

In one embodiment, the metronome device is an electronic device that sends a specific signal to the control host, the beat effect output device, or the user when the user buttons, taps, touches, rotates, moves Beat sensing device.

In one embodiment, the control host is a smart electronic device, and the smart electronic device is connected to the beat special effect output device via a wireless network, and the smart electronic device includes a built-in microphone, and the smart electronic device is installed in the smart electronic device. There is a specific application, the specific application records the sound emitted by the external device through the built-in microphone, performs feature sampling and feature analysis on the recorded sound to identify the identifier of the song played by the external device, and according to the identifier The beat effect data set is obtained from the cloud server.

An embodiment of the present invention further provides a synchronization beat special effect processing method, where the method includes:

When the multimedia file is played, or when the multimedia file is played by the external device, the beat effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label includes a time setting. Information and corresponding special effects setting materials;

After receiving the beat trigger signal sent by the beat sensing device, obtaining a matching beat effect label from the beat special effect data set according to the current time, and generating a beat special effect signal according to the acquired beat special effect label, wherein the beat trigger signal is generated by the beat The sensing device generates the user's beat action during the playing of the multimedia file; and

The corresponding beat effect is output according to the beat effect signal.

In one embodiment, the beat effect label further includes a beat trigger signal setting data; the matched beat special effect label refers to a beat special effect label that simultaneously satisfies the time setting data and the beat trigger signal setting data.

In one embodiment, the special effect setting data sets a plurality of beat special effects, and the beat trigger signal setting data settings respectively correspond to the beat trigger signals of the plurality of beat special effects, wherein the plurality of beat trigger signals respectively correspond to different beats Equipment or user;

The method further includes:

After receiving the plurality of beat trigger signals sent by the beat sensing device, generating a corresponding beat effect signal for each matched beat trigger signal;

All beat effect signals are output.

In one embodiment, the acquiring a beat effect data set corresponding to the multimedia file includes:

Sending, according to the identifier of the multimedia file, a request for acquiring the corresponding beat effect data set to the cloud server system;

Receiving the beat effect data set returned by the cloud server system.

In one embodiment, the acquiring a beat effect data set corresponding to the multimedia file further includes:

Sending identity authentication information to the cloud server system, so that the cloud server system verifies whether it has permission to acquire a beat effect data set;

The cloud server system returns to the beat effect data set when the control host has permission to acquire a beat effect data set.

In an embodiment, the method further includes:

Receiving, by the external device, the identifier of the multimedia file sent by the external device; the step of acquiring a beat special effect data set corresponding to the multimedia file, after receiving the identifier of the multimedia file get on.

In one embodiment, the acquiring the beat effect data set corresponding to the multimedia file comprises: parsing the beat special effect data set embedded in the multimedia file from the multimedia file.

In one embodiment, the special effect setting data includes audio special effect data, lighting special effect data, and video special effect data, wherein the audio special effect data sets a sound effect sent by the audio output device, and the light special effect data sets the light. The mode of changing the light of the special effect device, wherein the video special effect data sets the image change mode of the video output device to include one or more of a change of a pattern, a color, a position, an angle, a size, and the like.

In one embodiment, the method further includes: collecting an external sound, and analyzing whether the audio feature conforms to the preset beat audio feature according to the collected sound, and if yes, generating the beat trigger signal.

In one embodiment, the method further includes: capturing a video of the user, and identifying, according to the captured user video, whether the user's motion conforms to a predetermined feature, and if so, generating the beat trigger signal.

In one embodiment, the method further includes receiving the beat trigger signal sent by the beat device according to a user operation.

In one embodiment, the beat effect data set and the beat effect signal are transmitted through a wireless network.

The beneficial effects of the above technical solution are as follows: the synchronous beat special effect system further acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes a beat special effect label for setting data for different time respectively, when When the user's beat action is sensed during the playing of the music, the control host can find a matching beat effect label and output an obvious beat effect through audio, video or light, especially visualizing the user's beat action. Enhance the interactive functions of the multimedia file playback system, especially for KTV and other occasions. Moreover, in addition to being triggered by a special beat device, the user can trigger the beat action by using a common operation such as shaking the tambourine in the KTV, so that the user can naturally start the beat effect without learning, and improve the user's feeling in the KTV room. .

The above and other objects, features and advantages of the present invention will become more <RTIgt;

The specific embodiments, structures, features and functions of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

First embodiment

Referring to FIG. 1 , it is a schematic structural diagram of a synchronous beat special effect system according to a first embodiment of the present invention. As shown in FIG. 1, the synchronous beat special effect system 100 includes a control host 10, a song-song terminal 11, a beat sensing device 12, an audio output device 13, a multimedia video output device 14, a lighting effect device 15, and a video output device 16. It can be understood that the architecture of FIG. 1 is merely illustrative, and the synchronous beat effect system 100 may also include more devices such as a power amplifier, a microphone, and the like.

The karaoke terminal 11 provides a karaoke interface. The user can, for example, sing a song through the karaoke interface, and the selected song is submitted to the control host 10, and the control host 10 plays the accompaniment sound corresponding to the selected song according to the list to be played and The singer video transmits the audio and video to the audio output device 13 and the multimedia video output device 14 respectively.

The karaoke terminal 11 may specifically be an input/output device connected to the control host 10, such as a touch panel connected to the control host 10. At this time, the application interface of the karaoke terminal 11 is substantially controlled by the control host 10, The karaoke terminal 11 serves only as an input/output device. The songs that the user orders through the touch panel are directly acquired by the control host 10.

The karaoke terminal 11 can also be a separate electronic device, such as an electronic device such as a mobile phone, a tablet, or the like, to which a specific application is installed. The user can click through the application, and the information of the clicked song is transmitted by the application to the control host 10. The specific transmission mode may include the following: when the control host 10 and the karaoke terminal 11 are in the same local area network, the karaoke terminal 11 can directly directly feed the information of the songs of the user through the network through the predetermined network.埠 is sent to the control host 10. It can be understood that this method requires the control host 10 to open corresponding network services. When the control host 10 and the karaoke terminal 11 are not in the same local area network, the server can be relayed to transmit the information of the songs clicked by the user. That is, the application first submits the information of the songs clicked by the user to the server, and then, when the same user logs in to the control host 10, the control host 10 can obtain from the server or actively push the current login by the server. User-on-demand songs.

The beat sensing device 12 is configured to generate a beat trigger signal after sensing the user's beat motion when the host computer 10 plays the multimedia file. The beat action here refers to the action of the user playing the music or the action made by the user in response to the rhythm of the music. For example, when a user plays, plays, or beats an instrument, each note can be considered a beat action. The action made by the user in response to the rhythm of the music refers to various actions performed by the user following the rhythm of the music, and the specific implementation includes but is not limited to: cheering, shaking the tambourine, shaking the arm, controlling the mobile phone, pressing the remote controller, Dance and so on.

In general, the beat action can be divided into two categories: sound and action.

Therefore, in a specific implementation manner, referring to FIG. 2, the beat sensing device 12 is implemented based on audio analysis, and includes a recording module 122 and an audio analysis module 124. The recording module 122 is configured to collect external sounds and audio analysis. The module 124 is configured to analyze whether the audio feature meets the preset beat audio feature according to the sound collected by the recording module 122. If so, the audio analysis module 124 generates a beat trigger signal.

For example, when the most common tambourine in a KTV facility is shaken, in addition to making a crisp sound, it also emits ultrasonic waves. Therefore, when the audio analysis module 124 detects the ultrasonic wave of the predetermined frequency, a beat trigger signal is generated.

The audio analysis module 124 can also identify whether the recorded audio is a predetermined content by means of audio recognition. For example, when the user cheers "I love you", a beat trigger signal is generated.

Referring to FIG. 3, in another specific embodiment, the beat sensing device 12 is implemented based on the motion of the video analysis user, and includes a video capture module 126 and a video analysis module 128. The video capture module 126 is used for shooting. The video analysis module 128 is configured to analyze the user video captured by the video capture module 126 to identify whether the user's motion conforms to the predetermined feature. If so, the video analysis module 128 generates a beat trigger signal.

For example, the video analysis module 128 generates a beat trigger signal by video analysis to obtain an operation of the user shaking the arm at the same time.

In another specific embodiment, the beat sensing device 12 is implemented based on a beat signal transmitted by the beat device. For example, the beat sensing device 12 includes a Bluetooth module, an infrared module, or a WIFI module.

The beat device can be, for example, a remote controller having a plurality of buttons thereon. When the user presses a button, the remote controller transmits a corresponding infrared signal to the beat sensing device 12. That is, the infrared signal sent by the remote controller is the above-mentioned beat signal.

The beat device can also be, for example, a dedicated electronic device, which is also provided with a Bluetooth module, so as to be paired with the Bluetooth module of the beat sensing device 12, after successful pairing, when detecting that the user presses a certain button, or When the beat device is shaken, the beat device transmits a corresponding Bluetooth signal to the beat sensing device 12. That is, the Bluetooth signal sent by the beat device is the above-mentioned beat signal.

The beat device can also be, for example, a mobile phone connected to the beat sensing device 12 via WIFI. The mobile phone is equipped with a specific application program, and the application obtains the motion parameters of the beat device through the built-in accelerometer of the mobile phone, and further calculates the beat device. The motion track, when the motion track of the beat device conforms to the preset feature, the mobile phone transmits a predetermined network signal to the beat sensing device 12 through the WIFI network. That is to say, the network signal sent by the above mobile phone is the above-mentioned beat signal.

Further, it can be understood that the beat device is not limited to only one of the above types, and various types of beat devices can also be used in combination. That is, the beat sensing device 12 receives the beat signal sent by the different beat devices; or the control host 10 detects the actions or audio of the plurality of users.

The audio output device 13 can be, for example, a speaker, and the multimedia video output device 14 and the video output device 16 can be any device that outputs a video image, such as a television, a display, a projector, or the like. The light effect device 15 includes at least one light fixture that can output a light signal according to the control signal. Preferably, the light effect device 15 can include an array of LED lights and corresponding drive devices that can cover all of the walls, roofs and even the ground of the room. When each LED light in the LED light array is separately driven, the entire LED light array essentially constitutes a display, which can be used to display complex image signals. At this time, the light effect device 15 is different from the video output device 16. It is the difference in display scale.

The multimedia video output device 14 is, for example, a video home screen for displaying a multimedia vocal file and a video effect superimposed on the video home screen, and the video output device 16 is, for example, for displaying a video effect.

It can be understood that the plurality of multimedia video output devices 14 and the plurality of video output devices 16 can also be included in the synchronized beat effect system 100.

When the synchronized beat special effect system 100 of the present embodiment plays a song or other multimedia file, the control host 10 acquires the beat special effect data set corresponding to the current song in addition to the original file of the song.

In a specific implementation manner, the above-mentioned beat effect data set is embedded in the original file of the song. Therefore, the control host 10 needs to parse the corresponding beat effect data set from the original file of the song. It can be understood that the original file of the song can be stored in the local memory (referring to the memory connected to the control host through the data bus), or can be stored in the network memory. The network memory here can include a local area network, an intranet, or the Internet.

In another specific implementation manner, the above-mentioned beat effect data set is stored separately from the original file of the song. Similar to the original file of the song, the beat effect data set can be stored in local memory or stored in network memory.

The above-mentioned beat effect data set is a beat special effect data set using a predefined agreement or language description. For example, in a specific implementation manner, the beat effect data set may include a plurality of ordered beat special effects labels, and each beat special effect label includes time setting data and special effect setting materials. The time setting data is used to set the time interval during which the beat effect is valid. Special effects settings can be either directly for audio, video or vector animation, or for other formats that describe, generate, or acquire beat effects.

In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] special effect setting data 1 [00:24.88] special effect setting data 2 [01:27.05] special effect setting data 3 [02:30.39] special effect setting Data 4...

In this case, the beat trigger signal is not defined in the beat effect label, so all supported beat trigger signals can be regarded as the same beat trigger signal. That is, when any of the beat trigger signals is detected, a corresponding beat effect is generated. For example, whether the user shakes the tambourine or cheers "I love you", the same beat effect can be triggered.

For the special effect setting data of this format, a time interval can be formed by two adjacent time starting points. For example, the time interval formed by [00:00.00]-[00:24.88] is the effective time interval of the special effect setting data 1. Of course, the effective time interval of the special effect setting data 1 is not limited to this method. For example, given a time difference range, the time before or after the start time is less than the time difference range described above can be used as the effective time interval of the corresponding effect setting data. Taking the above-mentioned [00:24.88] special effect setting data 2 as an example, if the allowable time difference range is 2 seconds, the effective time interval of the special effect setting data 2 is [00:22.88]-[00:26.88].

In a specific implementation manner, the beat effect data set can be as follows: [00:00.00] Beat trigger signal setting data 1 Special effect setting data 1 [00:24.88] Beat trigger signal setting data 2 Special effect setting data 2 [01:27.05 ] Beat trigger signal setting data 1 Special effect setting data 3 [02:30.39] Beat trigger signal setting data 3 Special effect setting data 4 ... ...

Among them, the time setting data in the square brackets expresses the time when the distance file starts playing, and the beat trigger signal setting data and the special effect setting data corresponding to the square brackets. The beat trigger signal setting data is used to set the beat trigger signal that is valid in this time interval, and the special effect setting data is used to set the generation mode and parameters of the beat effect. According to this format, in addition to defining the effect data, the beat effect label also defines a corresponding beat trigger signal. For example, the specific definition is a voice command, a limb motion, or a tambourine sound. Only the defined beat trigger signal can trigger the corresponding beat effect, and the remaining beat trigger signals will be ignored even if they are detected at this time.

According to the data of this format, each beat effect label only includes the time start point, and does not directly include the length of time of each beat effect label, which means that the length of time needs to be calculated according to the upper and lower beat effect labels. For example, the time interval of the first special effect setting data 1 is 00:00.00 to 00:24.88, and the length of time is 00:24.88, that is, 24 seconds and 88 milliseconds.

It can be understood that the data format of the beat special effect label is not limited to this, and the time setting data may also include more information, for example, directly specifying the time interval, as follows: [00:00.00-00:23.86] beat trigger signal setting data 1 special effect Setting data 1 [00:24.88-01:00.90] Beat trigger signal setting data 1 Effect setting data 2 [01:27.05-03:29.00] Beat trigger signal setting data 1 Effect setting data 3 [03:30.39-05:38.86] Beat trigger signal setting data 1 effect setting data 4

The first time in square brackets is the start time, and the latter time is the end time. In this way, a time interval of discontinuities can be defined, and its adaptability is more flexible than just including the start time. In this case, according to one embodiment, any beat trigger signal received outside of all time intervals (eg, at 01:10.00) will not trigger any beat effects. According to another embodiment, an allowable error range may also be defined for the time interval, if the time difference between the current time and any of the two endpoints of a time interval is less than the allowable error range of the term, Although the beat trigger signal of the current time is not within a time interval, the corresponding beat effect will still be triggered. That is, the time interval set by the time setting data is extended to the allowable error range to both ends. For example, if the allowable error range is 2 seconds, the beat trigger signal 1 at 00:23.88 will still trigger the beat effect set by the effect setting data 2.

In addition, the start time plus the length of time can be used to define the effective time interval of each beat effect label, which can be as follows: [00:00.00, 00:55.00] Beat trigger signal setting data 1 Special effect setting data 1 [00:24.00 , 01:03.00] Beat trigger signal setting data 2 Special effect setting data 2 [01:28.00, 03:02.00] Beat trigger signal setting data 1 Special effect setting data 3 [04:30.00, 01:08.00] Beat trigger signal setting data 1 Special effects Setting information 4

It can be seen from the above data definition that the effective time interval of the visual effect corresponding to the special effect setting data 1 and the special effect setting data 2 overlap, but the beat trigger signals corresponding to the two beat special effects are different, and therefore, in the present embodiment, Two different beat effects can coexist in the same time interval.

Further, corresponding to the same beat trigger signal, there may be multiple beat effects, and the multiple beat effects may be the same type of visual effects, such as multiple lighting effects, or multiple video overlay effects, or multiple different Types of visual effects, for example, include lighting effects as well as video effects. At this time, the beat effect label can be as follows: [00:00.00, 00:55.00] Beat trigger signal setting data 1 Special effect setting data 1-1, special effect setting data 1-2 [00:24.00, 01:03.00] Beat trigger signal Setting data 2 Special effect setting data 2 [01:28.00, 03:02.00] Beat trigger signal setting data 1 Special effect setting data 3 [04:30.00, 08:08.00] Beat trigger signal setting data 1 Special effect setting data 4-1, special effects setting Data 4-2.

Further, corresponding to each beat effect, one or more corresponding beat trigger signals may also be included. That is, one or more beat trigger signals trigger the same beat effect. Moreover, when multiple beat effects are set in one beat effect label, the corresponding beat trigger signal can also be set for each beat effect. as follows:

[00:00.00, 00:55.00] Beat trigger signal setting data 1-1, beat trigger signal setting data 1-2, special effect setting data 1-1, special effect setting data 1-2

The beat trigger signal setting data 1-1 corresponds to the special effect setting data 1-1, and the beat trigger signal setting data 1-2 corresponds to the special effect setting data 1-2. During the same time interval, when the beat trigger signal 1 (corresponding to the beat trigger signal setting data 1-1) is detected, the beat effect 1 (corresponding to the special effect setting data 1-1) is generated and output; when the beat trigger signal is detected 2 (corresponding to the beat trigger signal setting data 1-2), the beat effect 2 (corresponding to the effect setting data 1-2) is generated and output.

In this way, different users can trigger different beat effects through different beat devices. And multiple beat effects can be designed to match each other, so that the beat effect system can support multiple users to interact at the same time, improving the overall participation.

It can be understood that the setting method of the above-mentioned beat effect label is equivalent to the following manner: [00:00.00, 00:55.00] Beat trigger signal setting data 1-1, special effect setting data 1-1 [00:00.00, 00:55.00] beat Trigger signal setting data 1-2, special effect setting data 1-2

That is, the beat effect label including a plurality of special effects is split into a plurality of beat effect labels having the same effective time interval, but the beat trigger signal and the special effect setting data are different.

In the various embodiments listed above, the time is represented by time: minute: second. However, the present invention is not limited to this method. For example, any unit such as seconds, milliseconds, minutes, etc. can be directly used. To characterize. Taking the start time 00:24.00 as an example, the number of seconds converted is 1440, and the number of milliseconds is 14.40 million, which is 24 in minutes. The time data recorded in the time setting data can also be the result of various reversible operations on the time value, and even an encryption operation can be performed. Taking the above number of seconds 1440 as an example, for example, it can be divided by 2 to obtain 720. That is, 720 is stored in the time setting data, but in fact it is expressed in 1440 seconds. It can be understood that after this operation, in order to calculate the effective time interval of a certain beat effect label, it is necessary to perform a reverse operation to obtain an actual time interval.

It can be understood that no matter what kind of processing, the essence is still to define a time interval in the beat effect label, and compare the current time with the defined time interval to obtain the matching beat effect label. Therefore, all these methods should be It is included in the scope of the above time setting data.

For example, in one embodiment, the effect setting data is a description of the beat effect to be achieved using a predefined agreement or language. This description can define the type and parameters of the beat effect. The types described above may include, for example, audio, video, lighting, or any combination thereof. The above parameters may include specific effects of the specific parameters such as the sound to be output, the color of the light, the pattern and the brightness, such as speed, scale and range.

For example, in another specific embodiment, the special effect setting data is information for obtaining other formats of the beat effect, for example, an identifier of a video special effect file. The video effect file here may be pre-stored in the memory connected to the control host 10 or stored in the cloud server. The control host 10 can read the video file in the memory or initiate a network request to download the video file from the cloud server.

It can be understood that the beat effect data set can be automatically generated by the special system according to the analysis result of the audio data of each song, or can be manually generated according to the content of the song. But in general, no matter how the beat special effects data set is produced, its purpose is to output a change that can be perceived by the user through audio, video, lighting, etc., and the amplitude, brightness, range and other parameters of the beat effect can be changed. It is related to the intensity of the beat (by analyzing the audio parameters such as volume and frequency) or related to the user's motion range (by analyzing the video). For example, when the volume is higher, the magnitude of the effect change is larger, the higher the frequency, the brighter the brightness of the effect change, and the like.

After receiving the beat trigger signal, the control host 10 obtains a matching beat effect label from the beat effect data set according to the current time, and generates a beat special effect signal according to the acquired beat special effect label. The matching beat effect label here is, for example, a beat effect label that satisfies both the time setting data and the beat trigger signal setting data.

In a specific implementation, the beat effect is an audio effect. Thus, when the user's beat action is sensed (such as detecting the ultrasonic wave emitted by the user's hand drum), the matching beat effect label is found from the beat effect data set, for example, the time interval includes the current time and the beat trigger signal is ultrasonic. Beat effect label. After the matching beat effect label is obtained, the audio corresponding to the special effect setting data in the matching beat effect label can be played through the audio output device 13. In this way, when the user's beat action is successfully matched with a beat special effect label in the beat special effect data set, the system automatically outputs the corresponding audio as a response to the user's beat action, so that the synchronous beat effect of the embodiment is successful. The system gains richer expression through interaction.

In a specific embodiment, the beat effect is a video effect. In this way, when the user's beat action is sensed (such as detecting the ultrasonic wave emitted by the user's hand drum), the matching beat effect label is found from the beat effect data set. After the matching beat effect label is obtained, the video special effect corresponding to the special effect setting data in the matching beat effect label can be played through the video output device 16. In this way, when the user's beat action is successfully matched with a beat effect label in the beat special effect data set, the system automatically outputs the corresponding video as a response to the user's beat action, so that the synchronous beat effect of the embodiment is successful. The system has richer interactive features.

In a specific embodiment, the beat effect is a lighting effect. In this way, when the user's beat action is sensed (for example, when the ultrasonic wave emitted by the user's hand drum is detected), the matching beat effect label is found from the beat effect data set. After the matching beat effect label is obtained, the light effect corresponding to the special effect setting data in the matching beat effect label can be played through the light effect device 15. In this way, each time the user's beat action is successfully matched with a beat special effect label in the beat special effect data set, the system automatically outputs the corresponding light special effect as a response to the user's beat action, so that the synchronous beat of the embodiment is performed. Special effects systems have richer interactive features.

Further, the above various types of special effects can also be used in combination. That is, a variety of special effects can be included in a beat effect label, for example, any combination of sound effects, video effects, or lighting effects.

The synchronous beat special effect system of the embodiment also acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, and the beat special effect data set includes a beat special effect label for setting data for different time, which is sensed during the playing of the music. When the user's beat action, the control host can find the matching beat effect label and output an obvious beat effect through audio, video or lighting, especially visualizing the user's beat action, and improving the multimedia file playing system. Interactive features, especially for KTV and other occasions. Moreover, besides the special beat device triggered by the special beat device, the common operation of the user in the KTV, such as shaking the tambourine, can trigger the beat action, so that the user can naturally start the beat effect without learning, and improve the user's room in the KTV. Use feelings inside.

Second embodiment

Referring to FIG. 4, it is a schematic diagram of a synchronous beat special effect system 200 according to a second embodiment of the present invention. The synchronous beat special effect system 200 of the present embodiment is similar to the synchronous beat special effect system of FIG. 1 except that it further includes: an external device 20.

The external device 20 can be, for example, a computer that installs a song app. The karaoke panel 11, the audio output device 13, and the multimedia video output device 14 are connected to the external device 20. Thus, the song panel 11, the audio output device 13, and the multimedia video output device 14 and the external device 20 themselves constitute a common multimedia on-demand system that can be used in KTV and the like. The beat sensing device 12, the video output device 16 and the light effect device 15 are still connected to the control host 10.

In the present embodiment, the external device 20 is, for example, a conventional karaoke system host, which implements a song control function of songs and songs. However, it is further connected to the control host 10 compared to the conventional VOD system host. Whenever the external device 20 plays a song or a song is added to the playlist, the external device 20 transmits the identification of the song to the control host 10.

It can be understood that in order for the external device 20 to send specific information to the control host 10, a specific application design development interface (API) can be disclosed in the control host 10, so that the external device 20 can make a call to the control host 10. Send the above information. Whenever the external device 20 plays a song, the external device 20 can submit the identification of the song and the time when the playback starts to the control host 10 via the API described above. Of course, in order to implement the API call, the external device 20 needs to slightly modify the existing karaoke player so that the information is synchronized with the control host 10 through the API when needed.

After receiving the song information synchronized by the external device 20, the control host 10 acquires the beat effect data set corresponding to the song, and starts monitoring the beat trigger signal from the beat sensing device 12, after receiving the beat trigger signal of the beat sensing device 12 The control host 10 acquires the matching beat effect label from the beat effect data set according to the current time, and further outputs the beat special effect through the light special effect device 15.

In the present embodiment, the audio output device 13 and the multimedia video output device 14 can simultaneously output audio and video from the external device 20 and beat effects from the control host 10. In the case of audio, for example, an audio superimposing device is additionally provided, which includes two input terminals respectively connected to the external device 20 and the audio output port of the control host 10, and the output of the audio superimposing device and the audio input device 13 are used for audio input. The mouth is connected. The audio superimposing device superimposes the audio outputted by the external device 20 and the control host 10 through the audio processing technology, and then transmits the audio to the audio output device 13 for output. Similar to audio, if you want to achieve video overlay, you need to set up a video overlay device.

According to the synchronous beat special effect system of the present embodiment, by slightly improving the existing VOD system application, the beat special effect function can be realized, and the existing equipment can be maximized to avoid the cost increase caused by the equipment upgrade.

In particular, when the control host 10 is a smart electronic device (such as a smart phone), the application installed in the smart electronic device can wirelessly control the audio output device 13, the light effect device 15 and the video output device 16 to The output of the beat effect can also be obtained by wirelessly accessing the beat effect data set on the network, and simultaneously recording the song sound played through the external device 20 through the built-in microphone, and directly identifying the external device 20 through feature sampling and feature matching. The song, so that the logo of the song can be obtained without communicating with the external device 20, and then the corresponding beat effect data set is downloaded.

Third embodiment

Referring to FIG. 5, the embodiment provides a synchronous beat special effect processing method, which can be used in the synchronous beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 5, the method of this embodiment includes the following steps:

In step S101, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label Includes time setting data and corresponding special effects setting data.

Step S102: After receiving the beat trigger signal sent by the beat sensing device, obtain a matching beat special effect label from the beat special effect data set according to the current time (that is, obtain a beat special effect label that simultaneously satisfies the time setting data and the beat trigger signal setting data) And generating a beat effect signal according to the acquired beat effect label, the beat trigger signal being generated by the beat sensing device after sensing the user's beat action;

Step S103, outputting a corresponding beat effect according to the beat special effect signal.

The synchronous beat special effect processing method of the embodiment further acquires a beat special effect data set corresponding to the multimedia file when the multimedia file is played, and the beat special effect data set includes a beat special effect label for setting data for different time, when the music is in the process of playing the music When the user's beat action is taken, the control host can find a matching beat effect label and output an obvious beat effect through audio, video or lighting, especially visualizing the user's beat action and enhancing the interaction of the multimedia file play system. Features, especially for KTV and other occasions. Moreover, besides the special beat device triggered by the special beat device, the user can trigger the beat signal by common operations such as shaking the tambourine in the KTV, so that the user can naturally start the beat effect without learning, and improve the user in the KTV room. feeling of using.

Fourth embodiment

Referring to FIG. 6, the embodiment provides a synchronous beat special effect processing method, which can be used in the synchronous beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 6, the method of this embodiment includes the following steps:

In step S101, when the multimedia file is played, or when the multimedia file is played by the external device, the beat special effect data set corresponding to the multimedia file is acquired, and the beat special effect data set includes a plurality of beat special effect labels, and each beat special effect label It includes time setting data, beat trigger signal setting data and corresponding special effect setting data.

Step S104, receiving a beat trigger signal sent by the beat sensing device. The beat trigger signal can be from a user or an interactive device, or it can be from multiple users or multiple beat devices.

In step S105, if a beat special effect label that satisfies both the time setting data and the beat trigger signal setting data is found, step 103a is performed.

Step S103a, generating a beat special effect signal according to the beat special effect label;

Step S103, outputting a corresponding beat effect according to the beat special effect signal.

According to the technical solution of the embodiment, by setting the beat trigger signal, the interference of the invalid signal can be avoided, and different users can respectively trigger different beat effects through different beat devices. And multiple beat effects can be designed to match each other, so that the beat effect system can support multiple users to interact at the same time, which enhances the overall participation.

Fifth embodiment

Referring to FIG. 7, the embodiment provides a synchronous beat special effect processing method, which can be used in the synchronous beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 7, the method of this embodiment includes the following steps:

Step S201: Send, according to the identifier of the multimedia file, a request for acquiring the corresponding beat special effect data set to the cloud server system;

Step S202, receiving the beat effect data set returned by the cloud server system.

Step S102: After receiving the beat trigger signal sent by the beat sensing device, obtain a matching beat effect label from the beat special effect data set according to the current time, and generate a beat special effect signal according to the acquired beat special effect label, the beat trigger The signal is generated by the beat sensing device after sensing the user's beat motion during the playing of the multimedia file;

Step S103, outputting a corresponding beat effect according to the beat special effect signal.

According to the synchronous beat special effect processing method of the embodiment, the synchronous beat special effect data set is stored in the cloud server, and the beat special effect data set of all the songs is not stored in the local machine, and the beat special effect data set version of all the songs is guaranteed to be the latest. .

Sixth embodiment

Referring to FIG. 8, the embodiment provides a synchronous beat special effect processing method, which can be used in the synchronous beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 8, the method of the present embodiment is similar to the method of FIG. 7, except that before step S201, the method further includes:

Step S301: Send identity authentication information to the cloud server system, so that the cloud server system verifies whether the control host has permission to acquire a beat special effect data set;

The cloud server system returns to the beat effect data set requested by the control host when the control host has the permission to acquire the beat special effect data set.

According to the synchronous beat special effect processing method of the embodiment, the cloud server further performs identity verification before returning the synchronous beat special effect data set, and returns to the beat special effect data set only when the user has the corresponding permission right, for example, when the payment mark is normal. In order to ensure that the version of the beat effect data set is effectively protected.

Seventh embodiment

Referring to FIG. 9, the embodiment provides a synchronous beat special effect processing method, which can be used in the synchronous beat special effect system shown in FIG. 1 or FIG. 4. As shown in FIG. 9, the method of the present embodiment is similar to the method of FIG. 5, except that before step S101, the method further includes:

Step S401, the external device sends the identifier of the corresponding multimedia file to the control host when the multimedia file is played or when the multimedia file is added to the playlist;

After receiving the identifier of the multimedia file, the control host performs a step of sending, by the control host, a request for acquiring the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file, that is, step S101.

According to the method of the present embodiment, by slightly improving the existing VOD system application, the beat special effect function can be realized, and the existing equipment is minimized and the equipment upgrade cost is reduced.

In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, such as a non-volatile memory such as a compact disk, a hard disk, or a flash memory. . The computer executable instructions described above are used to cause a computer or similar computing device to perform the methods of the above embodiments.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The present invention has been disclosed in the preferred embodiments, but is not intended to limit the invention, and any person skilled in the art. The equivalents of the technical solutions disclosed above may be modified or modified to equivalent variations, without departing from the technical scope of the present invention, in accordance with the technical essence of the present invention. Any of the above-described modifications, equivalent changes and modifications of the above embodiments are still within the scope of the technical solutions of the present invention.

100, 200‧‧‧ synchronized beat special effects system
10‧‧‧Control host
11‧‧‧歌歌终端
12‧‧‧ beat sensing device
13‧‧‧Audio output device
14‧‧‧Multimedia video output device
15‧‧‧Lighting effect device
16‧‧‧Video output device
20‧‧‧External equipment
122‧‧‧Recording module
124‧‧‧Audio Analysis Module
126‧‧‧Video Capture Module
128‧‧‧Video Analysis Module

1 is a schematic structural diagram of a synchronous visual effect system provided by a first embodiment of the present invention; [FIG. 2] is a block diagram of a beat sensing device of a synchronous beat special effect system provided by the first embodiment; [FIG. 3] Another module diagram of the beat sensing device of the synchronous beat special effect system provided by the first embodiment; [FIG. 4] is a schematic structural diagram of a synchronous beat special effect system provided by the second embodiment of the present invention; [FIG. 5] A flowchart of a synchronous beat special effect processing method provided by the third embodiment; [FIG. 6] is a flowchart of a synchronous beat special effect processing method according to a fourth embodiment of the present invention; [FIG. 7] is a synchronous beat special effect provided by the fifth embodiment of the present invention. FIG. 8 is a flowchart of a synchronous beat special effect processing method according to a sixth embodiment of the present invention; FIG. 9 is a flowchart of a synchronous beat special effect processing method according to a seventh embodiment of the present invention.

100‧‧‧Synchronous Beat Special Effects System

10‧‧‧Control host

11‧‧‧歌歌终端

12‧‧‧ beat sensing device

13‧‧‧Audio output device

14‧‧‧Multimedia video output device

15‧‧‧Lighting effect device

16‧‧‧Video output device

Claims (24)

A synchronous beat special effect system, comprising: a control host, a beat sensing device and a beat special effect output device; the control host acquires a beat corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device The special effect data set includes a plurality of beat special effect labels, each beat special effect label includes a time setting data and a corresponding special effect setting data, and the beat special effect label further includes a beat trigger signal setting data, The matched beat special effect label refers to a beat special effect label that simultaneously satisfies the time setting data and the beat trigger signal setting data; the beat sensing device senses a user's beat action when the control host plays the multimedia file Generating a beat trigger signal after the control host receives the beat trigger signal, and obtaining a matching beat effect label from the beat special effect data set according to the current time, and generating a beat special effect signal according to the acquired beat special effect label; Special effect output device according to the Effects beat signal output corresponding to the tempo of the host system effects. The synchronization beat special effect system of claim 1, wherein the special effect setting data sets a plurality of beat special effects, and the beat trigger signal setting data settings respectively correspond to the beat trigger signals of the plurality of beat special effects, The plurality of beat trigger signals respectively correspond to different beat devices or users; after receiving the plurality of beat trigger signals sent by the beat sensing device, the control host generates a corresponding beat special effect signal for each matched beat trigger signal; The beat effect output device outputs a beat effect. The synchronization beat special effect system of claim 1, wherein the controlling host acquiring the beat special effect data set corresponding to the multimedia file comprises: the control host according to the identifier of the multimedia file to the cloud server The system sends a request for acquiring the corresponding beat effect data set; and receiving the beat special effect data set returned by the cloud server system. The synchronization beat special effect system of claim 3, wherein the controlling host acquiring the beat special effect data set corresponding to the multimedia file when playing the multimedia file further comprises: the control host sending the identity authentication information Giving the cloud server system to enable the cloud server system to verify whether the control host has permission to acquire a beat special effect data set; the cloud server system has a beat special effect data set at the control host The permission time is returned to the beat effect data set requested by the control host. The synchronous beat special effect system of claim 3, further comprising an external device connected to the control host; the external device corresponding to the multimedia file when the multimedia file is played or the multimedia file is added to the playlist Sending the identifier to the control host; after receiving the identifier of the multimedia file, the control host executes the control host to send the corresponding beat effect data set to the cloud server system according to the identifier of the multimedia file. The step of the request. The synchronization beat special effect system of claim 1, wherein the control host acquires a beat special effect data set corresponding to the multimedia file when playing the multimedia file, including: Parsing the beat effect data set embedded in the multimedia file from the multimedia file. The synchronous beat effect system of claim 1, wherein the beat special effect output device comprises: an audio output device, a video output device, and a light special effect device; and the special effect setting data includes audio special effect data and lighting special effect data. And the video special effect data, the audio special effect data sets a sound effect sent by the audio output device, the light special effect data sets a manner of changing the light of the light special effect device, and the video special effect data sets the video output device The image change mode includes one or more of changes in pattern, color, position, angle, size, and the like. The synchronous beat special effect system of claim 1, wherein the beat sensing device comprises a recording module and an audio analysis module, wherein the recording module is configured to collect external sound, and the audio analysis module And configured to analyze, according to the sound collected by the recording module, whether the audio feature meets a preset beat audio feature, and if so, the audio analysis module generates the beat trigger signal. The synchronous beat special effect system of claim 1, wherein the beat sensing device comprises a video capture module and a video analysis module, wherein the video capture module is configured to capture a video of a user, the video The analysis module is configured to analyze the user video captured by the video capture module to identify whether the user's action conforms to a predetermined feature, and if so, the video analysis module generates the beat trigger signal. The synchronous beat special effect system of claim 1, further comprising: a beat device, configured to send the beat trigger signal to the control host, the beat special effect output device or the device according to a user operation The beat sensing device is described. The synchronous beat special effect system of claim 10, wherein the beat device is a passive sound emitting device for emitting a specific audio signal. The synchronous beat special effect system of claim 10, wherein the beat device is an electronic device, and the electronic device sends a specific signal to the control when the user buttons, taps, touches, rotates, and moves. a host, the beat effect output device, or the beat sensing device. The synchronous beat special effect system of claim 1 or 3, wherein the control host is a smart electronic device, and the smart electronic device is connected to the beat special effect output device via a wireless network, the smart The electronic device includes a built-in microphone, and the smart electronic device is installed with a specific application, and the specific application records the sound emitted by the external device through the built-in microphone, and performs feature sampling and feature analysis on the recorded sound to identify the The identifier of the song played by the external device, and acquiring the beat effect data set from the cloud server according to the identifier. A synchronization beat special effect processing method, the method comprising: acquiring a beat special effect data set corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device, where the beat special effect data set includes multiple The beat effect label, each beat special effect label includes a time setting data and a corresponding special effect setting data, wherein the beat special effect label further includes a beat trigger signal setting data, and the matching beat special effect label refers to simultaneously satisfying the time setting data And a beat effect label of the beat trigger signal setting data; after receiving the beat trigger signal sent by the beat sensing device, obtaining a matching beat effect label from the beat special effect data set according to the current time, and generating according to the acquired beat effect label Beat a beat signal generated by the beat sensing device during the playing of the multimedia file to sense a user's beat motion; and outputting a corresponding beat effect according to the beat special effect signal. The synchronization beat special effect processing method of claim 14, wherein the special effect setting data sets a plurality of beat special effects, and the beat trigger signal setting data settings respectively correspond to the beat trigger signals of the plurality of beat special effects, The plurality of beat trigger signals respectively correspond to different beat devices or users; the method further includes: after receiving the plurality of beat trigger signals sent by the beat sensing device, generating corresponding beat effects for each matched beat trigger signal Signal; and output all beat effect signals. The synchronization beat effect processing method of claim 14, wherein the acquiring the beat effect data set corresponding to the multimedia file comprises: transmitting, according to the identifier of the multimedia file, the acquisition to the cloud server system Corresponding to the request of the beat effect data set; and receiving the beat effect data set returned by the cloud server system. The synchronization beat special effect processing method of claim 16, wherein the acquiring the beat special effect data set corresponding to the multimedia file further comprises: sending the identity authentication information to the cloud server system, so that The cloud server system verifies whether there is permission to acquire a beat special effect data set; The cloud server system returns to the beat effect data set when the user has permission to acquire a beat effect data set. The method for processing a synchronous beat effect according to claim 16, wherein the method further comprises: receiving an identifier of the multimedia file sent by the external device when the external device plays a multimedia file; The step of acquiring the beat effect data set corresponding to the multimedia file is performed after receiving the identifier of the multimedia file. The synchronization beat effect processing method of claim 14, wherein the acquiring a beat effect data set corresponding to the multimedia file comprises: parsing out from the multimedia file and embedding in the multimedia file The beat effect data set. The method for processing a synchronous beat effect according to claim 14, wherein the special effect setting data includes audio special effect data, lighting special effect data, and video special effect data, and the audio special effect data sets a sound emitted by the audio output device. a special effect, the lighting effect data setting a mode of changing the light of the light special effect device, wherein the video special effect data sets an image change mode of the video output device to include one of a pattern, a color, a position, an angle, a size, and the like. A variety. The synchronous beat special effect processing method of claim 14, wherein the method further comprises: collecting an external sound, and analyzing, according to the collected sound, whether the audio feature meets a preset beat audio feature, and if so, The beat trigger signal is generated. The method for processing a synchronous beat effect according to claim 14, wherein the method further comprises: capturing a video of the user, and identifying, according to the captured user video, whether the user's motion conforms to a predetermined feature, and if And generating the beat trigger signal. The synchronous beat special effect processing method of claim 14, wherein the method further comprises: receiving the beat trigger signal sent by the beat device according to a user operation. The synchronous beat special effect processing method of claim 14 or 16, wherein the beat special effect data set and the beat special effect signal are transmitted through a wireless network.