CN110072321B

CN110072321B - Light control method based on music rhythm

Info

Publication number: CN110072321B
Application number: CN201910326775.0A
Authority: CN
Inventors: 姚斌
Original assignee: Individual
Current assignee: Individual
Priority date: 2019-04-23
Filing date: 2019-04-23
Publication date: 2021-08-27
Anticipated expiration: 2039-04-23
Also published as: CN110072321A

Abstract

The invention relates to a light control method based on music rhythm, which comprises the following steps: acquiring a streaming media audio signal; preprocessing a streaming media audio signal to obtain an audio preprocessing signal; identifying and separating a single percussion music signal in the audio preprocessing signal to obtain a percussion pulse signal, and outputting a beat pulse signal by the percussion pulse signal through a hysteresis comparator; constructing a minimum beat synchronizer through at least one beat pulse signal to obtain a beat synchronization signal; based on the beat synchronous signal, the striking pulse signal is digitally quantized in intensity and time respectively to obtain a light control signal, and the light control signal controls light flicker. According to the light control method, multiple groups of different lights are correspondingly controlled by analyzing the multiple sound channels with independent stereo, various rhythms of music can travel synchronously with the beat, and the change of the lights can blend the rhythms of sound waves with accurate coordination with the music, so that the lights of an intelligent music-lighting engineer in commanding the music can be realized.

Description

Light control method based on music rhythm

Technical Field

The invention relates to the technical field of lamps, in particular to a light control method based on music rhythm.

Background

At present, sound and light appearing in the eyes of the public often work on stages, dance halls, bars and the like through a console by professional operators (such professional lighting operators), so that the users need to step on the music to achieve a correct beat and get a good effect. This also avoids the need to learn music, which must be followed by a tempo of the music in order to match the tempo of the music at the scene.

The tempo of music is often likened to the skeleton of the musician. The beat is the repeated and regular repetition of the repeated beat and the weak beat in the music periodically, the feeling of the light is achieved, so that the perception of the music and the strength of the rhythm are enhanced, and the sense of the speed, the strength and the time of the accompanying music on the vision, the perception of the time and the atmosphere are added, so that the appreciators obtain higher-order aesthetic and enhanced experience, and the requirement of cultural entertainment life of people is met.

At present, there are several light control modes, the first is: the light is controlled according to the detected music amplitude signal, namely the light is controlled by directly using the detector to obtain the signal fluctuating along with the music amplitude, so that different musical instruments cannot be distinguished like human ears, the beat cannot be stabilized, the interference of various background sounds is caused, and the light cannot be controlled in a rhythm manner. And the second method comprises the following steps: by analyzing the frequency spectrum of the sound electric signal, the brightness of the lamp varies in various frequency spectrum values, such as: the spectrum flowing water lamp has certain visual effect, but people can not read and understand the relation with music and can not bring rhythm feeling. The independent and timing control colored lamps which are irrelevant to music are arranged, but the colored lamps can be used for decoration and are not connected with the music. And the third is that: the rhythm is calculated by detecting the frequency and the period of the signal and further judging the length of the tone. For example, chinese patent application No. 201510946627.0 discloses a light controller for controlling the rhythm of light of a lamp according to the sound signal of the external environment. The light controller includes sound collection module, processing module and signal output module, carries out the discernment of note and beat with the sound signal that sound collection module gathered through processing module, and rethread signal output module sends this note and the corresponding control signal of beat to lamps and lanterns to let lamps and lanterns can cooperate external environment's music rhythm or the transform of rhythm, let the scintillation rate of light and present music rhythm or rhythm correspond mutually, and reach the beautiful effect of dazzling of the scintillation rhythm of music rhythm and light is unified. However, this method is effective only in that the light changes according to the appearance and disappearance of notes and is limited to a single musical instrument. The note is short because it may occupy 1/4 beats, half beats, or 1 beat, etc., and the beat of the note is not equivalent to the beat of the music traveling, so the light cannot be synchronized with the music rhythm by the method of identifying the note length. Moreover, when a plurality of musical instruments play voices, singing voices and rhythm fermented voices exist at the same time, frequency components of the notes can be submerged and cannot be identified, and a plurality of components which have the same frequency with the notes but are not from the notes are mixed and included at the same time, so that the notes cannot be accurately identified. Or when no note exists in the music performance and only the rhythm instrument sounds, the rhythm cannot be recognized.

Today, the demand of artificial intelligence is higher and higher, the demand of the times is adapted, and a more intelligent light control method is urgently needed.

Disclosure of Invention

Therefore, it is necessary to provide a light control method based on music rhythm to solve the problems of the deficiency of the existing light control method and the incapability of accurately identifying or identifying notes, so that the light of the lamp can be matched with the rhythm of music advancing and can change along with the change of beat sound waves, and wonderful visual experience can be obtained.

A light control method based on music rhythm is characterized by comprising the following steps:

acquiring a streaming media audio signal;

preprocessing the streaming media audio signal to obtain an audio preprocessing signal;

identifying and separating a single percussion music signal in the audio preprocessing signal to obtain a percussion pulse signal, wherein the percussion pulse signal outputs a beat pulse signal through a hysteresis comparator;

constructing a minimum beat synchronizer through at least one beat pulse signal to obtain a beat synchronization signal;

and based on the beat synchronous signal, digitally quantizing the intensity and time of the striking pulse signal respectively to obtain a light control signal, and controlling light flicker by the light control signal.

In one embodiment, the step of identifying and separating a single percussion music in the audio pre-processing signal and obtaining a percussion pulse signal includes:

presetting a pair of orthogonal signals of the electro-acoustic signals of the target percussion music as local signals, carrying out orthogonal demodulation on the audio preprocessing signals through the local signals,

then obtaining the demodulation complex signal of the target percussion music through a low-pass filter, obtaining a module value of the demodulation complex signal, obtaining the envelope of the percussion pulsation,

and outputting a striking pulse signal by the envelope of the striking pulse through a beat filter.

In one embodiment, the step of identifying and separating a single percussion signal in the audio pre-processed signal to obtain a percussion pulse signal further includes:

prestoring the acoustic feature of target percussion music, obtaining first acoustic feature, the beat synchronizing signal that is provided by the beat synchronizer is right the start-up stage of percussion music carries out acoustic feature extraction in the audio frequency preprocessing signal, obtains second acoustic feature, will first acoustic feature with second acoustic feature compares, works as first acoustic feature with when second acoustic feature matches, carries impact signal to the beat filter, acquires the percussion pulsation signal.

In one embodiment, the minimum beat synchronizer is constructed by at least one beat pulse signal of the single percussion music, and comprises the following steps:

presetting a timer with the same frequency and phase as the beat pulse signal, circularly timing, constructing a beat synchronizer,

when a first pulse of any one of the beat pulse signals is received, the timer starts to time, and when a second pulse of any one of the beat pulse signals is received, a cycle is completed and the cycle is used for repeatedly timing;

acquiring the time difference between the initial time of each period of the beat synchronizer and the initial time of the beat pulse signal, adjusting the frequency of the beat synchronizer in a negative feedback mode through an accumulator or a low-pass filter,

and when the beat frequency of the beat synchronizer is equal to that of the beat pulse signal and the phase of the beat synchronizer is consistent, the beat synchronizer is locked and outputs a beat synchronization signal.

In one embodiment, the method comprises the following steps: the beat combination sequence in the beat pulse signal is recorded by a memory.

In one embodiment, the beat combination order accumulates one bar per repetition of one cycle, and accumulates one eight beats per repetition of two bars.

In one embodiment, the method comprises the following steps: and at the starting moment of each period, the gate control is opened, and the beat pulse signal is synchronized to the beat frequency of the beat synchronization signal to form a light control signal.

The light control method based on music rhythm comprises the steps of preprocessing after streaming media audio data information is acquired, acquiring audio preprocessing signals, identifying and separating single percussion music signals in the audio preprocessing signals, acquiring percussion pulse signals, and outputting beat pulse signals through a hysteresis comparator; then, a minimum beat synchronizer is constructed through one or more beat pulses of the single percussion music, beat synchronization signals are obtained, the percussion pulse signals are respectively subjected to digital quantization in strength and time based on the beat synchronization signals, light control signals are output, and the light control signals control light flicker. The light control signals of different target percussion music respectively control multiple paths of different lamps, and multiple groups of different lights are correspondingly controlled by analyzing multiple sound channels independent of stereo sound, various rhythms of music can advance synchronously with the beat, percussion music is added into a certain measure during music playing, or the percussion music is removed, or the shearing of regular beat is carried out when the music is transited from one measure to another measure, the synchronous characteristics are unchanged, the change of the lights can be matched with accurate rhythm sound waves, various forms are derived and blended with the music, and the lights are like lights with music-light operators in 'commanding' at the back of intangible.

Drawings

FIG. 1 is a flow diagram of a music tempo based light control in one embodiment;

FIG. 2 is a flow diagram of identifying and separating audio pre-processing signals, according to one embodiment;

FIG. 3 is a flow diagram of constructing a minimum beat synchronizer according to one embodiment;

FIG. 4 is a schematic diagram of a principle of light control based on music tempo according to an embodiment;

FIG. 5 is a diagram of streaming audio data of a musical composition, according to one embodiment.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.

A light control method based on music rhythm comprises,

step S10: a streaming media audio signal is obtained. The streaming audio signal may be streaming audio data or an audio electro-acoustic signal. For example, an audio file is read from a storage device. For example, analog audio is converted to a digital signal using an analog-to-digital converter. And for example, a digital audio interface, an optical fiber interface, a wireless communication receiving module and the like are used for receiving the audio file.

Step S20: and preprocessing the streaming media audio signal to obtain an audio preprocessing signal. The pretreatment process comprises the following steps: removing human voice, power frequency noise, high frequency noise and other methods from the streaming media audio data, and filtering out useless signals; the audio signal is compressed, limited or loudness adjusted to match the dynamic range of the audio signal with the audio processing module.

Step S30: and identifying and separating single percussion music in the audio preprocessing signal to obtain a percussion pulse signal, and outputting a beat pulse signal by the percussion pulse signal through a hysteresis comparator. And identifying and separating multiple target percussion music in the audio preprocessing signal to form a plurality of beat pulse signals of single percussion music. The target percussion signals include: gong, fermented soybean, cymbal, triquetrum, hammer and/or rock bell, etc. The hysteresis comparator digitally quantizes the output signal over time, avoiding output transients.

Step S40: constructing a minimum beat synchronizer through at least one beat pulse signal to obtain a beat synchronization signal;

step S50: based on the beat synchronous signal, the striking pulse signal is respectively digitally quantized in intensity and time, and a light control signal is output and controls light flicker. The signal is transmitted to equipment such as lamps and lanterns, light controllers and the like for output through a single-wire switching value signal interface, a digital communication interface or wireless communication.

According to the light control method based on music rhythm, after the information of the streaming media audio data is acquired, single percussion music in the streaming media audio data is identified and separated, percussion pulse signals are acquired, and a hysteresis comparator outputs beat pulse signals; then, a minimum beat synchronizer is constructed through beat pulses of one or more single percussion music, beat synchronization signals are obtained, the percussion pulse signals are respectively digitally quantized in strength and time based on the beat synchronization signals, and light control signals are output and control light flicker. The light control signals from a plurality of different target percussion music respectively control a plurality of paths of different lamps, a plurality of sound channels with independent stereo sound are processed to correspondingly control a plurality of groups of different lights, various rhythm music sounds can advance synchronously with the tempo, percussion music is added in the music, the percussion music is removed, or a plurality of bars are changed, the synchronous characteristics are not changed, the change of the lights is matched with accurate rhythm sound waves to derive various forms, and the lights are blended with music brightly, just like the lights of music-light operators in a command concert on the back of a invisibility.

In one embodiment, step S30 includes,

step S310: presetting a pair of orthogonal signals of electro-acoustic signals of the target percussion music as local signals, carrying out orthogonal demodulation on the audio preprocessing signals through the local signals, obtaining a demodulation complex signal of the target percussion music through a low-pass filter, taking a modulus value of the demodulation complex signal, obtaining an envelope of percussion pulsation, and outputting the percussion pulsation signal through a beat filter by the envelope of the percussion pulsation.

Preferably, the envelope reduction sample rate fed into the beat filter is resampled to save system resources. The striking pulse signal passes through a hysteresis comparator to output a beat pulse signal. The output signal is digitally quantized in intensity by a hysteresis comparator, avoiding output intermediate instabilities.

In one embodiment, step S30 includes,

step S320: prestoring the acoustic feature of target percussion music, obtaining first acoustic feature, the beat synchronizing signal that is provided by the beat synchronizer is right the start-up stage of percussion music carries out acoustic feature extraction in the audio frequency preprocessing signal, obtains second acoustic feature, will first acoustic feature with second acoustic feature compares, works as first acoustic feature with when second acoustic feature matches, carries impact signal to the beat filter, acquires the percussion pulsation signal. The beat filter is a low-delay low-frequency filter of variable bandwidth. The center frequency of the beat filter is 0.5Hz-8Hz, so that the beat frequency of most music pieces is covered. A sound is divided into three stages from appearance to disappearance, namely, starting vibration, steady state and attenuation. The existence of timbre can be really felt by people in the oscillation starting stage. If the start-up phase of a sound is removed, it is even unclear what instrument it is. For the start-up phase, acoustic features are used for identification. For the acting time, the steady state and attenuation shape of the target percussion music signal can be obtained through orthogonal signal demodulation of the target musical instrument sound wave prepared in advance, and the orthogonal demodulation is used for suppressing the interference of a local signal to the output.

Step S330: the striking pulse signal outputs a beat pulse signal through a hysteresis comparator.

In one embodiment, step S40 includes,

step S410: and presetting a timer with the same frequency and phase as the beat pulse signal, circularly timing, and constructing a beat synchronizer.

Step S420: and when receiving the second pulse of any one of the beat pulse signals, finishing a period and repeatedly timing by the period.

Step S430: acquiring the time difference between the initial time of each period of the beat synchronizer and the initial time of the beat pulse signal, adjusting the frequency of the beat synchronizer in a negative feedback mode through an accumulator or a low-pass filter,

step S440: and when the beat frequency of the beat synchronizer is equal to that of the beat pulse signal and the phase of the beat synchronizer is consistent, the beat synchronizer is locked and outputs a beat synchronization signal. The output light signal is fed back to the comparator through the low-pass filter, and the rhythm synchronizer can track the beat in the music in a negative feedback mode to keep synchronization, namely locking. In order to stably influence the brightness density of the lamp of vision and avoid short or overlong turn-on time, the ratio of the light turn-on time is too high, and the threshold value of hysteresis comparison is increased; otherwise, the threshold is lowered. In rhythm, beats will advance at stable time intervals, people create music, actually the length of notes in a music score and the length of beats in a black music score are filled according to a predetermined beat number, the beat number is increased by 1 beat, 1/2 beat, 1/4 beat, 1/8 beat and the like, and a beat synchronizer is arranged to ensure accurate time for collection.

Step S440: and outputting a beat synchronous signal when the beat frequency of the beat synchronizer is equal to that of the beat pulse signal and the phase of the beat synchronizer is consistent with that of the beat pulse signal. For example, the construction signal of the beat synchronizer comes from a target percussion instrument sound with relatively strong rhythmicity, such as a Bass drum (Bass drum kit) sound, a rhythm Hi-Hat (Close Hi-Hat) sound, and/or a military drum (Snaredrum) sound.

In one embodiment, step S40 further includes: the beat synchronizer records the beat combination sequence in the beat pulse signal through the memory at the starting moment of each period.

In one embodiment, step S40 further includes: and after the beat combination sequence is locked, when the whole bar is at rest and regular beats among the bars are changed, the minimum beat synchronizer keeps timing continuously, and the past beat combination sequence is copied until the current at least one eight-beat length is finished. Therefore, the synchronization signal keeps synchronous with the music rhythm and the beat when the percussion music disappears and returns.

In one embodiment, step S50 includes: at the starting time of each period, the gate control is opened, and the beat pulse signal is controlled by the gate control, namely is synchronized to the beat frequency of the beat synchronous signal to form a light control signal.

In the actual operation process, for example, the bass fermented soybean sound signals are separated, as shown in fig. 5, fig. 5 is streaming media audio data of music, the lower part is a time domain waveform, and the upper part is a shape of the rhythm of the bass fermented soybean which is separated and extracted, so that the control signals of the light of the bass fermented soybean can be obtained.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A light control method based on music rhythm is characterized by comprising the following steps:

acquiring a streaming media audio signal;

presetting a pair of orthogonal signals of an electroacoustic signal of a target percussion music as local signals, carrying out orthogonal demodulation on the audio preprocessing signal through the local signals, obtaining a demodulation complex signal of the target percussion music through a low-pass filter, taking a modulus value of the demodulation complex signal, obtaining an envelope of percussion pulsation, and outputting the percussion pulsation signal through a beat filter;

pre-storing the acoustic characteristics of the target percussion music, acquiring first acoustic characteristics, performing acoustic characteristic extraction on a start-up stage of the percussion music in the audio preprocessing signal by using a beat synchronization signal provided by a beat synchronizer, acquiring second acoustic characteristics, comparing the first acoustic characteristics with the second acoustic characteristics, and transmitting an impact signal to a beat filter to acquire a percussion pulse signal when the first acoustic characteristics are matched with the second acoustic characteristics;

2. The light control method of claim 1, wherein the minimum tempo synchronizer is constructed by at least one tempo pulse signal of the single percussive music, comprising the steps of:

3. The light control method of claim 1, comprising: the beat combination sequence in the beat pulse signal is recorded by a memory.

4. A light control method according to claim 3, characterized in that the beat combination sequence counts up one bar per repetition of one cycle, and counts up one eight beats per repetition of two bars.

5. The light control method of claim 4, comprising: and at the starting moment of each period, the gate control is opened, and the beat pulse signal is synchronized to the beat frequency of the beat synchronization signal to form a light control signal.