CN114245528A - Vehicle light show control method, apparatus, device, medium, and program product - Google Patents
Vehicle light show control method, apparatus, device, medium, and program product Download PDFInfo
- Publication number
- CN114245528A CN114245528A CN202111545324.XA CN202111545324A CN114245528A CN 114245528 A CN114245528 A CN 114245528A CN 202111545324 A CN202111545324 A CN 202111545324A CN 114245528 A CN114245528 A CN 114245528A
- Authority
- CN
- China
- Prior art keywords
- rhythm
- sampling
- audio
- preset
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000033764 rhythmic process Effects 0.000 claims abstract description 173
- 238000005070 sampling Methods 0.000 claims abstract description 119
- 238000004458 analytical method Methods 0.000 claims abstract description 37
- 230000000694 effects Effects 0.000 claims abstract description 22
- 238000001228 spectrum Methods 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 13
- 230000001795 light effect Effects 0.000 claims description 12
- 230000011218 segmentation Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 230000003595 spectral effect Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 description 10
- 241001647280 Pareques acuminatus Species 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 241000208967 Polygala cruciata Species 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 239000011324 bead Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010183 spectrum analysis Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/165—Controlling the light source following a pre-assigned programmed sequence; Logic control [LC]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
The application provides a vehicle light show control method, device, equipment, medium and program product, by obtaining audio to be analyzed; sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array; analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light on and off states of the lamp in the time period corresponding to the display frame; and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence. The technical problem of how to automatically control the vehicle light show according to the played audio is solved. The technical effect that the light show can be controlled according to the audio played in real time without manual editing is achieved.
Description
Technical Field
The present application relates to the field of automotive technologies, and in particular, to a method, an apparatus, a device, a medium, and a program product for controlling a vehicle light show.
Background
With the continuous development of vehicle technology, automobiles are not only travel tools but also gradually develop new entertainment functions, and a vehicle light show is a new entertainment form. Because a plurality of light-emitting lamps are arranged on the existing vehicle, the effect that the light waves along with music can be created only by controlling the on-off change of the light on the vehicle in a certain mode, and the use experience of a user on the vehicle is enhanced.
However, at present, a professional developer needs to configure a corresponding control file for a fixed audio file in advance to realize the display control of the light show. This requires control files developed in advance, which greatly limit the richness of the light show and the real-time nature is poor.
How to automatically control the car light show according to the played audio becomes a technical problem to be solved urgently.
Disclosure of Invention
The application provides a vehicle light show control method, device, equipment, medium and program product, so as to solve the technical problem of how to automatically control the vehicle light show according to the played audio.
In a first aspect, the present application provides a vehicle light show control method comprising:
acquiring audio to be analyzed;
sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array;
analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light effect in the time period corresponding to the display frame;
and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
In one possible design, the sample array includes: frequency spectrum array and energy array, sampling model include frequency spectrum model and audio stream and acquire the model, correspond, treat the analytic audio frequency according to predetermineeing sampling frequency and sampling model and sample to in depositing the sampling result in the sampling array, include:
according to the frequency spectrum model and the preset sampling frequency, carrying out segmentation sampling on the frequency spectrum corresponding to the audio to be analyzed, and storing each sampling frequency band in a frequency spectrum array;
and according to the preset sampling frequency and the audio stream acquisition model, carrying out segmentation sampling on the data stream corresponding to the audio to be analyzed during playing, and storing each sampled audio segment into an energy array.
Optionally, the spectrum model includes: and (3) windowing and interpolating a fast Fourier transform model.
In one possible design, the preset tempo resolution model includes: the frequency analysis model and the energy analysis model analyze the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, and the method comprises the following steps:
analyzing each sampled audio segment by using an energy analysis model according to a preset rhythm interval so as to determine audio energy corresponding to the sampled audio segment;
and analyzing each sampling frequency band by using a frequency analysis model according to a preset rhythm interval so as to determine a rhythm point and a rhythm type.
In one possible design, analyzing each sampling frequency band according to a preset rhythm interval by using a frequency analysis model to determine a rhythm point and a rhythm type, includes:
and if the characteristic frequency band corresponding to the rhythm point is in the characteristic range corresponding to the rhythm type, determining that the rhythm point corresponds to the rhythm type, wherein the characteristic frequency band is contained in the sampling frequency band.
Optionally, the tempo types include at least: drumhead rhythm and drumless rhythm.
Optionally, the drumbeat rhythm includes: audio Energy; the drumless rhythm includes: bottom drum sock, Snare drum, high hat cymbal HitHat.
In a second aspect, the present application provides a vehicle light show device comprising:
the acquisition module is used for acquiring the audio to be analyzed;
a processing module to:
sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array;
analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light effect in the time period corresponding to the display frame;
and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
In one possible design, the sample array includes: spectrum array and energy array, the sampling model includes spectrum model and audio stream and obtains the model, and is corresponding, processing module is used for:
according to the frequency spectrum model and the preset sampling frequency, carrying out segmentation sampling on the frequency spectrum corresponding to the audio to be analyzed, and storing each sampling frequency band in a frequency spectrum array;
and according to the preset sampling frequency and the audio stream acquisition model, carrying out segmentation sampling on the data stream corresponding to the audio to be analyzed during playing, and storing each sampled audio segment into an energy array.
Optionally, the spectrum model includes: and (3) windowing and interpolating a fast Fourier transform model.
In one possible design, the preset tempo resolution model includes: frequency analytic model and energy analytic model, correspondingly, processing module is used for:
analyzing each sampled audio segment by using an energy analysis model according to a preset rhythm interval so as to determine rhythm points corresponding to the sampled audio segments;
and analyzing each sampling frequency band by using a frequency analysis model according to a preset rhythm interval so as to determine the rhythm type.
In one possible design, the processing module is to:
and if the characteristic frequency band corresponding to the rhythm point is in the characteristic range corresponding to the rhythm type, determining that the rhythm point corresponds to the rhythm type, wherein the characteristic frequency band is contained in the sampling frequency band.
Optionally, the tempo types include at least: drumhead rhythm and drumless rhythm.
Optionally, the drumbeat rhythm includes: audio Energy; the drumless rhythm includes: bottom drum sock, Snare drum, high hat cymbal HitHat.
In a third aspect, the present application provides an electronic device comprising:
a memory for storing program instructions;
a processor for calling and executing the program instructions in the memory to perform any one of the possible vehicle light show control methods provided by the first aspect.
In a fourth aspect, the present application provides a vehicle comprising: the electronic device provided by the third aspect.
In a fifth aspect, the present application provides a storage medium having stored thereon a computer program for executing any one of the possible vehicle light show control methods provided in the first aspect.
In a sixth aspect, the present application further provides a computer program product comprising a computer program that, when executed by a processor, implements any one of the possible vehicle light show system methods provided by the first aspect.
The application provides a vehicle light show control method, device, equipment, medium and program product, by obtaining audio to be analyzed; sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array; analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light on and off states of the lamp in the time period corresponding to the display frame; and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence. The technical problem of how to automatically control the vehicle light show according to the audio played at the vehicle end is solved. The technical effect that the light show can be controlled according to the audio played in real time without manual editing is achieved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
FIG. 1 is a schematic view of an application scenario of a vehicle light show according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart illustrating a method for controlling a light show of a vehicle according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart of another method for controlling a vehicle light show according to an embodiment of the present disclosure;
FIG. 4 is a schematic structural diagram of a vehicle light show device according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device provided in the present application.
With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, including but not limited to combinations of embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any inventive step are within the scope of the present application.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
At present, a vehicle light show basically needs to be displayed and controlled by a professional developer by configuring a corresponding control file for a fixed audio file in advance. The control files which need to be developed in advance greatly limit the richness of the light show, the real-time performance of the control files is poor, and how to automatically control the vehicle light show according to the played audio is a technical problem which needs to be solved urgently.
In order to solve the technical problems, the invention idea of the application is as follows:
the method comprises the following steps of pre-establishing a control instruction set corresponding to a plurality of rhythm types, intercepting and sampling audio streams in real time when audio is played, and carrying out comprehensive analysis on each sampled audio segment, wherein the control instruction set comprises: energy analysis and frequency analysis.
The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 is a schematic view of an application scenario of a vehicle light show according to an embodiment of the present application. As shown in fig. 1, the vehicle-mounted controller 10 is responsible for controlling the vehicle light show, and when audio is played on the vehicle-mounted music player or the mobile device wirelessly connected to the vehicle-mounted controller 10, the vehicle-mounted controller 10 analyzes the audio in real time by using the vehicle light show control method provided by the present application, and generates control instructions for the front light group 101, the rear turn light 102, the tail light 103, and the high-mount stop light 104, so that the above-mentioned light fixtures are turned on and off according to a certain rule, and an effect of dancing the vehicle lights along with music is generated. It should be noted that, in fig. 1, a plurality of vehicles form a light show group, so that the lamps of all vehicles in the group can be controlled by the controller of one vehicle, so that the light show group can combine richer light effects more flexibly on the whole, and the lights of each vehicle can be arranged out of synchronization but according to needs. And, each vehicle of the show group of the light show one by one needs to establish good control connection through the thing networking.
The following describes in detail how to implement the vehicle light show control method provided by the present application.
Fig. 2 is a schematic flowchart of a vehicle light show control method according to an embodiment of the present disclosure. As shown in fig. 2, the method for controlling a light show of a vehicle includes the following steps:
s201, obtaining the audio to be analyzed.
In this step, the user may play the audio through an audio playing application at the vehicle end, or play the audio through an audio playing application on a mobile terminal in the same network as the vehicle-mounted controller, where the audio playing application may push an audio data stream (referred to as an audio stream for short) to the vehicle-mounted controller, and the vehicle-mounted controller receives the audio, that is, the audio to be analyzed.
S202, sampling the audio to be analyzed according to the preset sampling frequency and the sampling model, and storing the sampling result into a sampling array.
In this step, a received audio stream, i.e., an audio to be analyzed, is divided in time sequence and at preset division intervals, i.e., sampling is performed according to a preset sampling frequency, then a sampling model is used to perform spectrum analysis on the divided audio segment, for example, a fourier transform algorithm or a fast fourier transform algorithm is used to obtain spectrum data of the audio segment, and then the audio segment and the spectrum data are respectively put into different sampling arrays.
And S203, analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point.
In this step, the tempo points are used to characterize: and the light effect is switched in the time period corresponding to the display frame.
Specifically, the audio energy corresponding to the audio segment is calculated by adopting an energy analysis algorithm for the audio segment in the sampling array, and the audio energy can be used for controlling the lighting number of the LED matrix lamps, for example, the LED matrix lamps are lighted, namely, the larger the audio energy is, the more the LED lamp beads are lighted, or the more the LED lamp beads are extinguished the larger the audio energy is.
For the spectrum data in the sampling array, firstly, extracting a characteristic frequency band corresponding to an audio segment, namely, intercepting one or more characteristic frequency bands from all spectrum data corresponding to one audio segment according to a preset requirement, such as at least one preset type threshold value, then, comparing the characteristic frequency bands with a preset frequency identification range corresponding to various rhythm types, if the characteristic frequency bands fall into the frequency identification range, considering that the audio segment belongs to the rhythm type, and the time point corresponding to the characteristic frequency band is a rhythm point.
It should be noted that, if there are multiple rhythm types, a preset sequence needs to be set in comparison between the recognition ranges corresponding to the multiple rhythm types and the characteristic frequency band, and as long as the characteristic frequency band falls into the recognition range corresponding to a certain rhythm type for the first time, the audio segment is determined to belong to the rhythm type.
In one possible design, if the recognition range of each rhythm type cannot cover each characteristic frequency band, the rhythm type of the audio segment is taken as the rhythm type with the highest coverage rate, i.e., the recognition range with the highest degree of overlap with the characteristic frequency band.
It should be noted that the display frame is the basic display unit of the whole light show, and is played frame by frame like a movie, so in this embodiment, 24 display frames are set every second, that is, in this embodiment, at least 24 times per second are needed for determining the rhythm point and the rhythm type.
S204, determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
In this step, each rhythm type corresponds to a basic light effect, and a control instruction set corresponding to the basic light effect can be preset and stored in the vehicle-mounted controller and can be directly called when needed. The rhythm point may be considered as an execution point of the basic lighting effect, or may be considered as a switching of the basic lighting effect at a predetermined interval before or after the rhythm point, because some basic lighting effects such as tickers last for a longer time.
It should be noted that, if no rhythm point is extracted in S203 or no corresponding preset rhythm type is found, the wavy light effect is output according to the preset light effect corresponding to the audio energy. The effect that a plurality of blocky control pieces fluctuate up and down in the audio player is created through the combination of a plurality of lamps, and the plurality of lamps can replace the blocky control pieces in the light show.
The embodiment provides a vehicle light show control method, which comprises the steps of obtaining audio to be analyzed; sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array; analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light on and off states of the lamp in the time period corresponding to the display frame; and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence. The technical problem of how to automatically control the vehicle light show according to the audio played at the vehicle end is solved. The technical effect that the light show can be controlled according to the audio played in real time without manual editing is achieved.
FIG. 3 is a schematic flow chart diagram of another vehicle light show control method provided in the practice of the present application. As shown in fig. 3, the method for controlling a light show of a vehicle includes the following steps:
s301, obtaining the audio to be analyzed.
In this step, the user may play the audio through an audio playing application at the vehicle end, or play the audio through an audio playing application on a mobile terminal in the same network as the vehicle-mounted controller, where the audio playing application may push an audio data stream (referred to as an audio stream for short) to the vehicle-mounted controller, and the vehicle-mounted controller receives the audio, that is, the audio to be analyzed.
S302, according to the frequency spectrum model and the preset sampling frequency, carrying out division sampling on the frequency spectrum corresponding to the audio to be analyzed, and storing each sampling frequency band in a frequency spectrum array.
In this step, the audio stream received in S301, i.e. the audio to be analyzed, is first segmented in time sequence and at preset segmentation intervals, and then the segmented audio segment is subjected to spectrum analysis.
In this embodiment, the spectrum model includes: and (3) windowing and interpolating a fast Fourier transform model. Because of the persistence of vision of human eyes, the flicker frequency of a lamp cannot be too high, i.e. the interval between two rhythm points cannot be too small. However, during the segmentation, the position of the rhythm point cannot be predicted, which may cause a contradiction between the time point of the segmentation and the minimum rhythm interval, or may cause a spectrum leakage due to asynchronous sampling and non-integer period truncation with the natural rhythm of the audio and the preset minimum rhythm interval during the segmentation, thereby affecting the processing precision of the frequency analysis and causing a problem that the rhythm point and/or the rhythm type cannot be identified. The inventor of the application finds that the windowed interpolation fast Fourier transform model can effectively improve the problem, practical interpolation correction is obtained by applying polynomial fitting through the spectral characteristics of the Blackman-Harris window, frequency spectrum leakage is effectively inhibited, and the judgment accuracy of rhythm points and/or rhythm types is guaranteed.
For a specific implementation of the windowed interpolation fft model, those skilled in the art can check corresponding data, which is not described herein.
And S303, according to the preset sampling frequency and the audio stream acquisition model, carrying out segmentation sampling on the data stream corresponding to the audio to be analyzed during playing, and storing each sampled audio segment into an energy array.
In this step, the audio stream is directly stored in the energy array after being divided, so as to be ready for subsequent audio energy calculation.
And S304, analyzing each sampled audio segment according to a preset rhythm interval by using an energy analysis model to determine the audio energy corresponding to the sampled audio segment.
In this embodiment, the preset tempo resolution model includes: the frequency analysis model and the energy analysis model are used for analyzing the model according to a preset rhythm.
In this step, the energy analysis model is used to calculate the audio energy of the audio stream, and a person skilled in the art may select a corresponding audio energy calculation method according to a specific scene or requirement, which is not limited in this application.
And S305, analyzing each sampling frequency band according to a preset rhythm interval by using a frequency analysis model to determine a rhythm point and a rhythm type.
In this step, if the characteristic frequency band corresponding to the rhythm point is within the characteristic range corresponding to the rhythm type, it is determined that the rhythm point corresponds to the rhythm type, and the characteristic frequency band is included in the sampling frequency band.
Optionally, the tempo types include at least: drumhead rhythm and drumless rhythm.
In the present embodiment, the drumless rhythm includes: audio Energy; the drumbeat rhythm includes: bottom drum sock, Snare drum, high hat cymbal HitHat.
Specifically, the frequency identification range corresponding to the bottom drum kit is the lowest, the Snare order is the next to the Snare drum, and the high hat cymbal HitHat is the highest, so that the identification sequence is to determine whether the bottom drum kit is the bottom drum kit or not, if not, determine whether the bottom drum kit is the Snare drum Snare or not, if not, determine whether the bottom drum kit is the high hat cymbal HitHat or not, and if not, the rhythm type is the audio Energy.
It should be noted that the combination of steps S304 and S305 can make the judgment of the rhythm point and the rhythm type more accurate, and can avoid the false appearance of light show pause caused by blank display frames when the display frames cannot correspond to any rhythm type. Namely, when the audio to be analyzed belongs to elegant and slow drumless rhythm, the preset basic light effect corresponding to the audio energy is directly utilized to correspondingly control the light show.
S306, determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
In this step, each display frame may correspond to at least one vehicle in the light show display group shown in fig. 1, or different vehicles may correspondingly complete different display frames, so that the complexity and richness of the light show are greatly improved, and the user experience is increased.
It should be noted that the display mode corresponding to the rhythm point and the rhythm type can be embodied not only by the light, but also by the oscillating amplitude and frequency of the wiper shown in fig. 1.
The embodiment provides a vehicle light show control method, which comprises the steps of obtaining audio to be analyzed; sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array; analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light on and off states of the lamp in the time period corresponding to the display frame; and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence. The technical problem of how to automatically control the vehicle light show according to the audio played at the vehicle end is solved. The technical effect that the light show can be controlled according to the audio played in real time without manual editing is achieved.
Fig. 4 is a schematic structural diagram of a vehicle light show device according to an embodiment of the present disclosure. The vehicle light show apparatus 400 may be implemented by software, hardware, or a combination of both.
As shown in fig. 4, the vehicle light show apparatus 400 includes:
an obtaining module 401, configured to obtain an audio to be analyzed;
a processing module 402 for:
sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array;
analyzing the sampling array according to a preset rhythm analysis model to determine the rhythm point of each display frame and the rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light effect in the time period corresponding to the display frame;
and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
In one possible design, the sample array includes: a spectrum array and an energy array, wherein the sampling model includes a spectrum model and an audio stream acquisition model, and correspondingly, the processing module 402 is configured to:
according to the frequency spectrum model and the preset sampling frequency, carrying out segmentation sampling on the frequency spectrum corresponding to the audio to be analyzed, and storing each sampling frequency band in a frequency spectrum array;
and according to the preset sampling frequency and the audio stream acquisition model, carrying out segmentation sampling on the data stream corresponding to the audio to be analyzed during playing, and storing each sampled audio segment into an energy array.
Optionally, the spectrum model includes: and (3) windowing and interpolating a fast Fourier transform model.
In one possible design, the preset tempo resolution model includes: a frequency analysis model and an energy analysis model, and correspondingly, the processing module 402 is configured to:
analyzing each sampled audio segment by using an energy analysis model according to a preset rhythm interval so as to determine rhythm points corresponding to the sampled audio segments;
and analyzing each sampling frequency band by using a frequency analysis model according to a preset rhythm interval so as to determine the rhythm type.
In one possible design, the processing module 402 is configured to:
and if the characteristic frequency band corresponding to the rhythm point is in the characteristic range corresponding to the rhythm type, determining that the rhythm point corresponds to the rhythm type, wherein the characteristic frequency band is contained in the sampling frequency band.
Optionally, the tempo types include at least: drumhead rhythm and drumless rhythm.
Optionally, the drumbeat rhythm includes: audio Energy; the drumless rhythm includes: bottom drum sock, Snare drum, high hat cymbal HitHat.
It should be noted that the apparatus provided in the embodiment shown in fig. 4 can execute the method provided in any of the above method embodiments, and the specific implementation principle, technical features, term explanation and technical effects thereof are similar and will not be described herein again.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 5, the electronic device 500 may include: at least one processor 501 and memory 502. Fig. 5 shows an electronic device as an example of a processor.
The memory 502 is used for storing programs. In particular, the program may include program code including computer operating instructions.
The processor 501 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.
Alternatively, the memory 502 may be separate or integrated with the processor 501. When the memory 502 is a device independent from the processor 501, the electronic device 500 may further include:
a bus 503 for connecting the processor 501 and the memory 502. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. Buses may be classified as address buses, data buses, control buses, etc., but do not represent only one bus or type of bus.
Alternatively, in a specific implementation, if the memory 502 and the processor 501 are integrated on a chip, the memory 502 and the processor 501 may communicate through an internal interface.
An embodiment of the present application further provides a vehicle, including: any one of the possible electronic devices in the embodiment shown in fig. 5.
An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium may include: various media that can store program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and in particular, the computer-readable storage medium stores program instructions for the methods in the above method embodiments.
An embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the method in the foregoing method embodiments.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (10)
1. A vehicle light show control method, comprising:
acquiring audio to be analyzed;
sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array;
analyzing the sampling array according to a preset rhythm analyzing model to determine a rhythm point of each display frame and a rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light effect in the time period corresponding to the display frame;
and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
2. The vehicle light show control method of claim 1, wherein the sampling array comprises: frequency spectrum array and energy array, the sampling model includes that frequency spectrum model and audio stream acquire the model, and is corresponding, it is right according to predetermineeing sampling frequency and sampling model wait to resolve the audio frequency and sample to in saving the sampling result in the sampling array, include:
according to the frequency spectrum model and the preset sampling frequency, performing division sampling on the frequency spectrum corresponding to the audio to be analyzed, and storing each sampling frequency band in the frequency spectrum array;
and according to the preset sampling frequency and the audio stream acquisition model, carrying out segmentation sampling on the data stream corresponding to the audio to be analyzed during playing, and storing each sampled audio segment into the energy array.
3. The vehicle light show control method of claim 2, wherein the spectral model comprises: and (3) windowing and interpolating a fast Fourier transform model.
4. The vehicle light show control method of claim 2, wherein the predetermined cadence analysis model comprises: the method comprises a frequency analysis model and an energy analysis model, wherein the sampling array is analyzed according to a preset rhythm analysis model to determine a rhythm point of each display frame and a rhythm type corresponding to the rhythm point, and the method comprises the following steps of:
analyzing each sampled audio segment by using the energy analysis model according to a preset rhythm interval so as to determine audio energy corresponding to the sampled audio segment;
and analyzing each sampling frequency band by using the frequency analysis model according to the preset rhythm interval so as to determine the rhythm point and the rhythm type.
5. The vehicle light show control method of claim 4, wherein said analyzing each of said sampled frequency bands to determine said cadence type according to said preset cadence interval using said frequency analysis model comprises:
and if the characteristic frequency band corresponding to the rhythm point is in the characteristic range corresponding to the rhythm type, determining that the rhythm point corresponds to the rhythm type, wherein the characteristic frequency band is contained in the sampling frequency band.
6. A vehicle light show control apparatus, comprising:
the acquisition module is used for acquiring the audio to be analyzed;
a processing module to:
sampling the audio to be analyzed according to a preset sampling frequency and a sampling model, and storing a sampling result into a sampling array;
analyzing the sampling array according to a preset rhythm analyzing model to determine a rhythm point of each display frame and a rhythm type corresponding to the rhythm point, wherein the rhythm point is used for representing: the time of switching the light effect in the time period corresponding to the display frame;
and determining a display sequence of each preset lamp effect according to the rhythm point and the rhythm type, and controlling at least one lamp on at least one target vehicle to display the light show according to the display sequence.
7. An electronic device, comprising: a processor and a memory;
the memory for storing a computer program for the processor;
the processor is configured to perform the vehicle light show control method of any one of claims 1 to 5 via execution of the computer program.
8. A vehicle characterized by comprising the electronic device of claim 7.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the vehicle light show control method according to any one of claims 1 to 5.
10. A computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the vehicle light show control method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111545324.XA CN114245528B (en) | 2021-12-16 | 2021-12-16 | Vehicle lamplight show control method, device, equipment, medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111545324.XA CN114245528B (en) | 2021-12-16 | 2021-12-16 | Vehicle lamplight show control method, device, equipment, medium and program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114245528A true CN114245528A (en) | 2022-03-25 |
| CN114245528B CN114245528B (en) | 2023-11-21 |
Family
ID=80757195
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111545324.XA Active CN114245528B (en) | 2021-12-16 | 2021-12-16 | Vehicle lamplight show control method, device, equipment, medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114245528B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115243107A (en) * | 2022-07-08 | 2022-10-25 | 华人运通(上海)云计算科技有限公司 | Method, device, system, electronic equipment and medium for playing short video |
| WO2024051347A1 (en) * | 2022-09-05 | 2024-03-14 | 华为技术有限公司 | Method and apparatus for controlling light display |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017000794A1 (en) * | 2015-06-30 | 2017-01-05 | 芋头科技（杭州）有限公司 | Music and light rhythm system and method |
| CN107889323A (en) * | 2017-09-27 | 2018-04-06 | 杭州古北电子科技有限公司 | The control method and device that a kind of light is shown |
| US20180319324A1 (en) * | 2016-09-22 | 2018-11-08 | Tencent Technology (Shenzhen) Company Limited | Lamp light control method and apparatus, computer storage medium and in-vehicle device |
| WO2019114688A1 (en) * | 2017-12-14 | 2019-06-20 | 蔚来汽车有限公司 | Method for controlling light provided on vehicle and lighting system for vehicle |
| CN110996463A (en) * | 2019-11-25 | 2020-04-10 | 智然软件科技(深圳)有限公司 | Acousto-optic control method and control system and acousto-optic device |
| CN211364410U (en) * | 2019-11-06 | 2020-08-28 | 宁波吉利汽车研究开发有限公司 | Control device of automobile lamp |
| CN111988891A (en) * | 2020-08-17 | 2020-11-24 | 一飞(海南)科技有限公司 | Unmanned aerial vehicle formation music synchronous light control method and control system and unmanned aerial vehicle |
| US20200410975A1 (en) * | 2019-06-28 | 2020-12-31 | Shanghai Edaysoft Co., Ltd. | Audio synthesis method, computer apparatus, and storage medium |
| US20210261050A1 (en) * | 2020-02-21 | 2021-08-26 | Cobalt Industries Inc. | Real-time contextual vehicle lighting systems and methods |
| CN113613369A (en) * | 2021-08-11 | 2021-11-05 | 深圳市智岩科技有限公司 | Light effect control method, device, equipment and storage medium |
| CN113706667A (en) * | 2021-08-16 | 2021-11-26 | 智马达汽车有限公司 | Vehicle light show determination method and device, electronic equipment and storage medium |
-
2021
- 2021-12-16 CN CN202111545324.XA patent/CN114245528B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017000794A1 (en) * | 2015-06-30 | 2017-01-05 | 芋头科技（杭州）有限公司 | Music and light rhythm system and method |
| US20180319324A1 (en) * | 2016-09-22 | 2018-11-08 | Tencent Technology (Shenzhen) Company Limited | Lamp light control method and apparatus, computer storage medium and in-vehicle device |
| CN107889323A (en) * | 2017-09-27 | 2018-04-06 | 杭州古北电子科技有限公司 | The control method and device that a kind of light is shown |
| WO2019114688A1 (en) * | 2017-12-14 | 2019-06-20 | 蔚来汽车有限公司 | Method for controlling light provided on vehicle and lighting system for vehicle |
| US20200410975A1 (en) * | 2019-06-28 | 2020-12-31 | Shanghai Edaysoft Co., Ltd. | Audio synthesis method, computer apparatus, and storage medium |
| CN211364410U (en) * | 2019-11-06 | 2020-08-28 | 宁波吉利汽车研究开发有限公司 | Control device of automobile lamp |
| CN110996463A (en) * | 2019-11-25 | 2020-04-10 | 智然软件科技(深圳)有限公司 | Acousto-optic control method and control system and acousto-optic device |
| US20210261050A1 (en) * | 2020-02-21 | 2021-08-26 | Cobalt Industries Inc. | Real-time contextual vehicle lighting systems and methods |
| CN111988891A (en) * | 2020-08-17 | 2020-11-24 | 一飞(海南)科技有限公司 | Unmanned aerial vehicle formation music synchronous light control method and control system and unmanned aerial vehicle |
| CN113613369A (en) * | 2021-08-11 | 2021-11-05 | 深圳市智岩科技有限公司 | Light effect control method, device, equipment and storage medium |
| CN113706667A (en) * | 2021-08-16 | 2021-11-26 | 智马达汽车有限公司 | Vehicle light show determination method and device, electronic equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115243107A (en) * | 2022-07-08 | 2022-10-25 | 华人运通(上海)云计算科技有限公司 | Method, device, system, electronic equipment and medium for playing short video |
| CN115243107B (en) * | 2022-07-08 | 2023-11-21 | 华人运通(上海)云计算科技有限公司 | Method, device, system, electronic equipment and medium for playing short video |
| WO2024051347A1 (en) * | 2022-09-05 | 2024-03-14 | 华为技术有限公司 | Method and apparatus for controlling light display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114245528B (en) | 2023-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114245528A (en) | Vehicle light show control method, apparatus, device, medium, and program product | |
| CN107393569B (en) | Audio-video clipping method and device | |
| US11657798B2 (en) | Methods and apparatus to segment audio and determine audio segment similarities | |
| US20220287167A1 (en) | Acousto-optic control method, system, and an acousto-optic device | |
| US9330546B2 (en) | System and method for automatically producing haptic events from a digital audio file | |
| US8378964B2 (en) | System and method for automatically producing haptic events from a digital audio signal | |
| CN113192152A (en) | Audio-based image generation method, electronic device and storage medium | |
| CN109257545A (en) | A kind of multisource video clipping method, device and storage medium | |
| CN111901538B (en) | Subtitle generating method, device and equipment and storage medium | |
| US11511200B2 (en) | Game playing method and system based on a multimedia file | |
| CN113706667A (en) | Vehicle light show determination method and device, electronic equipment and storage medium | |
| CN113573442A (en) | Method, apparatus, and computer-readable storage medium for audio control of scenes | |
| US9275377B2 (en) | System, method, and computer program product for determining a monotonic set of presets | |
| CN113173179A (en) | Driving mode switching prompting method and device and vehicle | |
| CN111507254B (en) | Method, apparatus, terminal and non-transitory computer readable storage medium for producing word-by-word lyrics | |
| CN110097618B (en) | Music animation control method and device, vehicle and storage medium | |
| JP2022541380A (en) | Multi-speaker diarization of speech input using neural networks | |
| CN101742764A (en) | Method for controlling LED lamps along with energy of music | |
| CN114241115A (en) | Illumination rendering method and device of multipoint light source, computer equipment and storage medium | |
| CN109063340B (en) | Simulation-based GPU performance testing method and device | |
| CN114559890A (en) | Audio linkage control method, device, equipment and storage medium | |
| CN112233662A (en) | Audio analysis method and device, computing equipment and storage medium | |
| US10390410B2 (en) | Music selection device for generating lighting control data, music selection method for generating lighting control data, and music selection program for generating lighting control data | |
| CN114126158A (en) | Lamp effect control method and device, electronic equipment and readable storage medium | |
| CN116343757A (en) | Interface light control method based on audio data and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |