CN113573442A - Method, apparatus, and computer-readable storage medium for audio control of scenes - Google Patents
Method, apparatus, and computer-readable storage medium for audio control of scenes Download PDFInfo
- Publication number
- CN113573442A CN113573442A CN202110809192.0A CN202110809192A CN113573442A CN 113573442 A CN113573442 A CN 113573442A CN 202110809192 A CN202110809192 A CN 202110809192A CN 113573442 A CN113573442 A CN 113573442A
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- change
- music
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000005236 sound signal Effects 0.000 claims abstract description 77
- 230000008859 change Effects 0.000 claims abstract description 71
- 238000013507 mapping Methods 0.000 claims abstract description 12
- 238000004590 computer program Methods 0.000 claims description 22
- 238000001228 spectrum Methods 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 230000000007 visual effect Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 241001465382 Physalis alkekengi Species 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000035622 drinking Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
A method, apparatus and computer-readable storage medium for controlling a scene with audio to precisely control a change of the scene, resulting in more experience for a user. The method comprises the following steps: acquiring audio signals belonging to music in a scene; extracting audio features from an audio signal of the music; acquiring light characteristics according to the mapping relation between the audio characteristics of the audio signals of the music and the light characteristics; and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics of the audio signal of the music. The technical scheme of the application can become more accurate, meticulous to light and video playback mode's control for the change of scene is more colorful, brings better visual experience for the user.
Description
Technical Field
The present invention relates to the field of audio processing, and in particular, to a method, an apparatus, and a computer-readable storage medium for controlling a scene with audio.
Background
In entertainment and leisure places such as KTV, pubs, dance halls and the like, the change of light is usually adopted to set off the scene atmosphere. One existing method of using lights to mood a scene is to control the changes of the lights according to the song, for example, to switch the lights according to the genre of the song, or to play a specific material according to the song number, etc. Although the prior art can change the light, the light is changed according to the song, and the defects of rough control mode and monotonous effect exist.
Disclosure of Invention
The application provides a method, equipment and a computer-readable storage medium for controlling a scene through audio, so that the change of the scene can be accurately controlled, and more experiences can be brought to a user.
In one aspect, the present application provides a method for controlling a scene with audio, including:
acquiring audio signals belonging to music in a scene;
extracting audio features from an audio signal of the music;
acquiring the light characteristics according to the mapping relation between the audio characteristics and the light characteristics;
and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics.
In another aspect, the present application provides an apparatus for controlling a scene with audio, including:
the first acquisition module is used for acquiring audio signals belonging to music in the scene;
an extraction module for extracting audio features from the audio signal of the music;
the second acquisition module is used for acquiring the light characteristics according to the mapping relation between the audio characteristics and the light characteristics;
and the control module is used for controlling the corresponding lamp to change the light according to the light characteristics and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics.
In a third aspect, the present application provides an apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method of controlling a scene as described above when executing the computer program.
In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the above-mentioned method for controlling a scene.
According to the technical scheme provided by the application, the change of the light is controlled according to the song compared with the prior art, the control mode is extensive, the effect is monotonous and different, the change of the light and the change of the video playing mode are controlled according to the audio characteristics of the audio signal of the music, the control granularity is smaller, and therefore the control over the light and the video playing mode becomes more accurate and fine, the change of the scene is more colorful, and better visual experience is brought to a user.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for controlling a scene through audio provided by an embodiment of the present application;
FIG. 2 is a schematic structural diagram of an apparatus for controlling a scene with audio provided by an embodiment of the present application;
fig. 3 is a schematic structural diagram of an apparatus provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In this specification, adjectives such as first and second may only be used to distinguish one element or action from another, without necessarily requiring or implying any actual such relationship or order. References to an element or component or step (etc.) should not be construed as limited to only one of the element, component, or step, but rather to one or more of the element, component, or step, etc., where the context permits.
In the present specification, the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
The present application provides a method for controlling a scene with audio, as shown in fig. 1, the method mainly includes steps S101 to S104, which are detailed as follows:
step S101: an audio signal belonging to music in the scene is acquired.
In entertainment and leisure places such as KTVs, pubs, dance halls and the like, a sound source in the scene is mixed with a voice signal or other non-music signals transmitted by people in entertainment besides music, and the signals are noise relative to the music. Generally, the audio signal of music has relatively stable characteristics, such as a specific frequency band, and the sound signal from people or other non-music signals also have characteristics, so that these noise signals can be filtered by a filter to obtain the audio signal belonging to music in the scene.
Step S102: audio features are extracted from an audio signal of the music.
For a segment of an audio signal, its characteristics, e.g., frequency, amplitude, and energy, etc., may be represented from multiple dimensions. In general, a normal person feels more profound to the music beat, and usually responds to the music beat, such as clapping, dancing, drinking, and the like. In order to correspond to music, the change of the light and the video playing mode is controlled in real time on the beat, so that the user experience can be improved, and the effect of rendering atmosphere is achieved.
As an embodiment of the present application, extracting audio features from an audio signal of music may be implemented by steps S1021 to S1023 as follows:
step S1021: and carrying out signal processing on the audio signal segments of the music to obtain a maximum value point sequence.
In the embodiment of the present application, the signal processing on the audio signal segment of music may be sampling the audio signal segment of music, converting a time domain into a frequency domain, reducing dimensions, performing autocorrelation, and the like, where parameters of the sampling at least include a sampling frequency, a step value, and the number of sampling points, and the like. By signal processing the audio signal segments of the music, a sequence of maximum points can be obtained. The maximum point sequence refers to a frequency point formed by a series of amplitude maximum values in an audio signal.
Step S1022: a first maximum point and a second maximum point are determined from the sequence of maximum points.
Here, the first maximum point is a point having the largest value in the first sequence range in the maximum point sequence, the second maximum point is a point having the largest value in the second sequence range in the maximum point sequence, the number of maximum points included in the first sequence range is smaller than the number of maximum points included in the second sequence range, and the starting point of the second sequence range is the first maximum point.
Step S1023: determining the beat in the audio signal of the music according to the sequence position of the first maximum point and the sequence position of the second maximum point.
Specifically, the beat type in the audio signal of the music may be determined according to the sequence position of the first maximum value point and the sequence position of the second maximum value point, then the first candidate point and the second candidate point may be determined according to the sequence position and the value of the first maximum value point, the sequence position and the value of the second maximum value point, and the beat type, and finally the beat in the audio signal of the music may be determined according to the first candidate point, the second candidate point, and the beat type.
As another embodiment of the present application, extracting audio features from an audio signal of music may be implemented by steps S '1021 to S' 1024 as follows:
step S' 1021: the spectrum of each frame signal in an audio signal of music is acquired.
The audio signal of the music is initially a function of the sound pressure changing along with time, which is equivalent to a waveform diagram in a time domain, and after the audio signal of the music is acquired, the audio signal in the time domain is processed from the time domain to the frequency domain to obtain the frequency spectrum of each frame in the music signal.
Step S' 1022: the low frequency signal and the high frequency signal of each frame signal are extracted from the frequency spectrum.
Here, the low frequency signal is a low frequency signal in a predetermined frequency band, and the high frequency signal is a high frequency signal in a predetermined high frequency band.
Step S' 1023: and if the energy increase of the frame signal is larger than a preset value compared with the low-frequency signal of the previous frame signal, determining that the beat occurs at the position of the frame signal.
Through analysis and comparison of music signals, when beats occur, a distinct low-frequency extension process appears on a frequency spectrum, and the lower the signal frequency, the farther the transmission distance, the more energy. Based on the above facts, in the embodiment of the present application, the audio signal of music is divided into a plurality of frames, and after the frequency spectrum of each frame signal is obtained, the low frequency signal of each frame signal in the preset low frequency band is extracted, the energy of the low frequency signal of each frame signal is calculated, then the energy changes of the previous and next 2 frames of signals are compared, and if the energy increase of the present frame signal is greater than the preset value compared with the low frequency signal of the previous frame signal, the beat of the position of the present frame signal is determined.
Step S' 1024: and if the energy change of the frame signal is larger than a preset value compared with the high-frequency signal of the previous frame signal, and the energy consistency degree of the high-frequency signal of the frame signal is larger than a preset threshold, determining that the beat occurs at the position of the frame signal.
Through analysis and comparison of music signals, the beat has very strong energy in a high-frequency part and has very good periodicity. Based on the above facts, in the embodiment of the present application, the high frequency signal of each frame signal in the preset high frequency band is extracted, the energy and the energy consistency degree of the high frequency signal of each frame signal are calculated, and if the energy change of the frame signal is greater than the preset value compared with the high frequency signal of the previous frame signal, and the energy consistency degree of the high frequency signal of the frame signal is greater than the preset threshold, the beat occurring at the position of the frame signal is determined.
Step S103: and acquiring the light characteristics according to the mapping relation between the audio characteristics of the audio signal and the light characteristics.
Since a certain mapping relationship has been generated in advance between the audio features of the audio signal and the light features, after the audio features of the audio signal of the music are acquired in steps S101 and S102, the light features may be acquired according to the mapping relationship between the audio features of the audio signal and the light features. In the embodiment of the present application, the light feature may be brightness, color and/or shape of the light.
Step S104: and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics of the audio signal of the music.
In an embodiment of the present application, according to the light characteristics, controlling the corresponding lamp to change the light may be: and generating a control instruction according to the light characteristics and the identification of the lamp, and controlling the lamp corresponding to the identification of the lamp to change the brightness, color and/or shape at the beat according to the control instruction. In the above embodiment, the control instruction is an instruction conforming to the DMX512 control protocol. Lamps and lanterns can include one or more fluorescent tubes, receive these control command at lamps and lanterns after for its light that sends can carry out corresponding change according to audio frequency characteristics such as the beat of music, including the power change of light, the change of flicker frequency or the number change of the fluorescent tube that sends light at present, for example when the high pitch constantly increases appearing in the audio frequency, control light and continuously strengthen luminance, when heavy bass appears in the audio frequency, the quantity of the luminous fluorescent tube of control increases, thereby realized that light cooperation audio frequency characteristic carries out rich and varied change.
In another embodiment of the present application, according to the audio characteristics of the audio signal of the music, the change of the video playing mode of the corresponding video display device may be: determining the change parameters of elements in a playing picture of the video display equipment according to the beat information in the audio signal of the music; generating a video playing model corresponding to the audio signal of the music according to the variation parameters of the elements in the playing picture of the video display equipment; and controlling the corresponding video display equipment to change the video playing mode according to the video playing model, wherein the beat information comprises the time corresponding to the beat of the music. In the above embodiments, the video display device may be a jubilant, a panoramic device, or the like in an entertainment and leisure place such as a KTV, a bar, a dance hall, or the like, and the elements in the playing screen may be points, lines, graphics, curves, or other entities with set shapes, or the like, or may be a combination of any two or more of the above graphics and curves, points and lines, for example: triangles, histograms, wave diagrams, etc. Further, the change of the video playing mode of the corresponding video display device controlled according to the video playing model may be controlling the brightness output by the video display devices such as a large screen and a panoramic device, the playing magnification of the video, the video switching of different scenes, the size scaling of a window, the change of RGB colors, and the like.
In one embodiment of the present application, determining the variation parameters of the elements in the playing picture of the video display device according to the tempo information in the audio signal of the music may be: determining the time corresponding to each beat according to the beat information in the audio signal; and determining the time corresponding to each beat as the time of sudden change of the playing picture elements. In another embodiment of the present application, determining the variation parameters of the elements in the playing picture of the video display device according to the tempo information in the audio signal of the music may be: selecting a playing picture generation model; determining the beat rate and the time period corresponding to each beat rate according to the beat information; and determining the change period or change frequency of the picture elements contained in the playing picture generation model in each time period according to the beat rate and the corresponding time period.
It can be known from the method for controlling a scene by audio illustrated in fig. 1 above that, compared with the prior art, the method for controlling a scene by controlling light change only according to songs has a rough control mode and a monotonous effect, and because the method controls light change and video playing mode change according to audio characteristics of audio signals of music, the control granularity is smaller, the control on light and video playing mode becomes more accurate and finer, so that the scene change is more colorful, and a better visual experience is brought to a user.
Referring to fig. 2, the apparatus for controlling a scene by audio according to an embodiment of the present application may include a first obtaining module 201, an extracting module 202, a second obtaining module 203, and a control module 204, which are detailed as follows:
a first obtaining module 201, configured to obtain an audio signal belonging to music in a scene;
an extraction module 202, configured to extract audio features from an audio signal of music;
the second obtaining module 203 is configured to obtain a light feature according to a mapping relationship between an audio feature of the audio signal of the music and the light feature;
the control module 204 is configured to control the corresponding lamp to change the light according to the light characteristics, and/or control the corresponding video display device to change the video playing mode according to the audio characteristics of the audio signal of the music.
Known from the description of above technical scheme, with prior art only control the change of light according to the song, its control mode is extensive, and the effect is monotonous different, because this application controls the change of light and the change of video playback mode according to the audio frequency characteristic of the audio signal of music, its control granularity is littleer, consequently, control to light and video playback mode becomes more accurate, meticulous for the change of scene is more rich and varied, brings better visual experience for the user.
Optionally, the extraction module 202 illustrated in fig. 2 may include a maximum value sequence extraction unit, a first determination unit, and a second determination unit, where:
the maximum sequence extraction unit is used for carrying out signal processing on the audio signal segments of the music to obtain a maximum point sequence;
the first determining unit is used for determining a first maximum value point and a second maximum value point from the maximum value point sequence;
a second determining unit for determining the beat in the audio signal according to the sequence position of the first maximum point and the sequence position of the second maximum point.
Optionally, the extraction module 202 illustrated in fig. 2 may include a spectrum obtaining unit, a low-frequency high-frequency signal obtaining unit, a third determining unit, and a fourth determining unit, where:
a spectrum acquisition unit for acquiring a spectrum of each frame signal in an audio signal of music;
a low-frequency and high-frequency signal acquisition unit for extracting a low-frequency signal and a high-frequency signal of each frame signal from the frequency spectrum;
the third determining unit is used for determining that the beat occurs at the position of the signal of the current frame if the energy increase of the signal of the current frame is larger than the preset value compared with the low-frequency signal of the previous frame;
and the fourth determining unit is used for determining that the beat occurs at the position of the frame signal if the energy change of the frame signal is larger than the preset value compared with the high-frequency signal of the previous frame signal and the energy consistency degree of the high-frequency signal of the frame signal is larger than the preset threshold.
Optionally, in the apparatus illustrated in fig. 2, the light characteristics include brightness, color and/or shape of the light, and the control module 204 may include an instruction generating unit and a light variation control unit, wherein:
the command generation unit is used for generating a control command according to the light characteristics and the identification of the lamp;
and the light change control unit is used for controlling the lamp corresponding to the identifier of the lamp to change the brightness, color and/or shape at the beat according to the control instruction.
Optionally, the control module 204 illustrated in fig. 2 may include a fifth determining unit, a model generating unit, and a playing manner changing unit, where:
a fifth determining unit, configured to determine a variation parameter of an element in a playing picture of the video display device according to the beat information in the audio signal;
the model generating unit is used for generating a video playing model corresponding to the audio signal according to the variation parameters of elements in a playing picture of the video display equipment, wherein the beat information comprises the time corresponding to the beat in the music;
and the playing mode changing unit is used for controlling the corresponding video display equipment to change the video playing mode according to the video playing model.
Optionally, the fifth determining unit of the above example may include a sixth determining unit and a seventh determining unit, wherein:
a sixth determining unit, configured to determine, according to the beat information, a time corresponding to each beat;
and the seventh determining unit is used for determining the time corresponding to the beat as the time of sudden change of the playing picture element.
Optionally, the fifth determining unit of the above example may include a selecting unit, an eighth determining unit, and a ninth determining unit, wherein:
a selecting unit for selecting a play picture generation model;
an eighth determining unit, configured to determine, according to the beat information, a beat rate and a time period corresponding to each beat rate;
and a ninth determining unit, configured to determine a change cycle or a change frequency of the picture elements included in the play picture generation model in each time period according to the beat rate and the corresponding time period.
Fig. 3 is a schematic structural diagram of an apparatus provided in an embodiment of the present application. As shown in fig. 3, the apparatus 3 of this embodiment mainly includes: a processor 30, a memory 31 and a computer program 32, such as a program of a method of audio controlling a scene, stored in the memory 31 and executable on the processor 30. The steps in the method embodiments of the audio control scenario described above, such as steps S101 to S104 shown in fig. 1, are implemented when the processor 30 executes the computer program 32. Alternatively, the processor 30, when executing the computer program 32, implements the functions of the modules/units in the above-described device embodiments, such as the functions of the first obtaining module 201, the extracting module 202, the second obtaining module 203 and the control module 204 shown in fig. 2.
Illustratively, the computer program 32 of the method of audio control of a scene mainly comprises: acquiring audio signals belonging to music in a scene; extracting audio features from an audio signal of the music; acquiring light characteristics according to the mapping relation between the audio characteristics of the audio signals of the music and the light characteristics; and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics of the audio signal of the music. The computer program 32 may be partitioned into one or more modules/units, which are stored in the memory 31 and executed by the processor 30 to accomplish the present application. One or more of the modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 32 in the device 3. For example, the computer program 32 may be divided into functions of the first acquisition module 201, the extraction module 202, the second acquisition module 203, and the control module 204 (modules in the virtual device), and the specific functions of each module are as follows: a first obtaining module 201, configured to obtain an audio signal belonging to music in a scene; an extraction module 202, configured to extract audio features from an audio signal of music; the second obtaining module 203 is configured to obtain a light feature according to a mapping relationship between an audio feature of the audio signal of the music and the light feature; the control module 204 is configured to control the corresponding lamp to change the light according to the light characteristics, and/or control the corresponding video display device to change the video playing mode according to the audio characteristics of the audio signal of the music.
The device 3 may include, but is not limited to, a processor 30, a memory 31. Those skilled in the art will appreciate that fig. 3 is merely an example of a device 3 and does not constitute a limitation of device 3 and may include more or fewer components than shown, or some components in combination, or different components, e.g., a computing device may also include input-output devices, network access devices, buses, etc.
The Processor 30 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 31 may be an internal storage unit of the device 3, such as a hard disk or a memory of the device 3. The memory 31 may also be an external storage device of the device 3, such as a plug-in hard disk provided on the device 3, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. Further, the memory 31 may also include both an internal storage unit of the device 3 and an external storage device. The memory 31 is used for storing computer programs and other programs and data required by the device. The memory 31 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned functions may be distributed as required to different functional units and modules, that is, the internal structure of the apparatus may be divided into different functional units or modules to implement all or part of the functions described above. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the above-mentioned apparatus may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/device and method may be implemented in other ways. For example, the above-described apparatus/device embodiments are merely illustrative, and for example, a module or a unit may be divided into only one logic function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a non-transitory computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above may also be implemented by a computer program to instruct related hardware, where the computer program of the method for controlling a scene in an audio system may be stored in a computer readable storage medium, and when being executed by a processor, the computer program may implement the steps of the embodiments of the methods described above, that is, acquiring an audio signal belonging to music in a scene; extracting audio features from an audio signal of the music; acquiring light characteristics according to the mapping relation between the audio characteristics of the audio signals of the music and the light characteristics; and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics of the audio signal of the music. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The non-transitory computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution media, and the like. It should be noted that the non-transitory computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, non-transitory computer readable media does not include electrical carrier signals and telecommunications signals as subject to legislation and patent practice. The above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application. The above-mentioned embodiments, objects, technical solutions and advantages of the present application are described in further detail, it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present application, and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present application should be included in the scope of the present invention.
Claims (10)
1. A method of audio control of a scene, the method comprising:
acquiring audio signals belonging to music in a scene;
extracting audio features from an audio signal of the music;
acquiring the light characteristics according to the mapping relation between the audio characteristics and the light characteristics;
and controlling the corresponding lamp to change the light according to the light characteristics, and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics.
2. The method of audio controlling a scene of claim 1, wherein said extracting audio features from an audio signal of said music comprises:
performing signal processing on the audio signal segments of the music to obtain a maximum point sequence;
determining a first maximum point and a second maximum point from the maximum point sequence;
and determining the beat in the audio signal according to the sequence position of the first maximum value point and the sequence position of the second maximum value point.
3. The method of audio controlling a scene of claim 1, wherein said extracting audio features from an audio signal of said music comprises:
acquiring the frequency spectrum of each frame of signal in the audio signal of the music;
extracting a low-frequency signal and a high-frequency signal of each frame signal from the frequency spectrum;
if the energy increase of the frame signal is larger than a preset value compared with the low-frequency signal of the previous frame signal, determining that the position of the frame signal has a beat;
and if the energy change of the frame signal is larger than a preset value compared with the high-frequency signal of the previous frame signal, and the energy consistency degree of the high-frequency signal of the frame signal is larger than a preset threshold, determining that the beat occurs at the position of the frame signal.
4. A method for controlling a scene according to the audio frequency of claim 2 or 3, wherein the light characteristics comprise the brightness, the color and/or the shape of the light, and the controlling the corresponding lamps to change the light according to the light characteristics comprises:
generating a control instruction according to the light characteristics and the identification of the lamp;
and controlling the lamps corresponding to the marks of the lamps to change the brightness, color and/or shape of the light according to the control instruction.
5. The method for controlling scenes according to the audio frequency of the claim 2 or 3, characterized in that, the controlling the corresponding video display equipment to change the video playing mode according to the audio frequency characteristics comprises:
determining the change parameters of elements in a playing picture of the video display equipment according to the beat information in the audio signal;
generating a video playing model corresponding to the audio signal according to the variation parameters of elements in a playing picture of the video display device, wherein the beat information comprises the time corresponding to the beat;
and controlling the corresponding video display equipment to change the video playing mode according to the video playing model.
6. The method for audio control of a scene according to claim 5, wherein said determining a variation parameter of an element in a playing picture of said video display device according to beat information in said audio signal comprises:
determining the time corresponding to each beat according to the beat information; and determining the time corresponding to the beat as the time of the sudden change of the playing picture element.
7. The method for audio control of a scene according to claim 5, wherein said determining a variation parameter of an element in a playing picture of said video display device according to beat information in said audio signal comprises:
selecting a playing picture generation model;
determining beat rates and time periods corresponding to the beat rates according to the beat information;
and determining the change period or change frequency of the picture elements contained in the playing picture generation model in each time period according to the beat rate and the corresponding time period.
8. An apparatus for audio control of a scene, the apparatus comprising:
the first acquisition module is used for acquiring audio signals belonging to music in the scene;
an extraction module for extracting audio features from the audio signal of the music;
the second acquisition module is used for acquiring the light characteristics according to the mapping relation between the audio characteristics and the light characteristics;
and the control module is used for controlling the corresponding lamp to change the light according to the light characteristics and/or controlling the corresponding video display equipment to change the video playing mode according to the audio characteristics.
9. An apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110809192.0A CN113573442A (en) | 2021-07-16 | 2021-07-16 | Method, apparatus, and computer-readable storage medium for audio control of scenes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110809192.0A CN113573442A (en) | 2021-07-16 | 2021-07-16 | Method, apparatus, and computer-readable storage medium for audio control of scenes |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113573442A true CN113573442A (en) | 2021-10-29 |
Family
ID=78165306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110809192.0A Pending CN113573442A (en) | 2021-07-16 | 2021-07-16 | Method, apparatus, and computer-readable storage medium for audio control of scenes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113573442A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114375083A (en) * | 2021-12-17 | 2022-04-19 | 广西世纪创新显示电子有限公司 | Light rhythm method, device, terminal equipment and storage medium |
| CN114422846A (en) * | 2021-12-31 | 2022-04-29 | 深圳市智岩科技有限公司 | Lamp effect control method, system, device, electronic equipment and storage medium |
| CN114449705A (en) * | 2022-01-26 | 2022-05-06 | 深圳瑞迪泰科电子有限公司 | Light control system for scooter |
| CN115334099A (en) * | 2022-07-20 | 2022-11-11 | 榜威电子科技（上海）有限公司 | Linkage system, method and storage medium of streaming media audio/video data and lamp |
| CN115520090A (en) * | 2022-11-04 | 2022-12-27 | 北京经纬恒润科技股份有限公司 | Control method and device of light information, storage medium and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6175632B1 (en) * | 1996-08-09 | 2001-01-16 | Elliot S. Marx | Universal beat synchronization of audio and lighting sources with interactive visual cueing |
| CN106304539A (en) * | 2016-08-03 | 2017-01-04 | 杭州电子科技大学 | A kind of music lantern controller design method followed based on rhythm |
| CN108111909A (en) * | 2017-12-15 | 2018-06-01 | 广州市百果园信息技术有限公司 | Method of video image processing and computer storage media, terminal |
| CN108281157A (en) * | 2017-12-28 | 2018-07-13 | 广州市百果园信息技术有限公司 | The detection method of drum beat and computer storage media, terminal in music |
| CN109640465A (en) * | 2018-11-07 | 2019-04-16 | 萤火虫（深圳）灯光科技有限公司 | Lamp light control method, device, equipment and the storage medium of automatic identification music |
-
2021
- 2021-07-16 CN CN202110809192.0A patent/CN113573442A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6175632B1 (en) * | 1996-08-09 | 2001-01-16 | Elliot S. Marx | Universal beat synchronization of audio and lighting sources with interactive visual cueing |
| CN106304539A (en) * | 2016-08-03 | 2017-01-04 | 杭州电子科技大学 | A kind of music lantern controller design method followed based on rhythm |
| CN108111909A (en) * | 2017-12-15 | 2018-06-01 | 广州市百果园信息技术有限公司 | Method of video image processing and computer storage media, terminal |
| CN108281157A (en) * | 2017-12-28 | 2018-07-13 | 广州市百果园信息技术有限公司 | The detection method of drum beat and computer storage media, terminal in music |
| CN109640465A (en) * | 2018-11-07 | 2019-04-16 | 萤火虫（深圳）灯光科技有限公司 | Lamp light control method, device, equipment and the storage medium of automatic identification music |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114375083A (en) * | 2021-12-17 | 2022-04-19 | 广西世纪创新显示电子有限公司 | Light rhythm method, device, terminal equipment and storage medium |
| CN114375083B (en) * | 2021-12-17 | 2024-04-05 | 广西世纪创新显示电子有限公司 | Light rhythm method, device, terminal equipment and storage medium |
| CN114422846A (en) * | 2021-12-31 | 2022-04-29 | 深圳市智岩科技有限公司 | Lamp effect control method, system, device, electronic equipment and storage medium |
| CN114449705A (en) * | 2022-01-26 | 2022-05-06 | 深圳瑞迪泰科电子有限公司 | Light control system for scooter |
| CN115334099A (en) * | 2022-07-20 | 2022-11-11 | 榜威电子科技（上海）有限公司 | Linkage system, method and storage medium of streaming media audio/video data and lamp |
| WO2024016603A1 (en) * | 2022-07-20 | 2024-01-25 | 榜威电子科技（上海）有限公司 | System and method for linking streaming media audio/video data with lamp, and storage medium |
| CN115334099B (en) * | 2022-07-20 | 2024-02-27 | 榜威电子科技（上海）有限公司 | Linkage system, method and storage medium for streaming media audio/video data and lamp |
| CN115520090A (en) * | 2022-11-04 | 2022-12-27 | 北京经纬恒润科技股份有限公司 | Control method and device of light information, storage medium and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113573442A (en) | Method, apparatus, and computer-readable storage medium for audio control of scenes | |
| CN107889323B (en) | Control method and device for light display | |
| JP4260168B2 (en) | Video color preference characteristic conversion device, conversion method, and recording medium | |
| CN107329980B (en) | Real-time linkage display method based on audio and storage device | |
| CN109640465A (en) | Lamp light control method, device, equipment and the storage medium of automatic identification music | |
| CN110444185B (en) | Music generation method and device | |
| CN110461077A (en) | A kind of lamp light control method, Light Control Unit and readable storage medium storing program for executing | |
| CN101252801A (en) | Method and apparatus for controlling light | |
| CN104099750B (en) | The washing machine and generation method of a kind of current generation music | |
| CN101548551A (en) | Ambient lighting | |
| US10222930B2 (en) | Method, apparatus, and storage medium for playing control processing of audio file | |
| CN113597061A (en) | Method, apparatus and computer readable storage medium for controlling a magic color light strip | |
| CN104099748A (en) | Music washing machine and control method | |
| CN102123546A (en) | Full-color acousto-optic conversion control method and system | |
| KR101985880B1 (en) | Display device and control method thereof | |
| CN113727501B (en) | Sound-based light dynamic control method, device, system and storage medium | |
| CN106879111B (en) | A kind of RGBW-LED music lantern based on Bluetooth communication | |
| CN114245528B (en) | Vehicle lamplight show control method, device, equipment, medium and program product | |
| WO2016183980A1 (en) | Image transmission method and device, and terminal apparatus | |
| CN113853047A (en) | Light control method and device, storage medium and electronic equipment | |
| CN111666445A (en) | Scene lyric display method and device and sound box equipment | |
| CN114449713A (en) | Intelligent audio recognition light control system | |
| CN110097618B (en) | Music animation control method and device, vehicle and storage medium | |
| CN116681613A (en) | Illumination-imitating enhancement method, device, medium and equipment for face key point detection | |
| CN115604887A (en) | Atmosphere lamp group control method, control console and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |