CN104464741B - A kind of audio signal turns the method and system of visual color information - Google Patents

A kind of audio signal turns the method and system of visual color information Download PDF

Info

Publication number
CN104464741B
CN104464741B CN201410833247.1A CN201410833247A CN104464741B CN 104464741 B CN104464741 B CN 104464741B CN 201410833247 A CN201410833247 A CN 201410833247A CN 104464741 B CN104464741 B CN 104464741B
Authority
CN
China
Prior art keywords
audio signal
brightness
frame
color
rgb
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410833247.1A
Other languages
Chinese (zh)
Other versions
CN104464741A (en
Inventor
徐永键
陆许明
刘志敏
谭洪舟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SYSU HUADU INDUSTRIAL SCIENCE AND TECHNOLOGY INSTITUTE
Sun Yat Sen University
Original Assignee
SYSU HUADU INDUSTRIAL SCIENCE AND TECHNOLOGY INSTITUTE
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SYSU HUADU INDUSTRIAL SCIENCE AND TECHNOLOGY INSTITUTE, Sun Yat Sen University filed Critical SYSU HUADU INDUSTRIAL SCIENCE AND TECHNOLOGY INSTITUTE
Priority to CN201410833247.1A priority Critical patent/CN104464741B/en
Publication of CN104464741A publication Critical patent/CN104464741A/en
Application granted granted Critical
Publication of CN104464741B publication Critical patent/CN104464741B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Auxiliary Devices For Music (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

The present invention provides the method and system that a kind of audio signal turns visual color information, and method includes S1:Audio signal is sampled;S2:Calculate the brightness V of audio signal;S3:Calculate the form and aspect H and saturation degree S of audio signal;S4:Brightness V, form and aspect H and saturation degree S are subjected to RGB color format conversion;S5:The rgb value obtained in S4 progress blend of colors is finally extracted to the color value of audio signal.The present invention is by by the audio signal quantification treatment of collection, its energy value is calculated to represent brightness, the form and aspect and saturation degree of its representative are calculated by FFT processing, obtained brightness, form and aspect and saturation degree are converted into RGB color format again, whole method is in accordance with the principles of science and calculates deduction, process is all the quantification treatment process of one, the expression of the subjective meaning of nobody, scientific and precise.

Description

A kind of audio signal turns the method and system of visual color information
Technical field
The present invention relates to Audio Signal Processing field, turns visual color information more particularly, to a kind of audio signal Method and system.
Background technology
Music and the fine arts are all the important components of art.Just as drawing needs a variety of colors, the tone color of music It is and diversified.Just the tone color and color of music are linked together in people a long time ago, such as the moral of 17th century Compatriots Ji Xieer, he it is proposed that:Music is the imitation of light, and the two can be expressed each other.This theory was by France later People's John Castle is confirmed that he published in 1720《Music and color》One book, and a kind of " vision was devised in 1734 Ha Puxi Coudés ", i.e., scale is arranged into distribution, an a kind of color of key connection by the position of spectrum, button plays music score, light Just spread out of from transparent color bands.Also there are many scientists, artist even writer music and color contact one later Rise, 1876, famous musician Bo Sakete proposed musicians' acceptable analogy at that time:String music, people Sound --- black;Copper pipe, drum --- it is red;Wooden pipe --- blueness.And conductor Gao get Fu is come the opinion proposed:Flute --- Blueness;Clarinet --- rosiness;Copper pipe --- it is red.This analogy was obtaining the approval of more people at that time, it is apparent that it is With dense personal subjective colo(u)r.18th century, great scientist newton was found that the corpuscular property of light, and then people are again The fluctuation of light is found that, and seven kinds of colors have been separated out by prism:The yellowish green ultramarine of blood orange is purple.So, will with regard to someone Seven sounds and this seven kinds of colors in music connect, and same this corresponding relation is clearly mechanical, not more Big meaning.
Nowadays, contact of the people to music and color has with further insight.Zhongxing Microelectronci Co., Ltd., Beijing A patent《A kind of brightness of music-controlled luminous lamp group and the method for color》In mention, by way of establishing look-up table The contact of music and color is established, every a line of the look-up table is stored with the control parameter of one group of electroluminescent lamp, described luminous The control parameter of lamp is corresponding with color that multicolor light-emitting lamp group is shown and brightness.Obviously, this corresponding relation is limited to be A kind of less rigorous consistent relationship.《Harbin University of Science and Technology's journal》The 6th phase paper of volume 18《Based on audio signal frequency spectrum The design of mixing light efficiency and realization of analysis》In mention:" for RGB mixing light efficiencies, can substantially it observe in different frequencies Under, under different amplitudes, the color and light intensity of light are different, are formed here it is the different duty that make use of PWM." but It does not have labor music(Audio signal)Specific mapping relations between color.Analyzed based on more than, the present invention The colorization effect of music from extraction of music colouring information, will be realized according to the time and frequency domain analysis of simulated audio signal.
Until the artist of Today, most is that music and color are linked together according to the emotional factor of people , but this is a not effective regular mapping method.With scientific technological advance, people have to sound and light New understanding, although sound belongs to mechanical wave, light wave belongs to electromagnetic wave, and they have all characteristics of ripple, such as:It can produce Phenomena such as reflection, refraction, interference, diffraction.In addition, they have some base attributes of ripple, such as:Velocity of wave, wavelength, frequency it Between relation, we easily will link together the frequency of the frequency of sound and light.For example the ear of people can be listened To the frequency range of sound relate to the frequency range of visible ray, seven kinds of colors pair have most typically been separated out from white light Seven basic scales are answered, this mapping relations are that have certain reason, and it has generally conformed to the corresponding relation of tone color and color, but This mapping relations are limited, and not rigorous enough.
The content of the invention
The present invention provides the method that a kind of rigorous audio signal of mapping relations turns visual color information.
A further object of the present invention is to provide the system that a kind of audio signal turns visual color information.
In order to reach above-mentioned technical purpose, technical scheme is as follows:
A kind of method that audio signal turns visual color information, comprises the following steps:
S1:Audio signal is sampled;
S2:Calculate the brightness V of audio signal;
S3:Calculate the form and aspect H and saturation degree S of audio signal;
S4:Brightness V, form and aspect H and saturation degree S are subjected to RGB color format conversion;
S5:The rgb value obtained in S4 progress blend of colors is finally extracted to the color value of audio signal.
Further, the audio signal in the step S1 includes simulated audio signal and digital audio and video signals;
The process sampled to simulated audio signal is as follows:
It is a frame signal that N number of point is sampled in unit interval T, N=2M, M is positive integer;
The process sampled to digital audio and video signals is as follows:
Resampling is carried out to digital audio and video signals, sampling is increased according to the sample rate of audio and the selection of the frequency of resampling or subtracted Multiple is sampled, obtains the sampled signal that N number of point in unit interval T is a frame, N=2M, M is positive integer.
Further, the process that the brightness V of audio signal is calculated in the step S2 is as follows:
The average energy of audio signal in unit interval T:
If the ceiling capacity of audio signal is Emax, brightness V corresponding to a frame sampling signal:
Further, the process of the step S3 is as follows:
Real-time FFT is carried out to the audio signal after sampling and obtains the audible spectrum of a frame audio signal, makes frame audio frequency In spectrumiThe frequency of individual sampled point isf i , the form and aspect of the sampled pointH i For:
Make amplitude in a frame audible spectrumFMaximum beF max , minimum value isF min , in a frame audible spectrumiIt is individual to adopt The color saturation of sampling pointS i With amplitudeF i Relation be:
Further, the process of the step S4 is as follows:
Color vector (the R of ith sample point in one frame audible spectrumi,Gi,Bi) be:
Further, the process of the step S5 is as follows:
The RGB of N number of sampled point average value is in one frame audible spectrum:
A kind of audio signal turns visual color information system, including:
Signal sampling module, for gathering simulated audio signal or digital audio and video signals;
Brightness value computing module, for calculating the brightness value V of the audio signal collected;
Form and aspect and saturation computation module, for calculating the form and aspect H and saturation degree S of the audio signal collected;
HSV turns RGB block, for brightness V, form and aspect H and saturation degree S to be carried out into RGB color format conversion;
RGB color mixing module, it is final that the obtained rgb value for turning to obtain HSV in RGB block carries out blend of colors Extract the color value of audio signal.
Compared with prior art, the beneficial effect of technical solution of the present invention is:
The present invention is by by the audio signal quantification treatment of collection, calculating its energy value to represent brightness, at FFT Manage to calculate the form and aspect and saturation degree of its representative, then obtained brightness, form and aspect and saturation degree are converted into RGB color format, it is whole Individual method is in accordance with the principles of science and calculates deduction, and process is all the quantification treatment process of one, the subjective meaning of nobody Expression, scientific and precise.
Brief description of the drawings
Fig. 1 is the inventive method general flow chart;
Fig. 2 is the inventive method sampled audio signal flow chart;
Fig. 3 is that the inventive method asks for audio signal form and aspect and saturation degree flow chart;
Fig. 4 is visible spectrum and the hue circle corresponding diagram after cutting;
Fig. 5 is present system structure chart.
Embodiment
Accompanying drawing being given for example only property explanation, it is impossible to be interpreted as the limitation to this patent;
In order to more preferably illustrate the present embodiment, some parts of accompanying drawing have omission, zoomed in or out, and do not represent actual product Size;
To those skilled in the art, it is to be appreciated that some known features and its explanation, which may be omitted, in accompanying drawing 's.
Technical scheme is described further with reference to the accompanying drawings and examples.
Embodiment 1
As shown in figure 1, a kind of audio signal turns the method for visual color information, comprise the following steps:
S1:Audio signal is sampled;
S2:Calculate the brightness V of audio signal;
S3:Calculate the form and aspect H and saturation degree S of audio signal;
S4:Brightness V, form and aspect H and saturation degree S are subjected to RGB color format conversion;
S5:The rgb value obtained in S4 progress blend of colors is finally extracted to the color value of audio signal.
In the present embodiment, as shown in Fig. 2 the audio signal in step S1 includes simulated audio signal and DAB is believed Number;
The process sampled to simulated audio signal is as follows:
Sampled in unit interval TNIndividual point is a frame signal,N=2 M ,MFor positive integer;
The process sampled to digital audio and video signals is as follows:
Resampling is carried out to digital audio and video signals, sampling is increased according to the sample rate of audio and the selection of the frequency of resampling or subtracted Multiple is sampled, is obtained in unit interval TNIndividual point is the sampled signal of a frame,N=2 M ,MFor positive integer.
In the present embodiment, the process that the brightness V of audio signal is calculated in step S2 is as follows:
The average energy of audio signal in unit interval T:
If the ceiling capacity of audio signal is Emax, brightness V corresponding to a frame sampling signal:
In the present embodiment, as shown in figure 3, step S3 process is as follows:
Real-time FFT is carried out to the audio signal after sampling and obtains the audible spectrum of a frame audio signal, for real-time sampling A frameNPoint signalu(n) carry out FFT:
Because the eyes of people can only see visible spectrum, it is about 780nm-380nm to change to violet wavelength regions by red, Respective frequencies scope is 430THz-750THz.But the color that human eye can be seen all might not fall on visible spectrum, such as Aubergine, but it can be mixed according to a certain percentage with red (R) and blue (B).In order to preferably reflect audible sound Frequency range and the corresponding relation of visible spectrum, and the corresponding relation of audio range and mensurable colourity, such as Shown in Fig. 4, the present embodiment complete hue circle (0 ~ 360 °) will be divided into corresponding 0 ~ 270 ° of form and aspect originally, i.e., from red to purple Eliminate 270 ° ~ 360 ° of " purple color part " and so just meet color possessed by visible spectrum.
Make in a frame audible spectrumiThe frequency of individual sampled point isf i, the form and aspect of the sampled pointH i For:
Make amplitude in a frame audible spectrumFMaximum beF max , minimum value isF min , in a frame audible spectrumiIt is individual to adopt The color saturation of sampling pointS i With amplitudeF i Relation be:
In the present embodiment, rgb color pattern is a kind of color standard of industrial quarters, is by red (R), green (G), indigo plant (B) change of three Color Channels and their mutual superpositions obtain miscellaneous color, and RGB is to represent The color of three passages of red, green, blue, this standard almost include all colours that human eyesight can perceive, and are to transport at present With one of most wide color system.
It is a kind of color mode defined from the angle of vision and HSV is based on identification of the eyes of people to color.Being will Color separation is tone, saturation degree and brightness.By adjusting tone, saturation degree and brightness obtain color and change.Therefore, this reality Applying example will link together to the direct feel of music and the color of HSV patterns.But in order to give full expression to all combinations Color, while for convenience " blend of colors " as described below, HSV patterns are switched to the color standard of industrial quarters in the present embodiment RGB color:
In one frame audible spectrumiColor vector (the R of individual sampled pointi,Gi,Bi) be:
In the present embodiment, different form and aspect that the audio signal within the unit interval is included, saturation degree, the color of brightness Information carries out blend of colors, and a frame audio signal is askedNThe RGB of individual point average value:
This method is by by the audio signal quantification treatment of collection, calculating its energy value to represent brightness, at FFT Manage to calculate the form and aspect and saturation degree of its representative, then obtained brightness, form and aspect and saturation degree are converted into RGB color format, it is whole Individual method is in accordance with the principles of science and calculates deduction, and process is all the quantification treatment process of one, the subjective meaning of nobody Expression, scientific and precise.
Embodiment 2
As shown in figure 5, a kind of audio signal turns visual color information system, including:
Signal sampling module, for gathering simulated audio signal or digital audio and video signals;
Brightness value computing module, for calculating the brightness value V of the audio signal collected;
Form and aspect and saturation computation module, for calculating the form and aspect H and saturation degree S of the audio signal collected;
HSV turns RGB block, for brightness V, form and aspect H and saturation degree S to be carried out into RGB color format conversion;
RGB color mixing module, it is final that the obtained rgb value for turning to obtain HSV in RGB block carries out blend of colors Extract the color value of audio signal.
Same or analogous label corresponds to same or analogous part;
Position relationship is used for being given for example only property explanation described in accompanying drawing, it is impossible to is interpreted as the limitation to this patent;
Obviously, the above embodiment of the present invention is only intended to clearly illustrate example of the present invention, and is not pair The restriction of embodiments of the present invention.For those of ordinary skill in the field, may be used also on the basis of the above description To make other changes in different forms.There is no necessity and possibility to exhaust all the enbodiments.It is all this All any modification, equivalent and improvement made within the spirit and principle of invention etc., should be included in the claims in the present invention Protection domain within.

Claims (4)

1. a kind of method that audio signal turns visual color information, it is characterised in that comprise the following steps:
S1:Audio signal is sampled;
S2:Calculate the brightness V of audio signal;
S3:Calculate the form and aspect H and saturation degree S of audio signal;
S4:Brightness V, form and aspect H and saturation degree S are subjected to RGB color format conversion;
S5:The rgb value obtained in S4 progress blend of colors is finally extracted to the color value of audio signal;
Wherein, audio signal includes simulated audio signal and digital audio and video signals;
The process sampled to simulated audio signal is as follows:
It is a frame signal that N number of point is sampled in unit interval T, N=2M, M is positive integer;
The process sampled to digital audio and video signals is as follows:
Resampling is carried out to digital audio and video signals, sampling is increased according to the sample rate of audio and the selection of the frequency of resampling or subtracts sampling Multiple, obtain the sampled signal that N number of point in unit interval T is a frame, N=2M, M is positive integer;
The brightness V of audio signal process is as follows:
The average energy of audio signal in unit interval T:
Wherein,u(n) it is the frame sampledNPoint signal;
If the ceiling capacity of audio signal is Emax, brightness V corresponding to a frame sampling signal:
Real-time FFT is carried out to the audio signal after sampling and obtains the audible spectrum of a frame audio signal, is made in a frame audible spectrum The frequency of ith sample point isf i , the form and aspect H of the sampled pointiFor:
The maximum for making amplitude F in a frame audible spectrum is Fmax, minimum value is Fmin, ith sample point in a frame audible spectrum Color saturation SiWith amplitude FiRelation be:
2. the method that audio signal according to claim 1 turns visual color information, it is characterised in that the step S4's Process is as follows:
Color vector (the R of ith sample point in one frame audible spectrumi,Gi,Bi) be:
3. the method that audio signal according to claim 2 turns visual color information, it is characterised in that the step S5's Process is as follows:
The RGB of N number of sampled point average value is in one frame audible spectrum:
4. the system that a kind of audio signal realized as described in claim any one of 1-3 turns visual color information approach, it is special Sign is, including:
Signal sampling module, for gathering simulated audio signal or digital audio and video signals;
Brightness value computing module, for calculating the brightness value V of the audio signal collected;
Form and aspect and saturation computation module, for calculating the form and aspect H and saturation degree S of the audio signal collected;
HSV turns RGB block, for brightness V, form and aspect H and saturation degree S to be carried out into RGB color format conversion;
RGB color mixing module, the obtained rgb value for turning to obtain HSV in RGB block carry out blend of colors and finally extracted The color value of audio signal.
CN201410833247.1A 2014-12-29 2014-12-29 A kind of audio signal turns the method and system of visual color information Active CN104464741B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410833247.1A CN104464741B (en) 2014-12-29 2014-12-29 A kind of audio signal turns the method and system of visual color information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410833247.1A CN104464741B (en) 2014-12-29 2014-12-29 A kind of audio signal turns the method and system of visual color information

Publications (2)

Publication Number Publication Date
CN104464741A CN104464741A (en) 2015-03-25
CN104464741B true CN104464741B (en) 2018-04-06

Family

ID=52910686

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410833247.1A Active CN104464741B (en) 2014-12-29 2014-12-29 A kind of audio signal turns the method and system of visual color information

Country Status (1)

Country Link
CN (1) CN104464741B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105205304A (en) 2015-06-30 2015-12-30 胡国生 Color synaesthesia visualizing method for music
CN108541098B (en) * 2018-01-29 2019-12-27 杭州电子科技大学 Music lighting system based on audio difference value tone extraction method
CN112857560B (en) * 2021-02-06 2022-07-22 河海大学 Acoustic imaging method based on sound frequency
CN113766695A (en) * 2021-08-25 2021-12-07 北京奕斯伟计算技术有限公司 Brightness control method, chip and system of LED lamp
CN114416610B (en) * 2021-12-02 2023-11-10 深圳市乐升半导体有限公司 PWM signal generation method, chip and electronic equipment
CN114828337B (en) * 2022-07-01 2022-09-27 杭州罗莱迪思科技股份有限公司 Control method and application of outdoor LED dyeing lamp

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1229759C (en) * 1999-08-18 2005-11-30 哈茉尼彩色音技术开发公司 Method and appats. for electing harmonic color using harmonics, and method and appts. for converting sound to color or color to sound
CN1977569A (en) * 2004-06-30 2007-06-06 皇家飞利浦电子股份有限公司 Ambient lighting derived from video content and with broadcast influenced by perceptual rules and user preferences
CN101916569A (en) * 2010-08-03 2010-12-15 北京中星微电子有限公司 Method and device for displaying sound
CN102096822A (en) * 2010-12-24 2011-06-15 华为终端有限公司 Color discrimination method and device
CN102289778A (en) * 2011-05-10 2011-12-21 南京大学 Method for converting image into music
CN103685683A (en) * 2012-09-03 2014-03-26 中兴通讯股份有限公司 Voice scrawling implementation method, device and terminal
JP2014095905A (en) * 2013-12-04 2014-05-22 Seiko Epson Corp Display device, program, and information storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080183474A1 (en) * 2007-01-30 2008-07-31 Damion Alexander Bethune Process for creating and administrating tests made from zero or more picture files, sound bites on handheld device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1229759C (en) * 1999-08-18 2005-11-30 哈茉尼彩色音技术开发公司 Method and appats. for electing harmonic color using harmonics, and method and appts. for converting sound to color or color to sound
CN1977569A (en) * 2004-06-30 2007-06-06 皇家飞利浦电子股份有限公司 Ambient lighting derived from video content and with broadcast influenced by perceptual rules and user preferences
CN101916569A (en) * 2010-08-03 2010-12-15 北京中星微电子有限公司 Method and device for displaying sound
CN102096822A (en) * 2010-12-24 2011-06-15 华为终端有限公司 Color discrimination method and device
CN102289778A (en) * 2011-05-10 2011-12-21 南京大学 Method for converting image into music
CN103685683A (en) * 2012-09-03 2014-03-26 中兴通讯股份有限公司 Voice scrawling implementation method, device and terminal
JP2014095905A (en) * 2013-12-04 2014-05-22 Seiko Epson Corp Display device, program, and information storage medium

Also Published As

Publication number Publication date
CN104464741A (en) 2015-03-25

Similar Documents

Publication Publication Date Title
CN104464741B (en) A kind of audio signal turns the method and system of visual color information
CN1229759C (en) Method and appats. for electing harmonic color using harmonics, and method and appts. for converting sound to color or color to sound
CN107437073A (en) Face skin quality analysis method and system based on deep learning with generation confrontation networking
CN102123546A (en) Full-color acousto-optic conversion control method and system
CN107024987A (en) A kind of real-time human brain Test of attention and training system based on EEG
CN107204034B (en) A kind of image processing method and terminal
CN105657901B (en) Audio-video signal and lamp light control system
EA200600324A1 (en) SYSTEM AND METHOD FOR JOINT VISUALIZATION OF THE SET OF ATTRIBUTES IN REAL TIME
CN102231281B (en) Voice visualization method based on integration characteristic and neural network
WO2017119915A1 (en) Method and apparatus for converting audio data into a visual representation
CN109886214A (en) A kind of chirm characteristic strengthening method based on image procossing
KR20150112048A (en) music-generation method based on real-time image
CN108960250A (en) Image is to the conversion method of melody, device and computer readable storage medium
CN105810226B (en) A kind of method and system of control musical effect
CN108459714A (en) Few channel asynchronous controlling brain machine interface system based on the bis- normal forms of MI and SSVEP
CN106061044B (en) A kind of intelligent lamp control method and control system based on DTMF patterns
CN108541098A (en) The music lighting system of tone method is extracted based on audio difference value
Bologna et al. On the use of the auditory pathway to represent image scenes in real-time
CN107742280A (en) A kind of image sharpening method and device
CN105678208B (en) Method and device for extracting face texture
Bologna et al. Blind navigation along a sinuous path by means of the See ColOr interface
Pun et al. Sonification of colour and depth in a mobility aid for blind people
EP3678369A1 (en) Image processing method and device
CN107423765A (en) Based on sparse coding feedback network from the upper well-marked target detection method in bottom
CN205902039U (en) Luminance is along with isolychn of music regular movements

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant