CN107135578B - Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology - Google Patents

Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology Download PDF

Info

Publication number
CN107135578B
CN107135578B CN201710429403.1A CN201710429403A CN107135578B CN 107135578 B CN107135578 B CN 107135578B CN 201710429403 A CN201710429403 A CN 201710429403A CN 107135578 B CN107135578 B CN 107135578B
Authority
CN
China
Prior art keywords
music
chord
light
color
lamp
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710429403.1A
Other languages
Chinese (zh)
Other versions
CN107135578A (en
Inventor
陈炜
卡塔琳娜·比尔杰明
任浩冉
袁心宇
王天
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fudan University
Original Assignee
Fudan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fudan University filed Critical Fudan University
Priority to CN201710429403.1A priority Critical patent/CN107135578B/en
Publication of CN107135578A publication Critical patent/CN107135578A/en
Application granted granted Critical
Publication of CN107135578B publication Critical patent/CN107135578B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05BELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B45/00Circuit arrangements for operating light-emitting diodes [LED]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78Detection of presence or absence of voice signals
    • G10L25/81Detection of presence or absence of voice signals for discriminating voice from music
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense

Abstract

The invention belongs to the technical field of wireless lamp control, and particularly relates to an intelligent music chord-atmosphere lamp system based on a TonaLighting adjusting technology. The system comprises a hardware lamp control part and a software analysis part, wherein the hardware lamp control part comprises: a controller, an LED lamp; the software analysis part is a TonaLigighting program system which automatically identifies and classifies chord tones and marks the occurrence moments of the chord tones; then according to the scheme of 'TonalColor', determining the RGB combination corresponding to the marked chord tones, simultaneously reading the music segment, the chord occurrence time list and the music chord-RGB combination list, obtaining a light control instruction, transmitting the light control instruction to a light control part controller, and controlling the light color to change in real time along with the change of music; and the color of the LED light is changed according to the control command. The invention can be applied to different entertainment scenes, entertainment teaching and music treatment of patients with autism, cerebral apoplexy, cerebral injury, botanic people and other nerve diseases.

Description

Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology
Technical Field
The invention belongs to the technical field of wireless lamp control, and particularly relates to an intelligent music chord-atmosphere lamp system.
Background
The music visualization is to combine color and sound together, and the two complement each other from the physical angle and have commonality. Music and light are combined together, so that the music expression form is richer, and the intelligent music-light adjusting equipment enables the music to have a visual function. In the aspect of intelligent light adjustment, a mature product is the philips HUE system. It is connected to the home network through a router to form a network bridge, and realizes wireless remote control of the lamp matched with the HUE system. The light control system comprises intelligent light control, away-from-home control, light planning, comfortable brightness control and awakening functions.
The HUE system itself can only dynamically adjust the light. In order to realize the combination of music and light, several types of application programs based on the HUE platform can realize the control of HUE or atmosphere light according to the music being played on the market, and most of the applications are suitable for iOS. [1]
Some applications utilize an audio processor, such as the "Realtime LightFX" algorithm of the "Ambify" application [2], to visualize music in real time with dynamic compensation and random variations in lighting. The HUE's "Disco" application [3] has the characteristics of "Adaptive lighting", "Mood", and "Strobe", and has the functions of recognizing external audio output by using a mobile phone microphone, selecting lighting Mood according to music being played, and generating a flashing effect. The 'Beat Bulb' application software [4] based on the iOS system accesses an iPod music library by using an intelligent Beat detection algorithm and changes five light colors according to the music rhythm. And the "Huegasm" application [5] controls and synchronizes the Philips HUE light and music rhythm. The "MagicHue" application [6] uses a microphone to convert input music or sound into various light effects.
Other applications provide the user with various light effects that can be preset, such as "danning-HUE-light" [7], which utilize fifteen light effects, synchronized with HUE, color saturation and shade of the HUE light according to the musical tone, bass and treble in the user or iTunes playlist. The "Hue Music" application [8] adapted to iOS alters the room atmosphere from Music. While the "Hue Fun" application [9] has many possibilities, such as selecting color range, color saturation, switching speed and brightness, controlling the lights independently or in groups, selecting and controlling on the screen, using party mode and letting music control the lights, and "cross fade" function to fade the lights from one color to another. The "HouseParty" application [10] has a schema for creating fully customizable colors, with 10 preset color combinations, over one billion possible custom color combinations. The "HueUSE" application [11] allows the user to select audio and light patterns. The "Hue Party" application [12] has features of light presentation, brightness control, saturation and transition time, flashing, candle twitter, flow and movement patterns with music. The "Hue SPA LITE" application [13] provides five modes in which ambience lights may be interacted with songs from a personal music library. The "Light DJ Pro" application [14] can interface control Philips HUE and LIFX lighting, including effect buttons that provide the user with quick access to lighting effects, and up to 11 custom colors, adding Pro controller add-on functionality to LIFX. The "muesic" application has the capability of automatically adjusting lighting effects to suit the song type and animation, creating a relaxing or entertaining atmosphere with multiple effects for the user to select. The "Splyce" application has a variety of lighting effects for the user to select. The "Ultimate Party Button" application allows the user to select light effects by pressing keys.
All of the above mentioned applications can only control the philips HUE light system by means of the music tempo. In addition, none of these applications send commands to control light changes based on musical chords or other complex musical features. By utilizing the combined action of music and light, the emotion of a person can be improved, the purpose of psychotherapy is achieved, and the intelligent music-light equipment can play different functions and roles according to different application scenes.
Reference documents:
[1]http://www.makeuseof.com/tag/8-fabulous-apps-philips-hue-lights/
[2]http://getambify.com/iOS.html
[3]https://itunes.apple.com/us/app/hue-disco/id581258186 mt=8
[4]http://apps4hue.com/product/beat-bulb/
[5]http://apps4hue.com/product/huegasm/
[6]http://apps4hue.com/product/magichue-the-disco-effect-and-color-fading-app-for-philips-hue/
[7]http://apps4hue.com/product/dancing-hue-light/
[8]http://apps4hue.com/product/hue-music/
[9]http://apps4hue.com/product/hue-fun/
[10]http://apps4hue.com/product/houseparty-light-pattern-programmer-for-lifx-hue/
[11]http://apps4hue.com/product/huemuse/
[12]http://apps4hue.com/product/hue-party-for-philips-hue-and-lifx/
[13]http://apps4hue.com/product/hue-spa-lite-for-philips-hue/
[14]http://apps4hue.com/product/light-dj-pro-light-show-creator-for-lifx-philips-hue/
[15]http://ebooks.iospress.nl/volumearticle/45193
[16]WORLDSEMI, 28085-WS2812B-RGB-LED Datasheet。
disclosure of Invention
The invention aims to provide a novel intelligent music chord-atmosphere lamp system with a chord automatic identification function.
The intelligent music chord-atmosphere lamp system comprises a hardware lamp control part and a software analysis part, and the structural block diagram of the intelligent music chord-atmosphere lamp system is shown in figure 1. The software analysis part is a TonaLigighting program system which firstly pre-analyzes the chord neutralizing structure in the music segment by a music retrieval technology and a machine learning algorithm, automatically identifies chord tones and marks the occurrence time of the chord tones; then according to the scheme of 'TonalColor', determining the RGB combination corresponding to the marked chord tones, simultaneously reading the music segments, the chord occurrence time list and the music chord-RGB combination list, obtaining a light control instruction, transmitting the light control instruction to a light control part, and controlling the color of the LED light to change in real time along with the change of the music; the hardware lamp control part comprises: the LED display device comprises a controller, a Bluetooth module, a power module, an annular LED lamp set, an OLED display screen, an SD storage module and a loudspeaker, and the structural block diagram of the LED display device is shown in FIG. 5. The controller mainly drives the Bluetooth module through the core processor, receives the control command sent by the software analysis part in a wireless mode, and changes the color of the LED light according to the control command; the upper computer synchronously transmits the audio information while sending the control command, and the Bluetooth module in the lamp control system stores the received audio information and control information into the SD card, so that the system can be directly applied by a user subsequently; when the user plays the same music for the second time, the stored music information can be selected by the keys through the prompt in the OLED screen, and the lamp control system is directly controlled.
The system utilizes the music retrieval technology and the machine learning algorithm to automatically identify and classify the special chords in the music segments, further generates the lamp control command to realize the change of the atmosphere lamp color, and finally achieves the purpose of audio-visual feeling with entertainment effect or music treatment on patients with nervous system diseases. When the system is applied to music treatment of a patient, the system is fed back and a treatment scheme is adjusted according to analysis of electroencephalogram signals of the patient, so that personalized treatment of the patient is realized.
In the invention, the TonaLigighting program system replaces an application program which randomly controls light change according to music beats in the existing music-light technology, changes light in a structured mode based on a music theory, and follows a more complicated music chord analysis method and a personalized music chord-light combination scheme.
The "TonaLighting" program system is executed by first completing the automatic identification and classification of chords. The specific process is as follows:
first, a large number of pieces of music, of the type including pop, classical, jazz, etc., and music played by different instruments, are pre-analyzed by a music specialist. Music chords are manually extracted, and a series of samples are obtained to serve as a machine learning data set.
Secondly, extracting characteristic parameters of the chords in the data set, wherein the characteristic parameters mainly comprise time domain characteristics, frequency domain characteristics and sound spectrum characteristics.
And finally, training the data set by using a machine learning algorithm to obtain a training model, and inputting the song to be identified into the trained classifier so as to obtain chord information of the song.
In the invention, after the TonaLighting program system completes automatic identification and classification of the chords, the chord occurrence time is labeled to obtain a chord time list.
In the invention, a TonaLigighting program system acquires a chord-RGB combined list according to a TonaLColor relation scheme. It associates musical chords and spectral colors in a unique way. Unlike the traditional pitch-spectral relationship, the "Tonallighting" procedure makes up the deficiency of strictly defining a color to associate with a given pitch phase, making the choice of pitch and musical association more personalized, by assigning the corresponding color according to the distance of the pitch from the primary note (i.e., the key). In particular, the key of a piece of music may be assigned a basic color, while the fifth note relative to the scale (i.e. the tonic) is given a color complementary to the key, since the opposite position of the color spectrum also reflects the opposite function of the key in the tone to the tonic. The chord-spectrum relationship is shown in fig. 2. In addition, on the basis of meeting the color distribution of the chromatogram, the initial corresponding relation between the key and the basic color can be customized by a user, so that the personalized design of the light color change can be realized according to the preference of the user.
In the invention, a TonaLighting program system generates a light control command according to a music segment and two file lists generated when the program is operated, namely a chord appearance time list and a chord-RGB color combination list, by combining an RGB spectrogram in the program, and sends the control command to a lamp control system by using Bluetooth at a PC end.
In the invention, the software part is executed in a TonaLigighting program at the PC end, and the hardware part is realized by a lamp control system.
In the invention, the power module of the lamp control system provides two power supply modes for the lamp control system, one mode is 5V power supply, and the other mode is 3.7V rechargeable lithium battery power supply.
In the invention, the WS2812 intelligent external control integrated light source [16] is selected as the annular LED lamp assembly, and the structure of the annular LED lamp assembly is shown in figure 6. The LED lamps adopt a mixed light model, are displayed in a circular ring arrangement structure (see fig. 7), and respectively adopt 16 LED lamps of red, green and blue, and totally 48 LED lamps, that is, 16 intelligent external control LED light sources, and the arrangement structure is shown in fig. 4. Each red, green and blue LED monochromatic lamp forms an LED RGB unit to realize color change in 256 colors; the three primary colors are added and mixed in different proportions to realize different color mixing effects; the system adopts pulse width modulation for dimming, and the duty ratio of the pulse signal is adjusted to adjust the current, so that the change of the LED light intensity is realized. In addition, the RGB color variation ranges are all 0 to 255, and different color mixing results can be achieved by performing additive mixing of three primary colors in different proportions, thereby achieving a mixed light effect (see fig. 8).
In the invention, the SD card realizes the memory function of the played music, and the audio information and the control information received by the Bluetooth module are stored, so that the user can conveniently access the music again.
In the invention, the core controller drives the OLED display module to display music information, and guides a user to select played music through prompt information.
In the invention, the audio information and the control information stored in the SD card are read, the music playing function is realized by externally connecting a loudspeaker through an analog signal output port, and the color change of the LED light is controlled.
The present invention extends from pop music or electronic music to music having a complicated structure, such as classical music or music in which complicated chords are a major component. Since structural musical elements of harmony can also convey a complex musical semantic content, the atmosphere light is selected to make harmony visualization generate more complex cognitive stimuli. Due to the characteristics, the system can be applied to the research of music on influencing the nerve function, because music with rich semantic and structural contents provides more complex neurocognitive stimulation, and further more complex brain processing is generated, so that more functional areas for processing music contents in the cerebral cortex are activated, and the functional areas are mainly reflected in the change of the electrical activity of the cerebral cortex. Monitoring neurophysiological measurements using electroencephalography (EEG) as a means of detection[15]The research result proves that the electrical activity of different areas of the cerebral cortex of the subject changes, and the frequency range of the electrical activity of the area responsible for special functions changes obviously. In addition, the personalized music chord-atmosphere lamp system can be applied to landscape, stage lighting, automotive interior and the like. Thus, the invention can be applied to different entertainment scenarios and to selfMusical therapy for patients with other neurological disorders such as Autism (ASD), Stroke (Stroke), brain injury (TBI), botanicals (VS), and the like.
The invention has the technical effects that:
1. the system is a scheme for reflecting music chord change based on light color change in the capital, and is expanded from popular music or electronic music to music with a complex structure, such as classical music or music with complex chords as main components;
2. identifying and classifying chords in music analysis automatically by applying a music information retrieval technology and a machine learning algorithm;
3. the 'TonalColor' relation scheme enables the corresponding relation between the chord and the spectrum to be more flexible and is not limited to the strict limitation of specific tone and the specified spectrum color;
4. because structural music elements of harmony can also convey a complex music semantic content, the chord is visualized by utilizing the atmosphere lamp, more complex cognitive stimulation is generated, and therefore, the functional area for processing the auditory sense and the visual sense in the cerebral cortex is activated, the effect of music therapy is achieved, and the music auxiliary therapeutic device can be used for preparing music auxiliary therapeutic devices for various diseases (such as rehabilitation therapy). For example, it is used for music-assisted therapy of patients with other neurological diseases such as Autism (ASD), Stroke (Stroke), brain injury (TBI), and botanic humans (VS).
Drawings
FIG. 1 is a block diagram of an intelligent musical chord-atmosphere light for use in a musical therapy setting.
FIG. 2 is a visual representation of chord positions in a spectrum according to the "TonalColor" relationship scheme.
Fig. 3 is a frame structure of a "TonalLighting" program for automatically implementing a music-light relation scheme using a machine learning algorithm.
FIG. 4 is a diagram of test environment and effects.
Fig. 5 is a block diagram of a lamp control system.
Fig. 6 shows a WS2812 intelligent external control integrated light source structure.
Fig. 7 shows a mixed light model of LED lamp-ring arrangement.
Fig. 8 shows the LED mixed light effect.
Detailed Description
The intelligent music chord-atmosphere lamp system provided by the invention obtains information in a music section through a unique music chord retrieval mode, automatically identifies chords by a TonaLighting program, obtains a music chord-spectrum combination list by utilizing a TonaLColor scheme, simultaneously reads the music section, a time list and the music chord-spectrum relation combination list to generate a control command, sends the control command to a lamp control system through a Bluetooth wireless transmission mode, receives the control command by a hardware system, and controls the change of the brightness and the color of lamplight, thereby finally realizing the consistent change of the music and the lamplight. The upper computer transmits the control command and simultaneously transmits the audio information synchronously, and the Bluetooth module in the lamp control system stores the received audio information and control information into the SD card, so that the subsequent direct application of the system by a user is facilitated. When the user plays the same music for the second time, the stored music information can be selected by the keys through the prompt in the OLED screen, and the lamp control system is directly controlled. The method comprises the following steps of: a software analysis system and a hardware control system.
The implementation of the software analysis system first requires a pre-analysis of the piece of music to be done. Different types of music and music played by different instruments produce different chord effects, and a large number of music pieces are pre-analyzed by a music specialist, wherein the types of the music pieces comprise pop music, classical music, jazz music and the like, and the music played by different instruments.
Firstly, rhythm detection (beat detect) is carried out on an MP3 file containing music segments to obtain basic beat numbers and speed information of the music segments, and since chord changes appear between bars or between partial beats and the expression mode of mapping the time-whole music segments to the beat-treble is beneficial to analyzing the chord, the music segments need to be divided into bars according to the beats.
Secondly, the music segments which are divided again according to the beat are analyzed for the chord, and a special chord combination is obtained.
Then, music characteristics are extracted from the obtained chord combination according to the music theory and physical characteristics of the music, and the extracted chord combination mainly comprises time domain characteristics and frequency domain characteristics. The method comprises the steps of mapping each music fragment to a frequency domain after preprocessing and discrete Fourier transform, and extracting characteristic parameters such as a sound spectrum Centroid (Spectral center), sound spectrum attenuation (Spectral roll-off), spectrum Flatness (Spectral Flatness Measure), Peak-to-average ratio (Peak-to-average ratio), and Spectral flux (Spectral flux).
And finally, training the data set by using a machine learning algorithm to obtain a training model, judging and classifying the chord by using a Support Vector Machine (SVM) classification method in the invention, and inputting the song to be identified into a trained classifier so as to obtain the chord identification rate of the song.
And marking the chord appearance time to obtain a chord time list after the TonaLigighting program finishes the automatic identification and classification of the chords.
The tonallighting "program contains a" TonalColor "relationship scheme according to which a chord-RGB combination list is obtained that associates musical chords with spectral colors in a unique way. Unlike the traditional pitch-spectral relationship, the "Tonallighting" procedure makes up the deficiency of strictly defining a color to associate with a given pitch phase, making the choice of pitch and musical association more personalized, by assigning the corresponding color according to the distance of the pitch from the primary note (i.e., the key). In particular, the key of a piece of music may be assigned a basic color, while the fifth note relative to the scale (i.e. the tonic) is given a color complementary to the key, since the opposite position of the color spectrum also reflects the opposite function of the key in the tone to the tonic. It is assumed that the key corresponds to the orange color, the attorney notes correspond to the blue color complementary to the orange color, and the other levels are assigned different colors according to their own function and relative distance from the key. This scheme is the basis for the "TonalLighting" program to assign different colors to different sound levels. In addition, on the basis of meeting the color distribution of the chromatogram, the initial corresponding relation between the key and the basic color can be defined by a user, for example, if the initial color preferred by the user A is red, the color of the key corresponds to the red, and the rest colors and the tone levels correspond to one another in sequence; and if the initial color preferred by the user B is blue, the base tone color corresponds to the blue, and the rest colors and the tone levels correspond to one another in sequence, so that the personalized design of the light color change can be realized according to the preference of the user.
The TonaLighting program generates a light control command according to the music segments and two file lists generated when the program is operated, namely a chord appearance time list and a chord-RGB combined list, and combines an RGB spectrogram in the program, and sends the control command to the lamp control system by using the Bluetooth at the PC end.
The software part is executed in the TonaLigighting program at the PC end, and the hardware part is realized by the lamp control system. The lamp control system is controlled by the main control chip, drives the Bluetooth module and the LED lamp, receives control commands sent by software control in an unequal mode in a wireless mode, and controls the color change of light according to the commands. R, G, B respectively representing red light, light and blue light, and adopting a circular ring arrangement structure by controlling a R, G, BLED light mixing model, wherein the circular ring arrangement structure respectively adopts 16 LED lamps of red, green and blue, and the number of the LED lamps is 48. The system adopts pulse width modulation for dimming, and the duty ratio of the pulse signal is adjusted to adjust the current, so that the change of the LED light intensity is realized. In addition, the RGB color change ranges are all 0-255, and different color mixing results can be realized by adding and mixing three primary colors in different proportions, so that different light mixing effects are realized.
The TonalLighting program is mainly a music auxiliary treatment scheme designed for rehabilitation treatment of various medical conditions, and can also be used for music audio-visual experience and audio-visual teaching. The system is applied to the research in the scientific field of audio-visual stimulation of a subject, and the treatment effect of the system is obtained by detecting EEG and other physiological parameters. The subjects comprise healthy individuals, patients suffering from cerebrovascular diseases (apoplexy), Autism (ASD), postoperative rehabilitation and the like, the patients are obtained according to the analysis of the electroencephalogram signals of the patients, the system is fed back, the treatment scheme is adjusted in time, and the purpose of personalized treatment is achieved.

Claims (8)

1. An intelligent music chord-atmosphere lamp system based on a 'TonaLighting' adjusting technology comprises a hardware lamp control part and a software analysis part, and is characterized in that the software analysis part is a 'TonaLighting' program system which firstly pre-analyzes a chord neutralizing structure in a music segment through a music retrieval technology and a machine learning algorithm, automatically identifies and classifies chord tones and marks the occurrence time of the chord tones; then according to the scheme of 'TonalColor', determining the RGB combination corresponding to the marked chord tones, simultaneously reading the music segments, the chord occurrence time list and the music chord-RGB combination list, obtaining a light control instruction, transmitting the light control instruction to a hardware light control part in a wireless mode, and controlling the color of the LED light to change in real time along with the change of the music; the hardware lamp control part comprises: the controller mainly drives the Bluetooth module through the core processor, receives a control command sent by the software analysis part in a wireless mode, and changes the color of LED light according to the control command; the upper computer synchronously transmits the audio information while sending the control command, and the Bluetooth module in the lamp control system stores the received audio information and control information into the SD card, so that the system can be directly applied by a user subsequently; when the user plays the same music for the second time, the stored music information is selected by the keys through the prompt in the OLED screen, and the lamp control system is directly controlled.
2. The intelligent musical and aura light system as claimed in claim 1, wherein the "TonaLighting" program system automatically identifies and classifies chord tones by the specific process of:
firstly, a large number of music pieces are pre-analyzed by a music expert, wherein the types of the music pieces comprise pop music, classical music, jazz music and music played by different musical instruments; manually extracting music chords to obtain a series of samples serving as a machine learning data set;
secondly, extracting characteristic parameters of the chords in the data set, wherein the characteristic parameters mainly comprise time domain characteristics, frequency domain characteristics and sound spectrum characteristics;
and finally, training the data set by using a machine learning algorithm to obtain a training model, and inputting the song to be identified into the trained classifier so as to obtain chord information of the song.
3. The intelligent musical chord-ambience light system as claimed in claim 1 or 2, wherein the "TonaLighting" program system marks the chord appearance time to obtain the chord time list after the automatic identification and classification of the chord is completed.
4. The intelligent musical chord-ambience light system as claimed in claim 3, wherein the "TonaLighting" program system obtains the chord-RGB combination list according to the "TonalColor" relationship scheme; wherein it associates musical chords and spectral colors in a unique way; i.e. the key of a piece of music can be assigned a basic color, while the fifth note relative to the scale, i.e. the tonic, is given a color complementary to the dominant tone, since the opposite position of the color spectrum also reflects the opposite function of the key in the tone to the tonic; in addition, on the basis of meeting the color distribution of the chromatogram, the initial corresponding relation between the key and the basic color is customized by the user, and the personalized design of the light color change is realized according to the preference of the user.
5. The intelligent music chord-ambience lamp system as claimed in claim 1, 2 or 4, wherein the TonaLighting program system generates the control light command according to the generated two file lists, namely the chord appearance time list and the chord-RGB color combination list, in combination with the RGB spectrogram inside the program, and sends the control command to the lamp control system by using the PC-side Bluetooth.
6. The intelligent music and chord-atmosphere lamp system as claimed in claim 5, wherein the power module of the lamp control system provides two power supply modes for the lamp control system, one is a 5V power supply and the other is a 3.7V rechargeable lithium battery.
7. The intelligent music and chord-atmosphere lamp system as claimed in claim 1, 2, 4 or 6, wherein the annular LED lamp set adopts WS2812 intelligent external control integrated light source, the LED lamps adopt mixed light model, and are displayed in circular ring arrangement structure, and respectively adopt 16 LED lamps of red, green and blue, for a total of 48 LED lamps; each red, green and blue LED monochromatic lamp forms an LEDRGB unit, color change in 256 colors is realized, and the three primary colors are added and mixed in different proportions, so that different color mixing effects are realized; the system adopts pulse width modulation for dimming, and the duty ratio of the pulse signal is adjusted to adjust the current, so that the change of the LED light intensity is realized.
8. Use of an intelligent musical chord-ambience lamp system as claimed in any one of claims 1 to 7 for the preparation of a musical adjuvant therapy device for diseases.
CN201710429403.1A 2017-06-08 2017-06-08 Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology Active CN107135578B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710429403.1A CN107135578B (en) 2017-06-08 2017-06-08 Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710429403.1A CN107135578B (en) 2017-06-08 2017-06-08 Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology

Publications (2)

Publication Number Publication Date
CN107135578A CN107135578A (en) 2017-09-05
CN107135578B true CN107135578B (en) 2020-01-10

Family

ID=59733902

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710429403.1A Active CN107135578B (en) 2017-06-08 2017-06-08 Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology

Country Status (1)

Country Link
CN (1) CN107135578B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107890234A (en) * 2017-11-01 2018-04-10 宿州市宜美家具有限公司 A kind of sofa
CN108009262A (en) * 2017-12-11 2018-05-08 北京骑骑智享科技发展有限公司 The display methods and device of wheel are dazzled based on big data analysis
CN110503992A (en) * 2019-08-28 2019-11-26 常州市小先信息技术有限公司 A kind of the Intelligent music player equipment and its implementation of multi-modal interaction
CN111477200B (en) * 2020-04-03 2023-08-25 深圳市人工智能与机器人研究院 Music score file generation method, device, computer equipment and storage medium
CN112396918A (en) * 2020-11-24 2021-02-23 辽东学院 Five-line visual display technology-based blackboard for vocal music teaching and method
CN112634814B (en) * 2020-12-01 2022-04-08 黑龙江建筑职业技术学院 Rhythm control method of LED three-dimensional stereoscopic display following music
CN113050915B (en) * 2021-03-31 2023-12-26 联想(北京)有限公司 Electronic equipment and processing method
CN113365385A (en) * 2021-07-25 2021-09-07 深圳市迈捷物联光电有限公司 Light and music wireless interactive intelligent system and light and music wireless interactive control method
CN114422846A (en) * 2021-12-31 2022-04-29 深圳市智岩科技有限公司 Lamp effect control method, system, device, electronic equipment and storage medium
CN114501742A (en) * 2021-12-31 2022-05-13 深圳市爱图仕影像器材有限公司 Light effect control method and device based on motion state identification and lamp
TWI827195B (en) * 2022-08-10 2023-12-21 南臺學校財團法人南臺科技大學 Intelligent music sound and light processing method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1842236A (en) * 2005-04-01 2006-10-04 英华达(上海)电子有限公司 Control module of incoming call chord light and its controlling method
CN102187386A (en) * 2008-10-15 2011-09-14 缪西卡股份公司 Method for analyzing a digital music audio signal
CN103793010A (en) * 2014-02-28 2014-05-14 苏州三星电子电脑有限公司 Multi-media playing device dynamically varying outer shell color along with rhythm and control method of multi-media playing device
CN105810226A (en) * 2016-03-08 2016-07-27 惠州市金能量科技有限公司 Method and system for controlling expression effects of music

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1842236A (en) * 2005-04-01 2006-10-04 英华达(上海)电子有限公司 Control module of incoming call chord light and its controlling method
CN102187386A (en) * 2008-10-15 2011-09-14 缪西卡股份公司 Method for analyzing a digital music audio signal
CN103793010A (en) * 2014-02-28 2014-05-14 苏州三星电子电脑有限公司 Multi-media playing device dynamically varying outer shell color along with rhythm and control method of multi-media playing device
CN105810226A (en) * 2016-03-08 2016-07-27 惠州市金能量科技有限公司 Method and system for controlling expression effects of music

Also Published As

Publication number Publication date
CN107135578A (en) 2017-09-05

Similar Documents

Publication Publication Date Title
CN107135578B (en) Intelligent music chord-atmosphere lamp system based on TonaLighting adjusting technology
US11786163B2 (en) System and method for associating music with brain-state data
US20190387998A1 (en) System and method for associating music with brain-state data
CN102441220B (en) Computer-based music color light physical factor physical and mental health system
CN101428163B (en) Adjusting apparatus for states of examination, athletics and sports
CN102436801A (en) Making method of healthy music and selective listening method thereof
CN101989086A (en) Music and color-light environmental control centre based on internet
US20180061438A1 (en) System and Method for Predictive Generation of Visual Sequences
CN103918353A (en) User interface using sounds to control a lighting system
US11832954B2 (en) Sensory-motor generation of therapeutic musical tracks
London et al. Speed on the dance floor: Auditory and visual cues for musical tempo
CN104606763A (en) Audio-visual comprehensive training aid based on brain wave induction and audio visualization technology
Dromey et al. The effects of emotional expression on vibrato
CN201887798U (en) Music colored light environment control center base on Internet
KR100250017B1 (en) An audio system for sensitive faculty lighting
WO2021200981A1 (en) Environment control system and environment control method
CN201223621Y (en) Apparatus for adjusting states of examination, athletics and sports
WO2012031568A1 (en) Physical and mental health care system and method thereof
CN105611693B (en) The control method and device of sound equipment and desk lamp with dimmer switch
US11369016B2 (en) Method and system for producing a sound-responsive lighting effect
Bonde et al. Auditory and Visual based Intelligent Lighting Design for Music Concerts
US20110277616A1 (en) Low frequency massage apparatus operating in conjuction with music and method of operating the same
CN207219088U (en) The light controller of intelligent music chord atmosphere lamp system
KR101462003B1 (en) video display method using background illumination based on bio-signal and system adopting the method
Giordano et al. A learning interface for novice guitar players using vibrotactile stimulation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant