RU2259858C1 - Method and device for making color accompaniment of sound - Google Patents

Abstract

FIELD: medical engineering.

SUBSTANCE: method involves transforming signal carrying information about sound, with nonlinearity degree being not lower than 4.

EFFECT: wide range of functional applications.

4 cl, 3 dwg

Description

The invention relates to the field of entertainment and can be used for color accompaniment in the performance of music in concert halls, for accompaniment of sounds in theatrical and circus productions, in films, at discos, in computer games, in image animation, in art therapy, etc. .

A known method of color accompaniment of sound [1], which consists in the fact that from an electrical signal that carries information about the sound, vibrations in one or more fixed frequency ranges are isolated. The signals obtained after isolation control the spectrum of color accompaniment, namely, the color sources of the three primary colors.

A device for implementing the known method [1] comprises a source of an electric signal, comprising a linear converter of sound into an electric signal carrying information about the sound, a filtering unit, and a block of color accompaniment sources. The color source block contains a combination of three primary color sources and rheostats used for control.

The input of the filtering unit is connected to the output of the electric signal source. The outputs of the filtering unit are connected to the inputs of the block of color sources.

In this case, the filtering unit contains at least one group of three outputs that collectively transmit signals of a certain sound (in the audible region) octave, but are divided into different outputs, respectively, into three frequency subbands.

The signals from the outputs of the filtering unit are fed to the inputs of three primary colors. The excitation intensity of each color source is directly proportional to the signal level at the corresponding output of the filter unit. Color accompaniment is formed using these sources in the form of one or a mixture of colors.

The mentioned method allows you to implement color accompaniment of sound visualized on a computer screen, or using sources that emit light of a certain color.

When using the known method [1], each specific sound expressing the simplest element of a musical score - a note, is expressed in a specific color. The connection of color accompaniment with sound according to the method [1] is artificial, is not caused by the specifics of perception of music by a person, in the general case it does not enhance the emotional impact of the performed musical work.

There is a method of color accompaniment of sound [2], which consists in determining the tonic of a given piece of music, in which octaves are allocated, each stage of the octave is assigned a code characterizing the number of this stage relative to the tonic, a color range of twelve colors is set from which colors are reproduced corresponding to sounds and their sequences in a given musical work; it determines the mode of a given piece of music, forms a group of scale codes, in each of which the seven-digit code of a stage inside a given octave is used as the low order, and the corresponding code of this octave is used as the high order. The color range is set in the sequence characteristic of the color wheel (from red to violet-red); the color corresponding to the tonic is selected from the mentioned color range, and when reproducing the colors corresponding to sounds and their sequence in a musical work, the colors of the specified color range are used, while the serial numbers of colors are selected from it in accordance with the mathematical relation given in [2].

Additionally, the lightness of the color is changed step by step depending on the octave code, increasing the lightness with increasing octave number.

In accordance with the mathematical relationship between color accompaniment and sound used in the method, the consonances in the sound correspond to the consonances in color, and the dissonances correspond to dissonances, and depending on the fret (major or minor) the direction of color change in the color wheel changes.

A device for implementing this method in automatic mode includes an audio player, a controller and a block of color sources. The output of the audio player is connected to the input of the controller. The output of the controller is connected to the input of the block of color sources. In addition to utilities related to the organization of the controller itself, a program is written in the controller that forms the color scheme in accordance with the aforementioned method. In order, in accordance with the proposed method, to change step by step the lightness of a color depending on the octave code, the block of sources of color accompaniment includes a block for changing lightness.

The known method [2] is tied to the tonic of a musical work, respectively, it is implemented only in relation to the so-called functional (“tonal”) music written in the corresponding keys, does not cover the field of atonal music (written without using the laws inherent in a major or minor fret , as well as the key of major or minor).

In this case, the establishment of the color of the tonics in accordance with their taste (randomly) is carried out by a person before a session of color accompaniment of music. Therefore, works of completely different moods can be performed with a relatively similar in nature color accompaniment.

When using the known method [2], the patterns inherent in the construction of a musical work are mechanically transferred to the patterns of color accompaniment. The basis for the transition to color are the elements of the musical score - notes. As you know, the mood that functional music creates is largely determined by its mode, the tonality in which it is written, and the rate of execution. However, the connection of color accompaniment with sound, organized in accordance with the aforementioned method, does not depend on the tonality in which the piece of music is written, or on the tempo of the performance, i.e. the nature of the musical work being performed is objectively poorly taken into account.

As a result, the application of the above method in the general case does not lead to a significant increase in the emotional impression of the sound.

There is also known a method of color accompaniment of sound, described in [3].

This method in terms of features is closest to the claimed and adopted as a prototype.

In this method, each of the seven primary musical notes from the sound source corresponds to one of the colors of the color source, equivalent to or approximately corresponding to the seven primary colors of the color spectrum. Seven notes represent the main notes from “to” to “si,” with each note having its own color: “do” is red, “re” is orange, “mi” is yellow, “fa” is green, and “salt” is blue, "la" - blue, "si" - purple. Raised or lowered notes with flats or sharps correspond to two colors, located on each side of the note with a flat or sharp. The brightness of the color scheme changes in accordance with the volume level of the music. The lightness of the color scheme varies depending on the octave in which the notes of the music played are located. Chords consisting of several notes can correspond to several colors lit at the same time.

The method consists in the fact that oscillations in seven fixed frequency ranges are isolated from an electrical signal carrying information about the sound after preliminary amplification. This operation is carried out by filtering. Through these fluctuations, the spectrum of color accompaniment is controlled.

A device for implementing the method is shown in figure 1. It includes a filtering unit 5 of seven filters of the electric signal, as well as a unit 6 of color sources.

The input of the filtering unit 5 is connected to the output of an electric signal source (not shown). The outputs of block 5 of the filter are connected to the inputs of block 6 of color sources.

A preliminary linear amplifier may be included in the source of the electrical signal. In addition, it may contain a linear converter of sound into an electrical signal - a microphone.

The color of the color sources is equivalent to or approximately equivalent to the primary colors of the color spectrum.

The device operates as follows.

An electric signal carrying information about the sound is fed to a filtering unit 5, where control oscillations in seven fixed frequency ranges corresponding to individual notes are extracted from the electric signal carrying information about the sound. The control oscillation acts on block 6 of the sources of color accompaniment, activating the corresponding section of the color spectrum: the note “do” corresponds to red, “re” - orange, “mi” - yellow, “fa” - green, “salt” - blue, “la "- blue," si "- purple. If a musical note is between the main notes (sharp or flat), for example, “before sharp”, then two colors are activated: red, which refers to the “do”, and orange, which refers to the “re”.

The sound volume level changes the level of control vibrations and, accordingly, the brightness of the color source.

A device can perceive notes in various octaves, and color can change lightness relative to lightness in the first octave. For example, the color is darker in the lower octaves, and lighter in the higher ones. A set of seven color sources can be provided for each octave.

When using the method adopted for the prototype, the colors corresponding to the notes of a musical work are mechanically attached to the elements of the musical score - notes. A certain color corresponds to a certain note, regardless of the mood that the piece of music evokes. In these colors there is no biophysical conditioning. In addition, each note played is translated into color. Accordingly, for works performed at a fast pace, there is an unpleasant flickering on the screen of various colors and their combinations, which does not carry a semantic emotional coloring and reduces the emotional effect.

The task to which the invention is directed is to achieve a psychologically determined relationship between sound and color and to enhance the emotional impact of sound on a person (listener-viewer).

The technical result obtained by the implementation of the claimed invention consists in the formation of color accompaniment of sound, taking into account the biophysical laws of music perception, and color by a person, i.e. using an objective basis - identifying the mood corresponding to the sound, in particular fragments of the performed musical work.

The specified technical result in the implementation of the invention is achieved by a solution representing a group of diverse inventions - a method and device for its implementation, combined by a single inventive concept.

The specified technical result is achieved by the fact that in the method of color accompaniment of sound, including the selection from the electrical signal carrying information about the sound, vibrations in at least one fixed frequency range, and subsequent control through these vibrations of the color spectrum, in contrast to the known method a signal carrying sound information is converted with a degree of nonlinearity of at least 4, and control oscillations are isolated in the range of infrasound frequencies.

The technical result in the implementation of the invention is also achieved by the fact that a signal carrying information about the sound is non-linearly converted together with the same signal, delayed no more than 5 seconds.

The technical result in the implementation of the invention is also achieved by the fact that the inventive device for color accompaniment of sound, containing a filtering unit, the input of which is connected to a source of an electric signal that carries information about the sound, and the output is connected to the control input of a block of sources of color accompaniment, is equipped with a non-linear converter with a degree nonlinearity not lower than 4, while the filtering unit is made in the infrasonic range, and its input is connected to the output of the electric signal source through the aforementioned non-linear converter.

The technical result in the implementation of the invention is also achieved by the fact that the inventive device is equipped with a delay unit for an electrical signal, the input of which is connected to the output of the source of the electrical signal, and the output to the input of a nonlinear converter.

In figure 1. schematically depicts a device that implements the known method.

Figure 2 schematically shows a device that implements the inventive method according to claim 1.

Figure 3 schematically shows a device that implements the inventive device according to claim 2.

The inventive device (figure 2) includes a non-linear Converter 1, block 2 filtering and block 3 sources of color.

This device implements the inventive method for sounds consisting of vibrations of at least two fundamental frequencies, i.e. in the form of a chord.

Nonlinear transducer 1 has a conversion characteristic with a degree of nonlinearity not lower than 4. Filtering unit 2 is made in the infrasonic range.

The input of the filtering unit 2 is connected to the output of the source of an electrical signal carrying sound information (not shown in FIG.) Through a non-linear converter. The output of filtering unit 2 is connected to the control input of unit 3 of color sources.

Block 2 filtering performs the function of isolating oscillations in the range of infrasonic frequencies, and, if necessary, detection and linear amplification.

The source of color accompaniment can be made, for example, in the form of a device that emits colored light, in the form of a color filter illuminated by a white color, in the form of a color visualized on a computer screen.

Non-linear converter 4 can be performed, for example, in the form of an amplifier, in which the dependence of the output signal on the input is described by a polynomial of at least the 4th degree.

Nonlinear converter 1, block 2 filtering and block 3 sources of color accompaniment are most often performed in the form of analog devices. However, some of them can be performed using digital devices: using an analog-to-digital converter and controller.

The inventive method in the simplest embodiment is implemented as follows.

An electrical signal carrying information about the sound passes to the input of the nonlinear converter 1, and then to the input of the filtering unit 2.

Filtering unit 2 carries out the selection of the control oscillations from the signal in the range of infrasonic frequencies, for some versions - with the division of individual oscillations into subbands, for the simplest version - without such separation. These fluctuations arrive at block 3 sources of color accompaniment and are used to control the spectrum of color accompaniment.

Nonlinear conversion of electrical signals when using the proposed method is carried out similarly to how it is performed in the ear-brain system.

As shown in [4, 5], the human ear-brain system is a nonlinear sound transducer. Sound, in particular musical works, is accompanied by the formation of Raman vibrations in the human brain in the infrasound frequency region. In the middle part of the scale, when at least three notes of the tonic triad interact, the maximum level of infrasonic combination vibrations corresponds to an oscillation order equal to 4. When two notes belonging to the tonic third interact, 9th-order infrasound combination vibrations are formed. It follows that the degree of nonlinearity of the ear-brain system is at least 4.

Let the sound be a chord of three notes of the same intensity. In this case, an electric signal carrying information about the sound, if you do not take into account the overtones of sounds, can be simplistically described as follows:

where U is the voltage of the total electrical signal carrying information about the sound,

a is the amplitude of the signal carrying information about one note,

ω ₁ , ω ₂ , ω ₃ - the circular frequency of each of the three signals that carry information about three notes, respectively,

t is time.

The result of a nonlinear transformation with a degree of nonlinearity 4 is the following expression:

After the nonlinear transformation, a set of oscillations of the combination frequencies is formed, including 4ω ₁ , 4ω ₂ , 4ω ₃ , | 3ω ₁ ± ω ₂ |, | 2ω ₁ ± 2ω ₂ |, | 3ω ₂ ± ω ₁ | etc.

A biophysical prerequisite for the features of the emotional influence of sound is the brain's perception of these combination vibrations, and their parameters, in particular the frequency, level and nature of the change, determine the emerging emotional state of a person. The level of combinational vibrations is determined by their order, which is equal to the sum of the numbers of harmonics involved in their formation. In general, the greater the order, the lower the level.

These vibrations occur during the perception of various sounds, including musical works, including functional (“tonal”) and atonal music.

For example, in [4, 5] it was shown that the difference in the spectrum of combination vibrations of major and minor thirds and triads corresponds to the difference in the emotional perception of the major and minor frets: for major (invigorating) music a much higher level is characteristic, that is, a lower order (p≥9 for thirds, p≥4 for triads) of infrasound Raman oscillations than for minor, relatively sadder (p≥11 for thirds and p≥5 for triads).

Therefore, by isolating, using the simplest embodiment of the filtration unit, the control vibrations in the infrasonic frequency range that arise after non-linear conversion of an electric signal carrying sound information and controlling color accompaniment through these vibrations, we can distinguish the color accompaniment of major music from minor music. This color scheme is based on objective laws of perception of music by a person and helps to increase the emotional impact of music.

When separating individual vibrations in the infrasonic frequency range into subbands, the device allows you to organize the color accompaniment of sound, which takes into account the nuances of the mood that the sound carries, in particular music (both functional and atonal).

The fact is that, as shown in [5], the parameters of infrasonic vibrations that occur when sound is transmitted in the form of chords built in different keys through a nonlinear system are significantly different from each other.

For example, the major keys “re b (do #)” major and “salt b (fa #)” are used, as a rule, in musical works of a calm (contemplative) nature, in contrast to other, more invigorating keys. Tonic thirds and triads of these tonalities are characterized by a lower frequency of Raman oscillations of the infrasonic range in comparison with other tonalities of major.

Among the minor keys, the keys “G # minor” and “D # (E b) minor” differ. They are known as creating a less sad mood than other minor keys. For their tonic triads, the order of infrasound components (p = 5) is lower (level higher) than for the rest of the minor keys.

The second group — the keys of “F minor” and “B-minor” - is characterized by the fact that the order of the infrasonic components (p = 9) of their triads is much higher than for other keys. Accordingly, the level of these components is much lower. Works in the keys of F minor and B minor, whose tonic triads cause infrasonic vibrations of only a very low level, are usually perceived as particularly sad.

In the third group, which includes all the other keys of the minor, the order of infrasonic vibrations is 6. Although their parameters differ significantly from the parameters of the major keys, they differ less in selected parameters from each other. However, they can also be distinguished differences in Raman oscillations in frequency, as well as more subtle differences in levels.

When modeling atonal music, combination vibrations in the range of infrasonic frequencies can also be distinguished.

Thus, the sound is characterized by certain objective parameters that determine the type and degree of emotional impact, which are expressed by the parameters of infrasonic vibrations that occur in the non-linear ear-brain transducer.

The inventive device implements the inventive method of color accompaniment of sound, in which an electrical signal that carries information about the sound is preliminarily converted nonlinearly with a degree of conversion of at least 4, the oscillations are extracted from the signal, at least in the range of infrasonic frequencies, and then controlled using these vibrations spectrum of color accompaniment. In this case, the vibration parameters, on the basis of which the signals of the subsequent control of the spectrum of color accompaniment are formed, are objectively related to the emotions that the sound effect carries.

As you know, a person perceives the emotional influence of sounds both at the same time and in a sequential sound. Major triad is easily recognized when playing in the form of arpeggios.

For the case when the sounds are not reproduced simultaneously (in the form of a chord), but sequentially, the inventive device is shown in figure 3.

To enhance the emotional impact of the color accompaniment of sound, the claimed device is additionally equipped with a block 4 delay electric signal. The input of the delay unit 5 is connected to the input of the electrical signal, and the output to the input of the nonlinear converter.

The signal from the output of the electric signal source 1 passes to the input of the delay unit 5, as well as to the input of the nonlinear converter.

The signal from the output of the delay unit 4 is also fed to the input of a nonlinear converter.

The delay unit implements a temporary delay of the output signal relative to the input for a period of not more than 5 s.

The fact is that, as shown in [5], inertia is characteristic of the ear-brain system. The delay time should be no more than 5 s. This boundary approximately corresponds to the maximum time during which the human brain can jointly analyze sounds heard sequentially. Otherwise, the sound heard first is forgotten.

After the passage of an electric signal carrying information about the sound through the delay unit 4, a signal containing oscillations of several frequencies is supplied to the nonlinear converter 4. Further operation of the device is similar to that described above.

The inventive device can be performed on the following elements.

The filtering unit may be performed on band-pass filters or low-pass filters. A nonlinear converter, a filtering unit, and a delay unit are most often implemented as analog devices. However, they can be performed using digital devices. For example, a filtering unit can be implemented using an analog-to-digital converter and a controller with software. Similarly, a non-linear converter and a delay unit can be made. Therefore, these blocks can be implemented in one device [6].

The color accompaniment unit can use a controlled computer monitor, a plasma screen, or laser devices similar to those used by Jean-Michel Jarre [7].

The inventive method of color accompaniment of sound and a device for its implementation model the patterns revealed by the authors of the formation of the emotional reaction of a person under the influence of sound signals on the ear-brain system and, as a result, provide a qualitatively more powerful emotional effect.

Thus, a technical result is achieved and the task is solved.

Literature

1. Patent US6046724. Hvass C. Method and apparatus for conversion of sound signals into light.

2. RF patent 2103739. Afanasyev V.V. The method of forming a color image.

3. Patent GB2370794. Jeans P. D. M. Music-activated lighting system.

4. K.B. Sapozhnikova, R.E. Taimanov. Biophysical prerequisites for creating a measuring model for the perception of the structural elements of music // Transactions of the International Scientific and Practical Conference "Theory, Methods and Means of Measurement, Control and Diagnostics" (Novocherkassk), 2001, pp. 59-65.

5. Sapozhnikova K., Taymanov R. About a measuring model of emotional perception of music // Proc. of the XVII IMEKO World Congress, 2003, Dubrovnik, Croatia, p.p.2049-2053.

6. V. Gadzikovsky. Digital models of the main nonlinear transformations of strip signals in radio receivers. / Instrumentation Problems, 2003, No. 1, pp. 68-80.

7. Jarre, Jean-Michel. Paris Eiffel tower. - VHS, 1995.

Claims (4)

1. The method of color accompaniment of sound, including the selection from an electrical signal that carries information about the sound, vibrations in at least one fixed frequency range, and subsequent control through these vibrations of the spectrum of color accompaniment, characterized in that the signal carrying information about sound are converted with a degree of nonlinearity of at least 4, and control oscillations are isolated in the range of infrasound frequencies. 2. The method according to claim 1, characterized in that the signal carrying information about the sound is non-linearly converted together with the same signal, delayed by no more than 5 s. 3. A device for color accompaniment of sound, containing a filtering unit, the input of which is connected to a source of an electric signal carrying information about the sound, and the output is connected to the control input of a block of sources of color accompaniment, characterized in that it is equipped with a non-linear converter with a degree of non-linearity of at least 4 while the filtering unit is made in the infrasonic range, and its input is connected to the output of the electric signal source through the aforementioned nonlinear transducer. 4. The device according to claim 3, characterized in that it is equipped with an electric signal delay unit, the input of which is connected to the output of the electric signal source, and the output to the input of a nonlinear converter.

Images