AU2020104383A4

AU2020104383A4 - Projection filter based universal framework to match the musical notes of synthesizer and indian classical instruments

Info

Publication number: AU2020104383A4
Application number: AU2020104383A
Authority: AU
Inventors: Aditya S.Abhyankar; Abhijit V.Chitre
Original assignee: S Abhyankar Aditya Dr; V Chitre Abhijit Dr
Current assignee: VChitre Abhijit Dr
Priority date: 2020-12-29
Filing date: 2020-12-29
Publication date: 2021-03-18
Anticipated expiration: 2028-12-29

Abstract

The role of different instruments can be incorporated in a synthesizer. Due to rapid development in audio processing techniques the accuracy of producing the tones of different instruments has been substantially increased. Currently Synthesizers adapt different techniques to mimic the sound of instruments. Prominent techniques are additive and subtractive synthesis. The additive synthesis technique produces sound by adding different sine waveforms. Potentially this technique can produce sounds that closely approximate the sounds generated by acoustic musical instruments, but this makes it a complicated task due to the rigorous analysis required in this approach. The framework proposed in the present invention is all together a different approach of combination of different adaptive filter configurations with inclusion of Empirical Mode Decomposition technique for adaptively changing the input signal from synthesizer to the desired signal recorded from actual instrument. Even if the framework is tested for Indian Classical instruments it can equally be applied to match the sounds between synthesizer and any instrument as it captures the essential characteristic behavior of signals which proves very critical for matching. 18 •) E 4- a) * 4- . E U CL A) E E Ea -c = E0 E Ec 4-- c 0 c E -Ccu uC E E E E 4.,.c-- c 4 4- -- 0 - U ." aa> C 4E o c 3 0 o C E .. c 0 - r-.. e o +O C O - C.-~ 4>- _- a)a cu Vo 4 . -o -c . EWo E - W s 2C -c-cW CU3 - -o c '-> -- W oz -4O-c > c WO C O _u .- O C 0 ._ 4- -m CWb c +C4 L 0- C:5W C V -C 00 W C V~ Ill4 E CL c -- 4- o -C E - 4- 0 c 0 4-E a>) E 2> E> - -. +- s> 0 4- 4- O + .2-~C r cu E E C .4- .c > -auc V >) 0 U > > V 4 C c. 4-- o -n m a).-'0' E =n .-- C W c E E W C- -on 0> 0F 4-uW uo 0 4oC-- -- ..c W onU E oE O0 ~CL E E C C -C W 0 En ac toC 0 DW

Description

•) E 4- . 4- a)

* E U CL A) E E Ec E Ea 4-- c -c = E0 Ccu E - 0 c

uC E E

c E E 4.,.c-- 4 4--- 0 - U ." aa> C4E o c 3 0 o C E .. c 0- r-.. e o +O C O - C.-~

. -o -c

. 4>- _- a)a cu Vo EWo E-W 4 s

2C -c-cW CU3

- -o c -4O-c '-> > -- c WO W C O _u .- O C 0 ._ oz 4--m CWb c +C4 L

0- C:5W C V -C 00 W C V~ Ill4

E CL c 4- o -C -- E - 4- 0 c 0

- 4-E -. a>) E2> E>

.4- .c0 > 4- O+ +- s> 4- 0 -auc V >) 4 > >V U .2-~C r cu C c. E E C

.-- C

0F 4-uW W c E E W

4-- o m -n a) .-'0' W onU E =n

~CL C- E -on 0> E uo 0 4oC-- -- ..c C C -C W 0 En E oE ac toC

0 DW O0

PROJECTION FILTER BASED UNIVERSAL FRAMEWORK TO MATCH THE MUSICAL NOTESOFSYNTHESIZER AND INDIAN CLASSICAL INSTRUMENTS

FIELD OF THE INVENTION The present invention generally relates to a system of creating sound of musical instruments by using projection filter based synthesizer and method thereof.

BACKGROUND OF THE INVENTION Existing musical instruments are divided into three categories: strings, percussion, and wind. Strings are essentially one dimensional solids (i.e. they are long and thin, having a relatively small cross section). Percussion is typically a two-dimensional (i.e. flat and relatively thin) or three-dimensional (bulk) solid. Wind instruments run on matter in its gaseous state.

Electronic music synthesizers have had difficulty capturing the sound and phrasing of expressive instruments such as violin, saxophone, and trumpet. Even traditional sampling synthesizers, which use actual recordings of real instruments, are unable to reassemble these recordings to form expressive phrases.

A traditional sampling synthesizer can be viewed as a system that stores in memory, a digitized recording of a highly constrained musical performance. The performance consists of a number of notes covering the pitch and intensity range of the instrument, separated by brief periods of silence. In response to a note on command, with associated pitch and intensity values, the sampling synthesizer searches through the stored performance for the location of a note that most nearly matches the pitch and intensity associated with the note on command. The recorded note is then read out of memory, further pitch-shifted, and amplitude scaled to achieve a more precise match with the desired pitch and intensity, and then output through a digital-to-analog converter.

The role of different instruments can be incorporated in a synthesizer. Due to rapid development in audio processing techniques the accuracy of producing the tones of different instruments has been substantially increased. Currently Synthesizers adapt different techniques to mimic the sound of instruments. Prominent techniques are additive and subtractive synthesis. The additive synthesis technique produces sound by adding different sine waveforms. Fourier theory forms the foundation of this procedure. Sine waveforms are the basis functions which can be added to generate complex signal. Potentially this technique can produce sounds that closely approximate the sounds generated by acoustic musical instruments, but this makes it a complicated task due to the rigorous analysis required in this approach. Another existing technique is Subtractive audio synthesis, which produces sounds by generating a waveform with rich harmonic content. Then this waveform is passed through a filter which successively subtracts harmonics to get the desired sound. Synthesizers also incorporate different techniques such as wavetable synthesis frequency modulation synthesis. The fundamental purpose is to produce the sound which will be very close to actual instrument.

In one solution, a computer entertainment system is disclosed for dynamically composing a music sound tract in response to dynamic and unpredictable actions and events initiated by a directing system in a way that is aesthetically appropriate and natural. The system includes a composition database having one or more musical sequences. One or more of the one or more musical sequences has one or more decision points. The decision points within the database comprise a composing decision tree, with the decision points marking places where branches in the performance of the musical sequences may occur. A sound driver interprets each decision point within the one or more musical sequences. The sound driver conditionally responds to the interpreted decision points depending on the unpredicted actions and events initiated by the directing system. It is also contemplated that the directing system may directly query the state of the sound driver and adjust the activities of the directing system based on the results of the query. Other direct commands may be initiated by the directing system for controlling the performance of the sound driver.

In one solution, an instrument is disclosed for being used with a plurality of pieces or containers or regions of user interface input fluid, said pieces or containers or regions of fluid for direct physical contact by a user of said instrument, said instrument comprising: a plurality of pickups, each arranged for conversion of one of (a) an acoustic disturbance, or (b) a vibrational disturbance, or (c) a pressure or flow disturbance in each of said pieces or containers or regions of input fluid; an electric circuit connected to an output of each of said pickups, said electric circuits each altering said disturbance into a signal comprising one note of a musical scale, with a one to-one correspondence between said pieces or containers or regions of input fluid, and said notes of said musical scale; and one or more output devices for converting said signals into sound; said instrument further including a housing, a plurality of flow channels, each flow channel having an output adapted to permit the fluid to flow therefrom and be selectively obstructed by a user to reduce or alter the flow therefrom, wherein each pickup is positioned to sense the reduction or alteration in the flow therefrom, where each of said pickups is connected to one of the electric circuits, said instrument further including at least one audio output from said electric circuits, and each of said electric circuits including an amplitude inverter wherein the pickup receives a linearly varying signal that has a maximum amplitude value when the user is not in contact to the medium and a minimum amplitude value or off value when the user is fully interacting with the media and intermediate values there between and the amplitude inverter calculates an output value to produce an output signal that is inversely correlated to its input, and wherein the output signal of each amplitude inverter controls a musical note amplitude varying from an off or minimum level to a maximum level in correspondence to the output signal.

In another solution, a musical synthesizer is indicated for synthesizing an output audio signal in response to an input control sequence, includes sound segment storage means for storing a collection of sound segments, wherein said collection includes a plurality of transitions between musical tones; sound segment sequencer means responsive to said input control sequence for selecting a sequence of sound segments, including segments corresponding to transitions between musical tones, from said sound segment storage means; and sound segment player means for combining and playing out said sequence of sound segments to form said output audio signal.

The existing systems are very complex for addition and subtraction number of frequencies and developing the envelope of any musical note to mimic any instrument from synthesizer. In addition of, the existing systems do not modify produced sound from the synthesizer. These existing systems just work on functionality of the synthesizer, which are required to be improved. Therefore, there exists a need to have a better system of creating sound of musical instruments by using projection filter based synthesizer.

SUMMARY OF THE INVENTION

The present invention generally relates to a system of creating sound of musical instruments by using projection filter based synthesizer and method thereof.

In an embodiment, a method of creating sound of musical instruments by using projection filter based synthesizer is provided. The method includes the steps of: generating original musical note by the plurality of musical instruments, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note; generating musical note of the musical instruments by the synthesizer for targeting output set of projections filter, wherein musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note; storing the generated musical note of the synthesizer in form of audio file by the storage unit; converting the audio file into the digital file by the audio processing unit; determining pitch of a waveform of the digital signal by the digital analyzing unit and braking the waveform in small waveform with in a particular frequency; matching the small waveform of the musical note of the synthesizer with the original note of the musical instruments by the matching unit, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer; and making changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments.

In another embodiment, a system for creating sound of musical instruments by using projection filter based synthesizer is provided. The system includes a plurality of musical instruments configured to generate original musical note, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note; a synthesizer configured to generate musical note of the musical instruments for targeting output set of projections filter, wherein musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note; a storage unit configured to store the generated musical note of the synthesizer in form of audio file; an audio processing unit adapted to response the audio file and convert into a digital file; an digital analyzing unit adapted to determine pitch of a waveform of the digital signal, wherein the digital analyzing unit breaks the waveform in small waveform with in a particular frequency; a matching unit adapted to match the small waveform of the musical note of the synthesizer with the original note of the musical instruments, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer; and an originating module adapted to make changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments.

An object of the present invention is to develop an envelope of any musical note to mimic any instrument from synthesizer.

Another object of the present invention is to modify sound produced from the synthesizer.

To further clarify advantages and features of the present invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which is illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail with the accompanying drawings.

BRIEF DESCRIPTION OF FIGURES

These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:

Figure 1 shows a flowchart for a method for creating sound of musical instruments by using projection filter based synthesizer;

Figure 2 shows a block diagram for a system for creating sound of musical instruments by using projection filter based synthesizer in accordance with an embodiment of the present invention by implementing the method illustrated in Figure.1;

Figure 3 shows exemplary implementation to implement the development of framework of projection based filters in accordance with an embodiment of the present invention; and

Figure 4 shows flow chart of creating sound of musical instruments by using projection filter based synthesizer in accordance with an embodiment of the present invention.

Further, skilled artisans will appreciate that elements in the drawings are illustrated for simplicity and may not have been necessarily been drawn to scale. For example, the flow charts illustrate the method in terms of the most prominent steps involved to help to improve understanding of aspects of the present invention. Furthermore, in terms of the construction of the device, one or more components of the device may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having benefit of the description herein.

DETAILED DESCRIPTION

For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates.

It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the invention and are not intended to be restrictive thereof.

Reference throughout this specification to "an aspect", "another aspect" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrase "in an embodiment", "in another embodiment" and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.

The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures or components proceeded by "comprises...a" does not, without more constraints, preclude the existence of other devices or other sub systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The system, methods, and examples provided herein are illustrative only and not intended to be limiting.

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

Figure 1 illustrates a flowchart for a method for creating sound of musical instruments by using projection filter based synthesizer. The method 100 includes the steps of: Step 102 of generating original musical note by the plurality of musical instruments, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note; Step 104 of generating musical note of the musical instruments by the synthesizer for targeting output set of projections filter, wherein musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note; Step 106 of storing the generated musical note of the synthesizer in form of audio file by the storage unit; Step 108 of converting the audio file into the digital file by the audio processing unit; and Step 110 of determining pitch of a waveform of the digital signal by the digital analyzing unit and braking the waveform in small waveform with in a particular frequency; Step 112 of matching the small waveform of the musical note of the synthesizer with the original note of the musical instruments by the matching unit, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer and Step 114 of making changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments.

Referring to Figure 2, a system for creating sound of musical instruments by using projection filter based synthesizer using the method implemented in Figure 1 is illustrated. The system 200 includes a plurality of musical instruments 202 configured to generate original musical note, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note; a synthesizer 204 configured to generate musical note of the musical instruments for targeting output set of projections filter, wherein musical note from the synthesizer 204 comprising the ragas of the musical instruments, wherein the musical note of the synthesizer 204 serves as a role of input for creating same musical note; a storage unit 206 configured to store the generated musical note of the synthesizer in form of audio file; an audio processing unit 208 adapted to response the audio file and convert into a digital file; an digital analyzing unit 210 adapted to determine pitch of a waveform of the digital signal, wherein the digital analyzing unit 210 breaks the waveform in small waveform with in a particular frequency; a matching unit 212 adapted to match the small waveform of the musical note of the synthesizer with the original note of the musical instruments 202, wherein the matching unit 212 shows unmatched waveforms of the musical note of the synthesizer 204; and an originating module 214 adapted to make changes in the unmatched waveforms of the musical note of the synthesizer 204 for matching the complete waveform with the musical note of the musical instruments 202.

In an embodiment, the matching unit 212 and the originating module 214 are worked on basis of empirical mode decomposition (EMD), recursive least square (RLS) and affine projection filter (AP).

In an embodiment, Bhairav, Bhairavi, Todi, and Bhoop and a plain note of Sa-Re-Ga-Ma-Pa-Dha-Ni-Sa are ragas recorded.

In an embodiment, the unmatched waveforms are passed through the affine projection filter which successively subtracts harmonics to get the desired musical note.

In an embodiment, the originating module 214 comprising a pitch adjusting unit 216 adapted to adjust the pitch of the unmatched waveform of the musical note of the synthesizer 204.

In an embodiment, the originating module 214 creates template of the waveform of the original musical note of the musical instrument.

Figure 3 shows exemplary implementation to implement the development of framework of projection based filters in accordance with an embodiment of the present invention. Synthesizer is used to generate the musical note of flute and sitar. Mike is used to record the signal from synthesizers and from sitar and flute (original). Flute is used for recording of original signal. Experimental mathematical framework is developed which takes input from synthesizer. Target output set is used for projection filters which are the signal form original instrument (flute and sitar).

Figure 4 shows flow chart of creating sound of musical instruments by using projection filter based synthesizer in accordance with an embodiment of the present invention. The present invention first aims at generating data from original instrument. The field is decided for experimentation is musical field where the reference signals are recorded from actual instruments which served the role of destination and the signals which are recorded from synthesizer play the role of input. Sitar and flute are considered for experimentation. The aim is to convert the input signal from synthesizer to the target signal recorded from actual Sitar and flute. Five Ragas are first recorded from sitar and flute which are Bhairav, Bhairavi, Todi, and Bhoop and a plain note Sa-Re-Ga-Ma-Pa-Dha-Ni-Sa. The selection of above Ragas serves the reference to generate the same notes on synthesizer. Instead of generating random notes these Ragas serve the reference datum for recording. The same Ragas are generated on synthesizer by playing the respective notes in flute mode of synthesizer. The tonal difference reflects the quality of synthesized musical note with original instrument note as a reference.

From the nature of the signals it is evident that any one adaptive filter configuration is not able to produce reconstructed signal tantalizingly close to original signal. So the present invention need a configuration which will exploit the positives from different basic filter structures .This fact is observed by the cascaded combination of affine projection and RLS along with empirical mode decomposition separating the oscillatory behavior and then using adaptive behavior of the filter. The framework AP-EMD -RLS generates a reconstructed signal which is 9 9 .8 % similar to original and is the best reconstruction.

In an implementation, the advantage of the method is less complex compared to the current technique of addition or subtraction of number of frequencies and developing the envelope of any musical note to mimic any instrument from synthesizer. The second prominent advantage is that it does not modify the synthesizer structure but modifies the sound produced from synthesizer.

The drawings and the forgoing description give examples of embodiments. Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, orders of processes described herein may be changed and are not limited to the manner described herein. Moreover, the actions of any flow diagram need not be implemented in the order shown; nor do all of the acts necessarily need to be performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of embodiments is by no means limited by these specific examples. Numerous variations, whether explicitly given in the specification or not, such as differences in structure, dimension, and use of material, are possible. The scope of embodiments is at least as broad as given by the following claims.

Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any component(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or component of any or all the claims.

Claims

WE CLAIM 1. A system for creating sound of musical instruments by using projection filter based synthesizer, said system comprising: a plurality of musical instruments configured to generate original musical note, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note;

a synthesizer configured to generate musical note of the musical instruments for targeting output set of projections filter, wherein musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note;

a storage unit configured to store the generated musical note of the synthesizer in form of audio file;

an audio processing unit adapted to response the audio file and convert into a digital file;

an digital analyzing unit adapted to determine pitch of a waveform of the digital signal, wherein the digital analyzing unit breaks the waveform in small waveform with in a particular frequency;

a matching unit adapted to match the small waveform of the musical note of the synthesizer with the original note of the musical instruments, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer.

an originating module adapted to make changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments.

2. The system as claimed in claim 1, wherein the matching unit and the originating module are worked on basis of empirical mode decomposition (EMD), recursive least square (RLS) and affine projection filter (AP), wherein the ragas comprising Bhairav, Bhairavi, Todi, and Bhoop and a plain note of Sa-Re-Ga-Ma-Pa-Dha-Ni-Sa.

3. The system as claimed in claim 1, the unmatched waveforms are passed through the affine projection filter which successively subtracts harmonics to get the desired musical note, and wherein the originating module comprising a pitch-adjusting unit adapted to adjust the pitch of the unmatched waveform of the musical note of the synthesizer.

4. The system as claimed in claim 1, wherein the originating module creates template of the waveform of the original musical note of the musical instrument.

5. A method for creating sound of musical instruments by using projection filter based synthesizer, said method comprising: generating original musical note by the plurality of musical instruments, wherein the original musical note from the musical instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note; generating musical note of the musical instruments by the synthesizer for targeting output set of projections filter, wherein musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note; storing the generated musical note of the synthesizer in form of audio file by the storage unit; converting the audio file into the digital file by the audio processing unit; determining pitch of a waveform of the digital signal by the digital analyzing unit and braking the waveform in small waveform with in a particular frequency; matching the small waveform of the musical note of the synthesizer with the original note of the musical instruments by the matching unit, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer; and making changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments.

Generating original musical note by the plurality of musical instruments, wherein the original musical note from the musical 102 instruments comprising a plurality of ragas, wherein the recorded ragas serves as reference datum for matching the musical note

Generating musical note of the musical instruments by the synthesizer for targeting output set of projections filter, wherein 104 musical note from the synthesizer comprising the ragas of the musical instruments, wherein the musical note of the synthesizer serves as a role of input for creating same musical note

106 Storing the generated musical note of the synthesizer in form of audio file by the storage unit

108 Converting the audio file into the digital file by the audio processing unit

Determining pitch of a waveform of the digital signal by the digital analyzing unit and braking the waveform in small waveform with 110 in a particular frequency

112 Matching the small waveform of the musical note of the synthesizer with the original note of the musical instruments by the matching unit, wherein the matching unit shows unmatched waveforms of the musical note of the synthesizer

114 Making changes in the unmatched waveforms of the musical note of the synthesizer for matching the complete waveform with the musical note of the musical instruments

Figure 1

Plurality Of Synthesizer204 Storage Unit 206 Musical Instruments 202 Digital Analyzing Matching Unit Unit 210 212 Audio Processing Unit 208 Originating Pitch-adjusting Module 214 Unit 216

Figure 2

Figure 3

Figure 4