FR3141276A1 - Method and system for measuring point of impact for the initiation and development of a musical gesture - Google Patents

Abstract

The present invention relates to a method for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture (1). For this purpose, computer means receive a first data representative of a contact between said organ and said playing zone from a first sensor associated with said playing zone, receive a second data representative of an impact dynamic between said organ and said playing zone from a second sensor associated with said playing zone, and determine a fourth data representative of a dynamic of said musical gesture (1) from said first data and said second data. Figure for abstract: Figure 1

Description

Method and system for measuring point of impact for the initiation and development of a musical gesture

The present invention relates to the field of electronic musical instruments.

The present invention relates more particularly to a method for measuring a point of impact associated with a musical gesture making it possible to better characterize and differentiate interactions with the electronic musical instrument.

For the purposes of the present invention, musical gesture is understood here, and throughout the description which follows, to be any interaction with the electronic musical instrument capable of creating or impacting a sound generated by the musical instrument. The nature of the musical gesture thus varies according to the desired characteristics of the electronic musical instrument, and corresponds for example to a set of gestures associated with a standard musical instrument, which is reproduced by the electronic musical instrument.

The present invention will thus find numerous advantageous applications in the emulation of a wide variety of acoustic instruments, or even in the creation of sounds specific to electronic musical instruments.

State of the art

The Applicant develops, produces and markets electronic musical instruments.

For the engagement of musical notes and the variations of expression of the musician, the Applicant has already developed a particular process for measuring these musical gestures for wind instruments. This process allows the musician to very precisely nuance his playing on an electronic instrument as he could do on an acoustic instrument.

Document WO 2016/193601 A1 is thus known.

The Applicant has also developed a sound engine which makes it possible to respond to varied and nuanced gestures for its electronic wind instrument.

Intending to bring the possibilities of this sound engine to a wider audience not limited to wind instruments alone, it was necessary to imagine a similar technical solution for other ranges of instruments.

We can thus describe two large families of instruments, to which specific instrumental gestures are associated:
- percussion instruments, for which the usual methods use impact and deformation sensors, allowing the measurement of a point of impact and impact dynamics;
- keyboard instruments, for which the usual methods are based on measuring the dynamics of triggering gestures, based on the crossing of thresholds.

Many technical solutions offer electronic percussion instruments using force sensors, for example piezoelectric sensors or resistive force sensors (also called FSR sensors, from English “Force-sensing resistor”), for a game most often using chopsticks to trigger sounds. Striking a finger or stick on the electronic percussion instrument activates the force sensor and triggers the generation of an associated sound.

Other solutions, associated with “finger drumming” practices, revolve around a grid of sensors allowing different sounds to be triggered. Depending on the position of the strike, different force sensors are activated, and the sound is modulated.

The Applicant submits, however, that these solutions do not allow electronic instruments to obtain as many nuances as acoustic, percussion or keyboard instruments. In particular, sound modulation using a grid of force sensors has limited precision and requires a multiplication of sensors, resulting in a complex instrument generating irregular sounds.

The present invention aims to improve the current situation described above.

The present invention aims more particularly to remedy the above limitations by proposing an original technical solution which makes it possible to measure the entire musical gesture triggered directly with the fingers in the same way as on an instrument, (dynamics of engagement of the note, continuous variation according to different parameters during the development of the note and release of the note, position of the point of impact which can have an influence on the sound rendering) possibly integrating additional possibilities.

To this end, the object of the present invention relates in a first aspect to a method for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a gesture musical, the method being implemented by at least one processor, the method comprising the following steps:
- reception of a first data representative of a contact between the organ and the playing zone from a first sensor associated with the playing zone;
- reception of a second data representative of an impact dynamic between the organ and the playing zone from a second sensor associated with the playing zone; And
- determination of a fourth data representative of a dynamic of the musical gesture from the first data and the second data.

It is understood here that the organ corresponds for example to one or more fingers of a user interacting with the playing zone, to a hand of such a user, to a wand or to any other tool used to interact with a playing instrument. electronic music. It is further understood that the playing zone corresponds to a surface or space associated with the electronic musical instrument or more generally to any zone in which the user performs the musical gesture. The game zone corresponds for example to a portion of a physical device bringing together the first sensor and the second sensor, for example a flat surface associated with this physical device.

The first data thus includes information on the way in which the organ is brought into contact with the playing zone, for example one or more positions associated with different fingers, one or more trajectories or movements, this is that is to say a set of positions of the organ when it moves along the playing zone, or even a contact surface between the organ and the playing zone. The first data also includes for example derived from the position or the contact surface between the organ and the playing zone. The reception of the first data therefore corresponds to a capture of the position and the continuous gestures of the organ on the playing zone, between the the impact of the organ with the playing zone and the release, that is to say over the entire interval during which the organ is in contact with the playing zone.

The first sensor includes, for example, a capacitive touchpad. Those skilled in the art understand that a capacitive touchpad makes it possible to very precisely determine the position of a finger and its path on a surface but remains very limited in terms of measuring impact dynamics. A capacitive touchpad also allows variations to be introduced depending on the point(s) of impact between the organ and the playing area.

On the other hand, the reception of the second data corresponds to a capture of gestures triggering the musical gesture. The second data provides for example firstly information on threshold crossing, like the methods associated with keyboard instruments of the prior art, and secondly information relating to the dynamics of the musical gesture, which varies depending on whether the gesture corresponds with a strike, a rolling, a friction, or even whether it is made with the pad of a finger, a nail or a chopstick.

The second sensor comprises for example one or more piezoelectric sensors. Those skilled in the art understand that piezoelectric sensors, commonly used for electronic percussion instruments, make it possible to faithfully measure the dynamics of the impact of a strike on a surface, that is to say here the impact between the organ and the playing zone. In other words, piezoelectric sensors measure a mechanical stress or deformation resulting from the impact. On the contrary, such sensors are not suitable for determining the positions associated with impacts. The second sensor thus makes it possible to find the dynamics of percussive playing.

Alternatively, the second sensor comprises at least one accelerometer. Such an accelerometer can constitute an alternative to piezoelectric sensors, and can be integrated into a complete inertial unit more suitable for instruments that can be in motion.

Thus, the principle of the present invention consists of merging the data from the first and second sensors, which each have disadvantages with respect to the desired objective, to extract the most relevant information and combine them so as to obtain a fourth data representative of the entire dynamic of the musical gesture.

This combination makes it possible in particular to dissociate and characterize the different parts of the musical gesture:
- triggering, that is to say the moment and the way in which we begin to trigger a sound, generally the contact between the organ and the playing zone;
- maintenance, that is to say maintaining contact with the playing area allowing variations in sound to be controlled; And
- relaxation, that is to say the separation between the organ and the playing zone, corresponding to the stopping of the sustained part of the sound.

The Applicant therefore submits that the combination of the strong points of each sensor by merging the data, that is to say by giving weight to each sensor on the dimension where it is the most precise and the most interesting in terms of possibility to nuance in a controlled manner the control of the generated sound, makes it possible to obtain a more powerful and more precise result than what individual sensors would allow.

We further understand that it is possible to obtain additional information from the first sensor and the second sensor to supplement the second data and the first data respectively, with less weight. Interferometry techniques make it possible, for example, to obtain an approximate estimate of the position of the organ from the second sensor, in particular from piezoelectric type sensors. According to another example, the variation of the contact surface, obtained from the first data, makes it possible to anticipate release gestures, that is to say the reduction or stopping of the forces applied to the playing zone. In other words, the sensors can provide estimation and/or substitution information on certain aspects of the other sensors to make the process more robust. This design also makes it possible to consider more economical variants by reducing the requirements on a given sensor, the other sensors being able to supplement the information if necessary.

Thanks to the present invention, musical gestures are measured and transcribed with a fidelity much greater than previous techniques, subsequently allowing a more faithful and more nuanced restitution of the sound. This measurement thus makes it possible to obtain electronic musical instruments whose quality is closer to acoustic instruments, opening the way to greater variations of sound and timbre in their triggering and maintenance.

In an advantageous embodiment of the invention, the determination comprises the following phases:
- obtaining information representative of surface and contact variation from the first data;
- obtaining representative dynamic measurement information from the second data; And
- determination of information representative of triggering the musical gesture from the information representative of surface and contact variation and the information representative of dynamic measurement,
the fourth data item comprising the information representative of triggering the musical gesture.

In other words, the fourth piece of data includes information specifically associated with the trigger, that is to say a precise part of the musical gesture. The sound and/or timbre at the start of a note is thus obtained by combining all the information making it possible to characterize the dynamics of the impact, coming from both the first data and the second data. The representative information for triggering the musical gesture corresponds for example to one or more signals for controlling the dynamics of the sound and/or the timbre associated with the musical gesture.

In an additional embodiment, the determination comprises the following phases:
- obtaining information representative of the position of a contact point from the first data;
- obtaining information representative of maintenance and/or friction dynamics on the playing zone from the second data; And
- determination of information representative of variations in sound and/or timbre of the musical gesture and of information representative of maintenance of the musical gesture from information representative of position of the point of contact and of the dynamics of maintenance and /or friction on the playing area,
the fourth data item comprising information representative of variations in sound and/or timbre and maintenance of the musical gesture.

Thus, the information representative of the position of the contact point and the information representative of maintenance dynamics and/or friction make it possible to determine on the one hand the sound and/or the timbre associated with the musical gesture, which is for example used to all the parts of the musical gesture, on the other hand information associated specifically with the maintenance part of the musical gesture. This design thus makes it possible to precisely determine the evolution of the sound when the organ maintains contact with the playing zone.

For example, a determination of the sound associated with the triggering is provided by combining the previous embodiments, the choice of sound and/or timbre being obtained via the position and the dynamics of maintenance and/or friction, and the control of the dynamics associated with sound and/or timbre being obtained via surface and contact variation and dynamic measurement.

In a particular embodiment, the first data item comprises:
- information representative of the coordinates of the organ on a marker associated with the game zone; and or
- information representative of a contact surface between the organ and the playing zone; and or
- information representative of a distance between several organs; and or
- information representative of the speed of variations on the playing area; and or
- information representative of acceleration of variations on the playing area; and or
- information representative of the orientation of the organ in relation to the playing zone.

We understand here that the information included in the first data can vary depending on the first sensor and the processing carried out. Obviously, the information representative of distance between several organs is only used if several organs interact with the game zone, for example several fingers interacting with a virtual keyboard.

We also understand that the notion of first data representative of a contact between the organ and the playing zone is taken here in a broad sense, being able to correspond to one or more points of contact along a given surface, as well as to a evolution of the contact over time via the evolution of the contact surface and the possible movement(s) of the organ along the playing zone, according to a series of positions, or a combination of one or more speeds/ accelerations (also variable) and orientations.

The first data can thus include one or more information representative of coordinates, that is to say position, of the organ on the playing zone, of contact surface between the organ and the playing zone, as well as of their respective derivatives, notably speed or acceleration.

It is further understood that the speeds of variations on the playing zone correspond to the speeds associated with the different possible movements of the fingers on the surface. The information representative of speed of variations on the playing zone and the information representative of orientation of the organ relative to the playing zone are for example grouped together in a vector representative of movement of the organ on the playing zone. game.

Thus, the information representative of the contact surface between the organ and the playing zone corresponds for example to a crushing surface of a finger, which makes it possible to partly simulate the pressure exerted and for example to complete the information of force from the second data. The first datum includes for example speed and/or acceleration information supplementing the position information, for example corresponding to a change in positions, or even a speed of distance or rapprochement between several organs.

We further understand that, when the organ corresponds to a hand or several fingers of the user, some of the information can be linked together, the overall movement of the hand being able to impact the movement of distinct fingers. On the contrary, when the organ corresponds to several hands, many characteristics, notably the orientation and speed of the organs, can be completely independent.

In a specific embodiment, the second data item comprises:
- information representative of an amplitude of an envelope of a signal from the second sensor; and or
- information representative of spectral content of the signal from the second sensor; and or
- information representative of interferometry between a plurality of second sensors.

We understand here that the notions of signal envelope and signal spectral content are associated with a dynamic analysis of the information coming from the second sensor. Such information is for example determined during the execution of the method from raw data from the second sensor. This information makes it possible in particular to obtain a measurement of dynamics and/or maintenance dynamics and/or friction on the playing area.

Those skilled in the art further understand that the information representative of dynamic measurement stated above can be obtained, or results directly, from the information representative of amplitude of the envelope of the signal. Likewise, the information representative of measuring maintenance dynamics and/or friction on the playing zone can be obtained, or results directly, from the information representative of the spectral content of the signal.

We also understand, as stated above, that when using several second sensors, for example several piezoelectric sensors, interferometry makes it possible to obtain a position estimate associated with the measured forces. This position estimation can be used to complete the first data, or to distinguish several forces measured by the second sensors and associate them with given positions or zones, which can for example be specified via the first data.

In an additional embodiment, the method further comprises reception of a third piece of data representative of an approach and/or movement away gesture of the organ with respect to the playing zone from a third sensor, the fourth data being further determined from the third data.

We understand here that the third data includes information on the speed or orientation of the organ, before or after the impact. The fourth datum is thus modified so as to introduce on the one hand variations depending on the speed and direction of approach, on the other hand to increase the spectacular dimension of the musical gesture, in particular with regard to the movement of distance from the organ. This design therefore makes it possible, on the one hand, to better transcribe and anticipate musical gestures depending on the approach, and on the other hand to add unique additional variations depending on the distance. Obviously, it is also possible to consider only the approach or the distance, depending on the intention of the person skilled in the art.

The third sensor includes, for example, an electric field sensor, also called an “E-field” sensor. Those skilled in the art understand that an electric field sensor is capable of measuring the position of the organ, in particular of a hand, above a surface, in particular of the playing zone, to anticipate the approach before and after impact. Such a sensor not being more precise on the position of the impact itself or on the distinction of several fingers, this measurement remains approximate and must be supplemented, in particular via the information from the first sensor and the second sensor. According to another example, the third sensor comprises an optical sensor and/or a radio sensor, allowing alternative measurement of approach and departure movements. As stated above with regard to the first sensor and the second sensor, it is possible to use information from one of the sensors in order to estimate or substitute certain aspects of one of the other sensors.

Thus, the integration of the third sensor makes it possible to characterize and dissociate additional parts of the musical gesture:
- the approach, that is to say the period before the trigger, which does not normally produce a sound in itself but can modify the trigger; And
- the distance, that is to say the period after the release, which can introduce variations in the progressive disappearance of the sound.

Of course, although variations in the creation and disappearance of sound mainly result from the triggering, sustaining and releasing parts of the musical gesture, also characterizing the approach and/or distancing allows for additional possibilities of variation, for example in order to increase or exaggerate gestures based on the parameters of speed and direction of approach and distance.

Preferably, the determination further comprises obtaining information representative of the speed of approach of the organ with respect to the playing zone from the third data, the information representative of triggering the musical gesture being further determined as a function of the information representative of approach speed.

In other words, the way in which the fourth data is determined as a function of the third data includes a modification of the triggering of the musical gesture according to the speed of approach of the playing zone, that is to say of the surface contact with the organ. This approach speed is for example determined in advance and recorded in a memory during execution of the method according to the invention, so as to predetermine the dynamics of the sound before receiving more precise information from the first and second sensors.

In yet another mode of implementation, the determination further comprises obtaining information representative of the orientation of an approach gesture from the third datum, the information representative of variations of sound and/or of timbre and maintenance of the musical gesture being further determined as a function of the information representative of the orientation of the approach gesture.

In other words, the way in which the fourth datum is determined as a function of the third datum includes a modification of the sound (or timbre) and/or the maintenance associated with the musical gesture, depending on the angle of the approach. of the organ.

It is understood here, with regard to the previous embodiments, that the determination of the fourth datum involves one or more fusions of the first, second and third datum, so as to extract the relevant information and to complete or specify information. from one sensor via the other sensors.

In an additional embodiment, the determination further comprises a determination of information representative of an additional effect of an extinction of the musical gesture from the third datum.

We understand here that the extinction of the musical gesture is associated with the distancing part of the musical gesture as described above, the relaxation resulting in a progressive extinction of the sound, which is in this embodiment modulated according to the third data.

In yet another embodiment, the third data item comprises:
- information representative of an orientation of the organ; and or
- information representative of a speed between the organ and the playing zone; and or
- information representative of a distance between the organ and the playing zone.

We understand here, as previously, that the information included in the third data can vary depending on the third sensor and the processing carried out during the execution of the method. Likewise, the information representative of orientation or distance of the organ can vary depending on whether the organ designates a finger, several fingers, a hand, or another specific object, and the speed of approach or distance. between the organ and the playing zone is for example derived from the evolution of the distance between the organ and the playing zone.

In one embodiment, the method further comprises a restitution of at least one sound of an instrument from the fourth data.

We understand here that the fourth piece of data aims to characterize the sound and/or timbre of an instrument during playing, in the most precise and nuanced way possible. The method can therefore include a restitution of the characterized sound, for example via a sound device of the speaker, loudspeaker or other type. The sound reproduction is for example also determined as a function of a type of electronic musical instrument selected, in particular a type of emulated acoustic instrument. Such a process applies for example to different percussion or keyboard instruments, the characteristics of the process and/or of the sound reproduced being adapted so as to match the sound or the playing area to a given instrument.

In another embodiment, the method further comprises transmission of the fourth piece of data to a remote device.

We understand here that the method is designed so as to generate a recordable electronic signal, without necessarily itself resulting in sound restitution. The fourth data corresponds to a description of control parameters of a sound to be produced, based on the characteristics of the musical gesture. It is therefore possible in this embodiment to transmit the fourth data item to a remote device, for example a device dedicated to sound reproduction and distinct from the means implementing the method according to the invention. For example, a transmission of the fourth piece of data is provided to a sound device as described above, or to a remote device comprising a sound device.

The transmission of the fourth data item is for example carried out according to a specific communication protocol, for example a MIDI communication protocol (from the English “Musical Instrument Digital Interface”). Such a communication protocol allows in particular communication between a controller serving as a physical interface, comprising for example the game zone and the sensors, and a sound synthesis or processing device.

In yet another embodiment, the method further comprises a determination of a fifth data representative of an emulation of the behavior of an instrument from the fourth data.

We understand here that the fifth datum makes it possible to characterize in as much detail as possible the behavior of a given instrument as a function of the musical gesture, that is to say, to adapt the information from the fourth datum to the instrument. The fifth data is then, for example, transmitted to a remote device or used to reproduce a sound from the instrument, like the embodiments described above. The fifth datum is for example determined specifically for a predetermined instrument, or according to information representative of a type of selected electronic musical instrument. Such an embodiment is particularly suitable for communication with a remote device allowing only direct reproduction of sound, without being capable of processing the fourth data itself.

According to a second aspect, the present invention relates to a computer program comprising instructions for implementing the method according to the first aspect of the present invention, in particular when these instructions are executed by a processor.

According to a third aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for executing the steps of the method according to the first aspect of the invention.

On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a ROM memory of the microelectronic circuit type, or even a magnetic recording means or a hard disk.

On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or terrestrial radio or by self-directed laser beam or by other ways. The computer program according to the present invention can in particular be downloaded onto an Internet type network.

Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in executing the method in question.

According to a fourth aspect, the present invention relates to a system for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture.

Advantageously, the system includes:
- a support having a surface defining the playing zone;
- a first sensor and a second sensor associated with the playing zone;
- a beacon unit configured to receive a first data representative of a contact between the organ and the playing zone from the first sensor and to receive a second data representative of an impact dynamic between the organ and the playing area from said second sensor; And
- a processing unit for the first data and the second data configured to determine a fourth data representative of a dynamic of the musical gesture.

Preferably, the system comprises computer means configured for implementing the steps of the method according to the first aspect of the invention. The system thus comprises for example a third sensor associated with the playing zone, the beacon unit being configured to receive a third data representative of a gesture of approach and/or movement away from the organ in relation to vis of the playing area from the first sensor, and the processing unit being configured to also process the third data and to determine the fourth data additionally based on the third data. The system also includes, for example, means for reproducing the sound of an instrument from the fourth piece of data, for example computer means configured to convert a signal comprising the fourth piece of data into a sound signal.

Those skilled in the art understand that the beacon unit, the processing unit and the computing means, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits and/or into discrete components, be made in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.

Those skilled in the art also understand that the support, the first sensor, the second sensor and optionally the third sensor are for example grouped together in the same physical device integrating or in communication with the electronic circuit(s) above, the physical device forming an electronic musical instrument. According to yet another design, the support is configured to attach to another element, for example a drum tom or any flat surface, so as to form the electronic musical instrument.

Thus, through the various functional and structural technical characteristics above, the Applicant proposes a method and a system for measuring at least one point of impact between at least one organ and a play zone for engagement and development of a musical gesture, allowing a much more precise measurement of movements than the systems known from the state of the art and relying solely on force sensors and measurements of engagement dynamics, and thus resulting in a more varied modulation and specifies sounds that can be produced with electronic musical instruments.

Brief description of the figures

Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting examples of embodiment of the present invention below, with reference to Figures 1 to 8 attached and in which:

There schematically illustrates a chronology of the different parts of a musical gesture performed by hand, compared to percussion, keyboard playing or even bow playing;

There illustrates a front view of a support of a system for measuring at least one point of impact between an organ and a playing zone for the initiation and development of the musical gesture of the , according to a first embodiment;

There illustrates a profile view of the support of the ;

There illustrates a front view of a support of a system for measuring at least one point of impact between an organ and a playing zone for the initiation and development of the musical gesture of the , according to a second embodiment;

There illustrates a profile view of the support of the ;

There illustrates a flowchart of the different stages of a method of measuring at least one point of impact between an organ and a playing zone for the initiation and development of the musical gesture of the , according to a first alternative embodiment;

There illustrates a flowchart of the different stages of a method of measuring at least one point of impact between an organ and a playing zone for the initiation and development of the musical gesture of the , according to a second alternative embodiment; And

There schematically illustrates a device configured to measure at least one point of impact between an organ and a playing zone for the initiation and development of the musical gesture of the , according to a particular and non-limiting embodiment of the present invention.

detailed description

A method and a system for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture will now be described in what follows with joint reference in Figures 1 to 8. The same elements are identified with the same reference signs throughout the description which follows.

As indicated in the preamble to the description, current solutions for measuring musical gestures for percussion or keyboard instruments are limited on the one hand to the use of one or more impact sensors, on the other hand to a measure of crossing thresholds.

One of the objectives of the present invention is to propose a more precise and more nuanced measurement of musical gestures, adapted to the wide variety of gestures that it is possible to perform with an instrument.

This is made possible in the example described below, which considers a musical gesture performed in such a way as to reproduce the sound of a percussion instrument, a keyboard instrument or even a bowed instrument.

It will be understood here that this example is not limiting and that the method and the system according to the invention can be adapted to the restitution of sounds associated with a wide range of instruments.

According to the example of the , a musical gesture 1 can be broken down into several parts, as illustrated in a first timeline 11 illustrating an organ, here a finger, coming into contact with a surface forming a playing zone of the musical gesture 1:
- approach 111 corresponds to the period before contact between the organ and the playing zone;
- triggering 112 corresponds to the instant at which the organ comes into contact with the playing zone, potentially forming an impact of a certain force;
- maintenance 113 corresponds to the period during which the organ remains in contact with the playing zone, and for example performs different movements along the playing zone, in a continuous gesture;
- the release 114 corresponds to the end of the interview 113, that is to say the moment when the organ breaks contact with the playing zone; And
- the distance 115 corresponds to the period after contact between the organ and the playing zone.

Obviously, the organ can correspond to a variety of elements that can be used to interact with the play area, for example one or more fingers, a hand, a wand or any other appropriate tool.

The movement between the organ and the playing zone can be compared to a musical gesture of a percussion instrument, according to the second timeline 12 illustrating the sound of the percussion instrument and the third timeline 13 illustrating the movement of a organ, here a stick, opposite the playing zone, here a skin, of the percussion instrument:
- during approach 131, the stick approaches the percussion instrument, no sound is yet produced until the stick comes into contact with the skin;
- the contact between the stick and the percussion instrument generates a note or a sustained sound 121, which is for example modulated by the movement of the stick along the skin, from a first position 132 corresponding for example to the triggering, towards a second position 133 corresponding for example to relaxation;
- after the release, that is to say during the distance 134, the percussion instrument generates a progressive disappearance of the sound 122, corresponding for example to the free vibrations of the skin after impact.

Such behavior can also be adapted to the behavior of a keyboard according to the fourth chronology 14, or of a bow according to the fifth chronology 15, and for which only a sustained sound 141, 151 is generated, the sustained sound corresponding respectively to a note associated with a pressed key on the keyboard and the friction of the bow on a string. The gradual disappearance of sound after release is considered non-existent or negligible in these situations.

It therefore appears, for all of these instruments and in particular for percussion instruments, that the monitoring of the musical gesture 1 is more nuanced than the simple triggering of a note during contact between the organ and the playing zone In particular, the transcription of the interview part 131 into sustained sound 121, 141, 151 must take into account the different movements that can be carried out during this interview part 131.

In order to propose a solution to this problem, a method is provided for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of the musical gesture 1, for example the method 3 of Figures 6 and 7. Method 3 is for example implemented via a dedicated system comprising computer means configured for the implementation of method 3.

As illustrated in the , such computing means are for example advantageously grouped together in an electronic device 4, for example a calculator (hereinafter referred to as “computer”). The computer 4 is for example configured to transmit and receive data within a communications network. The elements of calculator 4, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and/or into discrete components. The calculator 4 can be produced in the form of electronic circuits and software modules.

The computer 4 comprises one (or more) processor(s) configured to execute instructions for carrying out the steps of the method and/or for executing the instructions of the software(s) embedded in the computer 4. The processor can include integrated memory, an input/output interface, and various circuits known to those skilled in the art. The calculator 4 further comprises at least one memory 40 corresponding for example to a volatile and/or non-volatile memory and/or comprises a memory storage device which may comprise volatile and/or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.

The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored on the memory 40 of the computer 4.

According to an alternative embodiment, the computer 4 is configured to implement a method of measuring at least one point of impact between at least one organ and a playing zone as part of a broader method. The method according to the invention is part, for example, of a method for restoring at least one sound from an instrument, in which the quantities determined during the method according to the invention, in particular the fourth datum described below , are used as input data for the restitution of the sound of an instrument. Such a method is for example specifically dedicated for the restitution of the sound of a given instrument, for example a percussion instrument or a keyboard instrument, or even for the restitution of the sound of a plurality of instruments, the fourth datum being for example combined with information representative of selection of an instrument among the plurality of instruments.

As illustrated in Figures 2 to 5, the system also includes, in combination with computer means, physical means associated with the musical gesture 1 and defining in particular the playing zone. The system thus comprises a support 2 having a surface defining the playing zone. game. Such a support 2 comprises for example a frame 21, delimiting an internal zone forming the game zone, and a substrate 22, assembled with the frame 21 and forming a solid base on which the member can strike. The combination of frame 21 and substrate 22 thus defines the playing zone as the portion of substrate 22 delimited by frame 21.

We understand here that the notion of support 2 must be taken in the broad sense, as a tangible physical element capable of forming the playing area on which to hit, and that it is for example possible to design a support 2 in a material flexible, for example reproducing the skin of a percussion instrument so as to be able to replace or cover such an instrument, or in a more rigid material, for example whose behavior remains substantially similar to that of a stretched skin. The support 2 can thus correspond, depending on the applications, to a more or less taut percussion skin or to a deformable textile.

In a first step 31 of the measurement method, the calculator 4 receives a first data representative of a contact between the member and the playing zone. In other words, the first data makes it possible to determine the position of the member with respect to the playing zone during the musical gesture 1, from triggering 112 until release 114. The contact between the organ and the playing zone corresponds for example to a simple position, to several different positions associated with several organs (for example several fingers), to a trajectory associated with a continuous movement of the organ, in particular during the maintenance part 113 of the musical gesture, or even to one or more contact surfaces between the organ and the zone game.

The first data thus includes for example:
- information representative of the coordinates of the organ on a marker associated with the game zone; and or
- information representative of a contact surface between the organ and the playing zone; and or
- information representative of a distance between several organs, which includes for example a speed of distance or rapprochement between several organs; and or
- information representative of the speed of variations on the playing area; and or
- information representative of acceleration of variations on said playing zone; and or
- information representative of the orientation of the organ in relation to the playing zone.

The first data is advantageously received from a first sensor 231 associated with the playing zone. As illustrated in Figures 2 and 4, for example a plurality of first position sensors 231 are provided forming a grid or a checkerboard crisscrossing the playing zone. , the first sensors 231 being arranged on the substrate 22 according to the example of Figures 3 and 5. Preferably, the first sensors 231 are grouped in a capacitive touchpad, that is to say a specific sensor allowing position monitoring precise within the playing area, in particular the tracking of one or more fingers.

According to the example of the , the first data is received by a beacon unit 42 of the computer 4, for example a beacon unit 42 in communication with the first sensor 231. The computer 4 is for example in wired or non-wired communication with the first sensor 231. According to yet another particular example, support 2 directly includes computer 4.

In a second step 32, the calculator 4 also receives a second data representative of an impact dynamic between the organ and the playing zone. In other words, the second data makes it possible to characterize the strike against the zone of play. play during triggering 112, as well as the forces applied during maintenance 113. The second data allows for example the capture of trigger gestures, providing not only a threshold but also gesture dynamics, making it possible to distinguish the typed gestures, rolling, rubbing gestures, or even to distinguish the organ used, for example an impact made with the pulp of the finger or with a nail.

The second data is advantageously received from a second sensor 232 also associated with the playing zone, like the first sensor 231. According to a first example illustrated in Figures 2 and 3, a second unique sensor 232 is provided, making it possible to measure only information relating to impact dynamics. According to a second example illustrated in Figures 4 and 5, a plurality of second sensors 232 are provided arranged at different points in the playing zone. Each sensor of the plurality of second sensors 232 measures, for example, significantly different information, making it possible to increase the precision of measuring impact dynamics, measure several distinct impacts or even associate a position estimate with impact dynamics.

Like the first data, the second data is advantageously received by the computer 4 via the beacon unit 42. According to a variant, the computer 4 comprises a plurality of distinct beacon units 42, in respective communication with the first sensor 231 and the second sensor 232.

The second data thus includes for example:
- information representative of an amplitude of an envelope of a signal from the second sensor 232; and or
- information representative of spectral content of the signal from the second sensor 232; and or
- information representative of interferometry between a plurality of second sensors 232, making it possible to approximately locate the organ or to associate the other information with a location.

The second sensor 232 comprises for example one or more piezoelectric sensors, which are known to very faithfully measure the dynamics of the impact, and thus make it possible to obtain all of the information listed above. According to a variant, the second sensor 232 comprises, in addition to or in replacement of the piezoelectric sensors, one or more accelerometers, for example grouped inside an inertial unit. Obviously, the exact information received during the second step 32 depends on the number, position and nature of the second sensors 232.

In a third optional step 33, the calculator 4, for example the beacon unit 42, receives a third data representative of a gesture of approach and/or distance of the organ with respect to the zone In other words, the third datum corresponds to datum making it possible to characterize the approach part 111 and/or the distancing part 115 of the musical gesture 1. The third datum therefore makes it possible to obtain information without that there is no contact between the organ and the playing area.

The third data includes for example:
- information representative of an orientation of the organ, that is to say of a finger, of several fingers, or even of the hand; and or
- information representative of a speed between the organ and the playing zone, for example an approach speed in the approach part 111 and a distance speed in the distance part 115, or even information representative of more complex movements; and or
- information representative of a distance between the organ and the playing zone.

The third data thus makes it possible, for example, to anticipate the triggering 112 by obtaining additional information on the way in which the organ approaches the playing zone, for example a speed making it possible to predict an impact force or an orientation making it possible to predict a position upon impact. The third data can therefore be used to supplement or anticipate the information from the first sensor 231 and/or the second sensor 232. Optionally, the third data can be used for the generation of sounds or additional effects before or after contact between the the organ and the playing area, so as to add additional variations or nuances when playing with an electronic musical instrument. The third data can for example be processed to modify the progressive disappearance of sound 122.

The third data is advantageously received from a third sensor 233. The third sensor 233 comprises for example an electric field sensor, making it possible to measure in particular the position of a hand above a surface, and therefore by extension the position of the organ above the playing zone. According to a variant, the third sensor 233 comprises an optical sensor and/or a radio sensor, or any other sensor making it possible to obtain information on the organ without requiring contact direct. The sensor is for example selected according to the type of organ considered, for example adapted in the context of using a wand or another tool.

According to the example of Figures 2 to 5, the third sensor 233 is integrated into the support 2 and arranged between the frame 21 and the substrate 22, on the periphery of the playing zone. It is understood here that the third sensor 233 does not require to be placed directly at the level of the playing zone, but simply arranged in such a way as to allow the distance between the organ and the playing zone to be determined. This arrangement thus makes it possible to limit the constraints on the dimensions of the playing zone , by associating the third sensor 233 with its periphery.

In a fourth operation, the computer 4 then determines a fourth data representative of a dynamic of the musical gesture 1. The fourth data is determined by a processing unit 41 integrated into the computer 4, the processing unit 41 corresponding for example to a integrated processor. The fourth datum is advantageously determined from the first datum and the second datum, and optionally from the third datum, when this third datum is received.

The determination of the fourth data therefore includes a combination of information from different sensors, making it possible to take advantage of the specificities of each sensor and to obtain a greater quantity of data than those used by the solutions of the prior art. This design also allows a less complex and more precise implementation than a multiplication of piezoelectric sensors. The different parts of the musical gesture 1 can thus be correctly characterized, in particular the triggering 112, the maintenance 113 and the release 114. The use of the third datum also makes it possible to characterize in more detail the approach 111 and the distance 115. Thus, the fourth datum is determined in a more precise and nuanced manner.

According to the example of the , the fourth step 34 is divided into a plurality of sub-steps 341, 342, 343, 344, 345, 346, 347 corresponding to a plurality of separate processing operations allowing the fourth data to be obtained, for example several pieces of information included in the fourth data.

Thus, in this example we provide a first sub-step 341 comprising obtaining information representative of the position of a contact point from the first data and information representative of an interview dynamic and/or or friction on the playing area from the second data. The information is then processed, for example via a first data fusion transform. Following this first sub-step 341, the processing unit 41 carries out a first determination 344 of information representative of variations in sound and/or timbre of the musical gesture 1 and a second determination 345 of information representative maintenance of the musical gesture 1. This first sub-step 341 therefore makes it possible to characterize on the one hand the type of sound associated with the musical gesture 1 via the first determination 344, on the other hand the maintenance part 113 of the musical gesture 1 via the second determination 345.

When the calculator 4 also receives the third data, the processing unit 41 also performs a second sub-step 342 of obtaining information representative of the orientation of the approach gesture, the first determination 344 and the second determination 345 being further carried out from the orientation of the approach gesture. We understand here that this second sub-step 342 makes it possible to specify additional information on the musical gesture 1, in particular the angle at which the playing zone is struck, as well as to anticipate the strike itself.

In this same example, a third sub-step 343 is provided including obtaining information representative of surface and contact variation from the first data and information representative of dynamic measurement from the second data . The information is for example processed via a second data fusion transform, and the processing unit 41 performs a third determination 346 of information representative of triggering the musical gesture 1. The third sub-step 343 and the third determination 346 thus make it possible to characterize the triggering part 112 of the musical gesture 1.

Optionally, the third sub-step 343 also includes obtaining information representative of the approach speed of the organ with respect to the playing zone from the third data, the second data fusion transform and the third determination also processing this information. The speed of approach of the organ thus makes it possible to anticipate the force of the impact between the organ and the playing zone.

Still according to the , the third step 33 can also be followed by a fourth determination 347 of information representative of an additional effect of extinction of the musical gesture 1, that is to say an additional effect associated with the distancing part 115 and/or the gradual disappearance of sound 122.

Thus, it will be understood that the present invention provides a method for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture, which makes it possible to provide precision and additional nuance in the measurement, so as to transcribe all the subtleties during the game. Such a method is for example implemented by a dedicated system associating a plurality of sensors with a playing zone, for example a system associated with an electronic musical instrument. Such a process can also be integrated into a broader process of sound reproduction of a given musical instrument.

It should be observed that this detailed description relates to a particular embodiment of the present invention, but that in no case does this description have any limiting character to the subject of the invention; on the contrary, it aims to remove any possible imprecision or misinterpretation of the claims that follow.

It should also be observed that the reference signs placed in parentheses in the claims which follow are in no way limiting in nature; The sole purpose of these signs is to improve the intelligibility and understanding of the claims which follow as well as the scope of the protection sought.

Claims (15)

Method for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture (1), said method being implemented by at least one processor, said method comprising the following steps:
- reception (31) of a first data representative of at least one position of a contact between said member and said playing zone from a first sensor (231) associated with said playing zone;
- reception (32) of a second data representative of an impact dynamic between said member and said playing zone from a second sensor (232) associated with said playing zone; And
- determination (34) of a fourth datum representing a dynamic of said musical gesture (1) from said first datum and said second datum. Method according to claim 1, wherein said determination (34) comprises the following phases:
- obtaining information representative of surface and contact variation from said first data;
- obtaining information representative of dynamic measurement from said second data; And
- determination (346) of information representative of triggering said musical gesture (1) from said information representative of surface and contact variation and said information representative of dynamic measurement,
said fourth data item comprising said information representative of triggering said musical gesture (1). Method according to claim 1 or 2, wherein said determination (34) comprises the following phases:
- obtaining information representative of the position of a contact point from said first data;
- obtaining information representative of maintenance and/or friction dynamics on said playing zone from said second data; And
- determination (344, 345) of information representative of variations in sound and/or timbre of said musical gesture (1) and of information representative of maintenance of said musical gesture (1) from said information representative of position of said point of contact and said dynamic of maintenance and/or friction on said playing zone,
said fourth data item comprising said information representative of variations in sound and/or timbre and maintenance of said musical gesture (1). Method according to one of claims 1 to 3, in which said first data item comprises:
- information representative of the coordinates of said organ on a marker associated with said game zone; and or
- information representative of a contact surface between said organ and said playing zone; and or
- information representative of a distance between several organs; and or
- information representative of the speed of variations on said playing zone and/or
- information representative of acceleration of variations on said playing zone; and or
- information representative of the orientation of said organ relative to said playing zone. Method according to one of claims 1 to 4, in which said second data item comprises:
- information representative of an amplitude of an envelope of a signal from said second sensor (232); and or
- information representative of a spectral content of said signal from said second sensor (232); and or
- information representative of interferometry between a plurality of second sensors (232). Method according to one of claims 1 to 5, which further comprises reception (33) of a third data representative of an approach and/or movement away gesture of said organ with respect to said zone of game from a third sensor (233), said fourth datum being further determined from said third datum. Method according to claim 6 in combination at least with claim 2, wherein said determination (34) further comprises obtaining information representative of the speed of approach of said member with respect to said playing zone from of said third datum, said information representative of triggering of said musical gesture (1) being further determined as a function of said information representative of approach speed. Method according to claim 6 or 7 in combination at least with claim 3, in which said determination (34) further comprises obtaining information representative of the orientation of an approach gesture from said third datum, said information representative of variations in sound and/or timbre and maintenance of said musical gesture (1) being further determined as a function of said information representative of orientation of said approach gesture. Method according to one of claims 6 to 8, in which said determination (34) further comprises a determination (347) of information representative of an additional effect of an extinction of said musical gesture (1) from said third data. Method according to one of claims 6 to 9, in which said third data item comprises:
- information representative of an orientation of said organ; and or
- information representative of a speed between said organ and said playing zone; and or
- information representative of a distance between said organ and said playing zone. Method according to one of claims 1 to 10, which further comprises a restitution of at least one sound of an instrument from said fourth data. Computer program product comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor. Computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to any one of claims 1 to 11. System for measuring at least one point of impact between at least one organ and a playing zone for the initiation and development of a musical gesture, said system comprising:
- a support (2) having a surface defining said playing zone;
- a first sensor (231) and a second sensor (232) associated with said playing zone;
- a beacon unit (42) configured to receive first data representative of at least one position of said member on said playing zone from said first sensor (231) and to receive second data representative of impact dynamics between said member and said playing zone from said second sensor (232); And
- a processing unit (41) of said first data and said second data configured to determine a fourth data representative of a dynamic of said musical gesture. Measuring system according to claim 14 comprising computer means configured for the implementation of any one of claims 2 to 11.