EP2787501A1 - Instrument de musique et dispositif de télécommande d'un processus dans l'environnement de l'instrument de musique - Google Patents

Instrument de musique et dispositif de télécommande d'un processus dans l'environnement de l'instrument de musique Download PDF

Info

Publication number
EP2787501A1
EP2787501A1 EP20140160820 EP14160820A EP2787501A1 EP 2787501 A1 EP2787501 A1 EP 2787501A1 EP 20140160820 EP20140160820 EP 20140160820 EP 14160820 A EP14160820 A EP 14160820A EP 2787501 A1 EP2787501 A1 EP 2787501A1
Authority
EP
European Patent Office
Prior art keywords
musical instrument
signal
event
sensor
music
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20140160820
Other languages
German (de)
English (en)
Other versions
EP2787501B1 (fr
Inventor
Joachim Rudhard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of EP2787501A1 publication Critical patent/EP2787501A1/fr
Application granted granted Critical
Publication of EP2787501B1 publication Critical patent/EP2787501B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/201—User input interfaces for electrophonic musical instruments for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/211—User input interfaces for electrophonic musical instruments for microphones, i.e. control of musical parameters either directly from microphone signals or by physically associated peripherals, e.g. karaoke control switches or rhythm sensing accelerometer within the microphone casing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/391—Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/395—Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing.
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/401—3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing.
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121—Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/145—Sound library, i.e. involving the specific use of a musical database as a sound bank or wavetable; indexing, interfacing, protocols or processing therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H3/00—Instruments in which the tones are generated by electromechanical means
    • G10H3/12—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument
    • G10H3/14—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument using mechanically actuated vibrators with pick-up means
    • G10H3/18—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument using mechanically actuated vibrators with pick-up means using a string, e.g. electric guitar
    • G10H3/186—Means for processing the signal picked up from the strings

Definitions

  • the present invention relates to a musical instrument for remotely controlling an operation in the environment of the musical instrument, to an apparatus for remotely controlling an operation using a musical instrument, to a corresponding method, and to a music system.
  • a musician can control stage effects and music effects via command devices, such as switches.
  • the musician can usually use a body part not used for making music.
  • the musician can operate foot-operated controls with his feet.
  • the DE 10 2008 064 330 A1 describes an arrangement for real-time control of acoustic effects.
  • the present invention provides a musical instrument for remotely controlling an operation in the environment of the musical instrument, an apparatus for remotely controlling an operation using a musical instrument, a music system for remotely controlling an operation using a musical instrument, a method of remotely controlling an operation a musical instrument and a method for creating a linkage of an event on a musical instrument with a process to be controlled in an environment of the musical instrument and finally a corresponding computer program product according to the Main claims presented.
  • Advantageous embodiments emerge from the respective subclaims and the following description.
  • the musician can perform movement patterns, ie movements and characteristic orientations of the instrument with his musical instrument, which are each associated with an effect.
  • the movement patterns can be detected on the musical instrument in a signal and processed in an evaluation logic for controlling or performing the stage effects and / or the music effects.
  • These movement patterns can be freely selected and each effect can be assigned to a gesture.
  • the musician can operate the effects independently of his position on the stage and thus enjoy increased freedom of movement.
  • the freedom of choice in the movement patterns also allows complex processes to be controlled.
  • a musical instrument can be understood as a musical instrument that can be moved by a person.
  • the musical instrument may be a plucked instrument such as a guitar, a stringed instrument such as a violin, or a wind instrument such as a flute.
  • the musical instrument may be an electronically detached instrument adapted to provide electrical music information.
  • the music information may also be provided by a sound transducer on the musical instrument.
  • a process may be a driving of a stage effect.
  • the process may be a recording of music information.
  • the process may be playing the music information or a pre-deposited further music information.
  • the process may be an activation and, alternatively or additionally, influencing an effect for changing the musical information of the musical instrument.
  • An event may be a willful act performed on the musical instrument.
  • the musical instrument may be held and / or moved in a predetermined manner to trigger the signal.
  • the musical instrument may be used in a predetermined manner to trigger the signal.
  • the sensor device may comprise a mobile sensor carrier and a detachable interface to the sensor carrier, wherein the sensor carrier has a multi-axis acceleration sensor and alternatively or additionally a multiaxial rotation rate sensor which is rigidly coupled to the musical instrument via the mechanical interface, and is adapted to a movement of the Music instrument as an event to capture and map in the signal.
  • a sensor carrier may be a removable device that can be attached to the musical instrument via the interface.
  • the interface can be executed mechanically and additionally electrically.
  • the sensor carrier may be latched to the musical instrument.
  • the interface can be designed as a plug connection, via which electrical signals can be transmitted.
  • the sensor carrier When the sensor carrier is attached to the musical instrument, the sensor can detect movements of the musical instrument. Through the sensor carrier, the event can also be detected on a musical instrument without integrated electronics.
  • the sensor device may comprise a position sensor and a signal generator, wherein the position sensor is adapted to detect a position of the musical instrument in space and to image in the signal and wherein the signal generator is adapted to detect an action of an operator of the musical instrument and in an acknowledgment signal
  • the sensor device is designed to provide the signal when the position and the confirmation signal correspond to predetermined parameters.
  • a position sensor may determine a direction of gravitational acceleration with respect to at least one reference axis of the position sensor and thus with reference to a reference axis of the musical instrument.
  • the position sensor may also have a plurality of reference axes.
  • a signal generator can, for example, a Switch, a button, a lever or a pressure sensor. Via the signal generator, a clear, position-independent action of the operator can be detected, which in combination with the position of the musical instrument can be unambiguously assigned to an operation to be carried out.
  • the signal generator can be embodied as an audio analysis device, wherein the audio analysis device is designed to analyze a music signal of the musical instrument and to provide the confirmation signal if the music signal fulfills at least one predetermined criterion.
  • An audio analysis device can read in frequencies generated by the musical instrument and examine for predetermined frequency patterns. If there is a match, the acknowledge signal may be provided.
  • the sound analysis device may be connected to an electrical signal of the musical instrument.
  • the sound analysis device may have its own sound transducer, via which a sound of the musical instrument is converted into the electrical signal. By the sound analysis device, the operator can generate a predetermined sound sequence or a predetermined sound or harmony to trigger the confirmation signal.
  • a device for receiving may be an interface to the musical instrument.
  • a means for associating may be formed be to analyze the signal.
  • the means for assigning may be configured to compare the event underlying the signal with a stored image of a predetermined and event.
  • the means for assigning may comprise a look-up table in which a plurality of different associations between events and control sequences are stored.
  • a control sequence may include one or more instructions for performing the operation. In the control sequence, a predetermined pause may be stored between two consecutive commands. In the control sequence, a processing instruction may be stored for the event, which converts at least one component of the signal as an input variable into a command parameter for driving the process.
  • a means for driving may be configured to convert the control sequence into electrical signals for driving connected devices. The means for driving can be configured to process the control sequence itself.
  • the means for driving may be further configured to communicate with a network and, in response to the control sequence, request a music file from the network and provide it as music information for a peripheral of the musical instrument.
  • the means for driving may be adapted to process a music information of the musical instrument to a music file and deposited in the network.
  • a network can be a data network.
  • the network can be the Internet.
  • the network may be a local computer network.
  • the device for activating can be designed to access at least one storage medium of the network via a communication protocol.
  • the means for driving may comprise an analog-to-digital converter.
  • the A / D converter can convert analog music information into digital music files and vice versa.
  • a peripheral may be, for example, an amplifier and speakers.
  • the sensor device of the musical instrument may include a mobile data device as a sensor carrier, which is attachable to the musical instrument.
  • the data device may be a mobile phone or a digital music player or a tablet computer.
  • the data device may be a smartphone.
  • the data device can be connected to the musical instrument via a device-specific interface.
  • the musical instrument may have a matching recess for integrating the data device into the musical instrument.
  • the data device may have at least one wireless communication interface via which it is possible to communicate with commercially available peripheral devices and / or networks.
  • the functions of the device for remote control via at least one computer program can be executed, which controls the electronic components of the data device.
  • an application can perform a software implementation of the functions of the device.
  • a plug & play solution can be set on the musical instrument.
  • the data device can have a simple operability.
  • the device may be configured to receive via an interface a musical information of the musical instrument, the device being designed to change as a process the music information using a program code and the event to obtain an altered music information.
  • the device may be configured to provide the altered music information.
  • the data device can have a powerful processor.
  • the data device may include a processor powerful enough to process the music information in real time.
  • the data device can be designed to store the music information and / or the changed music information and to play them with a time delay. By directly changing on the data device, a Variety of changes in the music signal can be influenced directly on the musical instrument.
  • a computer program product with program code which can be stored on a machine-readable carrier such as a semiconductor memory, a hard disk memory or an optical memory and is used to carry out the method according to one of the embodiments described above if the program product is installed on a computer or a device is also of advantage is performed.
  • Fig. 1 shows a block diagram of a music system 100 according to an embodiment of the present invention.
  • the music system comprises a musical instrument 102 according to an embodiment of the present invention and a device 104 for remotely controlling an operation 106 using the musical instrument 102.
  • the musical instrument 102 is designed to remotely control a process in the environment of the musical instrument 102.
  • the musical instrument 102 has a sensor device 108 for detecting a user-triggered event 110 on the musical instrument 102.
  • the sensor device 108 is designed to detect the event 110, to map it in a signal 112 and to transmit it to the device 104 for remote control.
  • the device 104 comprises means 114 for receiving, means 116 for addressing, and means 118 for driving.
  • the receiving device 114 is configured to receive the signal 112 representative of the user initiated event 110 on the musical instrument 102.
  • the device 114 for receiving is connected to the sensor device 108 of the musical instrument 102.
  • Means 116 is adapted to associate event 110 with event 106 to be addressed in the environment of musical instrument 102 using a stored link 120 between event 110 and a control sequence 122 for the event.
  • the means 118 for driving is configured to control the process 106 using the control sequence 122.
  • sensor device 108 includes a mobile sensor carrier and a detachable interface to the sensor carrier.
  • the sensor carrier has a multiaxial acceleration sensor and, alternatively or additionally, a multiaxial rotation rate sensor.
  • the acceleration sensor and, alternatively or additionally, the rotation rate sensor can be coupled rigidly to the musical instrument 102 via the mechanical interface.
  • the acceleration sensor and, alternatively or additionally, the rotation rate sensor is designed to detect a movement of the musical instrument 102 as an event 110 and to map it in the signal 112.
  • the sensor device 108 has a position sensor and a signal generator.
  • the position sensor is designed to detect a position of the musical instrument 102 in space and to image it in the signal 112.
  • the signal generator is designed to detect an action of an operator of the musical instrument 102 and to map it in an acknowledgment signal.
  • the sensor device 108 is configured to provide the signal 112 when the position and the confirmation signal correspond to predetermined parameters.
  • the signal generator is configured as an audio analysis device, wherein the audio analysis device is designed to analyze a music signal of the musical instrument 102 and to provide the confirmation signal if the music signal fulfills at least one predetermined criterion.
  • the device 104 is embodied as a mobile data device that can be attached to the musical instrument 102, wherein the data device further comprises a component of the sensor device 108 in order to provide the signal 112.
  • the device 104 has an interface for receiving musical information of the musical instrument 102.
  • the device 104 is configured to change the music information as a process 106 using a program code and the event 110 in order to obtain changed music information.
  • the device 104 is configured to provide the altered music information.
  • the means 118 for driving is further adapted to communicate with a network, not shown, and to request a music file from the network in response to the stored control sequence and to provide music information for a periphery of the musical instrument 102.
  • the means 118 for driving is adapted to process a music information of the musical instrument 102 to a music file and deposited in the network.
  • FIG. 12 shows a flowchart of a process 200 for remotely controlling an operation using a musical instrument according to an embodiment of the present invention.
  • the method 200 includes a step 202 of receiving, a step 204 of assigning, and a step 206 of driving.
  • the method can be used on a device for remote control, as in Fig. 1 is shown executed.
  • step 202 of receiving a signal representing a detectable event on the musical instrument is received.
  • step 204 of the assignment the event is assigned to an activity to be controlled.
  • the process takes place in the environment of the musical instrument.
  • the event is assigned to the process using a stored link between the event and a control sequence for the operation.
  • step 206 of the drive the process is driven using the control sequence.
  • step 202 of receiving a position signal from at least one position sensor coupled to the musical instrument is read in to detect a position of the musical instrument in space as a detectable event.
  • a confirmation signal is read in from a signal generator disposed on the musical instrument to detect the event.
  • the signal generator can be designed as a proportional encoder to represent a physical quantity that is impressed by the operator proportionally in the confirmation signal.
  • step 202 of receiving a motion signal from at least one motion sensor coupled to the musical instrument is read to detect movement of the musical instrument as a detectable event.
  • FIG. 12 shows a flowchart of a method 300 for establishing a linkage of an event on a musical instrument with a process to be controlled in an environment of the musical instrument according to an exemplary embodiment of the present invention.
  • the method 300 includes a step 302 of detecting, a step 304 of reading, a step 306 of making and a step 308 of storing.
  • step 302 of the capture a control sequence for the process is detected.
  • step 304 of the read-in at least one signal of a sensor device coupled to the musical instrument is read in to detect the event in the sensor signal. The signal is read in when the event is performed on the musical instrument.
  • step 306 of manufacturing the linkage of the event to the process is made using the signal and the control sequence to obtain the link.
  • the link is stored in a memory.
  • Fig. 4 shows a representation of a musical instrument 102 with a sensor device 108 (sensor) for controlling effects by gesture recognition in musical instruments 102 according to an embodiment of the present invention.
  • the musical instrument 102 is an electric guitar 400 in this exemplary embodiment.
  • the sensor device 108 is embodied as an electrical circuit 402 and integrated in a body of the electric guitar 102.
  • a multiaxial acceleration sensor 404 and / or a multiaxial rotation rate sensor 406 are integrated into the electrical circuit 402.
  • the acceleration sensor 404 is configured to detect an acceleration force 408 that acts on the musical instrument 102 and to map it in an electrical acceleration signal.
  • the acceleration sensor 404 is configured to resolve acceleration forces 408 in different spatial directions.
  • the acceleration signal may include, for example, a first component, a second component, and a third component, the first component representing a first portion of the acceleration force 408 in a first spatial direction, the second component Component represents a second portion of the acceleration force 408 in a second spatial direction and the third component represents a third portion of the acceleration force 408 in a third spatial direction.
  • the rotation rate sensor 406 is configured to detect a rotation 410 of the musical instrument 102 and to map it in an electrical rotation rate signal.
  • the rotation rate sensor 406 is designed to resolve rotations 410 in different spatial directions.
  • the yaw rate signal may include a first component, a second component, and a third component, wherein the first component represents a first portion of rotation 410 about the first spatial direction, the second component represents a second portion of rotation 410 about the second spatial direction, and the third component Component represents a third portion of the rotation 410 around the third spatial direction.
  • the freedom of as many axes in space as possible allows many movement patterns on the guitar 400 and artistic freedom.
  • the approach presented here is shown concretely using the example of an electric guitar (electric guitar) 400.
  • Electric Guitars 400 are available in various designs. All have in common that the vibration of a page by a pickup (magnet) is converted into an electrical signal.
  • This signal can be processed. When working up, the signal is subjected to sonic changes produced by different effects. The best known is the “distortion”. The signal is made audible by means of an amplifier via loudspeaker. Electronic systems that change the signal (reverb, echo, distortion, octave, distortion, etc.) can be discrete and then turned on or off with a footswitch. In the case of increasing and decreasing sound effects, the sound effect can be controlled with the deflection of the foot position. The best known is the "Wah Wah”.
  • the guitar 102 is correspondingly rhythmically moved while playing, or the artist's perception or the expression of the music is used underlining, according to the approach presented here, it can be freer and also more free in appearance between differently applied motion sensors / sensors 108 Sound effects are switched or light effects are controlled or so-called “tape machines” (nowadays digitally stored on soundtracks rhythms or melodies, sometimes as endless loops) are started, or generally further independent functions are controlled or operated.
  • the effects of the electric guitar 400 in the approach presented here are no longer switched on or off with a footswitch.
  • a signal is controlled and changed.
  • the acceleration 408 or the rate of rotation 410 of the guitar 400 is detected by means of corresponding MEMS sensors 404, 406.
  • small-sized sensors 404, 406 are suitable.
  • the sensors can be configured as multiaxial acceleration sensors 404 and / or yaw rate sensors 406.
  • the signals can be transmitted both via connection cable or optically but also by radio. This can be realized for example by means of Bluetooth or other transmission systems.
  • Fig. 4 is the approach presented here using the example of an electric guitar 400 described. Other instruments like an electric bass, etc. are just as easy implemented.
  • the multi-axis acceleration sensors 404 and yaw rate sensors 406 and the necessary electronics 402, or additional switching elements and control elements are housed.
  • a handle identifier is integrated into the electronics 402.
  • at least one button / switch is integrated in the body.
  • a pressure sensor is integrated on the guitar body on the back.
  • the control can also be designed as a lever, similar in execution to a tremolo lever.
  • a primary signal conditioning and power supply such as a 9V battery, is integrated with the electronics 402.
  • FIG. 12 shows an illustration of a music system 100 with multiple controllable operations 106 according to one embodiment of the present invention.
  • the music system 100 corresponds to the music system in Fig. 1
  • the musical instrument 102 is as in FIG Fig. 4 an electric guitar 400.
  • the electric guitar 400 is connected to the device 104 via a radio transmission system 500.
  • the radio transmission system 500 is designed as a two-way system in this embodiment.
  • the radio communication system 500 transmits a music signal of the electric guitar 400 to the device 104.
  • the music signal is looped through the device and delivered as needed to the various units 502 for performing the operations 106.
  • three units 502 are connected to the device 104.
  • the first unit 502 is designed to control a number of lighting effects and is therefore connected to a light control 504.
  • the second unit 502 is configured to perform a number of sound effects on the music signal of the electric guitar 400 and to provide an altered music signal.
  • the second unit 502 is connected to an input of an amplifier 506 of the electric guitar 400.
  • the amplifier 506 is connected to at least one speaker 508 for reproducing the sounds of the electric guitar 400.
  • the third unit 502 is configured to perform further effects.
  • the third unit 502 is adapted to store the music signal, for example, on tape or a semiconductor memory and play back again.
  • the gesture 510 is detected by the sensor unit of the electric guitar 400 and transmitted as a signal via the signal transmission 500 to the device 104.
  • the gesture 510 is recognized and compared with stored gesture patterns. If a match is detected within a tolerance range, action 106 associated with the recognized gesture pattern is triggered.
  • music sequences with a gesture of the guitar 400 can be recorded and played with a different gesture.
  • the overall system 100 has a "learning function" of the corresponding gestures or movement patterns to avoid false triggering.
  • a corresponding gesture is assigned to a switching function.
  • the corresponding units can be installed in the guitar body.
  • the music system 100 is ANDed with a controller.
  • a pushbutton or switch or a pickup for detecting certain finger images on the guitar 400 can be read in as a control element in accordance with the tripping characteristic.
  • This control element can also be embodied as a pressure sensor in the guitar body at the rear and in turn independently trigger an effect depending on the pressure, respond to an effect device or trigger another event remotely.
  • the pressure sensor or the sensor plate can be harmoniously integrated into the artistic embodiment by pressing the instrument 102 against the body of the operator.
  • controllable effects according to the approach presented here need not be exclusively on and off operations. It is also possible to control swelling and decaying effects such as the "Wah Wah” effect. Likewise, lighting effects can be controlled. Deposited soundtracks can be faded in and out. The artist can thus trigger the corresponding effects at any location on the stage and is thus not on a specific location for switching effects reliant.
  • the freedom and inclusion of physical expression, for example, on the electric guitar with the triggering of sound or light effects, a "more" of total artistic freedom is possible.
  • motion patterns can be processed, different events detected by the electronics and wired directly or via any wireless connection of a transmitter 500 to the sound signals or separately from the sound signals to a receiver 500 are transmitted.
  • the decoding of the signal information can be done after the receiver 500 in a downstream logic unit 104. This assigns the corresponding information to particular channels 106, which in turn are processed in the corresponding control units 502 for light 504, sound 506 and other effects.
  • the artist's desire for a changed sound, light effect or the start of a soundtrack, pyrotechnics or the like is implemented.
  • FIG. 12 shows a representation of various signal generators 600 for a musical instrument according to embodiments of the present invention.
  • the first signal transmitter 600 is designed as a switch.
  • the switch has a stable first switching position and at least a second stable switching position.
  • the first signal generator 600 can also be designed as a push button with a stable switching position and an unstable switching position.
  • the second signal generator 600 is designed as a lever.
  • the lever may be configured to convert a pressure force and / or a tensile force of the musician into a signal that is proportional to the force.
  • the confirmation signal may be provided if the force is greater than a threshold.
  • the third signal generator 600 is designed as a music signal analysis device. The current sound or tones of the musical instrument are evaluated. If the tone or tones correspond to a stored tone pattern, the confirmation signal is provided.
  • FIG. 12 shows a block diagram of a music system 100 with wired transmission and / or radio transmission according to an embodiment of the present invention.
  • the music system 100 has as in Fig. 1 a musical instrument 102 and a device 104 for remotely controlling an operation in the environment of the musical instrument 102.
  • the musical instrument 102 for remotely controlling the process has a pickup 700 for generating analog music information 702.
  • the musical instrument 102 has, as in Fig. 1 a sensor device 108 for generating a signal 112. Signal 112 is provided digitally in this embodiment.
  • the musical instrument 102 further includes a preamplifier 704.
  • the pre-amplifier 704 (Pre Amp) is configured to merge the analog music information 702 and the digital signal 112 into a mixed signal 706 and to transmit them via a common connection line 708 to the device 104.
  • the sensor device 108 has an acceleration sensor 404 and a yaw rate sensor 406 and an electrical circuit 402.
  • the acceleration sensor 404 provides an acceleration signal 710 to the electrical circuit 402.
  • the yaw rate sensor 406 provides a yaw rate signal 712 to the electrical circuit 402.
  • the electrical circuit 402 is configured to combine the acceleration signal 710 and the rotation rate signal 712 to the signal 112. In the device 104, the mixed signal 706 is again separated into the digital signal 112 and the analog music information 702.
  • At least one effect 714 for changing the music information 702 is activated.
  • the effect 714 provides altered music information 716 for an amplifier 718 (amp) when the effect 714 is activated. If the effect 714 is inactive, the effect 714 provides the unaltered music information 702 to the amplifier 718.
  • the amplifier 718 drives at least one speaker 720 (speaker), where the analog music information 702 and the changed music information 716, respectively, are converted to sound.
  • connection line 708 is replaced by a wireless connection 500.
  • the composite signal 706 is transmitted to the device 104.
  • the device 104, the effect 714 and the amplifier 718 are arranged in this embodiment in a common unit, which is connected directly to the speaker 720.
  • the music system 100 includes both the wired connection line 708 and the wireless connection 500.
  • the connection line 708 is connected to a Wired first effect 714 connected.
  • the wireless connection 500 is connected to an in-device integrated effect 714.
  • the musical instrument 102 may be permanently equipped with MEMS technology generated sensors 404, 406.
  • the sensors 404, 406 may be mechanically integrated into the musical instrument 102.
  • the sensors 404, 406 can detect the position in space and / or the acceleration of the instrument 102 in order to expand the information density.
  • the musical instrument 102 may be a stringed instrument.
  • the sensors 404, 406 may be multiaxial acceleration and yaw rate sensors 404, 406.
  • a sensor can be a pressure sensor.
  • the pressure sensor can serve as a switch for verifying a control request of the operator.
  • the pressure sensor can be used to control an effect for itself depending on the pressure.
  • the pressure sensor can also be used as a verification device for the confirmation of the control request.
  • Information from motion patterns can trigger effects on secondary devices that affect all existing sensory impressions.
  • the effects can trigger further effects due to movement patterns of the musical instrument.
  • the effects can be lighting, acoustic or pyrotechnic applications.
  • the effects can start more complex applications.
  • the complex applications may be, for example, movements of revolving stages, lifting platforms or motors.
  • FIG. 12 shows a block diagram of a music system 100 having a sensor carrier 800 according to an embodiment of the present invention.
  • the music system 100 consists of a musical instrument 102 and a device 104 for remotely controlling a process in the environment of the musical instrument 102.
  • the sensor unit of the musical instrument 102 has an interface 802.
  • the interface 802 is designed to mechanically secure the sensor carrier 800 to the musical instrument 102.
  • the interface 802 is designed to be detachable.
  • the sensor carrier has an acceleration sensor 404 and a yaw rate sensor 406 and an electrical circuit 402.
  • the acceleration sensor 404 provides an acceleration signal 710 to the electrical circuit 402.
  • the yaw rate sensor 406 provides a yaw rate signal 712 to the electrical circuit 402.
  • the electrical circuit 402 is configured to receive the acceleration signal 710 and the
  • the signal 112 is transmitted to the device 104 via a wireless connection 500.
  • the wireless connection 500 may be established, for example, via a communication protocol such as Bluetooth.
  • the device 104 is connected to a conventional effect device 714.
  • the effects device 714 is connected via a cable 708 to a preamplifier 704 and above to at least one pickup 700 of the musical instrument. Through the cable 708, the effects device 714 receives music information 702 from the musical instrument 102.
  • the effects device 714 may be connected to a switch 714 for driving the effect 714. Through the switch 804, the effect 714 can be controlled independently of a movement pattern on the musical instrument 102 by hand and / or foot. As in Fig. 7 the effect device 714 is connected to an amplifier 718 and at least one speaker 720.
  • the interface 802 is configured to transmit the music information 702 to the sensor carrier 800 via an interface.
  • the sensor carrier has a processor 806.
  • the processor 806 is connected to the electrical circuit 402.
  • the processor 806 is configured to process the music information 702 in response to detection of a characteristic motion sequence via the acceleration sensor 404 and / or the rotation rate sensor 406.
  • the processor 806 is configured to change the music information 702 and provide altered music information in response to the recognition.
  • the processor 806 is configured to store the music information 702 in response to the recognition of the characteristic motion sequence and to play in response to the detection of another characteristic motion sequence.
  • processor 806 is connected to a non-illustrated network via another wireless connection 808.
  • the processor 806 is connected to the Internet.
  • the music information 702 is transmitted over a radio link to the processor 806.
  • the music information may be transmitted via a communication protocol such as Bluetooth.
  • the sensor carrier 800 is designed as a mobile data device 800.
  • the data device 800 may be a smartphone, a tablet computer, or a portable digital music player.
  • At least one application 810 is installed on the data device 800, which activates the processor 806 in order to control the music information 702 according to the approach presented here via movement patterns.
  • the application 810 may also trigger stage effects, such as light effects, fog effects, and / or a background noise independently of the music information 702, in response to detected movement patterns.
  • a smartphone 800, a tablet computer 800 or a portable digital music player 800 can temporarily be adapted to the electric guitar 102 by means of a recording 802 in the case of a correspondingly designed interface 802 be applied.
  • the data device 800 is connected via Bluetooth or a plug connection with a corresponding cable to the guitar 102 or the transmitter of the sound information 702.
  • the data device 800 thus assumes the function of movement pattern recognition.
  • the Smartphone 800 can be mounted both on the front and on the back of the carcass or on the bridge. Depending on the mounting location can be accessed by means of an input surface of the device 800 and its functionality and used accordingly.
  • the interface 802 may also be bidirectional and signals and / or information may be transferred in both directions.
  • a corresponding "app" 810 provides the smartphone 800 with the necessary information. Accordingly, no major changes to a conventional guitar are required. This also older guitars can use the possibilities of movement pattern recognition.
  • the audio signals are transmitted directly to the amplifier 718 via wireless transmission.
  • the interface 808 is bi-directional.
  • experiences, pictures, video etc. can be shared with friends via virtual worlds or social networks.
  • the bidirectional interface 808 sound sequences, guitar riffs, or entire pieces of music can be recorded directly live and uploaded via smartphone 800 to the Internet to share them with friends. Analogous to a "netmeeting" different musicians can come together in different places to play together over the net.
  • the term smartphone is used by way of example for mobile data devices 800 of different variants.
  • the interface 802 is an interface of the electronic device 800, which has indicators 404, 406 for detecting the position and the positional change in space. The position and the change in position are used for influencing the sensory perception of living beings by transferring the signals of the indicators 404, 406 for further processing.
  • the interface 802 may be designed such that it is a wireless interface, a radio interface or an optical fiber interface for optical or electrical connection, which transmits the information 112 generated by the indicators 404, 406.
  • the interface 802 may be bidirectional.
  • the electronic device 800 may be used in the original sense for another application.
  • the electronic device 800 may be temporarily or permanently connected to the interface with a musical instrument.
  • the electronic device 800 may become part of a new larger system through the connection.
  • the indicators 404, 406 may be fabricated by a MEMS process and may temporarily become part of a sound producing system 102.
  • the indicators 404, 406 may be acceleration and / or rotation rate sensors 404, 406 or pressure sensors.
  • the indicators 404, 406 can detect several or all degrees of freedom in space depending on or independent of movements.
  • the signals 112 may be further processed for the purpose of influencing sensory impressions.
  • the signals 112 may be further processed by devices 104 or devices 104 for the purpose of indirectly influencing sensory impressions.
  • the signals 112 may be further processed for the purpose of influencing secondary effects.
  • the signals 112 can be used to further process devices 104 or devices 104, which can trigger subsequent reactions with one another.
  • the Electronic device 800 may be a smartphone 800 or a similar device corresponding to the function.
  • the electronic device 800 can exchange unidirectional or bidirectional information with the string instrument 102 via the interface 802.
  • the string instrument 102 may be an electric guitar or an electric bass, violin, etc.
  • an exemplary embodiment comprises a "and / or" link between a first feature and a second feature, then this is to be read so that the embodiment according to one embodiment, both the first feature and the second feature and according to another embodiment either only first feature or only the second feature.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
EP14160820.8A 2013-04-05 2014-03-20 Instrument de musique, système musical et méthode de télécommande d'un processus dans l'environnement de l'instrument de musique Not-in-force EP2787501B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE201310206073 DE102013206073A1 (de) 2013-04-05 2013-04-05 Musikinstrument und Vorrichtung zum Fernsteuern eines Vorgangs im Umfeld des Musikinstruments

Publications (2)

Publication Number Publication Date
EP2787501A1 true EP2787501A1 (fr) 2014-10-08
EP2787501B1 EP2787501B1 (fr) 2017-01-04

Family

ID=50343648

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14160820.8A Not-in-force EP2787501B1 (fr) 2013-04-05 2014-03-20 Instrument de musique, système musical et méthode de télécommande d'un processus dans l'environnement de l'instrument de musique

Country Status (2)

Country Link
EP (1) EP2787501B1 (fr)
DE (1) DE102013206073A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202017100648U1 (de) 2017-02-08 2017-05-15 Niklas Jakob Läsche Anordnung für elektronische Saiteninstrumente sowie Schlagbrett für Saiteninstrumente
WO2019064035A1 (fr) * 2017-09-29 2019-04-04 Bognar Andras Système programmable de traitement de signaux et de configuration d'instrument de musique pour instruments de musique à cordes, et procédé de programmation et d'exploitation du système

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015107166A1 (de) * 2015-05-07 2016-11-10 Learnfield GmbH System mit einem Musikinstrument und einer Rechenvorrichtung

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030196542A1 (en) * 2002-04-16 2003-10-23 Harrison Shelton E. Guitar effects control system, method and devices
US20070169615A1 (en) * 2005-06-06 2007-07-26 Chidlaw Robert H Controlling audio effects
US20090100988A1 (en) * 2007-10-19 2009-04-23 Sony Computer Entertainment America Inc. Scheme for providing audio effects for a musical instrument and for controlling images with same
DE102008064330A1 (de) 2008-12-17 2010-09-02 Arthur Schmidt Anordnung zur Echtzeitsteuerung von akustischen Effekten
WO2011000059A1 (fr) * 2009-07-03 2011-01-06 Starplayit Pty Ltd Procédé d'obtention d'une sélection d'utilisateur
DE102011003976B3 (de) * 2011-02-11 2012-04-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Eingabeschnittstelle zur Erzeugung von Steuersignalen durch akustische Gesten
US20120210849A1 (en) * 2011-02-17 2012-08-23 Rockerswitch, Llc Microprocessor controlled, accelerometer based guitar pickup switching system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030196542A1 (en) * 2002-04-16 2003-10-23 Harrison Shelton E. Guitar effects control system, method and devices
US20070169615A1 (en) * 2005-06-06 2007-07-26 Chidlaw Robert H Controlling audio effects
US20090100988A1 (en) * 2007-10-19 2009-04-23 Sony Computer Entertainment America Inc. Scheme for providing audio effects for a musical instrument and for controlling images with same
DE102008064330A1 (de) 2008-12-17 2010-09-02 Arthur Schmidt Anordnung zur Echtzeitsteuerung von akustischen Effekten
WO2011000059A1 (fr) * 2009-07-03 2011-01-06 Starplayit Pty Ltd Procédé d'obtention d'une sélection d'utilisateur
DE102011003976B3 (de) * 2011-02-11 2012-04-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Eingabeschnittstelle zur Erzeugung von Steuersignalen durch akustische Gesten
US20120210849A1 (en) * 2011-02-17 2012-08-23 Rockerswitch, Llc Microprocessor controlled, accelerometer based guitar pickup switching system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202017100648U1 (de) 2017-02-08 2017-05-15 Niklas Jakob Läsche Anordnung für elektronische Saiteninstrumente sowie Schlagbrett für Saiteninstrumente
WO2019064035A1 (fr) * 2017-09-29 2019-04-04 Bognar Andras Système programmable de traitement de signaux et de configuration d'instrument de musique pour instruments de musique à cordes, et procédé de programmation et d'exploitation du système
US11205409B2 (en) 2017-09-29 2021-12-21 András BOGNÁR Programmable signal processing and musical instrument setup system for stringed musical instruments, and method for programming and operating the system

Also Published As

Publication number Publication date
EP2787501B1 (fr) 2017-01-04
DE102013206073A1 (de) 2014-10-09

Similar Documents

Publication Publication Date Title
US11625994B2 (en) Vibrotactile control systems and methods
DE102011003976B3 (de) Eingabeschnittstelle zur Erzeugung von Steuersignalen durch akustische Gesten
JP6563603B2 (ja) 周波数変化によって実時間振動を提供する振動提供システム及び振動提供方法
EP2787501B1 (fr) Instrument de musique, système musical et méthode de télécommande d'un processus dans l'environnement de l'instrument de musique
DE112021001491T5 (de) Decodierer, decodierverfahren, programm, codierer und codierverfahren
CN104754466A (zh) 使用扬声器的用户接口装置及其方法
CN101425004B (zh) 用声音作为计算机系统输入控制的方法和装置
DE102014204630A1 (de) Mobile Vorrichtung für immersive Sounderlebnisse
DE202017106383U1 (de) Fühlbare Basswiedergabe
WO2011107459A1 (fr) Appareil de commande pour une console de jeu ainsi que procédé pour la commande d'une console de jeu
DE112004002940T5 (de) Automatische Abspielvorrichtung für eine akustische/elektrische Gitarre
DE112017002171B4 (de) Laser-Trigger für eine Bassdrum
DE112019004528T5 (de) Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahrenund programm
JP2014526183A (ja) テレビジョン受信機用のセンサ手段
JP6346245B2 (ja) 玩具システム、玩具体の制御方法、及びプログラム
JP6043518B2 (ja) 玩具体、制御方法、プログラム、及び玩具システム
DE102010038550A1 (de) Verfahren und eine Vorrichtung zum Steuern von Aktionen mehrerer Fahrzeuge
DE102018211133A1 (de) Audioeinrichtung für ein Fahrzeug und Verfahren zum Betrieb einer Audioeinrichtung für ein Fahrzeug
US12008892B2 (en) Vibrotactile control systems and methods
DE102014101991A1 (de) Musikinstrumentenanordnung
DE102010011484A1 (de) Musikinstrumentenanordnung
WO2004008300A2 (fr) Dispositif pourvu d'un ou plusieurs capteurs de mouvement, adaptateur et support de memoire lisible par processeur
DE102013020990B4 (de) Kraftfahrzeug und Verfahren zum Bereitstellen eines vorbestimmten akustischen Signals für ein Bedienelement
DE102008039967A1 (de) Verfahren zum Betrieb eines elektronischen Klangerzeugungsgerätes und zur Erzeugung kontextabhängiger musikalischer Kompositionen
DE102017202226A1 (de) Steuergerät und Verfahren zur Wiedergabe von digitalen Audiodateien auf einem handhaltbaren Audiowiedergabegerät

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17P Request for examination filed (corrected)

Effective date: 20150408

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20151208

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160822

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 859928

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502014002377

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Ref country code: NL

Ref legal event code: MP

Effective date: 20170104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170405

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170404

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170504

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170404

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170504

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502014002377

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170320

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170331

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20180320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140320

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20190520

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20200325

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20200324

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170104

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 859928

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190320

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502014002377

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210320