EP3204935A1 - Dispositif de commande, procédé de fonctionnement d'un tel dispositif et système audiovisuel - Google Patents
Dispositif de commande, procédé de fonctionnement d'un tel dispositif et système audiovisuelInfo
- Publication number
- EP3204935A1 EP3204935A1 EP15804896.7A EP15804896A EP3204935A1 EP 3204935 A1 EP3204935 A1 EP 3204935A1 EP 15804896 A EP15804896 A EP 15804896A EP 3204935 A1 EP3204935 A1 EP 3204935A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light beams
- function
- optical sensor
- signal
- optical paths
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 16
- 230000003287 optical effect Effects 0.000 claims abstract description 158
- 230000000694 effects Effects 0.000 claims abstract description 42
- 238000001514 detection method Methods 0.000 claims description 12
- 230000000007 visual effect Effects 0.000 claims description 9
- 230000001131 transforming effect Effects 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 3
- 238000005259 measurement Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 46
- 230000008901 benefit Effects 0.000 description 10
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000004913 activation Effects 0.000 description 4
- 238000003776 cleavage reaction Methods 0.000 description 4
- 230000007017 scission Effects 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 3
- 229910044991 metal oxide Inorganic materials 0.000 description 3
- 150000004706 metal oxides Chemical class 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 239000002184 metal Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
- G10H1/04—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
- G10H1/053—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only
- G10H1/055—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by switches with variable impedance elements
- G10H1/0553—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by switches with variable impedance elements using optical or light-responsive means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/405—Beam sensing or control, i.e. input interfaces involving substantially immaterial beams, radiation, or fields of any nature, used, e.g. as a switch as in a light barrier, or as a control device, e.g. using the theremin electric field sensing principle
- G10H2220/411—Light beams
Definitions
- the present invention relates to a control device, a method of operating such a device and an audiovisual system.
- the present invention applies to the field of non-contact control devices.
- the present invention is applicable to electronic musical instruments.
- Non-contact control devices are mainly control devices on presentation of an object or by interruption of a light beam, such as a laser for example. These control devices make it possible to switch from one state to another, such as the opening of a door, or the start-up of an appliance.
- Modulating devices of an intensity, sound or light for example, use a potentiometer and require a contact of the user. These devices allow modulation of an intensity. These devices exclude the possibility of switching from one state to another over the proposed range of intensities without going through all the intermediate intensities.
- US Pat. No. 8,835,739 discloses a device that makes it possible to play previously recorded sounds by interrupting lasers.
- the device disclosed in patent FR 2 777 107 makes it possible to produce sounds by interrupting a laser by means of a rod.
- the baton interrupts the laser for the first time to play the sound and a second time to interrupt the sound.
- the velocity of the rod being measured by device object of patent FR 2 777 107, the sound produced is more or less strong depending on this velocity.
- a sequence of sounds is prerecorded and the sound played, for example a note, is independent of the will of the user.
- the present invention aims to remedy all or part of these disadvantages.
- the present invention is directed to a device for controlling a parameterizable audiovisual effect, which comprises:
- means for generating at least two optical paths traversed by non-parallel light beams comprising at least one optical sensor and at least one emitter of at least one light beam, means for measuring the speed of an object traversing at least two light beams as a function of a signal emerging from at least one optical sensor representing the cutting of the optical paths by the object,
- Position control means of a parameter value of an audiovisual effect according to the estimated longitudinal position.
- the user can, for example, create a melody or control different devices, such as devices producing visual effects, depending on the estimated longitudinal position.
- such a device can be used to control a large number of devices.
- the device object of the present invention can have different uses.
- the device that is the subject of the present invention comprises control means called "speed control means" of a parameter value of an audiovisual effect as a function of the measured speed.
- the device that is the subject of the present invention comprises:
- Control means said "directional control means" of a parameter value of an audiovisual effect according to the direction detected.
- the advantage of these embodiments is to control two parameter values of an audiovisual effect for the same position of cutting optical paths by the object as a function of the cutoff direction.
- the direction of cleavage of the optical paths by the object is detected as a function of at least one signal output from at least one optical sensor representing the cleavage of the optical paths by the object of at least three light beams and the directional control means control at least one parameter of at least one audiovisual effect according to two components of a vector representative of the direction detected.
- each component of the vector representative of the detected direction can control a parameter value of a distinct audiovisual effect.
- the direction of cleavage of the optical paths by the object is detected as a function of at least one signal output from at least one optical sensor representing the cleavage of the optical paths by the object of at least three light beams defining a volume and the directional control means controls at least one parameter value of at least one audiovisual effect according to three components of a vector representative of the direction detected.
- each component of the vector representative of the detected direction can control a parameter value of a distinct audiovisual effect.
- the speed measuring means are configured to measure the speed of the object as a function of at least one duration of so-called "cut-off time" of a signal output from at least one optical sensor, the cut-off time representing the cutting of the optical paths by the object of at least one light beam and a predetermined dimension of the object.
- the advantage of these embodiments is to require only two optical paths traversed by light beams. The energy consumption of the device is reduced.
- the means for measuring the speed are configured to measure the speed of the object as a function of a signal emerging from at least one optical sensor representing the cutting of the optical paths by the object of the invention. minus two parallel light beams.
- the use of two parallel light beams to measure the cutoff speed of the optical paths allows the user to choose any object to use the control device, such as a stick or fingers of the hand for example.
- the means for estimating the longitudinal position of the bushing and the means for measuring the speed of the object are configured to estimate the longitudinal position and the speed as a function of a signal exiting from less an optical sensor representing the cutting of optical paths by the object of at least three light beams defining a volume.
- the device that is the subject of the present invention comprises means of converting each parameter value into a value represented according to the MIDI protocol (acronym for "Musical Instrument Digital Interface”).
- the advantage of these embodiments is to be able to use the device object of the present invention as a musical instrument.
- the present invention aims at a method of operating a device that is the subject of the present invention, which comprises the following steps:
- the present invention aims at an audiovisual system which comprises:
- the advantage of these embodiments is to have a system for producing a sound and / or visual effect according to the movements made by the user facing the light beams.
- the transducer includes an electroacoustic transducer such that the sound signal emitted by the transducer depends on the movements of a user facing the light beams.
- the connection of a device object of the present invention with an electroacoustic transducer has the advantage of using the system as a musical instrument.
- FIG. 1 represents, schematically, a first particular embodiment of a device that is the subject of the present invention
- FIG. 2 represents, schematically, a second particular embodiment of a device that is the subject of the present invention
- FIG. 3 schematically represents a third particular embodiment of a device that is the subject of the present invention
- FIG. 4 represents, in the form of a logic diagram, a fourth particular embodiment of a device that is the subject of the present invention.
- FIG. 5 shows, schematically, a fifth particular embodiment of a device object of the present invention.
- FIG. 1 shows a particular embodiment of a device for controlling a parameterizable audiovisual effect that is the subject of the present invention.
- the device 10 comprises a structural element 100 on which are fixed the means for generating two optical paths and in particular the transmitters, 105a and 105b, at least one light beam, 1 10a or 1 10b, and the optical sensor 1 15.
- the structural element may be a metal structure comprising the emitters 105a and 105b and the optical sensor 1 15.
- the structural element may comprise two independent supports fixed by pinching on a surface, such as a table, for example.
- One of the supports may comprise at least one transmitter, 105a or 105b, the other support comprising at least one optical sensor 1 15.
- An emitter, 105a or 105b, of at least one light beam, 1 10a or 1 10b, may comprise:
- An emitter, 105a or 105b may emit several light beams, 1 10a or 1 10b.
- Each transmitter, 105a or 105b may be of different type.
- the device 10, object of the present invention comprises two transmitters, 105a and 105b.
- the transmitter 105a emitting a light beam 1 10a
- the transmitter 105b emitting a light beam 1 10b.
- An optical sensor 1 15 may comprise:
- CMOS sensor (acronym for "Complementary Metal Oxide Semiconductor” in English) and / or
- An optical sensor 1 may include a wavelength discrimination filter.
- An optical sensor 1 15 may comprise diffraction means of at least one captured light beam.
- An optical sensor 1 can pick up several light beams, 1 10a and 1 10b. Each optical sensor 1 15 may be of different type.
- the device 10, object of the present invention comprises an optical sensor sensing the two light beams 1 10a and 1 10b respectively from the two transmitters 105a and 105b.
- discrimination of the light beams 1 10a and 1 10b is effected by diffraction.
- each light beam 1 10a, 1 10b is a beam with a single wavelength.
- the light beams 1 10a and 1 10b have the same wavelength and are activated alternately.
- the discrimination of the light beams 1 10a and 1 10b is effected by means of the alternative activation.
- At least two light beams 1 10a, 1 10b are nonparallel.
- the means for generating two optical paths traversed by non-parallel light beams 1 10a and 1 10b comprising at least one optical sensor 1 15 and at least one transmitter, 105a or 105b comprise at least one mirror.
- the mirror can be semi-reflective.
- a light beam, 1 10a or 1 10b, from an emitter, 105a or 105b is partially diffracted and partially reflected by the mirror.
- the diffracted portion of the light beam, 1 10a or 1 10b traverses an optical path.
- the reflected part of the light beam, 1 10a or 1 10b goes through another optical path.
- the optical sensor 1 15 generates at least one electrical signal 120 representative of the cutoff of at least one light beam, 1 10a or 1 10b, captured. Each electrical signal 120 is transmitted to:
- means 125 for estimating the longitudinal position 130 of the crossing of the object as a function of a signal 120 issuing from at least one optical sensor 1 representing the cutting of the optical paths by the object of at least one two light beams, 1 10a and 1 10b, not parallel and
- detection means 165 of the cutoff direction 170 of the optical paths by the object as a function of at least one signal 120 coming out of at least one optical sensor 1 representing the cutting of the optical paths by the object of at least two light beams, 1 10a and 1 10b.
- At least one dimension d of the object is predetermined and previously recorded by the measuring means 145 of the speed of the object.
- the object is a cylinder trunk circular guide curve located in a plane perpendicular to the generator, such a rod for example.
- the predetermined dimension is the diameter of the cylinder trunk. It is recalled that a cylinder is a surface in the space defined by a line, called generator, passing through a variable point describing a closed plane curve, called the directing curve, and keeping a fixed direction.
- the measuring means 145 of the speed of the object determine, for at least one beam, 1 10a or 1 10b, the so-called duration "cut-off" during which the beam, 1 10a or 1 10b, has not been
- the cut-off time is determined by means of the electrical signal 120.
- the cut-off time corresponds to the time during which the optical sensor 1 15 is closed by the object.
- the cut-off time may correspond to the duration between two characteristic times of an electrical signal 120, each characteristic instant being defined with respect to a predetermined limit value of intensity or voltage of the electrical signal 120.
- the speed of the object is obtained by dividing the predetermined dimension d by the cut-off time.
- the cut-off time for each beam, 1 10a and 1 10b, is determined.
- the speed is determined with respect to an average of the cut-off times.
- the measured speed 150 is then transmitted:
- control means 155 called "speed control means" of a parameter value 160 of an audiovisual effect as a function of the measured speed 150 and
- the longitudinal position 130 of the crossing of the object of at least two light beams, 1 10a and 1 10b, is determined by calculation of the so-called duration "crossing time".
- the crossing time is the time between a characteristic instant of the electrical signal 120 when a first beam, 1 10a or 1 10b, is not picked up by an optical sensor 1 15 and a corresponding characteristic instant of the electrical signal 120 when the second beam, 1 10a or 1 10b, is not picked up by an optical sensor 1 15.
- the characteristic instant may be the instant of start of the cutoff of the light beam, 1 10a or 1 10b, or the instant of end of the cut of the light beam, 1 10a or 1 10b.
- the start time of the cutoff and the end time of the break corresponding each to a change of state of the electrical signal 120.
- the longitudinal position 130 is determined by multiplying the transit time by the predetermined dimension d divided by the cut-off time.
- the longitudinal position 130 can be determined by multiplying the measured speed 150 by the traversing time.
- the longitudinal position 130 is transmitted to control means 135 called "position control means" of a parameter value 140 of an audiovisual effect as a function of the estimated longitudinal position 130.
- the detection means 165 detect the breaking direction 170 as a function of a characteristic instant of the electrical signal 120 when a first light beam, 1 10a or 1 10b, is not picked up by an optical sensor 1 15 and a corresponding characteristic instant of the electrical signal 120 when a second light beam, 1 10a or 1 10b, is not picked up by an optical sensor 1 15.
- the cutoff direction 170 is in the direction of the first beam, 1 10a or 1 10b , which is not picked up by an optical sensor 1 15 towards the second beam, 1 10a or 1 10b, which is not picked up by an optical sensor 1 15.
- the cutoff direction 170 is transmitted to control means 175 called "directional control means" of a parameter value 180 of an audiovisual effect as a function of the direction 170 detected.
- Conversion means 185 converts each parameter value 140, 160 and 180 to a value represented according to the MIDI protocol (acronym for "Musical Instrument Digital Interface "in English) 190. In embodiments, the conversion means 185 are optional.
- the measuring means 145, the estimation means 125, the determination means 165, the position control means 135, the speed control means 155, the directional control means 175 and the conversion means 185 may each be a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method that is the subject of the present invention.
- a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method that is the subject of the present invention performs the functions of the means 125, 135, 145, 155, 165, 175 and 185.
- FIG. 2 shows a particular embodiment of a device that is the subject of the present invention.
- the device 20 comprises a structural element 200 on which are fixed the means for generating three optical paths and in particular the transmitters 205a and 205b, at least one light beam 210a, 210b or 210c, and the optical sensors 215a and 215b.
- the structural element may be a metallic structure comprising the emitters 205a and 205b and the optical sensors 215a and 215b.
- the structural element may comprise two independent supports fixed by pinching on a surface, such as a table, for example. One of the supports may comprise at least one transmitter, 205a or 205b, the other support comprising at least one optical sensor, 215a or 215b.
- An emitter 205a or 205b of at least one light beam 210a, 210b or 210c may comprise:
- An emitter 205a or 205b may emit several light beams 210a, 210b or 210c. Each transmitter, 205a or 205b, may be of different type. Preferably, the transmitter 205a emits a light beam 210a. The transmitter 205b emits two light beams, 210b and 210c. The light beam 210b is non-parallel to the beam 210a, and the light beam 210c is parallel to the beam 210a.
- An optical sensor, 215a or 215b may comprise:
- CCD Charge Device
- CMOS complementary Metal Oxide Semiconductor
- an optical sensor, 215a or 215b may include a wavelength discrimination filter.
- An optical sensor, 215a or 215b can comprise diffraction means of at least one light beam, 210a, 210b or 21 Oc, captured.
- a discrimination of at least two light beams, 210a, 210b or 210c, can be effected by diffraction.
- An optical sensor 215a or 215b can pick up a plurality of light beams 210a, 210b or 210c. Each optical sensor, 215a or 215b, may be of different type.
- the device 20 object of the present invention comprises two optical sensors 215a and 215b.
- the optical sensor 215a captures the light beams 210a and 210b.
- the optical sensor 215a has means for discriminating the light beams 210a and 210b.
- the optical sensor 215b captures the light beam 210c.
- each light beam 210a, 210b, 210c is a single wavelength beam.
- the means for generating three optical paths comprise at least one mirror.
- the mirror can be semi-reflective.
- a light beam, 210a, 210b or 210c, from an emitter 205a or 205b is partially diffracted and partially reflected by the mirror.
- the diffracted portion of the light beam, 210a, 210b or 210c travels through an optical path.
- the reflected part of the light beam, 210a, 210b or 210c goes through another optical path.
- the optical sensor 215a generates an electrical signal 220a representative of the cutoff of at least one light beam, 210a or 210b, captured.
- the electrical signal 220a is transmitted to:
- means 225 for estimating the longitudinal position 230 of the crossing of the object as a function of at least one signal, 220a or 220b, issuing from at least one optical sensor, 215a or 215b, representing the cutting of the paths optical objects by the object of at least two light beams, 210a, 210b or 210c, and
- detection means 265 of the cutoff direction 270 of the optical paths by the object as a function of at least one signal 220a, 220b issuing from at least one optical sensor representing the cutting of the optical paths by the object of at least three light beams 210a, 210b and 210c.
- the optical sensor 215b generates an electrical signal 220b representative of the cutoff of at least one light beam 210c captured.
- the electrical signal 220b is transmitted to the measuring means 245, the estimation means 225 and the detection means 265.
- the light beams 210a and 210c are parallel, the speed 250 of the object passing through the light beams 210a and 210c is measured by means of the electrical signals 220a and 220b.
- the speed 250 is measured by the calculation of the transit time.
- the duration of crossing is the duration between:
- the distance between the beams 210c and 210a is predetermined and previously recorded by the measuring means 245.
- the speed 250 is measured by dividing the distance between the beams 210c and 210a by the crossing time of the distance between the beams 210c and 21a. .
- the measuring means 245 measure the speed as described with reference to FIG. 1, as a function of the beams 210a and 210b and / or as a function of the beams 210b and 210c.
- the measured speed 250 may be an average of different speeds calculated from several pairs of light beams 210a, 210b, 210c.
- the measured speed 250 is transmitted to control means 255 called "speed control means" of a parameter value 260 of an audiovisual effect as a function of the speed 250 measured and to the estimation means 225.
- the longitudinal position 230 is estimated according to one of the detailed embodiments with reference to FIG. 1, as a function of the signals 220a and 220b representing the cut-off of the light beams 210a, 210b and 21c by an object.
- the longitudinal position 230 is transmitted to control means 235 called "position control means" of a parameter value 240 of an audiovisual effect as a function of the estimated longitudinal position 230.
- the detection means 265 detect the cutoff direction 270.
- two components of the cutoff direction 270 are detected, a axial direction component and a longitudinal direction component.
- the axial direction component is a component perpendicular to the parallel beams 210a and 210c.
- the longitudinal direction component is a component parallel to the parallel beams 210a and 210c.
- the axial direction component is detected according to the signals 220a and
- the axial direction component is the direction of the first cut of a light beam, 210a, 210b or 210c, towards the cutting of a second light beam, 210a, 210b or 210c.
- the axial direction component may be beam 210a to beam 210c or beam 210c to beam 210a.
- Each cutoff of each light beam 210a, 210b or 210c is determined by analysis of the electrical signals 220a and 220b.
- the detection of the cutoff order of the light beams is determined by a time comparison of the electrical signals 220a and 220b.
- the longitudinal direction component is detected as a function of the electrical signals 220a and 220b.
- the longitudinal direction component is determined by analysis of electrical signals 220a and 220b.
- the longitudinal direction component may be in the direction of the optical path followed by one of the parallel light beams, 210a or 210c, or in the opposite direction.
- the longitudinal direction component is measured, as a function of the determined axial direction component and by comparing the estimated longitudinal position between the light beams 210a and 210b and an estimated longitudinal position between the light beams 210b and 210c calculated by the estimation means 225.
- the components of the cutoff direction 270 are transmitted to control means 275 called "directional control means" of a parameter value 280 of an audiovisual effect as a function of the detected direction 270.
- each component of the cutoff direction 270 controls a parameter value of an audiovisual effect.
- Converting means 285 converts each parameter value 240, 260 and 280 to a value represented according to the MIDI protocol (acronym for "Musical Instrument Digital Interface") 290. In embodiments, conversion means 285 are optional.
- the measuring means 245, the estimation means 225, the determination means 265, the position control means 235, the speed control means 255, the directional control means 275 and the conversion means 285 may each be a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method that is the subject of the present invention.
- a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method which is the subject of the present invention performs the functions of the means 225, 235, 245, 255, 265, 275 and 285.
- FIG. 3 shows a particular embodiment of a device that is the subject of the present invention.
- the device 30 comprises a structural element 300 on which are fixed the means for generating three optical paths and in particular the emitters 305a, 305b and 305c, at least one light beam 310a, 310b or 310c, and the optical sensors, 315a, 315b and 315c.
- the structural element may be a metal structure comprising the emitters 305a, 305b and 305c, and the optical sensors 315a, 315b and 315c.
- the structural element may comprise two independent supports fixed by pinching on a surface, such as a table, for example. One of the supports may comprise at least one transmitter, 305a, 305b or 305c, the other support comprising at least one optical sensor, 315a, 315b or 315c.
- An emitter, 305a, 305b or 305c, of at least one light beam, 310a, 310b or 310c may comprise:
- An emitter, 305a, 305b or 305c may emit several light beams, 310a,
- Each transmitter, 305a, 305b or 305c may be of different type.
- the transmitter 305a emits a light beam 310a.
- the transmitter 305b emits a light beam 310b and the transmitter 305c emits a light beam 310c.
- the light beams 310a, 310b and 310b form a volume.
- An optical sensor, 315a, 315b or 315c may comprise:
- CMOS sensor (acronym for "Complementary Metal Oxide”
- an optical sensor 315a, 315b or 315c may include a wavelength discrimination filter.
- An optical sensor, 315a, 315b or 315c may comprise diffraction means of at least one light beam, 310a, 310b or 310c, captured. Discrimination of the light beams, 310a, 310b or 310c, can be effected by diffraction.
- An optical sensor, 315a, 315b or 315c can pick up several light beams, 310a, 310b or 310c. Each optical sensor, 315a, 315b or 315c, may be of different type.
- the optical sensor 315a captures the light beam 310a.
- the optical sensor 315b captures the light beam 310b.
- the optical sensor 315c captures the light beam 310c.
- each light beam 310a, 310b, 310c is a single wavelength beam.
- the light beams 310a, 310b and 310c form a volume. At least two light beams 310a, 310b, 310c are nonparallel.
- the means for generating three optical paths comprise at least one mirror.
- the mirror can be semi-reflective.
- a light beam, 310a, 310b or 310c, from an emitter, 305a, 305b or 305c is partially diffracted and partially reflected by the mirror.
- the diffracted portion of the light beam, 310a, 310b or 310c traverses an optical path.
- the reflected part of the light beam, 310a, 310b or 310c goes through another optical path.
- the optical sensor 315a generates an electrical signal 320a representative of the cutoff of at least one light beam 310a picked up.
- the electrical signal 320a is transmitted to:
- detection means 365 of the cutoff direction 370 of the optical paths by the object as a function of at least one signal 320a, 320b, 320c coming out of at least one optical sensor representing the cutting of the optical paths by the object at least three light beams 310a, 310b and 310c.
- the optical sensor 315b generates an electrical signal 320b representative of the cutoff of at least one light beam 310b captured.
- the electrical signal 320b is transmitted to the measuring means 345, the estimation means 325 and the detection means 365.
- the optical sensor 315c generates an electrical signal 320c representative of the cutoff of at least one light beam 310c captured.
- the electrical signal 320c is transmitted to the measuring means 345, the estimation means 325 and the detection means 365.
- the speed 350 of the object passing through the light beams 310a, 310b and 310c is measured by means of at least two electrical signals, 320a, 320b or 320c.
- the speed 350 is measured according to one of the embodiments defined with reference to FIGS. 1 and 2.
- the measured speed 350 can be an average of different speeds calculated from several pairs of light beams, 31 Oa, 31 Ob or 31 Oc.
- the measured speed 350 is then transmitted to control means 355 called "speed control means" of a parameter value 360 of an audiovisual effect as a function of the measured speed 350 and the estimation means 325.
- the longitudinal position 330 is estimated according to one of the detailed embodiments with reference to FIG.
- the longitudinal position 330 may be an average of longitudinal positions 330 calculated for at least two light beams, 310a, 31b or 310c.
- the longitudinal position 330 is transmitted to said control means 335
- the detection means 365 detect the cutoff direction 370.
- three components of the cutoff direction 370 are detected, a direction component ab, a direction component bc and a direction component ac.
- the direction component ab is a component determined with respect to the plane formed by the light beams 310a and 310b.
- the direction component bc is a component determined with respect to the plane formed by the light beams 310b and 310c.
- the direction component ac is a component determined with respect to the plane formed by the light beams 310a and 310c.
- each direction component is determined as a function of an estimated longitudinal position between the light beams 310a and 310b, of an estimated longitudinal position between the light beams 310b and 310c and of an estimated longitudinal position between the light beams 310a and 310b. 310c respectively.
- the components of the cutoff direction 370 are transmitted to control means 375 called "directional control means" of a parameter value 380 of an audiovisual effect as a function of the detected direction 370.
- each component of the cutoff direction 370 controls a parameter value of at least one audiovisual effect.
- Converting means 385 converts each parameter value 340, 360 and 380 to a value represented according to the MIDI protocol (acronym for "Musical Instrument Digital Interface") 390.
- the measuring means 345, the estimation means 325, the determination means 365, the position control means 335, the speed control means 355, the directional control means 375 and the conversion means 385 may each be a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method that is the subject of the present invention.
- a microprocessor associated with a program memory comprising instructions for carrying out the steps of the method that is the subject of the present invention provides functions of means 325, 335, 345, 355, 365, 375 and 385.
- FIG. 4 shows a particular embodiment 40 of a method which is the subject of the present invention.
- the method 40 comprises the following steps:
- measuring 42 the speed, 150, 250 or 350, of an object traversing at least two light beams, 1 10a, 1 10b, 210a, 210b, 210c, 310a, 310b or 310c, as a function of a signal, 120 , 220a, 220b, 320a, 320b or 320c, emerging from at least one optical sensor, 1 15, 215a, 215b, 315a, 315b or 315c, representing the breaking of the optical paths by the object,
- the generation steps 41, measurement 42, estimate 43, control 44 are preferably performed by means of an embodiment of a device, 10, 20, 30 or one of the embodiments described above.
- the method 40 includes at least one of the following steps:
- FIG. 5 shows a particular embodiment of an audiovisual system 50 which is the subject of the present invention.
- An embodiment, 10, 20 or 30, of a device that is the subject of the present invention transmits each parameter value, 140, 160 and 180, or 240, 260 and 280, or 340, 360 and 380, in value represented according to the MIDI protocol, 190, 290 or 390, to transformation means 500 of each parameter value of an audiovisual effect, represented according to the MIDI protocol, 190, 290 or 390, into a control signal 505 of a sound effect and / or visual.
- the transforming means 500 transforming the parameter values of an audiovisual effect, 140, 160 and 180, or 240, 260 and 280, or 340, 360 and 380 in a control signal 505 of a sound and / or visual effect.
- the control signal 505 is transmitted at the input of a transducer 510 converting the control signal 505 to sound and / or visual effect.
- the transducer 510 comprises an electroacoustic transducer so that the sound signal emitted by the transducer depends on the movements of a user facing the light beams of an embodiment of a device that is the subject of the present invention.
- the device of the audiovisual system 50 is one of the embodiments described above.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1461092A FR3028655B1 (fr) | 2014-11-17 | 2014-11-17 | Dispositif de commande, procede de fonctionnement d'un tel dispositif et systeme audiovisuel |
PCT/FR2015/053108 WO2016079420A1 (fr) | 2014-11-17 | 2015-11-17 | Dispositif de commande, procédé de fonctionnement d'un tel dispositif et système audiovisuel |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3204935A1 true EP3204935A1 (fr) | 2017-08-16 |
EP3204935B1 EP3204935B1 (fr) | 2019-10-23 |
Family
ID=52824326
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15804896.7A Active EP3204935B1 (fr) | 2014-11-17 | 2015-11-17 | Dispositif de commande, procédé de fonctionnement d'un tel dispositif et système audiovisuel |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3204935B1 (fr) |
FR (1) | FR3028655B1 (fr) |
WO (1) | WO2016079420A1 (fr) |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5017770A (en) * | 1985-10-07 | 1991-05-21 | Hagai Sigalov | Transmissive and reflective optical control of sound, light and motion |
FR2590033A1 (fr) * | 1985-11-13 | 1987-05-15 | Guerre Philippe | Dispositif de detection en trois dimensions d'objet par lumiere laser particulierement destine au spectacle |
DE4226661A1 (de) * | 1992-06-23 | 1994-01-05 | Friedrich Foerster | Verfahren und Vorrichtung zur Bedienung elektronischer Musikinstrumente |
US6489550B1 (en) * | 1997-12-11 | 2002-12-03 | Roland Corporation | Musical apparatus detecting maximum values and/or peak values of reflected light beams to control musical functions |
FR2777107B1 (fr) | 1998-04-02 | 2001-03-09 | Jean Joseph Paul Schmutz | Instrument optoelectronique d'interpretation de la musique |
US8431811B2 (en) * | 2001-08-16 | 2013-04-30 | Beamz Interactive, Inc. | Multi-media device enabling a user to play audio content in association with displayed video |
US8339379B2 (en) * | 2004-04-29 | 2012-12-25 | Neonode Inc. | Light-based touch screen |
JP4822782B2 (ja) * | 2005-09-15 | 2011-11-24 | 株式会社河合楽器製作所 | 鍵盤楽器のタッチ検出装置 |
CN102782616A (zh) * | 2009-10-16 | 2012-11-14 | Rpo有限公司 | 用于检测和跟踪触摸对象的方法 |
US8835739B2 (en) | 2012-02-01 | 2014-09-16 | Beamz Interactive, Inc. | Keystroke and MIDI command system for DJ player and video game systems |
-
2014
- 2014-11-17 FR FR1461092A patent/FR3028655B1/fr not_active Expired - Fee Related
-
2015
- 2015-11-17 WO PCT/FR2015/053108 patent/WO2016079420A1/fr active Application Filing
- 2015-11-17 EP EP15804896.7A patent/EP3204935B1/fr active Active
Also Published As
Publication number | Publication date |
---|---|
WO2016079420A1 (fr) | 2016-05-26 |
EP3204935B1 (fr) | 2019-10-23 |
FR3028655B1 (fr) | 2019-10-18 |
FR3028655A1 (fr) | 2016-05-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
FR2824903A1 (fr) | Amelioration aux procedes et dispositifs de mesure par imagerie confocale a chromatisme etendu | |
EP0347277B1 (fr) | Capteur interférométrique et son utilisation dans un dispositif interférométrique | |
JP6983374B2 (ja) | 測定装置及び測定方法 | |
WO2017108400A1 (fr) | Dispositif et procede de mesure de hauteur en presence de couches minces | |
EP0142464A1 (fr) | Procédé et dispositif pour déterminer la position d'un objet par rapport à une référence | |
FR2913265A1 (fr) | Dispositif pour la mesure optique d'un objet. | |
CA1296545C (fr) | Dispositif pour determiner en continu un indice d'etat de surface d'une feuille crepee en mouvement | |
FR2639124A1 (fr) | Velocimetre doppler optique a faisceau de reference pour des mesures multidimensionnelles | |
FR3013128A1 (fr) | Dispositif et methode de mise au point tridimensionnelle pour microscope | |
EP3087358B1 (fr) | Dispositif de caractérisation d'un phénomène physique par ablation de fibre optique à réseaux de bragg | |
US7187444B2 (en) | Measuring method and apparatus using attenuation in total internal reflection | |
FR2663752A1 (fr) | Dispositif de mesure de parametres meteorologiques. | |
EP1927001B1 (fr) | Dispositif d'anemometrie laser a securite oculaire amelioree | |
EP3204935B1 (fr) | Dispositif de commande, procédé de fonctionnement d'un tel dispositif et système audiovisuel | |
FR3026484A1 (fr) | Procede et systeme d'inspection de plaquettes transparentes pour l'electronique, l'optique ou l'optoelectronique | |
WO1993004347A1 (fr) | Microcapteur a poutre vibrante compense en temperature | |
EP1380811B2 (fr) | Dispositif optique de mesure de distances | |
EP1105712B1 (fr) | Dispositif de mesure de la taille de particules en deplacement, notamment pour des mesures pluviometriques | |
WO1986000697A1 (fr) | Procede et dispositif pour la determination de la position d'un organe mobile au moyen d'elements a proprietes optiques variables | |
EP0069071A2 (fr) | Procédé d'identification d'un objet et de mesure de sa position et de son orientation, et dispositif pour la mise en oeuvre de ce procédé | |
EP1943527B1 (fr) | Accelerometre pour la mesure des vibrations avec capteur optique | |
FR2598218A1 (fr) | Capteur de mesure lineaire sans contact de la distance d'une cible par rayonnement retrodiffuse | |
EP1219953A1 (fr) | Détecteur utilisant la réflexion totale | |
WO2021166130A1 (fr) | Dispositif de mesure de distance, procédé de mesure de distance, dispositif d'apprentissage de mesure de distance et procédé d'apprentissage de mesure de distance | |
FR2767205A1 (fr) | Procede pour mesurer des parametres d'une montre mecanique et dispositif pour sa mise en oeuvre |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170509 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180608 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
INTC | Intention to grant announced (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20190201 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20190508 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015040412 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1194553 Country of ref document: AT Kind code of ref document: T Effective date: 20191115 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20191023 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200224 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200123 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200124 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200123 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200224 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015040412 Country of ref document: DE |
|
PG2D | Information on lapse in contracting state deleted |
Ref country code: IS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191117 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200223 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1194553 Country of ref document: AT Kind code of ref document: T Effective date: 20191023 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20191130 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
26N | No opposition filed |
Effective date: 20200724 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191117 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20151117 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191023 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20221230 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230130 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231130 Year of fee payment: 9 |