EP3230833A1 - Method for continuously detecting a state contact or non-contact between a tip of an instrument and a writing medium having a variable thickness, and related system - Google Patents
Method for continuously detecting a state contact or non-contact between a tip of an instrument and a writing medium having a variable thickness, and related systemInfo
- Publication number
- EP3230833A1 EP3230833A1 EP15805187.0A EP15805187A EP3230833A1 EP 3230833 A1 EP3230833 A1 EP 3230833A1 EP 15805187 A EP15805187 A EP 15805187A EP 3230833 A1 EP3230833 A1 EP 3230833A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- tip
- current
- contact
- distance
- writing surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
Definitions
- the present invention relates to a method for the continuous detection of a state of contact or non-contact between a tip of a utensil and a writing medium of variable thickness, and associated system. continuous state of contact or non-contact between a tip of a utensil and a writing medium of varying thickness.
- An object of the invention is to overcome these problems.
- a method of continuously detecting a state of contact or non-contact between a tip of a utensil and a writing surface of a thick writing medium comprising the steps of: determining, at a current time, the position of the tip of the utensil relative to the bearing surface;
- the distance is less than or equal to the sum of a current minimum distance and a tolerance, said tolerance being representative of an uncertainty as to the distance between the writing surface and the bearing surface;
- the movement parameter is representative of a movement substantially tangential to the writing surface, i.e. its value is less than or equal to a tangential movement threshold
- a norm of the amplitude parameter is greater than or equal to a minimum amplitude threshold
- a sliding time window is used on which respective weighted averages are used for said position, and / or said distance, and / or said motion parameter, and / or said amplitude parameter; the sliding window comprising a set of data samples corresponding to a set of successive instants in which a current instant is considered, the other instants of the set preceding the current instant being considered as past instants of the sliding window, and the other instants of the set succeeding the current instant being considered as future instants of the current sliding window.
- the current instant considered is not the last.
- the method further comprises a step of updating said tolerance when two successive determinations of contact or non-contact state determine the same state.
- the method adapts better to the state of the writing surface without losing the reactivity during rapid loss of contact.
- said tolerance is reduced without being less than a minimum tolerance threshold.
- the motion parameter is representative of a movement that is essentially tangential to the writing surface, ie its value is less than or equal to the tangential motion threshold (it would be desirable to keep the same, because the same condition is defined) and the distance is greater than the sum of the current minimum distance and the tolerance, the current minimum distance is increased.
- the utensil is provided with a fixed magnetic element and the localization device used is provided with an array of at least N triaxial magnetometers connected to each other mechanically without any degree of freedom to preserve a known relative position of these magnetometers, N being an integer at least equal to 2.
- variable thickness disposed on a bearing surface of a locating device; said system comprising a computer adapted to:
- the distance is less than or equal to the sum of a current minimum distance and a tolerance, said tolerance being representative of an uncertainty as to the distance between the writing surface and the bearing surface;
- the movement parameter is representative of a movement substantially tangential to the writing surface, i.e. its value is less than or equal to a tangential movement threshold
- a norm of the amplitude parameter is greater than or equal to a minimum amplitude threshold
- FIG. 1 to 10 schematically illustrate a method according to one aspect of the invention.
- the method and system of the invention assumes to have at any time an estimate of the position of the tip P of a utensil U, such as a stylus or pen, relative to a reference plane or bearing surface SA on which is placed the writing medium SUE comprising a writing surface SE.
- the writing medium SUE for example a notebook or notebook, can more or less be deformed.
- the object of the invention is to make it possible to decide whether at a moment the tip of the utensil is in contact with the writing medium or not.
- a reference ( ⁇ , ⁇ , ⁇ , ⁇ ) bound to the reference surface is defined, such that the X and Y axes are parallel to the writing surface SE and the Z axis is perpendicular to this surface SE.
- the position Pos of the tip P of the utensil U at the instant is described in this reference:
- the x and y components along the X and Y axes are called tangential components and are represented by the vector t (ti).
- the component z along the Z axis is called the normal component.
- the utensil U may be provided with a magnetic element
- Similar utensils U and DL locating device are for example described in documents FR 2988862 and FR 2988874.
- the invention also applies to a digitization system based on the ultrasonic localization in which an ultrasonic transmitter is connected to the utensil and an ultrasonic reception system is connected to the writing surface.
- the invention also applies to a system of optical location using a camera that can determine the position of a point of the utensil in three dimensions.
- the decision instant t-G ti_ n + 1 ti is defined as the moment for which the decision is made (contact or non-contact).
- the instants t k such that t ⁇ . ⁇ n + 1 ⁇ -t L V k ⁇ ti
- a motion can be composed of a tangential motion dt (ti) corresponding to the two axes X and Y, and of a normal movement dz (ti): dx (ti) " x (ti) -x (ti- -l)
- a motion parameter at time t ⁇ (denoted PM (ti)) makes it possible to distinguish whether the movement is rather tangential with respect to the writing surface or rather normal to the writing surface.
- the motion parameter does not give useful information if the range of motion is small. This is due to the noise on the estimate of the Pos position of the tip P (and thus on the movement). It is therefore necessary to link the tests on the movement parameter to a test on the range of motion to have certainty on these tests.
- the value of this parameter is between -1 and 1.
- the value 1 corresponds to a movement that is entirely normal to the writing surface SE (i.e. when the tip P moves away from the writing surface SE).
- the value 0 corresponds to a movement perfectly parallel to the writing surface SE.
- the value -1 corresponds to a movement that is entirely normal to the writing surface SE when the tip P approaches the writing surface SE.
- the ratio of the absolute value of normal movement (or distance h) to the norm of movement can be used as the movement parameter:
- the value 1 corresponds to an entirely normal movement on the surface.
- the value 0 corresponds to a movement perfectly parallel to the writing surface SE (or more precisely the support surface SA).
- a sliding window containing the values of the motion parameter ⁇ ( ⁇ ,) is formed at various successive instants:
- Figure 1 shows the various parameters describing the writing surface SE.
- CONTACT which describes the state of contact between the tip P of the utensil U and the writing surface SE.
- the minimum level of the contact surface or, in other words, the current value of the minimum distance h min (ti) between the bearing surface SA and the writing surface SE of the writing medium SUE hmin (ti) is unknown. It is initialized to the maximum tolerable value of the thickness of the writing medium, for example 3 cm, considering that this is the maximum thickness of a notebook.
- the tolerance is set at an initial value, for example 1 mm, and the tip P of the utensil U is considered to be in a non-contact state. It is then expected to have received n estimates of the position of the tip P of the utensil U.
- the iterative processing of the method comprises the following steps:
- the method of the invention aims at estimating h min (t j ), tol (t j ) and Contact (t j ), with t j G pi- n + i; 1 ⁇ 4]. These parameters depend on the contact state (boolean respectively 1 for a contact state and 0 for a non-contact state) at the previous instant (t ⁇ ) as well as the value of the various calculated parameters.
- h min (t j ) the minimum level of the contact surface, or minimum distance h min (t j ) between the bearing surface SA and the tip P, at time j. This estimate can be calculated in several ways depending on the number of points recorded as well as the position of the decision instant in the window. For example, we can compare h min (t j ) to the vertical distance
- This comparison can also be made with respect to all the points of the sliding window, the average value, or the median value of the window. It can also be performed with respect to the future instants or at times past, compared to the instant of the sliding window considered as the current time.
- i- n + l ⁇ l ⁇ m ⁇ i n represents the number of points in the sliding window
- the determination of the state of contact or non-contact at time t j is conditioned by the previous state t i _ 1 as well as all or part of the parameters saved in the sliding window.
- a machine with two states (contact / non-contact).
- the transition from one state to another is carried out by tests and thresholds which are adapted to the locating device DL making it possible to estimate the position of the tip P of the utensil U.
- These thresholds can also be optimized as a function of a style of writing or drawing.
- the tolerance tol h (t j ) on the level of the writing surface SE can be either fixed (adapted in cases where the device for locating the estimation of the position of the tip of the utensil is fairly accurate and that the support does not deform too much) is variable, in which case, its estimate will be refined according to the test results.
- Passing conditions from non-contact state to contact state include the following mandatory conditions:
- the movement parameter PM (t j ) of the tip P indicates a movement parallel to the writing surface SE.
- this condition it is necessary to couple this condition to a minimum condition (threshold) on the parameter of amplitude of movement
- the amplitude of motion dPos (t j ) and the motion parameter PM (t j ) can be calculated only on the decision instant (t j ) or on several instants of the sliding window, ie by making combinations on future instants and past instants of the sliding window (for example, maximum value, minimum value, average value or median value). For example, this makes it possible to detect the moment of passage between vertical movement and horizontal movement as shown in FIG. 4, which generally corresponds to the moment of contact between the tip P and the writing surface SE. The movement is essentially normal to the writing surface
- the movement parameter PM makes it possible to detect a tangential movement such that the point P is below a maximum threshold, the tolerance is incremented.
- This technique makes it possible to quickly reach the new thickness of the writing medium SUE and not to lose a lot of points because of such a change. The result can therefore be very satisfactory but depends on the acquisition frequency of the location device. This is illustrated in Figure 6.
- the movement parameter PM (t j ) of the tip P indicates a movement having a slope with respect to the writing surface SE greater than a threshold.
- a threshold it is necessary to couple this condition to a minimum condition (threshold) on the amplitude parameter of motion
- FIG. 7 represents a simple case of end of contact between the tip P of the utensil U and the writing surface SE. These mandatory conditions do not make it possible to mitigate problems related to the bending of the writing medium SUE as well as the defects of estimation of the position of the tip P. Also, it is possible to combine additional optional conditions to determine if the tip P is well disconnected from the writing surface SE or it is just a bending of the writing surface SE, a change of thickness due to the fact that the writing surface SE is not perfectly parallel to the xy plane of the support surface SA, or a problem related to the accuracy of the acquisition device DL. Such a case is illustrated in FIG.
- Thresholding means comparing the PM motion parameter with a threshold. If the latter does not exceed the threshold, the parameter estimate is refined. This threshold makes it possible to say that, probably, the thickness of the support has changed, and that there is always contact. As with other conditions related to PM motion indicators, it is best to pair it with an amplitude of motion test for best results.
- the value of the minimum level h min (t j ) of the writing surface SE is increased. This is valid up to a certain threshold so as not to favor false positives or false contact detections.
- the solution is more or less fault-tolerant at the level of the writing surface SE.
- Figure 9 illustrates a refinement of the tolerance on the level of the writing surface in the state of contact.
- This operation makes it possible to quickly detect contact losses, since when this interval reaches its minimum value, a lifting of the tip P quickly removes it from the tolerance zone and makes it possible to validate the mandatory conditions proposed above.
- Figure 10 illustrates an example of the state machine (contact or non-contact) with the optional update of tolerance tol (t j ).
- the steps of the method described above may be performed by one or more programmable processors executing a computer program for performing the functions of the invention by operating on input data and generating output data.
- a computer program can be written in any form of programming language, including compiled or interpreted languages, and the computer program can be deployed in any form, including as a stand-alone program or as a subroutine, element, or other unit suitable for use in a computing environment.
- a computer program can be deployed to run on one computer or multiple computers at a single site or spread across multiple sites and interconnected by a communications network.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- Length Measuring Devices With Unspecified Measuring Means (AREA)
- A Measuring Device Byusing Mechanical Method (AREA)
Abstract
Description
Procédé de détection continue d'un état de contact ou de non contact entre une pointe d'un ustensile et un support d'écriture d'épaisseur variable, et système associé Method for continuously detecting a state of contact or non-contact between a tip of a utensil and a writing medium of variable thickness, and associated system
La présente invention porte sur un procédé de détection continue d'un état de contact ou de non contact entre une pointe d'un ustensile et un support d'écriture d'épaisseur variable, et système associé II est connu des procédés et systèmes de détection continue d'un état de contact ou de non contact entre une pointe d'un ustensile et un support d'écriture d'épaisseur variable. The present invention relates to a method for the continuous detection of a state of contact or non-contact between a tip of a utensil and a writing medium of variable thickness, and associated system. continuous state of contact or non-contact between a tip of a utensil and a writing medium of varying thickness.
Il est connu d'utiliser un ustensile d'écriture équipé d'un dispositif de détection de contact tel un capteur de pression, mais un tel ustensile d'écriture nécessite d'être équipé d'un dispositif électronique utilisant une source d'alimentation électrique. It is known to use a writing implement equipped with a contact detection device such as a pressure sensor, but such a writing utensil needs to be equipped with an electronic device using a power source. .
Il est également connu d'utiliser une surface d'écriture sensible au toucher, telle une interface tactile, mais une telle approche ne permet pas d'utiliser des supports passifs d'épaisseur variable, tel un cahier. It is also known to use a touch-sensitive writing surface, such as a tactile interface, but such an approach does not make it possible to use passive supports of variable thickness, such as a notebook.
Il est également connu d'utiliser un seuil fixe de contact, par exemple comme décrit dans le document FR 2988874, ce qui ne permet pas de pallier les défauts d'estimation de la position de la pointe de l'ustensile d'écriture, exige une erreur d'estimation submillimétrique, et n'est pas efficace si le support d'écriture se déforme au touché de l'ustensile. It is also known to use a fixed contact threshold, for example as described in document FR 2988874, which does not make it possible to overcome the errors in estimating the position of the tip of the writing utensil, requires a submillimetric estimation error, and is not effective if the writing medium is deformed by the touch of the utensil.
Un but de l'invention est de pallier ces problèmes. An object of the invention is to overcome these problems.
Il est proposé, selon un aspect de l'invention, un procédé de détection continue d'un état de contact ou de non contact entre une pointe d'un ustensile et une surface d'écriture d'un support d'écriture d'épaisseur variable disposé sur une surface d'appui d'un dispositif de localisation; ledit procédé comprenant les étapes consistant à: déterminer, à un instant courant, la position de la pointe de l'ustensile par rapport à la surface d'appui; According to one aspect of the invention, there is provided a method of continuously detecting a state of contact or non-contact between a tip of a utensil and a writing surface of a thick writing medium. variable disposed on a support surface of a locating device; said method comprising the steps of: determining, at a current time, the position of the tip of the utensil relative to the bearing surface;
déterminer, à l'instant courant, une distance entre la surface d'appui et la pointe, à partir de ladite position de la pointe; determining, at the current time, a distance between the bearing surface and the tip, from said position of the tip;
mettre à jour la valeur courante d'une distance minimale entre la surface d'appui et la surface d'écriture avec la distance entre la surface d'appui et la pointe à l'instant courant, lorsque ladite distance est inférieure à la valeur courante de la distance minimale; updating the current value of a minimum distance between the bearing surface and the writing surface with the distance between the bearing surface and the tip at the current time, when said distance is less than the current value the minimum distance;
déterminer, à l'instant courant, un paramètre de mouvement de la pointe, représentatif d'un rapport entre le mouvement tangentiel à la surface d'écriture et le mouvement normal à la surface d'écriture entre l'instant courant et l'instant précédent; determining, at the current instant, a parameter of movement of the tip, representative of a ratio between the movement tangential to the writing surface and the normal movement at the writing surface between the current instant and the instant previous;
déterminer, à l'instant courant, un paramètre d'amplitude représentatif de l'amplitude du mouvement de la pointe entre l'instant courant et l'instant précédent; determining, at the current instant, an amplitude parameter representative of the amplitude of the movement of the tip between the current instant and the previous instant;
déterminer un état de contact entre la pointe et la surface d'écriture, à l'instant courant, lorsque: determining a state of contact between the tip and the writing surface, at the current time, when:
- la distance est inférieure ou égale à la somme d'une distance minimale courante et d'une tolérance, ladite tolérance étant représentative d'une incertitude sur la distance entre la surface d'écriture et la surface d'appui; the distance is less than or equal to the sum of a current minimum distance and a tolerance, said tolerance being representative of an uncertainty as to the distance between the writing surface and the bearing surface;
- le paramètre de mouvement est représentatif d'un mouvement essentiellement tangentiel à la surface d'écriture, i.e. sa valeur est inférieure ou égale à un seuil de mouvement tangentiel; et the movement parameter is representative of a movement substantially tangential to the writing surface, i.e. its value is less than or equal to a tangential movement threshold; and
- une norme du paramètre d'amplitude est supérieure ou égale à un seuil d'amplitude minimum; a norm of the amplitude parameter is greater than or equal to a minimum amplitude threshold;
déterminer, sinon, un état de non contact entre la pointe et la surface d'écriture, à l'instant courant. to determine, otherwise, a state of non-contact between the tip and the writing surface, at the current instant.
Ainsi, il est possible d'estimer la position de la pointe de l'ustensile d'écriture, de manière précise même si le support d'écriture se déforme au touché de l'ustensile. Ainsi, l'invention fonctionne aussi bien avec une simple feuille qu'avec un carnet. Dans un mode de mise en œuvre, on utilise une fenêtre temporelle glissante sur laquelle on utilise des moyennes pondérées respectives pour ladite position, et/ou ladite distance, et/ou ledit paramètre de mouvement, et/ou ledit paramètre d'amplitude; la fenêtre glissante comprenant un ensemble d'échantillons de données correspondant à un ensemble d'instants successifs dans lequel on considère un instant courant, les autres instants de l'ensemble précédant l'instant courant étant considérés comme des instants passés de la fenêtre glissante, et les autres instants de l'ensemble succédant à l'instant courant étant considérés comme des instants futurs de la fenêtre glissante courante. Thus, it is possible to estimate the position of the tip of the writing implement, accurately even if the writing medium is deformed to the touch of the utensil. Thus, the invention works as well with a single sheet with a notebook. In one embodiment, a sliding time window is used on which respective weighted averages are used for said position, and / or said distance, and / or said motion parameter, and / or said amplitude parameter; the sliding window comprising a set of data samples corresponding to a set of successive instants in which a current instant is considered, the other instants of the set preceding the current instant being considered as past instants of the sliding window, and the other instants of the set succeeding the current instant being considered as future instants of the current sliding window.
En d'autres termes, sur une fenêtre glissante courante, comprenant une pluralité d'instants successifs, l'instant courant considéré n'est pas le dernier. In other words, on a current sliding window, comprising a plurality of successive instants, the current instant considered is not the last.
Ainsi on améliore la précision du procédé, ce qui permet d'avoir une meilleure visibilité sur la nature du mouvement, et ainsi de réduire les faux positifs. Selon un mode de mise en œuvre, le procédé comprend, en outre, une étape consistant à mettre à jour ladite tolérance lorsque deux déterminations successives d'état de contact ou non contact, déterminent un même état. Ainsi, le procédé s'adapte mieux à l'état de la surface d'écriture sans perdre la réactivité lors de pertes rapides de contact. This improves the accuracy of the process, which allows a better visibility on the nature of the movement, and thus reduce false positives. According to one embodiment, the method further comprises a step of updating said tolerance when two successive determinations of contact or non-contact state determine the same state. Thus, the method adapts better to the state of the writing surface without losing the reactivity during rapid loss of contact.
Dans un mode de mise en œuvre, lorsque deux déterminations successives d'état sont de contact, ladite tolérance est diminuée sans pouvoir être inférieure à un seuil de tolérance minimum. In one embodiment, when two successive state determinations are in contact, said tolerance is reduced without being less than a minimum tolerance threshold.
Ainsi, la réduction de la tolérance permet au procédé d'être réactif aux pertes rapides de contact. Selon un mode de mise en œuvre, lorsque le paramètre de mouvement est représentatif d'un mouvement essentiellement tangentiel à la surface d'écriture, i.e. sa valeur est inférieure ou égale au seuil de mouvement tangentiel (il serait souhaitable de garder le même, car on définit la même condition) et que la distance est supérieure à la somme de la distance minimale courante et de la tolérance, la distance minimale courante est augmentée. Thus, reducing the tolerance allows the process to be responsive to rapid contact losses. According to one embodiment, when the motion parameter is representative of a movement that is essentially tangential to the writing surface, ie its value is less than or equal to the tangential motion threshold (it would be desirable to keep the same, because the same condition is defined) and the distance is greater than the sum of the current minimum distance and the tolerance, the current minimum distance is increased.
Ainsi, l'augmentation de la distance minimale permet au procédé de suivre un changement éventuel de l'épaisseur du support en fonction de la position de contact, ce qui est pratique pour le cas de supports dont la surface de contact n'est pas de hauteur régulière. Thus, increasing the minimum distance allows the method to follow a possible change in the thickness of the support depending on the contact position, which is convenient for the case of media whose contact surface is not of regular height.
Dans un mode de mise en œuvre, lorsque deux déterminations successives d'état sont de non contact et la valeur du paramètre de mouvement est inférieur à un seuil de mouvement maximal, ladite tolérance est augmentée sans pouvoir être supérieure à un seuil de tolérance maximum. In one embodiment, when two successive state determinations are non-contact and the value of the motion parameter is less than a maximum movement threshold, said tolerance is increased without being greater than a maximum tolerance threshold.
Selon un mode de mise en œuvre, l'ustensile est muni d'un élément magnétique fixe et le dispositif de localisation utilisé est muni d'un réseau d'au moins N magnétomètres triaxiaux reliés entre-eux mécaniquement sans aucun degré de liberté pour conserver une position relative connue de ces magnétomètres, N étant un nombre entier au moins égal à 2. According to one mode of implementation, the utensil is provided with a fixed magnetic element and the localization device used is provided with an array of at least N triaxial magnetometers connected to each other mechanically without any degree of freedom to preserve a known relative position of these magnetometers, N being an integer at least equal to 2.
Ainsi, il est possible d'utiliser des supports d'écriture passifs (papier, carnet, cahier...) avec un ustensile passif (un simple stylet ...) auquel est lié un aimant. Thus, it is possible to use passive writing media (paper, notebook, notebook ...) with a passive utensil (a simple stylus ...) to which is attached a magnet.
Il est également proposé, selon un autre aspect de l'invention, un système de détection continue d'un état de contact ou de non contact entre une pointe d'un ustensile et une surface d'écriture d'un support d'écriture d'épaisseur variable disposé sur une surface d'appui d'un dispositif de localisation; ledit système comprenant un calculateur apte à: It is also proposed, according to another aspect of the invention, a system for continuously detecting a state of contact or non-contact between a tip of a utensil and a writing surface of a writing support. variable thickness disposed on a bearing surface of a locating device; said system comprising a computer adapted to:
- déterminer, à un instant courant, la position de la pointe de l'ustensile par rapport à la surface d'appui; - Determine, at a current time, the position of the tip of the utensil relative to the bearing surface;
- déterminer, à l'instant courant, une distance entre la surface d'appui et la pointe, à partir de ladite position de la pointe; - mettre à jour la valeur courante d'une distance minimale entre la surface d'appui et la surface d'écriture avec la distance entre la surface d'appui et la pointe à l'instant courant, lorsque ladite distance est inférieure à la valeur courante de la distance minimale; - determining, at the current time, a distance between the bearing surface and the tip, from said position of the tip; updating the current value of a minimum distance between the bearing surface and the writing surface with the distance between the bearing surface and the tip at the current time, when said distance is less than the value current of the minimum distance;
- déterminer, à l'instant courant, un paramètre de mouvement de la pointe, représentatif d'un rapport entre le mouvement tangentiel à la surface d'écriture et le mouvement normal à la surface d'écriture entre l'instant courant et l'instant précédent; determining, at the current moment, a parameter of movement of the tip, representative of a ratio between the movement tangential to the writing surface and the normal movement at the writing surface between the current instant and the previous moment;
- déterminer, à l'instant courant, un paramètre d'amplitude représentatif de l'amplitude du mouvement de la pointe entre l'instant courant et l'instant précédent; determining, at the current instant, an amplitude parameter representative of the amplitude of the movement of the tip between the current instant and the preceding instant;
- déterminer un état de contact entre la pointe et la surface d'écriture, à l'instant courant, lorsque: - determining a state of contact between the tip and the writing surface, at the current time, when:
- la distance est inférieure ou égale à la somme d'une distance minimale courante et d'une tolérance, ladite tolérance étant représentative d'une incertitude sur la distance entre la surface d'écriture et la surface d'appui; the distance is less than or equal to the sum of a current minimum distance and a tolerance, said tolerance being representative of an uncertainty as to the distance between the writing surface and the bearing surface;
- le paramètre de mouvement est représentatif d'un mouvement essentiellement tangentiel à la surface d'écriture, i.e. sa valeur est inférieure ou égale à un seuil de mouvement tangentiel; et the movement parameter is representative of a movement substantially tangential to the writing surface, i.e. its value is less than or equal to a tangential movement threshold; and
- une norme du paramètre d'amplitude est supérieure ou égale à un seuil d'amplitude minimum; a norm of the amplitude parameter is greater than or equal to a minimum amplitude threshold;
- déterminer, sinon, un état de non contact entre la pointe et la surface d'écriture, à l'instant courant. - Otherwise, determine a state of no contact between the tip and the writing surface at the current time.
L'invention sera mieux comprise à l'étude de quelques modes de réalisation décrits à titre d'exemples nullement limitatifs et illustrés par les dessins annexés sur lesquels : The invention will be better understood by studying a few embodiments described by way of non-limiting examples and illustrated by the appended drawings in which:
- les figures 1 à 10 illustrent schématiquement un procédé selon un aspect de l'invention. - Figures 1 to 10 schematically illustrate a method according to one aspect of the invention.
Sur l'ensemble des figures, les éléments ayant des références identiques sont similaires. Le procédé et le système de l'invention suppose de disposer à chaque instant d'une estimation de la position de la pointe P d'un ustensile U, tel un stylet ou stylo, par rapport à une référence plane ou surface d'appui SA sur laquelle est placé le support d'écriture SUE comprenant une surface d'écriture SE. Le support d'écriture SUE, par exemple un bloc-notes ou carnet, peut plus ou moins se déformer. Le but de l'invention est de permettre de décider si à un instant ^ la pointe de l'ustensile est en contact avec le support d'écriture ou pas. In all the figures, the elements having identical references are similar. The method and system of the invention assumes to have at any time an estimate of the position of the tip P of a utensil U, such as a stylus or pen, relative to a reference plane or bearing surface SA on which is placed the writing medium SUE comprising a writing surface SE. The writing medium SUE, for example a notebook or notebook, can more or less be deformed. The object of the invention is to make it possible to decide whether at a moment the tip of the utensil is in contact with the writing medium or not.
On définit un repère (Ο,Χ,Υ,Ζ) lié à la surface de référence, telle que les axes X et Y sont parallèles à la surface d'écriture SE et l'axe Z est perpendiculaire à cette surface SE. La position Pos de la pointe P de l'ustensile U à l'instant est décrite dans ce repère: Les composantes x et y selon les axes X et Y sont appelées composantes tangentielles et sont représentées par le vecteur t(ti). La composante z selon l'axe Z est appelée composante normale. On appelle h la distance entre la pointe P et la surface d'appui SA (h = ||z||). Par exemple, l'ustensile U peut être muni d'un élément magnétiqueA reference (Ο, Χ, Υ, Ζ) bound to the reference surface is defined, such that the X and Y axes are parallel to the writing surface SE and the Z axis is perpendicular to this surface SE. The position Pos of the tip P of the utensil U at the instant is described in this reference: The x and y components along the X and Y axes are called tangential components and are represented by the vector t (ti). The component z along the Z axis is called the normal component. We call h the distance between the tip P and the bearing surface SA (h = || z ||). For example, the utensil U may be provided with a magnetic element
EM fixe et le dispositif de localisation DL utilisé être muni d'un réseau R d'au moins N magnétomètres triaxiaux M, reliés entre-eux mécaniquement sans aucun degré de liberté pour conserver une position relative connue de ces magnétomètres Μ,, N étant un nombre entier au moins égal à 2. Des ustensile U et dispositif de localisation DL similaires sont par exemple décrits dans les documents FR 2988862 et FR 2988874. Fixed EM and the locating device DL used to be provided with a network R of at least N triaxial magnetometers M, mechanically connected to each other without any degree of freedom to maintain a known relative position of these magnetometers Μ ,, N being a integer at least equal to 2. Similar utensils U and DL locating device are for example described in documents FR 2988862 and FR 2988874.
Toutefois l'invention s'applique également à un système de numérisation basé sur la localisation ultrasonique dans lequel un émetteur ultrasonique est lié à l'ustensile et un système de réception ultrasonique est lié à la surface d'écriture. L'invention s'applique également à un système de localisation optique utilisant une caméra pouvant déterminer la position d'un point de l'ustensile en trois dimensions. However, the invention also applies to a digitization system based on the ultrasonic localization in which an ultrasonic transmitter is connected to the utensil and an ultrasonic reception system is connected to the writing surface. The invention also applies to a system of optical location using a camera that can determine the position of a point of the utensil in three dimensions.
Dans la suite de la description, le procédé est décrit en utilisant une fenêtre glissante utilisant n valeurs successives, mais il peut être également appliqué sans fenêtre glissante, i.e. sur une seule donnée à la fois (n=1 ), ce qui revient à considérer une fenêtre glissante comprenant un seul échantillon de données à la fois. Les n dernières estimations de la position de la pointe P de l'ustensile U sont placées dans une fenêtre glissante: In the remainder of the description, the method is described using a sliding window using n successive values, but it can also be applied without a sliding window, ie on a single datum at a time (n = 1), which amounts to considering a sliding window comprising only one data sample at a time. The last n estimates of the position of the tip P of the utensil U are placed in a sliding window:
Pos(ti_n+1) ... PosCti.J Pos(ti) (2) Pos (ti_ n + 1 ) ... PosCti.J Pos (ti) (2)
L'instant de décision t.- G ti_n+1 ti est défini comme l'instant pour lequel on effectue la décision (contact ou non contact). On appelle instants passés par rapport à l'instant t.- les instants tk tel que t{. ■n+1 ≤— t L Vk < tiThe decision instant t-G ti_ n + 1 ti is defined as the moment for which the decision is made (contact or non-contact). The instants t k such that t { . ■ n + 1 ≤-t L V k <ti
On appelle instants futurs les instants tk tel que tj < tk < ti. The instants t k such that t j <t k <ti are called future instants.
On définit un vecteur de mouvement à l'instant ti comme étant: dPos(ti) = Pos(ti) - PosC i) (3) A motion vector at time ti is defined as: dPos (ti) = Pos (ti) - PosC i) (3)
Comme pour les positions, on forme une fenêtre glissante des mouvements aux instants successifs : As for positions, we form a sliding window of movements at successive moments:
dPos(ti_n+2)) ... dPos(ti) dPos (ti_ n + 2) ) ... dPos (ti)
Un mouvement peut être composé d'un mouvement tangentiel dt(ti) correspondant aux deux axes X et Y, et d'un mouvement normal dz(ti) : dx(ti)" x(ti) - x(ti- -l) A motion can be composed of a tangential motion dt (ti) corresponding to the two axes X and Y, and of a normal movement dz (ti): dx (ti) " x (ti) -x (ti- -l)
dPos(ti) = dy(ti) = y(ti) - y(ti. -l) (4) dPos (ti) = dy (ti) = y (ti) -y (ti.-1) (4)
dz(ti) Z(ti) - z(ti_ dz (ti) Z (ti) - z (ti_
-l) -l)
On appelle amplitude de mouvement à l'instant t{ la valeur scalaire HdPos(ti) ll (5) We call the amplitude of motion at time t { the scalar value HdPos (ti) ll (5)
Un paramètre de mouvement à l'instant t{ (noté PM(ti)) permet de distinguer si le mouvement est plutôt tangentiel par rapport à la surface d'écriture ou bien plutôt normal à la surface d'écriture. A motion parameter at time t { (denoted PM (ti)) makes it possible to distinguish whether the movement is rather tangential with respect to the writing surface or rather normal to the writing surface.
Le paramètre de mouvement ne donne pas une information utile si l'amplitude du mouvement est faible. Cela est dû au bruit sur l'estimation de la position Pos de la pointe P (et donc sur le mouvement). Il faut donc lier les tests sur le paramètre de mouvement à un test sur l'amplitude de mouvement pour avoir une certitude sur ces tests. The motion parameter does not give useful information if the range of motion is small. This is due to the noise on the estimate of the Pos position of the tip P (and thus on the movement). It is therefore necessary to link the tests on the movement parameter to a test on the range of motion to have certainty on these tests.
On peut par exemple utiliser comme indicateur le rapport du mouvement normal par la norme du mouvement : One can for example use as an indicator the ratio of the normal movement by the norm of the movement:
La valeur de ce paramètre est comprise entre -1 et 1 . La valeur 1 correspond à un mouvement entièrement normal à la surface d'écriture SE (i.e. lorsque la pointe P s'éloigne de la surface d'écriture SE). La valeur 0 correspond à un mouvement parfaitement parallèle à la surface d'écriture SE. La valeur -1 correspond à un mouvement entièrement normal à la surface d'écriture SE lorsque la pointe P s'approche de la surface d'écriture SE. The value of this parameter is between -1 and 1. The value 1 corresponds to a movement that is entirely normal to the writing surface SE (i.e. when the tip P moves away from the writing surface SE). The value 0 corresponds to a movement perfectly parallel to the writing surface SE. The value -1 corresponds to a movement that is entirely normal to the writing surface SE when the tip P approaches the writing surface SE.
On peut utiliser comme paramètre de mouvement le rapport de la valeur absolue du mouvement normal (ou distance h) et de la norme du mouvement : The ratio of the absolute value of normal movement (or distance h) to the norm of movement can be used as the movement parameter:
PMCt = |dz(ti) l = dh(ti) (6) PMCt = | dz (ti) l = dh (ti) ( 6 )
^ lJ ||dPos(ti)|| ||dPos(ti)|| ' ^ lJ || dPos (ti) || || dPos (ti) || '
Cette forme est simple à comparer à un seuil puisque le résultat est inclus entre 0 et 1 . La valeur 1 correspond à un mouvement entièrement normal à la surface. La valeur 0 correspond à un mouvement parfaitement parallèle à la surface d'écriture SE (ou plus précisément la surface d'appui SA). This form is easy to compare to a threshold since the result is included between 0 and 1. The value 1 corresponds to an entirely normal movement on the surface. The value 0 corresponds to a movement perfectly parallel to the writing surface SE (or more precisely the support surface SA).
Il est également possible d'utiliser la valeur de la composante normale du mouvement dz(ti) ou la variation de la distance dh(ti), qui donne l'amplitude du mouvement dans la direction normale. Généralement, quand la pointe P de l'ustensile U est en contact avec la surface d'écriture SE, cette composante ne varie pas beaucoup au cours du temps. Par contre lorsque l'ustensile U n'est pas en contact avec la surface d'écriture SE, il est difficile de la maintenir à une valeur faible. Pour plus de certitude, il vaut mieux exiger également que l'amplitude dPos(ti) du mouvement dépasse un seuil dPosmir, pour déterminer la nature du mouvement. It is also possible to use the value of the normal component of the movement dz (ti) or the variation of the distance dh (ti), which gives the amplitude of the movement in the normal direction. Generally, when the tip P of the utensil U is in contact with the writing surface SE, this component does not vary much over time. On the other hand, when the utensil U is not in contact with the writing surface SE, it is difficult to keep it at a low value. For greater certainty, it is also better to require that the amplitude dPos (ti) of the movement exceeds a threshold dPos mir , to determine the nature of the movement.
On forme une fenêtre glissante contenant les valeurs du paramètre de mouvement ΡΜ(ΐ,) à divers instants successifs: A sliding window containing the values of the motion parameter ΡΜ (ΐ,) is formed at various successive instants:
Deux autres paramètres sont estimés à chaque réception d'une nouvelle estimation de la position Pos(ti) de la pointe P de l'ustensile U: Le niveau minimal de la surface de contact à l'instant de décision hmin(tj) Two other parameters are estimated at each reception of a new estimate of the position Pos (ti) of the tip P of the utensil U: the minimum level of the contact surface at the moment of decision hmin (tj)
La tolérance tolh(tj) sur le niveau de la surface de contact ou surface d'écriture SE à l'instant de décision (l'incertitude sur le niveau de la surface de contact). The tolerance tol h (t j ) on the level of the contact surface or writing surface SE at the time of decision (the uncertainty on the level of the contact surface).
La figure 1 représente les divers paramètres décrivant la surface d'écriture SE. Enfin, il est possible de définir une variable booléenne CONTACT qui décrit l'état de contact entre la pointe P de l'ustensile U et la surface d'écriture SE. La suite de la description, décrit en détail un mode de réalisation non limitatif de la présente invention. Figure 1 shows the various parameters describing the writing surface SE. Finally, it is possible to define a Boolean variable CONTACT which describes the state of contact between the tip P of the utensil U and the writing surface SE. The following description describes in detail a non-limiting embodiment of the present invention.
Initialement, le niveau minimal de la surface de contact, ou, en d'autres termes, la valeur courante de la distance minimale hmin(ti) entre la surface d'appui SA et la surface d'écriture SE du support d'écriture SUE hmin (ti) est inconnu. Il est initialisé à la valeur maximale tolérable de l'épaisseur du support d'écriture, par exemple 3 cm, en considérant qu'il s'agit là de l'épaisseur maximale d'un carnet. Initially, the minimum level of the contact surface, or, in other words, the current value of the minimum distance h min (ti) between the bearing surface SA and the writing surface SE of the writing medium SUE hmin (ti) is unknown. It is initialized to the maximum tolerable value of the thickness of the writing medium, for example 3 cm, considering that this is the maximum thickness of a notebook.
La tolérance est fixée à une valeur initiale, par exemple 1 mm, et la pointe P de l'ustensile U est considérée comme en état non contact. On attend ensuite d'avoir reçu n estimations de la position de la pointe P de l'ustensile U. Le traitement itératif du procédé, comme illustré sur la figure 3, comprend les étapes suivantes : The tolerance is set at an initial value, for example 1 mm, and the tip P of the utensil U is considered to be in a non-contact state. It is then expected to have received n estimates of the position of the tip P of the utensil U. The iterative processing of the method, as illustrated in FIG. 3, comprises the following steps:
- à chaque nouvelle estimation de la position de la pointe P de l'ustensile U, mettre à jour les valeurs des paramètres pris en compte dans la fenêtre glissante (Pos, h, PM, dPos, toi); at each new estimate of the position of the tip P of the utensil U, update the values of the parameters taken into account in the sliding window (Pos, h, PM, dPos, you);
- faire une estimation préliminaire de la distance minimale hmin(tj) entre la surface d'appui SA et la pointe P; et - make a preliminary estimate of the minimum distance h min (t j ) between the bearing surface SA and the point P; and
- déterminer un état de contact ou de non contact entre la pointe P de l'ustensile U, et, éventuellement raffiner l'estimation de la distance minimale hmin(tj) entre la surface d'appui SA et la pointe P et/ou l'estimation de la tolérance tol(tj). determining a state of contact or non-contact between the tip P of the utensil U, and optionally refining the estimate of the minimum distance h min (t j ) between the bearing surface SA and the tip P and / or the estimate of tolerance tol (t j ).
Concernant la mise à jour de la fenêtre glissante, à un instant d'estimation ti; on dispose des valeurs suivantes : Pos(ti_n+1); ... PosCt^); Pos(ti) (8) Concerning the updating of the sliding window, at a time of estimation t i; we have the following values: Pos (ti_ n + 1 ); ... PosCt ^); Pos (ti) (8)
[dPos(ti_n+2)); ... dPosCti.J; dPos(ti)] (9) [dPos (ti_ n + 2) ); ... dPosCti.J; dPos (ti)] (9)
[PM(ti_n+2)) ... PM(ti)] (10) [PM (ti_ n + 2) ) ... PM (ti)] (10)
Contact(tJ_1) (vrai ou faux) Contact (t J _ 1 ) (true or false)
Le procédé de l'invention vise à estimer hmin(tj), tol(tj) et Contact(tj) , avec tj G pi-n+i ; ¼]. Ces paramètres dépendent de l'état de contact (booléen valant respectivement 1 pour un état de contact et 0 pour un état de non contact) à l'instant précédent (t^) ainsi que la valeur des différents paramètres calculés. The method of the invention aims at estimating h min (t j ), tol (t j ) and Contact (t j ), with t j G pi- n + i; ¼]. These parameters depend on the contact state (boolean respectively 1 for a contact state and 0 for a non-contact state) at the previous instant (t ^) as well as the value of the various calculated parameters.
On commence par une estimation préliminaire du niveau minimal de la surface de contact, ou distance minimale hmin(tj) entre la surface d'appui SA et la pointe P, à l'instant j. Cette estimation peut se calculer de plusieurs manières selon le nombre de points enregistrés ainsi que la position de l'instant de décision dans la fenêtre. Par exemple, on peut comparer hmin(tj) à la distance verticaleWe begin with a preliminary estimate of the minimum level of the contact surface, or minimum distance h min (t j ) between the bearing surface SA and the tip P, at time j. This estimate can be calculated in several ways depending on the number of points recorded as well as the position of the decision instant in the window. For example, we can compare h min (t j ) to the vertical distance
(h(tj)) de la pointe P de l'ustensile U au même instant. Si h(tj) < hmin(tj) alors hmin (tj) = h(t,) . (h (t j )) of the tip P of the utensil U at the same time. If h (t j ) <h min (t j ) then h min (tj) = h (t,).
Cette comparaison peut aussi être effectuée par rapport à la totalité des points de la fenêtre glissante, à la valeur moyenne, ou encore à la valeur médiane de la fenêtre. Elle peut aussi être effectuée par rapport aux instants futurs ou encore aux instants passés, par rapport à l'instant de la fenêtre glissante considéré comme l'instant courant. L'utilisation d'une valeur moyenne hMean(tj) sur la totalité ou bien une partie des points de la fenêtre glissante permet de réduire l'effet du bruit : (t _∑k=l tk) This comparison can also be made with respect to all the points of the sliding window, the average value, or the median value of the window. It can also be performed with respect to the future instants or at times past, compared to the instant of the sliding window considered as the current time. The use of an average value h Mean (t j ) on all or some of the points of the sliding window makes it possible to reduce the effect of the noise: ( t _Σk = l t k )
l½ean W " m_1+ 1 dans laquelle: lean W " m _ 1+ 1 in which:
i— n + l < l < m < i n représente le nombre de points de la fenêtre glissante, i- n + l <l <m <i n represents the number of points in the sliding window,
i : indice du premier point de la partie utilisée pour le calcul de la moyenne (médiane ou encore la valeur minimale) des points de la fenêtre glissante m : indice du dernier point de la partie des points de la fenêtre glissante m-l+1 : nombre de points dans cette partie i: index of the first point of the part used for the calculation of the average (median or the minimum value) of the points of the sliding window m: index of the last point of the part of the points of the sliding window m-1 + 1 : number of points in this part
Plus le bruit d'estimation de la position Pos de la pointe P est élevé, plus il faut de points pour limiter son effet. The higher the estimation noise of the pos position of the point P, the more points are needed to limit its effect.
Pour ne pas avoir beaucoup de retard (de détection de l'état de contact ou de non contact), il vaut mieux réduire le nombre de points dans la fenêtre glissante succédant à l'instant de décision tj. In order not to have a lot of delay (detection of the contact or non-contact state), it is better to reduce the number of points in the sliding window succeeding the decision instant t j .
La détermination de l'état de contact ou de non contact à l'instant tj est conditionné par l'état précèdent ti_1 ainsi que tout ou partie des paramètres sauvegardés dans la fenêtre glissante. The determination of the state of contact or non-contact at time t j is conditioned by the previous state t i _ 1 as well as all or part of the parameters saved in the sliding window.
Aussi, on définit une machine à deux états (contact/non contact). Le passage d'un état à un autre est effectué par des tests et des seuils qui sont adaptés au dispositif de localisation DL permettant d'estimer la position de la pointe P de l'ustensile U. Ces seuils peuvent aussi être optimisés en fonction d'un style d'écriture ou de dessin. Also, we define a machine with two states (contact / non-contact). The transition from one state to another is carried out by tests and thresholds which are adapted to the locating device DL making it possible to estimate the position of the tip P of the utensil U. These thresholds can also be optimized as a function of a style of writing or drawing.
Ces tests sont divisés en deux catégories: des tests obligatoires pouvant fonctionner avec un système assez précis, et des tests optionnels permettant de combler certaines imperfections d'estimation de la position Pos de la pointe P ainsi que les déformations du support d'écriture SUE, i.e. de la surface d'écriture SE. These tests are divided into two categories: mandatory tests that can work with a fairly precise system, and optional tests to fill some imperfections in estimating the Pos position of the tip P as well as the deformations of the writing medium SUE, ie of the writing surface SE.
La tolérance tolh(tj) sur le niveau de la surface d'écriture SE peut être soit fixe (adapté cas où le dispositif de localisation d'estimation de la position de la pointe de l'ustensile est assez précis et que le support ne se déforme pas trop) soit variable, auquel cas, son estimation sera raffinée en fonction des résultats des tests. Les conditions de passage de l'état de non contact à l'état de contact comprennent les conditions obligatoires suivantes: The tolerance tol h (t j ) on the level of the writing surface SE can be either fixed (adapted in cases where the device for locating the estimation of the position of the tip of the utensil is fairly accurate and that the support does not deform too much) is variable, in which case, its estimate will be refined according to the test results. Passing conditions from non-contact state to contact state include the following mandatory conditions:
- la position verticale de la pointe P, ou, en d'autres termes la distance h(tj) entre la surface d'appui SA et la pointe P, à l'instant tj est au- dessous du niveau minimal hmin(tj) de la surface de contact ou surface d'écriture SE auquel est ajoutée la tolérance toi sur le niveau de la surface de contact SE. - the vertical position of the point P, or in other words the distance h (t j ) between the bearing surface SA and the point P, at time t j is below the minimum level h min (t j ) of the contact surface or writing surface SE to which is added the tolerance on the level of the contact surface SE.
- le paramètre de mouvement PM(tj) de la pointe P indique un mouvement parallèle à la surface d'écriture SE. En outre, il est nécessaire de coupler cette condition à une condition minimale (seuil) sur le paramètre d'amplitude de mouvement ||dPos(tj)|| > dPosmin. the movement parameter PM (t j ) of the tip P indicates a movement parallel to the writing surface SE. In addition, it is necessary to couple this condition to a minimum condition (threshold) on the parameter of amplitude of movement || dPos (t j ) || > min .
Ces deux conditions doivent être réalisées pour passer de l'état de non contact à l'état contact. L'amplitude de mouvement dPos(tj) ainsi que le paramètre de mouvement PM(tj) peuvent être soit calculés uniquement sur l'instant de décision (tj) ou bien sur plusieurs instants de la fenêtre glissante, i.e. en faisant des combinaisons sur des instants futurs et des instants passés de la fenêtre glissante (par exemple, valeur maximale, valeur minimale, valeur moyenne ou encore valeur médiane). Par exemple, cela permet de détecter le moment de passage entre mouvement vertical et mouvement horizontal comme le montre la figure 4 qui correspond généralement au moment de contact entre la pointe P et la surface d'écriture SE. Le mouvement est essentiellement normal à la surface d'écritureThese two conditions must be realized to go from the non-contact state to the contact state. The amplitude of motion dPos (t j ) and the motion parameter PM (t j ) can be calculated only on the decision instant (t j ) or on several instants of the sliding window, ie by making combinations on future instants and past instants of the sliding window (for example, maximum value, minimum value, average value or median value). For example, this makes it possible to detect the moment of passage between vertical movement and horizontal movement as shown in FIG. 4, which generally corresponds to the moment of contact between the tip P and the writing surface SE. The movement is essentially normal to the writing surface
SE avant le début d'écriture, ensuite, il est tangent à la surface lors de récriture. On peut, par exemple, calculer une moyenne pondérée de ce paramètre PM sur les instants futurs et déterminer si elle correspond à un mouvement tangent à la surface ou non. Une condition optionnelle additionnelle peut être de réaliser un filtrage passe-bas de la position de la pointe P ou uniquement de la composante normale Z de la position, il est possible que les mouvements rapides, comme l'inscription d'un point, ne vérifient pas les conditions obligatoires. Dans ce cas, on ajoute une condition optionnelle qui permet de gérer ce problème. La figure 5 représente ce cas. SE before the start of writing, then it is tangent to the surface during rewriting. One can, for example, calculate a weighted average of this parameter PM on the future instants and determine if it corresponds to a movement tangent to the surface or not. An additional optional condition may be to perform a low-pass filtering of the position of the tip P or only of the normal component Z of the position, it is possible that the rapid movements, such as the inscription of a point, do not verify not the mandatory conditions. In this case, we add an optional condition to handle this problem. Figure 5 represents this case.
Si la pointe P de l'ustensile U effectue un mouvement de descente suivi d'un mouvement de montée, et que la position Pos de la pointe P au moment de décision est au-dessous d'un seuil maximal de distance à la surface d'appui SA prévu pour cette option, alors on passe à l'état contact pour une seule itération. If the tip P of the utensil U makes a downward movement followed by a rising movement, and the position Pos of the tip P at the decision time is below a maximum threshold of distance to the surface of SA support provided for this option, so we go to the contact state for a single iteration.
Pour détecter ceci, on peut utiliser le paramètre de mouvement à l'instant ou les instants précédents et le paramètre de mouvement à l'instant ou les instants suivants, et détecter le moment où on a une descente rapide suivie par une montée rapide. To detect this, one can use the motion parameter at the instant or the previous instants and the motion parameter at the instant or the moments following, and detect the moment when one has a fast descent followed by a fast rise.
Il est également possible d'avoir recours à des combinaisons, par exemple des combinaisons linéaires, des instants passés et des combinaisons, par exemple des combinaisons linéaires, des instants futurs pour détecter le moment de contact entre la pointe P de l'ustensile U et la surface d'écriture, par exemple, calculer la moyenne, la valeur médiane... Concernant le raffinage de la tolérance toi sur le niveau de la surface de contact SE à l'état de non contact, si aucune des contions n'est vérifiée, on reste à l'état de non contact. Accessoirement, il est possible de raffiner la tolérance afin de combler certains problèmes tels que l'imprécision du dispositif de localisation DL de la pointe P, la flexion du papier lors de récriture, et l'augmentation de l'épaisseur du support d'écriture SUE (la diminution étant gérée par l'estimation préliminaire du niveau de la surface d'écriture SE). It is also possible to resort to combinations, for example linear combinations, past times and combinations, for example linear combinations, future times to detect the moment of contact between the tip P of the utensil U and the writing surface, for example, calculating the average, the median value ... Regarding the refining of the tolerance you on the level of the contact surface SE to the non-contact state, if none of the contions is checked, we remain in the state of non-contact. Incidentally, it is possible to refine the tolerance in order to fill certain problems such as the imprecision of the locating device DL of the tip P, the bending of the paper during rewriting, and the increase of the thickness of the writing medium SUE (the decrease being managed by the preliminary estimate of the level of the writing surface SE).
Si le paramètre de mouvement PM permet de détecter un mouvement tangentiel tel que la pointe P est au-dessous d'un seuil maximal, la tolérance est incrémentée. Cette technique permet de rapidement atteindre la nouvelle épaisseur du support d'écriture SUE et de ne pas perdre beaucoup de points à cause d'un tel changement. Le résultat peut donc être très satisfaisant mais dépend de la fréquence d'acquisition du dispositif de localisation. Cela est illustré sur la figure 6. If the movement parameter PM makes it possible to detect a tangential movement such that the point P is below a maximum threshold, the tolerance is incremented. This technique makes it possible to quickly reach the new thickness of the writing medium SUE and not to lose a lot of points because of such a change. The result can therefore be very satisfactory but depends on the acquisition frequency of the location device. This is illustrated in Figure 6.
Il est également possible de sauvegarder les instants passés tant que le mouvement est plutôt tangentiel et dès que la tolérance atteint la nouvelle épaisseur, on peut corriger les décisions de ces instants passés en considérant qu'il y avait contact. Ceci permet de se rattraper en cas de changement importants d'épaisseur du support, et est utile lorsque la déformation du support est très importante ou bien lorsque le système n'est pas assez précis. Les conditions de passage de l'état de contact à l'état de non contact, comprennent les conditions obligatoires suivantes: It is also possible to save the instants passed as long as the movement is rather tangential and as soon as the tolerance reaches the new thickness, one can correct the decisions of these past instants by considering that there was contact. This makes it possible to catch up in the event of significant changes in the thickness of the support, and is useful when the deformation of the support is very important or when the system is not precise enough. Conditions for switching from contact state to non-contact state include the following mandatory conditions:
- la position verticale de la pointe P, ou, en d'autres termes la distance h(tj) entre la surface d'appui SA et la pointe P, à l'instant tj est au- dessus du niveau minimal hmin(tj) de la surface d'écriture SE auquel est ajoutée la tolérance toi sur le niveau de la surface de contact SE. - the vertical position of the point P, or, in other words the distance h (t j ) between the bearing surface SA and the point P, at time t j is above the minimum level h min (t j ) of the writing surface SE to which the tolerance is added on the level of the contact surface SE.
- le paramètre de mouvement PM(tj) de la pointe P indique un mouvement ayant une pente par rapport à la surface d'écriture SE supérieure à un seuil. Selon le paramètre de mouvement utilisé, il est nécessaire de coupler cette condition à une condition minimale (seuil) sur le paramètre d'amplitude de mouvement ||dPos(tj)|| > dPosmin. the movement parameter PM (t j ) of the tip P indicates a movement having a slope with respect to the writing surface SE greater than a threshold. Depending on the motion parameter used, it is necessary to couple this condition to a minimum condition (threshold) on the amplitude parameter of motion || dPos (t j ) || > min .
La figure 7 représente un cas simple de fin de contact entre la pointe P de l'ustensile U et la surface d'écriture SE. Ces conditions obligatoires ne permettent pas de pallier des problèmes liés à la flexion du support d'écriture SUE ainsi que des défauts d'estimation de la position de la pointe P. Aussi, il est possible de combiner des conditions supplémentaires optionnelles permettent de déterminer si la pointe P s'est bien déconnecté de la surface d'écriture SE ou bien il s'agit juste d'une flexion de la surface d'écriture SE, d'un changement d'épaisseur dû au fait que la surface d'écriture SE n'est pas parfaitement parallèle au plan xy de la surface d'appui SA, ou encore un problème lié à la précision du dispositif d'acquisition DL. Un tel cas est illustré sur la figure 8. FIG. 7 represents a simple case of end of contact between the tip P of the utensil U and the writing surface SE. These mandatory conditions do not make it possible to mitigate problems related to the bending of the writing medium SUE as well as the defects of estimation of the position of the tip P. Also, it is possible to combine additional optional conditions to determine if the tip P is well disconnected from the writing surface SE or it is just a bending of the writing surface SE, a change of thickness due to the fact that the writing surface SE is not perfectly parallel to the xy plane of the support surface SA, or a problem related to the accuracy of the acquisition device DL. Such a case is illustrated in FIG.
Ces conditions optionnelles reposent sur la paramètre de mouvement PM (ou bien une combinaison des valeurs du paramètre de mouvement aux instants passés ou/et futurs). En effet, la signature de levé de la pointe P en cours d'une écriture ou d'un dessin et celle d'un changement d'épaisseur ne sont différentes, et il suffit d'appliquer un double seuillage : These optional conditions are based on the PM motion parameter (or a combination of the motion parameter values at past and / or future times). Indeed, the signature of survey of the tip P during a writing or a drawing and that of a change of thickness are not different, and it suffices to apply a double thresholding:
- un seuillage plus tolérant au niveau de la condition obligatoire utilisant le paramètre de mouvement PM, et a more tolerant thresholding at the level of the mandatory condition using the movement parameter PM, and
- un seuillage plus strict au niveau des conditions optionnelles qui permet de passer en état de non contact uniquement si un mouvement de pente supérieure a été détecté. Dans le cas inverse, on effectue des raffinages de l'estimation des deux paramètres suivants: a stricter thresholding at the level of the optional conditions which makes it possible to go into the non-contact state only if an upper slope movement has been detected. In the opposite case, refinements of the estimation of the two following parameters are carried out:
- le niveau minimal de la surface de contact à l'instant de décision hmin(tj), the minimum level of the contact surface at the moment of decision h min (t j ),
- la tolérance sur le niveau de la surface d'écriture à l'instant de décision tolh(tj) (l'incertitude sur le niveau de la surface de d'écriture) the tolerance on the level of the writing surface at the decision time tol h (t j ) (the uncertainty on the level of the writing surface)
On entend par seuillage le fait de comparer le paramètre de mouvement PM avec un seuil. Si ce dernier ne dépasse pas le seuil, on effectue un raffinage de l'estimation des paramètres. Ce seuil permet de dire que probablement, l'épaisseur du support a changé, et qu'il y a toujours contact. Tout comme pour les autres conditions liées aux indicateurs de mouvement PM, il est préférable de le coupler à un test de l'amplitude du mouvement pour obtenir de meilleurs résultats. Thresholding means comparing the PM motion parameter with a threshold. If the latter does not exceed the threshold, the parameter estimate is refined. This threshold makes it possible to say that, probably, the thickness of the support has changed, and that there is always contact. As with other conditions related to PM motion indicators, it is best to pair it with an amplitude of motion test for best results.
Concernant le raffinage de l'estimation distance minimale hmin(tj) entre la surface d'appui SA et la surface d'écriture SE à l'état de contact. Si aucune des conditions optionnelles n'est vérifiée, on reste à l'état de contact. Accessoirement, il est possible de raffiner l'estimation du niveau minimal hmin(tj) de la surface d'écriture SE. Ceci permet de s'adapter aux changements d'épaisseur lors de l'écriture, par exemple s'il y a de petites bosses sur la surface d'écriture SE du support SUE ou si le support SUE n'est pas parfaitement parallèle au plan xy. Concerning the refining of the minimum distance estimation h min (t j ) between the bearing surface SA and the writing surface SE in the state of contact. If none of the optional conditions are satisfied, it remains in the contact state. Incidentally, it is possible to refine the estimate of the minimum level h min (t j ) of the writing surface SE. This makes it possible to adapt to changes in thickness during writing, for example if there are small bumps on the writing surface SE of the support SUE or if the support SUE is not perfectly parallel to the plane xy.
Si la position Pos de la pointe P de l'ustensile U, i.e. la distance h(tj) dépasse le niveau minimal hmin(tj) de la surface d'écriture auquel est ajouté la tolérance tol(tj) sur le niveau de la surface d'écriture SE, on augmente la valeur du niveau minimal hmin(tj) de la surface d'écriture SE. Ceci est valable jusqu'à un certain seuil afin de ne pas favoriser les faux positifs ou fausses détections de contact. Ainsi, selon les paramètres de seuillage ainsi que les valeurs des incréments, la solution est plus ou moins tolérante aux défauts au niveau de la surface d'écriture SE. If the position Pos of the tip P of the utensil U, ie the distance h (t j ) exceeds the minimum level h min (t j ) of the writing surface to which is added the tolerance tol (t j ) on the level of the writing surface SE, the value of the minimum level h min (t j ) of the writing surface SE is increased. This is valid up to a certain threshold so as not to favor false positives or false contact detections. Thus, according to the thresholding parameters as well as the increment values, the solution is more or less fault-tolerant at the level of the writing surface SE.
La figure 9 illustre un raffinage de la tolérance sur le niveau de la surface d'écriture à l'état de contact. Quand les conditions obligatoires ne sont pas vérifiées, il est clair que la pointe P est bien en contact avec la surface d'écriture SE. Dans ce cas, on peut éventuellement profiter pour réduire la tolérance tol(tj) sur le niveau de la surface d'écriture SE. La tolérance tol(tj) ne peut pas descendre au-dessous d'un seuil minimal afin d'éviter des problèmes de trous dans les lignes tracées à cause des imperfections. Figure 9 illustrates a refinement of the tolerance on the level of the writing surface in the state of contact. When the mandatory conditions are not verified, it is clear that the tip P is in contact with the writing surface SE. In this case, it may be possible to take advantage to reduce the tolerance tol (t j ) on the level of the writing surface SE. The tolerance tol (t j ) can not fall below a minimum threshold in order to avoid problems with holes in the lines drawn because of imperfections.
Cette opération, permet de détecter rapidement des pertes de contact, puisque quand cet intervalle atteint sa valeur minimale, une levée de la pointe P le fait sortir rapidement de la zone de tolérance et permet de valider les conditions obligatoires proposées ci-dessus. This operation makes it possible to quickly detect contact losses, since when this interval reaches its minimum value, a lifting of the tip P quickly removes it from the tolerance zone and makes it possible to validate the mandatory conditions proposed above.
La figure 10 illustre un exemple de la machine à états (contact ou non contact) avec la mise à jour optionnelle de la tolérance tol(tj). Les étapes du procédé décrit ci-dessus peuvent être effectuées par un ou plusieurs processeurs programmables exécutant un programme informatique pour exécuter les fonctions de l'invention en opérant sur des données d'entrée et générant des données de sortie. Figure 10 illustrates an example of the state machine (contact or non-contact) with the optional update of tolerance tol (t j ). The steps of the method described above may be performed by one or more programmable processors executing a computer program for performing the functions of the invention by operating on input data and generating output data.
Un programme d'ordinateur peut être écrit dans n'importe quelle forme de langage de programmation, y compris les langages compilés ou interprétés, et le programme d'ordinateur peut être déployé dans n'importe quelle forme, y compris en tant que programme autonome ou comme un sous- programme, élément ou autre unité appropriée pour une utilisation dans un environnement informatique. Un programme d'ordinateur peut être déployée pour être exécuté sur un ordinateur ou sur plusieurs ordinateurs à un seul site ou répartis sur plusieurs sites et reliées entre elles par un réseau de communication. A computer program can be written in any form of programming language, including compiled or interpreted languages, and the computer program can be deployed in any form, including as a stand-alone program or as a subroutine, element, or other unit suitable for use in a computing environment. A computer program can be deployed to run on one computer or multiple computers at a single site or spread across multiple sites and interconnected by a communications network.
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR1462107A FR3029656B1 (en) | 2014-12-09 | 2014-12-09 | METHOD FOR THE CONTINUOUS DETECTION OF A CONTACT OR NON-CONTACT STATUS BETWEEN A TIP OF A UTENSIL AND A VARIABLE THICKNESS WRITING MEDIUM, AND SYSTEM THEREOF |
| PCT/EP2015/078816 WO2016091799A1 (en) | 2014-12-09 | 2015-12-07 | Method for continuously detecting a state contact or non-contact between a tip of an instrument and a writing medium having a variable thickness, and related system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3230833A1 true EP3230833A1 (en) | 2017-10-18 |
| EP3230833B1 EP3230833B1 (en) | 2019-04-10 |
Family
ID=52450467
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP15805187.0A Active EP3230833B1 (en) | 2014-12-09 | 2015-12-07 | Method for continuously detecting a state contact or non-contact between a tip of an instrument and a writing medium having a variable thickness, and related system |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US10095326B2 (en) |
| EP (1) | EP3230833B1 (en) |
| JP (1) | JP6423536B2 (en) |
| CN (1) | CN107223225B (en) |
| FR (1) | FR3029656B1 (en) |
| WO (1) | WO2016091799A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7109201B2 (en) * | 2018-01-29 | 2022-07-29 | 株式会社ワコム | A method performed by a pen or pen detection device for detecting said pen |
| FR3101717B1 (en) * | 2019-10-04 | 2021-09-10 | ISKn | system for recording a trace made by a utensil on a writing surface |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5511135A (en) * | 1993-11-29 | 1996-04-23 | International Business Machines Corporation | Stylus-input recognition correction manager |
| US5825352A (en) * | 1996-01-04 | 1998-10-20 | Logitech, Inc. | Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad |
| JP2000099251A (en) * | 1998-09-25 | 2000-04-07 | Sanyo Electric Co Ltd | Electronic pen device and character recognizing method |
| US7027648B2 (en) * | 2002-02-08 | 2006-04-11 | Microsoft Corporation | Pen out-of-proximity handwriting-recognition trigger |
| US7925088B2 (en) * | 2005-02-23 | 2011-04-12 | Hewlett-Packard Development Company, L.P. | System, method and apparatus for automatic segmentation and analysis of ink stream |
| US7728825B2 (en) * | 2005-03-22 | 2010-06-01 | Microsoft Corporation | Targeting in a stylus-based user interface |
| US20070205994A1 (en) * | 2006-03-02 | 2007-09-06 | Taco Van Ieperen | Touch system and method for interacting with the same |
| JP5237196B2 (en) * | 2009-05-26 | 2013-07-17 | 日本写真印刷株式会社 | Hybrid touch panel |
| US8514187B2 (en) * | 2009-09-30 | 2013-08-20 | Motorola Mobility Llc | Methods and apparatus for distinguishing between touch system manipulators |
| WO2011151988A1 (en) * | 2010-06-03 | 2011-12-08 | パナソニック株式会社 | Information input device, information input method and program |
| JP2013089117A (en) * | 2011-10-20 | 2013-05-13 | Alps Electric Co Ltd | Input device |
| US9182860B2 (en) * | 2012-02-08 | 2015-11-10 | Sony Corporation | Method for detecting a contact |
| FR2988862B1 (en) | 2012-03-29 | 2014-03-28 | Commissariat Energie Atomique | METHOD AND DEVICE FOR LOCATING A MAGNETIC OBJECT |
| FR2988874B1 (en) * | 2012-03-29 | 2014-03-28 | Commissariat Energie Atomique | METHOD FOR DETECTING A POINT OF CONTACT BETWEEN A TIP OF A UTENSIL AND A WRITING MEDIUM |
| JP5579780B2 (en) * | 2012-06-06 | 2014-08-27 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Input device, input support method, and program |
| JP5705885B2 (en) * | 2013-01-09 | 2015-04-22 | シャープ株式会社 | Input display device |
| US8782550B1 (en) * | 2013-02-28 | 2014-07-15 | Google Inc. | Character string replacement |
| JP6060783B2 (en) * | 2013-04-08 | 2017-01-18 | 富士通株式会社 | Correction processing program, information processing apparatus, and correction processing method |
| JP2015088032A (en) * | 2013-10-31 | 2015-05-07 | コニカミノルタ株式会社 | Input device, input value correction method, and program |
-
2014
- 2014-12-09 FR FR1462107A patent/FR3029656B1/en not_active Expired - Fee Related
-
2015
- 2015-12-07 CN CN201580074265.9A patent/CN107223225B/en active Active
- 2015-12-07 US US15/534,830 patent/US10095326B2/en active Active
- 2015-12-07 WO PCT/EP2015/078816 patent/WO2016091799A1/en not_active Ceased
- 2015-12-07 JP JP2017531757A patent/JP6423536B2/en active Active
- 2015-12-07 EP EP15805187.0A patent/EP3230833B1/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107223225B (en) | 2021-01-12 |
| CN107223225A (en) | 2017-09-29 |
| EP3230833B1 (en) | 2019-04-10 |
| US20170351350A1 (en) | 2017-12-07 |
| JP6423536B2 (en) | 2018-11-14 |
| JP2018505466A (en) | 2018-02-22 |
| US10095326B2 (en) | 2018-10-09 |
| FR3029656B1 (en) | 2017-01-13 |
| FR3029656A1 (en) | 2016-06-10 |
| WO2016091799A1 (en) | 2016-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106918807B (en) | A kind of Targets Dots condensing method of radar return data | |
| Adu-Gyamfi et al. | Multiresolution information mining for pavement crack image analysis | |
| WO2010066563A1 (en) | Device with datastream pipeline architecture for recognizing and locating objects in an image by detection window scanning | |
| EP3230833B1 (en) | Method for continuously detecting a state contact or non-contact between a tip of an instrument and a writing medium having a variable thickness, and related system | |
| EP3709049B1 (en) | Radar processing system and related noise reduction method | |
| EP3214601B1 (en) | Image enhancement method applicable to fingerprint images | |
| EP3032463B1 (en) | Method and device for tracking characters on a plurality of images of a video stream of a text | |
| EP3387619B1 (en) | Detection and monitoring of rails in a video stream | |
| EP1998288A1 (en) | Method for determining the movement of an entity equipped with an image sequence sensor, associated computer program, module and optical mouse. | |
| EP1877826B1 (en) | Markov sequence detection | |
| FR3002338A1 (en) | METHOD FOR TEMPORALLY SEGMENTING AN INSTRUMENT GESTURE, DEVICE AND TERMINAL THEREOF | |
| CN102254321B (en) | Method for automatically identifying reversed polarity channel based on first-motion wave | |
| Haider et al. | A hybrid method for edge continuity based on Pixel Neighbors Pattern Analysis (PNPA) for remote sensing satellite Images | |
| McGonigle et al. | Robust multiscale estimation of time-average variance for time series segmentation | |
| EP3236280B1 (en) | Automatic calculation of a dimension of a mobile platform | |
| FR3037992A1 (en) | ||
| EP3543652B1 (en) | Method for detecting acceleration peaks by non-uniform sampling | |
| CN105354844A (en) | Edge inflection point detection method and detection apparatus based on shape fitting | |
| FR2875626A1 (en) | METHOD FOR DETECTING AND PITCHING TARGET TARGETS IN AN OPTRONIC MONITORING SYSTEM | |
| EP4350366B1 (en) | Method of evaluating a transmission line by automatic reflectogram analysis | |
| WO2014108652A1 (en) | Estimation of the movement of an image | |
| CN107807391B (en) | Seismic data processing method, device, electronic equipment and computer storage medium | |
| EP3008547B1 (en) | Device to analyse the movement of a mobile element and corresponding method | |
| CN121325163A (en) | A method for sea state estimation based on multi-source information fusion | |
| Scandurra et al. | A Framework for Initial Transient Detection and Statistical Assessment of Convergence in CFD Simulations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20170630 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20180809 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1119579 Country of ref document: AT Kind code of ref document: T Effective date: 20190415 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015028179 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20190410 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1119579 Country of ref document: AT Kind code of ref document: T Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190710 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190910 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190710 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190711 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190810 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015028179 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| 26N | No opposition filed |
Effective date: 20200113 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20191231 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191207 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191207 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191231 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20191231 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20151207 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190410 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20241121 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20251218 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20251217 Year of fee payment: 11 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20251217 Year of fee payment: 11 |