EP0898249B1 - System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line - Google Patents

System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line Download PDF

Info

Publication number
EP0898249B1
EP0898249B1 EP97114547A EP97114547A EP0898249B1 EP 0898249 B1 EP0898249 B1 EP 0898249B1 EP 97114547 A EP97114547 A EP 97114547A EP 97114547 A EP97114547 A EP 97114547A EP 0898249 B1 EP0898249 B1 EP 0898249B1
Authority
EP
European Patent Office
Prior art keywords
image
signal
line
sensor
reticule
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP97114547A
Other languages
German (de)
French (fr)
Other versions
EP0898249A1 (en
Inventor
Pascal Richard
Jean-Claude Rais
Francois Arthofer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omega Electronics SA
Original Assignee
Omega Electronics SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to ES97114547T priority Critical patent/ES2198522T3/en
Application filed by Omega Electronics SA filed Critical Omega Electronics SA
Priority to EP97114547A priority patent/EP0898249B1/en
Priority to AT97114547T priority patent/ATE239277T1/en
Priority to DE69721520T priority patent/DE69721520T2/en
Priority to AU79921/98A priority patent/AU755152B2/en
Priority to CA002245067A priority patent/CA2245067C/en
Priority to US09/138,075 priority patent/US6411329B1/en
Publication of EP0898249A1 publication Critical patent/EP0898249A1/en
Application granted granted Critical
Publication of EP0898249B1 publication Critical patent/EP0898249B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G04—HOROLOGY
    • G04F—TIME-INTERVAL MEASURING
    • G04F13/00—Apparatus for measuring unknown time intervals by means not provided for in groups G04F5/00 - G04F10/00
    • G04F13/02—Apparatus for measuring unknown time intervals by means not provided for in groups G04F5/00 - G04F10/00 using optical means
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/22—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people in connection with sports or games
    • G07C1/24—Race time-recorders

Definitions

  • the present invention relates to a system, in particular for race timing, and more particularly such a system comprising an optical device installed landline and in line with a line of passing objects to project an image of this line on a photosensitive sensor.
  • the invention relates to also a method of adjusting the alignment of such system on an object passage line such as a finish line of a race.
  • Document EP-A-0 207 675 already discloses a system for determining the times separating the Competitors crossing the right of a crossing line of a course or reference line substantially perpendicular to their trajectory.
  • This system includes a camera, a storage and processing device of images, a control box and a control screen.
  • the camera includes an optical unit with which is associated a photosensitive sensor on which the line image of reference is intended to be formed.
  • the optical unit includes a conventional optical lens and the sensor photosensitive is formed of a bar, composed of a plurality of pixels juxtaposed in a single column, generally designated CCD bar (corresponding to the Anglo-Saxon designation "Charged Coupled Device").
  • Patent EP 0 223 119 describes another mode of possible realization for such a timing system of races.
  • the camera must be installed at a landline extension of the line reference and perpendicular to it. More in particular, the reference line must be in perfect alignment with the CCD bar of the camera.
  • This alignment is generally carried out in two steps.
  • a bench CCD bar optic with the optical device of the camera.
  • the CCD bar is moved relative to the optical unit in order to be brought into overlay with a line of a crosshair of an eyepiece mounted on the camera's optical unit using different screw adjustment mechanisms. Once this adjustment made, the CCD bar is fixed in this position using mechanical means such as screws.
  • the optical unit further comprises a mirror switching between a first position called operation, in which the plane of the mirror is clear of the optical path connecting the CCD bar to the objective and a second position, called adjustment in which the mirror is placed on said optical path and returns the image perceived by the objective, in this case the image of the reference line, on the eyepiece.
  • operation in which the plane of the mirror is clear of the optical path connecting the CCD bar to the objective
  • second position called adjustment in which the mirror is placed on said optical path and returns the image perceived by the objective, in this case the image of the reference line, on the eyepiece.
  • the settings required by the camera when its assembly at the factory is long and delicate.
  • the mechanical parts constituting the optical adjustment device by CCD report can distort and misalign the reticle of the eyepiece with respect to the CCD bar.
  • the main aim of the invention is therefore to remedy to the disadvantages of the aforementioned prior art in providing a system comprising a camera comprising a simple and inexpensive device allowing adjustment precise alignment of a photosensitive sensor of the type CCD bar on a line of passage of a race.
  • the reticle is associated with means of control via a comparator circuit receiving as input image signal and a reference signal from control means and outputting a signal of command, and the crosshair can be moved over the image by response to the control signal.
  • the system further includes means for switching the image signal either to the processing means or to the extraction means thus switching the system in a spatial mode of operation respectively temporal.
  • switching means have in particular the advantage of allowing easy verification of the system positioning at any time by switching simply the system from temporal to spatial mode.
  • the alignment method of the invention can be, once the alignment steps have been completed, simply completed to provide additional possibilities of exploiting the process such as timing.
  • the invention is not not limited to this application and that it may be advantageously used as part of any other application in which it is needed perform a sensor alignment adjustment photosensitive CCD type on a pass line of objects, for example in scanners or the like.
  • FIG. 1 shows the principle of system according to the invention designated by the reference general digital 1.
  • Runners 2 each evolving on corridor 4 at a certain speed, pass a line crossing 6 which can be here the finish line of the race.
  • a camera 8 is installed which is part of system 1.
  • the camera 8 conventionally comprises a device optical 10 formed by a photo or video lens which can if necessary be equipped with a manually operated zoom or remote control.
  • the optical device 10 projects an image of the passage line 6 on a photosensitive sensor 12 behind the lens in a plane perpendicular to that of the figure.
  • the photosensitive sensor is a CCD type sensor which is presented as illustrated in FIG.
  • the sensor 12 is capable of supplying electrical signals 16 representative of the image projected by the device optical 10 and received by this sensor. These signals 16 will designated image signal in the following description.
  • the sensor 12 comprises 750 lines and 480 columns. These sensors can be easily obtained in commerce, for example at Thomson.
  • this sensor can be a color or black and white sensor depending on the application desired.
  • the image signal 16 from the sensor 12 is supplied as input to processing means 18 via switching means 20 when these are in a first position shown in solid lines at the figure, this position corresponding to a first mode of function of the system known as spatial mode.
  • These means of processing 18 output a processed image signal 21 to display means 22.
  • These are provided to display an image representative of the image signal and are formed by a video standard screen or monitor standard such as PAL, NTSC or multimedia. Through multimedia standard we will understand a digital output intended for a computer.
  • the processing means 18 comprise an encoder 24, which performs the coding of the image signal to render it suitable for display on the monitor, as well as means 26 for generating a reticle 28 which is displayed also on the monitor overlaying the image video or embedded in a digital image.
  • These means 26 are capable of generating on the image displayed by the monitor a vertical bar of small width, typically one pixel wide, and crossing the image of top to bottom which forms the reticle 28.
  • the reticle can be formed by putting part of the signal image from a determined pixel column of the sensor in a given state, for example in a color.
  • the generating means 26 are associated, via a circuit comparator 30, to control means 32 which allow in particular to control movement horizontal of the reticle 28 on the image.
  • control can be carried out via a user interface having the shape of a keyboard 34 on which it can manually enter parameters for selecting a column of the sensor 12 which will allow the formation of the crosshairs at a given location on the monitor 22.
  • the keyboard 34 is connected to the control means 32 by a bus 36.
  • the control means 32 are by elsewhere connected to the switching means 20 in order to control, via a switching signal 31, the mode of functioning of the system as will be described more in detail below.
  • the comparator circuit 30 receives the signal as an input image 16 which comes from the sensor as well as a signal reference 37 which comes from the control means 32, and outputs a control signal 38 which is applied on the one hand to the generating means 26 of the reticle, and secondly to extraction means 40 which will be described in more detail below.
  • the reference signal 37 is a signal representative of the position of the column pixels which corresponds to the desired position of the reticle on monitor 22.
  • This signal 37 is supplied to means memory 42 forming part of the comparator circuit 30 and which store a representative numerical value of an ith column of pixels of the matrix 14 forming the sensor 12, this value corresponding to the parameters of the column of pixels entered by the user at using the keyboard 34.
  • the storage means 42 are classics and can typically be formed by a registry or RAM or ROM.
  • Memory or register 42 includes a default value of system switching on, this value can for example be the one that corresponds to the central pixel column of the pixel matrix be the 240th column in the special case of a matrix with 480 columns.
  • Memory 42 outputs a signal 43 to a first input 44 of a comparator 46.
  • the comparator circuit 30 further comprises counting means 48 of columns which receive as input the image signal 16 and output a signal of counting 50 at a second input 52 of comparator 46 which in turn provides the control signal 38.
  • the column counting means 48 are advantageously formed by a counter which resets at the start of a complete image or "frame", that is to say 50 or 60 times per second depending on the standard video used (PAL respectively NTSC).
  • Comparator 46 is typically a comparator which provides the control signal when the signal count 50 is equal to reference signal 37.
  • the extraction means 40 also receive input image signal 16 via switching means 20 when these are in a second position shown in dotted lines in the figure, this position corresponding to a second mode of operation of the system says time mode. These means 40 are provided for extract the image signal 16 in connection with the signal command 38 coming from the comparator circuit 30, electrical signals from a column of pixels of the matrix 14, which corresponds to the position of the reticle on the screen and to output a column signal 54. The column signal is then supplied to means operating 56 which can be trained for example with the image acquisition and processing circuit from a column of pixels described in the patent EP-A-0 402 749.
  • the extraction means 40 may advantageously be formed by a filtering circuit classic which only lets through part of the signal image 16 relating to the column of pixels corresponding to the reticle based on control signal 38.
  • the system according to the invention further comprises timing means 58 for reading at a frequency determined the signal column 54, or in other words electrical signals from the pixel column defined by control signal 38, the column of pixels forming an image representative of the image of the row projected on this column at a given time, the image of the line being in perfect overlap with the reticle defined above.
  • the means of timing 58 provide a timing signal 60 as a binary signal to frequency programmable by the control means 32.
  • the column reading frequency is chosen by the operator as a function of the running speed objects whose image it must retain, in this case depending on the speed of the race.
  • the operator has the keyboard on which he can manually enter the value of this frequency, the control means 32 serving as an interface between the keyboard and the timing means 58 and delivering to the latter a timing control signal 62.
  • the timing means 58 comprise a time base circuit associated with a microcontroller, these circuits which can be obtained commercially, by example under the name Intel 80186 which combines these two components into one integrated component.
  • timing means 58 provide to sensor 12 sensor 64 timing signals for manage the different read speeds or image acquisition also via the signal timing control 62 depending on the mode of system operation. It should be noted in this connection that the acquisition speed is slow and fixed in the spatial and fast and variable operation in the mode operating time.
  • display speed is standard, PAL, NTSC or multimedia video and when the signal is switched to time mode, the acquisition speed can be between 100 and 5,000 Hz i.e. the content of the column selected is refreshed 100 to 5000 times per second.
  • the timing means 58 also manage the exposure time of the image recorded.
  • the system of the invention may further comprise programmable amplification means (not shown) which would be disposed between the sensor 12 and the means switch 20 to change the contrast and brightness of the image that is displayed on the monitor and this for each color in the case of a sensor color.
  • programmable amplification means not shown
  • the pixel matrix forming the sensor 12 is positioned so as to have a plus large number of pixels in the columns than in the lines. Similarly we will prefer to scan the matrix in the column direction rather than line direction.
  • the optical axis of camera 8 must be perfectly aligned with the object passing line that we want to film in order, for example, to determine speeds or times of passage of objects or competitors in racing, with the largest precision.
  • the matrix sensor 12 will also have been adjusted relative to the camera housing 8 in particular so that the verticality of the pixel columns of sensor 12, i.e. confused with that of the walls of the camera housing. Note in this connection that the optical axis is defined by the direction perpendicular to the plane of the sensor.
  • Camera 8 equipped with a tripod or support (not shown) adjustable according to all degrees of freedom is firstly placed in the extension of the line of passage 6 so that the optical axis of the camera is appreciably directed towards this line.
  • the verticality of the pixel columns of the sensor 12 is adjusted by orienting the housing of the camera 8, for example using a spirit level, acting on adjustment knobs and / or cranks provided on the tripod.
  • the camera is engaged in spatial operating mode by acting on the switching means 20 via the keyboard 34 and the control means 32.
  • this mode of camera 8 reads at first frequency determined, the image signal 16 from the sensor 12 to form on the monitor or screen 22 an image by example a video image.
  • the reading frequency is generated by the timing means 58 in response to switching the system to space mode via the means 32.
  • the first frequency varies depending on the video standard used and can be for example respectively 50 Hz and 60 Hz depending on whether the PAL or NTSC video standard. We can of course also use the multimedia standard.
  • the reticle 28 is therefore displayed at a position on the screen, which is determined by the value contained by default in reference memory 42 to engagement.
  • the value reference is the one that corresponds to the 240th pixel column of matrix 12 so the reticle 28 is formed in the middle of the screen.
  • the CR column is selected and corresponds to reticle 28.
  • the column of pixels CR is the column of pixels that will be used when the the invention will be switched to the operating mode temporal.
  • the image signal 16 is supplied in input to the extraction means 40 which receive by elsewhere the control signal 38.
  • camera 8 reads, at a second determined frequency, the image signal 16.
  • This frequency of reading is generated by the timing means 58 in response to switching the system to time mode. This frequency is chosen, and introduced by the user via the keyboard 34 and the control means 32, depending on the scrolling speed of the objects on the crossing line 6. Typically this second reading frequency varies between 100 and 5000 Hz.
  • extraction means 40 do not pass the image signal 16 that when the control signal 38 is active for thus output the signal column 54 representative of the image intensity profile of the line of passage 6 at a given time. Consequently, the column signal 54 comes from the pixel column CR and corresponds exactly to the position of the reticle 28 of the spatial mode of operation.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Image Input (AREA)
  • Measurement Of Unknown Time Intervals (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Catching Or Destruction (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

Optical system to be placed in the extension of the crossing line or finishing line of a race having computer and electronic based means for precise alignment of the optical device with the crossing line. System comprises an optical device for projecting the image of a crossing line on to a photo-sensitive recorder, which generates electronic signals representative of the image projected by the optical device, means for treating the signal image, means for display of a video image of the image on a screen, where the original captured image is in the form of a matrix of pixels (CCD), treatment means for generation of a reticule superimposed of the video image, and means for extraction of a column of pixels form the capture matrix which corresponds to the reticule image on the screen.

Description

La présente invention concerne un système, notamment pour le chronométrage de course, et plus particulièrement un tel système comportant un dispositif optique installé à poste fixe et dans le prolongement d'une ligne de passage d'objets pour projeter une image de cette ligne sur un capteur photosensible. L'invention concerne également un procédé de réglage de l'alignement d'un tel système sur une ligne de passage d'objets telle qu'une ligne d'arrivée d'une course.The present invention relates to a system, in particular for race timing, and more particularly such a system comprising an optical device installed landline and in line with a line of passing objects to project an image of this line on a photosensitive sensor. The invention relates to also a method of adjusting the alignment of such system on an object passage line such as a finish line of a race.

On connaít déjà du document EP-A-0 207 675 un système pour la détermination des temps séparant les passages de concurrents au droit d'une ligne de passage d'une course ou ligne de référence sensiblement perpendiculaire à leur trajectoire. Ce système comprend une caméra, un dispositif de stockage et de traitement d'images, un boítier de commande et un écran de contrôle. La caméra comprend un bloc optique auquel est associé un capteur photosensible sur lequel l'image de la ligne de référence est destinée à être formée. Le bloc optique comprend un objectif optique classique et le capteur photosensible est formé d'un barreau, composé d'une pluralité de pixels juxtaposés en une seule colonne, désigné généralement barreau CCD (correspondant à l'appellation anglo-saxonne "Charged Coupled Device").Document EP-A-0 207 675 already discloses a system for determining the times separating the Competitors crossing the right of a crossing line of a course or reference line substantially perpendicular to their trajectory. This system includes a camera, a storage and processing device of images, a control box and a control screen. The camera includes an optical unit with which is associated a photosensitive sensor on which the line image of reference is intended to be formed. The optical unit includes a conventional optical lens and the sensor photosensitive is formed of a bar, composed of a plurality of pixels juxtaposed in a single column, generally designated CCD bar (corresponding to the Anglo-Saxon designation "Charged Coupled Device").

Le brevet EP 0 223 119 décrit un autre mode de réalisation possible pour un tel système de chronométrage de courses.Patent EP 0 223 119 describes another mode of possible realization for such a timing system of races.

Pour fonctionner de façon satisfaisante dans les systèmes décrits ci-dessus, la caméra doit être installée à un poste fixe dans le prolongement de la ligne de référence et perpendiculairement à celle-ci. Plus particulièrement, la ligne de référence doit être en alignement parfait avec le barreau CCD de la caméra.To function satisfactorily in systems described above, the camera must be installed at a landline extension of the line reference and perpendicular to it. More in particular, the reference line must be in perfect alignment with the CCD bar of the camera.

Cet alignement est généralement réalisé en deux étapes.This alignment is generally carried out in two steps.

Selon une première étape mise en oeuvre en usine on procède, une fois pour toute, à l'alignement sur un banc optique du barreau CCD avec le dispositif optique de la caméra. Au cours de cette opération, le barreau CCD est déplacé par rapport au bloc optique afin d'être amené en superposition avec une ligne d'une mire d'un oculaire monté sur le bloc optique de la caméra à l'aide de différents mécanismes de réglage à vis. Une fois ce réglage effectué, le barreau CCD est fixé dans cette position à l'aide de moyens mécaniques tels que des vis.According to a first step implemented in the factory, once for all aligns on a bench CCD bar optic with the optical device of the camera. During this operation, the CCD bar is moved relative to the optical unit in order to be brought into overlay with a line of a crosshair of an eyepiece mounted on the camera's optical unit using different screw adjustment mechanisms. Once this adjustment made, the CCD bar is fixed in this position using mechanical means such as screws.

Selon une deuxième étape, on procède, à chaque installation de la caméra sur le terrain à l'alignement du barreau CCD via l'oculaire avec la ligne de référence. A cet effet, le bloc optique comprend en outre un miroir basculant entre une première position dite de fonctionnement, dans laquelle le plan du miroir est dégagé du chemin optique reliant le barreau CCD à l'objectif et une deuxième position, dite de réglage dans laquelle le miroir est placé sur ledit chemin optique et renvoie l'image perçue par l'objectif, en l'occurrence l'image de la ligne de référence, sur l'oculaire. Pour effectuer l'alignement du barreau CCD avec la ligne de référence, il est donc nécessaire de placer le miroir dans la position de réglage puis de déplacer la caméra qui a été préalablement fixée à un trépied de réglage classique tout en regardant dans l'oculaire l'image de la ligne de référence jusqu'à ce que cette image se superpose à ladite ligne de la mire de l'oculaire. Une fois ce dernier réglage effectué, le pied est fixé dans cette position à l'aide de moyens mécaniques classiques et la prise de vue peut commencer.In a second step, we proceed to each camera installation in the field at alignment CCD bar via the eyepiece with the reference line. For this purpose, the optical unit further comprises a mirror switching between a first position called operation, in which the plane of the mirror is clear of the optical path connecting the CCD bar to the objective and a second position, called adjustment in which the mirror is placed on said optical path and returns the image perceived by the objective, in this case the image of the reference line, on the eyepiece. For align the CCD bar with the line of reference, so it is necessary to place the mirror in the setting position and then move the camera which has been previously fixed to an adjustment tripod classic while looking in the eyepiece the image of the reference line until this image turns superimposed on said line of the eyepiece sight. A once this last adjustment has been made, the foot is fixed in this position using conventional mechanical means and shooting can begin.

Ce système présente différents inconvénients en particulier du fait qu'il nécessite la réalisation de mécanismes de réglage comprenant de nombreuses pièces compliquées à usiner rendant la fabrication laborieuse et augmentant de façon importante le prix de revient de la caméra. On mentionnera aussi à ce propos une fiabilité restreinte du système en raison des nombreuses pièces mécaniques dont il est composé.This system has various disadvantages in particular because it requires the realization of adjustment mechanisms comprising many parts complicated to machine making manufacturing laborious and significantly increasing the cost price of the camera. Reliability will also be mentioned in this connection. restricted system due to numerous parts mechanical components.

En outre, les réglages qu'exigent la caméra lors de son assemblage à l'usine sont longs et délicats. De plus, lors de chocs ou de vibrations les pièces mécaniques constitutives du dispositif de réglage de l'optique par rapport au CCD peuvent se fausser et désaligner le réticule de l'oculaire par rapport au barreau CCD.In addition, the settings required by the camera when its assembly at the factory is long and delicate. Moreover, during shocks or vibrations the mechanical parts constituting the optical adjustment device by CCD report can distort and misalign the reticle of the eyepiece with respect to the CCD bar.

L'invention a donc pour but principal de remédier aux inconvénients de l'art antérieur susmentionné en fournissant un système comprenant une caméra comprenant un dispositif simple et bon marché permettant le réglage précis de l'alignement d'un capteur photosensible du type barreau CCD sur une ligne de passage d'une course.The main aim of the invention is therefore to remedy to the disadvantages of the aforementioned prior art in providing a system comprising a camera comprising a simple and inexpensive device allowing adjustment precise alignment of a photosensitive sensor of the type CCD bar on a line of passage of a race.

A cet effet, l'invention a pour objet un système pouvant être installé dans le prolongement d'une ligne de passage d'au moins un objet, telle qu'une ligne d'arrivée d'une course, ledit système comportant :

  • un dispositif optique pour projeter une image de cette ligne sur un capteur photosensible, ledit capteur étant capable de fournir des signaux électriques représentatifs de l'image projetée par le dispositif optique, lesdits signaux électriques définissant ainsi un signal image,
  • des moyens de traitement dudit signal image,
  • des moyens d'affichage prévus pour afficher sur un écran une image représentative dudit signal image, dite image vidéo, reliés audits moyens de traitement. Ce système est caractérisé en ce que ledit capteur est formé d'une matrice de pixels,
  • en ce qu'il est prévu des moyens pour engendrer un signal formant un réticule qui s'affiche sur ledit écran et qui se superpose à l'image vidéo, et
  • en ce que ledit système comprend en outre des moyens d'extraction recevant en entrée le signal image et prévus pour extraire, dudit signal image, des signaux électriques provenant d'une colonne de pixels de la matrice correspondant à la position du réticule sur l'écran pour fournir en sortie un signal dit signal colonne.
To this end, the subject of the invention is a system which can be installed in the extension of a crossing line of at least one object, such as a finish line of a race, said system comprising:
  • an optical device for projecting an image of this line onto a photosensitive sensor, said sensor being capable of supplying electrical signals representative of the image projected by the optical device, said electrical signals thus defining an image signal,
  • means for processing said image signal,
  • display means provided for displaying on a screen an image representative of said image signal, called a video image, connected to said processing means. This system is characterized in that said sensor is formed of a matrix of pixels,
  • in that means are provided for generating a signal forming a reticle which is displayed on said screen and which is superimposed on the video image, and
  • in that said system further comprises extraction means receiving as input the image signal and provided for extracting, from said image signal, electrical signals coming from a column of pixels of the matrix corresponding to the position of the reticle on the screen to output a signal called column signal.

Grâce à ces caractéristiques la fonction et la structure mécanique compliquées du bloc optique des systèmes de l'art antérieur sont remplacées par un capteur unique, ce qui permet à la fois d'augmenter la précision d'alignement du système et sa fiabilité tout en diminuant le coût de fabrication du système.Thanks to these characteristics the function and complicated mechanical structure of the optical unit of prior art systems are replaced by a single sensor, which both increases the system alignment accuracy and reliability while reducing the manufacturing cost of the system.

Selon une caractéristique avantageuse de l'invention, le réticule est associé à des moyens de commande via un circuit comparateur recevant en entrée le signal image et un signal de référence provenant des moyens de commande et fournissant en sortie un signal de commande, et le réticule peut être déplacé sur l'image en réponse au signal de commande.According to an advantageous characteristic of the invention, the reticle is associated with means of control via a comparator circuit receiving as input image signal and a reference signal from control means and outputting a signal of command, and the crosshair can be moved over the image by response to the control signal.

Ainsi, on peut par exemple au moyen d'un curseur électronique sélectionner la colonne de CCD qui correspond à la ligne de référence que l'on peut voir sur un écran de contrôle.So you can for example use a cursor electronics select the CCD column which corresponds to the reference line that can be seen on a control screen.

Selon un mode de réalisation préféré de l'invention, le système comprend en'outre des moyens pour commuter le signal image soit vers les moyens de traitement, soit vers les moyens d'extraction commutant ainsi le système en un mode de fonctionnement spatial respectivement temporel.According to a preferred embodiment of the invention, the system further includes means for switching the image signal either to the processing means or to the extraction means thus switching the system in a spatial mode of operation respectively temporal.

Ces moyens de commutation présentent notamment l'avantage de permettre de vérifier aisément le positionnement du système à tout moment en commutant simplement le système du mode temporel au mode spatial. En d'autres termes on peut passer du mode dans lequel le système n'utilise qu'une seule colonne de pixels pour acquérir des données représentatives de l'image à chaque instant donnée de la ligne de passage, et par exemple traiter ces données conformément à ce qui est décrit dans le brevet EP 0 402 749 qui est inclus ici par référence, au mode dans lequel le capteur est utilisé classiquement en tant que capteur d'image vidéo avec une fréquence de balayage qui ne dépend que du standard utilisé, par exemple PAL, NTSC ou analogue.These switching means have in particular the advantage of allowing easy verification of the system positioning at any time by switching simply the system from temporal to spatial mode. In other words we can go from the mode in which the system only uses one column of pixels to acquire data representative of the image each time given instant of the crossing line, and for example process this data in accordance with what is described in EP 0 402 749 which is included here by reference, to the mode in which the sensor is conventionally used as a video image sensor with a frequency of scanning which only depends on the standard used, by example PAL, NTSC or the like.

L'invention a également pour objet un procédé de réglage de l'alignement d'un système sur une ligne de passage d'objets, le système comportant un dispositif optique ayant un axe optique, le dispositif étant capable de projeter une image de cette ligne sur un capteur photosensible formé d'une matrice de pixels ladite matrice de pixels étant capable de fournir des signaux électriques représentatifs de ladite image projetée, définissant ainsi un signal image, le système comportant également des moyens de traitement dudit signal image ainsi que des moyens d'affichage reliés auxdits moyens de traitement et prévus pour afficher sur un écran une image, dite image vidéo, représentative dudit signal image, caractérisé en ce qu'il comprend les étapes consistant à:

  • (a) placer le système dans le prolongement de la ligne de passage de sorte que l'axe de son dispositif optique est sensiblement dirigé sur ladite ligne,
  • (b) lire à une première fréquence déterminée le signal électrique fourni par des pixels se trouvant dans plusieurs colonnes de la matrice formant le capteur pour former sur l'écran ladite image vidéo comprenant notamment l'image de la ligne de passage
  • (c) engendrer un signal formant un réticule qui s'affiche sur ledit écran et qui se superpose à une partie de l'image vidéo;
  • (d) superposer le réticule à l'image de la ligne de passage dans l'image vidéo;
  • (e) sélectionner la colonne de pixels du capteur qui correspond au réticule. On remarque que selon le procédé de l'invention, l'alignement du système peut être effectué en déplaçant, par exemple à l'aide d'une commande électronique, sur une image vidéo un réticule pour le superposer à l'image de la ligne de passage apparaissant sur l'image. Ainsi, les opérations de réglage de l'alignement sont simplifiées notamment en ce que la mise en oeuvre de mécanisme mécano-optique délicat est totalement éliminée.Selon un mode de mise en oeuvre avantageux de l'invention, le procédé décrit ci-dessus peut être complété par les étapes de :
  • (f) lire à une deuxième fréquence déterminée, le signal électrique fourni par la colonne de pixels sélectionnée, dit signal colonne, et qui correspond au profil d'intensité d'image de la ligne à un instant donné; et
  • (g) fournir ledit signal colonne à des moyens d'exploitation.
    • The invention also relates to a method for adjusting the alignment of a system on an object passage line, the system comprising an optical device having an optical axis, the device being capable of projecting an image of this line. on a photosensitive sensor formed of a pixel matrix, said pixel matrix being capable of supplying electrical signals representative of said projected image, thus defining an image signal, the system also comprising means for processing said image signal as well as means for display connected to said processing means and provided for displaying on a screen an image, called a video image, representative of said image signal, characterized in that it comprises the steps consisting in:
  • (a) place the system in the extension of the passage line so that the axis of its optical device is substantially directed on said line,
  • (b) reading, at a first determined frequency, the electrical signal supplied by pixels located in several columns of the matrix forming the sensor to form on the screen said video image comprising in particular the image of the pass line
  • (c) generating a signal forming a reticle which is displayed on said screen and which is superimposed on a part of the video image;
  • (d) superimposing the reticle on the image of the passage line in the video image;
  • (e) select the pixel column of the sensor which corresponds to the reticle. Note that according to the method of the invention, the alignment of the system can be carried out by moving, for example with the aid of an electronic control, on a video image a reticle to superimpose it on the image of the line. of passage appearing on the image. Thus, the alignment adjustment operations are simplified in particular in that the implementation of delicate mechanical-optical mechanism is completely eliminated. According to an advantageous embodiment of the invention, the method described above can be completed with the steps of:
  • (f) reading at a second determined frequency, the electrical signal supplied by the selected column of pixels, called the column signal, and which corresponds to the image intensity profile of the line at a given instant; and
  • (g) supplying said column signal to operating means.

    • Ainsi, le procédé d'alignement de l'invention peut être, une fois les étapes d'alignement effectuées, complété de façon simple pour offrir d'autres possibilités d'exploitation du procédé tel que le chronométrage.Thus, the alignment method of the invention can be, once the alignment steps have been completed, simply completed to provide additional possibilities of exploiting the process such as timing.

    D'autres caractéristiques et avantages de l'invention apparaítront plus clairement à lecture de la description suivante d'un mode de réalisation de l'invention donné à titre purement illustratif et non limitatif, cette description étant faite en liaison avec les figures annexées dans lesquelles :

    • la figure 1 montre un schéma bloc illustrant le principe du système selon l'invention, et
    • la figure 2 montre une vue de face schématique d'un capteur photosensible matriciel utilisé dans le système de la figure 1.
    Other characteristics and advantages of the invention will appear more clearly on reading the following description of an embodiment of the invention given purely by way of non-limiting illustration, this description being made in conjunction with the appended figures in which :
    • FIG. 1 shows a block diagram illustrating the principle of the system according to the invention, and
    • FIG. 2 shows a schematic front view of a matrix photosensitive sensor used in the system of FIG. 1.

    La description du système selon l'invention va être faite dans le cadre d'une application au chronométrage de course et plus précisément au réglage de l'alignement d'un capteur photosensible du type CCD sur une ligne de passage de coureurs en vue d'effectuer un chronométrage avec prise de vues des coureurs qui passent au droit de la ligne. The description of the system according to the invention will be made as part of an application to the timing of stroke and more precisely to the alignment adjustment a CCD type photosensitive sensor on a line of passage of runners with a view to timing with shots of runners passing by line.

    Toutefois il va de soi que l'invention n'est nullement limitée à cette application et qu'elle pourra être avantageusement utilisée dans le cadre de toute autre application dans laquelle il est nécessaire d'effectuer un réglage d'alignement d'un capteur photosensible du type CCD sur une ligne de passage d'objets, par exemple dans des scanners ou analogue.However, it goes without saying that the invention is not not limited to this application and that it may be advantageously used as part of any other application in which it is needed perform a sensor alignment adjustment photosensitive CCD type on a pass line of objects, for example in scanners or the like.

    Le schéma bloc de la figure 1 montre le principe du système selon l'invention désigné par la référence numérique générale 1. Des coureurs 2, évoluant chacun sur un couloir 4 à une certaines vitesse, passent une ligne de passage 6 qui peut être ici la ligne d'arrivée de la course. Dans le prolongement de cette ligne de passage 6 est installée une caméra 8 qui fait partie du système 1. La caméra 8 comprend de façon classique un dispositif optique 10 formé d'un objectif photo ou vidéo qui peut le cas échéant être équipé d'un zoom à commande manuelle ou télécommandé. Le dispositif optique 10 projette une image de la ligne de passage 6 sur un capteur photosensible 12 qui se trouve derrière l'objectif dans un plan perpendiculaire à celui de la figure. Selon une caractéristique de l'invention, le capteur photosensible est un capteur de type CCD qui se présente comme illustré à la figure 2 sous la forme d'une matrice de pixels 14 juxtaposés en lignes L1-Ln et en colonnes C1-Cn. Le capteur 12 est capable de fournir des signaux électriques 16 représentatifs de l'image projetée par le dispositif optique 10 et reçue par ce capteur. Ces signaux 16 seront désignés signal image dans la suite de la description. A titre d'exemple le capteur 12 comprend 750 lignes et 480 colonnes. Ces capteurs peuvent être facilement obtenus dans le-commerce, par exemple chez Thomson.The block diagram in Figure 1 shows the principle of system according to the invention designated by the reference general digital 1. Runners 2, each evolving on corridor 4 at a certain speed, pass a line crossing 6 which can be here the finish line of the race. In the extension of this crossing line 6 a camera 8 is installed which is part of system 1. The camera 8 conventionally comprises a device optical 10 formed by a photo or video lens which can if necessary be equipped with a manually operated zoom or remote control. The optical device 10 projects an image of the passage line 6 on a photosensitive sensor 12 behind the lens in a plane perpendicular to that of the figure. According to one characteristic of the invention, the photosensitive sensor is a CCD type sensor which is presented as illustrated in FIG. 2 in the form of a matrix of pixels 14 juxtaposed in rows L1-Ln and in columns C1-Cn. The sensor 12 is capable of supplying electrical signals 16 representative of the image projected by the device optical 10 and received by this sensor. These signals 16 will designated image signal in the following description. AT as an example the sensor 12 comprises 750 lines and 480 columns. These sensors can be easily obtained in commerce, for example at Thomson.

    On notera également que ce capteur peut être un capteur couleur ou noir et blanc selon l'application souhaitée.It will also be noted that this sensor can be a color or black and white sensor depending on the application desired.

    Le signal image 16 provenant du capteur 12 est fourni en entrée à des moyens de traitement 18 via des moyens de commutation 20 lorsque ces derniers sont dans une première position représentée en trait continu à la figure, cette position correspondant à un premier mode de fonctionnent du système dit mode spatial. Ces moyens de traitement 18 délivrent en sortie un signal image traité 21 à des moyens d'affichage 22. Ces derniers sont prévus pour afficher une image représentative du signal image et sont formés par un écran ou moniteur à norme vidéo standard telle que la norme PAL, NTSC ou multimédia. Par norme multimédia on comprendra une sortie numérique destinée à un ordinateur.The image signal 16 from the sensor 12 is supplied as input to processing means 18 via switching means 20 when these are in a first position shown in solid lines at the figure, this position corresponding to a first mode of function of the system known as spatial mode. These means of processing 18 output a processed image signal 21 to display means 22. These are provided to display an image representative of the image signal and are formed by a video standard screen or monitor standard such as PAL, NTSC or multimedia. Through multimedia standard we will understand a digital output intended for a computer.

    Les moyens de traitement 18 comprennent un codeur 24, qui réalise le codage du signal image pour le rendre propre à l'affichage sur le moniteur, ainsi que des moyens 26 pour engendrer un réticule 28 qui s'affiche également sur le moniteur en superposition de l'image vidéo ou en incrustation dans une image numérique. Ces moyens 26 sont aptes à engendrer sur l'image affichée par le moniteur une barre verticale de faible largeur, typiquement large d'un pixel, et traversant l'image de haut en bas qui forme le réticule 28. Typiquement, le réticule peut être formé en mettant la partie du signal image provenant d'une colonne de pixels déterminée du capteur dans un état donné par exemple dans une couleur. Les moyens générateurs 26 sont associés, via un circuit comparateur 30, à des moyens de commande 32 qui permettent notamment de commander le déplacement horizontal du réticule 28 sur l'image. Pratiquement, la commande peut être réalisée via une interface utilisateur ayant la forme d'un clavier 34 sur lequel il peut introduire manuellement des paramètres de sélection d'une colonne du capteur 12 qui permettra la formation du réticule à un endroit donné sur le moniteur 22. Le clavier 34 est relié aux moyens de commande 32 par un bus de commande 36. Les moyens de commande 32 sont par ailleurs reliés aux moyens de commutation 20 afin de commander, via un signal de commutation 31, le mode de fonctionnement du système comme cela sera décrit plus en détail ci-après. The processing means 18 comprise an encoder 24, which performs the coding of the image signal to render it suitable for display on the monitor, as well as means 26 for generating a reticle 28 which is displayed also on the monitor overlaying the image video or embedded in a digital image. These means 26 are capable of generating on the image displayed by the monitor a vertical bar of small width, typically one pixel wide, and crossing the image of top to bottom which forms the reticle 28. Typically, the reticle can be formed by putting part of the signal image from a determined pixel column of the sensor in a given state, for example in a color. The generating means 26 are associated, via a circuit comparator 30, to control means 32 which allow in particular to control movement horizontal of the reticle 28 on the image. In practice, the control can be carried out via a user interface having the shape of a keyboard 34 on which it can manually enter parameters for selecting a column of the sensor 12 which will allow the formation of the crosshairs at a given location on the monitor 22. The keyboard 34 is connected to the control means 32 by a bus 36. The control means 32 are by elsewhere connected to the switching means 20 in order to control, via a switching signal 31, the mode of functioning of the system as will be described more in detail below.

    Le circuit comparateur 30 reçoit en entrée le signal image 16 qui provient du capteur ainsi qu'un signal de référence 37 qui provient des moyens de commande 32, et fournit en sortie un signal de commande 38 qui est appliqué d'une part aux moyens générateurs 26 du réticule, et d'autre part à des moyens d'extraction 40 qui seront décrits plus en détail ci-après.The comparator circuit 30 receives the signal as an input image 16 which comes from the sensor as well as a signal reference 37 which comes from the control means 32, and outputs a control signal 38 which is applied on the one hand to the generating means 26 of the reticle, and secondly to extraction means 40 which will be described in more detail below.

    Plus précisément, le signal de référence 37 est un signal représentatif de la position de la colonne de pixels qui correspond à la position désirée du réticule sur le moniteur 22. Ce signal 37 est fourni à des moyens de mémorisation 42 faisant partie du circuit comparateur 30 et qui stockent une valeur numérique représentative d'une ième colonne de pixels de la matrice 14 formant le capteur 12, cette valeur correspondant aux paramètres de la colonne de pixels introduits par l'utilisateur à l'aide du clavier 34. Les moyens de mémorisation 42 sont classiques et peuvent être formés typiquement par un registre ou une mémoire vive ou morte. La mémoire ou registre 42 comprend une valeur par défaut à l'enclenchement du système, cette valeur peut par exemple être celle qui correspond à la colonne de pixels centrale de la matrice de pixels soit la 240ième colonne dans le cas particulier d'une matrice à 480 colonnes. La mémoire 42 fournit en sortie un signal 43 à une première entrée 44 d'un comparateur 46.More specifically, the reference signal 37 is a signal representative of the position of the column pixels which corresponds to the desired position of the reticle on monitor 22. This signal 37 is supplied to means memory 42 forming part of the comparator circuit 30 and which store a representative numerical value of an ith column of pixels of the matrix 14 forming the sensor 12, this value corresponding to the parameters of the column of pixels entered by the user at using the keyboard 34. The storage means 42 are classics and can typically be formed by a registry or RAM or ROM. Memory or register 42 includes a default value of system switching on, this value can for example be the one that corresponds to the central pixel column of the pixel matrix be the 240th column in the special case of a matrix with 480 columns. Memory 42 outputs a signal 43 to a first input 44 of a comparator 46.

    Le circuit comparateur 30 comprend en outre des moyens de comptage 48 de colonnes qui reçoivent en entrée le signal image 16 et fournissent en sortie un signal de comptage 50 à une deuxième entrée 52 du comparateur 46 qui fournit à son tour le signal de commande 38.The comparator circuit 30 further comprises counting means 48 of columns which receive as input the image signal 16 and output a signal of counting 50 at a second input 52 of comparator 46 which in turn provides the control signal 38.

    Les moyens de comptage 48 de colonnes sont avantageusement formés par un compteur qui se réinitialise à chaque début d'image complète ou "frame", c'est-à-dire 50 ou 60 fois par seconde selon le standard vidéo utilisé (PAL respectivement NTSC). The column counting means 48 are advantageously formed by a counter which resets at the start of a complete image or "frame", that is to say 50 or 60 times per second depending on the standard video used (PAL respectively NTSC).

    Le comparateur 46 est typiquement un comparateur qui fournit le signal de commande lorsque le signal de comptage 50 est égal au signal de référence 37.Comparator 46 is typically a comparator which provides the control signal when the signal count 50 is equal to reference signal 37.

    Les moyens d'extraction 40 reçoivent également en entrée le signal image 16 via les moyens de commutation 20 lorsque ces derniers sont dans une deuxième position représentée en pointillé à la figure, cette position correspondant à un deuxième mode de fonctionnement du système dit mode temporel. Ces moyens 40 sont prévus pour extraire du signal image 16 en liaison avec le signal de commande 38 provenant du circuit comparateur 30, des signaux électriques provenant d'une colonne de pixels de la matrice 14, qui correspond à la position du réticule sur l'écran et pour fournir en sortie un signal colonne 54. Le signal colonne est ensuite fourni à des moyens d'exploitation 56 qui peuvent être formés par exemple avec le circuit d'acquisition et de traitement des images provenant d'une colonne de pixels décrit dans le brevet EP-A-0 402 749. Les moyens d'extraction 40 pourront avantageusement être formés par un circuit de filtrage classique qui ne laisse passer que la partie du signal image 16 relative à la colonne de pixels correspondant au réticule sur la base du signal de commande 38.The extraction means 40 also receive input image signal 16 via switching means 20 when these are in a second position shown in dotted lines in the figure, this position corresponding to a second mode of operation of the system says time mode. These means 40 are provided for extract the image signal 16 in connection with the signal command 38 coming from the comparator circuit 30, electrical signals from a column of pixels of the matrix 14, which corresponds to the position of the reticle on the screen and to output a column signal 54. The column signal is then supplied to means operating 56 which can be trained for example with the image acquisition and processing circuit from a column of pixels described in the patent EP-A-0 402 749. The extraction means 40 may advantageously be formed by a filtering circuit classic which only lets through part of the signal image 16 relating to the column of pixels corresponding to the reticle based on control signal 38.

    Le système selon l'invention comprend en outre des moyens de cadencement 58 pour lire à une fréquence déterminée le signal colonne 54, ou en d'autres termes les signaux électriques provenant de la colonne de pixels définie par le signal de commande 38, la colonne de pixels formant une image représentative de l'image de la ligne projetée sur cette colonne à un instant donné, l'image de la ligne étant en superposition parfaite avec le réticule défini plus haut. A cet effet, les moyens de cadencement 58 fournissent un signal de cadencement d'extraction 60 sous la forme d'un signal binaire à fréquence programmable par les moyens de commande 32.The system according to the invention further comprises timing means 58 for reading at a frequency determined the signal column 54, or in other words electrical signals from the pixel column defined by control signal 38, the column of pixels forming an image representative of the image of the row projected on this column at a given time, the image of the line being in perfect overlap with the reticle defined above. To this end, the means of timing 58 provide a timing signal 60 as a binary signal to frequency programmable by the control means 32.

    La fréquence de lecture de la colonne est choisie par l'opérateur en fonction de la vitesse de défilement des objets dont il doit retenir l'image, en l'occurrence en fonction de la vitesse de la course. Pour cela, l'opérateur dispose du clavier sur lequel il peut manuellement introduire la valeur de cette fréquence, les moyens de commande 32 servant d'interface entre le clavier et les moyens de cadencement 58 et délivrant à ces derniers un signal de commande de cadencement 62. Typiquement, les moyens de cadencement 58 comprennent un circuit base de temps associé à un micro-contrôleur, ces circuits pouvant être obtenus dans le commerce, par exemple sous la dénomination Intel 80186 qui réunit ces deux composants en un seul composant intégré.The column reading frequency is chosen by the operator as a function of the running speed objects whose image it must retain, in this case depending on the speed of the race. For it, the operator has the keyboard on which he can manually enter the value of this frequency, the control means 32 serving as an interface between the keyboard and the timing means 58 and delivering to the latter a timing control signal 62. Typically, the timing means 58 comprise a time base circuit associated with a microcontroller, these circuits which can be obtained commercially, by example under the name Intel 80186 which combines these two components into one integrated component.

    En outre, les moyens de cadencement 58 fournissent au capteur 12 des signaux de cadencement capteur 64 pour gérer les différentes vitesses de lecture ou d'acquisition d'images également via le signal de commande de cadencement 62 en fonction du mode de fonctionnement du système. On notera à ce propos que la vitesse d'acquisition est lente et fixe dans le mode de fonctionnement spatial et rapide et variable dans le mode de fonctionnement temporel.In addition, the timing means 58 provide to sensor 12 sensor 64 timing signals for manage the different read speeds or image acquisition also via the signal timing control 62 depending on the mode of system operation. It should be noted in this connection that the acquisition speed is slow and fixed in the spatial and fast and variable operation in the mode operating time.

    A titre d'exemple, lorsque le système est commuté en mode de fonctionnement spatial, la vitesse d'affichage est standard, vidéo PAL, NTSC ou multimédia et lorsque le signal est commuté en mode de fonctionnement temporel, la vitesse d'acquisition peut être comprise entre 100 et 5'000 Hz c'est-à-dire que le contenu de la colonne sélectionnée est rafraíchi 100 à 5000 fois par seconde.For example, when the system is switched to spatial operating mode, display speed is standard, PAL, NTSC or multimedia video and when the signal is switched to time mode, the acquisition speed can be between 100 and 5,000 Hz i.e. the content of the column selected is refreshed 100 to 5000 times per second.

    De façon avantageuse, les moyens de cadencement 58 gèrent également le temps d'exposition de l'image enregistrée.Advantageously, the timing means 58 also manage the exposure time of the image recorded.

    Selon une variante de réalisation préférée, le système de l'invention peut comprendre en outre des moyens d'amplification programmables (non représentés) qui seraient disposés entre le capteur 12 et les moyens de commutation 20 pour modifier le contraste et la luminosité de l'image qui est affichée sur le moniteur et cela pour chaque couleur dans le cas d'un capteur couleur. According to a preferred embodiment, the system of the invention may further comprise programmable amplification means (not shown) which would be disposed between the sensor 12 and the means switch 20 to change the contrast and brightness of the image that is displayed on the monitor and this for each color in the case of a sensor color.

    Selon une caractéristique avantageuse de l'invention, et pour augmenter la résolution lors de l'extraction de l'image, la matrice de pixels formant le capteur 12 est positionnée de manière à avoir un plus grand nombre de pixels dans les colonnes que dans les lignes. De même on préférera balayer la matrice dans le sens des colonnes plutôt que dans le sens des lignes.According to an advantageous characteristic of invention, and to increase the resolution when image extraction, the pixel matrix forming the sensor 12 is positioned so as to have a plus large number of pixels in the columns than in the lines. Similarly we will prefer to scan the matrix in the column direction rather than line direction.

    Le procédé de réglage associé au système selon l'invention va maintenant être décrit ci-après.The adjustment process associated with the system according to the invention will now be described below.

    Dans de nombreuses applications du système qui vient d'être décrit, l'axe optique de la caméra 8 doit être aligné parfaitement sur la ligne de passage des objets que l'on souhaite filmer afin, par exemple, de déterminer des vitesses ou temps de passages d'objets ou de concurrents dans le cadre de courses, avec la plus grande précision.In many system applications that comes to be described, the optical axis of camera 8 must be perfectly aligned with the object passing line that we want to film in order, for example, to determine speeds or times of passage of objects or competitors in racing, with the largest precision.

    Le capteur matriciel 12 aura également été ajusté par rapport au boítier de la caméra 8 notamment pour que la verticalité des colonnes de pixels du capteur 12 soit confondue avec celle des parois du boítier de la caméra. On notera à ce propos que l'axe optique est défini par la direction perpendiculaire au plan du capteur.The matrix sensor 12 will also have been adjusted relative to the camera housing 8 in particular so that the verticality of the pixel columns of sensor 12, i.e. confused with that of the walls of the camera housing. Note in this connection that the optical axis is defined by the direction perpendicular to the plane of the sensor.

    La caméra 8 équipée d'un trépied ou support (non représenté) réglable selon tous les degrés de liberté est tout d'abord placée dans le prolongement de la ligne de passage 6 de sorte que l'axe optique de la caméra est sensiblement dirigé vers cette ligne. Au cours de cette première étape, la verticalité des colonnes de pixels du capteur 12 est réglée en orientant le boítier de la caméra 8, par exemple à l'aide d'un niveau à bulle, en agissant sur des boutons et/ou manivelles de réglage prévus sur le trépied.Camera 8 equipped with a tripod or support (not shown) adjustable according to all degrees of freedom is firstly placed in the extension of the line of passage 6 so that the optical axis of the camera is appreciably directed towards this line. During this first step, the verticality of the pixel columns of the sensor 12 is adjusted by orienting the housing of the camera 8, for example using a spirit level, acting on adjustment knobs and / or cranks provided on the tripod.

    Un fois cette opération de réglage effectuée, la caméra est enclenchée en mode de fonctionnement spatial en agissant sur les moyens de commutation 20 via le clavier 34 et les moyens de commande 32. Dans ce mode de fonctionnement, la caméra 8 lit, à une première fréquence déterminée, le signal image 16 provenant du capteur 12 pour former sur le moniteur ou écran 22 une image par exemple une image vidéo. La fréquence de lecture est engendrée par les moyens de cadencement 58 en réponse à la commutation du système en mode spatial via les moyens de commande 32. La première fréquence varie selon le standard vidéo utilisé et peut être par exemple respectivement 50 Hz et 60 Hz selon que l'on utilise le standard vidéo PAL ou NTSC. On pourra bien entendu utiliser également le standard multimédia.Once this adjustment operation has been carried out, the camera is engaged in spatial operating mode by acting on the switching means 20 via the keyboard 34 and the control means 32. In this mode of camera 8 reads at first frequency determined, the image signal 16 from the sensor 12 to form on the monitor or screen 22 an image by example a video image. The reading frequency is generated by the timing means 58 in response to switching the system to space mode via the means 32. The first frequency varies depending on the video standard used and can be for example respectively 50 Hz and 60 Hz depending on whether the PAL or NTSC video standard. We can of course also use the multimedia standard.

    A ce moment, l'image vidéo de la ligne de passage 6 et de l'environnement de cette ligne apparaissent sur le moniteur 22. On notera que la mise au point et la cadrage de l'image vidéo peuvent être effectués au cours de cette opération.At this moment, the video image of the passage line 6 and the environment of this line appear on the monitor 22. Note that the development and framing of the video image can be made during this surgery.

    On engendre alors un signal qui permet la formation du réticule 28 qui vient s'incruster ou se superposer à l'image vidéo affichée par le moniteur. Pour former ce réticule 28 on compte, dans chaque trame du signal image 16, les colonnes de pixels de la matrice 14 à l'aide du compteur 48. Le signal de comptage 50 représentatif d'une ième colonne de pixels dans la trame considérée est comparé au signal de référence 37 représentatif de la position désirée du réticule sur l'écran 22. Lorsqu'une égalité est constatée dans le comparateur 46, le signal de commande 38 est actif. Ce signal 38 est alors fourni pour toute la durée du balayage de cette colonne de pixels, dite colonne de référence CR, au générateur de réticule 26. Lorsque ce signal est actif en entrée du générateur 26, le signal image provenant de la colonne CR est forcé dans un état donné par exemple dans une couleur déterminée. Le réticule 28 est donc affiché à une position sur l'écran, qui est déterminée par la valeur contenue par défaut dans la mémoire de référence 42 à l'enclenchement. Selon un mode de réalisation la valeur de référence est celle qui correspond à la 240ième colonne de pixels de la matrice 12 de sorte que le réticule 28 est formé au milieu de l'écran. We then generate a signal that allows the formation of the reticle 28 which is encrusted or superimposed on the video image displayed by the monitor. To form this reticle 28 we count, in each frame of the image signal 16, the pixel columns of the matrix 14 using the counter 48. The counting signal 50 representative of a th column of pixels in the frame considered is compared to the reference signal 37 representative of the desired position of the reticle on screen 22. When a equality is noted in comparator 46, the signal 38 is active. This signal 38 is then supplied for the duration of the scan of this column of pixels, called CR reference column, to the generator reticle 26. When this signal is active at the input of the generator 26, the image signal coming from the column CR is forced in a given state for example in a color determined. The reticle 28 is therefore displayed at a position on the screen, which is determined by the value contained by default in reference memory 42 to engagement. According to one embodiment the value reference is the one that corresponds to the 240th pixel column of matrix 12 so the reticle 28 is formed in the middle of the screen.

    On commande ensuite le déplacement horizontal du réticule 28 sur l'écran afin d'amener le réticule en superposition exacte avec l'image vidéo de la ligne de passage 6. A cet effet, on modifie le contenu de la mémoire 42 via le clavier 34 et les moyens de commande 32.We then command the horizontal displacement of the reticle 28 on the screen to bring the reticle into exact overlay with the video image of the line of passage 6. To this end, the content of the memory 42 via the keyboard 34 and the means of command 32.

    Une fois cette opération effectuée, la colonne CR est sélectionnée et correspond au réticule 28.Once this is done, the CR column is selected and corresponds to reticle 28.

    En particulier, la colonne de pixels CR est la colonne de pixels qui sera utilisée lorsque le système de l'invention sera commuté dans le mode de fonctionnement temporel. Lorsque le système est commuté en mode de fonctionnement temporel, le signal image 16 est fourni en entrée aux moyens d'extraction 40 qui reçoivent par ailleurs le signal de commande 38. Dans ce mode de fonctionnement, la caméra 8 lit, à une deuxième fréquence déterminée, le signal image 16. Cette fréquence de lecture est engendrée par les moyens de cadencement 58 en réponse à la commutation du système en mode temporel. Cette fréquence est choisie, et introduite par l'utilisateur via le clavier 34 et les moyens de commande 32, en fonction de la vitesse de défilement des objets sur la ligne de passage 6. Typiquement cette deuxième fréquence de lecture varie entre 100 et 5000 Hz. Les moyens d'extraction 40 ne laissent passer le signal image 16 que lorsque le signal de commande 38 est actif pour fournir ainsi en sortie le signal colonne 54 représentatif du profil d'intensité d'image de la ligne de passage 6 à un instant donné. En conséquence, le signal de colonne 54 provient de la colonne de pixels CR et correspond exactement à la position du réticule 28 du mode de fonctionnement spatial.In particular, the column of pixels CR is the column of pixels that will be used when the the invention will be switched to the operating mode temporal. When the system is switched to the time operation, the image signal 16 is supplied in input to the extraction means 40 which receive by elsewhere the control signal 38. In this mode of operation, camera 8 reads, at a second determined frequency, the image signal 16. This frequency of reading is generated by the timing means 58 in response to switching the system to time mode. This frequency is chosen, and introduced by the user via the keyboard 34 and the control means 32, depending on the scrolling speed of the objects on the crossing line 6. Typically this second reading frequency varies between 100 and 5000 Hz. extraction means 40 do not pass the image signal 16 that when the control signal 38 is active for thus output the signal column 54 representative of the image intensity profile of the line of passage 6 at a given time. Consequently, the column signal 54 comes from the pixel column CR and corresponds exactly to the position of the reticle 28 of the spatial mode of operation.

    Claims (21)

    1. System (1) able to be installed in the extension of a line (6) of passage of at least one object (2), such as a finish line of a race, said system including:
      an optical device (10) for projecting an image of said line (6) onto a photosensitive sensor (12), said sensor (12) being capable of providing electric signals representative of the image projected by said optical device (10), said electric signals defining thus an image signal (16),
      processing means (18) for processing said image signal (16),
      display means (22) provided for displaying on a screen an image representative of said image signal (16), called the video image, and connected to said processing means (18), said system being characterised in that said sensor (12) is formed of a pixel matrix (14),
      in that said processing means (18) include means (26) for generating a signal forming a reticule (28) which is displayed on said screen and which is superposed onto said video image, and
      in that said system further includes extraction means (40) receiving in input the image signal (16) and intended for extracting, from said image signal, electric signals originating from the column of pixels of the matrix (14) corresponding to the position of the reticule (28) on the screen for providing a signal, called the column signal (54), in output.
    2. System according to claim 1, characterised in that said reticule (28) is associated with control means (32) via a comparator circuit (30) receiving in input said image signal (16) and a reference signal (37), originating from said control means (32), and providing a control signal (38) in output and in that said reticule (28) can be moved on said image in response to said control signal (38).
    3. System according to claim 2, characterised in that said reference signal (37) is a signal representative of the position of the pixel column which corresponds to the position of said reticule (28) on the screen.
    4. System according to any of claims 1 to 3, characterised in that the comparator circuit (30) includes column counting means (48) and memory means (42), said counting means (48) receiving in input said image signal (16) and providing in output a signal, called the counting signal (50), said memory means (42) receiving in input said reference signal (37) and providing in output a signal (43), said comparator circuit (30) further including means (46) intended for comparing said signals (43, 50) and providing in output said control signal (38).
    5. System according to any of the preceding claims, characterised in that it further includes clock means (58) for reading at a determined frequency, selected as a function of the passing speed of the object (2) over the line (6), electric signals (54) originating from said pixel column defined by said control signal (38), said pixel column forming an image representative of a line of field of the optical device in perfect superposition with the reticule (28).
    6. System according to claim 5, characterised in that said clock means (58) are connected to said sensor (12) for controlling the different image reading or image acquisition speeds and in that they are controlled by said control means (32).
    7. System according to any of claims 1 to 6, characterised in that it further includes means (20) for switching said image signal (16) either to said processing means (18) or to said extraction means (40), thereby switching said system (1) into a spatial or, repectively, a temporal operating mode.
    8. System according to any one of the preceding claims, characterised in that the matrix (14) of the sensor (12) includes 480 columns and 750 lines.
    9. System according to claims 7 and 8, characterised in that when said system (1) is switched into said spatial operating mode, the display speed is standard, of the PAL, NTSC or multimedia video type and when said image signal (16) is switched into said temporal operating mode, the acquisition speed can be comprised between 100 and 5,000 Hz.
    10. System according to claim 7, characterised in that it further includes programmable amplification means arranged between said sensor (12) and said switching means (20) for modifying the contrast and the lighting of the displayed image.
    11. System according to any one of the preceding claims, characterised in that said sensor (12) is a colour sensor.
    12. System according to any one of the preceding claims, characterised in that said sensor (12) is positioned so as to have more pixels in the columns than in the lines.
    13. Application of a system according to any one of claims 1 to 12 to the timing of races.
    14. Method for adjusting the alignment of a system (1) on a line (6) of passage of objects (2), said system including an optical device (10) having an optical axis, said device (10) being capable of projecting an image of said line (6) of passage onto a photosensitive sensor (12) formed of a matrix of pixels (14), said matrix of pixels being capable of providing electric signals representative of the projected image, defining thus an image signal (16), said system (1) also including processing means (18) for processing said image signal (16) and display means (22) connected to said processing means and provided for displaying an image on a screen, called the video image and representative of said image signal (16), characterised in that it includes the steps consisting in :
      (a) placing the system in the extension of said line (6) of passage so that the axis of its optical device (10) is substantially directed onto said line (6),
      (b) reading at a first determined frequency said image signal (16) provided by the pixels situated in several columns of the matrix (14) forming the sensor (12) to generate on said screen said video image including in particular the image of said line (6) of passage,
      (c) generating a signal forming a reticule (28) which is displayed on said screen and which is superposed onto a part of the video image,
      (d) superposing said reticule (28) onto the image of said line of passage in said video image,
      (e) selecting the pixel column of the sensor which corresponds to the reticule (28).
    15. Method according to claim 14, characterised in that the step (b) consists in reading said image signal at a video standard frequency of the PAL, NTSC or multimedia type.
    16. Method according to claim 14 or 15, characterised in that the step (d) consists in moving said reticule (28) with respect to said line (6) of passage.
    17. Method according to claim 14, characterised in that at step (c), said reticule (28) is formed substantially at the centre of the image displayed by said display means (22).
    18. Method according to claim 16, characterised in that said reticule (28) is moved on said image in response to a control signal (38).
    19. Method according to claim 14, characterised in that it further includes the steps of :
      (f) reading at a second determined frequency, the electric signal provided by the pixel column, called the column signal (54) and which corresponds to the image intensity profile of the line at a given moment, and
      (g) providing said column signal (54) to exploitation means (56).
    20. Method according to claim 19, characterised in that at step (f), prior to reading of said column signal (54), the second determined frequency is synchronised with the speed of movement of the objects (2) over the line (6) of passage.
    21. Method according to claim 19, characterised in that said second determined reading frequency can be comprised between 100 and 5,000 Hz.
    EP97114547A 1997-08-22 1997-08-22 System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line Expired - Lifetime EP0898249B1 (en)

    Priority Applications (7)

    Application Number Priority Date Filing Date Title
    EP97114547A EP0898249B1 (en) 1997-08-22 1997-08-22 System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line
    AT97114547T ATE239277T1 (en) 1997-08-22 1997-08-22 SYSTEM WITH A PHOTOSENSOR, ESPECIALLY FOR TIME MEASUREMENT IN COMPETITIONS, AND ADJUSTMENT METHOD FOR ALIGNING SUCH A SYSTEM TO A FINISH LINE
    DE69721520T DE69721520T2 (en) 1997-08-22 1997-08-22 System with a photosensor, in particular for time measurement in competitions, and setting method for aligning such a system to a finish line
    ES97114547T ES2198522T3 (en) 1997-08-22 1997-08-22 SYSTEM, MAINLY FOR TIMING; WHICH INCLUDES A PHOTOSENSIBLE SENSOR AND ADJUSTMENT PROCEDURE OF THE ALIGNMENT OF SUCH SYSTEM ON A PASSAGE PASS LINE.
    AU79921/98A AU755152B2 (en) 1997-08-22 1998-08-12 System, in particular for timing races; including a photosensitive sensor and method for adjusting the alignment of such a system with a line across which objects or persons pass
    CA002245067A CA2245067C (en) 1997-08-22 1998-08-13 System, in particular for timing races; including a photosensitive sensor and method for adjusting the alignment of such a system with a line across which objects or persons pass
    US09/138,075 US6411329B1 (en) 1997-08-22 1998-08-21 System, in particular for timing races; including a photosensitive sensor and method for adjusting the alignment of such a system with a line across which objects or persons pass

    Applications Claiming Priority (1)

    Application Number Priority Date Filing Date Title
    EP97114547A EP0898249B1 (en) 1997-08-22 1997-08-22 System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line

    Publications (2)

    Publication Number Publication Date
    EP0898249A1 EP0898249A1 (en) 1999-02-24
    EP0898249B1 true EP0898249B1 (en) 2003-05-02

    Family

    ID=8227258

    Family Applications (1)

    Application Number Title Priority Date Filing Date
    EP97114547A Expired - Lifetime EP0898249B1 (en) 1997-08-22 1997-08-22 System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line

    Country Status (7)

    Country Link
    US (1) US6411329B1 (en)
    EP (1) EP0898249B1 (en)
    AT (1) ATE239277T1 (en)
    AU (1) AU755152B2 (en)
    CA (1) CA2245067C (en)
    DE (1) DE69721520T2 (en)
    ES (1) ES2198522T3 (en)

    Families Citing this family (10)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US6985875B1 (en) * 1999-11-05 2006-01-10 Wolf Peter H Process for providing event photographs for inspection, selection and distribution via a computer network
    IL156124A (en) * 2003-05-26 2010-04-15 Rafael Advanced Defense Sys Method for identifying bad pixels against a non-uniform landscape
    US20060146132A1 (en) * 2005-01-05 2006-07-06 Hy Mayerson Video system having multiple video cameras for capturing events
    GB0917305D0 (en) 2009-10-02 2009-11-18 Timetronics Nv System and method of calibrating a system
    CN103299614B (en) * 2011-10-03 2016-08-10 松下知识产权经营株式会社 Camera head, the system using camera head and range unit
    US20140221159A1 (en) * 2012-12-21 2014-08-07 Wendell Lawrence Force feedback starting blocks
    EP2887656B1 (en) * 2013-12-20 2019-11-06 Swiss Timing Ltd. Method for adjusting a colour filter for a digital sensor
    EP2887655A1 (en) 2013-12-20 2015-06-24 Swiss Timing Ltd. Adaptive colour filter for digital sensor
    EP3982337B1 (en) * 2020-10-09 2023-09-27 Swiss Timing Ltd Method and system for improved measurement of time for moving across a finish line
    CN112907778A (en) * 2021-01-15 2021-06-04 西安菲猫创达智能技术有限公司 Integrated high-precision end point camera timing system and timing method thereof

    Family Cites Families (9)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US3678189A (en) * 1969-12-11 1972-07-18 Robert A Oswald Method of producing time-position records of objects
    FR2497369B1 (en) * 1980-12-31 1985-06-07 Ssih Equipment Sa PROCESS FOR TIMING STROKES AND DEVICE FOR CARRYING OUT SAID METHOD
    EP0207675B1 (en) * 1985-06-19 1990-05-02 Yamaguchi Cinema Corporation Video recording and reproducing apparatus
    FR2589604B1 (en) * 1985-11-04 1988-01-22 Longines Francillon Sa Cie Mon APPARATUS FOR TIMING SPORTS RACES
    AT392548B (en) * 1989-02-21 1991-04-25 Alge Guenther ELECTRONIC TIME MEASURING DEVICE
    FR2648594B1 (en) * 1989-06-15 1993-03-05 Omega Electronics Sa APPARATUS FOR TIMING COURSES
    DE3937977C1 (en) * 1989-11-15 1990-12-20 Augustin 7619 Steinach De Imhof
    DE9202456U1 (en) * 1992-02-26 1992-04-23 Imhof, Augustin, 7619 Steinach, De
    JPH06276526A (en) * 1993-03-22 1994-09-30 Hitachi Denshi Ltd Color arrival order and time discrimination device

    Also Published As

    Publication number Publication date
    ATE239277T1 (en) 2003-05-15
    DE69721520D1 (en) 2003-06-05
    CA2245067C (en) 2006-02-14
    AU7992198A (en) 1999-03-04
    EP0898249A1 (en) 1999-02-24
    US6411329B1 (en) 2002-06-25
    DE69721520T2 (en) 2004-03-18
    ES2198522T3 (en) 2004-02-01
    CA2245067A1 (en) 1999-02-22
    AU755152B2 (en) 2002-12-05

    Similar Documents

    Publication Publication Date Title
    EP0511101B1 (en) Modelling process for image pick-up system and process and system for making combinations between real pictures and artifical pictures
    US5103254A (en) Camera with subject highlighting and motion detection
    FR2649807A1 (en) FIXED IMAGE ELECTRONIC PHOTOGRAPHIC CAMERA
    EP0898249B1 (en) System, especially for timing races, containing a photosensor and method for adjusting the alignment of such a system on a finish line
    FR2827461A1 (en) Selection of region interest for wide panoramic area imager, has image processor identifying regions of interest and results user presented with user maneuvering image/selecting interest region
    FR2524235A1 (en) SPACE TRANSFORMATION SYSTEM COMPRISING A SIGNAL SIGNAL GENERATOR
    EP2082279A1 (en) Opto-electronic display assembly
    EP0448429B1 (en) Method for adjusting the stereoscopic convergence in a stereoscopic imaging equipment
    US7583293B2 (en) Apparatus and method for generating multi-image scenes with a camera
    FR2541842A1 (en) IMAGE ADJUSTMENT FOR TELEVISION CAMERA WITH INTEGRATED CIRCUITS
    FR2476864A1 (en) METHOD AND DEVICE FOR AUTOMATIC FOCUSING IN A VARIABLE-GROWTH PROJECTION SYSTEM
    FR2830337A1 (en) OPTICAL OBSERVATION INSTRUMENT WITH PHOTOGRAPHY FUNCTION
    FR2910770A1 (en) Videoconference device for e.g. TV, has light source illuminating eyes of local user viewing screen during communication with remote user, such that image sensor captures local user's image with reflection of light source on eyes
    FR2648954A1 (en) ASSISTING SYSTEM FOR ADJUSTING CATHODIC TUBES
    JP2007071891A (en) Three-dimensional measuring device
    EP1589749A1 (en) Digital image-pickup device with inclination sensor
    EP0452188B1 (en) Monitoring and imaging device with matrix sensor
    CA1252879A (en) Electronic shuttering devices
    FR2605821A1 (en) DEVICE FOR RECORDING THE IMAGE OF SURFACE ELEMENTS OF TISSUE BANDS IN DISPLACEMENT
    EP0477071B1 (en) Optical focalisation assisting device for a video camera and camera with such a device
    JP4212138B2 (en) 3D measuring device
    EP0393763A1 (en) Method for correcting offset dispersions in photoelectric sensors and correcting device therefor
    FR2659182A1 (en) SCANNING IMAGING DEVICE COMPRISING A MATRIX OF SENSORS WITH ACCUMULATION OF CHARGES.
    FR2588709A1 (en) System for enlarging a portion of an image in video filming devices, in particular with charge transfer sensor
    CA1263761A (en) Image processing device for controlling the transfer function of an optical system

    Legal Events

    Date Code Title Description
    PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

    Free format text: ORIGINAL CODE: 0009012

    AK Designated contracting states

    Kind code of ref document: A1

    Designated state(s): AT BE CH DE ES FR GB IT LI SE

    17P Request for examination filed

    Effective date: 19990824

    AKX Designation fees paid

    Free format text: AT BE CH DE ES FR GB IT LI SE

    17Q First examination report despatched

    Effective date: 20010801

    GRAG Despatch of communication of intention to grant

    Free format text: ORIGINAL CODE: EPIDOS AGRA

    GRAG Despatch of communication of intention to grant

    Free format text: ORIGINAL CODE: EPIDOS AGRA

    GRAH Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOS IGRA

    GRAH Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOS IGRA

    GRAA (expected) grant

    Free format text: ORIGINAL CODE: 0009210

    AK Designated contracting states

    Designated state(s): AT BE CH DE ES FR GB IT LI SE

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: FG4D

    Free format text: NOT ENGLISH

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: EP

    REF Corresponds to:

    Ref document number: 69721520

    Country of ref document: DE

    Date of ref document: 20030605

    Kind code of ref document: P

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: SE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20030802

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: NV

    Representative=s name: ICB INGENIEURS CONSEILS EN BREVETS SA

    GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)
    REG Reference to a national code

    Ref country code: ES

    Ref legal event code: FG2A

    Ref document number: 2198522

    Country of ref document: ES

    Kind code of ref document: T3

    PLBE No opposition filed within time limit

    Free format text: ORIGINAL CODE: 0009261

    STAA Information on the status of an ep patent application or granted ep patent

    Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

    26N No opposition filed

    Effective date: 20040203

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 19

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 20

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: GB

    Payment date: 20160726

    Year of fee payment: 20

    Ref country code: DE

    Payment date: 20160721

    Year of fee payment: 20

    Ref country code: CH

    Payment date: 20160726

    Year of fee payment: 20

    Ref country code: IT

    Payment date: 20160722

    Year of fee payment: 20

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: AT

    Payment date: 20160721

    Year of fee payment: 20

    Ref country code: FR

    Payment date: 20160720

    Year of fee payment: 20

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: ES

    Payment date: 20160727

    Year of fee payment: 20

    Ref country code: BE

    Payment date: 20160720

    Year of fee payment: 20

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R071

    Ref document number: 69721520

    Country of ref document: DE

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: PL

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: PE20

    Expiry date: 20170821

    REG Reference to a national code

    Ref country code: AT

    Ref legal event code: MK07

    Ref document number: 239277

    Country of ref document: AT

    Kind code of ref document: T

    Effective date: 20170822

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: GB

    Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

    Effective date: 20170821

    REG Reference to a national code

    Ref country code: BE

    Ref legal event code: MK

    Effective date: 20170822

    REG Reference to a national code

    Ref country code: ES

    Ref legal event code: FD2A

    Effective date: 20180508

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: ES

    Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

    Effective date: 20170823