FR2692773A1 - Correlation device for three-dimensional seizures of human organs. - Google Patents

Abstract

Device including at least three transmitters (S1-S8) and at least two receivers (R1-R3) fitted to the part of the organ to be analyzed, to a data acquisition camera, and/or to a plotting probe and/or to a stationary support, a pulse clock (18) connected to a pulse generator (19) causing the different transmitters (S1-S8) to emit in sequence, and to the receivers (R1-R3) in order to indicate to which transmitter corresponds the received signal, a converter (20) for transforming the information received by each probe into a numerical value, a computer (22-23) for determining the coordinates of each transmitter in relation to each receiver, storing the information according to each image, and deriving, based on one of the images serving as a reference, correlations of each image in relation to the reference image, in order to obtain a three-dimensional image of an organ. Application in odontology.

Description

INPUT CORRELATION DEVICE
THREE-DIMENSIONAL HUMAN ORGANS
The present invention relates to a device for correlating three-dimensional seizures of human organs with specific determination of characteristic points and a device for its implementation. In particular, this system offers a method based on the analysis of the respective position of the analysis or measurement instrument with respect to the organ analyzed or measured, and possibly all with respect to a fixed reference.

 There are different methods for grasping the shape of an internal or external human organ.

 A first method consists in making an imprint of the organ using a more or less elastic product or paste, making it possible to obtain a mold in which plaster will be cast, in order to obtain a complete replica of said organ. This method is very old and does not require any correlation for the impression of the organ itself. At most, this correlation will be brought into play, if one wishes to know the relative position of the organ studied in relation to another, if these are not united. In particular, in the dental field have been used, for many years, mechanical correctors called "bitten" and "articulators".

 However, these assume that the entire organ was captured in a single impression and the so-called correlative analysis only aims to know the static position and the relative dynamic monitoring of one of the organs compared to each other.

A second method called by micropalpage, presented by
Mushabac in 1977 (US 4 182 312) then by Becker US (US 4 411 626) and finally by Rekow (Journal of American Dental Association, Vol 122 # 13 p 42-48: 1991) is more recent and consists in micropalping the study surface and, if necessary, restore it using a micro-milling machine. Again, no intra-organ correlation method has been proposed.

 A third imprint method is called internal exploration and aims to visualize internal organs either by two-dimensional X-rays (CT or X-ray scanner), or by other investigative methods, in three dimensions, involving special radiation such as MRI (magnetic resonance imaging) or gamma and beta cameras. If these methods of exploration suppose the correlation of sections or voxels (elementary volumes), they suppose the a priori knowledge of the position of the body compared to the transmitter and the receiver. Apart from patent FR 83 07840 in the name of the Applicant, no method of correlation has been proposed.

 A final method is the so-called optical impression technique. Whether it is stereoscopy (Heitlinger, US 4 324 546) or interferometry such as moiré (Duret, US 4 611 288), it makes it possible to make a three-dimensional optical reading of the photographed objects. Again, these methods propose an inter-organ correlation by mechanical means (Duret FR 88 15483) but also optical systems (FR 82 06707) where it is proposed to follow the movements of the mandible by reading using 'a camera by visualizing the respective movements of three points on the upper jaw and three points on the lower jaw. This newly introduced method, like the others already mentioned, does not give the possibility of correlating different seizures of the same organ. With the exception of the first technique of FR 88 15483 which supposes the use of three visible spheres in the field of impression taking, all the other methods suppose or impose the fixation of the analyzed object and the camera in positions known a priori (Scanner, MRI ...) of the computer and analysis center. Thus it is relatively common today to carry out a known rotation or displacement of the object in front of the analysis instruments.

 As the user's observations show, these two approaches, spheres and fixations, considerably limit and complicate optical and micro-imprint methods to the point that some companies encourage indirect shooting on a model that is unlikely to move. , rather than on the patient.

 All other organ correlation methods using light points or other techniques only do this for dynamic monitoring of mandibular movements and, by the number and position of transmitters and receivers, they can neither allow nor optimize the correlation of three-dimensional captures of impression of all or part of the body analyzed. These other methods allow among other things the movement of an organ such as the maxilla relative to an organ such as the mandible, therefore a dynamic correlation of two organs (relative correlation) but do not allow the correlation of several views taken on the same organ (absolute correlation with respect to a benchmark depending on the impression taken).

 Finally, the identification of the points necessary for the construction of the prosthesis, as described in patent FR 88 15483, obliges to draw on the video screen important lines and points used for the realization of the future prosthesis, which is random and difficult for a man of medical skill.

 The present invention aims to allow and significantly optimize the correlation of a set of three-dimensional dental or medical views of an object or a part thereof or to correlate several objects having, possibly , is the subject of a correlation in themselves without knowing, a priori, the position of the object and the camera at the level of the computer. It also aims to allow the pointing of specific areas of the organs such as a tooth, the drawing of important lines such as the finishing line of a crown and the furrows and the location of adjacent and antagonistic elements necessary for the construction of the prosthesis . In particular, this technique allows direct location on the model or in the mouth without having to work on the display screen of three-dimensional views.

To this end, the device it relates to,
at least three transmitters and at least two receivers fixed on the part of the organ to be analyzed, on an acquisition camera, and / or on a trace probe and / or on a fixed support,
a pulsation clock connected, on the one hand, to a pulse generator causing the various transmitters to transmit successively and, on the other hand, to the receivers to indicate to them which transmitter corresponds to the received signal,
a converter transforming the information received by each sensor into a digital value,
a computer determining the coordinates of each transmitter with respect to each receiver, storing the information as a function of each shot, and making, from one of the views serving as a reference, correlations of each view with respect to the view reference, in order to obtain a three-dimensional view of the organ whose seizure is carried out.

 According to a first embodiment, the emitters are constituted by light-emitting diodes, while the receivers are constituted by photosensitive sensors, such as diodes or CCD.

 According to a second embodiment, the transmitters are ultrasonic, while the receivers are constituted by ultrasonic receivers.

 According to a third embodiment, the transmitters are magnetic or electromagnetic, while the receivers are Hall effect measurement antennas of the variable field as a function of the position of the organ which is the object of the measurement, of the camera and / or the probe.

 In the case of optical transmitters, the coordinates of each transmitter are calculated by triangulation using at least two photosensitive sensor cameras.

 In the case of ultrasonic transmitters, the coordinates of each transmitter are determined by measuring the distances by propagation / reflection of a sound wave, with the use of at least three receivers.

 In the case of magnetic or electromagnetic transmitters, the coordinates of each transmitter are determined by measuring the variation of the magnetic field, by measuring the Hall effect using at least three antennas oriented in the three directions of space.

 This device comprises means for controlling the triggering of the measurement, that is to say the analysis of the emissions concomitant with the taking of an optical impression.

 The transmitters can operate continuously, the start of the shooting triggering the storage of the information of the position of the transmitters, or on the contrary be put into operation at the beginning of the shooting.

 For their part, the receivers can either be put into operation at the time of the shooting, or operate continuously but only store the information at the time of the shooting.

In any case, the invention will be clearly understood with the aid of the description which follows, with reference to the appended schematic drawing representing, by way of nonlimiting examples, several embodiments of this device
Figures 1 to 3 are three schematic views using three types of transmitters and receivers
Figure 4 is a view schematically the control means of the device;
Figure 5 is a view of a probe for tracing or pointing;
Figure 6 is a perspective view of an alternative embodiment of this device;
Figure 7 is a perspective view of this device in the case of making impressions on body parts independent of one another in the dynamic plane;
Figures 8 and 9 are two views showing an embodiment of the outline of the circumference of an anterior tooth;
Figure 10 is a view of a representation of the correlation between different means of investigation of the human body
Figures 1 1 and 12 show the possibility of correlation of a traditional impression taking in the mouth compared to other data entry.

 FIG. 1 represents a device allowing the correlation of three-dimensional seizures of the lower jaw 2 of an individual. Three transmitters 3 constituted, for example by light-emitting diodes, are mounted on a camera 4, three transmitters 5 are installed on the lower jaw, and two transmitters 6 are arranged on a probe for locating and plotting points and lines .

 This device comprises at least two receivers 8 mounted on a fixed and stable support accepted as a reference. These receivers must be placed in a location from which it is possible to see, without embarrassment, all the transmitters during handling.

 Figure 2 is an alternative embodiment of the device of Figure 1 in which the same elements are designated by the same references as above. In this case, the transmitters 9, 10, 12 are constituted by ultrasonic transmitters, while the receivers 13 are also ultrasonic receivers.

 This device has the advantage over the previous one of being able to work without it being necessary for the receivers to see the transmitters, which considerably simplifies the manipulations, but requires a calibration of the media which will be crossed to avoid the risks of errors. .

 In the embodiment shown in FIG. 3, the transmitters 14, 15, 16 are magnetic or electro-magnetic transmitters, while the receivers are formed by Hall effect antennas 17, for measuring the variable magnetic field as a function the movement of the camera 4, of the part 2 of the body which is the object of the measurement, and of the probe 7 for drawing lines and points.

 FIG. 4 schematically represents the mechanism for controlling the device and for processing the information thereof.

A pulse clock 18 is connected to a pulse generator 19 providing control instructions to the transmitters S1,
S2, S3 of camera 4, transmitters S4, S5 of probe 7, and transmitters S6, S7, S8 of part 2 of the body whose analysis is carried out. This pulse clock 18 also provides information to the receivers
R1, R2 and R3 to indicate to them which is the transmitter from which they respectively receive the signal.

 This information, optical, ultrasonic or magnetic is converted into a digital value at the level of an analog-digital conversion card 20, to then be processed in a computer 22. This computer determines the coordinates of each transmitter, then proceeds to the correlations of each view of a picture taken as a reference, in order to obtain a single three-dimensional view.

 This correlation processing is carried out at the level of a card 17 associated with a fingerprinting or computer-assisted control system 24.

 The pulses supplied by the clock 18 are, for example, at least 0.5 kHz for an accuracy of 50 pu and for each transmitter, which gives ample time to transmit at least six suitably distinct and designated signals from the transmitters fixed on the part of the body analyzed, and to be fixed on the camera or on the trace probe.

This speed can be modified according to the ratio existing between the parasitic movements, the desired precision and the technical means available.

 In particular, if the emitters are optical, in order to avoid the phenomena of hysteresis, or thermal drifts of the diodes, the diodes can be switched on and off, for example with a rhythm of 2 KHz , with a minimum repetition of four transmissions to allow refinement of the information and establishment of an average for the calculations.

 In the case of ultrasonic transmitters, this emission being able to exceed 50 pulses per second, a cycle of a minimum of two emissions per transmitter will be proposed.

 Insofar as it is a variation of a magnetic field, this detection being continuous, it is at the level of the measurement antennas that the sampling is done.

 In the example of FIG. 4, the clock will therefore successively transmit signals S1, S2, S3, S4, S5, S6, S7 and S8.

The first five correspond to the emission of the transmitters from the camera or the track probe. Then there are the transmitters S6, S7 and
S8 corresponding to the transmitters fixed on the part of the body to be analyzed which emit successive signals.

 The triggering of the measurement, that is to say the analysis of the emissions of the transmitters is concomitant with the optical impression taking.

Two possibilities can be considered
- According to a first possibility, the transmitters transmit continuously, and the three-dimensional shooting at time T0 triggers the storage of the information of the position of the transmitters at time TO.

 - According to another possibility, the transmitters are only put into action at the time of shooting, which requires a synchronization mechanism.

 In both cases, the receivers R1, R2 and R3 are either permanently in action, but only store the information at the time of shooting, or come into action when triggering three-dimensional shooting.

 In order to avoid measurement errors, these are repeated several times, and / or the number of receivers and transmitters can be increased. In particular, in the case of ultrasound, it is advantageous to use more than three receivers.

 In order to simplify the structure of the plotting or pointing probe 7, it is sufficient to use two transmitters 25, insofar as the exact distance between these transmitters and the end 26 forming the point which comes into being is known. contact with interesting areas.

 According to another possibility, shown in FIG. 6, the device comprises receivers 27 on part 2 of the body to be analyzed, and transmitters 28, 29 on the camera and on the probe respectively.

This arrangement makes it possible to correlate the views in a relative manner on the first view taken, which is sufficient and limits the number of transmitters to five instead of eight.

 This device is very simple to implement, and has the advantage of being able to work blindly, avoiding all manipulation of location on the computer screen. This is an essential advantage because these manipulations of location on the screen are very difficult, even impossible on two-dimensional images, in particular because of a planar representation of the volumes, with the fixed character of the frozen views on the screen. , and shadows in areas of interest.

 In particular, this device makes it possible to suppress pointing on the screen followed by smoothing and mathematical skeletonization, as they are described in the document FR 88 15483. This device allows direct manipulation on the organ whose input is performed, or on a model reproducing this organ.

 Whenever the operator indicates a specific point, or a point on a line such as that of a finishing line, all he has to do is press a switch to trigger the search for transmitter position data by the receivers .

 To increase the quality of correlation thus made, it is possible for the practitioner to target certain points. Thus, if the user draws a finishing line for a dental prosthesis, it can serve as a basis for correcting correlations, views made between the position of the camera emitters and the receivers on the object or at 'outside.

The implementation of the device according to the invention, in the case of a dental application, is as follows
The practitioner realizes the size of the tooth or teeth on which it is necessary to intervene, and proceeds to the realization of an optical impression either directly in mouth, or on a model of reconstitution.

 As shown in FIG. 7, insofar as the practitioner works directly in the mouth, he fixes three transmitters, designated by the reference 30 on the lower jaw of the patient. The impression is taken in the mouth using a probe 7, itself equipped with three transmitters 32.

 These different transmitters will emit the agreed signal for each shot. For three transmitters it is possible to substitute three receivers fixed externally, for example at the syalitic level. Thus, it is possible to have the three transmitters on the probe and to fix the three receivers on the body, or vice versa. This method has the advantage of reducing the number of elements of analysis.

 This device allows the simple correlation of the arches carrying the preparation and the opposing arches. To this end, a bite is made according to the known method, but without having to target the information on the screen. It suffices, in fact, to point the information at the bite, using the probe placed on the preparation arch.

 It is also possible to make impressions on other dynamically independent parts of the body, for example, in the embodiment shown in FIG. 7 on the upper jaw. To this end, emitters 33 three in number are fixed on this upper jaw, which makes it possible to avoid the use of the dental bite as described in French patent 88 15483 and to identify the essential points of the opposing teeth directly in mouth of the patient or on the transfer model.

The implementation of the method is, in such a case, the following
- Attachment of transmitters and receivers in the patient's mouth carrying the size of the preparation, on the camera and on the probe.

 - Attachment of three additional transmitters on the opposing arch.

 - Measurement of the respective positions of the transmitters and receivers, in the closed mouth position then in the open mouth position, which makes it possible to know the displacement of the occlusal surfaces from the open mouth position to the closed mouth position.

 - On the opposing surfaces, accessible if the mouth is open, are drawn the lines and points important for good occlusion. The computer program applies to these elements drawn with the probe with two transmitters the reverse movement, mouth open, mouth closed, to position them as they are when the patient is grinding the teeth.

For more details, it is also possible to move the patient's mouth and thus to move the opposing surfaces and the elements, without it being necessary to measure them. This allows
- to eliminate an important use of dental articulators which are often too complex,
- to suppress the use of opto-electronic articulators, and
- to use static data for dynamic monitoring.

In particular, this makes it possible to follow only the movement of the centers and of the furrows, which is of capital interest and which reduces the overall use of the memory compared to the monitoring of all the surfaces.

 If the practitioner decides, for personal reasons and in order not to change his habits, to make a classic imprint, he captures and works his imprint of data on a transfer model which is either the paste having been used for the realization of the imprint, or a model made from it and cast for example in plaster. The practitioner can also use this method if accessibility in the mouth is difficult.

In this case, it proceeds as follows:
- creation of a classic footprint,
- fixation on the print or on the model resulting from this print or on the support of the print or the model of three transmitters or three receivers,
- use of the probe itself having three additional transmitters or three receivers if the transmitters are on the model,
- implementation of the probe indicated above.

 In the examples cited above, five transmitters and two receivers are used. It is possible, for technical reasons, to increase the number of receivers and the number of transmitters in order to improve accuracy.

 When it comes to using optical emitters of the light-emitting diode type, it is impossible to fix the receivers in the mouth or on the camera while being sure that they will see these emitters at the time of shooting.

 Under these conditions, only transmitters are placed in the mouth on the probe and on the camera and at least two receivers are placed outside in an area where they will receive light radiation.

 The ultrasonic receivers can be outside and in number greater than three, which has the advantage of considerably increasing the accuracy since it is possible to have wide antennas above the body analyzed.

 When the practitioner takes the information, he sets off the clock 18 which successively transmits each transmitter and which indicates to each receiver from which transmitter it has successively received signals.

 By conventional triangulation, and after carrying out a mathematical average, the computer calculates the coordinates of each transmitter with respect to each receiver.

 In the case of optical transmitters, it is carried out by conventional triangulation using at least two cameras comprising photo-sensitive sensors of the diode, CCD or other type.

 In the case of ultrasound, this is done by measuring the time separating the emission from the reception according to the known method of measuring distances by propagation / reflection of a sound wave. In this case, a minimum of three receivers must be used.

 In the case of the variation of the magnetic field, it is necessary at least three antennas arranged in the three directions of space.

 This information is stored next to each shot, for example according to a matrix system. One of these views serves as a zero reference. Using a conventional transformation matrix, the correlations of each view are performed on the view serving as a reference, so as to obtain only a single three-dimensional view of the organ whose entry has been made.

 Likewise, from the information obtained from the measurement of points or lines using the probe, each information item is correlated using the same matrix on the view obtained by correlation of the three-dimensional views. This gives complete information of the object with the indication of certain points.

This technique provides many advantages
- reduction of the clinical preparation time in the mouth and on plaster by the non-use of correlation spheres, always tedious;
- comfort for the patient and for the doctor because the spheres, used in known manner, must be positioned very precisely and are inconvenient for the patient;
- no risk of accidental movement of the spheres, since they are no longer used
- indifferent positioning of receivers and transmitters, while the spheres or any other form of indexing must always be in the reading field;
- freedom to take information, because it is no longer necessary to see the spheres in the data entry field during this information taking
- simplification of correlation of adjacent and antagonistic teeth, because it suffices to point three common points to reposition the two jaws in occlusion or any other organ, or to use three additional transmitters;
- possibility of working in areas inaccessible to correlation;
- very significant time savings in clinical work.

 Other advantages are explained below.

 With traditional techniques, the definition of the periphery of an anterior tooth remains impossible with precision on a screen, because of the shadows and the two-dimensional work that the screen requires.

 The fact of having a probe pencil ensures a rigorous, precise and easy tracing, since it is carried out directly on the tooth or any other organ before the intervention or on the symmetrical element. This layout allows the correct outline of the anterior teeth 34, as shown in FIGS. 8 and 9.

 This method also allows a preselection of the zones requiring more details, which is very important in terms of saving memory and speed of calculation for the computer.

 This device also ensures the correlation of views from other techniques such as X-rays, or other methods of internal and digital investigation, and the collection of surface information.

 Indeed, if there are several methods of investigation of the human body, surface or in depth, there is currently no possibility of correlation of the methods between them.

 The invention allows such a correlation.

 Indeed, the fact of having radio-opaque transmitters or receivers or even viewable by internal investigation methods or operating during this, allows their identification in these internal investigation analyzes, and the identification of the elements which serve as correlation benchmarks in the other methods described.

 Locating this information in, for example, at least two films of different incidence but of the same origin, makes it possible to reposition the radiological views relative to the surface views. This method is all the more effective as it does not involve any additional element than those described above.

 Thus, it is possible to associate the reading of the face, with three landmarks as described, a radiological analysis, a measurement of information in the mouth, then an analysis of dynamic movements of the elements preselected with the probe by the manipulator. This analysis provides visual information fundamental to the proper conduct of a diagnosis and / or elements correlated with each other, however derived from analyzes made on separate fields of applications, allowing the development of artificial intelligence software or an expert system. .

 It is permissible to combine measurements of the computed tomography type, with surface views thus ensuring an opening of the body to be operated on in a region and permanent monitoring of the anatomical reports.

In particular, this method is very important for implantology or drilling and the installation of an implant requiring very good knowledge of the work area and its environment to avoid accidents.

 As shown in FIG. 10, a surgical instrument 35 is equipped with transmitters 36 allowing the digitization of the act, therefore its monitoring in the already correlated and digitized universe, displayed on the screen. The limits of the zones being known, by an interactive action prior to the screen, or with the probe directly, a gradual sound signal can be emitted depending on the approach to fragile or dangerous zones. This is of paramount importance in surgical procedures where the practitioner must either work blind or open the patient's body widely. This technique makes it possible to reduce the openings and, as a result, to save healthy tissue.

 Finally, in the dental field, if the practitioner wants to correlate his traditional impression taking with respect to other information capture, he can, as shown in FIGS. 10 and 11, fix three transmitters 37 on the impression tray 38 himself then, after casting the models, place his impression tray with the model on a support carrying the receivers 39 and allowing all subsequent correlations.

 As is clear from the above, the invention brings a great improvement to the existing technique, by providing a device for correlating three-dimensional views, of simple design, offering high precision, and considerably simplifying the task of the practitioner.

 It goes without saying that the invention is not limited to the sole embodiments of this device, nor to its sole applications, described above by way of examples; on the contrary, it embraces all of its variant embodiments.

Claims (12)

 1. Correlation device for three-dimensional seizures of human organs, characterized in that it comprises  at least three transmitters (S1-S8) and at least two receivers (R1-R3) fixed on the part of the organ to be analyzed, on an acquisition camera, and / or on a trace probe and / or on a fixed support ,  a pulse clock (18) connected, on the one hand, to a pulse generator (19) causing the various transmitters (S1-S8) to successively transmit and, on the other hand, to the receivers (R1-R3) for their indicate which transmitter corresponds to the received signal,  a converter (20) transforming the information received by each sensor into a digital value,  a computer (22-23) determining the coordinates of each transmitter with respect to each receiver, storing the information as a function of each shot, and realizing, from one of the views serving as a reference, correlations of each view relative to the reference view, in order to obtain a three-dimensional view of the organ whose entry is made.  2. Device according to claim 1, characterized in that the emitters are constituted by light-emitting diodes (3, 5, 6), while the receivers are constituted by photosensitive sensors (8), such as diodes or CCD.  3. Device according to claim 1, characterized in that the transmitters (9, 10, 12) are ultrasonic, while the receivers (13) are constituted by ultrasonic receivers.  4. Device according to claim 1, characterized in that the transmitters (14, 15, 16) are magnetic or electromagnetic, while the receivers are measurement antennas (17) with Hall effect of the field variable according to the position of the organ which is the object of the measurement, of the camera and / or of the probe.  5. Device according to all of claims 1 and 2, characterized in that, in the case of optical transmitters (3, 5, 6), the coordinates of each transmitter are calculated by triangulation using at least two photosensitive sensor cameras.  6. Device according to all of claims 1 and 3, characterized in that, in the case of ultrasonic transmitters (9, 10, 12), the coordinates of each transmitter are determined by measuring the distances by propagation / reflection of a sound wave, using at least three receivers.  7. Device according to all of claims 1 and 4, characterized in that, in the case of magnetic or electromagnetic transmitters (14, 15, 16), the coordinates of each transmitter are determined by measuring the variation of the field magnetic, by measuring the Hall effect using at least three antennas (17) oriented in the three directions of space.  8. Device according to claim 1, characterized in that it comprises means for controlling the triggering of the measurement, that is to say the analysis of the emissions concomitant with the optical impression taking.  9. Device according to claim 8, characterized in that the transmitters operate continuously, the start of the three-dimensional shooting triggering the storage of the information of the position of the transmitters.  10. Device according to claim 8, characterized in that the transmitters are put into operation at the start of the shooting.  11. Device according to any one of claims 9 and 10, characterized in that the receivers are in action permanently, but do not store the information until the time of shooting.  12. Device according to any one of claims 9 and 10, characterized in that the putting into operation of the receivers is controlled at the time of shooting.