Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
  • H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
  • H04N7/014—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes involving the use of motion vectors

Definitions

• the invention relates to a method of temporal interpolation of images making it possible to reconstruct the luminance values of the pixels of a missing image in a series of images representing the same object.
• a method can be used, for example, for transmission of video images at very low bit rate, consisting in transmitting only certain frames, with coding reducing the information bit rate, and in restoring the frames not transmitted, by interpolation. from the transmitted and decoded frames. It can also be used for converting a series of video images from a standard having a frequency of 50 Hz to a standard having a frequency of 60 Hz, or vice versa. For such a conversion, most of the frames must be interpolated from the frames available at the frequency of 50 Hz, since the instants of shooting at the frequency of 60 Hz do not coincide, with the instants of shooting at the frequency of 50 Hz.
• the purpose of the interpolation is therefore to determine a luminance value L (IX, IY, T j ) for each pixel of a frame to be interpolated corresponding to an instant T j , from the luminance values L (IX, IY, T a ) and L (IX, IY, T b ) of the pixels of two known frames corresponding to instants T a and T b such that T j . is between T a and T b .
• the pixels of the frames are identified by the coordinates (IX, IY) of their center in an ortho-normalized reference which is common for all the frames.
• a first class of temporal interpolation methods is based on a simulated linear interpolation. pie consisting in calculating, for each pixel to be interpolated, a linear combination of two luminance values of the pixels having homologous coordinates (IX, IY) in the two known frames corresponding to the instants T a and T b , weighted by the durations T b -T j and T j -T a , according to the formula:
• the homologous coordinates are exactly identical if the two frames T a and T b have the same parity, and are identical to the nearest half-line if they have different parities.
• This class of methods allows good restitution of the fixed zones in a series of frames, because then the luminance values used for the interpolation effectively correspond to the same point of the object represented by the series of frames.
• the moving areas are poorly reproduced and are all the more blurred as the speed of the movement is higher.
• This vector translates an elementary translation of the pixel, which does not necessarily correspond to the speed of the object represented but corresponds to the variations in luminance of the pixels representing this object.
• These second class methods then consist in calculating an interpolated luminance value for each pixel, taking into account two displacements of opposite directions respectively in the two known frames. These two displacements are in the direction of the speed vector associated with the pixel to be interpolated, and have respectively a modulus proportional to the time interval separating the frame to be interpolated and the known frame considered.
• Each interpolated luminance value is therefore calculated according to the formula:
• Zurich Seminar on Digital Communications consists in associating with each pixel to interpolate the speed vector estimated for the pixel having the same coordinates in the first known frame. This association is always more or less inaccurate since in moving areas these two pixels do not represent the same point on the moving object. This association is only exact insofar as neighboring points of the moving object have the same velocity vector, which is not necessarily the case, especially if the object shown is rotated. The fidelity of image restitution therefore varies, in moving areas, depending on the type of movement of these areas.
• a second known method described by M. Bierling and R.
• Thoma in: Motion compensating field interpolation using a hierachically structured displacement estimator consists in estimating a speed vector for each pixel of each frame to be interpolated, independently for each frame to be interpolated. This estimate is made from the same pair of known images, for all the frames to be interpolated corresponding to instants between T a and T b , but it takes account of the duration of the time intervals separating the frame to be interpolated and the known images, therefore the speed vector associated with each pixel to be interpolated has a much more precise value than that associated by the method described above. The fidelity of restitution of the frames in the moving areas is therefore made independent of the type of movement. On the other hand, this second method has the drawback of multiplying the computation time necessary for the estimation of the speed vectors, since it is proportional to the number of frames to be interpolated comprised between the two known frames.
• the object of the invention is to propose a temporal interpolation method providing good fidelity of restitution of the frames in the moving areas, whatever the type of movement, without requiring a significant computation time for the estimation of the vectors. pixel speeds of the frames to be interpolated.
• the object of the invention is a method belonging to the second class and which essentially consists in estimating a speed vector for each pixel of a single frame which is called motion-carrying frame, which can be one of the two known frames, and then to determine, in each of the frames to be interpolated, the pixels known as child pixels, which have a speed vector equal to the speed vector of a pixel called parent pixel corresponding to the same point of the object represented by the sequence of frames, this point being assumed to move with the same speed vector during the time interval from T a to T b .
• the method according to the invention is also applicable to images which are not interlaced frames.
• a method of temporal interpolation of images for determining a value of interpolated luminance for each pixel of an image called image to interpolate, from the luminance values of the pixels of a first and of d 'a second image called known images, taken at times T a and T b respectively, T j being between T a and T b ; consisting in: associating the values of the components of a speed vector with each pixel of the image to be interpolated, said pixel to be interpolated;
• FIG. 3 shows a flowchart illustrating the method according to the invention
• FIG. 12 and 15 show the block diagram of an exemplary embodiment of a device for implementing the method according to the invention
• a frame to be interpolated is to be interpolated from a first and a second known frame called respectively frame T a and frame T b because they correspond to an instant Ta which precedes T j and to an instant T b which follows T j ,
• All these frames are identified in the same ortho-normed reference frame PXY having the dimensions of a pixel as units. Points having identical (X, Y) coordinates are differentiated by the instants corresponding to the frames where these points are located. In what follows, we will distinguish points and pixels, each grid point has infinitely small dimensions while each pixel has finite dimensions determined by the characteristics of the sampling.
• the known frames are supplied by a source of video signals such as than a conventional television camera followed by a conventional analog-to-digital converter.
• Each pixel is identified by the coordinates of its center and is represented by a dotted square.
• Each has a luminance value equal to the average of the luminances of all the points contained in this pixel.
• T a and T b two points M a and M b having coordinates which are homologous to those of M j and which are each the center of a pixel represented by a dotted square.
• the first class of known methods consists in calculating the luminance value of the pixel to be interpolated, by linearly combining the luminance values of the pixels centered on M b and on M a . There is an error due to the fact that in the frame T b the object represented is displaced, with respect to the frame T j , in the direction, and in the direction of the vector while.
• the second class of known methods consists in calculating an interpolated luminance value from the luminance values of a point B of the frame T b and a point A of the frame T a , determined by taking into account a translation of the object in the frames T a and T b , with respect to the frame T j .
• the point A is deduced from M a per a translation - (T j -T a ) and point B is deduced from
• Points A and B are called, in what follows, basic points of the temporal interpolation.
• the method according to the invention is based on the same assumption.
• FIG. 2 illustrates the step of the method according to the invention consisting in associating a speed vector to a pixel to be interpolated, centered on a point F j of the frame to be interpolated T j .
• there is only one frame T j to be interpolated but in other cases there may be several frames to be interpolated, corresponding to times between T a and T b .
• the associated speed vectors are deduced from the speed vectors of the pixels of a single frame T i , called the frame carrying the motion, corresponding to an instant between T a and T b or can be T a or T b .
• the calculations necessary to determine the speed vectors of the pixels of the carrier frame are carried out only once regardless of the number of frames to be interpolated between the instants T a and
• Each pixel of the frame T i carrying motion is considered to be the father of a single pixel, called the child pixel, in the frame to be interpolated T j , these two pixels being supposed to represent the same point of the moving object.
• This point of the moving object has a speed vector which is known in the frame T i . This point is supposed to keep this same speed vector at all times between T a and T b while it is represented by a series of pixels having different coordinates and which are all the children of the same pixel father of the frame T i .
• the method according to the invention consists in determining in each frame to interpolate T j , the center of a child pixel corresponding to a father pixel given in the frame T i carrying the movement, then in assigning to this child pixel an equal speed vector at the velocity vector of its parent pixel, or of one of its parent pixels.
• a pixel G centered on the point C i of the frame T i has for vector speed a vector known. It has a child pixel H in the frame T j , which corresponds approximately to it by a vector translation (T i -T j ) from a point C j having, in the frame T j , coordinates homologous to those of the point C i in the frame T i .
• This translation makes a point E j correspond exactly to point C j .
• the point E j does not coincide with the center of a pixel.
• the method then consists in taking as pixel son the pixel of the frame T i having a center F j closest to the point E j , by taking the nearest integer value for each of the coordinates.
• the speed vector of the father pixel G is then associated with this child pixel H.
• a pixel of the frame to be interpolated T j can be the child pixel of several parent pixels simultaneously. For example, if two parent pixels have respectively two non-collinear velocity vectors, it may happen that the two translation vectors corresponding to these velocity vectors converge in the same child pixel.
• the carrier frame T i considered is the frame T a or the frame T b .
• the estimation of the speed vectors of its pixels can consist of calculating, by a known process, the elementary translation undergone for each point of the object between the screen T a and the frame T b , deducing therefrom an elementary translation vector (DX, DY) for each pixel of the frame T b , then calculate a velocity vector for each of these pixels, according to the formula: - (3)
• FIG. 3 represents a flow diagram of the essential steps of the method according to the invention, whatever the variant of implementation which is considered.
• This flowchart represents the steps of the time interpolation method of a single frame to be interpolated, corresponding to the instant T j .
• the same steps are to be carried out.
• FIG. 3 does not mention the step of determining the speed vectors of the Dixels of the Spotifyeuse frame T i because it is a step which is carried out only once for all the frames to be interpolated situated between the two known traces corresponding to the instants T a and T b .
• the frame for which the estimation of the speed vectors is carried out can be the frame T a or the frame T b or a frame whose luminance values are unknown but which corresponds to an instant T i between T a and T b .
• it can be constituted by one of the frames to be interpolated, the main thing being to use a speed estimation method making it possible to obtain an exact value of the components of the speed vector for each pixel of this frame.
• Many methods of speed estimation can be used.
• Those carrying out the determination by block of pixels or pixel by pixel are more suitable than those carrying out the determination by extraction of the characteristics of the frame, because they allow to obtain a denser velocity vector field and therefore greater precision for each of the pixels.
• the method according to the invention comprises two main phases.
• a first phase consists in scanning the pixels of the carrier frame T i and in determining a child pixel, if there is one, in the frame to be interpolated T j , for each pixel of the carrier frame.
• a second phase then consists in successively scanning all the pixels of the frame to be interpolated T j ; to associate a speed vector to each pixel of this frame to be interpolated, as a function of the speed vector of the father pixel or of the parent pixels corresponding to the pixel to be interpolated considered, if there is at least one father pixel; determining, for each pixel to be interpolated, two base points of the temporal interpolation, in the two known frames T a and T b ; determining the luminance of these two base points by spatial interpolation in the two known frames T a and T b , when the base points are not the pixel centers of these known frames; and finally to determine an interpolated luminance value, for the pixel to be interpolated considered, by linearly combining the luminance values of the two base points in accordance with formula (2).
• FIG. 4 represents a flowchart of the first phase of a first variant implementation of the method according to the invention.
• the case where a pixel to be interpolated has several parent pixels is treated by selecting the parent pixel which is the best.
• the criterion is the value of a function called The DFD which is equal to the absolute value of the difference in the luminance values of the two base points A and B.
• the selection of the best parent pixel consists in comparing the values of the DFD function obtained by associating with the pixel to be interpolated the velocity vector of each of the parent pixels successively.
• the parent pixel considered to be the best is the one whose speed vector gives a minimum value to the DFD function.
• the case of an orphan pixel that is to say having no father pixel in the frame carrying the movement, is treated by determining a speed vector interpolated from the vectors velocity associated with the neighboring pixels in the frame to be entered, insofar as they are not orphans.
• the value of the DFD function is used as a criterion to detect pixels which are orphaned.
• this variant consists in associating a zero speed vector.
• the first phase of the first variant begins with an initialization of a memory M2 intended to store the minimum value of the DFD function determined for each pixel of the frame to be interpolated T j . it is initialized with a constant value equal to 255 which corresponds to the maximum value of the luminance of the frames and therefore also of the DFD.
• the series of frames considered is in fact constituted by a series of interlaced frames, each frame being considered as an independent frame. Each frame comprises a number M of pixels per line and a number N of lines.
• Memory M2 has a capacity of MxN bytes.
• the coordinates (IX, IY) designate the center C i of a pixel of the frame T i carrying the movement, and which can be a parent pixel. Then the vector IX, IY, T i ), which is the speed vector of this pixel, is read in a memory MI at an address corresponding to the coordinates of this pixel.
• the memory MI is a memory having a capacity of M ⁇ N cells and which is loaded beforehand with the values of the components of the speed vector of all the pixels of the motion-carrying frame used for the interpolation of the missing frames in the interval T a , T b .
• the coordinates of the center F j of a child pixel are determined by taking the integer part of the components of the vector: (0,5; 0,5) where (0,5; 0,5) makes it possible to find the integer value closest to the components, and not only the whole part of these; and or is a frame parity correction vector, having as components: (0.5; 0.5) if the frames T i and T j are frames having the same parity;
• the pixel to be interpolated centered on the point F j is a child pixel of the pixel of coordinate (IX, IY) in the frame T i .
• the method then consists in determining the coordinates of two basic interpolation points tem porelle, B and A, in the frames T b and T a respectively, according to the formulas:
• the vector is a vector of frame parity correction, having as components:
• the vector has analogous components as a function of the parity of the frame constituting the screen T j and the parity of the frame constituting the frame T b .
• the first phase of the first variant then consists in calculating the luminance values
• L ( , T a ) and L ( T b ) at points A and B according to a calculation method which will be detailed later and which consists of a spatial interpolation combining the luminance values of four pixels closest to point A, respectively of point B, when these points do not correspond not at the pixel centers of frame T a and frame T b . Then it consists in calculating the value of the DFD function, which is equal to the absolute value of the difference in luminances, at points A and B determined for this speed vector V.
• the value of the DFD function is compared with a fixed threshold value equal to 7 in this example. If the DFD function is less than the threshold value, this means that the coordinate pixel (IX, IY) in the carrier frame constitutes a parent pixel for the pixel to be interpolated centered on the point F j .
• the process consists then to read in the memory M2 a value DFD 'at an address corresponding to the components of the vector j . If the value DFD which has just been found for the parent pixel with coordinate (IX, IY) in the frame T i , is less than the value DFD 'read in the memory M2, this means that the parent pixel which comes to be found is better because its speed vector makes the value of the DFD function smaller.
• Its speed vector is therefore chosen to be associated with the child pixel centered on the point F j .
• This speed vector is written into a memory M1 at an address corresponding to the child pixel, that is to say corresponding to the components of the vector.
• the memory M1 is a memory of MxN cells intended to store the value of the components of an associated speed vector, for each pixel to be interpolated.
• the value of the DFD function which has just been calculated is written in the memory M2 at the address corresponding to the child pixel, in place of the previous DFD 'value which corresponds to another parent pixel or which is equal to the initialization value.
• the value of the DFD function read from the memory M2 is equal to the initialization value of the memory M2, c ' i.e. 255.
• the coordinate pixel (IX, IY) in the frame T i is not considered as a parent pixel, and the first phase continues with a test of the value reached by the coordinate IX.
• the pixel of coordinate (IX, IY) in the frame T i is a father pixel which is not better than a father pixel found previously and having supplied the value DFD 'which has just been read in the memory M2, it is therefore to be rejected.
• the first phase continues with the test on the IX coordinate.
• the preceding operations are repeated from the incrementation of IX. If IX has reached its maximum value, the first phase continues with a test relating to the IY coordinate. If the latter has not reached its maximum value N, the preceding operations are repeated from the increment of IY, until IY reaches N. The first phase, of the first variant, is then completed, and then begins the second phase of this first variant.
• FIG. 5 represents a flow diagram of the operations for calculating the luminance values L ( t, T a ) and of
• FIG. 6 illustrates this calculation method for the luminance value L , T a ).
• the point A does not coincide with the center of a pixel of the frame T a but is located between the centers G1, G2, G3, G4 of four pixels.
• the spatial interpolation of the luminance value at point A firstly consists in determining the integer part of the components of the vector to constitute the coordinates (XG a , YG a ) of the point G1.
• the coordinates of the point G2 are then (XG a + 1, YG a ).
• the coordinates of point G3 are then (XG a , YG a +1).
• the coordinates of point G4 are then (XG a + 1, YG a +1).
• the point G4 constitutes the reference point for the interpolation.
• the method then consists in reading from the memory MA luminance values: L (XG a , YG a ),
• the F, T a ) L (XG a + 1, YG a +1). (1- ⁇ X a ) (1- ⁇ Y a ) + L (XG a , YG a +1) . ⁇ X a . (1- ⁇ Y a )
• the calculation of the luminance value L ( , T b ) is carried out according to a sequence of operations quite similar.
• FIG. 7 represents the flowchart of the second phase of the first variant of the implementation of the method according to the invention.
• This second phase begins with an initialization at zero of a coordinate IY ', then an incrementation of one unit of this coordinate and an initialization at zero of a second coordinate IX'.
• the coordinates (IX ', IY') are the coordinates of the center of a pixel of the frame to be interpolated Tj.
• the method consists in incrementing the coordinate IX 'and in reading the value DFD (IX', IY ') stored in the memory M2 at an address corresponding to the coordinates (IX', IY ').
• the value read is compared with a threshold value equal to the value 255 having served to initialize the memory M2 and which is equal to the maximum value of the luminance.
• a speed vector is calculated by interpolating between the speed vectors of four pixels neighboring the orphan pixel, insofar as they are not themselves orphan pixels.
• This computation is carried out by reading in the memory M2 the values of the function DFD and by reading in the memory M1 the components of the speed vector for the four neighboring points whose coordinates are: (IX ', IY'-1), (IX'-1, IY'), (IX '+ 1, IY'), (IX ', IY' + 1)
• V IX ', IY' (A 00 . V (IX ', IY') +
• a 01 1 otherwise.
• the speed vector interpolated S constitutes a suitable estimate of the speed vector of the orphan pixel considered. It can therefore be associated with this orphan pixel.
• the method then consists in calculating the value of the interpolated luminance of the orphan pixel considered, L (IX ', IY', T j ) according to formula (9).
• the interpolated speed vector is not suitable and cannot be associated with the orphan pixel considered.
• a zero speed vector is associated with the orphan pixel.
• the two basic points of the temporal interpolation, A and B then have the same coordinates (IX ', IY') as the center of the pixel to be interpolated, therefore the vectors and are both equal and have components (IX ', IY').
• the luminance values L ( 1 a ) and L ( T b ) are then determined without spatial interpolation in the frames T a and T b , since IX 'and IY' are integer values. They are read in the memories MA and MB respectively at the addresses corresponding to (IX ', IY'). Then the interpolated luminance value
• an interpolated luminance value L (IX ', IY', T j ) has been calculated, this value is supplied, for example, to a memory of the frame storing the interpolated values of the frame T j in awaiting use of these luminance values. Then the value of the coordinate IX 'is compared with its maximum value M to determine whether it has reached this maximum value. If it has not reached it, the previous operations are repeated from the increment of IX '. If it has reached its maximum value, the value of the second coordinate IY 'is compared with its maximum value N. If it has not reached its maximum value, the preceding operations are repeated from the incrementation of IY'. If it has reached its maximum value, this means that all the pixels to be interpolated have been scanned and that, consequently, the temporal interpolation processing of the frame T j is finished.
• FIG. 8 represents a flowchart of the first phase of the method according to the invention, according to a second variant of implementation, making it possible to simplify the calculations and to delete the memory M2 because this variant does not use the DFD function.
• the first pha begins with an initialization of the memory M1 with the value (255, 255) which constitutes the maximum value of the components of the speed vector associated with each pixel to be interpolated.
• the ordinate IY of the pixels of the frame carrying the movement T i is initialized to zero. Then this ordinate IY is incremented by one, and the abscissa IX of the pixels of the frame carrying the movement T i is initialized to zero. Then this abscissa is incremented by one.
• the value of the components of the speed vector IX, IY, T i ) is read in the memory MI then is used to calculate the components of the vector and the components of the vector j . Then this speed vector is written in the memory M1 at the address corresponding to the components of the vector j , that is to say at the address corresponding to the coordinates of the child pixel.
• the value of the coordinate IX is compared with its maximum value M. If this is not reached the preceding operations are repeated from the incrementation of IX. If it is reached, the value of the IY coordinate is compared with its maximum value N. If this is reached, the first phase is ended and a second phase begins. If IY has not reached its maximum value N, the preceding operations are repeated from the increment of IY.
• FIG. 9 represents a flowchart of the second phase of the second variant of implementation of the method according to the invention.
• This second phase begins with an initialization at zero of the coordinate IY 'of the pixels to be interpolated. Then it consists of incrementing the coordinate IY 'and initializing the coordinate IX' to zero. Then it consists in incrementing the coordinate IX ′ by one and reading the speed vector V (IX ′, IY ′, T j ) in the memory M1 at an address corresponding to the coordinates (IX ′, IY ′). The components of this speed vector are each compared with the value 255 which is the initial value loaded into the memory M1.
• An interpolated velocity vector T is calculated by an interpola spatial map from the speed vectors of four neighboring pixels of the orphan pixel.
• the absence of use of the DFD function does not prevent detection of whether a pixel to be interpolated is an orphan pixel or not, thanks to the initialization of the memory M1 with the value (255,255) which allows to discriminate the velocity vector values which do not exist.
• the first phase does not distinguish the best parent pixel when a pixel to be interpolated has several parent pixels, therefore the associated speed vector is that corresponding to the last found parent pixel, for a given pixel to interpolate, when it has several fathers pixels.
• the velocity vector (IX ', IY', T j ) has components other than 255, this means that the pixel to be interpolated has an associated velocity vector which was determined during the first phase.
• the method then consists in calculating the vectors B and A according to formulas (5) and (6) for the speed vector read in the memory M1 or for the speed vector interpolated, associated with the pixel (IX ', IY'). Then it consists in calculating the luminance values L ( , T a ) and L , T b ). When the speed vector is not zero, this calculation is carried out by spatial interpolation in the frames T a and T b respectively, according to the flow diagram represented in FIG. 5 and described previously. When the speed vector is zero, these two luminance values are read from the memories MA and MB at the address corresponding to (IX ', IY').
• the method consists in calculating the interpolated luminance value L (IX ', IY', T j ), according to formula (10).
• the interpolated luminance value is then supplied, for example, to a frame memory to be stored while waiting for use on the interpolated frame T j .
• FIG. 10 represents a flow diagram of the first phase of the method according to the invention for a third variant of implementation of this method.
• This third variant of implementation does not require no calculation of the DFD function and does not require an M2 memory, as does the second variant. Compared with the second variant, it has the advantage of allowing the interpolated luminance values to be stored without having an additional frame memory, since this third variant makes it possible to reuse the memory M1 for storing the interpolated luminance values.
• this third variant instead of storing in the memory M1 the speed vectors associated with the child pixels as the parent pixels of the frame carrying the motion are scanned, it consists of calculating and store in M1 the interpolated luminance values corresponding to these child pixels.
• all that remains is to calculate an interpolated luminance value for each orphan pixel only.
• the value of the components of the speed vectors of the neighboring pixels not being stored it is not possible to use an interpolation to calculate a speed vector to be associated with each orphan pixel.
• the speed vector associated with the orphan pixel is then taken zero.
• the first phase of this third variant begins with an initialization of the memory M1 with the value 255 which corresponds to the maximum value of the luminance and which is therefore easy to discriminate in order to detect the orphan pixels, these being discriminable by the fact that the corresponding value of the luminance, stored in the memory M1, remains equal to 255 at the end of the first phase of the process. It also begins with an initialization of the IY coordinate to zero. Then it consists of incrementing IY by one unit and initializing the coordinate IX to zero. It then consists of incrementing the IX coordinate by one, then reading the speed vector (IX, IY, T i ) in the memory MI; then calculate the vectors according to formulas (4) to (6).
• the first phase then consists in testing the value of the coordinate IX to detect if it has reached its maximum value M. If the value M is not reached, it consists in repeating the previous operations from the incrementation of IX. When IX has reached the maximum value M, it consists in comparing the value of the coordinate IY with its maximum value N. If IY has reached the value N, the first phase is terminated. Otherwise, the previous operations are repeated from the increment of the IY coordinate.
• FIG. 11 represents a flowchart of the second phase of the third variant of implementation of the method according to the invention.
• This second phase consists first of all in initializing to zero the coordinate IY 'of a pixel of the frame to be interpolated T j ; then to increment this coordinate IY 'by one unit and to initialize to zero a second coordinate IX'. Then it consists in incrementing the coordinate IX 'of a unit; reading the luminance value stored in the memory M1 at the address corresponding to the coordinates (IX ', IY'); and to compare this luminance value with the value 255 which is the value loaded initially in the memory M1.
• the luminance value is other than 255, this means that a luminance value was determined during the first phase, for the pixel to be interpolated with coordinates (IX ', IY'). If the luminance value is equal to 255, this means that this pixel to be interpolated has no parent pixel in the frame carrying the movement T i . In this case, a zero speed vector is assigned to this orphan pixel, and the vectors F and have components equal to those of the vector carrying the center of the pixel to be interpolated, that is to say (IX ', IY').
• the luminance values of the two basic points of the temporal interpolation, L ( A, T a ) and L ( , T b ) are read in the memories MA and MB at the address corresponding to (IX ', IY'). Then an interpolated luminance value L (IX ', IY', T j ) is calculated according to formula (9). Finally, the interpolated luminance value is written into the memory M1 at the address corresponding to the coordinates (IX ', IY') to be stored there while waiting for the luminance values of the interpolated frame T j to be used . At the end of the processing of all the pixels of the frame to be interpolated, the memory M1 will be filled with the interpolated luminance values. The memory M1 therefore plays the role of the memory of the additional frame which was necessary to store the interpolated luminance values according to the first and the second variant of implementation, described above.
• FIG. 12 represents the block diagram of a first part of a device for implementing the method according to the invention, in accordance with the first variant described above.
• This first part comprises: an input terminal 1; a multiplexing device 2; a motion estimation device 3; a sequencer 4; a memory 5 called memory MI; a device 7 for calculating the vector ; an address and data bus, 9; a computing device 10; a memory MA, for storing the luminance values of the frame corresponding to the instant T a ; a memory MB for storing the luminance values of the frame corresponding to the instant T b ; and calculation means 5a, for associating a speed vector with each pixel to be interpolated having at least one parent pixel.
• These calculation means 5a comprise: a device 6 for calculating the vector ; a device 8 for calculating the vector ; a device 10 for calculating
• the multiplexing device 2 has an input connected to the input terminal 1 of the interpolation device to receive a series of luminance values corresponding to a series of known frames constituted by frames of conventional television frames. These luminance values are provided, for example, by a television camera and an analog-to-digital converter.
• the device 2 has an output connected to the bus 9, which is a data, address and command bus, for transmitting the luminance values either to the memory MA or to the memory MB.
• the frame corresponding to time T a is assumed to precede the frame corresponding to time T b , but during the processing of a series of frames memories MA and MB are used alternately to store the frame the most recent.
• the sequencer 4 supplies control signals to all of this exemplary embodiment and in particular to the device 2, in synchronism with the luminance values applied to the input terminal 1.
• the motion estimation device 3 has an input -output connected to bus 9 to enable it to control the reading of luminance values in the memories MA and MB, and the writing of the values of the components of the speed vector of the pixels of the frame T i in the memory MI.
• the device 3 is produced, for example, in accordance with the description of US Pat. No. 4,383,272. It provides an estimate of motion constituted by the components of a speed vector for each pixel of a frame corresponding to an instant T i between the instants T a and the instants T b , as a function of the luminance values of the known frames at the instants T a and T b ,
• the memory MI has an address input connected to an output of the sequencer 4 to receive an address constituted by the coordinates (IX, IY) of a pixel of the frame carrying the movement T i .
• the sequencer 4 provides a series of coordinates corresponding to the usual scanning order of a frame of the television frame. This series of coordinates is also provided at a first input of the computing device 7.
• a second input of the computing device 7 is connected to a data output of the memory MI to receive the value of the components of the speed vector (IX, IY, T i ) read in the MI memory at the address (IX, IY). The value of these components is also applied to an input of the computing device 6, to an input of the computing device 8, and to a first input of the multiplexer 18.
• the calculation devices 6, 7, and 8 operate in parallel to determine the components of the vectors, respectively.
• j PB For each pixel of coordinates (IX, IY) in the frame T i carrying the movement, the computing device 7 determines the center F j of a child pixel, if there is one; the calculation devices 6 and 8 determine the coordinates of the base points A and B for a temporal interpolation, with a view to calculating a luminance value for the child pixel.
• Devices 6 and 8 respectively provide the components of the vector and vector to an input of the computing device 10 and to an input of the computing device 11.
• the calculation device 10 has an output and an input connected respectively to an address input and to a data output of the memory MA, for controlling in the memory MA the reading of the luminance values necessary for a spatial interpolation from the pixels neighboring point A in frame T a .
• the device 11 has an output and an input linked respectively to an address input and to a data output of the memory MB to read there the luminance values necessary for a spatial interpolation between the pixels neighboring point B in the frame T b .
• the luminance values L (PX, T a ) and L ( F ⁇ f, T b ) calculated respectively by devices 10 and 11 are applied respectively to two inputs of the subtractor 14 to calculate a value of the DFD function.
• Subtractor 14 provides an algebraic value whose absolute value constitutes the value of the DFD function. This is applied to a first input of the multiplexer 17 and to first inputs of the comparators 15 and 16.
• a second input of the comparator 15 receives a value DFD 'of the DFD function read in the memory M2 at an address constituted by the components of the vector ⁇ ie corresponding to the child pixel being processed.
• the comparator 16 has a second input receiving a threshold value: 7.
• the comparators 15 and 16 each have an output connected to an input of the AND logic gate 19 to validate the latter when the value of the DFD function supplied by the subtractor 14 is less than the threshold value 7 and less than the value DFD 'read from the memory M2.
• the door 19 has an output connected to a control input of the multiplexer 17 and to a control input of the multiplexer 18.
• the second input of the multiplexer 17 is connected to the data output the memory M2.
• the first and second input of the multiplexer 18 are respectively connected to the data output of the memory MI providing the vector (IX, IY, T i ), and to an output of the memory M1 providing the value of the components of a speed vector read at the address constituted by the components j
• the memories M1 and M2 each have an address input connected to the output of the computing device 7 to receive the value of the components of the vector. PF j .
• the sequencer 4 controls in the memories M1 and M2, a reading at the address constituted by the components of the vector PF j . This reading allows to know the value DFD 'of the DFD function and the value of the components of the speed vector previously found if the pixel centered on the point F j has at least one parent pixel having been determined previously.
• the signal supplied by the output of the gate 19 controls the multiplexers 17 and 18 to transmit respectively the value of the DFD function supplied by the subtractor 14 and the speed vector supplied by the output of the memory MI.
• the multiplexers 17 and 18 respectively transmit the value DFD' provided by the memory M2 and the speed vector supplied by the memory M1.
• the output of the multiplexer 17 and the output of the multiplexer 18 are respectively connected to data inputs of the memories M2 and M1.
• the sequencer 4 commands a write in these memories to write the value of the DFD function transmitted by the multiplexer 17 and the speed vector transmitted by the multiplexer T8.
• the content of memories M2 and M1 is therefore renewed when a better parent pixel is detected.
• An initialization device 20 has two outputs connected respectively to the address input and to the data input of the memory M2 to provide it with a series of address values making it possible to write the value 255 at all the addresses during an initialization phase preceding the processing of each frame.
• the device 20 and the memory M2 are controlled by the sequencer 4 to carry out this writing.
• the address input and the data input of the memory M2 are connected on the other hand to an input terminal 26 and to an input terminal 28 which are connected to the second part of this exemplary embodiment.
• the data output of the memory M2 and the data output of the memory M1 are connected respectively to two output terminals 27 and 30, connected to the second part of this exemplary embodiment.
• FIG. 13 represents a more detailed block diagram of the calculation devices 6, 7, 8, 10 and 11.
• the device 6 comprises a multiplier 61, a device 62 for correcting parity of frames, and an adder 63.
• a second input of the multiplier 61 permanently receives the value - (T j -T a ).
• An output of the multiplier 61 is connected to an input of the device 62 to provide it with the value of the components of a vector: -V. (T j -T a ).
• the device 62 adds to the value of these components, the value of the components of the vector Z which is a function of the parity of the frame being interpolated and of the frame T a .
• the device 62 is connected, by links not shown, to outputs of the sequencer 4 supplying control signals which are functions of the parity of these two frames.
• the device 62 can consist of adders and a read only memory storing the value of the components of the vector Z, this read-only memory receiving an address constituted by the control signals supplied by the sequencer 4.
• the adder 63 has: an input connected to the output of the device 62; another input connected to the output of the computing device 7 to receive the value of the components of the vector ; and an output constituting the output of the device 6, output providing the value of the components of the vector
• the calculation device 8 has a structure very similar to that of the calculation device 6. It includes a multiplier 81, a device for correcting parity of frames, and an adder 83.
• the multiplier 81 receives the value (T b -T j ) instead of the value - (T j -T a ), and the device 82 adds the value of the components of the vector b , instead of the value of the components of the vector a
• the value of the components of the vector T is a function of the parity of the frame T j and the frame T b .
• the device 82 is connected to the sequencer
• the calculation device 7 comprises a multiplier 71, a subtractor 72, a device 73 for parity correction of frames, and a device 74 for calculating the nearest whole value (VEPP) of a value.
• a first input of the multiplier 71 constitutes the input of the device 7 receiving the value of the components of the vector 7 (IX, IY, T i ).
• a second input of the multiplier 71 permanently receives the value (T i -T j ).
• An output of the multiplier 71 is connected to a first input. of the subtractor 72 and provides it with the value of the components of the vector V. (T i -T j ).
• a second input of the subtractor 12 receives the coordinates (IX, IY) supplied by the sequencer 4 and constituting the components of the vector PC j .
• An exit from the subtractor 72 supplies an input to the device 73 with the value of the components of the vector calculated in accordance with the formula (4).
• the device 73 adds to the value of these components the value of the components of the vector which is function of the parity of the frame T j and the frame T i .
• the device 73 can be constituted like the devices 62 and 82. It is connected to outputs of the sequencer 4 by links not shown providing it with control signals depending on the parity of the frames T j and T i . An output of the device 73 is connected to an input of the device 74.
• the device 74 adds 0.5 to each of the components of the vector supplied by the output of the device 73 and then takes the whole part of the sum obtained.
• the device 74 can consist of two adders each adding the constant value 0.5. The whole part is extracted by setting the bits making up the fractional part to 0.
• An output of the device 74 constitutes the output of the device 7 and provides the value of two components constituting the vector j
• the value of these components is used in particular as address value for the memories M1 and M2, during the writing in these memories of the value of the function DFD and of the components of the speed vector, corresponding to the child pixel centered on the point F j .
• the calculation devices 10 and 11 have a similar structure, but the device 10 is coupled to the memory MA while the device: 1 is coupled to the memory MB.
• the device 10 comprises: a device
• An input of the device 101 constitutes the input of the device 10, and is also connected to a first input of the subtractor 103.
• An output of the device 101 is connected to a first input of the adder 102 and to an input of the computing device 104 addresses, to provide them with the value of the components (XG a , YG a ) obtained by taking the integer part of the value of the components of the vector
• the device 101 can be constituted like the device 74.
• the adder 102 has a second input permanently receiving the value of the components of a vector (1,1), and has an output connected to a second input of the subtractor 103.
• An output of the subtractor 103 is connected to a terminal d input 106 of the calculation device 105 to provide it with the value of the relative coordinates of the point A: ( ⁇ X a , ⁇ Y a ).
• the calculation device 105 has a second input terminal 108 connected to a data output from the memory MA and has an output terminal 107 constituting the output of the device 10 and connected to the first input of the subtractor 14 to supply it with the value of luminance L (PA, T a ).
• the address calculation device 104 has an input connected to the output of the device 101 for receiving the coordinates (XG a , YG a ) and has an output connected to an address input of the memory MA.
• the device 104 supplies four successive addresses to the memory MA under the action of a clock signal supplied by the sequencer 4 which commands four successive readings in the memory A to read the luminance values stored at addresses constituted by the coordinates : (XG a + 1, YG a +1); (XG a , YG a +1); (XG a + 1, YG a ); (XG a , YG a ).
• the device 103 can consist of four registers, four adders, and a multiplexer, controlled by control signals supplied by the sequencer 4.
• the calculation device 11 comprises: a device 111 for calculating the most integer value close to the components of a vector; a device 112 for calculating addresses; an adder 113; a subtractor 114; and a computing device 115, having functions analogous to the functions of elements 101 to 105 of the computing device 10.
• FIG. 14 represents the block diagram of an exemplary embodiment of the calculation device 105. It comprises: six registers, 120 to 123 and 133, 135; eight multipliers, 124 to 131; an adder 132; and two subtractors 134 and 136.
• the device 105 implements formula (8).
• the input terminal 106 is connected to inputs of registers 120 to 123 which respectively store the four pairs of coordinates applied to the input terminal 106.
• the input terminal 108 is connected to inputs of registers 133 and 135 which store the values ⁇ X a and ⁇ Y a respectively .
• the outputs of registers 120 to 123 are respectively connected to first inputs of multipliers 124, 126, 128, 130.
• the output of register 133 is connected to: a first input of subtractor 134, a second input of multiplier 126, and a second , input of the multiplier 130.
• the output of the multipliers 124, 126, 128, 130 is connected respectively to a first input of the multiplier 125, of the multiplier 127, of the multiplier 129, and of the multiplier 131.
• the output of the register 135 is connected to a second input of multiplier 129, a second input of multiplier 131, and a first input of subtractor 136.
• the subtractor 134 has a second input permanently receiving the value 1 and has an output connected to a second input of multiplier 124 and to a second input of multiplier 128.
• Subtractor 136 has a second input permanently receiving value 1 and has an output connected to a second input of the multiplier 125 and to a second input of the multiplier 127.
• the outputs of the multipliers 125, 127, 129, 131, are respectively connected to four inputs of the adder 132.
• a fifth input of the adder 132 receives permanently the value 0.5.
• An output of the adder 132 is connected to the output terminal 107.
• Subtractors 134 and 136 respectively supply the values ⁇ X a -1 and ⁇ Y a -1. Multipliers
• Multipliers 124 and 125 calculate the first term of formula (8).
• Multipliers 126 and 127 calculate the second term.
• Multipliers 128 and 129 calculate the third term.
• Multipliers 130 and 131 calculate the fourth term.
• the adder 132 adds up these four terms and the constant term 0.5.
• FIG. 15 represents the block diagram of the second part of the exemplary embodiment of a device for the implementation of the first variant of the method according to the invention.
• This second part corresponds to the second phase of the process. It notably comprises calculation means 5b for determining a speed vector interpolated from the speed vectors of the pixels neighboring the pixel to be interpolated when the latter has no parent pixel or else when its parent pixels have not been validated.
• calculation means 49 for associating a zero speed vector with the pixel to be interpolated when the interpolated speed vector is not validated, and to determine the luminance values L ( PA, T a ) and L ( PB, T b ) of the two base points A and B, as a function of the speed vector associated with the pixel to be interpolated; and calculating means 50 for calculating an interpolated luminance value, as a function of the luminance values of the two base points.
• the calculation means 5b include: an address generator 31; two registers, 32 and 33; a comparator 34; a multiplexer 35, with two inputs and one output; and a calculating device 36 for calculating an interpolated speed vector
• An output of the address generator 31 and an output terminal 58 of the computing device 36 are connected to the input terminal 28 of the computing means 5a, which is connected to the address inputs of the memories M1 and M2.
• the address generator 31 provides a series of addresses constituted by coordinates (IX ′, IY ′) corresponding to a systematic scanning of all the pixels to be interpolated from the frame T j . Each of these addresses makes it possible to read a DFD value (IX ', IY') of the DFD function in the memory M2 and a speed vector (IX ', IY') in the memory M1, corresponding to a pixel to be interpolated.
• a data input from register 32 and an input terminal 57 of the calculation device 36 are connected to the output terminal 27 of the calculation means 5a, which receives the value DFD (IX ', IY') read in the memory M2 .
• a data input from register 33 and an input terminal 56 of the calculation device 36 are connected to the output terminal 30 of the calculation means 5a, which supplies the value of the components of the speed vector V (IX ', IY') read in memory M1.
• the value DFD (IX ', IY') stored in the register 32 is compared with a threshold value, 255, by the comparator 34.
• An output of the comparator 34 is connected to a control input of the multiplexer 35.
• An output of the register 33 is connected to a first input of the multiplexer 35.
• An output terminal 59 of the calculation device 36 supplies the value of the components of a speed vector interpolated to a second input of the multiple xer 35.
• An output of the multiplexer 35 constitutes an output of the means 5b and is connected to a first input of the calculation means 49 to supply a speed vector Vt
• the comparator 34 controls the multiplexer 35 so that it transmits the value of the components of the vector stored in register 33, because this speed vector is suitable.
• the value of the DFD function is equal to 255, this means that the pixel to be interpolated has no parent pixel, therefore it is necessary to determine a speed vector by interpolation from the speed vectors of the neighboring pixels.
• the comparator 34 then controls the multiplexer 35 so that it transmits the value of the components of the interpolated speed vector T supplied by the calculation device 36.
• FIG. 16 A block diagram of the computing device 36 is shown in FIG. 16. It comprises: an address generator 150; ten registers, 151 to 154 and 165 to 168; five comparators 156 to 159; four multipliers, 161 to 164; two adders 170 and 171; a divider 172; and a multiplexer 173, with two inputs and one output.
• the address generator 150 has an input connected to the input terminal 60 to receive the sequence of coordinates (IX'.IY ') of each pixel of the frame to be interpolated T j , and it has an output connected to the terminal 58 to successively supply four values coordinates (IX '', IY '') for each pixel to be interpolated.
• the registers 151 to 154 each have a data input connected to the input terminal 56 for receiving and storing the values of the DFD function read in the memory M2 and corresponding to the four neighboring points respectively.
• the registers 165 to 168 each have a data input connected to the input terminal 57 to receive the value of the components of the speed vectors read in the memory M1 and corresponding respectively to the four neighboring points.
• the registers 151 to 154 have outputs connected respectively to first inputs of the comparators 156 to 159.
• the comparators 156 to 159 have second inputs receiving a constant value equal to 255 and have outputs connected respectively to first inputs of the multipliers 161 to 164 and respectively to four inputs of the adder 170.
• the comparators 156 to 159 each supply a logic signal of value 1 when the value applied to their first input is less than 255 and a value of zero when the value applied to their first input is equal to 255.
• the values of these logic signals are added by the adder 170.
• the output of the adder 170 is connected to a first input of the divider 172 and to a control input of the multiplexer 173.
• the outputs of registers 165 to 168 are respectively connected to second inputs of the multipliers 161 to 164.
• the multipliers 161 to 164 multiply the values of the components of the speed vectors by the values of the logic signals supplied respectively by the comparators 156 to 159, and provide the result on outputs connected respectively to four inputs of the adder 171.
• the output of the adder 171 is connected to a second input e of the divider 172.
• An output of the divider 172 provides the value of the components of an interpolated speed vector according to formula (10).
• An output of the multiplexer 173 is connected to the output terminal 59 of the calculation device 36.
• the value which it provides on its output controls the multiplexer 173 so that it transmits the value of the components of the interpolated vector. If the value of the sum calculated by the adder 170 is equal to 0, that is to say if the four neighboring pixels do not have validated parent pixels, the value 0 applied to the control input of the multiplexer 173 commands the transmission of a zero vector to constitute the vector T supplied by the computing device 36.
• the computing means 49 include two halves calculating in parallel the luminance values of the base points A and B and the value of the DFD function, respectively for the speed vector vt provided by the calculation means 5b and for a zero speed vector. These two calculations in parallel make it possible to save time when finally it turns out that the speed vector provided by the calculation means 5b is not validated because the corresponding DFD has a value greater than threshold 7.
• These calculation means 49 comprise: a calculation device 37 for calculating the vector for the velocity vector T a calculating device 38 for calculating a vector for the velocity vector ; a calculating device 41 for calculating a luminance value L ( T a ) for the velocity vector ; a calculating device 42 for calculating a luminance value L ( PBT b ) for the velocity vector; a device 43 reading L ( PA, T a ) at the address (IX ', IY') in the memory MA and a device 44 for reading L ( , T b ) at the address (IX ', IY') in the memory MB, which corresponds to a zero speed vector; a subtractor 45 and a subtractor 46 for determining respectively the value of the DFD function for the speed vector and for a zero speed vector; a comparator 48; and a multiplexer 47 with eight inputs and four outputs.
• the calculation device 37 is similar to the calculation device 6 described above and shown in FIG. 13.
• the calculation device 38 is similar to the calculation device 8 described above and shown in FIG. 13.
• the calculation devices 41 and 42 are respectively similar to the calculation devices 10 and 11 described above and represented in FIG. 13.
• the reading devices 43 and 44 each have an input-output connected to the bus 9. They have a very simple structure made up of buffer registers controlled by signals supplied by sequencer 4, and routed by links not shown.
• the calculation devices 37 and 38 each have their input which is connected to the first input of the calculation means 49 to receive the value of the components of the vector Tj.
• the outputs of the calculation 37 and 38 are respectively connected to the inputs of the calculation devices 41 and 42.
• the output of the device 41 is connected to a first input of the subtractor 45 and to an input marked ai of the multiplexer 47.
• the output of the device 42 is connected to a second input of the subtractor 45 and to an input denoted b1 of the multiplexer 47.
• the output of the device 43 is connected to a first input of the subtractor 46 and to an input denoted a2 of the multiplexer 47.
• the output of the device 44 is connected to a second input of the subtractor 46 and to an input denoted b2 of the multiplexer 47.
• the output of the subtractor 45 is connected to a first input of the comparator 48 and to an input marked d1 of the multiplexer 47.
• the output of the subtractor 46 is connected to an input marked d2 of the multiplexer 47.
• the multiplexer 47 also has: an input marked d connected to the first input of the calculation means 49 to receive the vector ⁇ an input denoted c2 which receives a zero speed vector; four outputs denoted a, b, c, d constituting respectively a first, a second, a third and a fourth output of the calculation means 49; and a control input connected to the output of comparator 48.
• Subtractor 45 calculates the value of the DFD function for the pixel to be interpolated, with the vector Tt as associated velocity vector.
• the value of the DFD function is compared with the threshold value, 7, by the comparator 48. If the value of the DFD function is less than or equal to 7, the multiplexer 47 transmits the information applied to the inputs a1, b1, c1, d1, respectively to outputs a, b, c, d. If the value of the DFD function corresponding to the vector V is greater lower than the threshold value, 7, the multiplexer 47 is controlled to transmit the information present on inputs a2, b2, c2, d2 respectively to outputs a, b, c, d.
• the first and the second output of the calculation means 49 respectively provide a luminance value L , T a ), L ( , T b ), corresponding to the speed vector selected to be associated with the pixel to be interpolated; the second and the third output of the calculation means 49 respectively supply the speed vector which is used to constitute the vector V (IX ′, IY ′, T i ) associated with the pixel to be interpolated, and the value of the DFD function corresponding to this pixel to be interpolated (IX ', IY', T i ).
• the third and fourth outputs of the calculation means 49 are respectively connected to the input terminals 26 and 29 of the calculation means 5a for recording the associated speed vector and the value of the DFD function in the memories M1 and M2 at the address constituted by the coordinates (IX ', IY'). This speed vector and this value of the DFD function will thus be available later to calculate interpolated speed vectors for orphan pixels.
• the calculation means 50 have two inputs connected respectively to the first and to the second output of the calculation means 49 to receive the two luminance values of the base points A and B corresponding to the pixel to be interpolated.
• the calculation means 50 comprise two multipliers 51 and 52 and an adder 53.
• the multiplier 51 has: a first input connected to the first output of the means 49; a second input receiving a constant value equal to T -T; and an output connected to a first input of the adder 53.
• the multiplier 52 has: a first input connected to the second output of the means 49; a second input receiving a constant value equal to and one output connected to one second input of the adder 53.
• the adder 53 has an output connected to the output terminal 51 of the time interpolation device to provide it with an interpolated luminance value L (IX ′, IY ′, T i ) corresponding to the pixel at interpolate, with coordinates (IX ', IY', T i ), and calculated according to formula (9).
• These luminance values can be used in real time, as they are calculated, or else be stored in a memory of the frame, not shown.
• the invention is applicable in real time, in particular to devices for changing the standard for television frames, and for the restitution of frames transmitted at very low bit rate with the suppression of a certain number of frames.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Television Systems (AREA)
• Ultra Sonic Daignosis Equipment (AREA)
• Apparatus For Radiation Diagnosis (AREA)
• Closed-Circuit Television Systems (AREA)
• Image Processing (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=9351724

Family Applications (2)

Family Applications Before (1)

Country Status (7)

Families Citing this family (10)

Family Cites Families (3)

• 1987
  • 1987-06-04 FR FR8707814A patent/FR2616248B1/fr not_active Expired - Lifetime
• 1988
  • 1988-05-31 JP JP50486988A patent/JP3161467B2/ja not_active Expired - Lifetime
  • 1988-05-31 EP EP88401315A patent/EP0294282B1/de not_active Expired - Lifetime
  • 1988-05-31 DE DE88401315T patent/DE3882285T2/de not_active Expired - Lifetime
  • 1988-05-31 AT AT88401315T patent/ATE91580T1/de not_active IP Right Cessation
  • 1988-05-31 WO PCT/FR1988/000271 patent/WO1988010046A1/fr not_active Application Discontinuation
  • 1988-05-31 ES ES198888401315T patent/ES2041816T3/es not_active Expired - Lifetime
  • 1988-05-31 EP EP88905206A patent/EP0315673A1/de active Pending

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events