EP0836325A1 - Data processor and decoder and encoder for a moving pictures database with high quality - Google Patents

Data processor and decoder and encoder for a moving pictures database with high quality Download PDF

Info

Publication number
EP0836325A1
EP0836325A1 EP19970117423 EP97117423A EP0836325A1 EP 0836325 A1 EP0836325 A1 EP 0836325A1 EP 19970117423 EP19970117423 EP 19970117423 EP 97117423 A EP97117423 A EP 97117423A EP 0836325 A1 EP0836325 A1 EP 0836325A1
Authority
EP
European Patent Office
Prior art keywords
means
main
coding
decoding
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP19970117423
Other languages
German (de)
French (fr)
Other versions
EP0836325B1 (en
Inventor
Toshio Koga
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
Priority to JP268326/96 priority Critical
Priority to JP26832696A priority patent/JPH10117353A/en
Priority to JP26832696 priority
Application filed by NEC Corp filed Critical NEC Corp
Publication of EP0836325A1 publication Critical patent/EP0836325A1/en
Application granted granted Critical
Publication of EP0836325B1 publication Critical patent/EP0836325B1/en
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=17456996&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP0836325(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Anticipated expiration legal-status Critical
Application status is Revoked legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • H04N19/194Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive involving only two passes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding

Abstract

A data processor includes a first encoder, a first storage medium, a subtracter, a second encoder, a second storage medium, and an output section. The first encoder generates, by using a predetermined first coding method, a main code prepared by encoding a moving picture signal input as an original signal. The first storage medium stores the main code generated by the first encoder. The subtracter calculates a coding distortion generated upon coding by the first encoder. The second encoder encodes, by using a predetermined second coding method, the coding distortion calculated by the subtracter, thereby generating a compensation code. The second storage medium stores the compensation code generated by the second encoder. The output section outputs the main and compensation codes respectively stored in the first and second storage media.

Description

The present invention relates to a data processor for constructing a database of encoded moving picture signals, and a receiver which receives an output from the data processor.

The use of the original signals of picture signals, and particularly, moving picture signals increases the data amount. For this reason, before transmitting an original signal without any change or reading/writing it between storage media, the original signal is generally subjected to compression coding (to be simply referred to as coding hereinafter) to eliminate statistical and visual redundancies.

Usually, a picture signal thus encoded is transferred via a communication line or stored in a storage medium at a fixed transfer or read/write rate called an STM (Synchronous Transfer Mode).

In recent years, a new transfer method called an ATM (Asynchronous Transfer Mode) capable of instantaneously changing the transfer rate is becoming available. At present, however, STM service systems are always considered for communication application and storage application, and coding at the fixed rate is assumed to realize the quality of an encoded picture (to be simply referred to as a picture quality hereinafter) free from any practical problem.

Fig. 9 shows a conventional picture database. While a moving picture signal 1 input to the database is controlled with a parameter by a constant rate controller 2 so as to keep the transfer rate constant, the picture signal is encoded by an encoder 3 and stored in a storage medium 4.

As is well known, the spacial and time correlations between dynamic pictures often change locally, instantaneously, and abruptly. For example, the information amount generated by lossy coding generally called high-efficiency coding, such as H.261 serving as an international standard coding scheme for a video phone and a video conference picture signal, and MPEG-1 and MPEG-2 serving as international standard coding schemes used for the purpose of storage/communication/broadcast, greatly changes depending on the redundancy of an input picture.

To stably realize a high picture quality at a fixed transfer rate for various input pictures having different redundancies, the transfer rate must be fixed high, which is not a proper method in practice. At present, the picture quality is slightly sacrificed to fix the transfer rate lower and simplify the system configuration. For economical advantages, the rate to be fixed is set as low as possible.

A typical example of the transfer rate in the use of high-efficiency coding is a case wherein an NTSC color TV signal is encoded using MPEG-2 while maintaining a good picture quality. At this time, a proper transfer rate is said to be 6 Mb/s for each channel. At present, the digital television picture transfer technology is being introduced into satellite broadcasting, terrestrial broadcasting, a cable television, and the like, the transfer rate is one of the most important parameters in system design.

When coding at a fixed rate results in an insufficient picture quality, if the coding rate can be intermittently increased, a higher picture quality can be attained as a whole in many cases. Generally speaking, coding is usually performed at a fixed rate to output "main information", and when the picture quality is unsatisfactory with only the main information, "compensation information" that reduces a distortion caused by coding (coding distortion) is to be added, thereby greatly improving the picture quality.

One example of the prior arts employing this idea is "TV SIGNAL CODING EQUIPMENT" (Prior Art 1) disclosed in Japanese Patent Laid-Open No. 51-117820. According to this technique, as shown in Fig. 10, a temporarily encoded picture (encoded information e1) is decoded (into a decoded signal y') on the transmission side, a difference (coding distortion information e2) between the original picture (input picture signal y) and the decoded signal is also encoded and multiplexed with the main encoded information e1, and the obtained signals are transferred via a single transfer path. The coding distortion information e2 is "compensation information". On the reception side, the encoded information e1 is decoded into the decoded picture signal y', and compensation is performed based on the coding distortion information e2 to output a picture signal y''. The degree of picture quality is higher in the order of y, y'', and y'.

Another similar prior art is "CODING AND DECODING DEVICE FOR ANIMATING PICTURE SIGNAL" (Prior Art 2) disclosed in Japanese Patent Laid-Open No. 61-214885. Compared to Prior Art 1, this technique expands to a case using both motion-compensated interframe prediction and orthogonal transform.

In both Prior Arts 1 and 2, when the picture quality is unsatisfactory, "compensation information" is added to "main information" and transferred in order to reduce a coding distortion. However, to improve the picture quality improved as in Prior Arts 1 and 2 on the assumption of transfer by the STM as a general transfer form at present, the transfer rate must be determined on the basis of the information amount upon adding "compensation information", and a higher transfer rate is required.

In both Prior Arts 1 and 2, data generated by coding is formed as data in which "main information" and "compensation information" are integrally inseparable from each other. That is, the information made up of the two kinds of information corresponds to substantial "main information". For this reason, a database constructed by only conventional "main information" cannot be used without any change, and a database must be reconstructed with original picture signals.

It is an object of the present invention to provide to provide a database processor and a receiver for constructing a database with a higher picture quality in a dynamic picture database storing encoded picture information while utilizing picture data stored in a conventional database.

In order to achieve the above object, according to the present invention, there is provided a data processor comprising first coding means for generating, by using a predetermined first coding method, a main code prepared by encoding a moving picture signal input as an original signal, first storage means for storing the main code generated by the first coding means, coding distortion calculation means for calculating a coding distortion generated upon coding by the first coding means, second coding means for encoding, by using a predetermined second coding method, the coding distortion calculated by the coding distortion calculation means, thereby generating a compensation code, second storage means for storing the compensation code generated by the second coding means, and output means for outputting the main and compensation codes respectively stored in the first and second storage means.

Brief Description of the Drawings

  • Fig. 1 is a block diagram of a data processor according to the first embodiment of the present invention in which a coding distortion information database is added to an existing dynamic picture database;
  • Fig. 2 is a block diagram of a data processor according to the second embodiment of the present invention in which two databases for a main signal and a coding distortion are simultaneously formed;
  • Fig. 3 is a block diagram of a data processor according to the third embodiment of the present invention;
  • Fig. 4 is a block diagram of a data processor according to the fourth embodiment of the present invention;
  • Fig. 5 is a block diagram for explaining the first example of supplying encoded data from the database according to the present invention;
  • Fig. 6 is a block diagram for explaining the second example of supplying encoded data from the database according to the present invention;
  • Fig. 7 is a block diagram of a receiver according to the fifth embodiment of the present invention;
  • Fig. 8 is a block diagram of a receiver according to the sixth embodiment of the present invention;
  • Fig. 9 is a block diagram of a conventional data processor storing a picture database; and
  • Fig. 10 is a block diagram of a conventional data processing system for transferring coding distortion information.
  • Description of the Preferred Embodiments

    The present invention will be described in detail below with reference to the accompanying drawings.

    Fig. 1 shows an arrangement of the first embodiment when the present invention is applied to a main data processor in which a moving picture signal 11 has already been encoded based on a predetermined coding method, and stored as a database in a storage medium 13. In this embodiment, additional information is newly added to a main data processor storing a database which is conventional used, thereby improving the picture quality provided to the database user.

    In the main data processor shown in Fig. 1, an input original signal (moving picture signal 11) is encoded into a main code by an encoder 12 and stored in the storage medium 13 in advance. The encoder 12 and the storage medium 13 constitute the existing main data processor. In this embodiment, an auxiliary data processor having the following arrangement is connected to the existing main data processor.

    A decoder 14 reads the main code from the storage medium 13, and decodes it into a main signal. The decoded main signal generally contains a coding distortion, and a difference between the decoded main signal and the original signal 11 is calculated by a subtracter 17. This difference is a coding distortion, and is not zero in general. This coding distortion is encoded by an encoder 15 using the same coding method as that of the encoder 12, and stored in a storage medium 16. This processing is performed for all main codes stored in the storage medium 13. The coding method used in the encoder 15 may be part of the coding method used in the encoder 12.

    The operation rates of the decoder 14 and the encoder 15 are not unique. For example, when calculation of a coding distortion is executed using a computer, the rates of signal supply from both the storage medium 13 and the original signal 11 are easily matched to the computer. For this purpose, a large-capacity storage medium which can be easily accessed from the computer may be used for both the storage medium 13 and the original signal 11. As for the input moving picture signal 11, a digital VTR is usable recently, which often incorporates a rate adjustment buffer memory in order to exchange picture data with the computer.

    The encoder 15 need not always operate in "real time". A picture is encoded by the computer slower than "real time", and the encoded picture is stored in the storage medium 16. With this processing, a high picture quality can be realized only by newly adding an auxiliary database without changing a conventional database. In this case, the "real time" operation means an operation using a TV signal standardization frequency of, e.g., about 10 to 15 MHz, but a detailed operation rate is not limited to this. At the operation rate of the computer, a moving picture signal such as a TV signal is generally difficult to process in "real time". More specifically, when the TV signal is an NTSC signal, it generates about 30 pictures per second. Encoding all the 30 pictures within one second requires an ability substantially equal to that of a supercomputer.

    The dynamic picture database has two output systems. In this embodiment, for example, for a special user who pays a predetermined additional charge, output 2, i.e., coding distortion information in addition to output 1 is sent to provide a high-quality picture service. For a general user who does not pay an additional charge, only output 1 is supplied. In this manner, a dynamic picture database in a service form can be provided.

    The first embodiment has exemplified the case wherein the auxiliary data processor according to the present invention is applied to the main data processor storing an existing picture database. When the latest picture not stored in an existing database, such as the latest movie, is to be newly encoded, the whole system must be operated in real time for moving picture signals output from a medium operating in real time such as a VTR. In the second embodiment of the present invention, the first coding and the second coding are performed in real time.

    All of encoders 22 and 25, a decoder 24, and a subtracter 27 shown in Fig. 2 according to the second embodiment of the present invention are operable in real time. At the same time a moving picture signal 21 is input, the moving picture signal 21 and a coding distortion from the subtracter 27 are encoded, and the results are respectively stored in storage media 23 and 26. In this case, the storage media 23 and 26 require realtime input buffer memories 23a and 26a.

    Depending on applications other than the above case, this processing must be executed in real time. For example, a live broadcast such as a sports program inevitably requires realtime processing.

    Fig. 3 shows the third embodiment of the present invention. A moving picture signal supplied from a moving picture signal source 31 is controlled with a coding parameter by a constant rate controller 35 so as to keep the coding rate (transfer rate in the transfer system) constant, encoded by an encoder 32, and stored in a storage medium 33. Assume that this processing has been performed in advance at a past point, and the storage medium 33 functions as a constructed database.

    For the descriptive convenience, an application of the present invention to a specific work (work A) will be explained. Work A encoded and stored in the storage medium 33 is read at a rate (real time) necessary for TV signal processing, while being decoded by a decoder 34. At this time, a subtracter 39 calculates a difference between work A and an input signal supplied at an adjusted timing to obtain a coding distortion. This coding distortion is encoded by an encoder 36 under such control as to keep its quality constant by a constant quality controller 38, and stored in a storage medium 37. This database system supplies both output 1 and output 2, which have the main-compensation information relationship.

    Practically, the storage medium 33 cannot always operate in real time. In this case, the system must be devised such that a difference (coding distortion) from an input signal from the moving picture signal source 31 is calculated when an output from the storage medium 33 is decoded by one frame. However, this is not essential in the present invention.

    As for the number of works, not only work A but also an enormous number of works are generally stored. As needed, the processing for work A is repeatedly executed for all the stored works.

    Coding control for a constant picture quality is easily realized. Normally, quantization characteristics should be fixed for a prediction error. In the present invention, quantization characteristics particularly in coding of a coding distortion are fixed. In Fig. 10, the quantization characteristics mean processing for adjusting the number of possible levels for prediction errors, and controlling an information generation situation. In general, this processing is the most effective for control of the generated information amount that limits the number of possible states.

    In an actual service, both of these outputs are sent to the user, and used to perform decoding, thereby obtaining a picture with a higher quality than that in decoding only output 1.

    The fourth embodiment exemplifying a case wherein the system operates in real time will be explained with reference to Fig. 4. A description of the same functions as those in Fig. 3 will omitted. At the same time a moving picture signal supplied from a moving picture signal source 41 in real time is encoded by an encoder 42, a decoded signal is generated by a decoder 44, and a difference (coding distortion) therebetween is generated in a subtracter 49. When data is only supplied without being stored, storage media 43 and 47 can be skipped to supply outputs 1 and 2. Reference numeral 46 denotes an encoder; and 48, a constant quality controller.

    The difference between Figs. 3 and 4 is that a coding distortion for either past encoded data stored in a database or currently encoded output data is obtained in generating a coding distortion. In Fig. 3, it is generally very difficult to construct a database in the same database as the conventional one, so that a physically different auxiliary database is used. In Fig. 4, a database is easily constructed in a single system.

    Fig. 5 shows the first example when encoded data are supplied from two databases shown in Figs. 1 to 4. An output section 120 supplies an output from a storage medium 113 via a communication path 101. An output section 130 supplies an output from a storage medium 116 via a gate 103 whose output is ON/OFF-controlled by a gate controller 104, and a communication path 102. The storage medium 113 corresponds to the storage medium 13, 23, 33, or 43, whereas the storage medium 116 corresponds to the storage medium 16, 26, 36, or 46.

    Under the ON/OFF output control of the gate controller 104 for coding distortion information, output 2 (coding distortion information) is transmitted to a special user who pays an additional charge for, e.g., a pay service, while output of the coding distortion information is stopped for a normal user. Alternatively, instead of controlling the gate 103, execution/nonexecution of setting of the communication path 102 may be controlled.

    This control can be executed in not the gate 103 but a user's receiver. In this case, the service provider sends a reception enable signal to a gate function installed in the user's receiver.

    The special user means a user who can receive information about a coding distortion and decode a high-quality picture. The normal user means a user who can receive and decode only main encoded data.

    Fig. 6 shows the second example when encoded data are supplied from two databases. In multiplexing two outputs from storage media 113 and 116 at a switch 105 in an output section 140, a multiplexing controller 106 instructs execution/nonexecution of multiplexing. That is, multiplexing of two outputs is executed for the special user, and only an output from the storage medium 113 is supplied to the normal user via a communication path 107.

    Fig. 7 shows the arrangement of a receiver according to the fifth embodiment of the present invention. Main and compensation codes supplied via two communication paths 101 and 102 are respectively supplied to decoders 108 and 109 and decoded.

    Not in a reception state as the special user, the decoder 109 is instructed to stop its operation by a control signal S, and outputs zero data in place of a coding distortion. In an adder 110, the coding distortion or zero data is added with a main signal from the decoder 108, and supplied to a postprocessing unit 111.

    The postprocessing unit 111 basically performs scheme conversion into NTSC, PAL/SECAM, or the like, and processing for outputting and displaying data on a TV monitor.

    If the system has a function of reducing/removing noise within a picture caused by coding, the gist of the present invention is not influenced. The special user can obtain coding distortion information from the decoder 109, whereas only zero data is output from, e.g., the decoder 109 to the normal user.

    Fig. 8 shows the arrangement of an apparatus on the reception side according to the sixth embodiment of the present invention. Fig. 8 shows the arrangement of a receiver when two outputs from the databases shown in Fig. 6 are multiplexed. Two multiplexed outputs supplied via a communication path 107 are separated by a separator 112, and input to decoders 114 and 115, respectively.

    Not in a reception state as the special user, the decoder 115 is instructed to stop its operation by the control signal S, and outputs zero data in place of a coding distortion. In an adder 117, the coding distortion or zero data is added with a main signal from the decoder 114, and supplied to a postprocessing unit 118.

    As has been described above, in constructing a dynamic picture database storing many encoded moving picture signals, the currently used method of storing encoded pictures at a fixed rate is not preferable because the picture quality varies depending on the spatial, time, and statistical properties of an input picture signal. In the future, higher-quality services will be gradually important, so the current method will become apparently unsatisfactory.

    According to the conventional database construction method, coding distortion information corresponding to "compensation information" must be added to attain a higher-quality picture. Nevertheless, this information cannot be added due to structural limitations. A dynamic picture database of encoded pictures at a higher coding rate must be reconstructed.

    According to the present invention, no "compensation information" is added to a moving picture signal having a satisfactory picture quality at a conventional coding rate, and a database storing "compensation information" is additionally constructed for only a moving picture signal in which a decrease in picture quality is recognized. In outputting information from the database, it suffices to supply main information and the "compensation information" parallel or upon multiplexing. An "old" database for the main information can be continuously used. Also, an old receiver which can meet with only the old database, a new receiver which receives information from the old database, and a new receiver which receives information from the new database can be used without any change.

    An old receiver which receives information from the new database can be continuously used only by ignoring "compensation information".

    In this manner, the effects of practical use of the present invention are very large. In the present invention, the method of encoding a "coding distortion" need not be the same as the method of encoding a signal. A fixed transfer rate need not be particularly used for the communication path through which the "coding distortion" is transferred. Even a variable line such as an ATM is usable, and the present invention is still effective in such an application.

    Claims (14)

    1. A data processor characterized by comprising:
      first coding means (12, 22, 32, 42) for generating, by using a predetermined first coding method, a main code prepared by encoding a moving picture signal input as an original signal;
      first storage means (13, 23, 33, 43) for storing the main code generated by said first coding means;
      coding distortion calculation means (17, 27, 37, 47) for calculating a coding distortion generated upon coding by said first coding means;
      second coding means (15, 25, 35, 45) for encoding, by using a predetermined second coding method, the coding distortion calculated by said coding distortion calculation means, thereby generating a compensation code;
      second storage means (16, 26, 36, 46) for storing the compensation code generated by said second coding means; and
      output means (120, 130, 140) for outputting the main and compensation codes respectively stored in said first and second storage means.
    2. A processor according to claim 1, further comprising decoding means (14, 34) for receiving and decoding the main code stored in said first storage means, and
      wherein said coding distortion calculation means calculates the coding distortion on the basis of a difference between the main signal obtained upon decoding by said decoding means, and the original signal.
    3. A processor according to claim 1, further comprising decoding means (24, 44) for receiving and decoding the main code encoded by said first coding means, and
      wherein said coding distortion calculation means calculates the coding distortion on the basis of a difference between the main signal obtained upon decoding by said decoding means, and the original signal.
    4. A processor according to any of claims 1 to 3, wherein the second coding method is the same as the first coding method.
    5. A processor according to any of claims 1 to 3, wherein the second coding method is part of the first coding method.
    6. A processor according to any of claims 1 to 5, wherein said output means comprises
      first output means (120) for outputting the main code stored in said first storage means to a first communication path (101), and
      second output means (130) for outputting the compensation code stored in said second storage means to a second communication path (102) logically independent of the first communication path.
    7. A processor according to claim 6, wherein said second output means comprises compensation code output control means (103, 104) for controlling whether the compensation code stored in said second storage means is output, independently of output of the main code by said first output means.
    8. A processor according to any of claims 1 to 5, wherein said output means comprises multiplexing means (105) for multiplexing the main code stored in said first storage means, and the compensation code stored in said second storage means in correspondence with the main code, and
      said output means outputs the main and compensation codes multiplexed by said multiplexing means to a physically common communication path (107).
    9. A processor according to claim 8, further comprising multiplexing control means (106) for controlling said multiplexing means to select whether the multiplexed main and compensation codes are output or only the main code is output.
    10. A data processor characterized by comprising a main data processor (12, 13) which receives a moving picture signal as an original signal, and stores a main code generated by performing lossy coding for the original signal, and an auxiliary data processor connected to said main data processor and used,
         said auxiliary data processor comprising:
      decoding means (14) for receiving the main code from said main data processor, and decoding the main code into a main signal;
      cording distortion calculation means (17) for receiving the original signal from said main data processor, and calculating a coding distortion from a difference between the original signal and the main signal;
      coding means (15) for encoding, by using a predetermined coding method, the coding distortion calculated by said coding distortion calculation means, thereby generating a compensation code;
      storage means (16) for storing the compensation code generated by said coding means; and
      output means (120, 130, 140) for outputting the compensation code stored in said storage means.
    11. A data receiver characterized by comprising:
      first decoding means (108) for decoding a main code prepared by encoding a moving picture signal serving as a main signal input via a first communication path (101) into a main signal;
      second decoding means (109) for decoding a compensation code prepared by encoding a coding distortion of the main signal input via a second communication path (102) into the coding distortion; and
      main signal compensation means (110) for generating a compensated main signal from the main signal decoded by said first decoding means and the coding distortion decoded by said second decoding means.
    12. A receiver according to claim 11, wherein said second decoding means selects based on an external control signal whether the coding distortion input via the second communication path is decoded.
    13. A data receiver characterized by comprising:
      separation means (112) for separating a main code prepared by encoding a moving picture signal serving as a multiplexed main signal input via a communication path (107), and a compensation code prepared by encoding a coding distortion of the main signal;
      first decoding means (114) for decoding the main code separated by said separation means into the main signal;
      second decoding means (115) for decoding the compensation code separated by said separation means into the coding distortion; and
      main signal compensation means (117) for generating a compensated main signal from the main signal decoded by said first decoding means and the coding distortion decoded by said second decoding means.
    14. A receiver according to claim 13, wherein said second decoding means selects based on an external control signal whether the coding distortion separated by said separation means is decoded.
    EP19970117423 1996-10-09 1997-10-08 Data processor for a moving pictures database with high quality Revoked EP0836325B1 (en)

    Priority Applications (3)

    Application Number Priority Date Filing Date Title
    JP268326/96 1996-10-09
    JP26832696A JPH10117353A (en) 1996-10-09 1996-10-09 Data processor and receiver
    JP26832696 1996-10-09

    Publications (2)

    Publication Number Publication Date
    EP0836325A1 true EP0836325A1 (en) 1998-04-15
    EP0836325B1 EP0836325B1 (en) 2003-02-19

    Family

    ID=17456996

    Family Applications (1)

    Application Number Title Priority Date Filing Date
    EP19970117423 Revoked EP0836325B1 (en) 1996-10-09 1997-10-08 Data processor for a moving pictures database with high quality

    Country Status (5)

    Country Link
    US (1) US6052416A (en)
    EP (1) EP0836325B1 (en)
    JP (1) JPH10117353A (en)
    AU (1) AU724916B2 (en)
    DE (2) DE69719138T2 (en)

    Cited By (27)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    WO2001043447A1 (en) * 1999-12-10 2001-06-14 Microsoft Corporation Layered coding and decoding of image data
    WO2001063935A1 (en) * 2000-02-24 2001-08-30 M-Wave Limited Video and audio coding
    WO2004057874A1 (en) * 2002-12-20 2004-07-08 Koninklijke Philips Electronics N.V. Method and system for delivering dual layer hdtv signals through broadcasting and streaming
    EP1441533A2 (en) * 2002-12-20 2004-07-28 Oplayo Oy Stream for a desired quality level
    US7508325B2 (en) 2006-09-06 2009-03-24 Intellectual Ventures Holding 35 Llc Matching pursuits subband coding of data
    US7545291B2 (en) 2007-07-12 2009-06-09 Donald Martin Monro FIFO radix coder for electrical computers and digital data processing systems
    US7548176B2 (en) 2007-07-12 2009-06-16 Donald Martin Monro Data coding buffer for electrical computers and digital data processing systems
    US7586424B2 (en) 2006-06-05 2009-09-08 Donald Martin Monro Data coding using an exponent and a residual
    US7602316B2 (en) 2007-07-12 2009-10-13 Monro Donald M Data coding/decoding for electrical computers and digital data processing systems
    US7671767B2 (en) 2007-07-12 2010-03-02 Donald Martin Monro LIFO radix coder for electrical computers and digital data processing systems
    US7689049B2 (en) 2006-08-31 2010-03-30 Donald Martin Monro Matching pursuits coding of data
    US7707214B2 (en) 2007-02-21 2010-04-27 Donald Martin Monro Hierarchical update scheme for extremum location with indirect addressing
    US7707213B2 (en) 2007-02-21 2010-04-27 Donald Martin Monro Hierarchical update scheme for extremum location
    US7770091B2 (en) 2006-06-19 2010-08-03 Monro Donald M Data compression for use in communication systems
    US7783079B2 (en) 2006-04-07 2010-08-24 Monro Donald M Motion assisted data enhancement
    US7786907B2 (en) 2008-10-06 2010-08-31 Donald Martin Monro Combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US7786903B2 (en) 2008-10-06 2010-08-31 Donald Martin Monro Combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US7791513B2 (en) 2008-10-06 2010-09-07 Donald Martin Monro Adaptive combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US7845571B2 (en) 2006-06-19 2010-12-07 Monro Donald M Data compression
    US7864086B2 (en) 2008-10-06 2011-01-04 Donald Martin Monro Mode switched adaptive combinatorial coding/decoding for electrical computers and digital data processing systems
    US7974488B2 (en) 2006-10-05 2011-07-05 Intellectual Ventures Holding 35 Llc Matching pursuits basis selection
    US7990289B2 (en) 2007-07-12 2011-08-02 Intellectual Ventures Fund 44 Llc Combinatorial coding/decoding for electrical computers and digital data processing systems
    US8055085B2 (en) 2007-07-12 2011-11-08 Intellectual Ventures Fund 44 Llc Blocking for combinatorial coding/decoding for electrical computers and digital data processing systems
    US8144037B2 (en) 2007-07-12 2012-03-27 Intellectual Ventures Fund 44 Llc Blocking for combinatorial coding/decoding for electrical computers and digital data processing systems
    US8674855B2 (en) 2006-01-13 2014-03-18 Essex Pa, L.L.C. Identification of text
    US10194175B2 (en) 2007-02-23 2019-01-29 Xylon Llc Video coding with embedded motion
    US10523974B2 (en) 2019-01-28 2019-12-31 Xylon Llc Video coding with embedded motion

    Families Citing this family (5)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    AU2002332706A1 (en) * 2001-08-30 2003-03-18 Faroudja Cognition Systems, Inc. Multi-layer video compression system with synthetic high frequencies
    US20070271250A1 (en) * 2005-10-19 2007-11-22 Monro Donald M Basis selection for coding and decoding of data
    US20070290899A1 (en) * 2006-06-19 2007-12-20 Donald Martin Monro Data coding
    US20080084924A1 (en) * 2006-10-05 2008-04-10 Donald Martin Monro Matching pursuits basis selection design
    US20080205505A1 (en) * 2007-02-22 2008-08-28 Donald Martin Monro Video coding with motion vectors determined by decoder

    Citations (10)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JPS51117820A (en) * 1975-04-09 1976-10-16 Nec Corp Tv signal coding equipment
    JPS61214885A (en) * 1985-03-20 1986-09-24 Nec Corp Coding and decoding device for animating picture signal
    US4723161A (en) * 1985-03-20 1988-02-02 Nec Corporation Method and arrangement of coding digital image signals utilizing interframe correlation
    JPH01194568A (en) * 1988-01-28 1989-08-04 Mitsubishi Electric Corp Picture composing and processing system
    JPH05167868A (en) * 1991-12-15 1993-07-02 Ricoh Co Ltd Image transmission device
    EP0595403A1 (en) * 1992-10-28 1994-05-04 Laboratoires D'electronique Philips S.A.S. Device for coding digital signals representative of images and corresponding decoding device
    US5349383A (en) * 1990-10-15 1994-09-20 British Telecommunications Public Limited Company Two layer video signal coding
    EP0627858A2 (en) * 1993-06-01 1994-12-07 Matsushita Electric Industrial Co., Ltd. Apparatus for further compressing and recording encoded digital video data streams
    EP0710030A1 (en) * 1994-10-31 1996-05-01 Mitsubishi Denki Kabushiki Kaisha Image coded data re-encoding apparatus
    EP0712251A2 (en) * 1994-11-08 1996-05-15 General Instrument Corporation Of Delaware Method and apparatus for partially recompressing digital signals

    Family Cites Families (10)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JP2579919B2 (en) * 1986-11-21 1997-02-12 株式会社東芝 Image compression device
    GB9102220D0 (en) * 1991-02-01 1991-03-20 British Telecomm Method and apparatus for decoding video signals
    GB9206860D0 (en) * 1992-03-27 1992-05-13 British Telecomm Two-layer video coder
    JPH06113292A (en) * 1992-09-29 1994-04-22 Sanyo Electric Co Ltd Picture coder
    CA2126467A1 (en) * 1993-07-13 1995-01-14 Barin Geoffry Haskell Scalable encoding and decoding of high-resolution progressive video
    US5515377A (en) * 1993-09-02 1996-05-07 At&T Corp. Adaptive video encoder for two-layer encoding of video signals on ATM (asynchronous transfer mode) networks
    US5586200A (en) * 1994-01-07 1996-12-17 Panasonic Technologies, Inc. Segmentation based image compression system
    JPH07240920A (en) * 1994-02-28 1995-09-12 Fuji Film Micro Device Kk Compression and extension for digital image data
    GB2295936B (en) * 1994-12-05 1997-02-05 Microsoft Corp Progressive image transmission using discrete wavelet transforms
    US5852565A (en) * 1996-01-30 1998-12-22 Demografx Temporal and resolution layering in advanced television

    Patent Citations (11)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JPS51117820A (en) * 1975-04-09 1976-10-16 Nec Corp Tv signal coding equipment
    US4077053A (en) * 1975-04-09 1978-02-28 Nippon Electric Company, Ltd. Television signal encoder utilizing a correlation between frames
    JPS61214885A (en) * 1985-03-20 1986-09-24 Nec Corp Coding and decoding device for animating picture signal
    US4723161A (en) * 1985-03-20 1988-02-02 Nec Corporation Method and arrangement of coding digital image signals utilizing interframe correlation
    JPH01194568A (en) * 1988-01-28 1989-08-04 Mitsubishi Electric Corp Picture composing and processing system
    US5349383A (en) * 1990-10-15 1994-09-20 British Telecommunications Public Limited Company Two layer video signal coding
    JPH05167868A (en) * 1991-12-15 1993-07-02 Ricoh Co Ltd Image transmission device
    EP0595403A1 (en) * 1992-10-28 1994-05-04 Laboratoires D'electronique Philips S.A.S. Device for coding digital signals representative of images and corresponding decoding device
    EP0627858A2 (en) * 1993-06-01 1994-12-07 Matsushita Electric Industrial Co., Ltd. Apparatus for further compressing and recording encoded digital video data streams
    EP0710030A1 (en) * 1994-10-31 1996-05-01 Mitsubishi Denki Kabushiki Kaisha Image coded data re-encoding apparatus
    EP0712251A2 (en) * 1994-11-08 1996-05-15 General Instrument Corporation Of Delaware Method and apparatus for partially recompressing digital signals

    Non-Patent Citations (5)

    * Cited by examiner, † Cited by third party
    Title
    GHANBARI M: "TWO-LAYER CODING OF VIDEO SIGNALS FOR VBR NETWORKS", IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, vol. 7, no. 5, June 1989 (1989-06-01), pages 771 - 781, XP000036748 *
    PATENT ABSTRACTS OF JAPAN vol. 001, no. 019 (E - 004) 24 March 1977 (1977-03-24) *
    PATENT ABSTRACTS OF JAPAN vol. 011, no. 055 (E - 481) 20 February 1987 (1987-02-20) *
    PATENT ABSTRACTS OF JAPAN vol. 013, no. 486 (E - 840) 6 November 1989 (1989-11-06) *
    PATENT ABSTRACTS OF JAPAN vol. 017, no. 575 (E - 1449) 20 October 1993 (1993-10-20) *

    Cited By (32)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    WO2001043447A1 (en) * 1999-12-10 2001-06-14 Microsoft Corporation Layered coding and decoding of image data
    WO2001063935A1 (en) * 2000-02-24 2001-08-30 M-Wave Limited Video and audio coding
    WO2004057874A1 (en) * 2002-12-20 2004-07-08 Koninklijke Philips Electronics N.V. Method and system for delivering dual layer hdtv signals through broadcasting and streaming
    EP1441533A2 (en) * 2002-12-20 2004-07-28 Oplayo Oy Stream for a desired quality level
    EP1441533A3 (en) * 2002-12-20 2004-10-13 Oplayo Oy Stream for a desired quality level
    US8674855B2 (en) 2006-01-13 2014-03-18 Essex Pa, L.L.C. Identification of text
    US7783079B2 (en) 2006-04-07 2010-08-24 Monro Donald M Motion assisted data enhancement
    US7586424B2 (en) 2006-06-05 2009-09-08 Donald Martin Monro Data coding using an exponent and a residual
    US7770091B2 (en) 2006-06-19 2010-08-03 Monro Donald M Data compression for use in communication systems
    US7845571B2 (en) 2006-06-19 2010-12-07 Monro Donald M Data compression
    US8038074B2 (en) 2006-06-19 2011-10-18 Essex Pa, L.L.C. Data compression
    US7689049B2 (en) 2006-08-31 2010-03-30 Donald Martin Monro Matching pursuits coding of data
    US7508325B2 (en) 2006-09-06 2009-03-24 Intellectual Ventures Holding 35 Llc Matching pursuits subband coding of data
    US8184921B2 (en) 2006-10-05 2012-05-22 Intellectual Ventures Holding 35 Llc Matching pursuits basis selection
    US7974488B2 (en) 2006-10-05 2011-07-05 Intellectual Ventures Holding 35 Llc Matching pursuits basis selection
    US7707213B2 (en) 2007-02-21 2010-04-27 Donald Martin Monro Hierarchical update scheme for extremum location
    US7707214B2 (en) 2007-02-21 2010-04-27 Donald Martin Monro Hierarchical update scheme for extremum location with indirect addressing
    US10194175B2 (en) 2007-02-23 2019-01-29 Xylon Llc Video coding with embedded motion
    US8144037B2 (en) 2007-07-12 2012-03-27 Intellectual Ventures Fund 44 Llc Blocking for combinatorial coding/decoding for electrical computers and digital data processing systems
    US7843367B2 (en) 2007-07-12 2010-11-30 Monro Donald Martin Data coding buffer for electrical computers and digital data processing systems
    US7671767B2 (en) 2007-07-12 2010-03-02 Donald Martin Monro LIFO radix coder for electrical computers and digital data processing systems
    US7602316B2 (en) 2007-07-12 2009-10-13 Monro Donald M Data coding/decoding for electrical computers and digital data processing systems
    US7907068B2 (en) 2007-07-12 2011-03-15 Intellectual Ventures Fund 44 Llc FIFO radix coder for electrical computers and digital data processing systems
    US7548176B2 (en) 2007-07-12 2009-06-16 Donald Martin Monro Data coding buffer for electrical computers and digital data processing systems
    US7990289B2 (en) 2007-07-12 2011-08-02 Intellectual Ventures Fund 44 Llc Combinatorial coding/decoding for electrical computers and digital data processing systems
    US7545291B2 (en) 2007-07-12 2009-06-09 Donald Martin Monro FIFO radix coder for electrical computers and digital data processing systems
    US8055085B2 (en) 2007-07-12 2011-11-08 Intellectual Ventures Fund 44 Llc Blocking for combinatorial coding/decoding for electrical computers and digital data processing systems
    US7786907B2 (en) 2008-10-06 2010-08-31 Donald Martin Monro Combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US7864086B2 (en) 2008-10-06 2011-01-04 Donald Martin Monro Mode switched adaptive combinatorial coding/decoding for electrical computers and digital data processing systems
    US7791513B2 (en) 2008-10-06 2010-09-07 Donald Martin Monro Adaptive combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US7786903B2 (en) 2008-10-06 2010-08-31 Donald Martin Monro Combinatorial coding/decoding with specified occurrences for electrical computers and digital data processing systems
    US10523974B2 (en) 2019-01-28 2019-12-31 Xylon Llc Video coding with embedded motion

    Also Published As

    Publication number Publication date
    AU724916B2 (en) 2000-10-05
    DE69719138T2 (en) 2003-11-27
    EP0836325B1 (en) 2003-02-19
    DE69719138D1 (en) 2003-03-27
    JPH10117353A (en) 1998-05-06
    US6052416A (en) 2000-04-18
    AU3998597A (en) 1998-04-23

    Similar Documents

    Publication Publication Date Title
    Ostermann et al. Video coding with H. 264/AVC: tools, performance, and complexity
    Rijkse H. 263: video coding for low-bit-rate communication
    JP2945268B2 (en) Compatible compression of digital video data
    US6480628B2 (en) Method for computational graceful degradation in an audiovisual compression system
    DE60023576T2 (en) Method and apparatus for moving picture data transcoding
    EP1010330B1 (en) Transcoding
    US6560284B1 (en) Video coder/decoder
    DE10190285B4 (en) Method and system for processing compressed video signals
    EP1096800B1 (en) Image coding apparatus and image decoding apparatus
    ES2204797T3 (en) Image sequence coding procedure.
    EP0637893B1 (en) Transcoding device
    US5940130A (en) Video transcoder with by-pass transfer of extracted motion compensation data
    JP3720875B2 (en) Transcoding method and apparatus
    US5623312A (en) Compressed-domain bit rate reduction system
    JP3547572B2 (en) Receiver having analog and digital video modes and receiving method thereof
    US8175148B2 (en) Method and device for indicating quantizer parameters in a video coding system
    CA2151085C (en) Coded image data re-encoding apparatus
    US5687095A (en) Video transmission rate matching for multimedia communication systems
    US6118817A (en) Digital video signal encoder and encoding method having adjustable quantization
    KR100600419B1 (en) Motion-compensated predictive image encoding and decoding
    US7379501B2 (en) Differential coding of interpolation filters
    US5629736A (en) Coded domain picture composition for multimedia communications systems
    US8130830B2 (en) Enhancement layer switching for scalable video coding
    CN1192629C (en) System and method for improved fine granular scalable video using base layer coding information
    EP0843485B1 (en) Video decoder with unified memory

    Legal Events

    Date Code Title Description
    AX Request for extension of the european patent to

    Free format text: AL;LT;LV;RO;SI

    AK Designated contracting states:

    Kind code of ref document: A1

    Designated state(s): DE FR GB NL

    17P Request for examination filed

    Effective date: 19980310

    RBV Designated contracting states (correction):

    Designated state(s): DE FR GB NL

    AKX Payment of designation fees

    Free format text: DE FR GB NL

    17Q First examination report

    Effective date: 20000314

    RTI1 Title (correction)

    Free format text: DATA PROCESSOR FOR A MOVING PICTURES DATABASE WITH HIGH QUALITY

    RTI1 Title (correction)

    Free format text: DATA PROCESSOR FOR A MOVING PICTURES DATABASE WITH HIGH QUALITY

    AK Designated contracting states:

    Designated state(s): DE FR GB NL

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: FG4D

    REF Corresponds to:

    Ref document number: 69719138

    Country of ref document: DE

    Date of ref document: 20030327

    Kind code of ref document: P

    ET Fr: translation filed
    26 Opposition filed

    Opponent name: INTERESSENGEMEINSCHAFTFUER RUNDFUNKSCHUTZRECHTE E.

    Effective date: 20031119

    NLR1 Nl: opposition has been filed with the epo

    Opponent name: INTERESSENGEMEINSCHAFT FUER RUNDFUNKSCHUTZRECHTE E

    R26 Opposition filed (correction)

    Opponent name: IGR GMBH & CO. KG.

    Effective date: 20031119

    R26 Opposition filed (correction)

    Opponent name: INTERESSENGEMEINSCHAFT FUER RUNDFUNKSCHUTZRECHTE E

    Effective date: 20031119

    R26 Opposition filed (correction)

    Opponent name: INTERESSENGEMEINSCHAFT FUER RUNDFUNKSCHUTZRECHTE E

    Effective date: 20031119

    NLR1 Nl: opposition has been filed with the epo

    Opponent name: IGR GMBH & CO. KG.

    Opponent name: INTERESSENGEMEINSCHAFT FUER RUNDFUNKSCHUTZRECHTE E

    NLR1 Nl: opposition has been filed with the epo

    Opponent name: INTERESSENGEMEINSCHAFT FUER RUNDFUNKSCHUTZRECHTE E

    PGFP Postgrant: annual fees paid to national office

    Ref country code: NL

    Payment date: 20101016

    Year of fee payment: 14

    Ref country code: FR

    Payment date: 20101020

    Year of fee payment: 14

    PGFP Postgrant: annual fees paid to national office

    Ref country code: DE

    Payment date: 20101006

    Year of fee payment: 14

    GBPR Gb: patent revoked under art. 102 of the ep convention designating the uk as contracting state

    Effective date: 20101125

    27W Revoked

    Effective date: 20101125

    PGFP Postgrant: annual fees paid to national office

    Ref country code: GB

    Payment date: 20101006

    Year of fee payment: 14