WO2001082590A2 - Method and system for improving the processing of video signals for use with a microdisplay based video projection system - Google Patents

Method and system for improving the processing of video signals for use with a microdisplay based video projection system Download PDF

Info

Publication number
WO2001082590A2
WO2001082590A2 PCT/US2001/013152 US0113152W WO0182590A2 WO 2001082590 A2 WO2001082590 A2 WO 2001082590A2 US 0113152 W US0113152 W US 0113152W WO 0182590 A2 WO0182590 A2 WO 0182590A2
Authority
WO
WIPO (PCT)
Prior art keywords
signal
control signal
video
video signal
generating
Prior art date
Application number
PCT/US2001/013152
Other languages
French (fr)
Other versions
WO2001082590A3 (en
Inventor
Edmund Sandberg
Paul J. Weihs
Original Assignee
Digital Reflection, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digital Reflection, Inc. filed Critical Digital Reflection, Inc.
Priority to AU2001257197A priority Critical patent/AU2001257197A1/en
Publication of WO2001082590A2 publication Critical patent/WO2001082590A2/en
Publication of WO2001082590A3 publication Critical patent/WO2001082590A3/en

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006—Details of the interface to the display terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0247—Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0257—Reduction of after-image effects
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/20—Circuitry for controlling amplitude response
    • H04N5/205—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic
    • H04N5/208—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H04N5/7416—Projection arrangements for image reproduction, e.g. using eidophor involving the use of a spatial light modulator, e.g. a light valve, controlled by a video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators

Definitions

  • the present invention relates to video image systems. More particularly, the present invention relates to method and system for providing improved video signal processing for use with a microdisplay based video projection system.
  • image correction is performed by boosting the gain in the high frequency portion of the signal. This approach can only improve some aspects of the video signal. In practice, any improvement to the video signals that occur may come at the cost of introducing new or exacerbating existing artifacts. Examples of common side effects include the introduction of phase errors, delay errors, the application of erroneous gain compensation, ringing, noise and excessive aliasing.
  • a more sophisticated video enhancement system may employ a similar approach but using a more complex set of alternating frequency groups or bands. While this approach may show improved image quality, there may be occasions when the image is still the subject to the same artifacts discussed above, with one notable difference - that behavior is pseudo-random. It is this apparent unpredictable behavior that limits the suitability, and thus, the applicability of the approaches discussed above.
  • the electronic circuitry may be added which attempts to predict when the normal operation of the system will be unsuccessful in correcting the video signal, and that which acts to adapt the corrective function to lower or skip the degree of correction. While this approach has the effect of reducing artifacts introduced by the operation of the video enhancement circuit, the video image is left still with all of its original shortcomings.
  • the drive signal may also be an important factor due to the fact that the signal required to drive the display system exhibits a high degree of non-linearity.
  • a signal enhancement system in accordance with one embodiment may include a signal enhancer configured to generate a control signal based on an input signal, a first signal conditioner configured to receive the control signal and accordingly, generate a first signal conditioner control signal, a normalizer configured to receive the conditioner control signal and accordingly, generate a normalizer control signal, and a second signal conditioner configured to receive the control signal, the first signal conditioner control signal and the normalizer control signal, and accordingly, generate a processed output signal.
  • the input signal may be a video signal and the processed output signal may be a corresponding video output signal.
  • the signal enhancer may include a column enhancer configured to process the input signal in a vertical direction, and a row enhancer configured to process the input signal in a horizontal direction.
  • the control signal may include a column enhanced control signal and a row enhanced control signal.
  • the first signal conditioner may be configured to process the received control signal on a pixel by pixel basis, while the second signal conditioner may be configured to process the control signal, the first signal conditioner control signal, and the normalizer control signal on a pixel by pixel basis.
  • the first signal conditioner may be configured to filter error components of the input signal, where the error components may include one or more of a signal phase error, a signal delay error, and a noise component.
  • a video signal correction unit of another embodiment includes a spatial correction unit for processing a received input video signal to perform spatial correction thereto, a primary rate converter unit coupled to the spatial correction unit, the primary rate converter unit configured to perform a primary rate conversion on the video signal, and a temporal corrector unit coupled to the spatial correction unit and the primary rate converter unit, the temporal corrector unit configured to perform signal correction to the video signal on a temporal basis.
  • the spatial correction unit may include a pre-corrector unit and a post-corrector unit.
  • Each of the spatial correction unit, the primary rate converter unit and the temporal corrector unit may be configured to simultaneously perform their respective processes.
  • the temporal corrector unit may be configured to first perform the secondary rate conversion and then the temporal basis signal value correction.
  • the primary rate converter unit may be configured to alter the signal across alternate frames of the input video signal in a temporal direction, where the primary rate converter unit may be further configured to perform a secondary rate conversion on the video signal.
  • the temporal corrector unit may be configured to perform a secondary rate conversion and a signal value correction on a temporal basis.
  • a video signal processing system of a further embodiment may include a luminance component analyzer configured to receive a video signal and accordingly generate a corresponding luminance component control signal, a color component analyzer configured to receive the video signal and accordingly generate a corresponding color component control signal, a signal conditioner configured to receive the luminance and color component control signals and accordingly generate a conditioner control signal, and a color component limiter configured to receive the conditioner control signal and the video signal, and accordingly generate a processed output video signal.
  • a luminance component analyzer configured to receive a video signal and accordingly generate a corresponding luminance component control signal
  • a color component analyzer configured to receive the video signal and accordingly generate a corresponding color component control signal
  • a signal conditioner configured to receive the luminance and color component control signals and accordingly generate a conditioner control signal
  • a color component limiter configured to receive the conditioner control signal and the video signal, and accordingly generate a processed output video signal.
  • the luminance component analyzer may include a Y analyzer, and the color component analyzer may include a CrCb analyzer, where the CrCb analyzer may be configured to process the CrCb signal in a horizontal direction of a line of the received video signal.
  • the signal conditioner may include a YCrCb enhance signal conditioner, configured to process the luminance and color component control signals on a pixel by pixel basis.
  • the color component limiter may include a CrCb minimum maximum limiter unit configured to process the conditioner control and the video signal on a pixel by pixel basis.
  • a signal enhancement method of one embodiment may include the steps of generating a control signal based on an input signal, receiving the control signal and generating a first signal conditioner control signal based on the control signal, receiving the conditioner control signal and generating a normalizer control signal based on the first signal conditioner control signal, and receiving the control signal, the first signal conditioner control signal and the normalizer control signal, and generating a processed output signal.
  • the step of generating said control signal may include the steps of processing the input signal in a vertical direction, and processing the input signal in a horizontal direction.
  • the step of generating the first signal conditioner control signal may include the step of processing the received control signal on a pixel by pixel basis.
  • the step of generating the processed output signal may include the step of processing the control signal, the first signal conditioner control signal, and the normalizer control signal on a pixel by pixel basis.
  • the step of generating the first signal conditioner control signal may include the step of filtering error components of the input signal, where the error components may include one or more of a signal phase error, a signal delay error, and a noise component.
  • a video signal correction method of a further embodiment may include the steps of processing a received input video signal for performing spatial correction thereto, performing a primary rate conversion on the video signal, and performing signal correction to the video signal on a temporal basis.
  • the steps of processing the received input video signal, performing the primary rate conversion and performing the signal correction may be performed simultaneously.
  • the step of performing the signal correction may include the steps of first performing a secondary rate conversion and then performing the temporal basis signal correction.
  • the step of performing the primary rate conversion may include the step of altering the signal across alternate frames of the input video signal in a temporal direction.
  • the step of performing the primary rate conversion may include the step of performing a secondary rate conversion on the video signal.
  • the step of performing the signal correction may include the steps of performing a secondary rate conversion and a signal value correction on a temporal basis.
  • a video signal processing method of yet a further embodiment may include receiving a video signal and accordingly generating a corresponding luminance component control signal, receiving the video signal and accordingly generating a corresponding color component control signal, receiving the luminance and color component control signals and accordingly generating a conditioner control signal, and receiving the conditioner control signal and the video signal, and accordingly generating a processed output video signal.
  • the step of generating the color component control signal may include the step of processing a CrCb signal in a horizontal direction of a line of the received video signal.
  • the step of generating the conditioner control signal may include the step of processing the luminance and color component control signals on a pixel by pixel basis.
  • the step of generating the processed output video signal may include the step of processing the conditioner control and the video signal on a pixel by pixel basis.
  • a signal enhancement system of another aspect of the present invention may include means for generating a control signal based on an input signal, means for generating a first signal conditioner control signal based on the control signal, means for generating a normalizer control signal based on the conditioner control signal, and means for generating a processed output signal based on the control signal, the first signal conditioner control signal and the normalizer control signal.
  • a video signal correction unit of a further aspect of the present invention may include means for performing spatial correction to an input video signal, means for performing a primary rate conversion on the video signal, and means for performing signal correction to the video signal on a temporal basis.
  • a video signal processing system of yet another aspect of the present invention may include means for generating a luminance component control signal based on a video signal, means for generating a color component control signal based on the video signal, means for generating a conditioner control signal based on the luminance component control signal and the color component control signal, and means for generating a processed output video signal based on the conditioner control signal and the video signal.
  • a color video signal may be defined in terms of RGB (or YCrCb) components, Y data for the video signal's luminance information and C data for the color information of the video signal.
  • a color video enhancement circuit in one embodiment of the present invention may be configured to analyze the incoming video signal, apply a variety of modifications and output a video signal that contains improved visual properties.
  • the video enhancement method and system may be based on digital signal processing (DSP) that is capable of producing an image with very high resolution, aperture ratio contrast ratio, and brightness.
  • DSP digital signal processing
  • the system and approach in accordance with the various aspects of the present invention may be configured such that it consumes relatively less power, is physically small (leading to compact and less expensive systems) and is inexpensive to manufacture.
  • one aspect of the present invention discloses a color video enhancement circuit that may be configured to use a combination of digital signal processing techniques to correct and/or conceal error and/or perturbations, improve visual sensation, reduce eye-strain and provide easier readability of text data.
  • Figure 1 illustrates an overall system for implementing a digital signal processing based video enhancement according to one embodiment.
  • Figure 2 illustrates a block diagram of the video enhancement circuit according to one embodiment.
  • Figure 3 illustrates a block diagram of the video correction unit according to one embodiment.
  • Figure 4 illustrates a block diagram of the video enhancement circuit according to another embodiment.
  • Figure 1 illustrates an overall system for implementing a digital signal processing based video enhancement according to a first embodiment.
  • the overall system 100 is provided with a frame rate conversion unit 110, an image scaling unit 120, a video enhancement unit 130, light valve drivers 140 and a control unit 150.
  • a video source separated into red, green and blue components is provided to the frame rate conversion unit 110 which is configured to perform frame rate conversion from 40-85 Hz for PC monitors and projectors.
  • the image scaling unit 120 may be configured to scale video images from VGA (640 x 480) to 1920 x 1080 resolution at full screen resolutions of 1920 x 1080.
  • the video enhancement unit 130 may be configured to apply image processing algorithms to the scaled and frame rate converted video images to improve the video images for sharper, clearer picture.
  • the video enhanced images are provided to the light valve drivers 140 which modulates the received light based on the video image in its memory.
  • the modulated red, green and blue light components are then provided to a prism assembly to output the processed video image as a composite, full color image.
  • the control unit 150 is coupled to the frame rate conversion unit 110, the image scaling unit 120, the video enhancement unit 130, and the light valve drivers 140, and is configured to provide control logic for the overall system 100 and in particular, to each of the frame rate conversion unit 110, the image scaling unit 120, the video enhancement unit 130, and the light valve drivers 140.
  • Figure 2 illustrates a block diagram of the video enhancement circuit according to one embodiment.
  • the video enhancement circuit 200 includes a column enhancer 210 and row enhancer 220, respectively configured to analyze signals across lines of video in the vertical and horizontal directions, and further, each configured to generate respective control signals.
  • a core signal conditioner 230 configured to receive the control signals from the column enhancer 210 and the row enhancer 220 for processing the received control signals on a pixel by pixel basis to minimize the effects of unwanted components of the video that may affect the perceived video quality.
  • the resulting control signal of the core signal conditioner 230 based on processing the received control signals from the column enhancer 210 and the row enhancer 220 is provided to a normalizer 240 which is configured to correct for any unwanted variations in the signal behavior due to variations in the original received signal.
  • control signals from the column enhancer 210, the row enhancer 220, and the core signal conditioner 230, as well as the processed output signal from the normalizer 240 are provided to an enhance signal conditioner 250 which processes the received signals on a pixel by pixel basis to generate the final processed video signal.
  • Figure 3 illustrates a block diagram of a video correction unit according to one embodiment.
  • the video correction unit 300 includes a pre-corrector unit 310, a primary rate converter 320, a post-corrector unit 330 and a temporal corrector unit 340.
  • the pre-corrector unit 310 and the post-corrector unit 330 together comprise a spatial correction block for the video correction unit 300.
  • the primary rate converter 320 may be configured to alter the signals across alternate frames of video in the temporal direction, and accordingly generating an intermediate video output signal. J-n one embodiment, the primary rate converter 320 may be configured to de-couple the video motion update rate from the LCD video display system refresh rate, thus allowing each to be optimized independently.
  • the temporal corrector unit 340 may be configured to perform secondary rate conversion and temporal basis signal value corrections.
  • the temporal corrector unit 340 may be configured to first perform the secondary rate conversion, followed by the time- variant value correction.
  • the secondary rate conversion may be performed by the primary rate converter 320.
  • the video correction unit 300 in one embodiment may be configured to alter the video signals across alternate frames of video in the temporal, spatial and value directions.
  • the video correction unit 300 may be configured to correct for the many transfer behavior differences between the incoming video signal and the LCD display's resultant optical errors. More specifically, the resultant optical errors are non-linear in nature and interact together, resulting in, in one embodiment, simultaneous correction to effectively address the optical errors.
  • Some examples of the corrections to the optical errors include bias correction, common mode matching, differential balancing, frequency equalization, gain correction, impulse shaping, phase compensation, positional correction, and temporal balancing.
  • FIG. 4 illustrates a block diagram of the video enhancement circuit according to another embodiment.
  • the video enhancement circuit 400 includes a Y analyzer unit 410, a CrCb analyzer unit 420, a YCrCb enhance signal conditioner unit 430, and a CrCb min max limiter unit 440.
  • the Y analyzer 410 may be configured to receive the composite input video signal and to process the luminance information corresponding thereto.
  • the CrCb analyzer unit 420 in one aspect may be configured to receive the composite input video signal and to process the color information thereof, by analyzing the CrCb signal in a line of the input video signal in the horizontal direction.
  • the Y analyzer unit 410 and the CrCb analyzer unit 420 based on the respective processings, then generate corresponding control signals which are provided to the YCrCb enhance signal conditioner unit 430.
  • the YCrCb enhance signal conditioner unit 430 may be configured to process the received control signals from the Y analyzer unit 410 and the
  • the CrCb analyzer unit 420 respectively, on a pixel-by-pixel basis, to generate a YCrCb enhance signal conditioner control signal.
  • the YCrCb enhance signal conditioner control signal processed and received from the YCrCb enhance signal conditioner unit 430 as well as the original CrCb signal, is provided to the CrCb min/max limiter unit 440.
  • the CrCb min/max limiter unit 440 then processes the received YCrCb enhance signal conditioner control signal and the original CrCb signal, on a pixel-by-pixel basis, to generate the final processed video signal for output display.
  • a generic DSP system for video processing applications may include sub-systems to perform pre-processing, column (vertical) data processing, row (horizontal) data processing, frame (time) data processing, and post- processing.
  • a color video enhancement circuit is provided to analyze the incoming video signal, apply a variety of modifications and output a video signal that contains visual properties to improve visual sensation, to reduce eye-strain, to provide easier readability of text and to provide correction and/or concealment of errors and/or perturbations.

Abstract

Method and system for providing a digital signal processing system for video processing applications includes sub-systems to perform pre-processing, column (vertical) data processing, row (horizontal) data processing, frame (time) data processing, and post-processing. In particular, a color video enhancement circuit is provided to analyze the incoming video signal, apply a variety of modifications and output a video signal that contains improved visual properties to improve visual sensation, to reduce eye-strain, to provide easier readability of text and to provide correction and/or concealment of errors and/or perturbations.

Description

SPECIFICATION
ELECTRONICS TO IMPROVE THE PROCESSING OF VIDEO SIGNALS FOR USE WITH A MICRODISPLAY BASED VIDEO PROJECTION SYSTEM
RELATED APPLICATION The present application claims priority under 35 USC §119 to provisional application no. 60/200,094 filed on April 27, 2000.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to video image systems. More particularly, the present invention relates to method and system for providing improved video signal processing for use with a microdisplay based video projection system.
2. Description of the Related Art
In a conventional video enhancement system, image correction is performed by boosting the gain in the high frequency portion of the signal. This approach can only improve some aspects of the video signal. In practice, any improvement to the video signals that occur may come at the cost of introducing new or exacerbating existing artifacts. Examples of common side effects include the introduction of phase errors, delay errors, the application of erroneous gain compensation, ringing, noise and excessive aliasing.
A more sophisticated video enhancement system may employ a similar approach but using a more complex set of alternating frequency groups or bands. While this approach may show improved image quality, there may be occasions when the image is still the subject to the same artifacts discussed above, with one notable difference - that behavior is pseudo-random. It is this apparent unpredictable behavior that limits the suitability, and thus, the applicability of the approaches discussed above. In a more advanced video enhancement system, the electronic circuitry may be added which attempts to predict when the normal operation of the system will be unsuccessful in correcting the video signal, and that which acts to adapt the corrective function to lower or skip the degree of correction. While this approach has the effect of reducing artifacts introduced by the operation of the video enhancement circuit, the video image is left still with all of its original shortcomings.
When digital signal processing is employed to perform the functions required to properly display the video information for a LCOS microdisplay, a number of unique problems arises. Indeed, among the most challenging are the high frequency, time dependent intensity variation referred to as flicker and the low frequency, time dependent intensity variation referred to as smear (or image retention).
While the problems discussed above may be inherent as a consequence of the materials from which the microdisplay is fabricated, the drive signal may also be an important factor due to the fact that the signal required to drive the display system exhibits a high degree of non-linearity.
SUMMARY OF THE INVENTION
In view of the foregoing, a signal enhancement system in accordance with one embodiment may include a signal enhancer configured to generate a control signal based on an input signal, a first signal conditioner configured to receive the control signal and accordingly, generate a first signal conditioner control signal, a normalizer configured to receive the conditioner control signal and accordingly, generate a normalizer control signal, and a second signal conditioner configured to receive the control signal, the first signal conditioner control signal and the normalizer control signal, and accordingly, generate a processed output signal.
The input signal may be a video signal and the processed output signal may be a corresponding video output signal. The signal enhancer may include a column enhancer configured to process the input signal in a vertical direction, and a row enhancer configured to process the input signal in a horizontal direction. The control signal may include a column enhanced control signal and a row enhanced control signal. The first signal conditioner may be configured to process the received control signal on a pixel by pixel basis, while the second signal conditioner may be configured to process the control signal, the first signal conditioner control signal, and the normalizer control signal on a pixel by pixel basis.
The first signal conditioner may be configured to filter error components of the input signal, where the error components may include one or more of a signal phase error, a signal delay error, and a noise component.
A video signal correction unit of another embodiment includes a spatial correction unit for processing a received input video signal to perform spatial correction thereto, a primary rate converter unit coupled to the spatial correction unit, the primary rate converter unit configured to perform a primary rate conversion on the video signal, and a temporal corrector unit coupled to the spatial correction unit and the primary rate converter unit, the temporal corrector unit configured to perform signal correction to the video signal on a temporal basis.
The spatial correction unit may include a pre-corrector unit and a post-corrector unit. Each of the spatial correction unit, the primary rate converter unit and the temporal corrector unit may be configured to simultaneously perform their respective processes.
The temporal corrector unit may be configured to first perform the secondary rate conversion and then the temporal basis signal value correction.
The primary rate converter unit may be configured to alter the signal across alternate frames of the input video signal in a temporal direction, where the primary rate converter unit may be further configured to perform a secondary rate conversion on the video signal.
The temporal corrector unit may be configured to perform a secondary rate conversion and a signal value correction on a temporal basis.
A video signal processing system of a further embodiment may include a luminance component analyzer configured to receive a video signal and accordingly generate a corresponding luminance component control signal, a color component analyzer configured to receive the video signal and accordingly generate a corresponding color component control signal, a signal conditioner configured to receive the luminance and color component control signals and accordingly generate a conditioner control signal, and a color component limiter configured to receive the conditioner control signal and the video signal, and accordingly generate a processed output video signal.
The luminance component analyzer may include a Y analyzer, and the color component analyzer may include a CrCb analyzer, where the CrCb analyzer may be configured to process the CrCb signal in a horizontal direction of a line of the received video signal.
The signal conditioner may include a YCrCb enhance signal conditioner, configured to process the luminance and color component control signals on a pixel by pixel basis.
The color component limiter may include a CrCb minimum maximum limiter unit configured to process the conditioner control and the video signal on a pixel by pixel basis.
A signal enhancement method of one embodiment may include the steps of generating a control signal based on an input signal, receiving the control signal and generating a first signal conditioner control signal based on the control signal, receiving the conditioner control signal and generating a normalizer control signal based on the first signal conditioner control signal, and receiving the control signal, the first signal conditioner control signal and the normalizer control signal, and generating a processed output signal.
The step of generating said control signal may include the steps of processing the input signal in a vertical direction, and processing the input signal in a horizontal direction.
The step of generating the first signal conditioner control signal may include the step of processing the received control signal on a pixel by pixel basis.
The step of generating the processed output signal may include the step of processing the control signal, the first signal conditioner control signal, and the normalizer control signal on a pixel by pixel basis.
The step of generating the first signal conditioner control signal may include the step of filtering error components of the input signal, where the error components may include one or more of a signal phase error, a signal delay error, and a noise component.
A video signal correction method of a further embodiment may include the steps of processing a received input video signal for performing spatial correction thereto, performing a primary rate conversion on the video signal, and performing signal correction to the video signal on a temporal basis.
The steps of processing the received input video signal, performing the primary rate conversion and performing the signal correction may be performed simultaneously.
The step of performing the signal correction may include the steps of first performing a secondary rate conversion and then performing the temporal basis signal correction.
The step of performing the primary rate conversion may include the step of altering the signal across alternate frames of the input video signal in a temporal direction.
The step of performing the primary rate conversion may include the step of performing a secondary rate conversion on the video signal.
The step of performing the signal correction may include the steps of performing a secondary rate conversion and a signal value correction on a temporal basis.
A video signal processing method of yet a further embodiment may include receiving a video signal and accordingly generating a corresponding luminance component control signal, receiving the video signal and accordingly generating a corresponding color component control signal, receiving the luminance and color component control signals and accordingly generating a conditioner control signal, and receiving the conditioner control signal and the video signal, and accordingly generating a processed output video signal.
The step of generating the color component control signal may include the step of processing a CrCb signal in a horizontal direction of a line of the received video signal.
The step of generating the conditioner control signal may include the step of processing the luminance and color component control signals on a pixel by pixel basis.
The step of generating the processed output video signal may include the step of processing the conditioner control and the video signal on a pixel by pixel basis. A signal enhancement system of another aspect of the present invention may include means for generating a control signal based on an input signal, means for generating a first signal conditioner control signal based on the control signal, means for generating a normalizer control signal based on the conditioner control signal, and means for generating a processed output signal based on the control signal, the first signal conditioner control signal and the normalizer control signal.
A video signal correction unit of a further aspect of the present invention may include means for performing spatial correction to an input video signal, means for performing a primary rate conversion on the video signal, and means for performing signal correction to the video signal on a temporal basis.
A video signal processing system of yet another aspect of the present invention may include means for generating a luminance component control signal based on a video signal, means for generating a color component control signal based on the video signal, means for generating a conditioner control signal based on the luminance component control signal and the color component control signal, and means for generating a processed output video signal based on the conditioner control signal and the video signal.
Indeed, a color video signal may be defined in terms of RGB (or YCrCb) components, Y data for the video signal's luminance information and C data for the color information of the video signal. A color video enhancement circuit in one embodiment of the present invention may be configured to analyze the incoming video signal, apply a variety of modifications and output a video signal that contains improved visual properties.
In particular, in accordance with various embodiments of the present invention, the video enhancement method and system may be based on digital signal processing (DSP) that is capable of producing an image with very high resolution, aperture ratio contrast ratio, and brightness. Moreover, the system and approach in accordance with the various aspects of the present invention may be configured such that it consumes relatively less power, is physically small (leading to compact and less expensive systems) and is inexpensive to manufacture. In addition, one aspect of the present invention discloses a color video enhancement circuit that may be configured to use a combination of digital signal processing techniques to correct and/or conceal error and/or perturbations, improve visual sensation, reduce eye-strain and provide easier readability of text data.
These and other features and advantages of the various aspects and embodiments of the present invention will be understood upon consideration of the following detailed description of the invention and the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 illustrates an overall system for implementing a digital signal processing based video enhancement according to one embodiment.
Figure 2 illustrates a block diagram of the video enhancement circuit according to one embodiment.
Figure 3 illustrates a block diagram of the video correction unit according to one embodiment.
Figure 4 illustrates a block diagram of the video enhancement circuit according to another embodiment.
INCORPORATION BY REFERENCE
What follows is a cite list of references each of which is, in addition to those references that may be cited above and below herein, including that which is described as background, and the above invention summary, are hereby incorporated by reference into the detailed description of the preferred embodiment below, as disclosing alternative embodiments of elements or features of the preferred embodiments not otherwise set forth in detail below. A single one or a combination of two or more of these references may be consulted to obtain a variation of the preferred embodiments described in the detailed description below. Further patent, patent application and non-patent references may be cited in the written description and are also incorporated by reference into the detailed description of the preferred embodiment with the same effect as just described with respect to the following references: United States patent applications no. 60/192,258, 60/192,732, 60/194,735, 60/198,436, 60/200,094, 60/202,265, 60/208,603, 60/210,784, 60/210,285, 60/213,334, 60/214,574, 60/215,932, 60/217,758, 60/220,979, 60/224,617, 60/224,961, 60/224,257, 60/224,503, 60/224,291, 60/224,290, 60/224,060, 60/224,059, 60/224,061, 60/224,289, 60/227,229, 60/229,666, 60/230,330, 60/230,326, 60/232,281, 60/234,415, 60/245,807 and 60/249,815, each of which is assigned to the same assignee as the present application. DETAILED DESCRIPTION OF THE INVENTION
Figure 1 illustrates an overall system for implementing a digital signal processing based video enhancement according to a first embodiment. Referring to Figure 1, the overall system 100 is provided with a frame rate conversion unit 110, an image scaling unit 120, a video enhancement unit 130, light valve drivers 140 and a control unit 150. As can be seen, a video source separated into red, green and blue components is provided to the frame rate conversion unit 110 which is configured to perform frame rate conversion from 40-85 Hz for PC monitors and projectors. The image scaling unit 120 may be configured to scale video images from VGA (640 x 480) to 1920 x 1080 resolution at full screen resolutions of 1920 x 1080. The video enhancement unit 130 may be configured to apply image processing algorithms to the scaled and frame rate converted video images to improve the video images for sharper, clearer picture.
The video enhanced images are provided to the light valve drivers 140 which modulates the received light based on the video image in its memory. The modulated red, green and blue light components are then provided to a prism assembly to output the processed video image as a composite, full color image. Referring back to Figure 1, the control unit 150 is coupled to the frame rate conversion unit 110, the image scaling unit 120, the video enhancement unit 130, and the light valve drivers 140, and is configured to provide control logic for the overall system 100 and in particular, to each of the frame rate conversion unit 110, the image scaling unit 120, the video enhancement unit 130, and the light valve drivers 140.
Figure 2 illustrates a block diagram of the video enhancement circuit according to one embodiment. Referring to Figure 2, the video enhancement circuit 200 includes a column enhancer 210 and row enhancer 220, respectively configured to analyze signals across lines of video in the vertical and horizontal directions, and further, each configured to generate respective control signals. Also shown in Figure 2 is a core signal conditioner 230 configured to receive the control signals from the column enhancer 210 and the row enhancer 220 for processing the received control signals on a pixel by pixel basis to minimize the effects of unwanted components of the video that may affect the perceived video quality. The resulting control signal of the core signal conditioner 230 based on processing the received control signals from the column enhancer 210 and the row enhancer 220 is provided to a normalizer 240 which is configured to correct for any unwanted variations in the signal behavior due to variations in the original received signal.
As further shown in Figure 2, the control signals from the column enhancer 210, the row enhancer 220, and the core signal conditioner 230, as well as the processed output signal from the normalizer 240 are provided to an enhance signal conditioner 250 which processes the received signals on a pixel by pixel basis to generate the final processed video signal.
Figure 3 illustrates a block diagram of a video correction unit according to one embodiment. Referring to Figure 3, the video correction unit 300 includes a pre-corrector unit 310, a primary rate converter 320, a post-corrector unit 330 and a temporal corrector unit 340. As shown, in one embodiment, the pre-corrector unit 310 and the post-corrector unit 330 together comprise a spatial correction block for the video correction unit 300. The primary rate converter 320 may be configured to alter the signals across alternate frames of video in the temporal direction, and accordingly generating an intermediate video output signal. J-n one embodiment, the primary rate converter 320 may be configured to de-couple the video motion update rate from the LCD video display system refresh rate, thus allowing each to be optimized independently. Referring back to Figure 3, the temporal corrector unit 340 may be configured to perform secondary rate conversion and temporal basis signal value corrections. In one embodiment, the temporal corrector unit 340 may be configured to first perform the secondary rate conversion, followed by the time- variant value correction. Furthermore, in one aspect, the secondary rate conversion may be performed by the primary rate converter 320.
As discussed above, the video correction unit 300 in one embodiment may be configured to alter the video signals across alternate frames of video in the temporal, spatial and value directions. In particular, the video correction unit 300 may be configured to correct for the many transfer behavior differences between the incoming video signal and the LCD display's resultant optical errors. More specifically, the resultant optical errors are non-linear in nature and interact together, resulting in, in one embodiment, simultaneous correction to effectively address the optical errors. Some examples of the corrections to the optical errors include bias correction, common mode matching, differential balancing, frequency equalization, gain correction, impulse shaping, phase compensation, positional correction, and temporal balancing.
Figure 4 illustrates a block diagram of the video enhancement circuit according to another embodiment. Referring to Figure 4, the video enhancement circuit 400 includes a Y analyzer unit 410, a CrCb analyzer unit 420, a YCrCb enhance signal conditioner unit 430, and a CrCb min max limiter unit 440. In one aspect, the Y analyzer 410 may be configured to receive the composite input video signal and to process the luminance information corresponding thereto. Furthermore, the CrCb analyzer unit 420 in one aspect may be configured to receive the composite input video signal and to process the color information thereof, by analyzing the CrCb signal in a line of the input video signal in the horizontal direction. The Y analyzer unit 410 and the CrCb analyzer unit 420, based on the respective processings, then generate corresponding control signals which are provided to the YCrCb enhance signal conditioner unit 430. The YCrCb enhance signal conditioner unit 430 may be configured to process the received control signals from the Y analyzer unit 410 and the
CrCb analyzer unit 420 respectively, on a pixel-by-pixel basis, to generate a YCrCb enhance signal conditioner control signal. The YCrCb enhance signal conditioner control signal, processed and received from the YCrCb enhance signal conditioner unit 430 as well as the original CrCb signal, is provided to the CrCb min/max limiter unit 440. The CrCb min/max limiter unit 440 then processes the received YCrCb enhance signal conditioner control signal and the original CrCb signal, on a pixel-by-pixel basis, to generate the final processed video signal for output display.
In the manner described above, in accordance with one aspect of the present invention, a generic DSP system for video processing applications may include sub-systems to perform pre-processing, column (vertical) data processing, row (horizontal) data processing, frame (time) data processing, and post- processing. In particular, a color video enhancement circuit is provided to analyze the incoming video signal, apply a variety of modifications and output a video signal that contains visual properties to improve visual sensation, to reduce eye-strain, to provide easier readability of text and to provide correction and/or concealment of errors and/or perturbations.
While the specific embodiments described herein may be directed to developing a system optimized for rear screen video projection, in one aspect of the present invention, the approach set forth herein may be applied to display systems optimized for other applications including those intended primarily for the display of text or those using direct view.
Various other modifications and alterations in the structure and method of operation of this invention will be apparent to those skilled in the art without departing from the scope and spirit of the invention. Although the invention has been described in connection with specific preferred embodiments, it should be understood that the invention as claimed should not be unduly limited to such specific embodiments. It is intended that the following claims define the scope of the present invention and that structures and methods within the scope of these claims and their equivalents be covered thereby.

Claims

WHAT IS CLAIMED IS:
1. A signal enhancement system, comprising: a signal enhancer configured to generate a control signal based on an input signal; a first signal conditioner configured to receive said control signal and accordingly, generate a first signal conditioner control signal; a normalizer configured to receive said conditioner control signal and accordingly, generate a normalizer control signal; and a second signal conditioner configured to receive said control signal, said first signal conditioner control signal and said normalizer control signal, and accordingly, generate a processed output signal.
2. The system of claim 1 wherein said input signal includes a video signal and said processed output signal includes a corresponding video output signal.
3. The system of claim 2 wherein said signal enhancer includes: a column enhancer configured to process said input signal in a vertical direction; and a row enhancer configured to process said input signal in a horizontal direction.
4. The system of claim 3 wherein said control signal includes a column enhanced control signal and a row enhanced control signal.
5. The system of claim 1 wherein said first signal conditioner is configured to process said received control signal on a pixel by pixel basis.
6. The system of claim 1 wherein said second signal conditioner is configured to process said control signal, said first signal conditioner control signal, and said normalizer control signal on a pixel by pixel basis.
7. The system of claim 1 wherein said first signal conditioner is configured to filter error components of the input signal.
8. The system of claim 7 wherein said error components includes one or more of a signal phase error, a signal delay error, and a noise component.
9. A video signal correction unit, comprising: a spatial correction unit for processing a received input video signal to perform spatial correction thereto; a primary rate converter unit coupled to said spatial correction unit, said primary rate converter unit configured to perform a primary rate conversion on said video signal; and a temporal corrector unit coupled to said spatial correction unit and said primary rate converter unit, said temporal corrector unit configured to perform signal correction to said video signal on a temporal basis.
10. The unit of claim 9, wherein said spatial correction unit includes a pre-corrector unit and a post-corrector unit.
11. The unit of claim 9 wherein each of said spatial correction unit, said primary rate converter unit and said temporal corrector unit is configured to simultaneously perform said respective processes.
12. The unit of claim 9 wherein said temporal corrector unit is configured to first perform a secondary rate conversion and then said temporal basis signal correction.
13. The unit of claim 9 wherein said primary rate converter unit is configured to alter the signal across alternate frames of said input video signal in a temporal direction.
14. The unit of claim 13 wherein said primary rate converter unit is further configured to perform a secondary rate conversion on said video signal.
15. The unit of claim 9 wherein said temporal corrector unit is configured to perform a secondary rate conversion and a signal value correction on a temporal basis.
16. A video signal processing system, comprising: a luminance component analyzer configured to receive a video signal and accordingly generate a corresponding luminance component control signal; a color component analyzer configured to receive said video signal and accordingly generate a corresponding color component control signal; a signal conditioner configured to receive said luminance and color component control signals and accordingly generate a conditioner control signal; and a color component limiter configured to receive said conditioner control signal and said video signal, and accordingly generate a processed output video signal.
17. The system of claim 16, wherein said luminance component analyzer includes a Y analyzer, and further, wherein said color component analyzer includes a CrCb analyzer
18. The system of claim 17 wherein said CrCb analyzer is configured to process the CrCb signal in a horizontal direction of a line of said received video signal.
19. The system of claim 16 wherein said signal conditioner includes a YCrCb enhance signal conditioner, configured to process said luminance and color component control signals on a pixel by pixel basis.
20. The system of claim 16 wherein said color component limiter includes a CrCb minimum/maximum limiter unit configured to process said conditioner control and said video signal on a pixel by pixel basis.
21. A signal enhancement method, comprising the steps of: generating a control signal based on an input signal; receiving said control signal and generating a first signal conditioner control signal based on said control signal; receiving said conditioner control signal and generating a normalizer control signal based on said first signal conditioner control signal; and receiving said control signal, said first signal conditioner control signal and said normalizer control signal, and generating a processed output signal.
22. The method of claim 21 wherein said input signal includes a video signal and said processed output signal includes a corresponding video output signal.
23. The method of claim 22 wherein said step of generating said control signal includes the steps of: processing said input signal in a vertical direction; and processing said input signal in a horizontal direction.
24. The method of claim 23 wherein said control signal includes a column enhanced control signal and a row enhanced control signal.
25. The method of claim 21 wherein said step of generating said first signal conditioner control signal includes the step of processing said received control signal on a pixel by pixel basis.
26. The method of claim 21 wherein said step of generating said processed output signal includes the step of processing said control signal, said first signal conditioner control signal, and said normalizer control signal on a pixel by pixel basis.
27. The method of claim 21 wherein said step of generating said first signal conditioner control signal includes the step of filtering error components of the input signal.
28. The method of claim 27 wherein said error components includes one or more of a signal phase error, a signal delay error, and a noise component.
29. A video signal correction method, comprising the steps of: processing a received input video signal for performing spatial correction thereto; performing a primary rate conversion on said video signal; and performing signal correction to said video signal on a temporal basis.
30. The method of claim 29, wherein said steps of processing said received input video signal, performing said primary rate conversion and performing said signal correction are performed simultaneously.
31. The method of claim 29 wherein said step of performing said signal correction includes the steps of first performing a secondary rate conversion and then performing said temporal basis signal correction.
32. The method of claim 29 wherein said step of performing said primary rate conversion includes the step of altering the signal across alternate frames of said input video signal in a temporal direction.
33. The method of claim 32 wherein said step of performing said primary rate conversion includes the step of performing a secondary rate conversion on said video signal.
34. The method of claim 29 wherein said step of performing said signal correction includes the steps of performing a secondary rate conversion and a signal value correction on a temporal basis.
35. A video signal processing method, comprising the steps of: receiving a video signal and accordingly generating a corresponding luminance component control signal; receiving said video signal and accordingly generating a corresponding color component control signal; receiving said luminance and color component control signals and accordingly generating a conditioner control signal; and receiving said conditioner control signal and said video signal, and accordingly generating a processed output video signal.
36. The method of claim 35 wherein said step of generating said color component control signal includes the step of processing a CrCb signal in a horizontal direction of a line of said received video signal.
37. The method of claim 35 wherein said step of generating said conditioner control signal includes the step of processing said luminance and color component control signals on a pixel by pixel basis.
38. The method of claim 35 wherein said step of generating said processed output video signal includes the step of processing said conditioner control and said video signal on a pixel by pixel basis.
39. A signal enhancement system, comprising: means for generating a control signal based on an input signal; means for generating a first signal conditioner control signal based on said control signal; means for generating a normalizer control signal based on said conditioner control signal; and means for generating a processed output signal based on said control signal, said first signal conditioner control signal and said normalizer control signal.
40. A video signal correction unit, comprising: means for performing spatial correction to an input video signal; means for performing a primary rate conversion on said video signal; and means for performing signal correction to said video signal on a temporal basis.
41. A video signal processing system, comprising: means for generating a luminance component control signal based on a video signal; means for generating a color component control signal based on said video signal; means for generating a conditioner control signal based on said luminance component control signal and said color component control signal; and means for generating a processed output video signal based on said conditioner control signal and said video signal.
PCT/US2001/013152 2000-04-27 2001-04-24 Method and system for improving the processing of video signals for use with a microdisplay based video projection system WO2001082590A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001257197A AU2001257197A1 (en) 2000-04-27 2001-04-24 Electronics to improve the processing of video signals for use with a microdisplay based video projection system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US20009400P 2000-04-27 2000-04-27
US60/200,094 2000-04-27

Publications (2)

Publication Number Publication Date
WO2001082590A2 true WO2001082590A2 (en) 2001-11-01
WO2001082590A3 WO2001082590A3 (en) 2002-04-25

Family

ID=22740305

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/013152 WO2001082590A2 (en) 2000-04-27 2001-04-24 Method and system for improving the processing of video signals for use with a microdisplay based video projection system

Country Status (2)

Country Link
AU (1) AU2001257197A1 (en)
WO (1) WO2001082590A2 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0814607A2 (en) * 1996-06-19 1997-12-29 Matsushita Electric Industrial Co., Ltd. Television receiver, antenna diversity controller, circuits for stabilizing luminance, chrominance and synchronizing signals and a method for transmitting a television signal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07143454A (en) * 1993-11-15 1995-06-02 Toshiba Corp High definition television receiver
JP3584362B2 (en) * 1998-01-05 2004-11-04 株式会社日立製作所 Video signal processing device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0814607A2 (en) * 1996-06-19 1997-12-29 Matsushita Electric Industrial Co., Ltd. Television receiver, antenna diversity controller, circuits for stabilizing luminance, chrominance and synchronizing signals and a method for transmitting a television signal

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 1995, no. 09, 31 October 1995 (1995-10-31) & JP 07 143454 A (TOSHIBA CORP;OTHERS: 01), 2 June 1995 (1995-06-02) *
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 12, 29 October 1999 (1999-10-29) & JP 11 196294 A (HITACHI LTD), 21 July 1999 (1999-07-21) *

Also Published As

Publication number Publication date
AU2001257197A1 (en) 2001-11-07
WO2001082590A3 (en) 2002-04-25

Similar Documents

Publication Publication Date Title
JP5127121B2 (en) Display device and display method
US7825938B2 (en) Method and apparatus for processing digital image to be displayed on display device with backlight module
US20070076226A1 (en) Smart clipper for mobile displays
US20090022411A1 (en) Image display apparatus
EP2161918B1 (en) Image processor, image display device, image processing method, and image display method
US8452121B2 (en) Image processor, image display device, and image processing method
JP2006153914A (en) Liquid crystal projector
US8374427B2 (en) Image processing method and image processing system
WO2008072162A2 (en) Video processing device and method of color gamut mapping
KR101173584B1 (en) Apparatus and method for image processing in spatial light modulated display systems
KR101267952B1 (en) Method and apparatus for improving images provided by spatial light modulatedslm display systems
JP2003069859A (en) Moving image processing adapting to motion
JPH05134268A (en) Picture reproducing liquid crystal display device
US8254448B2 (en) Moving picture display apparatus
JP2007300461A (en) Image display device and its color phase deviation correction method
JP2005057474A (en) Projection type image display device
WO2001082590A2 (en) Method and system for improving the processing of video signals for use with a microdisplay based video projection system
JP2006520479A (en) Signal processing for color sequential displays
JP4379029B2 (en) Image processing apparatus, image processing method, and image projection apparatus
US20040150654A1 (en) Sparkle reduction using a split gamma table
JP2007060169A (en) Image processing apparatus, image display apparatus and image processing method
US20180376031A1 (en) Projection apparatus that improves dynamic range of luminance of printed material, control method therefor, and storage medium
US6961039B2 (en) Method and apparatus for sparkle reduction by reactive and anticipatory slew rate limiting
US20080193036A1 (en) Method and device for image filtering
JP2009300961A (en) Projection display device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: RULE 69 (1) EPC

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP