US10003814B2 - Image processor, display image processing method and associated electronic device - Google Patents
Image processor, display image processing method and associated electronic device Download PDFInfo
- Publication number
- US10003814B2 US10003814B2 US14/940,164 US201514940164A US10003814B2 US 10003814 B2 US10003814 B2 US 10003814B2 US 201514940164 A US201514940164 A US 201514940164A US 10003814 B2 US10003814 B2 US 10003814B2
- Authority
- US
- United States
- Prior art keywords
- image
- video data
- sensors
- strength
- analyzing result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active - Reinstated
Links
- 238000003672 processing method Methods 0.000 title claims description 12
- 230000009467 reduction Effects 0.000 claims description 33
- 230000000295 complement effect Effects 0.000 claims description 4
- 229910044991 metal oxide Inorganic materials 0.000 claims description 4
- 150000004706 metal oxides Chemical class 0.000 claims description 4
- 230000008520 organization Effects 0.000 claims description 4
- 239000004065 semiconductor Substances 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 230000002708 enhancing effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 241000255925 Diptera Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/40—Picture signal circuits
- H04N1/409—Edge or detail enhancement; Noise or error suppression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/41—Bandwidth or redundancy reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
Definitions
- a display generally comprises an image processor for performing image enhancement operations such as noise reduction, color enhancement and sharpness enhancement.
- image enhancement operations such as noise reduction, color enhancement and sharpness enhancement.
- the function parameters of these image enhancement operations are generally set for all sorts of images, and this processing method may not provide a best enhancement for every image. For example, excessive enhancement in a noisy image will bring up noise artifact.
- an image processor comprises a receiving unit, an information analyzer and an adjusting circuit.
- the receiving unit is arranged for receiving image/video data and corresponding metadata
- the information analyzer is arranged for analyzing the metadata of the image/video data to generate at least one analyzing result for indicating a strength of an image/video quality enhancement
- the adjusting circuit is arranged for adjusting an image/video quality according to the analyzing result.
- an image processing method comprising: receiving image/video data and corresponding metadata; analyzing the metadata of the image/video data to generate at least one analyzing result for indicating a strength of an image/video quality enhancement; and adjusting an image/video quality according to the analyzing result.
- an electronic device comprises an image sensor, an image signal processor, a memory and an image processor.
- the image sensor is arranged for capturing light to generate raw image data.
- the image signal processor is coupled to the image sensor, and is arranged for processing the raw image data to generate image data and corresponding metadata.
- the memory is coupled to the image signal processor, and is arranged for storing the image data and the corresponding metadata generated from the image signal processor.
- the image processor is coupled to the memory, and is arranged for obtaining the image data and the corresponding metadata from the memory, analyzing the metadata of the image data to generate at least one analyzing result for indicating a strength of an image quality enhancement, and adjusting an image/video quality according to the analyzing result.
- FIG. 1 is a diagram illustrating an electronic device according to one embodiment of the present invention.
- FIG. 2 is a diagram illustrating the image processor according to one embodiment of the present invention.
- FIG. 3 shows a relationship between the ISO speed and the strength of the noise reduction according to one embodiment of the present invention.
- FIG. 4 shows a relationship between the ISO speed and the strength of the color enhancement according to one embodiment of the present invention.
- FIG. 5 shows a relationship between the ISO speed and the strength of the sharpness enhancement according to one embodiment of the present invention.
- FIG. 6 shows a relationship between the shutter speed and the strength of the sharpness enhancement according to one embodiment of the present invention.
- FIG. 7 shows a relationship between the bit-rate and the strength of the noise reduction according to one embodiment of the present invention.
- FIG. 8 shows a relationship between the bit-rate and the strength of the color enhancement according to one embodiment of the present invention.
- FIG. 9 shows a relationship between the bit-rate and the strength of the sharpness enhancement according to one embodiment of the present invention.
- FIG. 10 shows a flowchart of a display image processing method according to one embodiment of the present invention.
- FIG. 1 is a diagram illustrating an electronic device 100 according to one embodiment of the present invention.
- the electronic device 100 comprises an image sensor 110 , a video decoder 120 , and image signal processor (ISP) 130 , a memory 140 , an image processor 150 and a display panel 160 .
- the electronic device 100 can be a smartphone, a tablet, a notebook, a camera or any other device having a display panel.
- the image sensor 110 may be implemented by complementary metal oxide semiconductor (CMOS) sensors or charge coupled device (CCD) sensors, and is arranged to capture light to generate raw image data.
- CMOS complementary metal oxide semiconductor
- CCD charge coupled device
- the video decoder 120 is arranged to decode a video stream to generate video data to the memory 140 , where the video stream may come from another electronic device via wireless or Internet connection(s) or from any other appropriate source, and a video header comprises metadata such as bit-rate and/or image resolution.
- the ISP (Image Signal Processor) 130 is arranged to receive the raw image data from the image sensor 110 and process the raw image data to generate image data and corresponding metadata, where the metadata may comprise the information about the generation of the raw image data, such as ISO speed (based on the standard from “International Organization for Standardization”), shutter speed and/or aperture value.
- the ISO speed is arranged to control the sensitivity of the sensor that absorbs the light. The higher the ISO speed, the more sensitive the sensor is to light.
- the ISP 130 further packets the image data and the corresponding metadata to have Joint Photographic Experts Group (JPEG) format, and the corresponding metadata is an exchangeable image file format (EXIF) information within this JPEG file.
- JPEG Joint Photographic Experts Group
- EXIF exchangeable image file format
- the memory 140 is arranged to store the image data and the video data to be displayed.
- the image processor 150 is arranged to obtain the image/video data and corresponding metadata from the memory 140 , analyze the metadata of the image/video data to generate at least one analyzing result for indicating a strength (or degree) of an image quality enhancement needed to be applied, and adjust an image/video quality according to the analyzing result to generate an adjusted image/video data. Then, the adjusted image data is sent to the display panel 160 to be displayed thereon.
- the image processor 150 comprises a receiving unit 210 , an information analyzer 220 and an adjusting circuit 230 , where the adjusting circuit 230 comprises a noise reduction unit 232 , a color enhancement unit 234 and a sharpness enhancement unit 236 .
- the receiving unit 210 is arranged to receive image/video data and corresponding metadata from the memory 140
- the information analyzer 220 is arranged to analyze the metadata of the image/video data to generate analyzing results
- the adjusting circuit 230 adjusts the image/video data to generate the adjusted image/video data according to analyzing results.
- the detailed operations of the information analyzer 220 and the adjusting circuit 230 are in the following descriptions.
- the noise reduction unit 232 may perform the noise reduction operation upon the image data by using conventional temporal or spatial noise reduction filter or motion-adaptive compensation method, where the strength of the noise reduction operation may be determined by setting the coefficients of the temporal or spatial noise reduction filter.
- the color enhancement unit 234 may perform the color enhancement operation upon the image data by using conventional hue, saturation and value (HSV) components.
- the sharpness enhancement unit 236 may perform the sharpness enhancement operation upon the image data by using conventional edge contrast enhancement method. Because a person skilled in this art should understand the operations of the noise reduction, color enhancement and sharpness enhancement operations and how to determine the strengths of these operations, further descriptions are therefore omitted here.
- the information analyzer 220 extracts the ISO speed information from the EXIF information, and analyzes a level of the ISO speed to generate the analyzing result, and the noise reduction unit 232 , the color enhancement unit 234 and the sharpness enhancement unit 236 determines the enhancement strengths of their operations according to the analyzing result, respectively.
- the noise reduction unit 232 may apply a weak noise reduction
- the color enhancement unit 234 may apply a high strength of the color enhancement (i.e.
- the sharpness enhancement unit 236 may apply a high strength of the sharpness enhancement (i.e. strong sharpness enhancement) upon the image data.
- the noise reduction unit 232 may apply a strong noise reduction
- the color enhancement unit 234 may apply a low strength of the color enhancement (i.e. weak color enhancement)
- the sharpness enhancement unit 236 may apply a low strength of the sharpness enhancement (i.e. weak sharpness enhancement) upon the image data to avoid enhancing the noise.
- FIG. 3 shows a relationship between the ISO speed and the strength of the noise reduction according to one embodiment of the present invention
- FIG. 4 shows a relationship between the ISO speed and the strength of the color enhancement according to one embodiment of the present invention
- FIG. 5 shows a relationship between the ISO speed and the strength of the sharpness enhancement according to one embodiment of the present invention.
- FIGS. 3-5 the lower the ISO speed, the lower strength of the noise reduction operation, the higher strength of the color enhancement operation, and the higher strength of the sharpness enhancement operation. It is noted that the linear relation shown in FIGS. 3-5 are for illustrative purposes only, and is not a limitation of the present invention. In other embodiment, the relationship between the ISO speed and the strength of the noise reduction/color enhancement/sharpness enhancement can be determined according designer's consideration.
- the information analyzer 220 may extract the shutter speed information from the EXIF information, and analyzes a level of the shutter speed to generate the analyzing result, and the sharpness enhancement unit 236 determines the enhancement strength according to the analyzing result.
- the sharpness enhancement unit 236 may apply a normal or low strength of sharpness enhancement operation upon the image data.
- the sharpness enhancement unit 236 may apply a high strength of sharpness enhancement operation upon the image data to enhance the image clarity.
- FIG. 6 shows a relationship between the shutter speed and the strength of the sharpness enhancement according to one embodiment of the present invention.
- the lower the shutter speed the higher strength of the sharpness enhancement operation.
- the linear relation shown in FIG. 6 is for illustrative purposes only, and is not a limitation of the present invention. In other embodiment, the relationship between the shutter speed and the strength of the sharpness enhancement can be determined according designer's consideration.
- the information analyzer 220 extracts the bit-rate information (metadata) from the video header, and analyzes a level of the bit-rate to generate the analyzing result, and the noise reduction unit 232 , the color enhancement unit 234 and the sharpness enhancement unit 236 determines the enhancement strengths of their operations according to the analyzing result, respectively.
- the noise reduction unit 232 may apply a strong noise reduction
- the color enhancement unit 234 may apply a low strength of the color enhancement (i.e. weak color enhancement)
- the sharpness enhancement unit 236 may apply a low strength of the sharpness enhancement (i.e. weak sharpness enhancement) upon the image data to avoid enhancing the noise.
- the color enhancement operation and the sharpness enhancement operation should be performed after the noise reduction operation.
- FIG. 7 shows a relationship between the bit-rate and the strength of the noise reduction according to one embodiment of the present invention
- FIG. 8 shows a relationship between the bit-rate and the strength of the color enhancement according to one embodiment of the present invention
- FIG. 9 shows a relationship between the bit-rate and the strength of the sharpness enhancement according to one embodiment of the present invention.
- FIGS. 7-9 the lower the bit-rate, the higher strength of the noise reduction operation, the lower strength of the color enhancement operation, and the lower strength of the sharpness enhancement operation. It is noted that the linear relation shown in FIGS. 7-9 are for illustrative purposes only, and is not a limitation of the present invention. In other embodiment, the relationship between the bit-rate and the strength of the noise reduction/color enhancement/sharpness enhancement can be determined according designer's consideration.
- FIG. 10 shows a flowchart of a display image processing method according to one embodiment of the present invention. Referring to the above disclosure, the flow is described as follows.
- Step 1000 the flow starts.
- Step 1002 extract metadata of image/video data.
- Step 1004 analyze the metadata to generate analyzing result.
- Step 1006 determine strengths (degrees) of the enhancement operations needs to be applied.
- Step 1008 perform enhancement operations upon the image/video data according to the determined strength(s).
- Step 1010 determine if all image/video data are processed? If yes, the flow enters Step 1012 ; if not, the flow goes back to Step 1002 .
- Step 1012 the flow finishes.
- the metadata of the image/video data is analyzed to respectively determine appropriate strengths of the noise reduction, color enhancement and sharpness enhancement operations. Namely, the strengths of these operations can be adaptively determined. Therefore, most of the images can have the best enhancement.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Picture Signal Circuits (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (23)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/940,164 US10003814B2 (en) | 2015-05-06 | 2015-11-13 | Image processor, display image processing method and associated electronic device |
CN201610260372.7A CN106131392A (en) | 2015-05-06 | 2016-04-25 | Image processor, display image processing method and related electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562157530P | 2015-05-06 | 2015-05-06 | |
US14/940,164 US10003814B2 (en) | 2015-05-06 | 2015-11-13 | Image processor, display image processing method and associated electronic device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160330350A1 US20160330350A1 (en) | 2016-11-10 |
US10003814B2 true US10003814B2 (en) | 2018-06-19 |
Family
ID=57223006
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/940,164 Active - Reinstated US10003814B2 (en) | 2015-05-06 | 2015-11-13 | Image processor, display image processing method and associated electronic device |
Country Status (2)
Country | Link |
---|---|
US (1) | US10003814B2 (en) |
CN (1) | CN106131392A (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106792156A (en) * | 2016-12-08 | 2017-05-31 | 深圳Tcl新技术有限公司 | Lift the method and device of Internet video definition |
CN109168065B (en) * | 2018-10-15 | 2021-03-12 | Oppo广东移动通信有限公司 | Video enhancement method and device, electronic equipment and storage medium |
US10839565B1 (en) * | 2019-08-19 | 2020-11-17 | Samsung Electronics Co., Ltd. | Decoding apparatus and operating method of the same, and artificial intelligence (AI) up-scaling apparatus and operating method of the same |
KR20210067788A (en) * | 2019-11-29 | 2021-06-08 | 삼성전자주식회사 | Electronic apparatus, system and control method thereof |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040012694A1 (en) * | 1997-04-09 | 2004-01-22 | Pentax Corporation | Image correction information recording device |
US20070250893A1 (en) * | 2006-04-03 | 2007-10-25 | Yasuhiro Akiyama | Digital broadcasting receiving apparatus |
US20140115536A1 (en) * | 2011-06-21 | 2014-04-24 | Nikon Corporation | Display program and display device |
US20140333791A1 (en) * | 2013-05-07 | 2014-11-13 | Canon Kabushiki Kaisha | Image capturing apparatus and control method thereof |
US20150077603A1 (en) * | 2012-05-31 | 2015-03-19 | Olympus Imaging Corp. | Imaging device, image processing device, recording medium in which image file is recorded, recording method, image playback method, and computer-readable recording medium |
US20160316203A1 (en) * | 2015-04-27 | 2016-10-27 | Harmonic, Inc. | Adaptive pre-filtering based on video complexity and output bit rate |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2521843B2 (en) * | 1990-10-04 | 1996-08-07 | 大日本スクリーン製造株式会社 | Method and automatic setup device for modifying setup parameter determination characteristics |
JP3877385B2 (en) * | 1997-07-04 | 2007-02-07 | 大日本スクリーン製造株式会社 | Image processing parameter determination apparatus and method |
CN1307523C (en) * | 2001-03-15 | 2007-03-28 | 精工爱普生株式会社 | Printing control and image processing control |
-
2015
- 2015-11-13 US US14/940,164 patent/US10003814B2/en active Active - Reinstated
-
2016
- 2016-04-25 CN CN201610260372.7A patent/CN106131392A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040012694A1 (en) * | 1997-04-09 | 2004-01-22 | Pentax Corporation | Image correction information recording device |
US20070250893A1 (en) * | 2006-04-03 | 2007-10-25 | Yasuhiro Akiyama | Digital broadcasting receiving apparatus |
US20140115536A1 (en) * | 2011-06-21 | 2014-04-24 | Nikon Corporation | Display program and display device |
US20150077603A1 (en) * | 2012-05-31 | 2015-03-19 | Olympus Imaging Corp. | Imaging device, image processing device, recording medium in which image file is recorded, recording method, image playback method, and computer-readable recording medium |
US20140333791A1 (en) * | 2013-05-07 | 2014-11-13 | Canon Kabushiki Kaisha | Image capturing apparatus and control method thereof |
US20160316203A1 (en) * | 2015-04-27 | 2016-10-27 | Harmonic, Inc. | Adaptive pre-filtering based on video complexity and output bit rate |
Also Published As
Publication number | Publication date |
---|---|
CN106131392A (en) | 2016-11-16 |
US20160330350A1 (en) | 2016-11-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020038069A1 (en) | Exposure control method and device, and electronic apparatus | |
US9432579B1 (en) | Digital image processing | |
WO2020038072A1 (en) | Exposure control method and device, and electronic device | |
US8154634B2 (en) | Image processing device that merges a plurality of images together, image shooting device provided therewith, and image processing method in which a plurality of images are merged together | |
KR101858646B1 (en) | Apparatus and method for fusion of image | |
JP5213670B2 (en) | Imaging apparatus and blur correction method | |
US8559751B2 (en) | Method and device for removing motion blur effects | |
US10257449B2 (en) | Pre-processing for video noise reduction | |
US10003814B2 (en) | Image processor, display image processing method and associated electronic device | |
US10356311B2 (en) | Method and apparatus for performing image processing operation based on frame/algorithm selection | |
US9973707B2 (en) | Image processing method and apparatus and system for dynamically adjusting frame rate | |
US11637960B2 (en) | Image processing apparatus, image processing method, and storage medium | |
US20160301857A1 (en) | Image processing method and apparatus | |
US11032483B2 (en) | Imaging apparatus, imaging method, and program | |
JP2022179514A (en) | Control apparatus, imaging apparatus, control method, and program | |
US8223223B2 (en) | Image sensing apparatus and image sensing method | |
US9007492B2 (en) | Image processing device and imaging device | |
US8451356B2 (en) | System and method for correcting artifacts in sequential imagers caused by transient light disturbances | |
TW200929071A (en) | Image processing method and image capture apparatusapplying the same | |
JP2010183460A (en) | Image capturing apparatus and method of controlling the same | |
US10298889B2 (en) | Image processing apparatus, image processing method, and storage medium | |
US20130222655A1 (en) | Image capture system and image processing method applied to an image capture system | |
JP2006180078A (en) | Electronic camera, image processor and image processing program | |
US20100053448A1 (en) | Systems and methods for picture enhancement | |
US20080013856A1 (en) | Method for obtaining high snr image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIN, YU-MAO;CHANG, TE-HAO;CHEN, YING-JUI;REEL/FRAME:037029/0375 Effective date: 20151111 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: XUESHAN TECHNOLOGIES INC., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MEDIATEK INC.;REEL/FRAME:056593/0167 Effective date: 20201223 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20220619 |
|
PRDP | Patent reinstated due to the acceptance of a late maintenance fee |
Effective date: 20221104 |
|
FEPP | Fee payment procedure |
Free format text: PETITION RELATED TO MAINTENANCE FEES FILED (ORIGINAL EVENT CODE: PMFP); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PETITION RELATED TO MAINTENANCE FEES GRANTED (ORIGINAL EVENT CODE: PMFG); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: SURCHARGE, PETITION TO ACCEPT PYMT AFTER EXP, UNINTENTIONAL (ORIGINAL EVENT CODE: M1558); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |