EP3751833A4 - Single sensor-based dual-spectral camera system and image processing method - Google Patents

Single sensor-based dual-spectral camera system and image processing method Download PDF

Info

Publication number
EP3751833A4
EP3751833A4 EP18904907.5A EP18904907A EP3751833A4 EP 3751833 A4 EP3751833 A4 EP 3751833A4 EP 18904907 A EP18904907 A EP 18904907A EP 3751833 A4 EP3751833 A4 EP 3751833A4
Authority
EP
European Patent Office
Prior art keywords
image processing
processing method
camera system
single sensor
spectral camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18904907.5A
Other languages
German (de)
French (fr)
Other versions
EP3751833C0 (en
EP3751833A1 (en
EP3751833B1 (en
Inventor
Yue Sun
Duoming CHEN
Hengle YU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Uniview Technologies Co Ltd
Original Assignee
Zhejiang Uniview Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Uniview Technologies Co Ltd filed Critical Zhejiang Uniview Technologies Co Ltd
Publication of EP3751833A1 publication Critical patent/EP3751833A1/en
Publication of EP3751833A4 publication Critical patent/EP3751833A4/en
Application granted granted Critical
Publication of EP3751833C0 publication Critical patent/EP3751833C0/en
Publication of EP3751833B1 publication Critical patent/EP3751833B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/72—Combination of two or more compensation controls
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
    • H04N25/705—Pixels for depth measurement, e.g. RGBZ
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)
  • Measurement Of Optical Distance (AREA)
EP18904907.5A 2018-02-11 2018-10-17 Single sensor-based dual-spectral camera system and image processing method Active EP3751833B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810143997.4A CN108965654B (en) 2018-02-11 2018-02-11 Double-spectrum camera system based on single sensor and image processing method
PCT/CN2018/110685 WO2019153787A1 (en) 2018-02-11 2018-10-17 Single sensor-based dual-spectral camera system and image processing method

Publications (4)

Publication Number Publication Date
EP3751833A1 EP3751833A1 (en) 2020-12-16
EP3751833A4 true EP3751833A4 (en) 2021-09-22
EP3751833C0 EP3751833C0 (en) 2023-07-12
EP3751833B1 EP3751833B1 (en) 2023-07-12

Family

ID=64495785

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18904907.5A Active EP3751833B1 (en) 2018-02-11 2018-10-17 Single sensor-based dual-spectral camera system and image processing method

Country Status (7)

Country Link
US (1) US11252345B2 (en)
EP (1) EP3751833B1 (en)
CN (1) CN108965654B (en)
ES (1) ES2953107T3 (en)
HU (1) HUE063697T2 (en)
PL (1) PL3751833T3 (en)
WO (1) WO2019153787A1 (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109493309A (en) * 2018-11-20 2019-03-19 北京航空航天大学 A kind of infrared and visible images variation fusion method keeping conspicuousness information
FR3091114B1 (en) * 2018-12-19 2021-06-11 Valeo Comfort & Driving Assistance image capture device and associated driver monitoring system
KR20200090347A (en) * 2019-01-21 2020-07-29 엘지전자 주식회사 Camera device, and electronic apparatus including the same
CN110493579B (en) * 2019-03-14 2022-07-29 杭州海康威视数字技术股份有限公司 Color fog penetration method and device, camera and image processing system
CN111951200B (en) * 2019-05-15 2023-11-14 杭州海康威视数字技术股份有限公司 Image pickup apparatus, image fusion method, image fusion device, and storage medium
CN110493493B (en) * 2019-05-31 2022-04-29 杭州海康威视数字技术股份有限公司 Panoramic detail camera and method for acquiring image signal
CN110493495B (en) * 2019-05-31 2022-03-08 杭州海康威视数字技术股份有限公司 Image acquisition device and image acquisition method
CN110493494B (en) * 2019-05-31 2021-02-26 杭州海康威视数字技术股份有限公司 Image fusion device and image fusion method
CN110445961A (en) * 2019-07-10 2019-11-12 中山联合光电科技股份有限公司 A kind of adjustable camera system of double light
CN110445963A (en) * 2019-07-10 2019-11-12 中山联合光电科技股份有限公司 A kind of more light camera systems
CN110460753A (en) * 2019-07-10 2019-11-15 中山联合光电科技股份有限公司 A kind of more light camera systems of adjustable light path
CN110413836A (en) * 2019-07-18 2019-11-05 湖南宏动光电有限公司 A kind of panorama search system
WO2021016900A1 (en) * 2019-07-31 2021-02-04 华为技术有限公司 Image sensor and image photosensing method
CN112584109A (en) * 2019-09-30 2021-03-30 长城汽车股份有限公司 Vehicle image pickup device and vehicle image processing method
CN111144222A (en) * 2019-12-03 2020-05-12 宁波华高信息科技有限公司 Data acquisition and counterfeit discrimination method based on multi-light-source sensing device
CN111064899B (en) * 2019-12-06 2021-06-08 成都华为技术有限公司 Exposure parameter adjusting method and device
US10951869B1 (en) * 2019-12-11 2021-03-16 Karl Storz Imaging, Inc. System for optimizing blended video streams
CN110840386A (en) * 2019-12-19 2020-02-28 中国科学院长春光学精密机械与物理研究所 Visible light and near-infrared fluorescence 3D common imaging endoscope system based on single detector
CN111007020B (en) * 2019-12-23 2021-10-08 武汉呵尔医疗科技发展有限公司 Double-frame four-spectrum imaging method and application
CN113271414B (en) * 2020-02-14 2022-11-18 上海海思技术有限公司 Image acquisition method and device
EP4131916A4 (en) * 2020-04-29 2023-05-17 Huawei Technologies Co., Ltd. Camera and image acquisition method
CN111738969A (en) * 2020-06-19 2020-10-02 无锡英菲感知技术有限公司 Image fusion method and device and computer readable storage medium
JP2022029026A (en) * 2020-08-04 2022-02-17 キヤノン株式会社 Imaging apparatus
CN114125188A (en) * 2020-08-26 2022-03-01 信泰光学(深圳)有限公司 Lens device
US11689822B2 (en) * 2020-09-04 2023-06-27 Altek Semiconductor Corp. Dual sensor imaging system and privacy protection imaging method thereof
CN114143418B (en) * 2020-09-04 2023-12-01 聚晶半导体股份有限公司 Dual-sensor imaging system and imaging method thereof
US11568526B2 (en) 2020-09-04 2023-01-31 Altek Semiconductor Corp. Dual sensor imaging system and imaging method thereof
CN113179379B (en) * 2021-04-22 2023-03-24 太原理工大学 Visual sensor based on single sensitive device for visible light and near infrared imaging
CN113286094B (en) * 2021-05-27 2022-06-24 重庆紫光华山智安科技有限公司 Automatic image exposure method, device, equipment and medium
CN113411501B (en) * 2021-06-29 2022-06-07 杭州晶耐科光电技术有限公司 Embedded and dual-spectrum imaging-based unmanned aerial vehicle-mounted electric power inspection method and system
CN113786179A (en) * 2021-09-27 2021-12-14 北方工业大学 Human body blood pressure real-time measuring method and device with infrared and optical image fusion
CN114143427A (en) * 2021-11-23 2022-03-04 歌尔科技有限公司 Camera assembly, mobile terminal and camera-based body temperature measuring method
JP2023090492A (en) * 2021-12-17 2023-06-29 キヤノン株式会社 Image processing device, image processing method, and imaging apparatus
CN114422671A (en) * 2021-12-30 2022-04-29 中电海康集团有限公司 Double-spectrum camera based on FPGA
CN116962886A (en) * 2022-04-07 2023-10-27 安霸国际有限合伙企业 Intelligent automatic exposure control for RGB-IR sensor
CN114710611A (en) * 2022-04-11 2022-07-05 东莞理工学院 Confocal high definition surveillance camera head of day night
CN115174794B (en) * 2022-08-11 2023-09-22 哈尔滨工业大学（深圳） Double-light fusion imaging chip and double-light picture fusion processing method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040256561A1 (en) * 2003-06-17 2004-12-23 Allyson Beuhler Wide band light sensing pixel array
US20150200220A1 (en) * 2014-01-14 2015-07-16 Microsoft Corporation Image sensing system
US20160344965A1 (en) * 2012-04-18 2016-11-24 Brightway Vision Ltd. Controllable gated sensor
WO2017159041A1 (en) * 2016-03-14 2017-09-21 ソニー株式会社 Signal processing apparatus, image pickup apparatus, and signal processing method

Family Cites Families (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4385284B2 (en) * 2003-12-24 2009-12-16 ソニー株式会社 Imaging apparatus and imaging method
US7809426B2 (en) * 2004-04-29 2010-10-05 The Cleveland Clinic Foundation Acquiring contrast-enhanced, T1 weighted, cine magnetic resonance images
DE602006006582D1 (en) * 2005-08-08 2009-06-10 Mep Imaging Technologies Ltd ADAPTIVE EXPOSURE CONTROL
US8446480B2 (en) * 2006-12-20 2013-05-21 Nokia Corporation Exposure control based on image sensor cost function
US8446470B2 (en) * 2007-10-04 2013-05-21 Magna Electronics, Inc. Combined RGB and IR imaging sensor
JP2010093472A (en) * 2008-10-07 2010-04-22 Panasonic Corp Imaging apparatus, and signal processing circuit for the same
JP5547717B2 (en) * 2009-04-07 2014-07-16 ローム株式会社 Photoelectric conversion device and imaging device
EP2471258B1 (en) 2009-08-25 2017-05-24 Dual Aperture International Co. Ltd. Reducing noise in a color image
US8692198B2 (en) * 2010-04-21 2014-04-08 Sionyx, Inc. Photosensitive imaging devices and associated methods
US20110317048A1 (en) * 2010-06-29 2011-12-29 Aptina Imaging Corporation Image sensor with dual layer photodiode structure
US8581995B2 (en) * 2011-01-25 2013-11-12 Aptina Imaging Corporation Method and apparatus for parallax correction in fused array imaging systems
US9819879B2 (en) * 2011-07-12 2017-11-14 Samsung Electronics Co., Ltd. Image filtering apparatus and method based on noise prediction using infrared ray (IR) intensity
JP2014078052A (en) * 2012-10-09 2014-05-01 Sony Corp Authentication apparatus, authentication method, and program
US9348019B2 (en) * 2012-11-20 2016-05-24 Visera Technologies Company Limited Hybrid image-sensing apparatus having filters permitting incident light in infrared region to be passed to time-of-flight pixel
KR101744761B1 (en) * 2012-11-30 2017-06-09 한화테크윈 주식회사 Method and Apparatus for processing image
JP6490675B2 (en) * 2013-10-07 2019-03-27 グーグル エルエルシー Smart home hazard detector that gives a non-alarm status signal at the right moment
KR102241706B1 (en) * 2013-11-13 2021-04-19 엘지전자 주식회사 3 dimensional camera and method for controlling the same
US9392262B2 (en) * 2014-03-07 2016-07-12 Aquifi, Inc. System and method for 3D reconstruction using multiple multi-channel cameras
US20150287766A1 (en) * 2014-04-02 2015-10-08 Tae-Chan Kim Unit pixel of an image sensor and image sensor including the same
US9516295B2 (en) * 2014-06-30 2016-12-06 Aquifi, Inc. Systems and methods for multi-channel imaging based on multiple exposure settings
KR101637671B1 (en) * 2014-08-25 2016-07-07 현대자동차주식회사 Method for extracting RGB and NIR using RGBW sensor
JP6568719B2 (en) * 2014-08-29 2019-08-28 株式会社 日立産業制御ソリューションズ Imaging method and imaging apparatus
US9866764B2 (en) * 2014-11-21 2018-01-09 Motorola Mobility Llc Method and apparatus for synchronizing auto exposure between chromatic pixels and panchromatic pixels in a camera system
CN104639923B (en) * 2015-02-04 2017-08-04 华为技术有限公司 A kind of method handled view data, device and terminal
CN104683767B (en) * 2015-02-10 2018-03-06 浙江宇视科技有限公司 Penetrating Fog image generating method and device
CN105988215B (en) 2015-02-15 2020-03-06 宁波舜宇光电信息有限公司 Multispectral module imaging system and manufacturing method and application thereof
US10145678B2 (en) * 2015-04-20 2018-12-04 Samsung Electronics Co., Ltd. CMOS image sensor for depth measurement using triangulation with point scan
CN104822033B (en) * 2015-05-05 2017-09-01 太原理工大学 A kind of infrared vision sensor and its application method with visual image fusion
CN105049829B (en) 2015-07-10 2018-12-25 上海图漾信息科技有限公司 Optical filter, imaging sensor, imaging device and 3-D imaging system
US10453185B2 (en) * 2015-11-12 2019-10-22 Aquifi, Inc. System and method for high dynamic range depth capture using multiple cameras
US10056417B2 (en) * 2016-03-10 2018-08-21 Visera Technologies Company Limited Image-sensor structures
CN107438170B (en) * 2016-05-25 2020-01-17 杭州海康威视数字技术股份有限公司 Image fog penetration method and image acquisition equipment for realizing image fog penetration
US10638060B2 (en) * 2016-06-28 2020-04-28 Intel Corporation Color correction of RGBIR sensor stream based on resolution recovery of RGB and IR channels
CN106060364A (en) * 2016-07-28 2016-10-26 浙江宇视科技有限公司 Optical fog-penetrating color image acquisition method and camera
CN106375740B (en) * 2016-09-28 2018-02-06 华为技术有限公司 Generate the methods, devices and systems of RGB image
CN106488209A (en) * 2016-09-29 2017-03-08 杭州雄迈集成电路技术有限公司 A kind of color calibration method of the RGB IR imageing sensor based on infrared environmental
CN106572289B (en) * 2016-10-21 2019-08-20 维沃移动通信有限公司 A kind of image processing method and mobile terminal of camera module
US20180295336A1 (en) * 2017-04-11 2018-10-11 Himax Imaging Limited IMAGING SYSTEM FOR SENSING 3D image
US20180309919A1 (en) * 2017-04-19 2018-10-25 Qualcomm Incorporated Methods and apparatus for controlling exposure and synchronization of image sensors
WO2018208791A1 (en) * 2017-05-08 2018-11-15 Aquifi, Inc. Systems and methods for inspection and defect detection using 3-d scanning
US10116925B1 (en) * 2017-05-16 2018-10-30 Samsung Electronics Co., Ltd. Time-resolving sensor using shared PPD + SPAD pixel and spatial-temporal correlation for range measurement
CN110809881B (en) * 2018-08-31 2021-08-24 深圳市大疆创新科技有限公司 Image processing system and method
CN113168669B (en) * 2018-09-18 2024-03-29 浙江宇视科技有限公司 Image processing method, device, electronic equipment and readable storage medium
DE102019123356A1 (en) * 2019-08-30 2021-03-04 Schölly Fiberoptic GmbH Sensor arrangement, method for calculating a color image and a hyperspectral image, method for carrying out a white balance and use of the sensor arrangement in medical imaging
KR20210077901A (en) * 2019-12-18 2021-06-28 엘지전자 주식회사 Apparatus and Method for Obtaining Image
US11069104B1 (en) * 2020-05-13 2021-07-20 Facebook Technologies, Llc Display that uses a light sensor to generate environmentally matched artificial reality content

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040256561A1 (en) * 2003-06-17 2004-12-23 Allyson Beuhler Wide band light sensing pixel array
US20160344965A1 (en) * 2012-04-18 2016-11-24 Brightway Vision Ltd. Controllable gated sensor
US20150200220A1 (en) * 2014-01-14 2015-07-16 Microsoft Corporation Image sensing system
WO2017159041A1 (en) * 2016-03-14 2017-09-21 ソニー株式会社 Signal processing apparatus, image pickup apparatus, and signal processing method
US20190124271A1 (en) * 2016-03-14 2019-04-25 Sony Corporation Signal processing apparatus, imaging pickup apparatus, and signal processing method

Also Published As

Publication number Publication date
ES2953107T3 (en) 2023-11-08
HUE063697T2 (en) 2024-01-28
US20210044763A1 (en) 2021-02-11
EP3751833C0 (en) 2023-07-12
CN108965654B (en) 2020-12-25
WO2019153787A1 (en) 2019-08-15
US11252345B2 (en) 2022-02-15
EP3751833A1 (en) 2020-12-16
EP3751833B1 (en) 2023-07-12
PL3751833T3 (en) 2023-12-18
CN108965654A (en) 2018-12-07

Similar Documents

Publication Publication Date Title
EP3751833A4 (en) Single sensor-based dual-spectral camera system and image processing method
EP3823280A4 (en) Image processing device and method
EP3767954A4 (en) Image processing device and method
EP3780615A4 (en) Video image processing method and device
EP3859679A4 (en) Image processing device and image processing method
EP3797384A4 (en) Method and system for imaging and image processing
EP3742401A4 (en) Image processing device and method
EP3800616A4 (en) Image processing method and device
EP3780621A4 (en) Image processing device and image processing method
EP3700209A4 (en) Method and device for processing video image
EP3817387A4 (en) Image processing device and method
EP3803782A4 (en) Systems and methods for image processing
EP3823286A4 (en) Image processing device and method
EP3780613A4 (en) Image processing device and method
EP3949379A4 (en) Systems and methods for image processing
EP3698269A4 (en) An image processing method and system
EP3748341A4 (en) Image processing device and image processing method
EP4026310A4 (en) Systems and methods for image processing
EP3948766A4 (en) Systems and methods for image processing
EP3867809A4 (en) Methods and systems for processing an image
EP3651471A4 (en) Image processing system and image processing method
EP3796637A4 (en) Multi-computer cooperation-based image processing method and video monitoring system
EP3804604A4 (en) Camera apparatus, image processing method, and camera system
EP4066207A4 (en) Systems and methods for image processing
EP3843046A4 (en) Image processing device and method

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200810

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20210824

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/04 20060101ALI20210818BHEP

Ipc: H04N 5/235 20060101ALI20210818BHEP

Ipc: H04N 5/232 20060101ALI20210818BHEP

Ipc: H04N 5/265 20060101ALI20210818BHEP

Ipc: H04N 5/225 20060101ALI20210818BHEP

Ipc: H04N 5/33 20060101AFI20210818BHEP

REG Reference to a national code

Ref document number: 602018053425

Country of ref document: DE

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0005225000

Ipc: H04N0023110000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230203

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 23/80 20230101ALI20230120BHEP

Ipc: H04N 23/76 20230101ALI20230120BHEP

Ipc: H04N 23/73 20230101ALI20230120BHEP

Ipc: H04N 23/72 20230101ALI20230120BHEP

Ipc: H04N 23/71 20230101ALI20230120BHEP

Ipc: H04N 25/131 20230101ALI20230120BHEP

Ipc: H04N 23/11 20230101AFI20230120BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018053425

Country of ref document: DE

U01 Request for unitary effect filed

Effective date: 20230807

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20230810

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2953107

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20231108

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

U20 Renewal fee paid [unitary effect]

Year of fee payment: 6

Effective date: 20231024

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231013

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231020

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20231227

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231112

REG Reference to a national code

Ref country code: HU

Ref legal event code: AG4A

Ref document number: E063697

Country of ref document: HU

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230712

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231012

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231112

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230712

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231013

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20231016

Year of fee payment: 6

Ref country code: HU

Payment date: 20231024

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20231005

Year of fee payment: 6