EP3913914A4 - Display device having 3d camera module and electronic device - Google Patents

Display device having 3d camera module and electronic device Download PDF

Info

Publication number
EP3913914A4
EP3913914A4 EP20748003.9A EP20748003A EP3913914A4 EP 3913914 A4 EP3913914 A4 EP 3913914A4 EP 20748003 A EP20748003 A EP 20748003A EP 3913914 A4 EP3913914 A4 EP 3913914A4
Authority
EP
European Patent Office
Prior art keywords
camera module
display device
electronic device
electronic
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20748003.9A
Other languages
German (de)
French (fr)
Other versions
EP3913914A1 (en
EP3913914B1 (en
Inventor
Zhu Li
Fanglu Lyu
Wang Bo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Guangjian Technology Co Ltd
Original Assignee
Shenzhen Guangjian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Guangjian Technology Co Ltd filed Critical Shenzhen Guangjian Technology Co Ltd
Publication of EP3913914A1 publication Critical patent/EP3913914A1/en
Publication of EP3913914A4 publication Critical patent/EP3913914A4/en
Application granted granted Critical
Publication of EP3913914B1 publication Critical patent/EP3913914B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/521Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/50Transmitters
    • H04B10/501Structural aspects
    • H04B10/503Laser transmitters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/25Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/254Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/271Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226Determination of depth image, e.g. for foreground/background separation

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Electromagnetism (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP20748003.9A 2019-01-17 2020-01-08 Display device having 3d camera module and electronic device Active EP3913914B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910044209 2019-01-17
PCT/CN2020/070826 WO2020156064A1 (en) 2019-01-17 2020-01-08 Display device having 3d camera module and electronic device

Publications (3)

Publication Number Publication Date
EP3913914A1 EP3913914A1 (en) 2021-11-24
EP3913914A4 true EP3913914A4 (en) 2022-03-02
EP3913914B1 EP3913914B1 (en) 2022-12-14

Family

ID=67593259

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20748003.9A Active EP3913914B1 (en) 2019-01-17 2020-01-08 Display device having 3d camera module and electronic device

Country Status (4)

Country Link
US (2) US10931860B2 (en)
EP (1) EP3913914B1 (en)
CN (7) CN210093396U (en)
WO (1) WO2020156064A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10690752B2 (en) * 2018-07-16 2020-06-23 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
CN210093396U (en) 2019-01-17 2020-02-18 深圳市光鉴科技有限公司 A3D camera module and electronic equipment for under screen
CN113532266B (en) * 2020-04-15 2023-08-08 深圳市光鉴科技有限公司 Box volume measuring method, system, equipment and storage medium based on three-dimensional vision
CN113532265B (en) * 2020-04-15 2023-08-08 深圳市光鉴科技有限公司 Box volume measuring device based on three-dimensional vision
US11269075B2 (en) * 2020-04-17 2022-03-08 Samsung Electronics Co., Ltd. Hybrid sensor system and method for providing 3D imaging
CN111678457B (en) * 2020-05-08 2021-10-01 西安交通大学 ToF device under OLED transparent screen and distance measuring method
CN111739428B (en) * 2020-07-23 2022-04-22 维沃移动通信有限公司 Display module and display device
CN113625462B (en) * 2021-09-13 2023-01-06 江西欧迈斯微电子有限公司 Diffractive optical element, projection module, and electronic apparatus
CN114280628A (en) * 2022-03-03 2022-04-05 荣耀终端有限公司 Sensor module and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9577406B2 (en) * 2014-06-27 2017-02-21 Microsoft Technology Licensing, Llc Edge-emitting laser diode package comprising heat spreader
CN108627936A (en) * 2018-04-10 2018-10-09 Oppo广东移动通信有限公司 Laser projection structure and electronic device
CN109143607A (en) * 2018-09-17 2019-01-04 深圳奥比中光科技有限公司 It compensates display screen, shield lower optical system and electronic equipment

Family Cites Families (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4329876A (en) 1980-06-03 1982-05-18 International Business Machines Corporation Method and apparatus for acoustic scanning using bulk wave scattering of bulk waves by an acoustic grating
US4945408A (en) * 1987-06-26 1990-07-31 Antonio Medina Three dimensional stereoscopic video system with a single image sensor
US5138687A (en) 1989-09-26 1992-08-11 Omron Corporation Rib optical waveguide and method of manufacturing the same
GB2309609A (en) 1996-01-26 1997-07-30 Sharp Kk Observer tracking autostereoscopic directional display
EP1443320A3 (en) 1997-09-10 2005-02-02 Artificial Sensing Instruments ASI AG Sensor chip for characterising a chemical and/or biochemical substance
US6684007B2 (en) 1998-10-09 2004-01-27 Fujitsu Limited Optical coupling structures and the fabrication processes
US6785447B2 (en) 1998-10-09 2004-08-31 Fujitsu Limited Single and multilayer waveguides and fabrication process
US7203386B2 (en) 2004-09-21 2007-04-10 Corning Incorporated Self-referencing waveguide grating sensors
US8220318B2 (en) 2005-06-17 2012-07-17 Georgia Tech Research Corporation Fast microscale actuators for probe microscopy
US8050461B2 (en) * 2005-10-11 2011-11-01 Primesense Ltd. Depth-varying light fields for three dimensional sensing
US8022977B2 (en) * 2005-10-17 2011-09-20 I2Ic Corporation Camera placed behind a display with a transparent backlight
WO2007138543A2 (en) * 2006-05-25 2007-12-06 Udayan Kanade Display with gaps for capturing images
US8872085B2 (en) 2006-10-06 2014-10-28 Qualcomm Mems Technologies, Inc. Display device having front illuminator with turning features
DE102007024349A1 (en) 2007-05-24 2008-11-27 Dr. Johannes Heidenhain Gmbh Optical position measuring device
US8384997B2 (en) 2008-01-21 2013-02-26 Primesense Ltd Optical pattern projection
WO2009102733A2 (en) 2008-02-12 2009-08-20 Qualcomm Mems Technologies, Inc. Integrated front light diffuser for reflective displays
US20090219253A1 (en) 2008-02-29 2009-09-03 Microsoft Corporation Interactive Surface Computer with Switchable Diffuser
TW200938877A (en) 2008-03-07 2009-09-16 Wintek Corp Image display device and illumination control device therefor
US8408775B1 (en) 2008-03-12 2013-04-02 Fusion Optix, Inc. Light recycling directional control element and light emitting device using the same
US8042949B2 (en) 2008-05-02 2011-10-25 Microsoft Corporation Projection of images onto tangible user interfaces
JP2011119434A (en) 2009-12-03 2011-06-16 Renesas Electronics Corp Semiconductor laser device and method of manufacturing the same
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
US9110200B2 (en) 2010-04-16 2015-08-18 Flex Lighting Ii, Llc Illumination device comprising a film-based lightguide
US9036158B2 (en) 2010-08-11 2015-05-19 Apple Inc. Pattern projector
US9535537B2 (en) 2010-11-18 2017-01-03 Microsoft Technology Licensing, Llc Hover detection in an interactive display device
US20140049983A1 (en) 2010-11-18 2014-02-20 Anthony John Nichol Light emitting device comprising a lightguide film and aligned coupling lightguides
US9179134B2 (en) 2011-01-18 2015-11-03 Disney Enterprises, Inc. Multi-layer plenoptic displays that combine multiple emissive and light modulating planes
US9083905B2 (en) 2011-04-26 2015-07-14 Semiconductor Components Industries, Llc Structured light imaging system
US20130027548A1 (en) * 2011-07-28 2013-01-31 Apple Inc. Depth perception device and system
US8749796B2 (en) 2011-08-09 2014-06-10 Primesense Ltd. Projectors of structured light
US9097826B2 (en) 2011-10-08 2015-08-04 Svv Technology Innovations, Inc. Collimating illumination systems employing a waveguide
US9318877B2 (en) 2012-03-01 2016-04-19 Iee International Electronics & Engineering S.A. Compact laser source for active illumination for hybrid three-dimensional imagers
US9459461B2 (en) 2012-05-31 2016-10-04 Leia Inc. Directional backlight
EP2912405B1 (en) * 2012-10-29 2017-10-18 7D Surgical Inc. Integrated illumination and optical surface topology detection system and methods of use thereof
US9398287B2 (en) * 2013-02-28 2016-07-19 Google Technology Holdings LLC Context-based depth sensor control
KR101695821B1 (en) * 2013-03-25 2017-01-13 엘지전자 주식회사 Depth image obtaining device and display device using same
US9575352B2 (en) 2013-07-23 2017-02-21 3M Innovative Properties Company Addressable switchable transparent display
US9392219B2 (en) * 2013-07-31 2016-07-12 Howlett-Packard Development Company, L.P. Display-camera system
CN103458073B (en) * 2013-08-23 2015-12-23 深圳欧菲光科技股份有限公司 Contact panel, touching display screen and mobile phone thereof
US9462253B2 (en) * 2013-09-23 2016-10-04 Microsoft Technology Licensing, Llc Optical modules that reduce speckle contrast and diffraction artifacts
US9769459B2 (en) * 2013-11-12 2017-09-19 Microsoft Technology Licensing, Llc Power efficient laser diode driver circuit and method
KR20150057011A (en) * 2013-11-18 2015-05-28 삼성전자주식회사 A camera intergrated with a light source
US9456201B2 (en) * 2014-02-10 2016-09-27 Microsoft Technology Licensing, Llc VCSEL array for a depth camera
GB2526158B (en) 2014-05-16 2017-12-20 Two Trees Photonics Ltd Imaging device for moving a virtual image
KR102214345B1 (en) 2015-01-10 2021-02-09 레이아 인코포레이티드 Two-dimensional/three-dimensional(2d/3d) switchable display backlight and electronic display
EP3283923B1 (en) 2015-03-30 2020-05-13 LEIA Inc. 2d/3d mode-switchable electronic display with dual layer backlight
WO2016171705A1 (en) 2015-04-23 2016-10-27 Leia Inc. Dual light guide grating-based backlight and electronic display using same
CN107624163B (en) 2015-05-09 2020-11-06 镭亚股份有限公司 Backlight based on color scanning grating and electronic display using same
US10721420B2 (en) * 2015-06-02 2020-07-21 Intel Corporation Method and system of adaptable exposure control and light projection for cameras
KR102311688B1 (en) * 2015-06-17 2021-10-12 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN108027532A (en) 2015-09-05 2018-05-11 镭亚股份有限公司 Polychrome grating coupled backlights illuminate
US10802212B2 (en) 2015-09-05 2020-10-13 Leia Inc. Angular subpixel rendering multiview display using shifted multibeam elements
KR102475891B1 (en) * 2015-10-08 2022-12-12 삼성전자주식회사 Edge light emitting laser source, apparatus for obtaining 3D image having the same
US9930320B2 (en) * 2016-05-04 2018-03-27 Apple Inc. Resolving three dimensional spatial information using time-shared structured lighting that embeds digital communication
US10268268B1 (en) 2016-09-02 2019-04-23 Facebook Technologies, Llc Waveguide integrated eye tracking
US20180077430A1 (en) * 2016-09-09 2018-03-15 Barrie Hansen Cloned Video Streaming
CN106412434B (en) * 2016-10-11 2020-11-10 中国人民解放军陆军军官学院 Method for self-adapting brightness and focal length of laser vision-aid imaging image
US10254542B2 (en) 2016-11-01 2019-04-09 Microsoft Technology Licensing, Llc Holographic projector for a waveguide display
US10705214B2 (en) 2017-07-14 2020-07-07 Microsoft Technology Licensing, Llc Optical projector having switchable light emission patterns
JP2019053227A (en) * 2017-09-15 2019-04-04 シャープ株式会社 Photographing device
CN107678225A (en) * 2017-09-19 2018-02-09 深圳奥比中光科技有限公司 Structured light projection module based on high density VCSEL array light source
US11105677B2 (en) 2017-11-06 2021-08-31 Apple Inc. Electronic devices with switchable diffusers
CN108174180B (en) * 2018-01-02 2019-07-30 京东方科技集团股份有限公司 A kind of display device, display system and 3 D displaying method
CN108132573A (en) * 2018-01-15 2018-06-08 深圳奥比中光科技有限公司 Floodlighting module
CN108281880A (en) * 2018-02-27 2018-07-13 广东欧珀移动通信有限公司 Control method, control device, terminal, computer equipment and storage medium
WO2019218274A1 (en) * 2018-05-16 2019-11-21 深圳阜时科技有限公司 Light source module, image acquisition apparatus, identity recognition apparatus, and electronic device
CN109066288A (en) * 2018-05-30 2018-12-21 Oppo广东移动通信有限公司 Control system, the control method of terminal and laser projecting apparatus of laser projecting apparatus
CN108828786A (en) * 2018-06-21 2018-11-16 深圳市光鉴科技有限公司 A kind of 3D camera
US10545275B1 (en) 2018-07-16 2020-01-28 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
US10345506B1 (en) 2018-07-16 2019-07-09 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
CN109313703B (en) * 2018-08-15 2022-02-08 深圳市汇顶科技股份有限公司 Optical fingerprint identification system under screen, backlight module, display screen and electronic equipment
CN109188711B (en) * 2018-09-17 2020-11-03 深圳奥比中光科技有限公司 Under-screen optical system, design method of diffractive optical element, and electronic apparatus
CN109218588B (en) * 2018-10-31 2020-04-03 Oppo广东移动通信有限公司 Image acquisition method, image acquisition device, structured light assembly and electronic device
CN109167905B (en) * 2018-10-31 2020-07-31 Oppo广东移动通信有限公司 Image acquisition method, image acquisition device, structured light assembly and electronic device
CN109167904B (en) * 2018-10-31 2020-04-28 Oppo广东移动通信有限公司 Image acquisition method, image acquisition device, structured light assembly and electronic device
CN210093396U (en) 2019-01-17 2020-02-18 深圳市光鉴科技有限公司 A3D camera module and electronic equipment for under screen
CN110213559A (en) * 2019-05-24 2019-09-06 深圳市光鉴科技有限公司 Display device and electronic equipment with 3D camera module

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9577406B2 (en) * 2014-06-27 2017-02-21 Microsoft Technology Licensing, Llc Edge-emitting laser diode package comprising heat spreader
CN108627936A (en) * 2018-04-10 2018-10-09 Oppo广东移动通信有限公司 Laser projection structure and electronic device
CN109143607A (en) * 2018-09-17 2019-01-04 深圳奥比中光科技有限公司 It compensates display screen, shield lower optical system and electronic equipment

Also Published As

Publication number Publication date
CN210168142U (en) 2020-03-20
EP3913914A1 (en) 2021-11-24
CN210093396U (en) 2020-02-18
WO2020156064A1 (en) 2020-08-06
CN110149510A (en) 2019-08-20
US20210136268A1 (en) 2021-05-06
US20200275000A1 (en) 2020-08-27
CN110166761A (en) 2019-08-23
CN210168143U (en) 2020-03-20
EP3913914B1 (en) 2022-12-14
US10931860B2 (en) 2021-02-23
CN113840129A (en) 2021-12-24
CN110149510B (en) 2023-09-08
US11418689B2 (en) 2022-08-16
CN110290375A (en) 2019-09-27
CN110166761B (en) 2021-08-13

Similar Documents

Publication Publication Date Title
EP4040770A4 (en) Camera module and electronic device
EP3913914A4 (en) Display device having 3d camera module and electronic device
EP4044573A4 (en) Photographing module and electronic device
EP3920522A4 (en) Camera module and electronic device
EP3997689A4 (en) Display module and electronic device including the same
EP4030233A4 (en) Periscopic camera module and electronic device
EP4057611A4 (en) Camera module and electronic device
EP3879806A4 (en) Imaging module and electronic apparatus
EP3979100A4 (en) Image display method and electronic device
EP4040771A4 (en) Photographing module and electronic device
EP4057610A4 (en) Camera module and electronic device
EP3605177A4 (en) Split lens and camera module and electronic apparatus
EP4043949A4 (en) Display module and electronic device
EP3767937A4 (en) Camera module and electronic device
EP3832362A4 (en) Display module and display device
EP3582117A4 (en) Image display method and electronic device
EP4005192A4 (en) Electronic device including display and camera device
EP3977714A4 (en) Electronic device including camera module
EP3445033A4 (en) Compound-eye camera module and electronic device
EP4020944A4 (en) Camera module and electronic device
EP3743944A4 (en) Led display and electronic device having same
EP4024112A4 (en) Lens module and electronic device
EP4047917A4 (en) Camera module and electronic device
EP4111503A4 (en) Electronic device including display and camera
EP4063947A4 (en) Display module and electronic device

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210816

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

A4 Supplementary search report drawn up and despatched

Effective date: 20220128

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 5/222 20060101ALI20220124BHEP

Ipc: H04B 10/50 20130101ALI20220124BHEP

Ipc: H04N 13/271 20180101ALI20220124BHEP

Ipc: H04N 13/204 20180101ALI20220124BHEP

Ipc: G01B 11/25 20060101AFI20220124BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602020006960

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0013204000

Ipc: G01B0011250000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 5/222 20060101ALI20220701BHEP

Ipc: H04B 10/50 20130101ALI20220701BHEP

Ipc: H04N 13/271 20180101ALI20220701BHEP

Ipc: H04N 13/204 20180101ALI20220701BHEP

Ipc: G01B 11/25 20060101AFI20220701BHEP

INTG Intention to grant announced

Effective date: 20220727

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

RIN1 Information on inventor provided before grant (corrected)

Inventor name: WANG, BO

Inventor name: LYU, FANGLU

Inventor name: ZHU, LI

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020006960

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1537930

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230115

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20221214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230314

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1537930

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230315

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230414

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230414

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602020006960

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230108

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230131

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

26N No opposition filed

Effective date: 20230915

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230108

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240119

Year of fee payment: 5

Ref country code: GB

Payment date: 20240111

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221214

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240112

Year of fee payment: 5