CN113892254B - 显示器下方的图像传感器 - Google Patents

显示器下方的图像传感器 Download PDF

Info

Publication number
CN113892254B
CN113892254B CN202080040919.7A CN202080040919A CN113892254B CN 113892254 B CN113892254 B CN 113892254B CN 202080040919 A CN202080040919 A CN 202080040919A CN 113892254 B CN113892254 B CN 113892254B
Authority
CN
China
Prior art keywords
display
camera
image
light
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080040919.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN113892254A (zh
Inventor
R·J·戈夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Synaptics Inc
Original Assignee
Synaptics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Synaptics Inc filed Critical Synaptics Inc
Publication of CN113892254A publication Critical patent/CN113892254A/zh
Application granted granted Critical
Publication of CN113892254B publication Critical patent/CN113892254B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Input (AREA)
  • Image Processing (AREA)
CN202080040919.7A 2019-06-05 2020-05-22 显示器下方的图像传感器 Active CN113892254B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962857740P 2019-06-05 2019-06-05
US62/857740 2019-06-05
US16/654290 2019-10-16
US16/654,290 US11516374B2 (en) 2019-06-05 2019-10-16 Under-display image sensor
PCT/US2020/034301 WO2020247195A1 (en) 2019-06-05 2020-05-22 Under-display image sensor

Publications (2)

Publication Number Publication Date
CN113892254A CN113892254A (zh) 2022-01-04
CN113892254B true CN113892254B (zh) 2025-01-14

Family

ID=73650822

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080040919.7A Active CN113892254B (zh) 2019-06-05 2020-05-22 显示器下方的图像传感器

Country Status (5)

Country Link
US (1) US11516374B2 (https=)
JP (1) JP7564828B2 (https=)
KR (1) KR102775935B1 (https=)
CN (1) CN113892254B (https=)
WO (1) WO2020247195A1 (https=)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11575865B2 (en) 2019-07-26 2023-02-07 Samsung Electronics Co., Ltd. Processing images captured by a camera behind a display
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
WO2021092887A1 (en) * 2019-11-15 2021-05-20 Qualcomm Incorporated Display shade compensation for cameras
US11076080B2 (en) 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
US12372655B2 (en) * 2020-02-18 2025-07-29 Synaptics Incorporated Through-display time-of-flight (ToF) sensor
US12256154B2 (en) * 2020-05-08 2025-03-18 Sony Semiconductor Solutions Corporation Electronic device and imaging device with image data correction
KR102791013B1 (ko) * 2020-08-05 2025-04-02 삼성전자주식회사 이미지 센서를 포함하는 전자 장치
CN114125207A (zh) * 2020-08-31 2022-03-01 三星电子株式会社 图像传感器、图像获取设备和操作图像获取设备的方法
US11706520B2 (en) * 2020-10-12 2023-07-18 Qualcomm Incorporated Under-display camera and sensor control
WO2022093294A1 (en) * 2020-10-27 2022-05-05 Google Llc System and apparatus of under-display camera
DE112021006496T5 (de) * 2020-12-16 2023-11-23 Sony Group Corporation Anzeigevorrichtung, anzeigesteuerungsverfahren und programm
US11721001B2 (en) 2021-02-16 2023-08-08 Samsung Electronics Co., Ltd. Multiple point spread function based image reconstruction for a camera behind a display
US11588978B2 (en) 2021-02-19 2023-02-21 Qualcomm Incorporated Under-display camera systems and methods
US11722796B2 (en) * 2021-02-26 2023-08-08 Samsung Electronics Co., Ltd. Self-regularizing inverse filter for image deblurring
KR20220126924A (ko) * 2021-03-10 2022-09-19 삼성전자주식회사 디스플레이를 포함하는 전자 장치
KR102941945B1 (ko) * 2021-03-25 2026-03-20 삼성전자 주식회사 전자 장치 및 카메라의 원거리 성능 향상 방법
KR20220137459A (ko) * 2021-04-02 2022-10-12 삼성전자주식회사 기계 학습 기반 이미지 처리를 지원하기 위한 전자 장치
US11954833B2 (en) 2021-04-02 2024-04-09 Samsung Electronics Co., Ltd Electronic device for supporting machine learning-based image processing
KR20220141663A (ko) * 2021-04-13 2022-10-20 삼성전자주식회사 영상을 처리하는 방법 및 이를 수행하는 전자 장치
US12393765B2 (en) * 2021-08-06 2025-08-19 Samsung Electronics Co., Ltd. Automating search for improved display structure for under-display camera systems
US12453253B2 (en) 2021-08-10 2025-10-21 Samsung Electronics Co., Ltd. Electronic device including camera module
KR102901036B1 (ko) * 2021-08-10 2025-12-16 삼성전자 주식회사 카메라 모듈을 포함하는 전자 장치
US11765451B2 (en) * 2021-09-03 2023-09-19 Micron Technology, Inc. Image sensor selection
KR20230052041A (ko) 2021-10-12 2023-04-19 삼성전자주식회사 이미지를 제공하는 방법 및 이를 지원하는 전자 장치
US12216277B2 (en) 2021-10-14 2025-02-04 Samsung Electronics Co., Ltd. Optical element for deconvolution
US12482075B2 (en) 2022-06-08 2025-11-25 Samsung Electronics Co., Ltd. Restoring images using deconvolution
US12477203B2 (en) * 2022-06-13 2025-11-18 Samsung Electronics Co., Ltd. Method and apparatus with image quality improvement
US12450704B2 (en) 2022-10-11 2025-10-21 Samsung Electronics Co., Ltd. Machine learning model training using synthetic data for under-display camera (UDC) image restoration
US12511867B2 (en) 2022-10-11 2025-12-30 Samsung Electronics Co., Ltd. Machine learning model training using synthetic data for under-display camera (UDC) image restoration
US20250113097A1 (en) * 2023-09-28 2025-04-03 Samsung Electronics Co., Ltd. Reducing effects of light diffraction in under display camera (udc) systems

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018049201A1 (en) * 2016-09-09 2018-03-15 Google Llc Three-dimensional telepresence system

Family Cites Families (81)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07246184A (ja) 1994-03-09 1995-09-26 Fuji Photo Optical Co Ltd 面順次式撮像装置
GB2354389A (en) * 1999-09-15 2001-03-21 Sharp Kk Stereo images with comfortable perceived depth
US7239909B2 (en) 2000-01-19 2007-07-03 Luminetx Technologies Corp. Imaging system using diffuse infrared light
US7357509B2 (en) * 2003-04-28 2008-04-15 University Of Rochester Metrics to predict subjective impact of eye's wave aberration
US7519223B2 (en) 2004-06-28 2009-04-14 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
WO2006127967A2 (en) 2005-05-25 2006-11-30 Massachusetts Institute Of Technology Multifocal scanning microscopy systems and methods
WO2007138543A2 (en) 2006-05-25 2007-12-06 Udayan Kanade Display with gaps for capturing images
US7714923B2 (en) 2006-11-02 2010-05-11 Eastman Kodak Company Integrated display and capture apparatus
US7697053B2 (en) * 2006-11-02 2010-04-13 Eastman Kodak Company Integrated display having multiple capture devices
JP2010250789A (ja) * 2008-06-10 2010-11-04 Akira Tomono カメラ付き表示装置
US20100201808A1 (en) * 2009-02-09 2010-08-12 Microsoft Corporation Camera based motion sensing system
WO2011036813A1 (ja) * 2009-09-28 2011-03-31 株式会社 東芝 立体映像表示方法及び立体映像表示装置
WO2011047214A2 (en) * 2009-10-14 2011-04-21 Optimum Technologies, Inc. Portable retinal camera and image acquisition method
CN102812712B (zh) * 2010-03-24 2015-04-08 富士胶片株式会社 图像处理设备和图像处理方法
US9091903B2 (en) 2010-07-29 2015-07-28 Logitech Europe S.A. Optimized movable IR filter in cameras
US20120032875A1 (en) 2010-08-05 2012-02-09 Microvision, Inc. Scanned Image Projection System Employing Beam Folding Apparatus
KR101680762B1 (ko) 2010-10-29 2016-11-29 삼성전자주식회사 3ｄ 카메라용 빔스플리터 및 상기 빔스플리터를 채용한 3차원 영상 획득 장치
KR101632311B1 (ko) 2010-12-30 2016-06-22 삼성전자주식회사 패널 형태의 면 카메라, 이를 적용한 광 터치스크린 및 디스플레이 장치
KR20120080845A (ko) 2011-01-10 2012-07-18 삼성전자주식회사 광 감지 기능을 구비한 ｏｌｅｄ 디스플레이 장치
US9442346B2 (en) * 2011-01-28 2016-09-13 Windy Place, Inc. Lighting and power devices and modules
EP2692133B1 (en) 2011-03-31 2019-01-16 SMART Technologies ULC Video conferencing display device
JP5623982B2 (ja) * 2011-06-09 2014-11-12 株式会社ジャパンディスプレイ 半透過型表示装置及び電子機器
US8885882B1 (en) 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US20130080932A1 (en) * 2011-09-27 2013-03-28 Sanjiv Sirpal Secondary single screen mode activation through user interface toggle
US8937646B1 (en) * 2011-10-05 2015-01-20 Amazon Technologies, Inc. Stereo imaging using disparate imaging devices
US10848731B2 (en) * 2012-02-24 2020-11-24 Matterport, Inc. Capturing and aligning panoramic image and depth data
US10116919B2 (en) * 2012-11-14 2018-10-30 Thomson Licensing Method and arrangement for estimating at least one cross-channel colour mapping model from an set of tuples of corresponding colours relative to at least two images
US10368053B2 (en) * 2012-11-14 2019-07-30 Qualcomm Incorporated Structured light active depth sensing systems combining multiple images to compensate for differences in reflectivity and/or absorption
WO2015081325A1 (en) 2013-11-27 2015-06-04 Shenzhen Huiding Technology Co., Ltd. Eye tracking and user reaction detection
US9154697B2 (en) * 2013-12-06 2015-10-06 Google Inc. Camera selection based on occlusion of field of view
US9720506B2 (en) * 2014-01-14 2017-08-01 Microsoft Technology Licensing, Llc 3D silhouette sensing system
US9921688B2 (en) 2014-03-04 2018-03-20 Qualcomm Incorporated Large area interactive display screen
US9454699B2 (en) 2014-04-29 2016-09-27 Microsoft Technology Licensing, Llc Handling glare in eye tracking
CN105093541A (zh) * 2014-05-22 2015-11-25 华为技术有限公司 显示装置
CN105094307A (zh) 2014-05-23 2015-11-25 宇龙计算机通信科技(深圳)有限公司 一种具有前置摄像头的移动设备
US9638511B2 (en) 2014-08-08 2017-05-02 The Board Of Trustees Of The University Of Illinois Smart phone attachment for 3-D optical coherence tomography imaging
US9377623B2 (en) 2014-08-11 2016-06-28 Microsoft Technology Licensing, Llc Waveguide eye tracking employing volume Bragg grating
CN104318205A (zh) * 2014-09-29 2015-01-28 上海箩箕技术有限公司 信息检测显示装置及其检测方法和显示方法
WO2016064435A1 (en) 2014-10-24 2016-04-28 Usens, Inc. System and method for immersive and interactive multimedia generation
KR102309411B1 (ko) * 2014-10-27 2021-10-06 엘지전자 주식회사 휴대 전자기기
US9791924B2 (en) 2014-12-23 2017-10-17 Mediatek Inc. Eye tracking with mobile device in a head-mounted display
US10148918B1 (en) * 2015-04-06 2018-12-04 Position Imaging, Inc. Modular shelving systems for package tracking
US10043282B2 (en) * 2015-04-13 2018-08-07 Gerard Dirk Smits Machine vision for ego-motion, segmenting, and classifying objects
US10565734B2 (en) * 2015-04-15 2020-02-18 Google Llc Video capture, processing, calibration, computational fiber artifact removal, and light-field pipeline
KR20250035038A (ko) * 2015-04-19 2025-03-11 포토내이션 리미티드 Vr/ar 응용에서 심도 증강을 위한 다중-기선 카메라 어레이 시스템 아키텍처
CN107004130B (zh) 2015-06-18 2020-08-28 深圳市汇顶科技股份有限公司 用于屏幕上指纹感应的屏幕下光学传感器模块
JP6594101B2 (ja) * 2015-08-19 2019-10-23 キヤノン株式会社 画像処理装置、画像処理方法および画像処理プログラム
US10237473B2 (en) * 2015-09-04 2019-03-19 Apple Inc. Depth map calculation in a stereo camera system
US10523855B2 (en) 2015-09-24 2019-12-31 Intel Corporation Infrared and visible light dual sensor imaging system
CN108604116A (zh) 2015-09-24 2018-09-28 托比股份公司 能够进行眼睛追踪的可穿戴设备
US10169630B2 (en) * 2015-12-03 2019-01-01 Synaptics Incorporated Optical sensor for integration over a display backplane
US10152121B2 (en) 2016-01-06 2018-12-11 Facebook Technologies, Llc Eye tracking through illumination by head-mounted displays
JP6728714B2 (ja) 2016-01-28 2020-07-22 ブラザー工業株式会社 画像処理装置
US10268884B2 (en) 2016-01-29 2019-04-23 Synaptics Incorporated Optical fingerprint sensor under a display
US10217439B2 (en) 2016-02-04 2019-02-26 Apple Inc. Electronic device with ambient light sensor system
WO2017147614A1 (en) * 2016-02-26 2017-08-31 Essential Products, Inc. Image capture with a camera integrated display
US10462452B2 (en) * 2016-03-16 2019-10-29 Microsoft Technology Licensing, Llc Synchronizing active illumination cameras
WO2017161520A1 (zh) 2016-03-23 2017-09-28 徐鹤菲 支持近红外光与可见光成像的复合成像系统和移动终端
EP3465343A4 (en) * 2016-06-30 2020-07-29 Nokia Technologies Oy PROCESS AND APPARATUS FOR LIGHTING FOR CAPTURING PHOTOGRAPHIC IMAGES
US10311560B2 (en) 2016-09-07 2019-06-04 Huazhong University Of Science And Technology Method and system for estimating blur kernel size
US20180157908A1 (en) 2016-12-01 2018-06-07 Varjo Technologies Oy Gaze-tracking system and method of tracking user's gaze
US10120442B2 (en) 2016-12-21 2018-11-06 Oculus Vr, Llc Eye tracking using a light field camera on a head-mounted display
US10958841B2 (en) 2017-01-06 2021-03-23 Intel Corporation Integrated image sensor and display pixel
KR102736801B1 (ko) 2017-01-10 2024-12-04 삼성디스플레이 주식회사 표시 장치 및 그의 구동 방법
US10158845B2 (en) * 2017-01-18 2018-12-18 Facebook Technologies, Llc Tileable structured light projection for wide field-of-view depth sensing
US10872272B2 (en) 2017-04-13 2020-12-22 L'oreal System and method using machine learning for iris tracking, measurement, and simulation
US10567630B2 (en) * 2017-05-12 2020-02-18 Microsoft Technology Licensing, Llc Image capture using a hinged device with multiple cameras
JP2018195985A (ja) * 2017-05-17 2018-12-06 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
US10181200B1 (en) * 2017-06-28 2019-01-15 Facebook Technologies, Llc Circularly polarized illumination and detection for depth sensing
WO2019006749A1 (zh) 2017-07-07 2019-01-10 华为技术有限公司 一种具有摄像头的终端和拍摄方法
CA3071819A1 (en) 2017-09-01 2019-03-07 Magic Leap, Inc. Detailed eye shape model for robust biometric applications
US10609355B2 (en) * 2017-10-27 2020-03-31 Motorola Mobility Llc Dynamically adjusting sampling of a real-time depth map
US10911656B2 (en) 2017-11-21 2021-02-02 Microsoft Technology Licensing, Llc Optical isolation systems for displays
US11514325B2 (en) * 2018-03-21 2022-11-29 The Regents Of The University Of California Method and system for phase recovery and holographic image reconstruction using a neural network
US10636340B2 (en) 2018-04-16 2020-04-28 Facebook Technologies, Llc Display with gaze-adaptive resolution enhancement
US11321592B2 (en) * 2018-04-25 2022-05-03 Avigilon Corporation Method and system for tracking an object-of-interest without any required tracking tag theron
US10491885B1 (en) * 2018-06-13 2019-11-26 Luminar Technologies, Inc. Post-processing by lidar system guided by camera information
US10606349B1 (en) 2018-06-22 2020-03-31 Facebook Technologies, Llc Infrared transparent backlight device for eye tracking applications
CN109188711B (zh) 2018-09-17 2020-11-03 深圳奥比中光科技有限公司 屏下光学系统、衍射光学元件的设计方法及电子设备
US11589031B2 (en) 2018-09-26 2023-02-21 Google Llc Active stereo depth prediction based on coarse matching
US11301665B2 (en) 2019-02-20 2022-04-12 Novatek Microelectronics Corp. Fingerprint and proximity sensing apparatus and sensing process thereof

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018049201A1 (en) * 2016-09-09 2018-03-15 Google Llc Three-dimensional telepresence system

Also Published As

Publication number Publication date
US20200389575A1 (en) 2020-12-10
JP7564828B2 (ja) 2024-10-09
WO2020247195A1 (en) 2020-12-10
US11516374B2 (en) 2022-11-29
KR20220005600A (ko) 2022-01-13
CN113892254A (zh) 2022-01-04
KR102775935B1 (ko) 2025-03-04
JP2022536253A (ja) 2022-08-15

Similar Documents

Publication Publication Date Title
CN113892254B (zh) 显示器下方的图像传感器
AU2018247216B2 (en) Systems and methods for liveness analysis
US9058519B2 (en) System and method for passive live person verification using real-time eye reflection
US9934580B2 (en) Enhanced contrast for object detection and characterization by optical imaging based on differences between images
US20140028861A1 (en) Object detection and tracking
US9392196B2 (en) Object detection and tracking with reduced error due to background illumination
CN114402255B (zh) 相机的光源
US11908227B2 (en) Method and device for reference imaging and optical object recognition
KR101155992B1 (ko) 모바일폰을 이용한 카드의 비가시성 마크 검출 방법
US20240007759A1 (en) Video user interface and method for use in determining depth information relating to a scene
Samini Large scale audience interaction with a Kinect sensor
HK1235891A1 (en) Systems and methods for liveness analysis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant