CN107533761B - 图像处理装置和图像处理系统 - Google Patents

图像处理装置和图像处理系统 Download PDF

Info

Publication number
CN107533761B
CN107533761B CN201680023673.6A CN201680023673A CN107533761B CN 107533761 B CN107533761 B CN 107533761B CN 201680023673 A CN201680023673 A CN 201680023673A CN 107533761 B CN107533761 B CN 107533761B
Authority
CN
China
Prior art keywords
image
unit
image data
camera
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680023673.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN107533761A (zh
Inventor
大石刚士
山本一幸
佐藤修三
芦原隆之
村山淳
西田健
山田和弘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Semiconductor Solutions Corp
Original Assignee
Sony Semiconductor Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Semiconductor Solutions Corp filed Critical Sony Semiconductor Solutions Corp
Publication of CN107533761A publication Critical patent/CN107533761A/zh
Application granted granted Critical
Publication of CN107533761B publication Critical patent/CN107533761B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
CN201680023673.6A 2015-04-27 2016-04-22 图像处理装置和图像处理系统 Active CN107533761B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2015-089983 2015-04-27
JP2015089983A JP6646361B2 (ja) 2015-04-27 2015-04-27 画像処理装置、撮像装置、画像処理方法およびプログラム
PCT/JP2016/002161 WO2016174858A1 (en) 2015-04-27 2016-04-22 Image processing device and image processing system

Publications (2)

Publication Number Publication Date
CN107533761A CN107533761A (zh) 2018-01-02
CN107533761B true CN107533761B (zh) 2021-11-12

Family

ID=56080434

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680023673.6A Active CN107533761B (zh) 2015-04-27 2016-04-22 图像处理装置和图像处理系统

Country Status (6)

Country Link
US (1) US11089289B2 (enExample)
EP (1) EP3289564A1 (enExample)
JP (1) JP6646361B2 (enExample)
KR (1) KR102657198B1 (enExample)
CN (1) CN107533761B (enExample)
WO (1) WO2016174858A1 (enExample)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6419118B2 (ja) * 2016-08-04 2018-11-07 キヤノン株式会社 画像表示システム
JP6645949B2 (ja) * 2016-11-01 2020-02-14 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、および情報処理方法
DE102016224774B3 (de) * 2016-12-13 2018-01-25 Audi Ag Verfahren zur Programmierung eines Messroboters und Programmiersystem
JP7227165B2 (ja) * 2017-03-07 2023-02-21 ８２５９４０２ カナダ インコーポレイテッド ディスプレイにおける虚像を制御する方法
EP3667622B1 (en) 2017-08-08 2023-08-23 Sony Group Corporation Information processing device, information processing method, and program
US10362296B2 (en) 2017-08-17 2019-07-23 Microsoft Technology Licensing, Llc Localized depth map generation
US10437065B2 (en) * 2017-10-03 2019-10-08 Microsoft Technology Licensing, Llc IPD correction and reprojection for accurate mixed reality object placement
US20190265473A1 (en) * 2018-02-23 2019-08-29 Oculus Vr, Llc Apparatus, systems, and methods for enabling low-power communications via wearers' bodies
TW201947522A (zh) * 2018-05-08 2019-12-16 揚明光學股份有限公司 頭戴式電子裝置及其使用方法
JP7110738B2 (ja) * 2018-06-05 2022-08-02 大日本印刷株式会社 情報処理装置、プログラム及び情報処理システム
CN109040591B (zh) * 2018-08-22 2020-08-04 Oppo广东移动通信有限公司 图像处理方法、装置、计算机可读存储介质和电子设备
CN108965732B (zh) * 2018-08-22 2020-04-14 Oppo广东移动通信有限公司 图像处理方法、装置、计算机可读存储介质和电子设备
US11726320B2 (en) 2018-08-29 2023-08-15 Sony Corporation Information processing apparatus, information processing method, and program
CN109364478B (zh) 2018-09-07 2022-08-23 深圳市腾讯信息技术有限公司 信息同步方法、装置及存储介质
US11837145B2 (en) 2018-11-28 2023-12-05 Sony Semiconductor Solutions Corporation Display apparatus and display control apparatus
JP7418149B2 (ja) * 2018-11-29 2024-01-19 株式会社リコー 光学装置、網膜投影表示装置、頭部装着型表示装置、及び入力装置
CN109598718B (zh) * 2018-12-06 2020-12-04 安徽省华腾农业科技有限公司经开区分公司 设备更换需求分析机构
EP3899642A1 (en) 2018-12-20 2021-10-27 Snap Inc. Flexible eyewear device with dual cameras for generating stereoscopic images
US10621858B1 (en) 2019-02-06 2020-04-14 Toyota Research Institute, Inc. Systems and methods for improving situational awareness of a user
TWI669536B (zh) * 2019-03-05 2019-08-21 宏碁股份有限公司 頭戴裝置
WO2020195755A1 (ja) * 2019-03-26 2020-10-01 パナソニックＩｐマネジメント株式会社 測距撮像システム、測距撮像方法、及びプログラム
CN110225247B (zh) * 2019-05-29 2021-06-15 联想(北京)有限公司 一种图像处理方法及电子设备
WO2021044732A1 (ja) * 2019-09-06 2021-03-11 ソニー株式会社 情報処理装置、情報処理方法及び記憶媒体
CN110631603B (zh) * 2019-09-29 2022-06-14 阿波罗智联(北京)科技有限公司 车辆导航方法和装置
CN111062911B (zh) * 2019-11-15 2023-08-18 北京中科慧眼科技有限公司 基于路面信息的成像环境评价方法、装置、系统和存储介质
US10965931B1 (en) 2019-12-06 2021-03-30 Snap Inc. Sensor misalignment compensation
JP2021182344A (ja) * 2020-05-20 2021-11-25 京セラ株式会社 視点検出装置および表示装置
CN111556305B (zh) * 2020-05-20 2022-04-15 京东方科技集团股份有限公司 图像处理方法、vr设备、终端、显示系统和计算机可读存储介质
CN111768433B (zh) * 2020-06-30 2024-05-24 杭州海康威视数字技术股份有限公司 一种移动目标追踪的实现方法、装置及电子设备
KR20220030774A (ko) 2020-09-03 2022-03-11 삼성전자주식회사 전자 장치 및 사용자의 시선 정보 획득 방법
EP4167019A4 (en) * 2020-09-03 2023-12-06 Samsung Electronics Co., Ltd. METHOD FOR MODIFYING DISPLAY PARAMETERS AND ELECTRONIC DEVICE
KR20220036679A (ko) * 2020-09-16 2022-03-23 삼성전자주식회사 증강 현실 콘텐츠를 제공하는 전자 장치 및 그의 동작 방법
JP7591375B2 (ja) * 2020-09-18 2024-11-28 株式会社アマダ プレスブレーキ、画像出力装置及び画像出力方法
WO2022072097A1 (en) 2020-09-30 2022-04-07 Snap Inc. Multi-purpose cameras for augmented reality and computer vision applications
WO2022072261A1 (en) * 2020-09-30 2022-04-07 Snap Inc. Low power camera pipeline for computer vision mode in augmented reality eyewear
JP7608141B2 (ja) * 2020-12-14 2025-01-06 京セラ株式会社 立体表示用コントローラ
US20240121370A1 (en) * 2022-09-30 2024-04-11 Samsung Electronics Co., Ltd. System and method for parallax correction for video see-through augmented reality
WO2025069699A1 (ja) * 2023-09-25 2025-04-03 ソニーセミコンダクタソリューションズ株式会社 光検出システム、および、光検出システムの制御方法

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5359675A (en) * 1990-07-26 1994-10-25 Ronald Siwoff Video spectacles
US5267331A (en) * 1990-07-26 1993-11-30 Ronald Siwoff Digitally enhanced imager for the visually impaired
JP3372096B2 (ja) * 1993-12-28 2003-01-27 株式会社東芝 画像情報アクセス装置
US7280704B2 (en) * 1997-11-13 2007-10-09 The Schepens Eye Research Institute, Inc. Wide-band image enhancement
US6611618B1 (en) * 1997-11-13 2003-08-26 Schepens Eye Research Institute, Inc. Wide-band image enhancement
JP3728160B2 (ja) * 1999-12-06 2005-12-21 キヤノン株式会社 奥行き画像計測装置及び方法、並びに複合現実感提示システム
US6591008B1 (en) * 2000-06-26 2003-07-08 Eastman Kodak Company Method and apparatus for displaying pictorial images to individuals who have impaired color and/or spatial vision
US6911995B2 (en) * 2001-08-17 2005-06-28 Mitsubishi Electric Research Labs, Inc. Computer vision depth segmentation using virtual surface
US20040136570A1 (en) * 2002-04-30 2004-07-15 Shimon Ullman Method and apparatus for image enhancement for the visually impaired
DE102006001075A1 (de) * 2006-01-09 2007-07-12 Carl Zeiss Ag Elektronische Sehhilfe und elektronisches Sehhilfeverfahren
EP2299726B1 (en) * 2008-06-17 2012-07-18 Huawei Device Co., Ltd. Video communication method, apparatus and system
CN101610421B (zh) * 2008-06-17 2011-12-21 华为终端有限公司 视频通讯方法、装置及系统
TWI392485B (zh) * 2009-12-03 2013-04-11 Univ Nat Yang Ming 一種具立體視覺之頭盔式弱視輔具裝置及系統
US8421851B2 (en) * 2010-01-04 2013-04-16 Sony Corporation Vision correction for high frame rate TVs with shutter glasses
WO2012051223A2 (en) * 2010-10-11 2012-04-19 The Regents Of The University Of California Telescopic contact lens
JP5348114B2 (ja) 2010-11-18 2013-11-20 日本電気株式会社 情報表示システム、装置、方法及びプログラム
CN103946732B (zh) * 2011-09-26 2019-06-14 微软技术许可有限责任公司 基于对透视、近眼显示器的传感器输入的视频显示修改
US8937646B1 (en) * 2011-10-05 2015-01-20 Amazon Technologies, Inc. Stereo imaging using disparate imaging devices
JP2013117608A (ja) * 2011-12-02 2013-06-13 Fujifilm Corp 撮像装置及び撮像装置の制御方法
JP5713885B2 (ja) * 2011-12-26 2015-05-07 キヤノン株式会社 画像処理装置及び画像処理方法、プログラム、並びに記憶媒体
JP2013162453A (ja) * 2012-02-08 2013-08-19 Nikon Corp 撮像装置
KR101362462B1 (ko) * 2012-07-16 2014-02-12 한양대학교 산학협력단 스테레오 카메라를 이용한 장애물 검출 장치 및 방법
US20150331486A1 (en) * 2012-12-26 2015-11-19 Sony Corporation Image processing device, image processing method and program
WO2014128750A1 (ja) * 2013-02-19 2014-08-28 株式会社ブリリアントサービス 入出力装置、入出力プログラム、および入出力方法
JP6214236B2 (ja) * 2013-03-05 2017-10-18 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
US9934451B2 (en) * 2013-06-25 2018-04-03 Microsoft Technology Licensing, Llc Stereoscopic object detection leveraging assumed distance
CN103796001B (zh) * 2014-01-10 2015-07-29 深圳奥比中光科技有限公司 一种同步获取深度及色彩信息的方法及装置
CN108307675B (zh) 2015-04-19 2020-12-25 快图有限公司 用于vr/ar应用中的深度增强的多基线相机阵列系统架构

Also Published As

Publication number Publication date
US11089289B2 (en) 2021-08-10
KR102657198B1 (ko) 2024-04-16
EP3289564A1 (en) 2018-03-07
US20180035097A1 (en) 2018-02-01
KR20170139521A (ko) 2017-12-19
JP6646361B2 (ja) 2020-02-14
CN107533761A (zh) 2018-01-02
JP2016208380A (ja) 2016-12-08
WO2016174858A1 (en) 2016-11-03

Similar Documents

Publication Publication Date Title
CN107533761B (zh) 图像处理装置和图像处理系统
US10783654B2 (en) Information processing apparatus, information processing method, and recording medium
US8704881B2 (en) Stereoscopic image display apparatus
US20170324899A1 (en) Image pickup apparatus, head-mounted display apparatus, information processing system and information processing method
US20170070730A1 (en) Imaging apparatus and imaging method
US11603043B2 (en) Image processing apparatus, image processing method, and image processing system
CN103533340B (zh) 移动终端的裸眼3d播放方法和移动终端
US20130027517A1 (en) Method and apparatus for controlling and playing a 3d image
US11987182B2 (en) Image processing apparatus, image processing method, and image processing system
US11383656B2 (en) Image processing apparatus, image processing method, and image processing system
CN113641088B (zh) 用于深度传感的时间数字转换器
JP2015060071A (ja) 画像表示装置、画像表示方法、および画像表示プログラム
US9818033B2 (en) Monitoring method and apparatus using a camera
CN109791294B (zh) 用于运行具有数据眼镜的显示系统的方法和设备
WO2018179624A1 (ja) 撮像装置、撮像システム、および、撮像装置の制御方法
TW201515890A (zh) 行車安全輔助系統和方法
US12407805B2 (en) Image capturing apparatus for capturing a plurality of eyeball images, image capturing method for image capturing apparatus, and storage medium
US11234090B2 (en) Using audio visual correspondence for sound source identification
KR20250075931A (ko) 디스플레이 장치 및 이의 제어방법
US20260010055A1 (en) Imaging method, learning method, learning data generating device, and data structure
US12067907B2 (en) Position information acquisition device, head-mounted display, and position information acquisition method
KR20250113193A (ko) Hud 고스트 이미지 측정 방법 및 장치
CN108995592B (zh) 汽车影像系统
US20230168522A1 (en) Eyewear with direction of sound arrival detection
CN117275376A (zh) 用于车载平视显示的重影消除方法、以及相关设备和芯片

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant