CN107533761B - 图像处理装置和图像处理系统 - Google Patents

图像处理装置和图像处理系统 Download PDF

Info

Publication number
CN107533761B
CN107533761B CN201680023673.6A CN201680023673A CN107533761B CN 107533761 B CN107533761 B CN 107533761B CN 201680023673 A CN201680023673 A CN 201680023673A CN 107533761 B CN107533761 B CN 107533761B
Authority
CN
China
Prior art keywords
image
unit
image data
camera
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680023673.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN107533761A (zh
Inventor
大石刚士
山本一幸
佐藤修三
芦原隆之
村山淳
西田健
山田和弘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Semiconductor Solutions Corp
Original Assignee
Sony Semiconductor Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Semiconductor Solutions Corp filed Critical Sony Semiconductor Solutions Corp
Publication of CN107533761A publication Critical patent/CN107533761A/zh
Application granted granted Critical
Publication of CN107533761B publication Critical patent/CN107533761B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)
CN201680023673.6A 2015-04-27 2016-04-22 图像处理装置和图像处理系统 Active CN107533761B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2015-089983 2015-04-27
JP2015089983A JP6646361B2 (ja) 2015-04-27 2015-04-27 画像処理装置、撮像装置、画像処理方法およびプログラム
PCT/JP2016/002161 WO2016174858A1 (en) 2015-04-27 2016-04-22 Image processing device and image processing system

Publications (2)

Publication Number Publication Date
CN107533761A CN107533761A (zh) 2018-01-02
CN107533761B true CN107533761B (zh) 2021-11-12

Family

ID=56080434

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680023673.6A Active CN107533761B (zh) 2015-04-27 2016-04-22 图像处理装置和图像处理系统

Country Status (6)

Country Link
US (1) US11089289B2 (enExample)
EP (1) EP3289564A1 (enExample)
JP (1) JP6646361B2 (enExample)
KR (1) KR102657198B1 (enExample)
CN (1) CN107533761B (enExample)
WO (1) WO2016174858A1 (enExample)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6419118B2 (ja) * 2016-08-04 2018-11-07 キヤノン株式会社 画像表示システム
JP6645949B2 (ja) * 2016-11-01 2020-02-14 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、および情報処理方法
DE102016224774B3 (de) * 2016-12-13 2018-01-25 Audi Ag Verfahren zur Programmierung eines Messroboters und Programmiersystem
CA3053004C (en) * 2017-03-07 2020-09-22 8259402 Canada Inc. Method to control a virtual image in a display
JP7176520B2 (ja) 2017-08-08 2022-11-22 ソニーグループ株式会社 情報処理装置、情報処理方法及びプログラム
US10362296B2 (en) * 2017-08-17 2019-07-23 Microsoft Technology Licensing, Llc Localized depth map generation
US10437065B2 (en) * 2017-10-03 2019-10-08 Microsoft Technology Licensing, Llc IPD correction and reprojection for accurate mixed reality object placement
US20190265473A1 (en) * 2018-02-23 2019-08-29 Oculus Vr, Llc Apparatus, systems, and methods for enabling low-power communications via wearers' bodies
TW201947522A (zh) * 2018-05-08 2019-12-16 揚明光學股份有限公司 頭戴式電子裝置及其使用方法
JP7110738B2 (ja) * 2018-06-05 2022-08-02 大日本印刷株式会社 情報処理装置、プログラム及び情報処理システム
CN108965732B (zh) * 2018-08-22 2020-04-14 Oppo广东移动通信有限公司 图像处理方法、装置、计算机可读存储介质和电子设备
CN109040591B (zh) * 2018-08-22 2020-08-04 Oppo广东移动通信有限公司 图像处理方法、装置、计算机可读存储介质和电子设备
JP7400721B2 (ja) 2018-08-29 2023-12-19 ソニーグループ株式会社 情報処理装置、情報処理方法及びプログラム
CN109364478B (zh) 2018-09-07 2022-08-23 深圳市腾讯信息技术有限公司 信息同步方法、装置及存储介质
US11837145B2 (en) 2018-11-28 2023-12-05 Sony Semiconductor Solutions Corporation Display apparatus and display control apparatus
JP7418149B2 (ja) * 2018-11-29 2024-01-19 株式会社リコー 光学装置、網膜投影表示装置、頭部装着型表示装置、及び入力装置
CN109598718B (zh) * 2018-12-06 2020-12-04 安徽省华腾农业科技有限公司经开区分公司 设备更换需求分析机构
CN113196139B (zh) * 2018-12-20 2023-08-11 美国斯耐普公司 用于生成立体图像的具有双摄像头的柔性眼戴设备
US10621858B1 (en) 2019-02-06 2020-04-14 Toyota Research Institute, Inc. Systems and methods for improving situational awareness of a user
TWI669536B (zh) * 2019-03-05 2019-08-21 宏碁股份有限公司 頭戴裝置
WO2020195755A1 (ja) * 2019-03-26 2020-10-01 パナソニックＩｐマネジメント株式会社 測距撮像システム、測距撮像方法、及びプログラム
CN110225247B (zh) * 2019-05-29 2021-06-15 联想(北京)有限公司 一种图像处理方法及电子设备
WO2021044732A1 (ja) * 2019-09-06 2021-03-11 ソニー株式会社 情報処理装置、情報処理方法及び記憶媒体
CN110631603B (zh) * 2019-09-29 2022-06-14 阿波罗智联(北京)科技有限公司 车辆导航方法和装置
CN111062911B (zh) * 2019-11-15 2023-08-18 北京中科慧眼科技有限公司 基于路面信息的成像环境评价方法、装置、系统和存储介质
US10965931B1 (en) * 2019-12-06 2021-03-30 Snap Inc. Sensor misalignment compensation
JP2021182344A (ja) * 2020-05-20 2021-11-25 京セラ株式会社 視点検出装置および表示装置
CN111556305B (zh) * 2020-05-20 2022-04-15 京东方科技集团股份有限公司 图像处理方法、vr设备、终端、显示系统和计算机可读存储介质
CN111768433B (zh) * 2020-06-30 2024-05-24 杭州海康威视数字技术股份有限公司 一种移动目标追踪的实现方法、装置及电子设备
CN116057451A (zh) 2020-09-03 2023-05-02 三星电子株式会社 改变显示器的设置的方法及电子装置
KR20220036679A (ko) * 2020-09-16 2022-03-23 삼성전자주식회사 증강 현실 콘텐츠를 제공하는 전자 장치 및 그의 동작 방법
JP7591375B2 (ja) * 2020-09-18 2024-11-28 株式会社アマダ プレスブレーキ、画像出力装置及び画像出力方法
KR20230079411A (ko) 2020-09-30 2023-06-07 스냅 인코포레이티드 증강 현실 및 컴퓨터 비전 애플리케이션들을 위한 다목적 카메라들
KR20230079412A (ko) * 2020-09-30 2023-06-07 스냅 인코포레이티드 증강 현실 아이웨어에서 컴퓨터 비전 모드에 대한 저전력 카메라 파이프라인
JP7608141B2 (ja) * 2020-12-14 2025-01-06 京セラ株式会社 立体表示用コントローラ
US20240121370A1 (en) * 2022-09-30 2024-04-11 Samsung Electronics Co., Ltd. System and method for parallax correction for video see-through augmented reality
WO2025069699A1 (ja) * 2023-09-25 2025-04-03 ソニーセミコンダクタソリューションズ株式会社 光検出システム、および、光検出システムの制御方法

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5359675A (en) * 1990-07-26 1994-10-25 Ronald Siwoff Video spectacles
US5267331A (en) * 1990-07-26 1993-11-30 Ronald Siwoff Digitally enhanced imager for the visually impaired
JP3372096B2 (ja) * 1993-12-28 2003-01-27 株式会社東芝 画像情報アクセス装置
US6611618B1 (en) * 1997-11-13 2003-08-26 Schepens Eye Research Institute, Inc. Wide-band image enhancement
US7280704B2 (en) * 1997-11-13 2007-10-09 The Schepens Eye Research Institute, Inc. Wide-band image enhancement
JP3728160B2 (ja) * 1999-12-06 2005-12-21 キヤノン株式会社 奥行き画像計測装置及び方法、並びに複合現実感提示システム
US6591008B1 (en) * 2000-06-26 2003-07-08 Eastman Kodak Company Method and apparatus for displaying pictorial images to individuals who have impaired color and/or spatial vision
US6911995B2 (en) * 2001-08-17 2005-06-28 Mitsubishi Electric Research Labs, Inc. Computer vision depth segmentation using virtual surface
US20040136570A1 (en) * 2002-04-30 2004-07-15 Shimon Ullman Method and apparatus for image enhancement for the visually impaired
DE102006001075A1 (de) * 2006-01-09 2007-07-12 Carl Zeiss Ag Elektronische Sehhilfe und elektronisches Sehhilfeverfahren
CN101610421B (zh) 2008-06-17 2011-12-21 华为终端有限公司 视频通讯方法、装置及系统
WO2009152769A1 (zh) * 2008-06-17 2009-12-23 深圳华为通信技术有限公司 视频通讯方法、装置及系统
TWI392485B (zh) * 2009-12-03 2013-04-11 Univ Nat Yang Ming 一種具立體視覺之頭盔式弱視輔具裝置及系統
US8421851B2 (en) * 2010-01-04 2013-04-16 Sony Corporation Vision correction for high frame rate TVs with shutter glasses
WO2012051223A2 (en) * 2010-10-11 2012-04-19 The Regents Of The University Of California Telescopic contact lens
JP5348114B2 (ja) 2010-11-18 2013-11-20 日本電気株式会社 情報表示システム、装置、方法及びプログラム
KR20140066258A (ko) * 2011-09-26 2014-05-30 마이크로소프트 코포레이션 투시 근안 디스플레이에 대한 센서 입력에 기초한 비디오 디스플레이 수정
US8937646B1 (en) * 2011-10-05 2015-01-20 Amazon Technologies, Inc. Stereo imaging using disparate imaging devices
JP2013117608A (ja) * 2011-12-02 2013-06-13 Fujifilm Corp 撮像装置及び撮像装置の制御方法
JP5713885B2 (ja) * 2011-12-26 2015-05-07 キヤノン株式会社 画像処理装置及び画像処理方法、プログラム、並びに記憶媒体
JP2013162453A (ja) * 2012-02-08 2013-08-19 Nikon Corp 撮像装置
KR101362462B1 (ko) * 2012-07-16 2014-02-12 한양대학교 산학협력단 스테레오 카메라를 이용한 장애물 검출 장치 및 방법
US20150331486A1 (en) * 2012-12-26 2015-11-19 Sony Corporation Image processing device, image processing method and program
WO2014128750A1 (ja) * 2013-02-19 2014-08-28 株式会社ブリリアントサービス 入出力装置、入出力プログラム、および入出力方法
JP6214236B2 (ja) * 2013-03-05 2017-10-18 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
US9934451B2 (en) * 2013-06-25 2018-04-03 Microsoft Technology Licensing, Llc Stereoscopic object detection leveraging assumed distance
CN103796001B (zh) 2014-01-10 2015-07-29 深圳奥比中光科技有限公司 一种同步获取深度及色彩信息的方法及装置
KR102777120B1 (ko) 2015-04-19 2025-03-05 포토내이션 리미티드 Vr/ar 응용에서 심도 증강을 위한 다중-기선 카메라 어레이 시스템 아키텍처

Also Published As

Publication number Publication date
JP2016208380A (ja) 2016-12-08
WO2016174858A1 (en) 2016-11-03
US20180035097A1 (en) 2018-02-01
KR20170139521A (ko) 2017-12-19
EP3289564A1 (en) 2018-03-07
KR102657198B1 (ko) 2024-04-16
US11089289B2 (en) 2021-08-10
JP6646361B2 (ja) 2020-02-14
CN107533761A (zh) 2018-01-02

Similar Documents

Publication Publication Date Title
CN107533761B (zh) 图像处理装置和图像处理系统
US10783654B2 (en) Information processing apparatus, information processing method, and recording medium
US8704881B2 (en) Stereoscopic image display apparatus
US9541761B2 (en) Imaging apparatus and imaging method
US20170324899A1 (en) Image pickup apparatus, head-mounted display apparatus, information processing system and information processing method
US11603043B2 (en) Image processing apparatus, image processing method, and image processing system
CN103533340B (zh) 移动终端的裸眼3d播放方法和移动终端
US11987182B2 (en) Image processing apparatus, image processing method, and image processing system
US20130027517A1 (en) Method and apparatus for controlling and playing a 3d image
US11794667B2 (en) Image processing apparatus, image processing method, and image processing system
CN113641088B (zh) 用于深度传感的时间数字转换器
JP2015060071A (ja) 画像表示装置、画像表示方法、および画像表示プログラム
US9818033B2 (en) Monitoring method and apparatus using a camera
TWI794207B (zh) 攝像裝置、相機模組、攝像系統、及攝像裝置之控制方法
CN109791294B (zh) 用于运行具有数据眼镜的显示系统的方法和设备
TW201515890A (zh) 行車安全輔助系統和方法
US12407805B2 (en) Image capturing apparatus for capturing a plurality of eyeball images, image capturing method for image capturing apparatus, and storage medium
US11234090B2 (en) Using audio visual correspondence for sound source identification
JP2013118472A (ja) 画像処理装置、撮像装置及び画像処理プログラム
KR20250075931A (ko) 디스플레이 장치 및 이의 제어방법
US12067907B2 (en) Position information acquisition device, head-mounted display, and position information acquisition method
KR20250113193A (ko) Hud 고스트 이미지 측정 방법 및 장치
CN108995592B (zh) 汽车影像系统
US20230168522A1 (en) Eyewear with direction of sound arrival detection
JP2010206345A (ja) 模擬人目の成像撮影システム及びその方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant