JP5260705B2 - 3次元拡張現実提供装置 - Google Patents
3次元拡張現実提供装置 Download PDFInfo
- Publication number
- JP5260705B2 JP5260705B2 JP2011139514A JP2011139514A JP5260705B2 JP 5260705 B2 JP5260705 B2 JP 5260705B2 JP 2011139514 A JP2011139514 A JP 2011139514A JP 2011139514 A JP2011139514 A JP 2011139514A JP 5260705 B2 JP5260705 B2 JP 5260705B2
- Authority
- JP
- Japan
- Prior art keywords
- augmented reality
- video
- image
- camera
- reality data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title claims description 143
- 230000001133 acceleration Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 30
- 238000001514 detection method Methods 0.000 description 10
- 238000013500 data storage Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 5
- 230000002194 synthesizing effect Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 235000008331 Pinus X rigitaeda Nutrition 0.000 description 2
- 235000011613 Pinus brutia Nutrition 0.000 description 2
- 241000018646 Pinus brutia Species 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/593—Depth or shape recovery from multiple images from stereo images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Description
関する。
z=(B/d)×F・・・(1)
Claims (5)
- 客体に関する第1映像を獲得する第1カメラと、前記客体に関する前記第1映像と相違する第2映像を獲得する第2カメラとを含む映像獲得部と、
前記客体が第1客体と第2客体とを含む場合に、前記第1映像および前記第2映像を用いて前記第1客体までの距離情報を獲得し、獲得した前記距離情報を用いて前記第1客体の3次元位置情報を算出し、前記第1客体に対応する拡張現実データを前記3次元位置情報に応じて変換し、前記第2客体に対応する拡張現実データを前記第1客体より近いか遠いかの相対的関係に応じて変換し、前記第1客体および前記第2客体に対応する前記拡張現実データと前記第1映像と前記第2映像とを用いて、前記第1客体に対応する前記拡張現実データと前記第2客体に対応する前記拡張現実データとの3次元映像での前後関係が前記相対的関係となるように、3次元拡張現実イメージを生成する映像処理部と、
を含むことを特徴とする3次元拡張現実提供装置。 - 前記映像処理部は、
前記3次元位置情報に基づいて、前記第1映像と合成される第1拡張現実データと前記第2映像と合成される第2拡張現実データとをそれぞれ生成して、生成された前記第1拡張現実データと前記第1映像を合成して、生成された前記第2拡張現実データと前記第2映像を合成した後、前記3次元拡張現実イメージを生成することを特徴とする請求項1に記載の3次元拡張現実提供装置。 - GPSセンサ、加速度センサおよび地磁気センサのうち少なくとも一つを含むセンサ部と、
を含むことを特徴とする請求項1に記載の3次元拡張現実提供装置。 - 前記映像処理部は、
前記センサ部のセンシング情報を用いて、前記獲得された映像の中から関心領域を指定して、前記関心領域により前記客体を検出することを特徴とする請求項3に記載の3次元拡張現実提供装置。 - 前記拡張現実イメージを3次元的に表示する映像表示部と、
を含むことを特徴とする請求項1に記載の3次元拡張現実提供装置。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020100063053A KR101295714B1 (ko) | 2010-06-30 | 2010-06-30 | 3차원 증강 현실 제공 장치 및 방법 |
KR10-2010-0063053 | 2010-06-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2012014690A JP2012014690A (ja) | 2012-01-19 |
JP5260705B2 true JP5260705B2 (ja) | 2013-08-14 |
Family
ID=44799575
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2011139514A Active JP5260705B2 (ja) | 2010-06-30 | 2011-06-23 | 3次元拡張現実提供装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20120001901A1 (ja) |
EP (1) | EP2402906A3 (ja) |
JP (1) | JP5260705B2 (ja) |
KR (1) | KR101295714B1 (ja) |
CN (1) | CN102395036A (ja) |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9122053B2 (en) | 2010-10-15 | 2015-09-01 | Microsoft Technology Licensing, Llc | Realistic occlusion for a head mounted augmented reality display |
US9606992B2 (en) * | 2011-09-30 | 2017-03-28 | Microsoft Technology Licensing, Llc | Personal audio/visual apparatus providing resource management |
KR101874895B1 (ko) * | 2012-01-12 | 2018-07-06 | 삼성전자 주식회사 | 증강 현실 제공 방법 및 이를 지원하는 단말기 |
US9093012B2 (en) | 2012-02-29 | 2015-07-28 | Lenovo (Beijing) Co., Ltd. | Operation mode switching method and electronic device |
CN103472909B (zh) * | 2012-04-10 | 2017-04-12 | 微软技术许可有限责任公司 | 用于头戴式、增强现实显示器的逼真遮挡 |
US9501831B2 (en) * | 2012-10-02 | 2016-11-22 | Google Inc. | Identification of relative distance of objects in images |
TWI571827B (zh) * | 2012-11-13 | 2017-02-21 | 財團法人資訊工業策進會 | 決定3d物件影像在3d環境影像中深度的電子裝置及其方法 |
CN103873840B (zh) | 2012-12-12 | 2018-08-31 | 联想(北京)有限公司 | 显示方法及显示设备 |
US9342929B2 (en) * | 2013-01-22 | 2016-05-17 | Microsoft Technology Licensing, Llc | Mixed reality experience sharing |
CN104062758B (zh) * | 2013-03-19 | 2017-02-08 | 联想(北京)有限公司 | 图像显示的方法和显示设备 |
KR102197964B1 (ko) * | 2014-01-29 | 2021-01-04 | 엘지전자 주식회사 | 포터블 디바이스 및 그 제어 방법 |
CN103914869B (zh) * | 2014-02-26 | 2017-02-22 | 浙江工业大学 | 支持骨架个性化编辑的轻量化三维树木模型构建方法 |
EP3138284A4 (en) * | 2014-04-30 | 2017-11-29 | Aurasma Limited | Augmented reality without a physical trigger |
KR101646503B1 (ko) * | 2014-12-17 | 2016-08-09 | 경북대학교 산학협력단 | 시각장애인을 위한 3차원 장애물 안내장치와 이를 이용한 주위 정보 안내시스템 및 그 방법 |
CN105872526B (zh) * | 2015-01-21 | 2017-10-31 | 成都理想境界科技有限公司 | 双目ar头戴显示设备及其信息显示方法 |
KR101649163B1 (ko) * | 2015-06-29 | 2016-08-18 | 한국원자력연구원 | 핵연료교환기 비상구동 이동로봇 영상 가이드 시스템 |
CN105491365A (zh) * | 2015-11-25 | 2016-04-13 | 罗军 | 基于移动终端的图像处理方法、装置及系统 |
CN105812680A (zh) * | 2016-03-31 | 2016-07-27 | 联想(北京)有限公司 | 图像处理方法及电子设备 |
KR101837474B1 (ko) | 2016-09-23 | 2018-04-19 | 주식회사 코젠 | 터널 자동제어시스템에 적용되는 3d 영상시스템 |
US11488369B2 (en) | 2017-02-07 | 2022-11-01 | Teledyne Flir Detection, Inc. | Systems and methods for identifying threats and locations, systems and method for augmenting real-time displays demonstrating the threat location, and systems and methods for responding to threats |
GB2607199B (en) * | 2017-02-07 | 2023-06-14 | Flir Detection Inc | Systems and methods for identifying threats and locations,systems and method for augmenting real-time displays demonstrating the threat location and systems |
US10979685B1 (en) | 2017-04-28 | 2021-04-13 | Apple Inc. | Focusing for virtual and augmented reality systems |
WO2018200993A1 (en) | 2017-04-28 | 2018-11-01 | Zermatt Technologies Llc | Video pipeline |
US10861142B2 (en) | 2017-07-21 | 2020-12-08 | Apple Inc. | Gaze direction-based adaptive pre-filtering of video data |
US11009949B1 (en) | 2017-08-08 | 2021-05-18 | Apple Inc. | Segmented force sensors for wearable devices |
KR102031870B1 (ko) * | 2017-08-30 | 2019-10-16 | 주식회사 카이비전 | 가상 이미지 영상동기화를 위한 증강현실글래스 |
CN109688399A (zh) * | 2017-10-18 | 2019-04-26 | 深圳市掌网科技股份有限公司 | 一种基于增强现实的立体图像显示方法和系统 |
US11087527B2 (en) * | 2017-12-01 | 2021-08-10 | Koninklijke Kpn N.V. | Selecting an omnidirectional image for display |
US11527044B2 (en) * | 2018-06-27 | 2022-12-13 | Samsung Electronics Co., Ltd. | System and method for augmented reality |
KR102103991B1 (ko) * | 2018-08-23 | 2020-04-23 | 주식회사 버넥트 | 혼합현실 기반의 접이식 표시 시스템 |
US10733800B2 (en) * | 2018-09-17 | 2020-08-04 | Facebook Technologies, Llc | Reconstruction of essential visual cues in mixed reality applications |
KR101985711B1 (ko) * | 2019-03-13 | 2019-06-04 | (주)정도기술 | 증강현실 cctv 시스템 및 그 제어방법 |
KR102288528B1 (ko) * | 2019-11-14 | 2021-08-10 | 한국광기술원 | 증강현실 영상 생성장치 및 방법 |
KR102338984B1 (ko) * | 2020-04-20 | 2021-12-14 | 주식회사 스쿱 | 인공지능을 활용한 3d 모형 증강현실 서비스 제공 시스템 및 그 방법 |
KR102539838B1 (ko) * | 2021-10-18 | 2023-06-08 | 서울과학기술대학교 산학협력단 | 증강 현실 기반의 건설 현장 안전 점검 장치 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6064749A (en) * | 1996-08-02 | 2000-05-16 | Hirota; Gentaro | Hybrid tracking for augmented reality using both camera motion detection and landmark tracking |
JP2000102036A (ja) * | 1998-09-22 | 2000-04-07 | Mr System Kenkyusho:Kk | 複合現実感提示システム、複合現実感提示方法、マン・マシーンインタフェース装置、およびマン・マシーンインタフェース方法 |
JP4364002B2 (ja) * | 2004-02-06 | 2009-11-11 | オリンパス株式会社 | 頭部装着型カメラ及び頭部装着型カメラによる撮影方法 |
KR101309176B1 (ko) * | 2006-01-18 | 2013-09-23 | 삼성전자주식회사 | 증강 현실 장치 및 방법 |
CN101772305B (zh) | 2007-08-09 | 2013-10-30 | 罗蒂株式会社 | 含液体芯的口香糖组合物 |
KR100922544B1 (ko) | 2007-12-17 | 2009-10-21 | 한국전자통신연구원 | 실시간 카메라 트래킹을 이용한 실사 영상 합성 시스템 및 그 방법 |
US8314832B2 (en) * | 2009-04-01 | 2012-11-20 | Microsoft Corporation | Systems and methods for generating stereoscopic images |
-
2010
- 2010-06-30 KR KR1020100063053A patent/KR101295714B1/ko active IP Right Grant
-
2011
- 2011-02-15 US US13/028,118 patent/US20120001901A1/en not_active Abandoned
- 2011-06-22 EP EP20110170889 patent/EP2402906A3/en not_active Withdrawn
- 2011-06-23 JP JP2011139514A patent/JP5260705B2/ja active Active
- 2011-06-24 CN CN2011101756807A patent/CN102395036A/zh active Pending
Also Published As
Publication number | Publication date |
---|---|
EP2402906A3 (en) | 2015-04-22 |
EP2402906A2 (en) | 2012-01-04 |
US20120001901A1 (en) | 2012-01-05 |
CN102395036A (zh) | 2012-03-28 |
JP2012014690A (ja) | 2012-01-19 |
KR20120002261A (ko) | 2012-01-05 |
KR101295714B1 (ko) | 2013-08-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5260705B2 (ja) | 3次元拡張現実提供装置 | |
CN109615703B (zh) | 增强现实的图像展示方法、装置及设备 | |
KR102214827B1 (ko) | 증강 현실 제공 장치 및 방법 | |
US9071827B1 (en) | Method and system for automatic 3-D image creation | |
KR20160140452A (ko) | 이미지 기반의 라이트 필드를 사용자의 디바이스 상에 표시하기 위한 방법 및 장치, 및 대응하는 컴퓨터 프로그램 제품 | |
CN104641633B (zh) | 用于组合来自多个深度相机的数据的系统和方法 | |
KR101944911B1 (ko) | 영상 처리 방법 및 영상 처리 장치 | |
JP6406853B2 (ja) | 光フィールド映像を生成する方法及び装置 | |
JP2013171523A (ja) | Ar画像処理装置及び方法 | |
JP2016537901A (ja) | ライトフィールド処理方法 | |
JP6680207B2 (ja) | 視線計測システム、視線計測方法、及びプログラム | |
US20120127203A1 (en) | Mixed reality display | |
CN111108742A (zh) | 信息处理装置、信息处理方法、程序以及可互换透镜 | |
US20120127302A1 (en) | Mixed reality display | |
KR20180120456A (ko) | 파노라마 영상을 기반으로 가상현실 콘텐츠를 제공하는 장치 및 그 방법 | |
JP6388532B2 (ja) | 画像提供システムおよび画像提供方法 | |
JP2012146305A (ja) | ウィンドウ状の拡張現実を提供する装置および方法 | |
CN104463958A (zh) | 基于视差图融合的三维超分辨率方法 | |
JP2011205385A (ja) | 立体映像制御装置および立体映像制御方法 | |
CN112085777A (zh) | 六自由度vr眼镜 | |
JP5689693B2 (ja) | 描画処理装置 | |
JP7336871B2 (ja) | 全天周映像処理装置及びプログラム | |
JP6292785B2 (ja) | 画像処理装置、画像処理方法およびプログラム | |
JP2011048545A (ja) | 画像合成装置及びプログラム | |
KR102151250B1 (ko) | 객체 좌표를 도출하는 장치 및 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20111027 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20121011 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20121023 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20130123 |
|
A602 | Written permission of extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A602 Effective date: 20130128 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20130221 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20130326 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20130425 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20160502 Year of fee payment: 3 |
|
R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 Ref document number: 5260705 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313111 |
|
S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |